[2025-10-23T17:00:01.199441] [INFO ] [MAIN ] Using last completed trading day: 2025-10-23 [2025-10-23T19:30:54.571194] [INFO ] [MAIN ] Using last completed trading day: 2025-10-23 [2025-10-23T19:31:49.647420] [INFO ] [MAIN ] Using last completed trading day: 2025-10-23 [2025-10-23T19:32:08.405284] [INFO ] [MAIN ] Using last completed trading day: 2025-10-23 [2025-10-23T19:32:33.387277] [INFO ] [MAIN ] Using last completed trading day: 2025-10-23 [2025-10-23T19:32:33.570381] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-23T19:32:33.570573] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-23T19:32:33.577176] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-23T19:32:33.578352] [WARN ] [STATE ] State set to: RUNNING [2025-10-23T19:32:33.578445] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-23T19:32:33.578539] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-23T19:32:33.578753] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-23T19:32:33.578838] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-23T19:32:34.929491] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-23T19:32:34.929787] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-23T19:32:34.930041] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-23T19:32:34.931136] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-23T19:32:34.931309] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-23T19:32:34.931383] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-23T19:32:34.931505] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-23T19:32:34.931581] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-23T19:32:34.931677] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-23T19:32:34.932073] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-23T19:32:34.932140] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-23T19:32:34.932319] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-23T19:32:34.932385] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-23T19:32:34.932429] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-23T19:32:34.932469] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-23T19:32:34.958180] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-23T19:32:34.984309] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-23T19:32:34.984401] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-23T19:32:34.984473] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-23T19:32:34.984542] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-23T19:32:34.984669] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-23T19:32:34.985094] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-23T19:32:34.985166] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-23T19:32:34.985236] [INFO ] [MAIN ] Starting incremental update for 2367 symbols. [2025-10-23T19:32:34.985302] [INFO ] [MAIN ] Running in parallel mode [2025-10-23T19:32:34.985501] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2367 symbols [2025-10-23T19:32:35.675840] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:35.652144] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:35.726558] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:35.731114] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:35.733231] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-23T19:32:35.734221] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-23T19:32:35.735227] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-23T19:32:35.735326] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-23T19:32:35.735431] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-23T19:32:35.735520] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-23T19:32:35.988966] [DEBUG] [LOCAL ] AAMI: Loaded 24441 existing records from primary storage. [2025-10-23T19:32:36.038395] [INFO ] [MAIN ] AAMI: Loaded 24441 existing records. [2025-10-23T19:32:36.144243] [DEBUG] [LOCAL ] A: Loaded 50664 existing records from primary storage. [2025-10-23T19:32:36.182429] [INFO ] [MAIN ] A: Loaded 50664 existing records. [2025-10-23T19:32:36.199271] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-23T19:32:36.246003] [INFO ] [MAIN ] AA: Loaded 53622 existing records. [2025-10-23T19:32:36.400686] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:36.482824] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-23T19:32:36.627732] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:32:36.757460] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-23T19:32:36.766989] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:32:36.793038] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-23T19:32:36.792809] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:32:36.793392] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-23T19:32:36.793516] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-23T19:32:36.793817] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-23T19:32:36.793757] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-23T19:32:36.793876] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-23T19:32:36.794214] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-23T19:32:36.799569] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-23T19:32:36.799524] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-23T19:32:36.858444] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-23T19:32:36.882378] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-23T19:32:37.116181] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-23T19:32:37.210632] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-23T19:32:37.770207] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:37.802977] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T19:32:37.812960] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-23T19:32:37.794460] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-23T19:32:37.853901] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:37.907445] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-23T19:32:37.930388] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:37.930853] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-23T19:32:38.297635] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T19:32:38.298665] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-23T19:32:38.652713] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-23T19:32:38.653822] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-23T19:32:38.939702] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-23T19:32:38.940730] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-23T19:32:38.981283] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T19:32:38.985176] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-23T19:32:39.196131] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-23T19:32:39.197120] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-23T19:32:39.500550] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-23T19:32:39.501457] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-23T19:32:39.707388] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T19:32:39.711303] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-23T19:32:39.913331] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-23T19:32:39.914469] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-23T19:32:39.955517] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-23T19:32:39.966378] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-23T19:32:40.054222] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-23T19:32:40.063889] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-23T19:32:40.226495] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-23T19:32:40.227429] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-23T19:32:40.748697] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-23T19:32:40.749677] [INFO ] [REMOTE ] AAM: Full fetch complete (913 records). [2025-10-23T19:32:40.749790] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-23T19:32:40.845028] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T19:32:40.877751] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-23T19:32:40.957475] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-23T19:32:40.957685] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-23T19:32:40.957760] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-23T19:32:40.957840] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-23T19:32:40.957933] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-23T19:32:40.957983] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-23T19:32:40.958093] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-23T19:32:40.958200] [INFO ] [MAIN ] Update Progress: 1/2367 symbols completed. AAM took 5.9s. Estimated remaining: 3h 55m 32s. Rate: 10.0 symbols/min [2025-10-23T19:32:41.138519] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:41.190317] [DEBUG] [LOCAL ] AAP: Loaded 51734 existing records from primary storage. [2025-10-23T19:32:41.190700] [INFO ] [MAIN ] AAP: Loaded 51734 existing records. [2025-10-23T19:32:41.371118] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:32:41.371492] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-23T19:32:41.371580] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-23T19:32:41.372967] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-23T19:32:41.373049] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-23T19:32:41.592004] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T19:32:41.725616] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-23T19:32:41.812022] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:41.812534] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-23T19:32:41.849455] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-23T19:32:41.859920] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-23T19:32:42.182168] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T19:32:42.188590] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-23T19:32:43.356589] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T19:32:43.362224] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-23T19:32:43.538811] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T19:32:43.548826] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-23T19:32:43.594491] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T19:32:43.605872] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-23T19:32:43.759804] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T19:32:43.770885] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-23T19:32:44.412979] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T19:32:44.418098] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-23T19:32:45.256772] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T19:32:45.266594] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-23T19:32:45.379084] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T19:32:45.389962] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-23T19:32:45.496737] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T19:32:45.508754] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-23T19:32:45.593595] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-23T19:32:45.599563] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-23T19:32:46.726047] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T19:32:46.731355] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-23T19:32:46.828721] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T19:32:46.839694] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-23T19:32:47.153279] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T19:32:47.164837] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-23T19:32:47.497998] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T19:32:47.509828] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-23T19:32:47.996255] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T19:32:48.002998] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-23T19:32:48.439824] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T19:32:48.451326] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-23T19:32:48.808131] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T19:32:48.818261] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-23T19:32:48.860674] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T19:32:48.864705] [INFO ] [REMOTE ] AAMI: Full fetch complete (33079 records). [2025-10-23T19:32:48.864813] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-23T19:32:49.230760] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-23T19:32:49.230884] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-23T19:32:49.231482] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-23T19:32:49.231606] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-23T19:32:49.232205] [FATAL] [LOCAL ] AAMI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:32:49.232290] [FATAL] [MAIN ] AAMI: Failed to save primary data. [2025-10-23T19:32:49.232370] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:32:49.232454] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-23T19:32:49.232547] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-23T19:32:49.232665] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-23T19:32:49.232882] [DEBUG] [LOCAL ] AAMI: Deleted derivative data file. [2025-10-23T19:32:49.233200] [INFO ] [MAIN ] Update Progress: 2/2367 symbols completed. AAMI took 14.2s. Estimated remaining: 4h 40m 48s. Rate: 8.4 symbols/min [2025-10-23T19:32:49.411732] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:49.441019] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T19:32:49.452833] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-23T19:32:49.479438] [DEBUG] [LOCAL ] AAT: Loaded 30227 existing records from primary storage. [2025-10-23T19:32:49.479780] [INFO ] [MAIN ] AAT: Loaded 30227 existing records. [2025-10-23T19:32:49.654334] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:32:49.654556] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-23T19:32:49.654632] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-23T19:32:49.654885] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-23T19:32:49.654957] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-23T19:32:50.030920] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:50.031510] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-23T19:32:50.140064] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:32:50.154044] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-23T19:32:50.313351] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T19:32:50.326891] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-23T19:32:51.107321] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T19:32:51.112872] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-23T19:32:51.234812] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T19:32:51.247484] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-23T19:32:51.620979] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T19:32:51.631772] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-23T19:32:51.936631] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T19:32:51.947298] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-23T19:32:52.288399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T19:32:52.294255] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-23T19:32:52.760701] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T19:32:52.773537] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-23T19:32:53.423391] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:32:53.434691] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-23T19:32:53.611740] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T19:32:53.618688] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-23T19:32:53.680971] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T19:32:53.692607] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-23T19:32:54.329868] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T19:32:54.341539] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-23T19:32:54.869371] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T19:32:54.879080] [INFO ] [REMOTE ] A: Full fetch complete (73575 records). [2025-10-23T19:32:54.879267] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-23T19:32:55.264072] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T19:32:55.313837] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-23T19:32:55.321588] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-23T19:32:55.321941] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-23T19:32:55.323699] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-23T19:32:55.323834] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-23T19:32:55.326093] [FATAL] [LOCAL ] A: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:32:55.326248] [FATAL] [MAIN ] A: Failed to save primary data. [2025-10-23T19:32:55.326332] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:32:55.326417] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-23T19:32:55.326556] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-23T19:32:55.326692] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-23T19:32:55.326869] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-10-23T19:32:55.327374] [INFO ] [MAIN ] Update Progress: 3/2367 symbols completed. A took 20.3s. Estimated remaining: 4h 27m 9s. Rate: 8.8 symbols/min [2025-10-23T19:32:55.520742] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T19:32:55.555429] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:55.555982] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-23T19:32:55.556241] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-23T19:32:55.556364] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-23T19:32:55.556430] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-23T19:32:55.556508] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-23T19:32:55.556575] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-23T19:32:55.599737] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-23T19:32:55.910717] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:55.911063] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-23T19:32:56.099297] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:32:56.099614] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-23T19:32:56.099736] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:32:56.099813] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-23T19:32:56.099911] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:32:56.099984] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-23T19:32:56.100081] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-23T19:32:56.100160] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-23T19:32:56.100241] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-23T19:32:56.100335] [INFO ] [MAIN ] Update Progress: 4/2367 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 27m 54s. Rate: 11.4 symbols/min [2025-10-23T19:32:56.285305] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:56.314098] [DEBUG] [LOCAL ] AB: Loaded 24673 existing records from primary storage. [2025-10-23T19:32:56.314504] [INFO ] [MAIN ] AB: Loaded 24673 existing records. [2025-10-23T19:32:56.495972] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:32:56.496547] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-23T19:32:56.496861] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-23T19:32:56.514155] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-23T19:32:56.514389] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-23T19:32:56.560467] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T19:32:56.663952] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-23T19:32:56.657051] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-23T19:32:56.729934] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-23T19:32:56.795576] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-23T19:32:57.049741] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:57.050353] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-23T19:32:57.385631] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-23T19:32:57.386041] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-23T19:32:57.388947] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-23T19:32:57.389340] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-23T19:32:57.390764] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:32:57.396084] [FATAL] [LOCAL ] AA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:32:57.403533] [FATAL] [MAIN ] AA: Failed to save primary data. [2025-10-23T19:32:57.403743] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:32:57.403832] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-23T19:32:57.403932] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-23T19:32:57.404463] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-10-23T19:32:57.404321] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-23T19:32:57.405989] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-10-23T19:32:57.406605] [INFO ] [MAIN ] Update Progress: 5/2367 symbols completed. AA took 22.4s. Estimated remaining: 2h 56m 32s. Rate: 13.4 symbols/min [2025-10-23T19:32:57.596220] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:57.596462] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-23T19:32:57.596535] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-23T19:32:57.596676] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-23T19:32:57.596780] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-23T19:32:57.596880] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-23T19:32:57.596955] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-23T19:32:58.056455] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:32:58.057209] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-23T19:32:58.084106] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T19:32:58.099291] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-23T19:32:58.432907] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T19:32:58.444537] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-23T19:32:59.318856] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T19:32:59.328451] [INFO ] [REMOTE ] AAP: Full fetch complete (75085 records). [2025-10-23T19:32:59.328633] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-23T19:32:59.759001] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T19:32:59.772786] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-23T19:32:59.773521] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-23T19:32:59.774726] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-23T19:32:59.774878] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-23T19:32:59.775519] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-23T19:32:59.777298] [FATAL] [LOCAL ] AAP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:32:59.777481] [FATAL] [MAIN ] AAP: Failed to save primary data. [2025-10-23T19:32:59.777601] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:32:59.777700] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-23T19:32:59.777795] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-23T19:32:59.777886] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-10-23T19:32:59.778050] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-10-23T19:32:59.779592] [INFO ] [MAIN ] Update Progress: 6/2367 symbols completed. AAP took 18.8s. Estimated remaining: 2h 42m 37s. Rate: 14.5 symbols/min [2025-10-23T19:32:59.963287] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:32:59.993103] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T19:33:00.003958] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-23T19:33:00.036950] [DEBUG] [LOCAL ] ABCB: Loaded 30308 existing records from primary storage. [2025-10-23T19:33:00.037268] [INFO ] [MAIN ] ABCB: Loaded 30308 existing records. [2025-10-23T19:33:00.259396] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T19:33:00.296695] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:00.297848] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-23T19:33:00.298230] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-23T19:33:00.298336] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-23T19:33:00.299322] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-23T19:33:00.299399] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-23T19:33:00.684404] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:00.684874] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-23T19:33:01.290913] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T19:33:01.301616] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-23T19:33:01.568912] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T19:33:01.579236] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-23T19:33:02.100973] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T19:33:02.110868] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-23T19:33:02.170424] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T19:33:02.177549] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-23T19:33:02.203571] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T19:33:02.210549] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-23T19:33:03.439787] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T19:33:03.444955] [INFO ] [REMOTE ] AAT: Full fetch complete (43066 records). [2025-10-23T19:33:03.445066] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-23T19:33:03.883689] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-23T19:33:03.893522] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T19:33:03.893838] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-23T19:33:03.894574] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-23T19:33:03.895145] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-23T19:33:03.896466] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T19:33:03.896888] [FATAL] [LOCAL ] AAT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:03.911467] [FATAL] [MAIN ] AAT: Failed to save primary data. [2025-10-23T19:33:03.911938] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-23T19:33:03.912688] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-23T19:33:03.914887] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:03.915097] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-23T19:33:03.915251] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-23T19:33:03.915353] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-10-23T19:33:03.915899] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-10-23T19:33:03.916124] [INFO ] [MAIN ] Update Progress: 7/2367 symbols completed. AAT took 14.7s. Estimated remaining: 2h 42m 34s. Rate: 14.5 symbols/min [2025-10-23T19:33:04.136511] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-23T19:33:04.138245] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:04.150394] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-23T19:33:04.203075] [DEBUG] [LOCAL ] ABEV: Loaded 53284 existing records from primary storage. [2025-10-23T19:33:04.203439] [INFO ] [MAIN ] ABEV: Loaded 53284 existing records. [2025-10-23T19:33:04.387292] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:04.387746] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-23T19:33:04.387833] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-23T19:33:04.388104] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-23T19:33:04.388183] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-23T19:33:04.764112] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:04.764465] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-23T19:33:04.922311] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-23T19:33:04.931088] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-23T19:33:05.288454] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T19:33:05.296171] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-23T19:33:05.957518] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T19:33:05.962486] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-23T19:33:06.138978] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T19:33:06.150274] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-23T19:33:06.733228] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T19:33:06.743827] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-23T19:33:06.821485] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T19:33:06.829306] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-23T19:33:07.203316] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T19:33:07.208900] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-23T19:33:07.843756] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:33:07.855193] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-23T19:33:08.108614] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T19:33:08.117406] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-23T19:33:08.298553] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T19:33:08.303908] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-23T19:33:08.459764] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T19:33:08.469854] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-23T19:33:09.372969] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T19:33:09.378350] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-23T19:33:09.484530] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T19:33:09.490057] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-23T19:33:09.897332] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-23T19:33:09.937460] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-23T19:33:09.938681] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T19:33:09.950917] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-23T19:33:10.173223] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T19:33:10.177454] [INFO ] [REMOTE ] AB: Full fetch complete (43963 records). [2025-10-23T19:33:10.177577] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-23T19:33:10.555754] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-23T19:33:10.555909] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-23T19:33:10.556429] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-23T19:33:10.556534] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-23T19:33:10.557040] [FATAL] [LOCAL ] AB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:10.557140] [FATAL] [MAIN ] AB: Failed to save primary data. [2025-10-23T19:33:10.557230] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:10.557331] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-23T19:33:10.557450] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-23T19:33:10.557546] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-23T19:33:10.557863] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-23T19:33:10.557997] [INFO ] [MAIN ] Update Progress: 8/2367 symbols completed. AB took 14.5s. Estimated remaining: 2h 54m 49s. Rate: 13.5 symbols/min [2025-10-23T19:33:10.731933] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:10.750376] [DEBUG] [LOCAL ] ABG: Loaded 17859 existing records from primary storage. [2025-10-23T19:33:10.750669] [INFO ] [MAIN ] ABG: Loaded 17859 existing records. [2025-10-23T19:33:10.891996] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T19:33:10.936547] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-23T19:33:10.956764] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:10.957629] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-23T19:33:10.957726] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-23T19:33:10.958170] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-23T19:33:10.958245] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-23T19:33:11.303276] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:11.303579] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-23T19:33:11.779721] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T19:33:11.791284] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-23T19:33:12.195124] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T19:33:12.206920] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-23T19:33:12.290883] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T19:33:12.297890] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-23T19:33:12.335455] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T19:33:12.339721] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-23T19:33:13.173434] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T19:33:13.177201] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-23T19:33:13.294454] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T19:33:13.305767] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-23T19:33:13.355567] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T19:33:13.362665] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-23T19:33:13.821358] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T19:33:13.834334] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-23T19:33:13.884840] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T19:33:13.890486] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-23T19:33:14.458113] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T19:33:14.463842] [INFO ] [REMOTE ] ABCB: Full fetch complete (44931 records). [2025-10-23T19:33:14.463955] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-23T19:33:14.849814] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-23T19:33:14.849944] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-23T19:33:14.850444] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-23T19:33:14.850820] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-23T19:33:14.851308] [FATAL] [LOCAL ] ABCB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:14.862273] [FATAL] [MAIN ] ABCB: Failed to save primary data. [2025-10-23T19:33:14.867479] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:14.877110] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-23T19:33:14.880217] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-23T19:33:14.880432] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-23T19:33:14.882177] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T19:33:14.892932] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-10-23T19:33:14.893748] [INFO ] [MAIN ] Update Progress: 9/2367 symbols completed. ABCB took 15.1s. Estimated remaining: 2h 54m 16s. Rate: 13.5 symbols/min [2025-10-23T19:33:14.894122] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-23T19:33:15.074091] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:15.074413] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-23T19:33:15.074543] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-23T19:33:15.074687] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-23T19:33:15.074762] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-23T19:33:15.074845] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-23T19:33:15.074914] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-23T19:33:15.352946] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-23T19:33:15.395560] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-23T19:33:15.481431] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:15.481936] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-23T19:33:15.552031] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T19:33:15.563279] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-23T19:33:16.067532] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T19:33:16.071445] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-23T19:33:16.315795] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T19:33:16.327536] [INFO ] [REMOTE ] ABBV: Full fetch complete (77844 records). [2025-10-23T19:33:16.327740] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-23T19:33:16.739926] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-23T19:33:16.740570] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-23T19:33:16.741604] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-23T19:33:16.742039] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-23T19:33:16.747927] [FATAL] [LOCAL ] ABBV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:16.767687] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T19:33:16.767135] [FATAL] [MAIN ] ABBV: Failed to save primary data. [2025-10-23T19:33:16.773967] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-23T19:33:16.774810] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:16.774975] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-23T19:33:16.776245] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T19:33:16.776368] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-23T19:33:16.780106] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-23T19:33:16.781165] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-23T19:33:16.781423] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-23T19:33:16.782165] [INFO ] [MAIN ] Update Progress: 10/2367 symbols completed. ABBV took 19.4s. Estimated remaining: 2h 44m 11s. Rate: 14.4 symbols/min [2025-10-23T19:33:16.987061] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-23T19:33:16.990082] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:16.990296] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-10-23T19:33:17.000851] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-10-23T19:33:17.001123] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-23T19:33:17.001426] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-23T19:33:17.001687] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-23T19:33:17.001748] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-23T19:33:17.045154] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-23T19:33:17.366291] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:17.366627] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-23T19:33:17.621416] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-23T19:33:17.626299] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-23T19:33:17.899573] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T19:33:17.904601] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-23T19:33:18.452721] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T19:33:18.457706] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-23T19:33:18.564236] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T19:33:18.575458] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-23T19:33:18.789888] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T19:33:18.800035] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-23T19:33:18.831514] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T19:33:18.838491] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-23T19:33:19.068737] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T19:33:19.072520] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-23T19:33:20.072187] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T19:33:20.075362] [INFO ] [REMOTE ] ABG: Full fetch complete (26743 records). [2025-10-23T19:33:20.075465] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-23T19:33:20.515750] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-23T19:33:20.515478] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T19:33:20.523449] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-23T19:33:20.524825] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-23T19:33:20.526470] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-23T19:33:20.526594] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-23T19:33:20.527503] [FATAL] [LOCAL ] ABG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:20.527970] [FATAL] [MAIN ] ABG: Failed to save primary data. [2025-10-23T19:33:20.538106] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:20.557436] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T19:33:20.555410] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-23T19:33:20.557716] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-23T19:33:20.568692] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-23T19:33:20.569727] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-23T19:33:20.569996] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-23T19:33:20.570158] [INFO ] [MAIN ] Update Progress: 11/2367 symbols completed. ABG took 10.0s. Estimated remaining: 2h 42m 43s. Rate: 14.5 symbols/min [2025-10-23T19:33:20.715066] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-23T19:33:20.770292] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-23T19:33:20.796217] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:20.854426] [DEBUG] [LOCAL ] ABT: Loaded 53624 existing records from primary storage. [2025-10-23T19:33:20.854806] [INFO ] [MAIN ] ABT: Loaded 53624 existing records. [2025-10-23T19:33:21.030771] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:21.030967] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-23T19:33:21.031041] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-23T19:33:21.031267] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-23T19:33:21.031339] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-23T19:33:21.376013] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:21.376338] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-23T19:33:21.755999] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-23T19:33:21.762428] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-23T19:33:22.594686] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T19:33:22.607142] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-23T19:33:22.907311] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T19:33:22.918019] [INFO ] [REMOTE ] ABEV: Full fetch complete (77338 records). [2025-10-23T19:33:22.918236] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-23T19:33:23.339731] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T19:33:23.362274] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-23T19:33:23.369400] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-23T19:33:23.370513] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-23T19:33:23.371109] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-23T19:33:23.370624] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-23T19:33:23.372315] [FATAL] [LOCAL ] ABEV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:23.372569] [FATAL] [MAIN ] ABEV: Failed to save primary data. [2025-10-23T19:33:23.372669] [WARN ] [MAIN ] ABEV: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:23.382424] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-23T19:33:23.396153] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-23T19:33:23.399214] [INFO ] [LOCAL ] ABEV: Starting deletion of derivative data. [2025-10-23T19:33:23.399858] [DEBUG] [LOCAL ] ABEV: Deleted derivative data file. [2025-10-23T19:33:23.402007] [INFO ] [MAIN ] Update Progress: 12/2367 symbols completed. ABEV took 19.5s. Estimated remaining: 2h 38m 22s. Rate: 14.9 symbols/min [2025-10-23T19:33:23.400828] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T19:33:23.413221] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-23T19:33:23.589572] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:23.589804] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-23T19:33:23.589881] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-23T19:33:23.590018] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-23T19:33:23.590093] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-23T19:33:23.590186] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-23T19:33:23.590257] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-23T19:33:23.952731] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:23.953296] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-23T19:33:24.559732] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T19:33:24.571617] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-23T19:33:24.747608] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T19:33:24.758663] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-23T19:33:24.773456] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T19:33:24.778788] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-23T19:33:25.286606] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T19:33:25.296899] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-23T19:33:25.845840] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T19:33:25.850850] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-23T19:33:26.053058] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T19:33:26.060091] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-23T19:33:26.197810] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T19:33:26.209172] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-23T19:33:26.947772] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T19:33:26.958804] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-23T19:33:27.091205] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T19:33:27.097576] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-23T19:33:27.548545] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T19:33:27.556883] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-23T19:33:27.647944] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T19:33:27.658308] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-23T19:33:28.288571] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T19:33:28.294708] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-23T19:33:28.784289] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T19:33:28.789949] [INFO ] [REMOTE ] ABM: Full fetch complete (45103 records). [2025-10-23T19:33:28.790070] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-23T19:33:29.169450] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-23T19:33:29.169797] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-23T19:33:29.170764] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-23T19:33:29.170934] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-23T19:33:29.181859] [FATAL] [LOCAL ] ABM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:29.199784] [FATAL] [MAIN ] ABM: Failed to save primary data. [2025-10-23T19:33:29.200067] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:29.200768] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-23T19:33:29.201811] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T19:33:29.202011] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-23T19:33:29.212701] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-23T19:33:29.213143] [DEBUG] [LOCAL ] ABM: No derivative data file found to delete. [2025-10-23T19:33:29.213704] [INFO ] [MAIN ] Update Progress: 13/2367 symbols completed. ABM took 14.3s. Estimated remaining: 2h 43m 39s. Rate: 14.4 symbols/min [2025-10-23T19:33:29.214087] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-23T19:33:29.396403] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:29.396605] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-23T19:33:29.396724] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-23T19:33:29.396890] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-23T19:33:29.396971] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-23T19:33:29.397052] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-23T19:33:29.397129] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-23T19:33:29.567424] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T19:33:29.689528] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-23T19:33:29.822078] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-23T19:33:29.826980] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:29.837829] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-23T19:33:29.838982] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-23T19:33:30.621905] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T19:33:30.627303] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-23T19:33:30.905760] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:33:30.917188] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-23T19:33:31.217213] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T19:33:31.674212] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T19:33:31.684205] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-23T19:33:31.721477] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T19:33:32.482933] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-23T19:33:32.558313] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T19:33:33.050084] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T19:33:33.283008] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-23T19:33:34.083009] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-23T19:33:34.251944] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T19:33:34.716587] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T19:33:34.882968] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-23T19:33:35.682953] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-23T19:33:36.111528] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T19:33:36.354898] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T19:33:36.482979] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-23T19:33:37.288112] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-23T19:33:37.304076] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T19:33:37.313386] [INFO ] [REMOTE ] ABR: Full fetch complete (75391 records). [2025-10-23T19:33:37.313528] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-23T19:33:37.704081] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-23T19:33:37.704232] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-23T19:33:37.705108] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-23T19:33:37.705272] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-23T19:33:37.718376] [FATAL] [LOCAL ] ABR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:37.726017] [FATAL] [MAIN ] ABR: Failed to save primary data. [2025-10-23T19:33:37.727251] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T19:33:37.727300] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:37.735764] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-23T19:33:37.736157] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-23T19:33:37.736234] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-23T19:33:37.736316] [DEBUG] [LOCAL ] ABR: No derivative data file found to delete. [2025-10-23T19:33:37.736904] [INFO ] [MAIN ] Update Progress: 14/2367 symbols completed. ABR took 21.0s. Estimated remaining: 2h 55m 47s. Rate: 13.4 symbols/min [2025-10-23T19:33:37.910462] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:37.939278] [DEBUG] [LOCAL ] ACEL: Loaded 26346 existing records from primary storage. [2025-10-23T19:33:37.939556] [INFO ] [MAIN ] ACEL: Loaded 26346 existing records. [2025-10-23T19:33:38.116429] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:38.088160] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-23T19:33:38.116830] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-23T19:33:38.117775] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-23T19:33:38.118086] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-23T19:33:38.118183] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-23T19:33:38.481604] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:38.495276] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T19:33:38.883002] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-23T19:33:39.587598] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T19:33:39.646898] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T19:33:39.682907] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-23T19:33:40.482953] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-23T19:33:40.911814] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T19:33:40.915587] [INFO ] [REMOTE ] ACA: Full fetch complete (34259 records). [2025-10-23T19:33:40.915765] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-23T19:33:41.294343] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-23T19:33:41.347606] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-23T19:33:41.352980] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-23T19:33:41.361567] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T19:33:41.362179] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-23T19:33:41.367524] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-23T19:33:41.368402] [FATAL] [LOCAL ] ACA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:41.368488] [FATAL] [MAIN ] ACA: Failed to save primary data. [2025-10-23T19:33:41.368559] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:41.368632] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-23T19:33:41.368755] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-23T19:33:41.368825] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-23T19:33:41.368906] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-10-23T19:33:41.369000] [INFO ] [MAIN ] Update Progress: 15/2367 symbols completed. ACA took 18.0s. Estimated remaining: 2h 53m 29s. Rate: 13.6 symbols/min [2025-10-23T19:33:41.536621] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:41.589578] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-23T19:33:41.590000] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-23T19:33:41.781167] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:41.781405] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-23T19:33:41.781480] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-23T19:33:41.783352] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-23T19:33:41.783428] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-23T19:33:42.097246] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-23T19:33:42.137775] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:42.882961] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-23T19:33:43.287941] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T19:33:43.288870] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T19:33:43.682972] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-23T19:33:44.375891] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T19:33:44.482939] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-23T19:33:45.282961] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-23T19:33:45.641708] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T19:33:46.083030] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-23T19:33:46.161768] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T19:33:46.662562] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T19:33:46.668628] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T19:33:46.681264] [INFO ] [REMOTE ] ABT: Full fetch complete (77771 records). [2025-10-23T19:33:46.681422] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-23T19:33:46.888215] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-23T19:33:47.076904] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-23T19:33:47.077030] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-23T19:33:47.077866] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-23T19:33:47.077957] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-23T19:33:47.078734] [FATAL] [LOCAL ] ABT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:47.078827] [FATAL] [MAIN ] ABT: Failed to save primary data. [2025-10-23T19:33:47.078894] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:47.078966] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-23T19:33:47.079074] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-23T19:33:47.079148] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-23T19:33:47.079331] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-23T19:33:47.080533] [INFO ] [MAIN ] Update Progress: 16/2367 symbols completed. ABT took 26.5s. Estimated remaining: 2h 56m 33s. Rate: 13.3 symbols/min [2025-10-23T19:33:47.256682] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:47.306073] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-23T19:33:47.306456] [INFO ] [MAIN ] ACI: Loaded 53286 existing records. [2025-10-23T19:33:47.481834] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:33:47.482035] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-23T19:33:47.482109] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-23T19:33:47.482507] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-23T19:33:47.482582] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-23T19:33:47.688085] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-23T19:33:47.852219] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:48.364153] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T19:33:48.482934] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-23T19:33:49.088487] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T19:33:49.282959] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-23T19:33:50.082978] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-23T19:33:50.882982] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-23T19:33:51.151334] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-23T19:33:51.223671] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T19:33:51.262727] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T19:33:51.682954] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-23T19:33:52.208001] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T19:33:52.215903] [INFO ] [REMOTE ] ACCO: Full fetch complete (53994 records). [2025-10-23T19:33:52.216115] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-23T19:33:52.489233] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-23T19:33:52.625175] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-23T19:33:52.625286] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-23T19:33:52.626009] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-23T19:33:52.626104] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-23T19:33:52.626681] [FATAL] [LOCAL ] ACCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:33:52.626763] [FATAL] [MAIN ] ACCO: Failed to save primary data. [2025-10-23T19:33:52.626831] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:33:52.626900] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-23T19:33:52.627046] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-23T19:33:52.627119] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-23T19:33:52.627198] [DEBUG] [LOCAL ] ACCO: No derivative data file found to delete. [2025-10-23T19:33:52.627292] [INFO ] [MAIN ] Update Progress: 17/2367 symbols completed. ACCO took 23.4s. Estimated remaining: 2h 58m 53s. Rate: 13.1 symbols/min [2025-10-23T19:33:52.822456] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:33:52.822618] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-23T19:33:52.822708] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-23T19:33:52.822817] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-23T19:33:52.822886] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-23T19:33:52.822991] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-23T19:33:52.823061] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-23T19:33:53.183095] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:33:53.282937] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-23T19:33:53.431148] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T19:33:53.762993] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T19:33:54.083011] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-23T19:33:54.883017] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-23T19:33:55.682995] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-23T19:33:55.841085] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-23T19:33:55.946874] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T19:33:56.252702] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T19:33:56.482951] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-23T19:33:56.876441] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T19:33:57.282964] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-23T19:33:58.082981] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-23T19:33:58.196846] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T19:33:58.489723] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T19:33:58.882953] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-23T19:33:59.682983] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-23T19:34:00.010604] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T19:34:00.482940] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-23T19:34:00.699255] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-23T19:34:01.282926] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-23T19:34:01.615235] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T19:34:01.812195] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T19:34:01.816633] [INFO ] [REMOTE ] ACEL: Full fetch complete (38748 records). [2025-10-23T19:34:01.816815] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-23T19:34:02.088174] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-23T19:34:02.199934] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-23T19:34:02.200058] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-23T19:34:02.200606] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-23T19:34:02.200740] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-23T19:34:02.201237] [FATAL] [LOCAL ] ACEL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:02.201320] [FATAL] [MAIN ] ACEL: Failed to save primary data. [2025-10-23T19:34:02.201389] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:02.201459] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-23T19:34:02.201550] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-23T19:34:02.201622] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-23T19:34:02.201903] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-10-23T19:34:02.202019] [INFO ] [MAIN ] Update Progress: 18/2367 symbols completed. ACEL took 24.5s. Estimated remaining: 3h 9m 42s. Rate: 12.4 symbols/min [2025-10-23T19:34:02.376473] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:02.377627] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-23T19:34:02.377722] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-23T19:34:02.377872] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-23T19:34:02.377947] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-23T19:34:02.378029] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-23T19:34:02.378115] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-23T19:34:02.735573] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:02.882952] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-23T19:34:03.683027] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-23T19:34:03.822489] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T19:34:03.866968] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-23T19:34:04.482988] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-23T19:34:05.041908] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-23T19:34:05.282938] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-23T19:34:05.360635] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T19:34:06.082969] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-23T19:34:06.121255] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T19:34:06.883034] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-23T19:34:07.671876] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T19:34:07.682923] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-23T19:34:07.930778] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-23T19:34:08.482985] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-23T19:34:08.640328] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T19:34:09.283029] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-23T19:34:09.443321] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T19:34:10.082944] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-23T19:34:10.725318] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-23T19:34:10.882938] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-23T19:34:11.157370] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T19:34:11.605838] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T19:34:11.682936] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-23T19:34:12.466842] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T19:34:12.482908] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-23T19:34:12.731204] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T19:34:13.282951] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-23T19:34:14.083004] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-23T19:34:14.591445] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-23T19:34:14.600895] [INFO ] [REMOTE ] ACI: Full fetch complete (77232 records). [2025-10-23T19:34:14.601072] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-23T19:34:14.891638] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-23T19:34:14.991466] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-23T19:34:14.991590] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-23T19:34:14.992405] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-23T19:34:14.992493] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-23T19:34:14.993199] [FATAL] [LOCAL ] ACI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:14.993288] [FATAL] [MAIN ] ACI: Failed to save primary data. [2025-10-23T19:34:14.993360] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:14.993434] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-23T19:34:14.993529] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-23T19:34:14.993601] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-10-23T19:34:14.993983] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-10-23T19:34:14.994719] [INFO ] [MAIN ] Update Progress: 19/2367 symbols completed. ACI took 27.9s. Estimated remaining: 3h 25m 59s. Rate: 11.4 symbols/min [2025-10-23T19:34:15.163892] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:15.164093] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-23T19:34:15.164164] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-23T19:34:15.164272] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-23T19:34:15.164342] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-23T19:34:15.164420] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-23T19:34:15.164486] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-23T19:34:15.518853] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:15.682920] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-23T19:34:16.080855] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T19:34:16.111735] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-23T19:34:16.149448] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T19:34:16.483000] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-23T19:34:17.282935] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-23T19:34:17.396518] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T19:34:18.016025] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T19:34:18.082919] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-23T19:34:18.883003] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-23T19:34:19.449196] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T19:34:19.682943] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-23T19:34:19.847426] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-23T19:34:20.482971] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-23T19:34:20.779847] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T19:34:20.963768] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T19:34:21.282989] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-23T19:34:21.805888] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T19:34:22.082985] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-23T19:34:22.882934] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-23T19:34:22.971380] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T19:34:22.979142] [INFO ] [REMOTE ] ACM: Full fetch complete (63285 records). [2025-10-23T19:34:22.979346] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-23T19:34:23.380598] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-23T19:34:23.380766] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-23T19:34:23.381558] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-23T19:34:23.381684] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-23T19:34:23.382386] [FATAL] [LOCAL ] ACM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:23.382489] [FATAL] [MAIN ] ACM: Failed to save primary data. [2025-10-23T19:34:23.382579] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:23.382704] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-23T19:34:23.382825] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-23T19:34:23.382920] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-23T19:34:23.383024] [DEBUG] [LOCAL ] ACM: No derivative data file found to delete. [2025-10-23T19:34:23.383208] [INFO ] [MAIN ] Update Progress: 20/2367 symbols completed. ACM took 30.8s. Estimated remaining: 3h 32m 0s. Rate: 11.1 symbols/min [2025-10-23T19:34:23.571620] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:23.582223] [DEBUG] [LOCAL ] ACR: Loaded 5310 existing records from primary storage. [2025-10-23T19:34:23.582460] [INFO ] [MAIN ] ACR: Loaded 5310 existing records. [2025-10-23T19:34:23.685245] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-23T19:34:23.745578] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T19:34:23.812600] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:34:23.813399] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-23T19:34:23.813482] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-23T19:34:23.813755] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-23T19:34:23.813831] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-23T19:34:24.189849] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:24.355795] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T19:34:24.482966] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-23T19:34:25.283065] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-23T19:34:25.319511] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T19:34:26.082966] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-23T19:34:26.424341] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-23T19:34:26.456847] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T19:34:26.882950] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-23T19:34:27.682988] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-23T19:34:27.976431] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T19:34:28.198594] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T19:34:28.318219] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T19:34:28.482931] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-23T19:34:29.282958] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-23T19:34:29.840432] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T19:34:30.082958] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-23T19:34:30.883147] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-23T19:34:31.080337] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T19:34:31.351368] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T19:34:31.682928] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-23T19:34:31.818975] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T19:34:32.482947] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-23T19:34:33.204858] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T19:34:33.282934] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-23T19:34:34.003090] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T19:34:34.083048] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-23T19:34:34.678376] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-23T19:34:34.692341] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-23T19:34:34.692600] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-23T19:34:34.888043] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-23T19:34:35.126863] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-23T19:34:35.126975] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-23T19:34:35.127755] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-23T19:34:35.127855] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-23T19:34:35.128536] [FATAL] [LOCAL ] ACHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:35.128662] [FATAL] [MAIN ] ACHR: Failed to save primary data. [2025-10-23T19:34:35.128753] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:35.128847] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-23T19:34:35.128970] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-23T19:34:35.129062] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-23T19:34:35.129344] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-23T19:34:35.129728] [INFO ] [MAIN ] Update Progress: 21/2367 symbols completed. ACHR took 53.8s. Estimated remaining: 3h 43m 42s. Rate: 10.5 symbols/min [2025-10-23T19:34:35.311952] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:35.322259] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T19:34:35.360681] [DEBUG] [LOCAL ] ACRE: Loaded 33223 existing records from primary storage. [2025-10-23T19:34:35.361040] [INFO ] [MAIN ] ACRE: Loaded 33223 existing records. [2025-10-23T19:34:35.537019] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:34:35.537284] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-23T19:34:35.537408] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-23T19:34:35.537763] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-23T19:34:35.537846] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-23T19:34:35.686327] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-23T19:34:35.891147] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:36.482964] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-23T19:34:37.066759] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T19:34:37.093353] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T19:34:37.099662] [INFO ] [REMOTE ] ACP: Full fetch complete (46446 records). [2025-10-23T19:34:37.099785] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-23T19:34:37.288130] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-23T19:34:37.474358] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-23T19:34:37.474478] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-23T19:34:37.475115] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-23T19:34:37.475202] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-23T19:34:37.475788] [FATAL] [LOCAL ] ACP: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:37.475874] [FATAL] [MAIN ] ACP: Failed to save primary data. [2025-10-23T19:34:37.475943] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:37.476027] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-23T19:34:37.476155] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-23T19:34:37.476273] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-23T19:34:37.476387] [DEBUG] [LOCAL ] ACP: No derivative data file found to delete. [2025-10-23T19:34:37.476490] [INFO ] [MAIN ] Update Progress: 22/2367 symbols completed. ACP took 22.5s. Estimated remaining: 3h 37m 36s. Rate: 10.8 symbols/min [2025-10-23T19:34:37.642131] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:37.642318] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-23T19:34:37.642404] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-23T19:34:37.642539] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-23T19:34:37.642617] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-23T19:34:37.642733] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-23T19:34:37.642804] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-23T19:34:37.998731] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:38.082967] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-23T19:34:38.124695] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T19:34:38.176472] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T19:34:38.840703] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T19:34:38.882972] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-23T19:34:39.683017] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-23T19:34:40.483001] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-23T19:34:40.995784] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-23T19:34:41.112166] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T19:34:41.197499] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T19:34:41.282924] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-23T19:34:42.082940] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-23T19:34:42.636389] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T19:34:42.651991] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T19:34:42.882979] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-23T19:34:43.682997] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-23T19:34:44.334316] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-23T19:34:44.482955] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-23T19:34:45.177374] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-23T19:34:45.186778] [INFO ] [REMOTE ] ACN: Full fetch complete (77419 records). [2025-10-23T19:34:45.186960] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-23T19:34:45.288049] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-23T19:34:45.589147] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-23T19:34:45.589265] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-23T19:34:45.590174] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-23T19:34:45.590257] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-23T19:34:45.590978] [FATAL] [LOCAL ] ACN: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:45.591062] [FATAL] [MAIN ] ACN: Failed to save primary data. [2025-10-23T19:34:45.591147] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:45.591225] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-23T19:34:45.591334] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-23T19:34:45.591406] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-23T19:34:45.591488] [DEBUG] [LOCAL ] ACN: No derivative data file found to delete. [2025-10-23T19:34:45.591880] [INFO ] [MAIN ] Update Progress: 23/2367 symbols completed. ACN took 43.4s. Estimated remaining: 3h 41m 51s. Rate: 10.6 symbols/min [2025-10-23T19:34:45.767103] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:45.767335] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-23T19:34:45.767452] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-23T19:34:45.767591] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-23T19:34:45.767768] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-23T19:34:45.767852] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-23T19:34:45.767919] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-23T19:34:46.065100] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T19:34:46.092587] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-23T19:34:46.155538] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:46.177931] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-23T19:34:46.812710] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T19:34:46.882988] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-23T19:34:47.682945] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-23T19:34:47.712506] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T19:34:48.483015] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-23T19:34:49.029509] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T19:34:49.282949] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-23T19:34:50.082939] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-23T19:34:50.153688] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T19:34:50.614441] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-23T19:34:50.615739] [INFO ] [REMOTE ] ACR: Full fetch complete (8537 records). [2025-10-23T19:34:50.615828] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-23T19:34:50.869032] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T19:34:50.887829] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-23T19:34:51.004728] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-23T19:34:51.004851] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-23T19:34:51.005086] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-23T19:34:51.005186] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-23T19:34:51.005489] [FATAL] [LOCAL ] ACR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:34:51.005579] [FATAL] [MAIN ] ACR: Failed to save primary data. [2025-10-23T19:34:51.005691] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:34:51.005781] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-23T19:34:51.005900] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-23T19:34:51.006023] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-23T19:34:51.006213] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-10-23T19:34:51.006348] [INFO ] [MAIN ] Update Progress: 24/2367 symbols completed. ACR took 27.6s. Estimated remaining: 3h 41m 19s. Rate: 10.6 symbols/min [2025-10-23T19:34:51.173111] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:51.173266] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-23T19:34:51.173316] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-23T19:34:51.173419] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-23T19:34:51.173472] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-23T19:34:51.173521] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-23T19:34:51.173564] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-23T19:34:51.527629] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:51.682946] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-23T19:34:51.879874] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:34:51.880220] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-23T19:34:51.880306] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:34:51.880383] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-23T19:34:51.880450] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:34:51.880522] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-23T19:34:51.880614] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-23T19:34:51.880706] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-23T19:34:51.880801] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-23T19:34:51.880900] [INFO ] [MAIN ] Update Progress: 25/2367 symbols completed. AD took 0.9s. Estimated remaining: 3h 33m 44s. Rate: 11.0 symbols/min [2025-10-23T19:34:52.050295] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:34:52.050501] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-23T19:34:52.050592] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-23T19:34:52.050753] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-23T19:34:52.050845] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-23T19:34:52.050959] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-23T19:34:52.051051] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-23T19:34:52.433323] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:34:52.457608] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T19:34:52.482964] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-23T19:34:53.282947] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-23T19:34:54.082957] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-23T19:34:54.462702] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-23T19:34:54.882928] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-23T19:34:54.927282] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T19:34:55.005699] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T19:34:55.682963] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-23T19:34:56.106702] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T19:34:56.482973] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-23T19:34:57.237703] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T19:34:57.282945] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-23T19:34:58.082945] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-23T19:34:58.171146] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T19:34:58.816985] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T19:34:58.818621] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T19:34:58.882917] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-23T19:34:59.682956] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-23T19:35:00.454113] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T19:35:00.482906] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-23T19:35:01.038613] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T19:35:01.282963] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-23T19:35:02.083002] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-23T19:35:02.214230] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T19:35:02.722894] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T19:35:02.882977] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-23T19:35:03.682946] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-23T19:35:04.078602] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T19:35:04.318009] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-23T19:35:04.371025] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T19:35:04.377050] [INFO ] [REMOTE ] ACRE: Full fetch complete (49422 records). [2025-10-23T19:35:04.377255] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-23T19:35:04.488225] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-23T19:35:04.766779] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-23T19:35:04.766895] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-23T19:35:04.767452] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-23T19:35:04.767533] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-23T19:35:04.768039] [FATAL] [LOCAL ] ACRE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:04.768150] [FATAL] [MAIN ] ACRE: Failed to save primary data. [2025-10-23T19:35:04.768237] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:04.768315] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-23T19:35:04.768446] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-23T19:35:04.768522] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-10-23T19:35:04.768753] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-10-23T19:35:04.768866] [INFO ] [MAIN ] Update Progress: 26/2367 symbols completed. ACRE took 29.6s. Estimated remaining: 3h 44m 46s. Rate: 10.4 symbols/min [2025-10-23T19:35:04.936665] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:04.975925] [DEBUG] [LOCAL ] ADCT: Loaded 35462 existing records from primary storage. [2025-10-23T19:35:04.976389] [INFO ] [MAIN ] ADCT: Loaded 35462 existing records. [2025-10-23T19:35:05.191819] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:05.192080] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-23T19:35:05.192195] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-23T19:35:05.192507] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-23T19:35:05.192594] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-23T19:35:05.288034] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-23T19:35:05.558865] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:06.082999] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-23T19:35:06.276715] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T19:35:06.685338] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T19:35:06.882941] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-23T19:35:07.058277] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T19:35:07.533878] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-23T19:35:07.682960] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-23T19:35:08.364827] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T19:35:08.482988] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-23T19:35:09.282935] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-23T19:35:09.479824] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T19:35:09.482736] [INFO ] [REMOTE ] ACV: Full fetch complete (10474 records). [2025-10-23T19:35:09.482846] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-23T19:35:09.859137] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-23T19:35:09.859250] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-23T19:35:09.859484] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-23T19:35:09.859559] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-23T19:35:09.859832] [FATAL] [LOCAL ] ACV: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:09.859912] [FATAL] [MAIN ] ACV: Failed to save primary data. [2025-10-23T19:35:09.859977] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:09.860044] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-23T19:35:09.860129] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-23T19:35:09.860199] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-23T19:35:09.860278] [DEBUG] [LOCAL ] ACV: No derivative data file found to delete. [2025-10-23T19:35:09.860369] [INFO ] [MAIN ] Update Progress: 27/2367 symbols completed. ACV took 32.4s. Estimated remaining: 3h 43m 42s. Rate: 10.5 symbols/min [2025-10-23T19:35:10.027169] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:10.074955] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-23T19:35:10.075293] [INFO ] [MAIN ] ADM: Loaded 53394 existing records. [2025-10-23T19:35:10.088165] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-23T19:35:10.294929] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:10.295235] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-23T19:35:10.295367] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-23T19:35:10.295763] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-23T19:35:10.295843] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-23T19:35:10.661422] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:10.837403] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T19:35:10.882907] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-23T19:35:11.609410] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T19:35:11.682948] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-23T19:35:12.245021] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T19:35:12.483018] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-23T19:35:13.282927] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-23T19:35:13.377302] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T19:35:13.794477] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T19:35:14.082952] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-23T19:35:14.882987] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-23T19:35:15.117995] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T19:35:15.281219] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T19:35:15.682953] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-23T19:35:16.482945] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-23T19:35:16.604834] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T19:35:17.282933] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-23T19:35:17.554364] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T19:35:17.814031] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-23T19:35:18.082975] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-23T19:35:18.726912] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T19:35:18.735942] [INFO ] [REMOTE ] ACVA: Full fetch complete (71099 records). [2025-10-23T19:35:18.736088] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-23T19:35:18.892429] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-23T19:35:19.121043] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-23T19:35:19.121156] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-23T19:35:19.121886] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-23T19:35:19.121967] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-23T19:35:19.122580] [FATAL] [LOCAL ] ACVA: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:19.122685] [FATAL] [MAIN ] ACVA: Failed to save primary data. [2025-10-23T19:35:19.122755] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:19.122824] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-23T19:35:19.122951] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-23T19:35:19.123026] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-23T19:35:19.123105] [DEBUG] [LOCAL ] ACVA: No derivative data file found to delete. [2025-10-23T19:35:19.123451] [INFO ] [MAIN ] Update Progress: 28/2367 symbols completed. ACVA took 33.5s. Estimated remaining: 3h 48m 31s. Rate: 10.2 symbols/min [2025-10-23T19:35:19.296404] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:19.296847] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-23T19:35:19.297021] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-23T19:35:19.297167] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-23T19:35:19.297265] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-23T19:35:19.297494] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-23T19:35:19.297579] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-23T19:35:19.657321] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T19:35:19.698519] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:19.698609] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-23T19:35:20.422267] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T19:35:20.482914] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-23T19:35:21.267547] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T19:35:21.282903] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-23T19:35:21.700563] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T19:35:22.083024] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-23T19:35:22.851988] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T19:35:22.882996] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-23T19:35:23.682942] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-23T19:35:23.756055] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T19:35:24.482963] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-23T19:35:24.819273] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T19:35:24.888797] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T19:35:25.282958] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-23T19:35:26.083000] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-23T19:35:26.229187] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T19:35:26.237842] [INFO ] [REMOTE ] ADC: Full fetch complete (66737 records). [2025-10-23T19:35:26.238085] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-23T19:35:26.644447] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-23T19:35:26.644676] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-23T19:35:26.645456] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-23T19:35:26.645544] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-23T19:35:26.652828] [FATAL] [LOCAL ] ADC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:26.666290] [FATAL] [MAIN ] ADC: Failed to save primary data. [2025-10-23T19:35:26.667487] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T19:35:26.667545] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:26.674923] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-23T19:35:26.675157] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-23T19:35:26.675529] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-23T19:35:26.675634] [DEBUG] [LOCAL ] ADC: No derivative data file found to delete. [2025-10-23T19:35:26.676270] [INFO ] [MAIN ] Update Progress: 29/2367 symbols completed. ADC took 34.8s. Estimated remaining: 3h 50m 42s. Rate: 10.1 symbols/min [2025-10-23T19:35:26.851680] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:26.882965] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-23T19:35:26.903386] [DEBUG] [LOCAL ] ADT: Loaded 53435 existing records from primary storage. [2025-10-23T19:35:26.903808] [INFO ] [MAIN ] ADT: Loaded 53435 existing records. [2025-10-23T19:35:27.086631] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:27.086992] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-23T19:35:27.087097] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-23T19:35:27.087583] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-23T19:35:27.087720] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-23T19:35:27.470428] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:27.682930] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-23T19:35:27.763441] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T19:35:28.360359] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T19:35:28.482952] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-23T19:35:29.278881] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T19:35:29.282944] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-23T19:35:30.074205] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T19:35:30.085681] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-23T19:35:30.821382] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T19:35:30.882963] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-23T19:35:31.696616] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-23T19:35:31.703496] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T19:35:32.482984] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-23T19:35:32.805797] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T19:35:33.282994] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-23T19:35:33.417968] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T19:35:33.425697] [INFO ] [REMOTE ] ADCT: Full fetch complete (51403 records). [2025-10-23T19:35:33.425843] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-23T19:35:33.840023] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-23T19:35:33.840148] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-23T19:35:33.840727] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-23T19:35:33.840824] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-23T19:35:33.841320] [FATAL] [LOCAL ] ADCT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:33.841420] [FATAL] [MAIN ] ADCT: Failed to save primary data. [2025-10-23T19:35:33.841503] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:33.841600] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-23T19:35:33.841737] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-23T19:35:33.841827] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-23T19:35:33.842092] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-23T19:35:33.842258] [INFO ] [MAIN ] Update Progress: 30/2367 symbols completed. ADCT took 29.1s. Estimated remaining: 3h 52m 13s. Rate: 10.1 symbols/min [2025-10-23T19:35:34.017985] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:34.051278] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T19:35:34.082924] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-23T19:35:34.083750] [DEBUG] [LOCAL ] ADX: Loaded 27644 existing records from primary storage. [2025-10-23T19:35:34.084765] [INFO ] [MAIN ] ADX: Loaded 27644 existing records. [2025-10-23T19:35:34.268295] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:34.268574] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-23T19:35:34.268691] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-23T19:35:34.268962] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-23T19:35:34.269053] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-23T19:35:34.616388] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:34.882939] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-23T19:35:34.998889] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T19:35:35.688278] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-23T19:35:35.709490] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T19:35:36.160588] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T19:35:36.482928] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-23T19:35:37.282970] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-23T19:35:37.462470] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T19:35:38.082964] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-23T19:35:38.177293] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:35:38.888112] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-23T19:35:38.909334] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T19:35:39.682979] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-23T19:35:39.790945] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T19:35:40.029535] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T19:35:40.482952] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-23T19:35:41.282993] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-23T19:35:41.487836] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T19:35:42.022870] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T19:35:42.082924] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-23T19:35:42.558140] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T19:35:42.882972] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-23T19:35:43.347979] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T19:35:43.682978] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-23T19:35:44.482939] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-23T19:35:44.733813] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T19:35:45.268599] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T19:35:45.282903] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-23T19:35:45.365811] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T19:35:45.375559] [INFO ] [REMOTE ] ADM: Full fetch complete (77474 records). [2025-10-23T19:35:45.375795] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-23T19:35:45.828106] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-23T19:35:45.828231] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-23T19:35:45.829151] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-23T19:35:45.829254] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-23T19:35:45.830010] [FATAL] [LOCAL ] ADM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:45.830096] [FATAL] [MAIN ] ADM: Failed to save primary data. [2025-10-23T19:35:45.830167] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:45.830250] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-23T19:35:45.830376] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-23T19:35:45.830455] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-10-23T19:35:45.830757] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-10-23T19:35:45.831274] [INFO ] [MAIN ] Update Progress: 31/2367 symbols completed. ADM took 36.0s. Estimated remaining: 3h 59m 41s. Rate: 9.7 symbols/min [2025-10-23T19:35:46.015597] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:46.071503] [DEBUG] [LOCAL ] AEE: Loaded 50072 existing records from primary storage. [2025-10-23T19:35:46.071984] [INFO ] [MAIN ] AEE: Loaded 50072 existing records. [2025-10-23T19:35:46.088146] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-23T19:35:46.316533] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:46.316828] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-23T19:35:46.316911] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-23T19:35:46.317279] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-23T19:35:46.317359] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-23T19:35:46.702238] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:46.882967] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-23T19:35:47.010619] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T19:35:47.226909] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T19:35:47.682998] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-23T19:35:48.482983] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-23T19:35:48.611875] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T19:35:49.282946] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-23T19:35:49.470535] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:35:49.982304] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T19:35:50.082972] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-23T19:35:50.862100] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T19:35:50.882922] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-23T19:35:51.587822] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T19:35:51.595572] [INFO ] [REMOTE ] ADNT: Full fetch complete (67761 records). [2025-10-23T19:35:51.595771] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-23T19:35:51.688028] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-23T19:35:52.001834] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-23T19:35:52.002049] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-23T19:35:52.002774] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-23T19:35:52.002895] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-23T19:35:52.003494] [FATAL] [LOCAL ] ADNT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:52.003577] [FATAL] [MAIN ] ADNT: Failed to save primary data. [2025-10-23T19:35:52.003668] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:52.003744] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-23T19:35:52.003842] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-23T19:35:52.003911] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-23T19:35:52.003996] [DEBUG] [LOCAL ] ADNT: No derivative data file found to delete. [2025-10-23T19:35:52.004501] [INFO ] [MAIN ] Update Progress: 32/2367 symbols completed. ADNT took 32.9s. Estimated remaining: 3h 59m 36s. Rate: 9.7 symbols/min [2025-10-23T19:35:52.187849] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T19:35:52.189365] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:52.209482] [DEBUG] [LOCAL ] AEFC: Loaded 7650 existing records from primary storage. [2025-10-23T19:35:52.209753] [INFO ] [MAIN ] AEFC: Loaded 7650 existing records. [2025-10-23T19:35:52.391915] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:52.392236] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-23T19:35:52.392317] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-23T19:35:52.392505] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-23T19:35:52.392581] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-23T19:35:52.492246] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-23T19:35:52.749398] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:53.282984] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-23T19:35:53.522447] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T19:35:54.082960] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-23T19:35:54.455509] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T19:35:54.465477] [INFO ] [REMOTE ] ADT: Full fetch complete (77369 records). [2025-10-23T19:35:54.465690] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-23T19:35:54.763446] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T19:35:54.890307] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-23T19:35:54.891282] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-23T19:35:54.892300] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-23T19:35:54.893164] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-23T19:35:54.893365] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-23T19:35:54.894495] [FATAL] [LOCAL ] ADT: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:35:54.894584] [FATAL] [MAIN ] ADT: Failed to save primary data. [2025-10-23T19:35:54.894689] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:35:54.894791] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-23T19:35:54.894901] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-23T19:35:54.894974] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-10-23T19:35:54.895247] [DEBUG] [LOCAL ] ADT: Deleted derivative data file. [2025-10-23T19:35:54.896178] [INFO ] [MAIN ] Update Progress: 33/2367 symbols completed. ADT took 28.2s. Estimated remaining: 3h 55m 39s. Rate: 9.9 symbols/min [2025-10-23T19:35:55.076805] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:35:55.123411] [DEBUG] [LOCAL ] AEG: Loaded 49558 existing records from primary storage. [2025-10-23T19:35:55.123785] [INFO ] [MAIN ] AEG: Loaded 49558 existing records. [2025-10-23T19:35:55.304505] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:35:55.304742] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-23T19:35:55.304817] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-23T19:35:55.305091] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-23T19:35:55.305164] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-23T19:35:55.677138] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:35:55.682910] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-23T19:35:55.790980] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T19:35:56.288944] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T19:35:56.482997] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-23T19:35:56.891768] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T19:35:57.282984] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-23T19:35:57.324386] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T19:35:58.082972] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-23T19:35:58.776023] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T19:35:58.821570] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T19:35:58.882922] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-23T19:35:59.682945] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-23T19:36:00.303278] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T19:36:00.421908] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T19:36:00.482946] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-23T19:36:01.283010] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-23T19:36:02.082933] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-23T19:36:02.162126] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-23T19:36:02.416801] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T19:36:02.882955] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-23T19:36:03.682938] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-23T19:36:03.756579] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T19:36:04.482921] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-23T19:36:04.579984] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T19:36:04.811242] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T19:36:05.282976] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-23T19:36:06.056038] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T19:36:06.082920] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-23T19:36:06.423959] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-23T19:36:06.882969] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-23T19:36:07.015692] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T19:36:07.683027] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-23T19:36:08.488176] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-23T19:36:08.505400] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T19:36:09.282944] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-23T19:36:09.330030] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T19:36:09.488295] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T19:36:09.493882] [INFO ] [REMOTE ] ADX: Full fetch complete (41865 records). [2025-10-23T19:36:09.494019] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-23T19:36:09.902576] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-23T19:36:09.902720] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-23T19:36:09.903213] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-23T19:36:09.903307] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-23T19:36:09.903800] [FATAL] [LOCAL ] ADX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:09.903895] [FATAL] [MAIN ] ADX: Failed to save primary data. [2025-10-23T19:36:09.903989] [WARN ] [MAIN ] ADX: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:09.904087] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-23T19:36:09.904208] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-10-23T19:36:09.904293] [INFO ] [LOCAL ] ADX: Starting deletion of derivative data. [2025-10-23T19:36:09.904559] [DEBUG] [LOCAL ] ADX: Deleted derivative data file. [2025-10-23T19:36:09.904728] [INFO ] [MAIN ] Update Progress: 34/2367 symbols completed. ADX took 36.1s. Estimated remaining: 4h 5m 47s. Rate: 9.5 symbols/min [2025-10-23T19:36:10.073315] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:10.082941] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-23T19:36:10.130021] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-23T19:36:10.130431] [INFO ] [MAIN ] AEM: Loaded 53477 existing records. [2025-10-23T19:36:10.306598] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:10.306863] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-23T19:36:10.306958] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-23T19:36:10.307262] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-23T19:36:10.307347] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-23T19:36:10.663086] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:10.690414] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T19:36:10.882977] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-23T19:36:11.682930] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-23T19:36:11.950209] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T19:36:12.482972] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-23T19:36:12.768393] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T19:36:13.282982] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-23T19:36:13.414672] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T19:36:14.082963] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-23T19:36:14.161754] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T19:36:14.687727] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T19:36:14.882995] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-23T19:36:15.682972] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-23T19:36:15.971838] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T19:36:15.980781] [INFO ] [REMOTE ] AEE: Full fetch complete (72993 records). [2025-10-23T19:36:15.980942] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-23T19:36:16.378590] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-23T19:36:16.378912] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-23T19:36:16.379747] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-23T19:36:16.379849] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-23T19:36:16.380788] [FATAL] [LOCAL ] AEE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:16.380890] [FATAL] [MAIN ] AEE: Failed to save primary data. [2025-10-23T19:36:16.380987] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:16.381086] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-23T19:36:16.381408] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-23T19:36:16.381515] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-23T19:36:16.381863] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-23T19:36:16.382499] [INFO ] [MAIN ] Update Progress: 35/2367 symbols completed. AEE took 30.6s. Estimated remaining: 4h 5m 51s. Rate: 9.5 symbols/min [2025-10-23T19:36:16.489366] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-23T19:36:16.494582] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T19:36:16.571412] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:16.623593] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-23T19:36:16.623997] [INFO ] [MAIN ] AEO: Loaded 53564 existing records. [2025-10-23T19:36:16.804081] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:16.804632] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-23T19:36:16.804778] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-23T19:36:16.806462] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-23T19:36:16.806616] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-23T19:36:17.010922] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T19:36:17.201567] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:17.282914] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-23T19:36:18.083003] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-23T19:36:18.176209] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T19:36:18.483497] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-23T19:36:18.882933] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-23T19:36:18.937784] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T19:36:19.672004] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T19:36:19.682902] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-23T19:36:20.069149] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-23T19:36:20.482989] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-23T19:36:21.282968] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-23T19:36:22.082964] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-23T19:36:22.525207] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T19:36:22.533900] [INFO ] [REMOTE ] AEG: Full fetch complete (70659 records). [2025-10-23T19:36:22.534088] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-23T19:36:22.853235] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T19:36:22.883190] [INFO ] [REMOTE ] AEFC: Full fetch complete (11612 records). [2025-10-23T19:36:22.893965] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-23T19:36:22.893810] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-23T19:36:22.980852] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-23T19:36:23.023126] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-23T19:36:23.035220] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-23T19:36:23.052476] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-23T19:36:23.067621] [FATAL] [LOCAL ] AEG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:23.073392] [FATAL] [MAIN ] AEG: Failed to save primary data. [2025-10-23T19:36:23.088864] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:23.088978] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-23T19:36:23.117362] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-23T19:36:23.124804] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-23T19:36:23.145625] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-10-23T19:36:23.186557] [INFO ] [MAIN ] Update Progress: 36/2367 symbols completed. AEG took 28.3s. Estimated remaining: 4h 6m 16s. Rate: 9.5 symbols/min [2025-10-23T19:36:23.449714] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-23T19:36:23.460857] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-23T19:36:23.471580] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-23T19:36:23.489483] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-23T19:36:23.523215] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:23.519880] [FATAL] [LOCAL ] AEFC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:23.523567] [FATAL] [MAIN ] AEFC: Failed to save primary data. [2025-10-23T19:36:23.524141] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:23.524230] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-23T19:36:23.524317] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-23T19:36:23.524500] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-23T19:36:23.524717] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-10-23T19:36:23.524842] [INFO ] [MAIN ] Update Progress: 37/2367 symbols completed. AEFC took 31.5s. Estimated remaining: 3h 59m 52s. Rate: 9.7 symbols/min [2025-10-23T19:36:23.558929] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T19:36:23.617158] [DEBUG] [LOCAL ] AER: Loaded 47899 existing records from primary storage. [2025-10-23T19:36:23.617492] [INFO ] [MAIN ] AER: Loaded 47899 existing records. [2025-10-23T19:36:23.690578] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-23T19:36:23.794685] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:23.794885] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-23T19:36:23.794959] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-23T19:36:23.795305] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-23T19:36:23.795381] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-23T19:36:24.167715] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:24.398263] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T19:36:24.482959] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-23T19:36:25.282978] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-23T19:36:25.805431] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-23T19:36:26.082931] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-23T19:36:26.160118] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T19:36:26.892025] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-23T19:36:26.895080] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T19:36:27.682982] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-23T19:36:28.083563] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T19:36:28.489977] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-23T19:36:28.507385] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T19:36:29.282983] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-23T19:36:29.666496] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T19:36:30.083019] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-23T19:36:30.480616] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T19:36:30.882966] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-23T19:36:30.987947] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T19:36:31.682941] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-23T19:36:32.054248] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T19:36:32.482952] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-23T19:36:32.965582] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-23T19:36:33.094706] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T19:36:33.282978] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-23T19:36:34.082962] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-23T19:36:34.182238] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T19:36:34.882979] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-23T19:36:35.357570] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T19:36:35.682940] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-23T19:36:35.778415] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T19:36:36.483030] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-23T19:36:36.882791] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T19:36:37.282985] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-23T19:36:37.879503] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-23T19:36:37.888999] [INFO ] [REMOTE ] AEM: Full fetch complete (77484 records). [2025-10-23T19:36:37.889197] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-23T19:36:38.328172] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-23T19:36:38.329525] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T19:36:38.329754] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-23T19:36:38.340393] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-23T19:36:38.340959] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-23T19:36:38.340866] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-23T19:36:38.342305] [FATAL] [LOCAL ] AEM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:38.342411] [FATAL] [MAIN ] AEM: Failed to save primary data. [2025-10-23T19:36:38.342481] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:38.342553] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-23T19:36:38.342672] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-10-23T19:36:38.342752] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-10-23T19:36:38.342969] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-10-23T19:36:38.343367] [INFO ] [MAIN ] Update Progress: 38/2367 symbols completed. AEM took 28.4s. Estimated remaining: 4h 8m 35s. Rate: 9.4 symbols/min [2025-10-23T19:36:39.436239] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-23T19:36:39.448956] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-23T19:36:39.584057] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T19:36:39.682978] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-23T19:36:41.271000] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T19:36:41.281438] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-23T19:36:41.606692] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-23T19:36:41.618419] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-23T19:36:42.933609] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T19:36:42.950417] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-23T19:36:43.627389] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-23T19:36:43.642790] [INFO ] [REMOTE ] AEO: Full fetch complete (77650 records). [2025-10-23T19:36:43.643061] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-23T19:36:44.124227] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-23T19:36:44.124338] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-23T19:36:44.125177] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-23T19:36:44.125259] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-23T19:36:44.125899] [FATAL] [LOCAL ] AEO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:44.125982] [FATAL] [MAIN ] AEO: Failed to save primary data. [2025-10-23T19:36:44.126063] [WARN ] [MAIN ] AEO: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:44.126149] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-23T19:36:44.126244] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-23T19:36:44.126348] [INFO ] [LOCAL ] AEO: Starting deletion of derivative data. [2025-10-23T19:36:44.126580] [DEBUG] [LOCAL ] AEO: Deleted derivative data file. [2025-10-23T19:36:44.127105] [INFO ] [MAIN ] Update Progress: 39/2367 symbols completed. AEO took 27.7s. Estimated remaining: 4h 7m 52s. Rate: 9.4 symbols/min [2025-10-23T19:36:44.745007] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T19:36:44.753205] [INFO ] [REMOTE ] AER: Full fetch complete (69933 records). [2025-10-23T19:36:44.753364] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-23T19:36:45.140059] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-23T19:36:45.140167] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-23T19:36:45.140865] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-23T19:36:45.140945] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-23T19:36:45.141556] [FATAL] [LOCAL ] AER: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:36:45.141639] [FATAL] [MAIN ] AER: Failed to save primary data. [2025-10-23T19:36:45.141744] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:36:45.141819] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-23T19:36:45.141924] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-23T19:36:45.142035] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-10-23T19:36:45.142257] [DEBUG] [LOCAL ] AER: Deleted derivative data file. [2025-10-23T19:36:45.142639] [INFO ] [MAIN ] Update Progress: 40/2367 symbols completed. AER took 21.9s. Estimated remaining: 4h 2m 33s. Rate: 9.6 symbols/min [2025-10-23T19:36:45.801217] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:45.733327] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:45.827020] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:45.827325] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-23T19:36:45.827682] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-23T19:36:45.837530] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-23T19:36:45.862248] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:45.862345] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-23T19:36:45.863212] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-23T19:36:45.863268] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-23T19:36:45.927811] [DEBUG] [LOCAL ] AFB: Loaded 11018 existing records from primary storage. [2025-10-23T19:36:45.948534] [INFO ] [MAIN ] AFB: Loaded 11018 existing records. [2025-10-23T19:36:46.350255] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-23T19:36:46.389744] [INFO ] [MAIN ] AES: Loaded 53665 existing records. [2025-10-23T19:36:46.435258] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:46.445831] [DEBUG] [LOCAL ] AESI: Loaded 49817 existing records from primary storage. [2025-10-23T19:36:46.455066] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-23T19:36:46.477088] [INFO ] [MAIN ] AESI: Loaded 49817 existing records. [2025-10-23T19:36:46.508174] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-23T19:36:46.553787] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-23T19:36:46.688894] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-23T19:36:46.817519] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:46.974950] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:46.932560] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-23T19:36:46.996360] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-23T19:36:47.085233] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:47.081342] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-23T19:36:47.116167] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-23T19:36:47.136563] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-23T19:36:47.126332] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-23T19:36:47.153084] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-23T19:36:47.204950] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-23T19:36:47.236461] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-23T19:36:47.422843] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:36:47.482502] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-23T19:36:47.483152] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:36:47.525480] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-23T19:36:47.572571] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:36:47.667315] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-23T19:36:47.744601] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-23T19:36:47.798953] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:47.863239] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-23T19:36:47.799100] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-23T19:36:47.946369] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-23T19:36:47.956395] [INFO ] [MAIN ] Update Progress: 41/2367 symbols completed. AEXA took 2.8s. Estimated remaining: 3h 59m 11s. Rate: 9.7 symbols/min [2025-10-23T19:36:48.202801] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:48.232855] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-23T19:36:48.226881] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:48.256461] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-23T19:36:48.305383] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:36:48.349479] [DEBUG] [LOCAL ] AFG: Loaded 31910 existing records from primary storage. [2025-10-23T19:36:48.349978] [INFO ] [MAIN ] AFG: Loaded 31910 existing records. [2025-10-23T19:36:48.541436] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:36:48.541787] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-23T19:36:48.541869] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-23T19:36:48.542256] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-23T19:36:48.542353] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-23T19:36:48.869832] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-23T19:36:48.880027] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-23T19:36:48.957566] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:36:48.957989] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-23T19:36:49.739316] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T19:36:49.742444] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-23T19:36:49.927370] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T19:36:49.936415] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-23T19:36:50.075590] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T19:36:50.087777] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-23T19:36:50.111944] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T19:36:50.117418] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-23T19:36:50.608969] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-23T19:36:50.882964] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-23T19:36:51.246327] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T19:36:51.564773] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T19:36:51.620940] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T19:36:51.682942] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-23T19:36:51.775128] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T19:36:52.482982] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-23T19:36:53.120413] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T19:36:53.282990] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-23T19:36:53.669389] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T19:36:54.082957] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-23T19:36:54.712520] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T19:36:54.882955] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-23T19:36:55.683009] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-23T19:36:55.779367] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T19:36:56.262682] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T19:36:56.482966] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-23T19:36:57.135432] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T19:36:57.282928] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-23T19:36:57.324302] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T19:36:58.083759] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T19:36:58.082911] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-23T19:36:58.882949] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-23T19:36:59.425617] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T19:36:59.676510] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T19:36:59.682908] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-23T19:37:00.482983] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-23T19:37:00.550688] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T19:37:01.282959] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-23T19:37:02.083001] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-23T19:37:02.478298] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T19:37:02.480595] [INFO ] [REMOTE ] AFB: Full fetch complete (16349 records). [2025-10-23T19:37:02.480711] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-23T19:37:02.888546] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-23T19:37:02.888711] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-23T19:37:02.892756] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-23T19:37:02.893209] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-23T19:37:02.893332] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-23T19:37:02.894056] [FATAL] [LOCAL ] AFB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:02.895719] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-23T19:37:02.895778] [FATAL] [MAIN ] AFB: Failed to save primary data. [2025-10-23T19:37:02.906484] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:02.906733] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-23T19:37:02.907159] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-23T19:37:02.907238] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-10-23T19:37:02.907742] [DEBUG] [LOCAL ] AFB: Deleted derivative data file. [2025-10-23T19:37:02.907859] [INFO ] [MAIN ] Update Progress: 42/2367 symbols completed. AFB took 17.8s. Estimated remaining: 4h 7m 11s. Rate: 9.4 symbols/min [2025-10-23T19:37:03.081570] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:03.086223] [DEBUG] [LOCAL ] AFGB: Loaded 2210 existing records from primary storage. [2025-10-23T19:37:03.086408] [INFO ] [MAIN ] AFGB: Loaded 2210 existing records. [2025-10-23T19:37:03.259285] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:37:03.259493] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-23T19:37:03.259565] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-23T19:37:03.259785] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-23T19:37:03.259860] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-23T19:37:03.615760] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:03.682919] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-23T19:37:03.832006] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T19:37:04.349409] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T19:37:04.482946] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-23T19:37:05.282930] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-23T19:37:05.649234] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-23T19:37:06.082974] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-23T19:37:06.124747] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T19:37:06.708239] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-23T19:37:06.728880] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T19:37:06.882942] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-23T19:37:07.682978] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-23T19:37:08.303705] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T19:37:08.482958] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-23T19:37:08.939809] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-23T19:37:09.282976] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-23T19:37:09.737611] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T19:37:09.870198] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T19:37:10.082937] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-23T19:37:10.882958] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-23T19:37:11.684388] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-23T19:37:11.688633] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T19:37:12.237760] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-23T19:37:12.482978] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-23T19:37:12.907938] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-23T19:37:12.959226] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-23T19:37:13.282961] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-23T19:37:13.738209] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T19:37:14.082974] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-23T19:37:14.882980] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-23T19:37:15.444993] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T19:37:15.682967] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-23T19:37:16.482978] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-23T19:37:16.588994] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T19:37:17.098308] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T19:37:17.104121] [INFO ] [REMOTE ] AFG: Full fetch complete (46893 records). [2025-10-23T19:37:17.104241] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-23T19:37:17.194785] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T19:37:17.291881] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-23T19:37:17.502999] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-23T19:37:17.503137] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-23T19:37:17.503729] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-23T19:37:17.503830] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-23T19:37:17.504282] [FATAL] [LOCAL ] AFG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:17.504376] [FATAL] [MAIN ] AFG: Failed to save primary data. [2025-10-23T19:37:17.504461] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:17.504553] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-23T19:37:17.504723] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-23T19:37:17.504821] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-23T19:37:17.505030] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-23T19:37:17.505176] [INFO ] [MAIN ] Update Progress: 43/2367 symbols completed. AFG took 29.5s. Estimated remaining: 4h 14m 29s. Rate: 9.1 symbols/min [2025-10-23T19:37:17.681884] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:17.686840] [DEBUG] [LOCAL ] AFGC: Loaded 2540 existing records from primary storage. [2025-10-23T19:37:17.687022] [INFO ] [MAIN ] AFGC: Loaded 2540 existing records. [2025-10-23T19:37:17.838678] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T19:37:17.879763] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:37:17.879937] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-23T19:37:17.879993] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-23T19:37:17.880198] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-23T19:37:17.880272] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-23T19:37:18.088173] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-23T19:37:18.239099] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:18.625348] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T19:37:18.882947] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-23T19:37:19.366313] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-23T19:37:19.682971] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-23T19:37:20.482987] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-23T19:37:20.960557] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T19:37:20.961506] [INFO ] [REMOTE ] AFGB: Full fetch complete (3432 records). [2025-10-23T19:37:20.961604] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-23T19:37:21.292817] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-23T19:37:21.324306] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-23T19:37:21.325242] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-23T19:37:21.325411] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-23T19:37:21.325498] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-23T19:37:21.325795] [FATAL] [LOCAL ] AFGB: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:21.325874] [FATAL] [MAIN ] AFGB: Failed to save primary data. [2025-10-23T19:37:21.326024] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:21.326097] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-23T19:37:21.326190] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-23T19:37:21.326263] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-23T19:37:21.326441] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-23T19:37:21.326576] [INFO ] [MAIN ] Update Progress: 44/2367 symbols completed. AFGB took 18.4s. Estimated remaining: 4h 11m 58s. Rate: 9.2 symbols/min [2025-10-23T19:37:21.501040] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:21.501252] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-23T19:37:21.501339] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-23T19:37:21.501471] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-23T19:37:21.501544] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-23T19:37:21.501634] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-23T19:37:21.501725] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-23T19:37:21.893203] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:21.898895] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-23T19:37:22.082930] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-23T19:37:22.568745] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-23T19:37:22.882932] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-23T19:37:22.911276] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T19:37:23.683011] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-23T19:37:24.137551] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T19:37:24.482956] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-23T19:37:24.923449] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-23T19:37:25.098991] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-23T19:37:25.109233] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-23T19:37:25.109385] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-23T19:37:25.284385] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-23T19:37:25.499816] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-23T19:37:25.499941] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-23T19:37:25.500720] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-23T19:37:25.500801] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-23T19:37:25.501513] [FATAL] [LOCAL ] AES: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:25.501603] [FATAL] [MAIN ] AES: Failed to save primary data. [2025-10-23T19:37:25.501693] [WARN ] [MAIN ] AES: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:25.501768] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-23T19:37:25.501857] [DEBUG] [LOCAL ] AES: No primary data file found to delete. [2025-10-23T19:37:25.501926] [INFO ] [LOCAL ] AES: Starting deletion of derivative data. [2025-10-23T19:37:25.502114] [DEBUG] [LOCAL ] AES: Deleted derivative data file. [2025-10-23T19:37:25.503207] [INFO ] [MAIN ] Update Progress: 45/2367 symbols completed. AES took 40.4s. Estimated remaining: 4h 9m 51s. Rate: 9.3 symbols/min [2025-10-23T19:37:25.667928] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:25.671978] [DEBUG] [LOCAL ] AFGE: Loaded 2245 existing records from primary storage. [2025-10-23T19:37:25.672166] [INFO ] [MAIN ] AFGE: Loaded 2245 existing records. [2025-10-23T19:37:25.847708] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:37:25.848029] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-23T19:37:25.848262] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-23T19:37:25.851307] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T19:37:25.852870] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-23T19:37:25.852958] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-23T19:37:26.088166] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-23T19:37:26.232948] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:26.883014] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-23T19:37:27.394757] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-23T19:37:27.682963] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-23T19:37:27.877000] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:37:28.151953] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-23T19:37:28.482962] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-23T19:37:28.936393] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T19:37:29.283000] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-23T19:37:29.739713] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T19:37:30.082954] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-23T19:37:30.519089] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-23T19:37:30.882961] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-23T19:37:31.315214] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T19:37:31.682980] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-23T19:37:32.482955] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-23T19:37:32.929317] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-23T19:37:33.282964] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-23T19:37:33.479536] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T19:37:33.490791] [INFO ] [REMOTE ] AESI: Full fetch complete (71733 records). [2025-10-23T19:37:33.491060] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-23T19:37:33.817676] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-23T19:37:33.930350] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-23T19:37:33.930514] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-23T19:37:33.931402] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-23T19:37:33.931532] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-23T19:37:33.932476] [FATAL] [LOCAL ] AESI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:33.932566] [FATAL] [MAIN ] AESI: Failed to save primary data. [2025-10-23T19:37:33.932639] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:33.932744] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-23T19:37:33.932852] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-10-23T19:37:33.932931] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-10-23T19:37:33.933129] [DEBUG] [LOCAL ] AESI: Deleted derivative data file. [2025-10-23T19:37:33.933712] [INFO ] [MAIN ] Update Progress: 46/2367 symbols completed. AESI took 48.8s. Estimated remaining: 4h 11m 24s. Rate: 9.2 symbols/min [2025-10-23T19:37:34.089979] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-23T19:37:34.119202] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:34.173869] [DEBUG] [LOCAL ] AFL: Loaded 53174 existing records from primary storage. [2025-10-23T19:37:34.174267] [INFO ] [MAIN ] AFL: Loaded 53174 existing records. [2025-10-23T19:37:34.348692] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:37:34.348887] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-23T19:37:34.348979] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-23T19:37:34.349402] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-23T19:37:34.349480] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-23T19:37:34.514036] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-23T19:37:34.713886] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:34.883003] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-23T19:37:35.335504] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T19:37:35.682990] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-23T19:37:36.482979] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-23T19:37:36.992295] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-23T19:37:37.282981] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-23T19:37:37.427828] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T19:37:37.908242] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T19:37:38.082955] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-23T19:37:38.883035] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-23T19:37:39.401955] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-23T19:37:39.688099] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-23T19:37:39.700708] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T19:37:40.120676] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-23T19:37:40.482937] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-23T19:37:41.003984] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-23T19:37:41.004940] [INFO ] [REMOTE ] AFGC: Full fetch complete (3565 records). [2025-10-23T19:37:41.005033] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-23T19:37:41.288143] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-23T19:37:41.363074] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-23T19:37:41.363181] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-23T19:37:41.363352] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-23T19:37:41.363450] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-23T19:37:41.363713] [FATAL] [LOCAL ] AFGC: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:41.363794] [FATAL] [MAIN ] AFGC: Failed to save primary data. [2025-10-23T19:37:41.363871] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:41.363973] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-23T19:37:41.364065] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-23T19:37:41.364146] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-10-23T19:37:41.364322] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-10-23T19:37:41.364497] [INFO ] [MAIN ] Update Progress: 47/2367 symbols completed. AFGC took 23.9s. Estimated remaining: 4h 12m 3s. Rate: 9.2 symbols/min [2025-10-23T19:37:41.531811] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:41.584319] [DEBUG] [LOCAL ] AG: Loaded 53644 existing records from primary storage. [2025-10-23T19:37:41.584700] [INFO ] [MAIN ] AG: Loaded 53644 existing records. [2025-10-23T19:37:41.774239] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:37:41.774448] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-23T19:37:41.774526] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-23T19:37:41.774859] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-23T19:37:41.774969] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-23T19:37:41.872684] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T19:37:42.098462] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-23T19:37:42.138531] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:42.882984] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-23T19:37:43.327848] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-23T19:37:43.682977] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-23T19:37:43.988238] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T19:37:44.482984] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-23T19:37:45.282941] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-23T19:37:45.591478] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T19:37:45.760425] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-23T19:37:46.082953] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-23T19:37:46.328507] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T19:37:46.492054] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-23T19:37:46.492878] [INFO ] [REMOTE ] AFGD: Full fetch complete (2716 records). [2025-10-23T19:37:46.492975] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-23T19:37:46.846618] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-23T19:37:46.846755] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-23T19:37:46.846875] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-23T19:37:46.846952] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-23T19:37:46.847254] [FATAL] [LOCAL ] AFGD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:46.847334] [FATAL] [MAIN ] AFGD: Failed to save primary data. [2025-10-23T19:37:46.847403] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:46.847486] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-23T19:37:46.847587] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-23T19:37:46.847691] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-23T19:37:46.847775] [DEBUG] [LOCAL ] AFGD: No derivative data file found to delete. [2025-10-23T19:37:46.847890] [INFO ] [MAIN ] Update Progress: 48/2367 symbols completed. AFGD took 25.5s. Estimated remaining: 4h 11m 7s. Rate: 9.2 symbols/min [2025-10-23T19:37:46.888152] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-23T19:37:47.020867] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:47.062775] [DEBUG] [LOCAL ] AGCO: Loaded 42149 existing records from primary storage. [2025-10-23T19:37:47.063137] [INFO ] [MAIN ] AGCO: Loaded 42149 existing records. [2025-10-23T19:37:47.239374] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:37:47.239601] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-23T19:37:47.239696] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-23T19:37:47.239983] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-23T19:37:47.240057] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-23T19:37:47.499744] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T19:37:47.609047] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:37:47.682916] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-23T19:37:48.482950] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-23T19:37:49.288043] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-23T19:37:49.300064] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T19:37:50.082954] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-23T19:37:50.380110] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T19:37:50.882960] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-23T19:37:51.231604] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T19:37:51.377053] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T19:37:51.581585] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T19:37:51.682965] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-23T19:37:52.482946] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-23T19:37:53.000964] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-23T19:37:53.229498] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T19:37:53.282945] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-23T19:37:54.082973] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-23T19:37:54.890674] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-23T19:37:54.893255] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T19:37:55.236493] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-23T19:37:55.682945] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-23T19:37:55.963578] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T19:37:56.482962] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-23T19:37:57.053080] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T19:37:57.282951] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-23T19:37:58.082975] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-23T19:37:58.186401] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T19:37:58.432460] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-23T19:37:58.747818] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T19:37:58.882959] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-23T19:37:59.389428] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T19:37:59.390261] [INFO ] [REMOTE ] AFGE: Full fetch complete (3319 records). [2025-10-23T19:37:59.390371] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-23T19:37:59.688150] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-23T19:37:59.755144] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-23T19:37:59.755238] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-23T19:37:59.755389] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-23T19:37:59.755466] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-23T19:37:59.755703] [FATAL] [LOCAL ] AFGE: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:37:59.755782] [FATAL] [MAIN ] AFGE: Failed to save primary data. [2025-10-23T19:37:59.755846] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:37:59.755927] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-23T19:37:59.756015] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-10-23T19:37:59.756082] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-10-23T19:37:59.756229] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-10-23T19:37:59.756355] [INFO ] [MAIN ] Update Progress: 49/2367 symbols completed. AFGE took 34.3s. Estimated remaining: 4h 16m 4s. Rate: 9.1 symbols/min [2025-10-23T19:37:59.927886] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:37:59.953301] [DEBUG] [LOCAL ] AGD: Loaded 19283 existing records from primary storage. [2025-10-23T19:37:59.953579] [INFO ] [MAIN ] AGD: Loaded 19283 existing records. [2025-10-23T19:38:00.133422] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:00.133593] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-23T19:38:00.133702] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-23T19:38:00.133903] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-23T19:38:00.133977] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-23T19:38:00.493312] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:00.488352] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-23T19:38:01.282929] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-23T19:38:01.398546] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T19:38:01.988004] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T19:38:02.082920] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-23T19:38:02.653159] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-23T19:38:02.882989] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-23T19:38:03.050112] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T19:38:03.682972] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-23T19:38:04.431422] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T19:38:04.473012] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T19:38:04.482911] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-23T19:38:05.282965] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-23T19:38:05.732586] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T19:38:06.083010] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-23T19:38:06.882998] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-23T19:38:07.040104] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T19:38:07.253085] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T19:38:07.682952] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-23T19:38:08.482981] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-23T19:38:08.791184] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T19:38:09.282959] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-23T19:38:09.352726] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T19:38:09.932146] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T19:38:10.082921] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-23T19:38:10.882954] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-23T19:38:11.158409] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T19:38:11.682942] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-23T19:38:11.800550] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T19:38:11.807967] [INFO ] [REMOTE ] AGCO: Full fetch complete (61585 records). [2025-10-23T19:38:11.808133] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-23T19:38:12.092941] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T19:38:12.220954] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-23T19:38:12.221062] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-23T19:38:12.221780] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-23T19:38:12.221877] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-23T19:38:12.222469] [FATAL] [LOCAL ] AGCO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:12.222557] [FATAL] [MAIN ] AGCO: Failed to save primary data. [2025-10-23T19:38:12.222670] [WARN ] [MAIN ] AGCO: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:12.222781] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-23T19:38:12.222948] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-23T19:38:12.223031] [INFO ] [LOCAL ] AGCO: Starting deletion of derivative data. [2025-10-23T19:38:12.223269] [DEBUG] [LOCAL ] AGCO: Deleted derivative data file. [2025-10-23T19:38:12.223555] [INFO ] [MAIN ] Update Progress: 50/2367 symbols completed. AGCO took 25.4s. Estimated remaining: 4h 20m 28s. Rate: 8.9 symbols/min [2025-10-23T19:38:12.389602] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:12.445537] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-23T19:38:12.445922] [INFO ] [MAIN ] AGI: Loaded 53423 existing records. [2025-10-23T19:38:12.491216] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-23T19:38:12.645427] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:12.645707] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-23T19:38:12.645802] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-23T19:38:12.646117] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-23T19:38:12.646207] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-23T19:38:12.996895] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:13.282983] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-23T19:38:13.587238] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T19:38:13.596581] [INFO ] [REMOTE ] AFL: Full fetch complete (77072 records). [2025-10-23T19:38:13.596761] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-23T19:38:13.723585] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T19:38:13.994523] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-23T19:38:13.994628] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-23T19:38:13.995415] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-23T19:38:13.995494] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-23T19:38:13.996124] [FATAL] [LOCAL ] AFL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:13.996206] [FATAL] [MAIN ] AFL: Failed to save primary data. [2025-10-23T19:38:13.996274] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:13.996389] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-23T19:38:13.996491] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-23T19:38:13.996566] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-10-23T19:38:13.996805] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-10-23T19:38:13.997044] [INFO ] [MAIN ] Update Progress: 51/2367 symbols completed. AFL took 40.1s. Estimated remaining: 4h 16m 35s. Rate: 9.0 symbols/min [2025-10-23T19:38:14.088174] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-23T19:38:14.167337] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:14.215787] [DEBUG] [LOCAL ] AGL: Loaded 52595 existing records from primary storage. [2025-10-23T19:38:14.216121] [INFO ] [MAIN ] AGL: Loaded 52595 existing records. [2025-10-23T19:38:14.394833] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:14.395969] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-23T19:38:14.396048] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-23T19:38:14.397072] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-23T19:38:14.397150] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-23T19:38:14.740933] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:14.882910] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-23T19:38:15.246460] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T19:38:15.419154] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-23T19:38:15.682992] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-23T19:38:16.415708] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T19:38:16.436499] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T19:38:16.482909] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-23T19:38:17.282923] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-23T19:38:17.517083] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T19:38:18.083065] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-23T19:38:18.804515] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T19:38:18.882917] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-23T19:38:19.255535] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T19:38:19.260010] [INFO ] [REMOTE ] AGD: Full fetch complete (26634 records). [2025-10-23T19:38:19.260107] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-23T19:38:19.621045] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-23T19:38:19.621165] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-23T19:38:19.621541] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-23T19:38:19.621620] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-23T19:38:19.621979] [FATAL] [LOCAL ] AGD: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:19.622062] [FATAL] [MAIN ] AGD: Failed to save primary data. [2025-10-23T19:38:19.622134] [WARN ] [MAIN ] AGD: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:19.622361] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-23T19:38:19.622454] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-23T19:38:19.622541] [INFO ] [LOCAL ] AGD: Starting deletion of derivative data. [2025-10-23T19:38:19.622738] [DEBUG] [LOCAL ] AGD: Deleted derivative data file. [2025-10-23T19:38:19.622854] [INFO ] [MAIN ] Update Progress: 52/2367 symbols completed. AGD took 19.9s. Estimated remaining: 4h 15m 43s. Rate: 9.1 symbols/min [2025-10-23T19:38:19.688092] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-23T19:38:19.795624] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:19.810318] [DEBUG] [LOCAL ] AGM: Loaded 10617 existing records from primary storage. [2025-10-23T19:38:19.810547] [INFO ] [MAIN ] AGM: Loaded 10617 existing records. [2025-10-23T19:38:19.981579] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:19.981814] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-23T19:38:19.981895] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-23T19:38:19.982114] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-23T19:38:19.982188] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-23T19:38:20.329241] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:20.482908] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-23T19:38:20.562680] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T19:38:21.141579] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T19:38:21.282917] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-23T19:38:21.525567] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T19:38:22.082961] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-23T19:38:22.799765] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T19:38:22.882940] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-23T19:38:23.661928] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T19:38:23.682914] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-23T19:38:24.416983] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T19:38:24.482918] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-23T19:38:24.955916] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T19:38:25.282939] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-23T19:38:25.977207] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T19:38:25.992807] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-23T19:38:26.082969] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-23T19:38:26.882954] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-23T19:38:27.683000] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-23T19:38:28.347149] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-23T19:38:28.482958] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-23T19:38:28.722942] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T19:38:29.282951] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-23T19:38:29.521820] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T19:38:30.082976] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-23T19:38:30.882940] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-23T19:38:31.040824] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T19:38:31.108812] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-23T19:38:31.118691] [INFO ] [REMOTE ] AG: Full fetch complete (77788 records). [2025-10-23T19:38:31.118901] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-23T19:38:31.514045] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-23T19:38:31.514172] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-23T19:38:31.514996] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-23T19:38:31.515078] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-23T19:38:31.515756] [FATAL] [LOCAL ] AG: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:31.515838] [FATAL] [MAIN ] AG: Failed to save primary data. [2025-10-23T19:38:31.515907] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:31.515982] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-23T19:38:31.516072] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-23T19:38:31.516145] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-10-23T19:38:31.516332] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-10-23T19:38:31.516798] [INFO ] [MAIN ] Update Progress: 53/2367 symbols completed. AG took 50.2s. Estimated remaining: 4h 19m 26s. Rate: 8.9 symbols/min [2025-10-23T19:38:31.610578] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-23T19:38:31.697681] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-23T19:38:31.702462] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:31.741508] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T19:38:31.773099] [DEBUG] [LOCAL ] AGO: Loaded 27710 existing records from primary storage. [2025-10-23T19:38:31.773392] [INFO ] [MAIN ] AGO: Loaded 27710 existing records. [2025-10-23T19:38:31.953735] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:31.953947] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-23T19:38:31.954031] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-23T19:38:31.954301] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-23T19:38:31.954380] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-23T19:38:32.314984] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:32.482936] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-23T19:38:33.282964] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-23T19:38:33.358252] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T19:38:33.425469] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T19:38:34.082982] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-23T19:38:34.114939] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T19:38:34.882981] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-23T19:38:35.682959] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-23T19:38:35.836379] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T19:38:35.988988] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T19:38:36.388503] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-23T19:38:36.482974] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-23T19:38:37.282939] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-23T19:38:37.520834] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T19:38:38.082956] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-23T19:38:38.882939] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-23T19:38:39.174694] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T19:38:39.562825] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T19:38:39.682924] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-23T19:38:40.135279] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T19:38:40.482959] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-23T19:38:41.282964] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-23T19:38:41.708685] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T19:38:42.082939] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-23T19:38:42.133675] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T19:38:42.179216] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T19:38:42.882968] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-23T19:38:43.525798] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T19:38:43.682964] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-23T19:38:44.482979] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-23T19:38:44.841752] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T19:38:44.986380] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-23T19:38:44.996424] [INFO ] [REMOTE ] AGI: Full fetch complete (77332 records). [2025-10-23T19:38:44.996580] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-23T19:38:45.300363] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-23T19:38:45.347930] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T19:38:45.409580] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-23T19:38:45.409708] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-23T19:38:45.410492] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-23T19:38:45.410573] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-23T19:38:45.411333] [FATAL] [LOCAL ] AGI: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:45.411433] [FATAL] [MAIN ] AGI: Failed to save primary data. [2025-10-23T19:38:45.411509] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:45.411591] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-23T19:38:45.411707] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-23T19:38:45.411806] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-23T19:38:45.411972] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-23T19:38:45.412467] [INFO ] [MAIN ] Update Progress: 54/2367 symbols completed. AGI took 33.2s. Estimated remaining: 4h 24m 27s. Rate: 8.7 symbols/min [2025-10-23T19:38:45.577639] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:45.608425] [DEBUG] [LOCAL ] AGRO: Loaded 32457 existing records from primary storage. [2025-10-23T19:38:45.608736] [INFO ] [MAIN ] AGRO: Loaded 32457 existing records. [2025-10-23T19:38:45.782473] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:45.782697] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-23T19:38:45.782789] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-23T19:38:45.783039] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-23T19:38:45.783109] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-23T19:38:46.091353] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-23T19:38:46.130432] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:46.882931] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-23T19:38:47.309390] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T19:38:47.398481] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-23T19:38:47.407698] [INFO ] [REMOTE ] AGL: Full fetch complete (75965 records). [2025-10-23T19:38:47.407847] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-23T19:38:47.688287] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-23T19:38:47.816402] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-23T19:38:47.816536] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-23T19:38:47.817475] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-23T19:38:47.817564] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-23T19:38:47.818307] [FATAL] [LOCAL ] AGL: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:47.818400] [FATAL] [MAIN ] AGL: Failed to save primary data. [2025-10-23T19:38:47.818474] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:47.818548] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-23T19:38:47.818666] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-23T19:38:47.818743] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-10-23T19:38:47.818943] [DEBUG] [LOCAL ] AGL: Deleted derivative data file. [2025-10-23T19:38:47.819341] [INFO ] [MAIN ] Update Progress: 55/2367 symbols completed. AGL took 33.8s. Estimated remaining: 4h 21m 13s. Rate: 8.9 symbols/min [2025-10-23T19:38:48.013484] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:48.050063] [DEBUG] [LOCAL ] AGX: Loaded 32652 existing records from primary storage. [2025-10-23T19:38:48.050408] [INFO ] [MAIN ] AGX: Loaded 32652 existing records. [2025-10-23T19:38:48.251599] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:48.252050] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-23T19:38:48.252151] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-23T19:38:48.270380] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-23T19:38:48.271411] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T19:38:48.271496] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-23T19:38:48.488381] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-23T19:38:48.623509] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T19:38:48.717089] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:49.282968] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-23T19:38:49.912558] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T19:38:50.082965] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-23T19:38:50.177259] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T19:38:50.180101] [INFO ] [REMOTE ] AGM: Full fetch complete (13342 records). [2025-10-23T19:38:50.180215] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-23T19:38:50.580469] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-23T19:38:50.580590] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-23T19:38:50.580885] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-23T19:38:50.580964] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-23T19:38:50.581232] [FATAL] [LOCAL ] AGM: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:50.581313] [FATAL] [MAIN ] AGM: Failed to save primary data. [2025-10-23T19:38:50.581391] [WARN ] [MAIN ] AGM: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:50.581478] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-23T19:38:50.581585] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-10-23T19:38:50.581693] [INFO ] [LOCAL ] AGM: Starting deletion of derivative data. [2025-10-23T19:38:50.581890] [DEBUG] [LOCAL ] AGM: Deleted derivative data file. [2025-10-23T19:38:50.582007] [INFO ] [MAIN ] Update Progress: 56/2367 symbols completed. AGM took 31.0s. Estimated remaining: 4h 18m 20s. Rate: 8.9 symbols/min [2025-10-23T19:38:50.750356] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:50.790323] [DEBUG] [LOCAL ] AHH: Loaded 40160 existing records from primary storage. [2025-10-23T19:38:50.790636] [INFO ] [MAIN ] AHH: Loaded 40160 existing records. [2025-10-23T19:38:50.888469] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-23T19:38:50.996732] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:38:50.997014] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-23T19:38:50.997088] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-23T19:38:50.997333] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-23T19:38:50.997409] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-23T19:38:51.355363] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:51.372570] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T19:38:51.682955] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-23T19:38:52.483015] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-23T19:38:52.540145] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T19:38:53.149977] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T19:38:53.282966] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-23T19:38:53.536405] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T19:38:54.082973] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-23T19:38:54.709555] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T19:38:54.882968] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-23T19:38:54.991533] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T19:38:55.683003] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-23T19:38:56.253521] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T19:38:56.483005] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-23T19:38:57.078874] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T19:38:57.084691] [INFO ] [REMOTE ] AGO: Full fetch complete (39747 records). [2025-10-23T19:38:57.084959] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-23T19:38:57.293779] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-23T19:38:57.496337] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-23T19:38:57.496518] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-23T19:38:57.497156] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-23T19:38:57.497248] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-23T19:38:57.498120] [FATAL] [LOCAL ] AGO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:38:57.498213] [FATAL] [MAIN ] AGO: Failed to save primary data. [2025-10-23T19:38:57.498284] [WARN ] [MAIN ] AGO: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:38:57.498360] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-23T19:38:57.498464] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-23T19:38:57.498542] [INFO ] [LOCAL ] AGO: Starting deletion of derivative data. [2025-10-23T19:38:57.498969] [DEBUG] [LOCAL ] AGO: Deleted derivative data file. [2025-10-23T19:38:57.499107] [INFO ] [MAIN ] Update Progress: 57/2367 symbols completed. AGO took 26.0s. Estimated remaining: 4h 18m 22s. Rate: 8.9 symbols/min [2025-10-23T19:38:57.686545] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:38:57.687151] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-23T19:38:57.687312] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-23T19:38:57.687443] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-23T19:38:57.687519] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-23T19:38:57.687602] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-23T19:38:57.687699] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-23T19:38:58.091765] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-23T19:38:58.118149] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T19:38:58.153445] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:38:58.711374] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T19:38:58.882933] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-23T19:38:59.640487] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T19:38:59.682923] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-23T19:39:00.495287] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-23T19:39:00.498792] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T19:39:01.100127] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T19:39:01.283222] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-23T19:39:02.082957] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-23T19:39:02.152088] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T19:39:02.288294] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:39:02.288607] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-23T19:39:02.288713] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:39:02.288802] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-23T19:39:02.288872] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:39:02.288956] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-23T19:39:02.289048] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-23T19:39:02.289117] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-23T19:39:02.289196] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-23T19:39:02.289277] [INFO ] [MAIN ] Update Progress: 58/2367 symbols completed. AHL took 4.8s. Estimated remaining: 4h 16m 59s. Rate: 9.0 symbols/min [2025-10-23T19:39:02.486946] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:39:02.487349] [DEBUG] [LOCAL ] AHR: No existing data file found in primary storage. [2025-10-23T19:39:02.487425] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-10-23T19:39:02.487518] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-23T19:39:02.487587] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-23T19:39:02.487682] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-23T19:39:02.487758] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-23T19:39:02.726980] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T19:39:02.887905] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-23T19:39:02.893244] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:39:03.682948] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-23T19:39:04.283208] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T19:39:04.482986] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-23T19:39:04.860553] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T19:39:05.282936] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-23T19:39:06.085835] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-23T19:39:06.088558] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T19:39:06.884167] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T19:39:06.883184] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-23T19:39:07.250879] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T19:39:07.682959] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-23T19:39:08.456018] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T19:39:08.482916] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-23T19:39:08.617780] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T19:39:09.282971] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-23T19:39:10.002527] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T19:39:10.082945] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-23T19:39:10.740457] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T19:39:10.882935] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-23T19:39:11.633784] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T19:39:11.682930] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-23T19:39:12.299369] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T19:39:12.482972] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-23T19:39:13.125630] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T19:39:13.282942] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-23T19:39:13.735247] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T19:39:14.083003] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-23T19:39:14.360018] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T19:39:14.882960] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-23T19:39:15.591473] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T19:39:15.682915] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-23T19:39:16.418741] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T19:39:16.482916] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-23T19:39:17.263963] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T19:39:17.269792] [INFO ] [REMOTE ] AGX: Full fetch complete (48919 records). [2025-10-23T19:39:17.269917] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-23T19:39:17.288213] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-23T19:39:17.702543] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-23T19:39:17.702704] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-23T19:39:17.703348] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-23T19:39:17.703432] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-23T19:39:17.704019] [FATAL] [LOCAL ] AGX: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:39:17.704103] [FATAL] [MAIN ] AGX: Failed to save primary data. [2025-10-23T19:39:17.704173] [WARN ] [MAIN ] AGX: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:39:17.704273] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-23T19:39:17.704384] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-23T19:39:17.704484] [INFO ] [LOCAL ] AGX: Starting deletion of derivative data. [2025-10-23T19:39:17.704707] [DEBUG] [LOCAL ] AGX: Deleted derivative data file. [2025-10-23T19:39:17.704983] [INFO ] [MAIN ] Update Progress: 59/2367 symbols completed. AGX took 29.9s. Estimated remaining: 4h 22m 34s. Rate: 8.8 symbols/min [2025-10-23T19:39:17.887972] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:39:17.899481] [DEBUG] [LOCAL ] AHT: Loaded 6358 existing records from primary storage. [2025-10-23T19:39:17.899741] [INFO ] [MAIN ] AHT: Loaded 6358 existing records. [2025-10-23T19:39:18.075204] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:39:18.075550] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-23T19:39:18.075788] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-23T19:39:18.076009] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-23T19:39:18.076087] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-23T19:39:18.106216] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-23T19:39:18.457262] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:39:18.459740] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T19:39:18.640273] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T19:39:18.647054] [INFO ] [REMOTE ] AHH: Full fetch complete (59447 records). [2025-10-23T19:39:18.647188] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-23T19:39:18.888025] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-23T19:39:19.040395] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-23T19:39:19.040549] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-23T19:39:19.041184] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-23T19:39:19.041264] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-23T19:39:19.041808] [FATAL] [LOCAL ] AHH: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:39:19.041889] [FATAL] [MAIN ] AHH: Failed to save primary data. [2025-10-23T19:39:19.041956] [WARN ] [MAIN ] AHH: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:39:19.042026] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-23T19:39:19.042116] [DEBUG] [LOCAL ] AHH: No primary data file found to delete. [2025-10-23T19:39:19.042189] [INFO ] [LOCAL ] AHH: Starting deletion of derivative data. [2025-10-23T19:39:19.042337] [DEBUG] [LOCAL ] AHH: Deleted derivative data file. [2025-10-23T19:39:19.042561] [INFO ] [MAIN ] Update Progress: 60/2367 symbols completed. AHH took 28.5s. Estimated remaining: 4h 18m 56s. Rate: 8.9 symbols/min [2025-10-23T19:39:19.220506] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:39:19.277754] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-23T19:39:19.278256] [INFO ] [MAIN ] AI: Loaded 53765 existing records. [2025-10-23T19:39:19.463672] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:39:19.463966] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-23T19:39:19.464143] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-23T19:39:19.481080] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-23T19:39:19.482052] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T19:39:19.482130] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-23T19:39:19.689973] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-23T19:39:19.854883] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:39:20.482997] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-23T19:39:20.654409] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T19:39:21.095600] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T19:39:21.282956] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-23T19:39:22.083025] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-23T19:39:22.761327] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-23T19:39:22.799830] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T19:39:22.806606] [INFO ] [REMOTE ] AGRO: Full fetch complete (48824 records). [2025-10-23T19:39:22.806857] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-23T19:39:22.887097] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-23T19:39:22.973350] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-23T19:39:23.242302] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-23T19:39:23.242422] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-23T19:39:23.242992] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-23T19:39:23.243072] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-23T19:39:23.243589] [FATAL] [LOCAL ] AGRO: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:39:23.243692] [FATAL] [MAIN ] AGRO: Failed to save primary data. [2025-10-23T19:39:23.243760] [WARN ] [MAIN ] AGRO: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:39:23.243847] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-23T19:39:23.243933] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-23T19:39:23.243983] [INFO ] [LOCAL ] AGRO: Starting deletion of derivative data. [2025-10-23T19:39:23.244139] [DEBUG] [LOCAL ] AGRO: Deleted derivative data file. [2025-10-23T19:39:23.244248] [INFO ] [MAIN ] Update Progress: 61/2367 symbols completed. AGRO took 37.8s. Estimated remaining: 4h 17m 14s. Rate: 9.0 symbols/min [2025-10-23T19:39:23.407792] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:39:23.458956] [DEBUG] [LOCAL ] AIG: Loaded 53459 existing records from primary storage. [2025-10-23T19:39:23.459275] [INFO ] [MAIN ] AIG: Loaded 53459 existing records. [2025-10-23T19:39:23.635210] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:39:23.635409] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-23T19:39:23.635482] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-23T19:39:23.635720] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-23T19:39:23.635792] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-23T19:39:23.688186] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-23T19:39:23.746348] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T19:39:24.013010] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:39:24.483016] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-23T19:39:25.051098] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T19:39:25.282991] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-23T19:39:25.435382] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T19:39:26.082959] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-23T19:39:26.776918] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-23T19:39:26.882953] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-23T19:39:27.024317] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T19:39:27.682952] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-23T19:39:28.483011] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-23T19:39:28.517237] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T19:39:29.114011] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T19:39:29.282939] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-23T19:39:29.518316] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T19:39:30.082950] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-23T19:39:30.882933] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-23T19:39:31.071479] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:39:31.648234] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T19:39:31.682937] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-23T19:39:31.917818] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T19:39:32.482959] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-23T19:39:33.283008] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-23T19:39:34.045738] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-23T19:39:34.082926] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-23T19:39:34.147576] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T19:39:34.882935] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-23T19:39:34.970294] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T19:39:34.978778] [INFO ] [REMOTE ] AHR: Full fetch complete (70787 records). [2025-10-23T19:39:34.978932] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-23T19:39:35.394323] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-23T19:39:35.394467] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-23T19:39:35.395328] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-23T19:39:35.395428] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-23T19:39:35.396134] [FATAL] [LOCAL ] AHR: Error saving primary data: Invalid comparison between dtype=datetime64[ns] and date [2025-10-23T19:39:35.396236] [FATAL] [MAIN ] AHR: Failed to save primary data. [2025-10-23T19:39:35.396334] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to save failure. [2025-10-23T19:39:35.396434] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-23T19:39:35.396577] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-23T19:39:35.396726] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-23T19:39:35.396851] [DEBUG] [LOCAL ] AHR: No derivative data file found to delete. [2025-10-23T19:39:35.397354] [INFO ] [MAIN ] Update Progress: 62/2367 symbols completed. AHR took 33.1s. Estimated remaining: 4h 20m 30s. Rate: 8.8 symbols/min [2025-10-23T19:39:35.581267] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:39:35.581463] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-23T19:39:35.581548] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-23T19:39:35.581759] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-23T19:39:35.581832] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-23T19:39:35.581927] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-23T19:39:35.582009] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-23T19:39:35.650599] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T19:39:35.690347] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-23T19:39:35.960234] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:39:36.030374] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T19:39:36.482944] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-23T19:39:37.282932] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-23T19:39:37.547695] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T19:39:38.082947] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-23T19:39:38.209312] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-23T19:39:38.475082] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T19:39:38.882950] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-23T19:39:39.689884] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-23T19:39:39.695406] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T19:39:40.482938] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-23T19:39:40.507568] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T19:39:40.674864] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:39:40.675177] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-23T19:39:40.675259] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:39:40.675334] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-23T19:39:40.675397] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:39:40.675468] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-23T19:39:40.675570] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-23T19:39:40.675669] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-23T19:39:40.675755] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-23T19:39:40.675853] [INFO ] [MAIN ] Update Progress: 63/2367 symbols completed. AII took 5.3s. Estimated remaining: 4h 19m 28s. Rate: 8.9 symbols/min [2025-10-23T19:39:40.848971] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:39:40.876976] [DEBUG] [LOCAL ] AIN: Loaded 24301 existing records from primary storage. [2025-10-23T19:39:40.877295] [INFO ] [MAIN ] AIN: Loaded 24301 existing records. [2025-10-23T19:39:40.888748] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-10-23T19:39:40.907706] [WARN ] [STATE ] Operation was interrupted, setting state to COMPLETED_ERROR [2025-10-23T19:39:40.938725] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-10-23T19:39:41.006850] [INFO ] [STATE ] Last completion updated: 2025-10-23T19:39:40.982579 [2025-10-23T19:39:41.088535] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:39:41.089240] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-23T19:39:41.089319] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-23T19:39:41.089597] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-23T19:39:41.089721] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-23T19:39:41.294712] [WARN ] [REMOTE ] AIG: Shutdown requested, aborting fetch for 2025-07 [2025-10-23T19:39:41.305732] [WARN ] [REMOTE ] AIG: Shutdown requested, stopping month iteration [2025-10-23T19:39:41.372289] [WARN ] [MAIN ] AIG: Shutdown requested, aborting refresh [2025-10-23T19:39:41.404940] [WARN ] [MAIN ] Main thread: Shutdown detected, cancelling 3 pending tasks [2025-10-23T19:39:41.410486] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-10-23T19:39:41.453506] [WARN ] [REMOTE ] AI: Shutdown requested, stopping month iteration [2025-10-23T19:39:41.468670] [WARN ] [MAIN ] AI: Shutdown requested, aborting refresh [2025-10-23T19:39:41.506555] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:39:41.506689] [WARN ] [REMOTE ] AIN: Shutdown requested, stopping month iteration [2025-10-23T19:39:41.506773] [WARN ] [MAIN ] AIN: Shutdown requested, aborting refresh [2025-10-23T19:40:02.477113] [INFO ] [MAIN ] Using last completed trading day: 2025-10-23 [2025-10-23T19:40:02.662754] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-23T19:40:02.662969] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-23T19:40:02.672823] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-23T19:40:02.673162] [WARN ] [STATE ] State set to: RUNNING [2025-10-23T19:40:02.673229] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-23T19:40:02.673273] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-23T19:40:02.673383] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-23T19:40:02.673468] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-23T19:40:04.132370] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-23T19:40:04.132509] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-23T19:40:04.132733] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-23T19:40:04.133221] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-23T19:40:04.133288] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-23T19:40:04.133324] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-23T19:40:04.133382] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-23T19:40:04.133417] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-23T19:40:04.133449] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-23T19:40:04.133834] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-23T19:40:04.133898] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-23T19:40:04.134056] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-23T19:40:04.134091] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-23T19:40:04.134124] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-23T19:40:04.134158] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-23T19:40:04.163955] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-23T19:40:04.193577] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-23T19:40:04.193802] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-23T19:40:04.193882] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-23T19:40:04.193953] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-23T19:40:04.194061] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-23T19:40:04.194499] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-23T19:40:04.194573] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-23T19:40:04.194676] [INFO ] [MAIN ] Starting incremental update for 2367 symbols. [2025-10-23T19:40:04.194748] [INFO ] [MAIN ] Running in parallel mode [2025-10-23T19:40:04.194902] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2367 symbols [2025-10-23T19:40:04.937081] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:04.937357] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-23T19:40:04.937441] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-23T19:40:04.937597] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-23T19:40:04.942744] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:04.942862] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-23T19:40:04.942905] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-23T19:40:04.942971] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-23T19:40:04.943012] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-23T19:40:04.943056] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-23T19:40:04.943093] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-23T19:40:04.948101] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-23T19:40:04.948185] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-23T19:40:04.948225] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-23T19:40:04.984718] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:05.004493] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-23T19:40:05.004591] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-23T19:40:05.004705] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-23T19:40:05.004798] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-23T19:40:05.004910] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-23T19:40:05.005004] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-23T19:40:05.023715] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:05.034465] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-23T19:40:05.044903] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-23T19:40:05.047926] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-23T19:40:05.051844] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-23T19:40:05.051985] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-23T19:40:05.052109] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-23T19:40:06.378538] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:06.399307] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-23T19:40:06.386883] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:06.422055] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-23T19:40:06.424417] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:06.424677] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-23T19:40:06.429860] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:06.430200] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-23T19:40:06.831694] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-23T19:40:06.832706] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-23T19:40:07.128270] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-23T19:40:07.130319] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-23T19:40:07.490620] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-23T19:40:07.501597] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-23T19:40:07.501970] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T19:40:07.507448] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-23T19:40:07.812849] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T19:40:07.822711] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-23T19:40:07.831427] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T19:40:07.832501] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-23T19:40:08.328807] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-23T19:40:08.335683] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-23T19:40:08.336094] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T19:40:08.341052] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-23T19:40:08.586977] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-23T19:40:08.588198] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-23T19:40:08.855745] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-23T19:40:08.856789] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-23T19:40:08.876389] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-23T19:40:08.888673] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-23T19:40:09.414678] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T19:40:09.419756] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-23T19:40:09.540820] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-23T19:40:09.541924] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-23T19:40:09.578036] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T19:40:09.587527] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-23T19:40:09.856912] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-23T19:40:09.858094] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-23T19:40:10.132831] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-23T19:40:10.133526] [INFO ] [REMOTE ] AAM: Full fetch complete (913 records). [2025-10-23T19:40:10.133602] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-23T19:40:10.348793] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-23T19:40:10.348992] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-23T19:40:10.349034] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-23T19:40:10.349075] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-23T19:40:10.349134] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-23T19:40:10.349174] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-23T19:40:10.349215] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-23T19:40:10.349278] [INFO ] [MAIN ] Update Progress: 1/2367 symbols completed. AAM took 6.1s. Estimated remaining: 4h 2m 41s. Rate: 9.7 symbols/min [2025-10-23T19:40:10.367486] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T19:40:10.386984] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-23T19:40:10.572617] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:10.572873] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-10-23T19:40:10.572934] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-10-23T19:40:10.573014] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-23T19:40:10.573056] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-23T19:40:10.573101] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-23T19:40:10.573137] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-23T19:40:10.579420] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T19:40:10.600109] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-23T19:40:10.949135] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:10.949447] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-23T19:40:11.137726] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T19:40:11.151385] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-23T19:40:11.245049] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T19:40:11.250845] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-23T19:40:12.277677] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T19:40:12.287580] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-23T19:40:12.312539] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T19:40:12.317679] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-23T19:40:12.501497] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T19:40:12.513086] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-23T19:40:12.586307] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T19:40:12.602219] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-23T19:40:13.324717] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-23T19:40:13.333419] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-23T19:40:14.084074] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T19:40:14.091752] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-23T19:40:14.126174] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T19:40:14.138633] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-23T19:40:14.218489] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T19:40:14.229456] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-23T19:40:14.641788] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T19:40:14.652814] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-23T19:40:14.950987] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T19:40:14.960318] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-23T19:40:15.317409] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-23T19:40:15.321550] [INFO ] [REMOTE ] AAMI: Full fetch complete (33079 records). [2025-10-23T19:40:15.321729] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-23T19:40:15.613335] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T19:40:15.634786] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-23T19:40:15.818551] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-23T19:40:15.818678] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-23T19:40:15.819025] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-23T19:40:15.819075] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-23T19:40:15.819857] [DEBUG] [LOCAL ] AAMI: Trimmed 33079 records to 24527 (keeping 200 days of data) [2025-10-23T19:40:15.959944] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T19:40:15.970107] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-23T19:40:16.019982] [DEBUG] [LOCAL ] AAMI: Primary data saved (24527 records). [2025-10-23T19:40:16.020141] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-23T19:40:16.020221] [INFO ] [MAIN ] Update Progress: 2/2367 symbols completed. AAMI took 11.8s. Estimated remaining: 3h 53m 3s. Rate: 10.1 symbols/min [2025-10-23T19:40:16.193008] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:16.193240] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-23T19:40:16.193290] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-23T19:40:16.193363] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-23T19:40:16.193403] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-23T19:40:16.193466] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-23T19:40:16.193504] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-23T19:40:16.364279] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T19:40:16.379821] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-23T19:40:16.637411] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:16.637736] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-23T19:40:17.062396] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T19:40:17.073359] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-23T19:40:17.621720] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T19:40:17.633893] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-23T19:40:17.938323] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T19:40:17.949397] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-23T19:40:17.964875] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T19:40:17.973727] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-23T19:40:19.070874] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-23T19:40:19.084445] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-23T19:40:19.284954] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T19:40:19.295762] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-23T19:40:19.317621] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T19:40:19.326381] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-23T19:40:19.882466] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T19:40:19.894323] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-23T19:40:20.502275] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T19:40:20.512769] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-23T19:40:20.619461] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T19:40:20.630277] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-23T19:40:20.729369] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T19:40:20.735974] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-23T19:40:21.555136] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T19:40:21.567702] [INFO ] [REMOTE ] A: Full fetch complete (73575 records). [2025-10-23T19:40:21.567920] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-23T19:40:21.956209] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T19:40:21.974949] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-23T19:40:22.009309] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-23T19:40:22.009393] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-23T19:40:22.010065] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-23T19:40:22.010354] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-23T19:40:22.012687] [DEBUG] [LOCAL ] A: Trimmed 73575 records to 51001 (keeping 200 days of data) [2025-10-23T19:40:22.248977] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T19:40:22.273701] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-23T19:40:22.392347] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T19:40:22.406567] [DEBUG] [LOCAL ] A: Primary data saved (51001 records). [2025-10-23T19:40:22.406771] [INFO ] [MAIN ] A: Full history saved. [2025-10-23T19:40:22.406941] [INFO ] [MAIN ] Update Progress: 3/2367 symbols completed. A took 18.2s. Estimated remaining: 3h 59m 11s. Rate: 9.9 symbols/min [2025-10-23T19:40:22.418940] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-23T19:40:22.593462] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:22.593672] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-23T19:40:22.593756] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-23T19:40:22.593843] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-23T19:40:22.593904] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-23T19:40:22.593959] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-23T19:40:22.594006] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-23T19:40:22.939952] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:22.940293] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-23T19:40:23.535821] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:40:23.536154] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-23T19:40:23.536246] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:40:23.536442] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-23T19:40:23.536520] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:40:23.536609] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-23T19:40:23.536734] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-23T19:40:23.536807] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-23T19:40:23.536894] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-23T19:40:23.536984] [INFO ] [MAIN ] Update Progress: 4/2367 symbols completed. AAUC took 1.1s. Estimated remaining: 3h 10m 26s. Rate: 12.4 symbols/min [2025-10-23T19:40:23.626219] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T19:40:23.632852] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-23T19:40:23.758470] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T19:40:23.783206] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:23.783386] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-23T19:40:23.783427] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-23T19:40:23.783499] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-23T19:40:23.783540] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-23T19:40:23.783583] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-23T19:40:23.783620] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-23T19:40:23.790133] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-23T19:40:24.165266] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:24.170010] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-23T19:40:24.177279] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T19:40:24.190457] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-23T19:40:24.684238] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T19:40:24.695924] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-23T19:40:24.696100] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-23T19:40:24.987606] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T19:40:25.006148] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-23T19:40:25.111098] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-23T19:40:25.111194] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-23T19:40:25.111883] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-23T19:40:25.111957] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-23T19:40:25.113360] [DEBUG] [LOCAL ] AA: Trimmed 77733 records to 54012 (keeping 200 days of data) [2025-10-23T19:40:25.431403] [DEBUG] [LOCAL ] AA: Primary data saved (54012 records). [2025-10-23T19:40:25.431549] [INFO ] [MAIN ] AA: Full history saved. [2025-10-23T19:40:25.431622] [INFO ] [MAIN ] Update Progress: 5/2367 symbols completed. AA took 21.2s. Estimated remaining: 2h 47m 12s. Rate: 14.1 symbols/min [2025-10-23T19:40:25.582150] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T19:40:25.589745] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-23T19:40:25.633344] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:25.633526] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-23T19:40:25.633568] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-23T19:40:25.633662] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-23T19:40:25.633733] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-23T19:40:25.633792] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-23T19:40:25.633834] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-23T19:40:25.880625] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T19:40:25.909382] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-23T19:40:26.039360] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T19:40:26.085791] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-23T19:40:26.117932] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:26.118284] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-23T19:40:26.770508] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T19:40:26.779493] [INFO ] [REMOTE ] AAP: Full fetch complete (75085 records). [2025-10-23T19:40:26.779827] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-23T19:40:27.202402] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-23T19:40:27.202523] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-23T19:40:27.203293] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-23T19:40:27.203386] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-23T19:40:27.206328] [DEBUG] [LOCAL ] AAP: Trimmed 75085 records to 52090 (keeping 200 days of data) [2025-10-23T19:40:27.353042] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T19:40:27.361844] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-23T19:40:27.381862] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T19:40:27.389332] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-23T19:40:27.591485] [DEBUG] [LOCAL ] AAP: Primary data saved (52090 records). [2025-10-23T19:40:27.591664] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-23T19:40:27.591772] [INFO ] [MAIN ] Update Progress: 6/2367 symbols completed. AAP took 17.2s. Estimated remaining: 2h 33m 27s. Rate: 15.4 symbols/min [2025-10-23T19:40:27.782059] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:27.782266] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-23T19:40:27.782309] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-23T19:40:27.782385] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-23T19:40:27.782426] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-23T19:40:27.782471] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-23T19:40:27.782508] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-23T19:40:28.181290] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T19:40:28.224960] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-23T19:40:28.405639] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:28.406390] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-23T19:40:28.671325] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T19:40:28.686208] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-23T19:40:28.719556] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T19:40:28.730385] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-23T19:40:29.429243] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T19:40:29.436760] [INFO ] [REMOTE ] AAT: Full fetch complete (43066 records). [2025-10-23T19:40:29.436959] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-23T19:40:29.746546] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T19:40:29.765500] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-23T19:40:29.878934] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-23T19:40:29.879054] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-23T19:40:29.879661] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-23T19:40:29.879742] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-23T19:40:29.881092] [DEBUG] [LOCAL ] AAT: Trimmed 43066 records to 30402 (keeping 200 days of data) [2025-10-23T19:40:30.019892] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T19:40:30.082347] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-23T19:40:30.129976] [DEBUG] [LOCAL ] AAT: Primary data saved (30402 records). [2025-10-23T19:40:30.130162] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-23T19:40:30.130263] [INFO ] [MAIN ] Update Progress: 7/2367 symbols completed. AAT took 14.1s. Estimated remaining: 2h 25m 44s. Rate: 16.2 symbols/min [2025-10-23T19:40:30.225421] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T19:40:30.236898] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-23T19:40:30.389362] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:30.389528] [DEBUG] [LOCAL ] ABEV: No existing data file found in primary storage. [2025-10-23T19:40:30.389698] [WARN ] [MAIN ] ABEV: No existing data found, performing full refresh instead. [2025-10-23T19:40:30.389868] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-23T19:40:30.389992] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-23T19:40:30.390067] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-23T19:40:30.390193] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-23T19:40:30.637107] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T19:40:30.654914] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-23T19:40:30.812349] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:30.812718] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-23T19:40:31.512288] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T19:40:31.522006] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-23T19:40:31.983337] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T19:40:31.994807] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-23T19:40:32.158037] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T19:40:32.166573] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-23T19:40:32.231315] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-23T19:40:32.236330] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-23T19:40:32.744517] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T19:40:32.757236] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-23T19:40:33.368559] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T19:40:33.377892] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-23T19:40:33.524413] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T19:40:33.535856] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-23T19:40:33.818120] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T19:40:33.835928] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-23T19:40:34.128049] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T19:40:34.143312] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-23T19:40:34.414020] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T19:40:34.421463] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-23T19:40:34.498551] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T19:40:34.507336] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-23T19:40:35.545456] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T19:40:35.558520] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-23T19:40:35.573032] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T19:40:35.579091] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-23T19:40:35.816925] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T19:40:35.828218] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-23T19:40:35.861540] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T19:40:35.872677] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-23T19:40:36.320251] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T19:40:36.324339] [INFO ] [REMOTE ] AB: Full fetch complete (43963 records). [2025-10-23T19:40:36.324444] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-23T19:40:36.732247] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-23T19:40:36.732337] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-23T19:40:36.732790] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-23T19:40:36.732929] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-23T19:40:36.733930] [DEBUG] [LOCAL ] AB: Trimmed 43963 records to 24773 (keeping 200 days of data) [2025-10-23T19:40:36.848363] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T19:40:36.859981] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-23T19:40:36.912947] [DEBUG] [LOCAL ] AB: Primary data saved (24773 records). [2025-10-23T19:40:36.913238] [INFO ] [MAIN ] AB: Full history saved. [2025-10-23T19:40:36.913398] [INFO ] [MAIN ] Update Progress: 8/2367 symbols completed. AB took 13.4s. Estimated remaining: 2h 40m 48s. Rate: 14.7 symbols/min [2025-10-23T19:40:37.090351] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:37.090559] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-23T19:40:37.090603] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-23T19:40:37.090748] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-23T19:40:37.090811] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-23T19:40:37.090858] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-23T19:40:37.090897] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-23T19:40:37.393574] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T19:40:37.425484] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-23T19:40:37.510667] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:37.511063] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-23T19:40:37.609247] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T19:40:37.625215] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-23T19:40:37.758674] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-23T19:40:37.765406] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-23T19:40:38.545505] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T19:40:38.551780] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-23T19:40:39.057701] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T19:40:39.064633] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-23T19:40:39.165073] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T19:40:39.177448] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-23T19:40:39.450739] [DEBUG] [REMOTE ] ABEV: Error fetching primary data for 2025-06: Thank you for using Alpha Vantage! Please contact premium@alphavantage.co if you are targeting a higher API call volume. [2025-10-23T19:40:39.451065] [WARN ] [REMOTE ] ABEV: No data returned for month 2025-06 [2025-10-23T19:40:39.452720] [FATAL] [REMOTE ] ABEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:40:39.452920] [FATAL] [MAIN ] ABEV: Failed to fetch primary data. [2025-10-23T19:40:39.453099] [WARN ] [MAIN ] ABEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:40:39.453167] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-23T19:40:39.453330] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-23T19:40:39.453462] [INFO ] [LOCAL ] ABEV: Starting deletion of derivative data. [2025-10-23T19:40:39.453573] [DEBUG] [LOCAL ] ABEV: No derivative data file found to delete. [2025-10-23T19:40:39.453730] [INFO ] [MAIN ] Update Progress: 9/2367 symbols completed. ABEV took 9.3s. Estimated remaining: 2h 33m 58s. Rate: 15.3 symbols/min [2025-10-23T19:40:39.612809] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T19:40:39.624887] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T19:40:39.625504] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-23T19:40:39.645828] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-23T19:40:39.701116] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T19:40:39.716620] [INFO ] [REMOTE ] ABCB: Full fetch complete (44931 records). [2025-10-23T19:40:39.716798] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-23T19:40:39.758598] [DEBUG] [REMOTE ] ABG: Error fetching primary data for 2025-03: Thank you for using Alpha Vantage! Please contact premium@alphavantage.co if you are targeting a higher API call volume. [2025-10-23T19:40:39.761112] [WARN ] [REMOTE ] ABG: No data returned for month 2025-03 [2025-10-23T19:40:39.761292] [FATAL] [REMOTE ] ABG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:40:39.761442] [FATAL] [MAIN ] ABG: Failed to fetch primary data. [2025-10-23T19:40:39.761564] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:40:39.761729] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-23T19:40:39.761875] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-23T19:40:39.762001] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-23T19:40:39.762138] [DEBUG] [LOCAL ] ABG: No derivative data file found to delete. [2025-10-23T19:40:39.762276] [INFO ] [MAIN ] Update Progress: 10/2367 symbols completed. ABG took 2.8s. Estimated remaining: 2h 19m 43s. Rate: 16.9 symbols/min [2025-10-23T19:40:39.760805] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:39.767612] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-23T19:40:39.781562] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-23T19:40:39.781735] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-23T19:40:39.781802] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-23T19:40:39.781872] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-23T19:40:39.781919] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-23T19:40:39.910066] [DEBUG] [REMOTE ] ABBV: Error fetching primary data for 2025-08: Thank you for using Alpha Vantage! Please contact premium@alphavantage.co if you are targeting a higher API call volume. [2025-10-23T19:40:39.910521] [WARN ] [REMOTE ] ABBV: No data returned for month 2025-08 [2025-10-23T19:40:39.910702] [FATAL] [REMOTE ] ABBV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:40:39.944420] [FATAL] [MAIN ] ABBV: Failed to fetch primary data. [2025-10-23T19:40:39.944508] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:40:39.944561] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-23T19:40:39.944629] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-23T19:40:39.980266] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-23T19:40:39.980520] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-23T19:40:39.980683] [INFO ] [MAIN ] Update Progress: 11/2367 symbols completed. ABBV took 14.5s. Estimated remaining: 2h 7m 45s. Rate: 18.4 symbols/min [2025-10-23T19:40:40.444555] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:40.444765] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-10-23T19:40:40.444821] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-10-23T19:40:40.444947] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-23T19:40:40.445012] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-23T19:40:40.445064] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-23T19:40:40.445107] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-23T19:40:40.829924] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:40.842865] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-23T19:40:40.842922] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-23T19:40:40.843000] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-23T19:40:40.843040] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-23T19:40:40.843087] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-23T19:40:40.843123] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-23T19:40:41.086875] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:41.087243] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-23T19:40:41.111363] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-23T19:40:41.111462] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-23T19:40:41.111926] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-23T19:40:41.112006] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-23T19:40:41.115971] [DEBUG] [LOCAL ] ABCB: Trimmed 44931 records to 30498 (keeping 200 days of data) [2025-10-23T19:40:41.666049] [DEBUG] [LOCAL ] ABCB: Primary data saved (30498 records). [2025-10-23T19:40:41.666238] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-23T19:40:41.666335] [INFO ] [MAIN ] Update Progress: 12/2367 symbols completed. ABCB took 14.1s. Estimated remaining: 2h 2m 34s. Rate: 19.2 symbols/min [2025-10-23T19:40:41.804102] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:41.835053] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-23T19:40:41.948234] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:41.948564] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-23T19:40:42.007122] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:42.007268] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-23T19:40:42.007309] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-23T19:40:42.007379] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-23T19:40:42.007419] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-23T19:40:42.007469] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-23T19:40:42.007510] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-23T19:40:42.353484] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:42.353846] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-23T19:40:42.616307] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T19:40:42.622388] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-23T19:40:43.474042] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T19:40:43.481279] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-23T19:40:43.540598] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T19:40:43.547396] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-23T19:40:43.585145] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T19:40:43.599537] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-23T19:40:43.745525] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T19:40:43.760836] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-23T19:40:44.589369] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T19:40:44.599038] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-23T19:40:44.647711] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T19:40:44.654817] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-23T19:40:44.942389] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T19:40:44.955787] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-23T19:40:45.633933] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T19:40:45.647927] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-23T19:40:45.693893] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T19:40:45.702430] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-23T19:40:45.999588] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T19:40:46.007578] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-23T19:40:46.573990] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T19:40:46.587433] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-23T19:40:46.870865] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T19:40:46.877131] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-23T19:40:47.182186] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T19:40:47.193840] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-23T19:40:47.212405] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T19:40:47.219195] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-23T19:40:48.156049] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T19:40:48.163711] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-23T19:40:48.268003] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T19:40:48.291196] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T19:40:48.309477] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-23T19:40:48.312220] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-23T19:40:49.184039] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T19:40:49.187330] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T19:40:49.192707] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-23T19:40:49.202989] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-23T19:40:49.818184] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T19:40:49.826039] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-23T19:40:50.181312] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-23T19:40:50.189827] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-23T19:40:50.287929] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T19:40:50.302297] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-23T19:40:50.699716] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T19:40:50.714114] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-23T19:40:51.212272] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T19:40:51.229047] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-23T19:40:51.240685] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T19:40:51.246846] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-23T19:40:52.030180] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T19:40:52.041992] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-23T19:40:52.293166] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T19:40:52.298415] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-23T19:40:52.432467] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T19:40:52.444701] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-23T19:40:52.480855] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T19:40:52.492536] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-23T19:40:52.885256] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T19:40:52.893107] [INFO ] [REMOTE ] ABM: Full fetch complete (45103 records). [2025-10-23T19:40:52.893372] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-23T19:40:52.986025] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T19:40:52.992007] [INFO ] [REMOTE ] ACA: Full fetch complete (34259 records). [2025-10-23T19:40:52.992099] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-23T19:40:53.539630] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T19:40:53.601034] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-23T19:40:53.884237] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-23T19:40:53.884352] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-23T19:40:53.884930] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-23T19:40:53.892840] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-23T19:40:53.893770] [DEBUG] [LOCAL ] ACA: Trimmed 34259 records to 22636 (keeping 200 days of data) [2025-10-23T19:40:54.062073] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-23T19:40:54.062165] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-23T19:40:54.062627] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-23T19:40:54.064324] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-23T19:40:54.065403] [DEBUG] [LOCAL ] ABM: Trimmed 45103 records to 32319 (keeping 200 days of data) [2025-10-23T19:40:54.243349] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T19:40:54.344612] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-23T19:40:54.359033] [DEBUG] [LOCAL ] ACA: Primary data saved (22636 records). [2025-10-23T19:40:54.359246] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-23T19:40:54.359418] [INFO ] [MAIN ] Update Progress: 13/2367 symbols completed. ACA took 12.7s. Estimated remaining: 2h 31m 24s. Rate: 15.5 symbols/min [2025-10-23T19:40:54.363741] [DEBUG] [LOCAL ] ABM: Primary data saved (32319 records). [2025-10-23T19:40:54.363917] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-23T19:40:54.364009] [INFO ] [MAIN ] Update Progress: 14/2367 symbols completed. ABM took 14.9s. Estimated remaining: 2h 20m 32s. Rate: 16.7 symbols/min [2025-10-23T19:40:54.789188] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:54.792615] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-23T19:40:54.792715] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-23T19:40:54.792827] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-23T19:40:54.792893] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-23T19:40:54.792987] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-23T19:40:54.793063] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-23T19:40:54.823009] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:40:54.827953] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-23T19:40:54.828024] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-23T19:40:54.828144] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-23T19:40:54.828208] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-23T19:40:54.828265] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-23T19:40:54.828348] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-23T19:40:55.089995] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T19:40:55.209448] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-23T19:40:55.607194] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:55.607514] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-23T19:40:55.721872] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:40:55.732792] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T19:40:55.999441] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-23T19:40:56.690146] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T19:40:56.799404] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-23T19:40:56.993758] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T19:40:57.074782] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T19:40:57.599425] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-23T19:40:58.290621] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T19:40:58.399394] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-23T19:40:58.725993] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T19:40:59.199399] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-23T19:40:59.314879] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T19:40:59.324792] [INFO ] [REMOTE ] ABR: Full fetch complete (75391 records). [2025-10-23T19:40:59.324953] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-23T19:40:59.719370] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-23T19:40:59.719477] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-23T19:40:59.720196] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-23T19:40:59.720277] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-23T19:40:59.721741] [DEBUG] [LOCAL ] ABR: Trimmed 75391 records to 52253 (keeping 200 days of data) [2025-10-23T19:41:00.007692] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-23T19:41:00.029864] [DEBUG] [LOCAL ] ABR: Primary data saved (52253 records). [2025-10-23T19:41:00.030020] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-23T19:41:00.030096] [INFO ] [MAIN ] Update Progress: 15/2367 symbols completed. ABR took 20.3s. Estimated remaining: 2h 25m 55s. Rate: 16.1 symbols/min [2025-10-23T19:41:00.199420] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:00.199596] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-23T19:41:00.199638] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-23T19:41:00.199765] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-23T19:41:00.199815] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-23T19:41:00.199859] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-23T19:41:00.199894] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-23T19:41:00.478756] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T19:41:00.574421] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:00.799414] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-23T19:41:00.904685] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T19:41:00.914286] [INFO ] [REMOTE ] ABT: Full fetch complete (77771 records). [2025-10-23T19:41:00.914538] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-23T19:41:01.298358] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-23T19:41:01.298678] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-23T19:41:01.299505] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-23T19:41:01.299673] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-23T19:41:01.301399] [DEBUG] [LOCAL ] ABT: Trimmed 77771 records to 54014 (keeping 200 days of data) [2025-10-23T19:41:01.621704] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-23T19:41:01.650207] [DEBUG] [LOCAL ] ABT: Primary data saved (54014 records). [2025-10-23T19:41:01.650400] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-23T19:41:01.650484] [INFO ] [MAIN ] Update Progress: 16/2367 symbols completed. ABT took 21.7s. Estimated remaining: 2h 20m 42s. Rate: 16.7 symbols/min [2025-10-23T19:41:01.855397] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T19:41:01.878083] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:01.878282] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-23T19:41:01.878325] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-23T19:41:01.878399] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-23T19:41:01.878441] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-23T19:41:01.878486] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-23T19:41:01.878522] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-23T19:41:02.238017] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:02.399402] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-23T19:41:03.199403] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-23T19:41:03.571237] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T19:41:03.999397] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-23T19:41:04.326785] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-23T19:41:04.375103] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T19:41:04.799402] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-23T19:41:05.078917] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T19:41:05.599415] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-23T19:41:06.399406] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-23T19:41:06.570718] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T19:41:06.646491] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T19:41:07.199401] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-23T19:41:07.526403] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T19:41:07.999437] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-23T19:41:08.799434] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-23T19:41:09.399380] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T19:41:09.456613] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-23T19:41:09.599395] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-23T19:41:09.963244] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T19:41:10.399421] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-23T19:41:11.199403] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-23T19:41:11.485699] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T19:41:11.999531] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-23T19:41:12.223984] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-23T19:41:12.337050] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T19:41:12.799422] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-23T19:41:13.599417] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-23T19:41:13.829936] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T19:41:14.399417] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-23T19:41:14.899479] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T19:41:15.033240] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T19:41:15.037664] [INFO ] [REMOTE ] ACEL: Full fetch complete (38748 records). [2025-10-23T19:41:15.037772] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-23T19:41:15.204596] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-23T19:41:15.367052] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-23T19:41:15.502539] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-23T19:41:15.502637] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-23T19:41:15.503145] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-23T19:41:15.503199] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-23T19:41:15.504062] [DEBUG] [LOCAL ] ACEL: Trimmed 38748 records to 26458 (keeping 200 days of data) [2025-10-23T19:41:15.652120] [DEBUG] [LOCAL ] ACEL: Primary data saved (26458 records). [2025-10-23T19:41:15.652293] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-23T19:41:15.652522] [INFO ] [MAIN ] Update Progress: 17/2367 symbols completed. ACEL took 21.3s. Estimated remaining: 2h 44m 38s. Rate: 14.3 symbols/min [2025-10-23T19:41:15.822760] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:15.822951] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-23T19:41:15.823004] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-23T19:41:15.823079] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-23T19:41:15.823141] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-23T19:41:15.823188] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-23T19:41:15.823224] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-23T19:41:16.008795] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-23T19:41:16.189111] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:16.752364] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T19:41:16.799395] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-23T19:41:17.599441] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-23T19:41:17.865149] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T19:41:18.399406] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-23T19:41:18.724779] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-23T19:41:19.199419] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-23T19:41:19.446685] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T19:41:19.705518] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T19:41:19.999478] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-23T19:41:20.801312] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-23T19:41:20.813216] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T19:41:21.441280] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T19:41:21.599566] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-23T19:41:22.399398] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-23T19:41:22.479470] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T19:41:23.201694] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-23T19:41:23.215632] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T19:41:23.999434] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-23T19:41:24.799403] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-23T19:41:24.903575] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T19:41:25.009337] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-23T19:41:25.415323] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T19:41:25.599424] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-23T19:41:25.711107] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T19:41:25.717389] [INFO ] [REMOTE ] ACCO: Full fetch complete (53994 records). [2025-10-23T19:41:25.717505] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-23T19:41:26.093708] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-23T19:41:26.093815] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-23T19:41:26.094351] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-23T19:41:26.094395] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-23T19:41:26.095467] [DEBUG] [LOCAL ] ACCO: Trimmed 53994 records to 36869 (keeping 200 days of data) [2025-10-23T19:41:26.300929] [DEBUG] [LOCAL ] ACCO: Primary data saved (36869 records). [2025-10-23T19:41:26.301089] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-23T19:41:26.301167] [INFO ] [MAIN ] Update Progress: 18/2367 symbols completed. ACCO took 31.9s. Estimated remaining: 2h 58m 35s. Rate: 13.2 symbols/min [2025-10-23T19:41:26.408802] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-23T19:41:26.476823] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:26.477015] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-23T19:41:26.477073] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-23T19:41:26.477149] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-23T19:41:26.477189] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-23T19:41:26.477234] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-23T19:41:26.477270] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-23T19:41:26.841576] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:27.106288] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T19:41:27.199455] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-23T19:41:27.999452] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-23T19:41:28.372345] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T19:41:28.799707] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-23T19:41:29.599427] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-23T19:41:29.852766] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T19:41:29.896154] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-23T19:41:30.399422] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-23T19:41:30.647461] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T19:41:31.191618] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-23T19:41:31.202683] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-23T19:41:31.965993] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T19:41:31.999391] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-23T19:41:32.799434] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-23T19:41:33.532531] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T19:41:33.599429] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-23T19:41:33.911490] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-23T19:41:34.399421] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-23T19:41:34.867501] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-23T19:41:35.150904] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T19:41:35.199405] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-23T19:41:35.999430] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-23T19:41:36.799708] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-23T19:41:37.093316] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-23T19:41:37.175430] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T19:41:37.599408] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-23T19:41:37.724879] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T19:41:38.399469] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-23T19:41:38.453375] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T19:41:39.064126] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T19:41:39.199406] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-23T19:41:39.309559] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T19:41:39.322492] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-23T19:41:39.322768] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-23T19:41:39.730447] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-23T19:41:39.730565] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-23T19:41:39.731312] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-23T19:41:39.731389] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-23T19:41:39.732867] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-23T19:41:40.006301] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-23T19:41:40.055996] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-23T19:41:40.056161] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-23T19:41:40.056239] [INFO ] [MAIN ] Update Progress: 19/2367 symbols completed. ACHR took 40.0s. Estimated remaining: 3h 17m 26s. Rate: 11.9 symbols/min [2025-10-23T19:41:40.228235] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:40.228463] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-23T19:41:40.228507] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-23T19:41:40.228581] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-23T19:41:40.228621] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-23T19:41:40.228703] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-23T19:41:40.228760] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-23T19:41:40.592189] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:40.799406] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-23T19:41:41.084828] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T19:41:41.599405] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-23T19:41:41.733950] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T19:41:41.943269] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-23T19:41:41.956176] [INFO ] [REMOTE ] ACI: Full fetch complete (77232 records). [2025-10-23T19:41:41.956361] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-23T19:41:42.353629] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-23T19:41:42.353795] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-23T19:41:42.354542] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-23T19:41:42.354635] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-23T19:41:42.356318] [DEBUG] [LOCAL ] ACI: Trimmed 77232 records to 53675 (keeping 200 days of data) [2025-10-23T19:41:42.408947] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-23T19:41:42.681971] [DEBUG] [LOCAL ] ACI: Primary data saved (53675 records). [2025-10-23T19:41:42.682149] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-23T19:41:42.682236] [INFO ] [MAIN ] Update Progress: 20/2367 symbols completed. ACI took 41.0s. Estimated remaining: 3h 12m 37s. Rate: 12.2 symbols/min [2025-10-23T19:41:42.738710] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T19:41:42.883820] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:42.883993] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-23T19:41:42.884034] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-23T19:41:42.884124] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-23T19:41:42.884165] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-23T19:41:42.884210] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-23T19:41:42.884247] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-23T19:41:43.202091] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-23T19:41:43.243723] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:43.287719] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T19:41:43.295896] [INFO ] [REMOTE ] ACM: Full fetch complete (63285 records). [2025-10-23T19:41:43.296090] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-23T19:41:43.724169] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-23T19:41:43.724316] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-23T19:41:43.725031] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-23T19:41:43.725112] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-23T19:41:43.726497] [DEBUG] [LOCAL ] ACM: Trimmed 63285 records to 43000 (keeping 200 days of data) [2025-10-23T19:41:44.001998] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-23T19:41:44.011348] [DEBUG] [LOCAL ] ACM: Primary data saved (43000 records). [2025-10-23T19:41:44.011459] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-23T19:41:44.011535] [INFO ] [MAIN ] Update Progress: 21/2367 symbols completed. ACM took 28.4s. Estimated remaining: 3h 5m 51s. Rate: 12.6 symbols/min [2025-10-23T19:41:44.202195] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:44.202382] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-23T19:41:44.202424] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-23T19:41:44.202496] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-23T19:41:44.202535] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-23T19:41:44.202579] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-23T19:41:44.202614] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-23T19:41:44.547184] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:44.684536] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-23T19:41:44.799429] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-23T19:41:45.170617] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-23T19:41:45.599394] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-23T19:41:46.061903] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T19:41:46.399409] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-23T19:41:46.821535] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-23T19:41:47.199403] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-23T19:41:47.676618] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-23T19:41:47.999417] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-23T19:41:48.371634] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T19:41:48.799685] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-23T19:41:48.877230] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T19:41:49.599410] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-23T19:41:49.910990] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T19:41:50.399438] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-23T19:41:50.415160] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T19:41:51.199428] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-23T19:41:51.877400] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T19:41:51.909162] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-23T19:41:51.999429] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-23T19:41:52.799410] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-23T19:41:53.367354] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T19:41:53.599476] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-23T19:41:54.399413] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-23T19:41:54.978889] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T19:41:54.994440] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T19:41:55.199426] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-23T19:41:55.851854] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T19:41:55.861224] [INFO ] [REMOTE ] ACN: Full fetch complete (77419 records). [2025-10-23T19:41:55.861418] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-23T19:41:55.924918] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T19:41:56.004708] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-23T19:41:56.317301] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-23T19:41:56.317417] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-23T19:41:56.318296] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-23T19:41:56.318374] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-23T19:41:56.319986] [DEBUG] [LOCAL ] ACN: Trimmed 77419 records to 53828 (keeping 200 days of data) [2025-10-23T19:41:56.436740] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-23T19:41:56.670029] [DEBUG] [LOCAL ] ACN: Primary data saved (53828 records). [2025-10-23T19:41:56.670190] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-23T19:41:56.670270] [INFO ] [MAIN ] Update Progress: 22/2367 symbols completed. ACN took 30.4s. Estimated remaining: 3h 19m 49s. Rate: 11.7 symbols/min [2025-10-23T19:41:56.804691] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-23T19:41:56.870396] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:41:56.870634] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-23T19:41:56.870869] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-23T19:41:56.873759] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-23T19:41:56.873886] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-23T19:41:56.873960] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-23T19:41:56.874079] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-23T19:41:57.239394] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:41:57.599408] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-23T19:41:57.995707] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T19:41:58.399421] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-23T19:41:58.749486] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T19:41:58.861241] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T19:41:59.199423] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-23T19:41:59.842755] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-23T19:41:59.999400] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-23T19:42:00.426137] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-23T19:42:00.799424] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-23T19:42:01.599438] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-23T19:42:02.145029] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T19:42:02.157206] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T19:42:02.399441] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-23T19:42:03.052307] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T19:42:03.199454] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-23T19:42:03.999418] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-23T19:42:04.489117] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T19:42:04.799446] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-23T19:42:05.035220] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T19:42:05.599456] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-23T19:42:06.104145] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T19:42:06.399413] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-23T19:42:07.026459] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-23T19:42:07.199421] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-23T19:42:07.292257] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T19:42:07.958324] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T19:42:07.999408] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-23T19:42:08.799433] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-23T19:42:09.436383] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T19:42:09.486972] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T19:42:09.492776] [INFO ] [REMOTE ] ACP: Full fetch complete (46446 records). [2025-10-23T19:42:09.492913] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-23T19:42:09.605707] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-23T19:42:09.880113] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-23T19:42:09.880204] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-23T19:42:09.881204] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-23T19:42:09.882555] [INFO ] [REMOTE ] ACR: Full fetch complete (8537 records). [2025-10-23T19:42:09.882634] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-23T19:42:09.880713] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-23T19:42:09.887745] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-23T19:42:09.888742] [DEBUG] [LOCAL ] ACP: Trimmed 46446 records to 31336 (keeping 200 days of data) [2025-10-23T19:42:10.261310] [DEBUG] [LOCAL ] ACP: Primary data saved (31336 records). [2025-10-23T19:42:10.261448] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-23T19:42:10.261538] [INFO ] [MAIN ] Update Progress: 23/2367 symbols completed. ACP took 30.2s. Estimated remaining: 3h 34m 8s. Rate: 10.9 symbols/min [2025-10-23T19:42:10.405804] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-23T19:42:10.616702] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:10.616902] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-23T19:42:10.616952] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-23T19:42:10.617060] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-23T19:42:10.617106] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-23T19:42:10.617151] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-23T19:42:10.617200] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-23T19:42:10.657639] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-23T19:42:10.657774] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-23T19:42:10.658000] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-23T19:42:10.658043] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-23T19:42:10.658578] [DEBUG] [LOCAL ] ACR: Trimmed 8537 records to 5325 (keeping 200 days of data) [2025-10-23T19:42:10.714828] [DEBUG] [LOCAL ] ACR: Primary data saved (5325 records). [2025-10-23T19:42:10.714962] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-23T19:42:10.715036] [INFO ] [MAIN ] Update Progress: 24/2367 symbols completed. ACR took 28.0s. Estimated remaining: 3h 25m 52s. Rate: 11.4 symbols/min [2025-10-23T19:42:11.102183] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:11.102382] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-23T19:42:11.102423] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-23T19:42:11.102497] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-23T19:42:11.102537] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-23T19:42:11.102581] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-23T19:42:11.102616] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-23T19:42:11.201326] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-23T19:42:11.250509] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T19:42:11.351147] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:11.588298] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:11.999459] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-23T19:42:12.649237] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T19:42:12.799435] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-23T19:42:12.997060] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:42:12.998351] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-23T19:42:12.998536] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:42:12.998755] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-23T19:42:12.998914] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:42:12.999009] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-23T19:42:12.999192] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-23T19:42:12.999351] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-23T19:42:12.999675] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-23T19:42:12.999875] [INFO ] [MAIN ] Update Progress: 25/2367 symbols completed. AD took 2.3s. Estimated remaining: 3h 21m 6s. Rate: 11.6 symbols/min [2025-10-23T19:42:13.281512] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:13.281797] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-23T19:42:13.281869] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-23T19:42:13.281967] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-23T19:42:13.282016] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-23T19:42:13.282072] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-23T19:42:13.282117] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-23T19:42:13.542768] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T19:42:13.600736] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-23T19:42:13.826803] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:14.399441] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-23T19:42:14.405872] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T19:42:15.199425] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-23T19:42:15.884566] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T19:42:15.950239] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T19:42:15.964090] [INFO ] [REMOTE ] ACRE: Full fetch complete (49422 records). [2025-10-23T19:42:15.964228] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-23T19:42:16.006710] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-23T19:42:16.419568] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-23T19:42:16.419705] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-23T19:42:16.420541] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-23T19:42:16.420617] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-23T19:42:16.421801] [DEBUG] [LOCAL ] ACRE: Trimmed 49422 records to 33455 (keeping 200 days of data) [2025-10-23T19:42:16.611236] [DEBUG] [LOCAL ] ACRE: Primary data saved (33455 records). [2025-10-23T19:42:16.611437] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-23T19:42:16.611788] [INFO ] [MAIN ] Update Progress: 26/2367 symbols completed. ACRE took 32.6s. Estimated remaining: 3h 18m 43s. Rate: 11.8 symbols/min [2025-10-23T19:42:16.791245] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:16.791431] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-23T19:42:16.791473] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-23T19:42:16.791543] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-23T19:42:16.791583] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-23T19:42:16.791626] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-23T19:42:16.791714] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-23T19:42:16.799619] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-23T19:42:17.167517] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:17.459249] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T19:42:17.599405] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-23T19:42:17.851997] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T19:42:18.399434] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-23T19:42:19.038143] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T19:42:19.076464] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-23T19:42:19.199403] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-23T19:42:19.999419] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-23T19:42:20.546474] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T19:42:20.799421] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-23T19:42:21.433405] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T19:42:21.522816] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T19:42:21.599459] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-23T19:42:22.399459] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-23T19:42:22.811274] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-23T19:42:23.199445] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-23T19:42:23.999415] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-23T19:42:24.100512] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T19:42:24.139618] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T19:42:24.799424] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-23T19:42:25.456872] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T19:42:25.599449] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-23T19:42:26.393599] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T19:42:26.403820] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-23T19:42:27.109995] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T19:42:27.199429] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-23T19:42:27.403951] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T19:42:27.999447] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-23T19:42:28.783107] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T19:42:28.799392] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-23T19:42:29.410571] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T19:42:29.599467] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-23T19:42:29.913305] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T19:42:29.960609] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-23T19:42:29.965071] [INFO ] [REMOTE ] ACV: Full fetch complete (10474 records). [2025-10-23T19:42:29.965161] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-23T19:42:30.337377] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-23T19:42:30.337488] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-23T19:42:30.337719] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-23T19:42:30.337794] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-23T19:42:30.338360] [DEBUG] [LOCAL ] ACV: Trimmed 10474 records to 7456 (keeping 200 days of data) [2025-10-23T19:42:30.383763] [DEBUG] [LOCAL ] ACV: Primary data saved (7456 records). [2025-10-23T19:42:30.383923] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-23T19:42:30.384004] [INFO ] [MAIN ] Update Progress: 27/2367 symbols completed. ACV took 33.7s. Estimated remaining: 3h 31m 10s. Rate: 11.1 symbols/min [2025-10-23T19:42:30.407007] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-23T19:42:30.566190] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:30.566378] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-23T19:42:30.566420] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-23T19:42:30.566491] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-23T19:42:30.566531] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-23T19:42:30.566575] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-23T19:42:30.566612] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-23T19:42:30.918230] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:31.199426] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-23T19:42:31.999432] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-23T19:42:32.155375] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T19:42:32.799438] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-23T19:42:32.832674] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T19:42:33.599431] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-23T19:42:33.777548] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T19:42:34.399413] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-23T19:42:34.442984] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T19:42:34.945377] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T19:42:35.199431] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-23T19:42:35.999401] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-23T19:42:36.221488] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T19:42:36.799441] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-23T19:42:36.905402] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T19:42:37.409337] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T19:42:37.601697] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-23T19:42:38.201949] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T19:42:38.399420] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-23T19:42:38.988369] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T19:42:39.199426] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-23T19:42:39.999396] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-23T19:42:40.091445] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T19:42:40.806568] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-23T19:42:40.811573] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T19:42:41.594837] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T19:42:41.603275] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-23T19:42:41.607988] [INFO ] [REMOTE ] ADCT: Full fetch complete (51403 records). [2025-10-23T19:42:41.608188] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-23T19:42:41.977395] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T19:42:42.131121] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-23T19:42:42.131280] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-23T19:42:42.131879] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-23T19:42:42.131972] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-23T19:42:42.133193] [DEBUG] [LOCAL ] ADCT: Trimmed 51403 records to 35735 (keeping 200 days of data) [2025-10-23T19:42:42.270891] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T19:42:42.289702] [INFO ] [REMOTE ] ACVA: Full fetch complete (71099 records). [2025-10-23T19:42:42.289945] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-23T19:42:42.423722] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-23T19:42:42.525969] [DEBUG] [LOCAL ] ADCT: Primary data saved (35735 records). [2025-10-23T19:42:42.526186] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-23T19:42:42.526332] [INFO ] [MAIN ] Update Progress: 28/2367 symbols completed. ADCT took 25.9s. Estimated remaining: 3h 40m 26s. Rate: 10.6 symbols/min [2025-10-23T19:42:42.965043] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:42.965219] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-23T19:42:42.965262] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-23T19:42:42.965336] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-23T19:42:42.965375] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-23T19:42:42.965419] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-23T19:42:42.965454] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-23T19:42:43.055726] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-23T19:42:43.055809] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-23T19:42:43.056527] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-23T19:42:43.056571] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-23T19:42:43.057882] [DEBUG] [LOCAL ] ACVA: Trimmed 71099 records to 49608 (keeping 200 days of data) [2025-10-23T19:42:43.199587] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-23T19:42:43.620121] [DEBUG] [LOCAL ] ACVA: Primary data saved (49608 records). [2025-10-23T19:42:43.620313] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-23T19:42:43.620412] [INFO ] [MAIN ] Update Progress: 29/2367 symbols completed. ACVA took 33.4s. Estimated remaining: 3h 34m 13s. Rate: 10.9 symbols/min [2025-10-23T19:42:43.868330] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:43.943936] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:43.944137] [DEBUG] [LOCAL ] ADT: No existing data file found in primary storage. [2025-10-23T19:42:43.944197] [WARN ] [MAIN ] ADT: No existing data found, performing full refresh instead. [2025-10-23T19:42:43.944292] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-23T19:42:43.944349] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-23T19:42:43.944396] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-23T19:42:43.944433] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-23T19:42:44.004504] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-23T19:42:44.236086] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T19:42:44.389980] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:44.799471] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-23T19:42:45.097616] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T19:42:45.556716] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T19:42:45.599401] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-23T19:42:46.245928] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T19:42:46.399439] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-23T19:42:47.005833] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T19:42:47.199452] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-23T19:42:47.999495] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-23T19:42:48.137863] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T19:42:48.811992] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-23T19:42:48.829260] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T19:42:49.585342] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T19:42:49.599382] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-23T19:42:50.399401] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-23T19:42:50.667001] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T19:42:51.199404] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-23T19:42:51.272836] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T19:42:51.284186] [INFO ] [REMOTE ] ADC: Full fetch complete (66737 records). [2025-10-23T19:42:51.284338] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-23T19:42:51.349887] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T19:42:51.712051] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-23T19:42:51.712178] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-23T19:42:51.712887] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-23T19:42:51.712975] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-23T19:42:51.714709] [DEBUG] [LOCAL ] ADC: Trimmed 66737 records to 46761 (keeping 200 days of data) [2025-10-23T19:42:51.996205] [DEBUG] [LOCAL ] ADC: Primary data saved (46761 records). [2025-10-23T19:42:51.996314] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-23T19:42:51.996388] [INFO ] [MAIN ] Update Progress: 30/2367 symbols completed. ADC took 39.0s. Estimated remaining: 3h 37m 52s. Rate: 10.7 symbols/min [2025-10-23T19:42:52.010679] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-23T19:42:52.190069] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:42:52.190369] [DEBUG] [LOCAL ] ADX: No existing data file found in primary storage. [2025-10-23T19:42:52.190415] [WARN ] [MAIN ] ADX: No existing data found, performing full refresh instead. [2025-10-23T19:42:52.190555] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-23T19:42:52.190603] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-23T19:42:52.190676] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-10-23T19:42:52.190760] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-23T19:42:52.594504] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:42:52.799433] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-23T19:42:52.991336] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T19:42:53.599507] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-23T19:42:53.751563] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T19:42:54.399417] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-23T19:42:54.567902] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T19:42:55.025741] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T19:42:55.199422] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-23T19:42:55.653208] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T19:42:55.999404] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-23T19:42:56.469211] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T19:42:56.799428] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-23T19:42:57.599487] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-23T19:42:57.774009] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T19:42:58.404715] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-23T19:42:58.425338] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T19:42:58.589684] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T19:42:59.199429] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-23T19:42:59.999415] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-23T19:43:00.071762] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T19:43:00.799429] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-23T19:43:00.898398] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T19:43:00.960691] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T19:43:01.599427] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-23T19:43:02.399396] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-23T19:43:02.677472] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T19:43:03.199411] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-23T19:43:03.273674] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-23T19:43:03.436840] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T19:43:03.999426] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-23T19:43:04.799417] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-23T19:43:05.349914] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-23T19:43:05.599445] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-23T19:43:06.060414] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T19:43:06.399445] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-23T19:43:06.813113] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T19:43:06.893129] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T19:43:06.999516] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T19:43:07.010487] [INFO ] [REMOTE ] ADNT: Full fetch complete (67761 records). [2025-10-23T19:43:07.010791] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-23T19:43:07.200788] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-23T19:43:07.454833] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-23T19:43:07.455009] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-23T19:43:07.455950] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-23T19:43:07.456040] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-23T19:43:07.458121] [DEBUG] [LOCAL ] ADNT: Trimmed 67761 records to 46574 (keeping 200 days of data) [2025-10-23T19:43:07.751424] [DEBUG] [LOCAL ] ADNT: Primary data saved (46574 records). [2025-10-23T19:43:07.751741] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-23T19:43:07.752074] [INFO ] [MAIN ] Update Progress: 31/2367 symbols completed. ADNT took 25.2s. Estimated remaining: 3h 50m 32s. Rate: 10.1 symbols/min [2025-10-23T19:43:07.941169] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:43:07.941458] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-10-23T19:43:07.941505] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-10-23T19:43:07.941592] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-23T19:43:07.941635] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-23T19:43:07.941741] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-23T19:43:07.941798] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-23T19:43:08.007968] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-23T19:43:08.341623] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:43:08.660128] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T19:43:08.799420] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-23T19:43:09.593616] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T19:43:09.606873] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-23T19:43:10.399431] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-23T19:43:10.679422] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T19:43:10.737062] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T19:43:11.199425] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-23T19:43:12.016737] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-23T19:43:12.246156] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T19:43:12.281908] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T19:43:12.291169] [INFO ] [REMOTE ] ADT: Full fetch complete (77369 records). [2025-10-23T19:43:12.291395] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-23T19:43:12.673851] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-23T19:43:12.674065] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-23T19:43:12.674877] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-23T19:43:12.675012] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-23T19:43:12.676511] [DEBUG] [LOCAL ] ADT: Trimmed 77369 records to 53825 (keeping 200 days of data) [2025-10-23T19:43:12.841735] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-23T19:43:12.988478] [DEBUG] [LOCAL ] ADT: Primary data saved (53825 records). [2025-10-23T19:43:12.988766] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-23T19:43:12.988929] [INFO ] [MAIN ] Update Progress: 32/2367 symbols completed. ADT took 29.4s. Estimated remaining: 3h 49m 36s. Rate: 10.2 symbols/min [2025-10-23T19:43:13.159045] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:43:13.159340] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-23T19:43:13.159466] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-23T19:43:13.159632] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-23T19:43:13.159781] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-23T19:43:13.159917] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-23T19:43:13.160059] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-23T19:43:13.520675] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:43:13.599385] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-23T19:43:13.731315] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T19:43:13.745091] [INFO ] [REMOTE ] ADM: Full fetch complete (77474 records). [2025-10-23T19:43:13.745296] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-23T19:43:13.854325] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T19:43:14.184526] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-23T19:43:14.184712] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-23T19:43:14.185629] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-23T19:43:14.185735] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-23T19:43:14.187397] [DEBUG] [LOCAL ] ADM: Trimmed 77474 records to 53780 (keeping 200 days of data) [2025-10-23T19:43:14.401450] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-23T19:43:14.525885] [DEBUG] [LOCAL ] ADM: Primary data saved (53780 records). [2025-10-23T19:43:14.526071] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-23T19:43:14.526317] [INFO ] [MAIN ] Update Progress: 33/2367 symbols completed. ADM took 44.1s. Estimated remaining: 3h 44m 22s. Rate: 10.4 symbols/min [2025-10-23T19:43:14.600249] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T19:43:14.706309] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:43:14.706620] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-23T19:43:14.706768] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-23T19:43:14.706934] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-23T19:43:14.707058] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-23T19:43:14.707194] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-23T19:43:14.707315] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-23T19:43:15.055903] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:43:15.199422] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-23T19:43:15.535866] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T19:43:15.999431] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-23T19:43:16.680684] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T19:43:16.799459] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-23T19:43:17.562892] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T19:43:17.599394] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-23T19:43:18.399400] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-23T19:43:18.552849] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T19:43:18.708821] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-23T19:43:18.714140] [INFO ] [REMOTE ] ADX: Full fetch complete (41865 records). [2025-10-23T19:43:18.714270] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-23T19:43:19.103524] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-23T19:43:19.103630] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-23T19:43:19.104169] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-23T19:43:19.109806] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-23T19:43:19.110861] [DEBUG] [LOCAL ] ADX: Trimmed 41865 records to 27825 (keeping 200 days of data) [2025-10-23T19:43:19.210714] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-23T19:43:19.245705] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T19:43:19.343511] [DEBUG] [LOCAL ] ADX: Primary data saved (27825 records). [2025-10-23T19:43:19.343962] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-23T19:43:19.344124] [INFO ] [MAIN ] Update Progress: 34/2367 symbols completed. ADX took 27.3s. Estimated remaining: 3h 43m 11s. Rate: 10.5 symbols/min [2025-10-23T19:43:19.512518] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:43:19.512724] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-10-23T19:43:19.512783] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-10-23T19:43:19.512862] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-23T19:43:19.512903] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-23T19:43:19.512946] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-10-23T19:43:19.512989] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-23T19:43:19.864407] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:43:19.983359] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T19:43:19.999402] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-23T19:43:20.799463] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-23T19:43:21.599443] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-23T19:43:21.734427] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T19:43:22.404016] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T19:43:22.406757] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-23T19:43:22.825932] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T19:43:23.199430] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-23T19:43:23.248974] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T19:43:24.003680] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-23T19:43:24.799473] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-23T19:43:24.895524] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T19:43:25.328967] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T19:43:25.599437] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-23T19:43:25.950320] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T19:43:26.002726] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-23T19:43:26.399425] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-23T19:43:27.129457] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T19:43:27.199429] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-23T19:43:27.999434] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-23T19:43:28.775197] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T19:43:28.799404] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-23T19:43:29.173269] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T19:43:29.415800] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T19:43:29.599438] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-23T19:43:30.399412] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-23T19:43:31.082124] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T19:43:31.083624] [INFO ] [REMOTE ] AEFC: Full fetch complete (11612 records). [2025-10-23T19:43:31.083752] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-23T19:43:31.204755] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-23T19:43:31.501883] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-23T19:43:31.501981] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-23T19:43:31.502335] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-23T19:43:31.502402] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-23T19:43:31.508106] [DEBUG] [LOCAL ] AEFC: Trimmed 11612 records to 7685 (keeping 200 days of data) [2025-10-23T19:43:31.523461] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T19:43:31.585198] [DEBUG] [LOCAL ] AEFC: Primary data saved (7685 records). [2025-10-23T19:43:31.585522] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-23T19:43:31.585734] [INFO ] [MAIN ] Update Progress: 35/2367 symbols completed. AEFC took 18.6s. Estimated remaining: 3h 50m 18s. Rate: 10.1 symbols/min [2025-10-23T19:43:31.762040] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:43:31.762242] [DEBUG] [LOCAL ] AEO: No existing data file found in primary storage. [2025-10-23T19:43:31.762285] [WARN ] [MAIN ] AEO: No existing data found, performing full refresh instead. [2025-10-23T19:43:31.762358] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-23T19:43:31.762397] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-23T19:43:31.762439] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-23T19:43:31.762498] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-23T19:43:32.004719] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-23T19:43:32.137708] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:43:32.799423] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-23T19:43:33.365608] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-23T19:43:33.599415] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-23T19:43:33.760620] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T19:43:34.399407] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-23T19:43:34.458455] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T19:43:35.199515] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-23T19:43:35.398629] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T19:43:35.999487] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-23T19:43:36.050399] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T19:43:36.799412] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-23T19:43:36.914328] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T19:43:37.513786] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T19:43:37.599413] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-23T19:43:38.399427] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-23T19:43:38.504181] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T19:43:39.199414] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-23T19:43:39.242573] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T19:43:39.999429] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-23T19:43:40.222384] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T19:43:40.799433] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-23T19:43:40.904233] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T19:43:41.599479] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-23T19:43:41.828980] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T19:43:42.399432] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-23T19:43:42.703448] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T19:43:43.199402] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-23T19:43:43.278344] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T19:43:43.886019] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T19:43:43.999438] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-23T19:43:44.801445] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-23T19:43:44.804089] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T19:43:44.813410] [INFO ] [REMOTE ] AEG: Full fetch complete (70659 records). [2025-10-23T19:43:44.813636] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-23T19:43:44.984617] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T19:43:45.319329] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-23T19:43:45.319617] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-23T19:43:45.320516] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-23T19:43:45.320684] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-23T19:43:45.322345] [DEBUG] [LOCAL ] AEG: Trimmed 70659 records to 49897 (keeping 200 days of data) [2025-10-23T19:43:45.615706] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-23T19:43:45.639031] [DEBUG] [LOCAL ] AEG: Primary data saved (49897 records). [2025-10-23T19:43:45.639191] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-23T19:43:45.639275] [INFO ] [MAIN ] Update Progress: 36/2367 symbols completed. AEG took 31.1s. Estimated remaining: 3h 58m 59s. Rate: 9.8 symbols/min [2025-10-23T19:43:45.839216] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:43:45.839415] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-10-23T19:43:45.839459] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-10-23T19:43:45.839536] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-23T19:43:45.839579] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-23T19:43:45.839625] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-23T19:43:45.839699] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-23T19:43:46.260021] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:43:46.399439] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-23T19:43:46.608303] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T19:43:47.199439] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-23T19:43:47.444468] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T19:43:47.999442] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-23T19:43:48.428907] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T19:43:48.561769] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T19:43:48.799445] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-23T19:43:49.599452] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-23T19:43:49.670542] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T19:43:50.399433] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-23T19:43:50.449839] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T19:43:50.492526] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T19:43:50.503302] [INFO ] [REMOTE ] AEM: Full fetch complete (77484 records). [2025-10-23T19:43:50.503541] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-23T19:43:50.923594] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-23T19:43:50.923787] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-23T19:43:50.924890] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-23T19:43:50.925032] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-23T19:43:50.927357] [DEBUG] [LOCAL ] AEM: Trimmed 77484 records to 53865 (keeping 200 days of data) [2025-10-23T19:43:51.199806] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-23T19:43:51.300219] [DEBUG] [LOCAL ] AEM: Primary data saved (53865 records). [2025-10-23T19:43:51.300427] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-23T19:43:51.300517] [INFO ] [MAIN ] Update Progress: 37/2367 symbols completed. AEM took 32.0s. Estimated remaining: 3h 58m 22s. Rate: 9.8 symbols/min [2025-10-23T19:43:51.789457] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T19:43:51.999479] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-23T19:43:52.799556] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-23T19:43:53.470426] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-23T19:43:53.535832] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T19:43:53.599506] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-23T19:43:54.404741] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-23T19:43:54.421369] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T19:43:55.199400] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-23T19:43:55.261923] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T19:43:55.270972] [INFO ] [REMOTE ] AEE: Full fetch complete (72993 records). [2025-10-23T19:43:55.271223] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-23T19:43:55.730899] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-23T19:43:55.756566] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-23T19:43:55.756672] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-23T19:43:55.757454] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-23T19:43:55.760889] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-23T19:43:55.762468] [DEBUG] [LOCAL ] AEE: Trimmed 72993 records to 50377 (keeping 200 days of data) [2025-10-23T19:43:55.999892] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-23T19:43:56.086799] [DEBUG] [LOCAL ] AEE: Primary data saved (50377 records). [2025-10-23T19:43:56.086960] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-23T19:43:56.087050] [INFO ] [MAIN ] Update Progress: 38/2367 symbols completed. AEE took 48.3s. Estimated remaining: 3h 56m 53s. Rate: 9.8 symbols/min [2025-10-23T19:43:56.885747] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T19:43:56.897381] [INFO ] [REMOTE ] AEO: Full fetch complete (77650 records). [2025-10-23T19:43:56.897545] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-23T19:43:56.960760] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T19:43:56.993786] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-23T19:43:57.352171] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-23T19:43:57.352312] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-23T19:43:57.353204] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-23T19:43:57.353288] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-23T19:43:57.354820] [DEBUG] [LOCAL ] AEO: Trimmed 77650 records to 53953 (keeping 200 days of data) [2025-10-23T19:43:57.671493] [DEBUG] [LOCAL ] AEO: Primary data saved (53953 records). [2025-10-23T19:43:57.671689] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-23T19:43:57.671788] [INFO ] [MAIN ] Update Progress: 39/2367 symbols completed. AEO took 26.1s. Estimated remaining: 3h 52m 17s. Rate: 10.0 symbols/min [2025-10-23T19:43:58.851385] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T19:43:58.864130] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-23T19:44:00.594094] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T19:44:00.607481] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-23T19:44:02.379901] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T19:44:02.389601] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-23T19:44:03.936744] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T19:44:03.947396] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-23T19:44:05.576965] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T19:44:05.588103] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-23T19:44:07.205890] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T19:44:07.216010] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-23T19:44:08.027276] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T19:44:08.037499] [INFO ] [REMOTE ] AER: Full fetch complete (69933 records). [2025-10-23T19:44:08.037681] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-23T19:44:08.438101] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-23T19:44:08.438209] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-23T19:44:08.438911] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-23T19:44:08.438989] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-23T19:44:08.440390] [DEBUG] [LOCAL ] AER: Trimmed 69933 records to 48226 (keeping 200 days of data) [2025-10-23T19:44:08.724953] [DEBUG] [LOCAL ] AER: Primary data saved (48226 records). [2025-10-23T19:44:08.725109] [INFO ] [MAIN ] AER: Full history saved. [2025-10-23T19:44:08.725185] [INFO ] [MAIN ] Update Progress: 40/2367 symbols completed. AER took 23.1s. Estimated remaining: 3h 57m 6s. Rate: 9.8 symbols/min [2025-10-23T19:44:09.390286] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:09.390485] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-10-23T19:44:09.390528] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-10-23T19:44:09.390619] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-23T19:44:09.390702] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-23T19:44:09.390766] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-10-23T19:44:09.390813] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-23T19:44:09.422909] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:09.423053] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-23T19:44:09.423094] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-23T19:44:09.423161] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-23T19:44:09.423200] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-23T19:44:09.423243] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-23T19:44:09.423277] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-23T19:44:09.437996] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:09.438194] [DEBUG] [LOCAL ] AES: No existing data file found in primary storage. [2025-10-23T19:44:09.442166] [WARN ] [MAIN ] AES: No existing data found, performing full refresh instead. [2025-10-23T19:44:09.442333] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-23T19:44:09.442455] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-23T19:44:09.442590] [DEBUG] [LOCAL ] AES: No primary data file found to delete. [2025-10-23T19:44:09.458891] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-23T19:44:09.483781] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:09.490140] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-10-23T19:44:09.490204] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-10-23T19:44:09.490299] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-23T19:44:09.490896] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-23T19:44:09.491049] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-23T19:44:09.491092] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-23T19:44:10.798691] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:10.815691] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-23T19:44:10.835240] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:10.844092] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-23T19:44:10.831559] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:10.845499] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-23T19:44:10.914111] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:10.914449] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-23T19:44:11.030061] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:44:11.030405] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-23T19:44:11.030479] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:44:11.030522] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-23T19:44:11.030558] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:44:11.030597] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-23T19:44:11.030681] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-23T19:44:11.030751] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-23T19:44:11.030866] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-23T19:44:11.030944] [INFO ] [MAIN ] Update Progress: 41/2367 symbols completed. AEXA took 2.3s. Estimated remaining: 3h 53m 23s. Rate: 10.0 symbols/min [2025-10-23T19:44:11.201119] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:11.201337] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-10-23T19:44:11.201389] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-10-23T19:44:11.201463] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-23T19:44:11.201502] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-23T19:44:11.201545] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-23T19:44:11.201578] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-23T19:44:11.560672] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:11.561014] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-23T19:44:11.750682] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T19:44:11.753764] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-23T19:44:12.413178] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T19:44:12.416360] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-23T19:44:12.443309] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T19:44:12.452683] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-23T19:44:12.747046] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T19:44:12.760082] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-23T19:44:12.762941] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T19:44:12.774458] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-23T19:44:13.288114] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-23T19:44:13.291468] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-23T19:44:13.850058] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T19:44:13.882425] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-23T19:44:13.884899] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T19:44:13.895528] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-23T19:44:14.271422] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T19:44:14.282424] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-23T19:44:14.309318] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T19:44:14.313065] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-23T19:44:15.109292] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T19:44:15.112325] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-23T19:44:15.282881] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T19:44:15.294626] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-23T19:44:15.386725] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T19:44:15.934990] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T19:44:15.999465] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-23T19:44:16.348464] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-23T19:44:16.659671] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T19:44:16.799391] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-23T19:44:16.848298] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T19:44:17.599411] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-23T19:44:18.399436] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-23T19:44:18.931760] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T19:44:19.199445] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-23T19:44:19.294103] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:44:19.490534] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T19:44:19.999503] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-23T19:44:20.799428] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-23T19:44:21.239714] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T19:44:21.263430] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T19:44:21.402021] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T19:44:21.599454] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-23T19:44:22.399421] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-23T19:44:23.204678] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-23T19:44:23.220325] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T19:44:23.227175] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T19:44:23.999426] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-23T19:44:24.614269] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T19:44:24.799413] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-23T19:44:25.234192] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T19:44:25.599430] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-23T19:44:26.399438] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-23T19:44:26.669620] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T19:44:27.071412] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T19:44:27.199417] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-23T19:44:27.734535] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-23T19:44:27.736967] [INFO ] [REMOTE ] AFB: Full fetch complete (16349 records). [2025-10-23T19:44:27.737133] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-23T19:44:27.999433] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-23T19:44:28.146963] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T19:44:28.192845] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-23T19:44:28.192944] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-23T19:44:28.193258] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-23T19:44:28.193304] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-23T19:44:28.195916] [DEBUG] [LOCAL ] AFB: Trimmed 16349 records to 11099 (keeping 200 days of data) [2025-10-23T19:44:28.282199] [DEBUG] [LOCAL ] AFB: Primary data saved (11099 records). [2025-10-23T19:44:28.282351] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-23T19:44:28.282429] [INFO ] [MAIN ] Update Progress: 42/2367 symbols completed. AFB took 19.6s. Estimated remaining: 4h 3m 39s. Rate: 9.5 symbols/min [2025-10-23T19:44:28.466779] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:28.467041] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-23T19:44:28.467102] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-23T19:44:28.467182] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-23T19:44:28.467224] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-23T19:44:28.467270] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-23T19:44:28.467339] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-23T19:44:28.825665] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-23T19:44:28.832134] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:29.357412] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T19:44:29.599432] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-23T19:44:30.066251] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-23T19:44:30.399419] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-23T19:44:30.486676] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T19:44:31.199446] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-23T19:44:31.764972] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T19:44:31.854607] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T19:44:31.866776] [INFO ] [REMOTE ] AESI: Full fetch complete (71733 records). [2025-10-23T19:44:31.866909] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-23T19:44:32.004492] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-23T19:44:32.289283] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-23T19:44:32.289401] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-23T19:44:32.290241] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-23T19:44:32.290872] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-23T19:44:32.292406] [DEBUG] [LOCAL ] AESI: Trimmed 71733 records to 50191 (keeping 200 days of data) [2025-10-23T19:44:32.584151] [DEBUG] [LOCAL ] AESI: Primary data saved (50191 records). [2025-10-23T19:44:32.584313] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-23T19:44:32.584562] [INFO ] [MAIN ] Update Progress: 43/2367 symbols completed. AESI took 23.8s. Estimated remaining: 4h 1m 46s. Rate: 9.6 symbols/min [2025-10-23T19:44:32.753002] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:32.753198] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-10-23T19:44:32.753257] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-10-23T19:44:32.753332] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-23T19:44:32.753371] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-23T19:44:32.753414] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-23T19:44:32.753449] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-23T19:44:32.799774] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-23T19:44:32.812916] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T19:44:32.830162] [INFO ] [REMOTE ] AFG: Full fetch complete (46893 records). [2025-10-23T19:44:32.830300] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-23T19:44:33.446569] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:33.586175] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-23T19:44:33.586293] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-23T19:44:33.586795] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-23T19:44:33.586872] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-23T19:44:33.588044] [DEBUG] [LOCAL ] AFG: Trimmed 46893 records to 32088 (keeping 200 days of data) [2025-10-23T19:44:33.642960] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-23T19:44:33.791369] [DEBUG] [LOCAL ] AFG: Primary data saved (32088 records). [2025-10-23T19:44:33.791522] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-23T19:44:33.791596] [INFO ] [MAIN ] Update Progress: 44/2367 symbols completed. AFG took 22.8s. Estimated remaining: 3h 57m 13s. Rate: 9.8 symbols/min [2025-10-23T19:44:33.965112] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:33.965311] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-23T19:44:33.965353] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-23T19:44:33.965428] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-23T19:44:33.965468] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-23T19:44:33.965513] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-23T19:44:33.965550] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-23T19:44:34.207835] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-23T19:44:34.338713] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:34.399420] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-23T19:44:34.874559] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T19:44:35.042689] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-23T19:44:35.199447] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-23T19:44:35.677253] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-23T19:44:35.999438] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-23T19:44:36.284432] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-23T19:44:36.799447] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-23T19:44:37.272018] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T19:44:37.599416] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-23T19:44:38.047763] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T19:44:38.399404] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-23T19:44:38.847185] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T19:44:39.199403] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-23T19:44:39.999506] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-23T19:44:40.559858] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-23T19:44:40.799388] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-23T19:44:41.173313] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T19:44:41.249678] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T19:44:41.599424] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-23T19:44:42.045752] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T19:44:42.399409] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-23T19:44:43.199423] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-23T19:44:43.642787] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-23T19:44:43.999424] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-23T19:44:44.351778] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T19:44:44.450326] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T19:44:44.799437] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-23T19:44:45.244266] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-23T19:44:45.599441] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-23T19:44:46.032772] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-23T19:44:46.399445] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-23T19:44:46.828945] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-23T19:44:47.199420] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-23T19:44:47.632362] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-23T19:44:47.999423] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-23T19:44:48.799401] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-23T19:44:48.851374] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T19:44:48.864596] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-23T19:44:48.864844] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-23T19:44:49.234325] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-23T19:44:49.276695] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-23T19:44:49.276804] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-23T19:44:49.277555] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-23T19:44:49.277605] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-23T19:44:49.279234] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 54053 (keeping 200 days of data) [2025-10-23T19:44:49.599484] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-23T19:44:49.603302] [DEBUG] [LOCAL ] AES: Primary data saved (54053 records). [2025-10-23T19:44:49.603975] [INFO ] [MAIN ] AES: Full history saved. [2025-10-23T19:44:49.604064] [INFO ] [MAIN ] Update Progress: 45/2367 symbols completed. AES took 40.9s. Estimated remaining: 4h 5m 27s. Rate: 9.5 symbols/min [2025-10-23T19:44:49.791614] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:49.791849] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-10-23T19:44:49.791900] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-10-23T19:44:49.791972] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-23T19:44:49.792012] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-23T19:44:49.792054] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-10-23T19:44:49.792090] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-23T19:44:50.179969] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:50.183813] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T19:44:50.399438] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-23T19:44:50.862268] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T19:44:51.199413] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-23T19:44:51.714385] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T19:44:51.999435] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-23T19:44:52.487754] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-23T19:44:52.799421] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-23T19:44:53.116531] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-23T19:44:53.122808] [INFO ] [REMOTE ] AFGB: Full fetch complete (3432 records). [2025-10-23T19:44:53.122931] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-23T19:44:53.517343] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-23T19:44:53.517434] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-23T19:44:53.517561] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-23T19:44:53.517603] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-23T19:44:53.517970] [DEBUG] [LOCAL ] AFGB: Trimmed 3432 records to 2217 (keeping 200 days of data) [2025-10-23T19:44:53.531550] [DEBUG] [LOCAL ] AFGB: Primary data saved (2217 records). [2025-10-23T19:44:53.531628] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-23T19:44:53.531730] [INFO ] [MAIN ] Update Progress: 46/2367 symbols completed. AFGB took 25.2s. Estimated remaining: 4h 3m 19s. Rate: 9.5 symbols/min [2025-10-23T19:44:53.603159] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-23T19:44:53.714314] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:44:53.714500] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-10-23T19:44:53.714542] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-10-23T19:44:53.714614] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-23T19:44:53.714684] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-23T19:44:53.714756] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-23T19:44:53.714799] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-23T19:44:54.063674] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:44:54.090502] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T19:44:54.399415] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-23T19:44:54.852067] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-23T19:44:55.199431] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-23T19:44:55.532381] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-23T19:44:55.999428] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-23T19:44:56.560516] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-23T19:44:56.799467] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-23T19:44:57.238563] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T19:44:57.599436] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-23T19:44:58.088914] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-23T19:44:58.399420] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-23T19:44:58.970767] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T19:44:59.199461] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-23T19:44:59.714436] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-23T19:44:59.999388] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-23T19:45:00.474677] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-23T19:45:00.799414] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-23T19:45:01.229452] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-23T19:45:01.230310] [INFO ] [REMOTE ] AFGD: Full fetch complete (2716 records). [2025-10-23T19:45:01.230400] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-23T19:45:01.604638] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-23T19:45:01.648225] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-23T19:45:01.648335] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-23T19:45:01.648445] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-23T19:45:01.648531] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-23T19:45:01.649093] [DEBUG] [LOCAL ] AFGD: Trimmed 2716 records to 1757 (keeping 200 days of data) [2025-10-23T19:45:01.661506] [DEBUG] [LOCAL ] AFGD: Primary data saved (1757 records). [2025-10-23T19:45:01.661715] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-23T19:45:01.661854] [INFO ] [MAIN ] Update Progress: 47/2367 symbols completed. AFGD took 27.9s. Estimated remaining: 4h 4m 43s. Rate: 9.5 symbols/min [2025-10-23T19:45:01.836356] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:01.836541] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-23T19:45:01.836583] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-23T19:45:01.836683] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-23T19:45:01.836748] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-23T19:45:01.836800] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-23T19:45:01.836889] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-23T19:45:02.204810] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:02.399431] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-23T19:45:02.835831] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T19:45:02.836864] [INFO ] [REMOTE ] AFGC: Full fetch complete (3565 records). [2025-10-23T19:45:02.837043] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-23T19:45:03.204498] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-23T19:45:03.246907] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-23T19:45:03.247005] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-23T19:45:03.247134] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-23T19:45:03.247177] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-23T19:45:03.247527] [DEBUG] [LOCAL ] AFGC: Trimmed 3565 records to 2557 (keeping 200 days of data) [2025-10-23T19:45:03.262811] [DEBUG] [LOCAL ] AFGC: Primary data saved (2557 records). [2025-10-23T19:45:03.262892] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-23T19:45:03.262957] [INFO ] [MAIN ] Update Progress: 48/2367 symbols completed. AFGC took 30.7s. Estimated remaining: 4h 0m 49s. Rate: 9.6 symbols/min [2025-10-23T19:45:03.447003] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:03.447183] [DEBUG] [LOCAL ] AGCO: No existing data file found in primary storage. [2025-10-23T19:45:03.447225] [WARN ] [MAIN ] AGCO: No existing data found, performing full refresh instead. [2025-10-23T19:45:03.447298] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-23T19:45:03.447338] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-23T19:45:03.447383] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-23T19:45:03.447437] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-23T19:45:03.537187] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T19:45:03.885817] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:03.999423] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-23T19:45:04.469696] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T19:45:04.799422] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-23T19:45:05.141127] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T19:45:05.277249] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-23T19:45:05.599430] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-23T19:45:06.399434] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-23T19:45:06.847235] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-23T19:45:07.199440] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-23T19:45:07.464869] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T19:45:07.775835] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T19:45:07.999446] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-23T19:45:08.799408] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-23T19:45:09.599395] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-23T19:45:09.750819] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T19:45:09.876074] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-23T19:45:10.300233] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T19:45:10.399474] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-23T19:45:11.199422] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-23T19:45:11.999425] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-23T19:45:12.364854] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T19:45:12.799422] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-23T19:45:13.144214] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T19:45:13.540001] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T19:45:13.599438] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-23T19:45:14.399424] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-23T19:45:14.726525] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-23T19:45:14.727349] [INFO ] [REMOTE ] AFGE: Full fetch complete (3319 records). [2025-10-23T19:45:14.727441] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-23T19:45:14.895447] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-23T19:45:15.149802] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-23T19:45:15.150024] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-23T19:45:15.150240] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-23T19:45:15.150370] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-23T19:45:15.150843] [DEBUG] [LOCAL ] AFGE: Trimmed 3319 records to 2248 (keeping 200 days of data) [2025-10-23T19:45:15.164784] [DEBUG] [LOCAL ] AFGE: Primary data saved (2248 records). [2025-10-23T19:45:15.164939] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-23T19:45:15.165097] [INFO ] [MAIN ] Update Progress: 49/2367 symbols completed. AFGE took 25.6s. Estimated remaining: 4h 5m 11s. Rate: 9.5 symbols/min [2025-10-23T19:45:15.203531] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-23T19:45:15.358679] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T19:45:15.394378] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:15.394583] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-10-23T19:45:15.394662] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-10-23T19:45:15.394770] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-23T19:45:15.394818] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-23T19:45:15.394964] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-23T19:45:15.395027] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-23T19:45:15.754836] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:15.999432] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-23T19:45:16.799431] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-23T19:45:17.127733] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T19:45:17.221604] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T19:45:17.599432] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-23T19:45:18.399403] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-23T19:45:18.522228] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T19:45:19.200280] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-23T19:45:19.211128] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T19:45:20.002171] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-23T19:45:20.009303] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T19:45:20.350957] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T19:45:20.799434] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-23T19:45:21.599396] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-23T19:45:21.827699] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T19:45:22.133484] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-23T19:45:22.399400] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-23T19:45:22.499318] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T19:45:23.199447] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-23T19:45:23.999685] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-23T19:45:24.441545] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-23T19:45:24.799438] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-23T19:45:24.962923] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T19:45:25.116553] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T19:45:25.599452] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-23T19:45:26.101369] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T19:45:26.399450] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-23T19:45:26.593928] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T19:45:27.199429] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-23T19:45:27.999415] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-23T19:45:28.138414] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T19:45:28.429429] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-23T19:45:28.799441] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-23T19:45:29.599429] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-23T19:45:29.739805] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T19:45:30.402078] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-23T19:45:30.407295] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T19:45:30.946739] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T19:45:31.199414] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-23T19:45:31.376223] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T19:45:31.388541] [INFO ] [REMOTE ] AFL: Full fetch complete (77072 records). [2025-10-23T19:45:31.390800] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-23T19:45:31.789508] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-23T19:45:31.789612] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-23T19:45:31.790359] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-23T19:45:31.790436] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-23T19:45:31.791886] [DEBUG] [LOCAL ] AFL: Trimmed 77072 records to 53562 (keeping 200 days of data) [2025-10-23T19:45:32.000033] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-23T19:45:32.113091] [DEBUG] [LOCAL ] AFL: Primary data saved (53562 records). [2025-10-23T19:45:32.113385] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-23T19:45:32.113553] [INFO ] [MAIN ] Update Progress: 50/2367 symbols completed. AFL took 38.6s. Estimated remaining: 4h 13m 16s. Rate: 9.1 symbols/min [2025-10-23T19:45:32.280490] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:32.280680] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-10-23T19:45:32.280744] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-10-23T19:45:32.280825] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-23T19:45:32.280871] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-23T19:45:32.280920] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-23T19:45:32.280963] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-23T19:45:32.637222] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:32.799417] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-23T19:45:32.860947] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T19:45:32.904900] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-23T19:45:33.599438] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-23T19:45:34.399414] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-23T19:45:35.095765] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T19:45:35.174689] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-23T19:45:35.199387] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-23T19:45:35.499907] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T19:45:35.999440] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-23T19:45:36.033389] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T19:45:36.042401] [INFO ] [REMOTE ] AGCO: Full fetch complete (61585 records). [2025-10-23T19:45:36.042517] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-23T19:45:36.437940] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-23T19:45:36.438040] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-23T19:45:36.438701] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-23T19:45:36.438775] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-23T19:45:36.440029] [DEBUG] [LOCAL ] AGCO: Trimmed 61585 records to 42392 (keeping 200 days of data) [2025-10-23T19:45:36.691185] [DEBUG] [LOCAL ] AGCO: Primary data saved (42392 records). [2025-10-23T19:45:36.691340] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-23T19:45:36.691415] [INFO ] [MAIN ] Update Progress: 51/2367 symbols completed. AGCO took 33.4s. Estimated remaining: 4h 11m 39s. Rate: 9.2 symbols/min [2025-10-23T19:45:36.804577] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-23T19:45:36.870227] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:36.870407] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-23T19:45:36.870448] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-23T19:45:36.870521] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-23T19:45:36.870561] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-23T19:45:36.870603] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-23T19:45:36.870637] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-23T19:45:37.213725] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:37.599406] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-23T19:45:38.399481] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-23T19:45:38.803211] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-23T19:45:39.133159] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T19:45:39.138934] [INFO ] [REMOTE ] AGD: Full fetch complete (26634 records). [2025-10-23T19:45:39.139050] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-23T19:45:39.200547] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-23T19:45:39.479862] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-23T19:45:39.604001] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-23T19:45:39.604111] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-23T19:45:39.604486] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-23T19:45:39.604533] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-23T19:45:39.605394] [DEBUG] [LOCAL ] AGD: Trimmed 26634 records to 19375 (keeping 200 days of data) [2025-10-23T19:45:39.728297] [DEBUG] [LOCAL ] AGD: Primary data saved (19375 records). [2025-10-23T19:45:39.728460] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-23T19:45:39.728540] [INFO ] [MAIN ] Update Progress: 52/2367 symbols completed. AGD took 24.6s. Estimated remaining: 4h 8m 58s. Rate: 9.3 symbols/min [2025-10-23T19:45:39.932816] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:39.933042] [DEBUG] [LOCAL ] AGM: No existing data file found in primary storage. [2025-10-23T19:45:39.933098] [WARN ] [MAIN ] AGM: No existing data found, performing full refresh instead. [2025-10-23T19:45:39.933178] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-23T19:45:39.933219] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-23T19:45:39.933264] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-10-23T19:45:39.933332] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-23T19:45:40.016700] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-23T19:45:40.273629] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-23T19:45:40.430869] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:40.799425] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-23T19:45:41.599438] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-23T19:45:41.730333] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-23T19:45:42.233773] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-23T19:45:42.367593] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T19:45:42.399398] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-23T19:45:42.922290] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-23T19:45:42.924297] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-23T19:45:43.199452] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-23T19:45:43.999449] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-23T19:45:44.644625] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T19:45:44.800111] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-23T19:45:44.883764] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T19:45:45.599423] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-23T19:45:46.399446] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-23T19:45:46.527920] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T19:45:46.557860] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T19:45:46.569876] [INFO ] [REMOTE ] AG: Full fetch complete (77788 records). [2025-10-23T19:45:46.570221] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-23T19:45:46.980166] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T19:45:47.031577] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-23T19:45:47.031717] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-23T19:45:47.032625] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-23T19:45:47.032754] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-23T19:45:47.034441] [DEBUG] [LOCAL ] AG: Trimmed 77788 records to 54033 (keeping 200 days of data) [2025-10-23T19:45:47.215368] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-23T19:45:47.376449] [DEBUG] [LOCAL ] AG: Primary data saved (54033 records). [2025-10-23T19:45:47.376632] [INFO ] [MAIN ] AG: Full history saved. [2025-10-23T19:45:47.376765] [INFO ] [MAIN ] Update Progress: 53/2367 symbols completed. AG took 45.7s. Estimated remaining: 4h 9m 43s. Rate: 9.3 symbols/min [2025-10-23T19:45:47.566576] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:47.566792] [DEBUG] [LOCAL ] AGO: No existing data file found in primary storage. [2025-10-23T19:45:47.566848] [WARN ] [MAIN ] AGO: No existing data found, performing full refresh instead. [2025-10-23T19:45:47.566922] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-23T19:45:47.566963] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-23T19:45:47.567008] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-23T19:45:47.567044] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-23T19:45:47.928282] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:45:47.954476] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T19:45:47.999444] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-23T19:45:48.799478] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-23T19:45:49.599451] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-23T19:45:49.849433] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T19:45:50.001315] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T19:45:50.399432] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-23T19:45:50.775210] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T19:45:51.199412] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-23T19:45:51.275164] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T19:45:51.999432] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-23T19:45:52.799405] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-23T19:45:53.188436] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T19:45:53.191212] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T19:45:53.599456] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-23T19:45:54.347085] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T19:45:54.399399] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-23T19:45:54.585223] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T19:45:55.199393] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-23T19:45:55.603233] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T19:45:55.677051] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-23T19:45:55.999426] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-23T19:45:56.799431] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-23T19:45:57.599423] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-23T19:45:57.776875] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T19:45:58.209986] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T19:45:58.399436] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-23T19:45:58.979011] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T19:45:58.981479] [INFO ] [REMOTE ] AGM: Full fetch complete (13342 records). [2025-10-23T19:45:58.981573] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-23T19:45:59.199490] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-23T19:45:59.362137] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-23T19:45:59.362238] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-23T19:45:59.362493] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-23T19:45:59.362540] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-23T19:45:59.363149] [DEBUG] [LOCAL ] AGM: Trimmed 13342 records to 10659 (keeping 200 days of data) [2025-10-23T19:45:59.432547] [DEBUG] [LOCAL ] AGM: Primary data saved (10659 records). [2025-10-23T19:45:59.432729] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-23T19:45:59.432834] [INFO ] [MAIN ] Update Progress: 54/2367 symbols completed. AGM took 19.7s. Estimated remaining: 4h 13m 36s. Rate: 9.1 symbols/min [2025-10-23T19:45:59.627594] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T19:45:59.650286] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:45:59.650494] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-23T19:45:59.650536] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-23T19:45:59.650609] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-23T19:45:59.650675] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-23T19:45:59.650750] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-23T19:45:59.650821] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-23T19:45:59.999745] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-23T19:46:00.047287] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:00.435250] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T19:46:00.799436] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-23T19:46:01.599409] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-23T19:46:01.669368] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T19:46:02.399394] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-23T19:46:02.729402] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T19:46:02.794948] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T19:46:03.199431] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-23T19:46:03.999401] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-23T19:46:04.113933] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T19:46:04.799433] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-23T19:46:04.886830] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T19:46:05.599425] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-23T19:46:05.807820] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T19:46:06.399409] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-23T19:46:06.575600] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T19:46:06.727835] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T19:46:07.199422] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-23T19:46:07.999453] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-23T19:46:08.114040] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T19:46:08.145222] [INFO ] [REMOTE ] AGL: Full fetch complete (75965 records). [2025-10-23T19:46:08.145436] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-23T19:46:08.167720] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T19:46:08.554912] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-23T19:46:08.555009] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-23T19:46:08.555733] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-23T19:46:08.555807] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-23T19:46:08.557163] [DEBUG] [LOCAL ] AGL: Trimmed 75965 records to 52979 (keeping 200 days of data) [2025-10-23T19:46:08.804447] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-23T19:46:08.856043] [DEBUG] [LOCAL ] AGL: Primary data saved (52979 records). [2025-10-23T19:46:08.856178] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-23T19:46:08.856252] [INFO ] [MAIN ] Update Progress: 55/2367 symbols completed. AGL took 32.2s. Estimated remaining: 4h 15m 29s. Rate: 9.0 symbols/min [2025-10-23T19:46:09.026079] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:09.026228] [DEBUG] [LOCAL ] AGX: No existing data file found in primary storage. [2025-10-23T19:46:09.026286] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-10-23T19:46:09.026357] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-23T19:46:09.026397] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-23T19:46:09.026440] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-23T19:46:09.026475] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-23T19:46:09.383100] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T19:46:09.405923] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:09.599390] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-23T19:46:10.399438] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-23T19:46:10.563670] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T19:46:10.867072] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T19:46:11.199447] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-23T19:46:11.763930] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T19:46:11.999444] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-23T19:46:12.134023] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T19:46:12.143258] [INFO ] [REMOTE ] AGI: Full fetch complete (77332 records). [2025-10-23T19:46:12.143407] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-23T19:46:12.525119] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-23T19:46:12.525215] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-23T19:46:12.525955] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-23T19:46:12.526028] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-23T19:46:12.527436] [DEBUG] [LOCAL ] AGI: Trimmed 77332 records to 53813 (keeping 200 days of data) [2025-10-23T19:46:12.820403] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-23T19:46:12.846400] [DEBUG] [LOCAL ] AGI: Primary data saved (53813 records). [2025-10-23T19:46:12.846554] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-23T19:46:12.846634] [INFO ] [MAIN ] Update Progress: 56/2367 symbols completed. AGI took 40.7s. Estimated remaining: 4h 13m 33s. Rate: 9.1 symbols/min [2025-10-23T19:46:13.022879] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:13.023068] [DEBUG] [LOCAL ] AHH: No existing data file found in primary storage. [2025-10-23T19:46:13.023251] [WARN ] [MAIN ] AHH: No existing data found, performing full refresh instead. [2025-10-23T19:46:13.023425] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-23T19:46:13.023496] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-23T19:46:13.023623] [DEBUG] [LOCAL ] AHH: No primary data file found to delete. [2025-10-23T19:46:13.023785] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-23T19:46:13.302115] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T19:46:13.421146] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:13.599422] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-23T19:46:14.334233] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T19:46:14.355380] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T19:46:14.360602] [INFO ] [REMOTE ] AGO: Full fetch complete (39747 records). [2025-10-23T19:46:14.360735] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-23T19:46:14.404714] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-23T19:46:14.741014] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-23T19:46:14.741128] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-23T19:46:14.741588] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-23T19:46:14.741635] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-23T19:46:14.742734] [DEBUG] [LOCAL ] AGO: Trimmed 39747 records to 27888 (keeping 200 days of data) [2025-10-23T19:46:14.903535] [DEBUG] [LOCAL ] AGO: Primary data saved (27888 records). [2025-10-23T19:46:14.903711] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-23T19:46:14.903802] [INFO ] [MAIN ] Update Progress: 57/2367 symbols completed. AGO took 27.5s. Estimated remaining: 4h 10m 23s. Rate: 9.2 symbols/min [2025-10-23T19:46:15.069602] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:15.069763] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-23T19:46:15.069815] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-23T19:46:15.069890] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-23T19:46:15.069935] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-23T19:46:15.069980] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-23T19:46:15.070015] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-23T19:46:15.205516] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-23T19:46:15.420317] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:15.991836] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T19:46:15.999536] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-23T19:46:16.288111] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T19:46:16.799430] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-23T19:46:17.003298] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:46:17.003679] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-23T19:46:17.003766] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:46:17.003854] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-23T19:46:17.003941] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:46:17.004017] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-23T19:46:17.004145] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-23T19:46:17.004256] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-23T19:46:17.004367] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-23T19:46:17.004453] [INFO ] [MAIN ] Update Progress: 58/2367 symbols completed. AHL took 2.1s. Estimated remaining: 4h 7m 22s. Rate: 9.3 symbols/min [2025-10-23T19:46:17.124103] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T19:46:17.228469] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:17.228665] [DEBUG] [LOCAL ] AHR: No existing data file found in primary storage. [2025-10-23T19:46:17.228733] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-10-23T19:46:17.228838] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-23T19:46:17.228887] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-23T19:46:17.228933] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-23T19:46:17.228988] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-23T19:46:17.575930] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:17.599385] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-23T19:46:18.399420] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-23T19:46:19.211847] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-23T19:46:19.234553] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T19:46:19.831556] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T19:46:19.999389] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-23T19:46:20.815360] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-23T19:46:20.815143] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T19:46:21.502967] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T19:46:21.599454] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-23T19:46:22.399434] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-23T19:46:22.725933] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T19:46:23.199428] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-23T19:46:23.311610] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T19:46:23.999418] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-23T19:46:24.346519] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T19:46:24.794391] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T19:46:24.801745] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-23T19:46:25.113904] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T19:46:25.599435] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-23T19:46:26.315363] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T19:46:26.399404] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-23T19:46:27.199428] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-23T19:46:27.312933] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T19:46:27.448961] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T19:46:27.999435] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-23T19:46:28.681379] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T19:46:28.799424] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-23T19:46:29.545342] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T19:46:29.599442] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-23T19:46:30.399430] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-23T19:46:30.456544] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T19:46:30.897812] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T19:46:31.199437] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-23T19:46:31.714252] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T19:46:31.999418] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-23T19:46:32.666219] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T19:46:32.799398] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-23T19:46:33.599427] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-23T19:46:33.714810] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T19:46:34.211027] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T19:46:34.399415] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-23T19:46:34.478671] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T19:46:35.199429] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-23T19:46:35.975814] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T19:46:35.999393] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-23T19:46:36.574630] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T19:46:36.799454] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-23T19:46:37.182725] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-23T19:46:37.580183] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T19:46:37.588396] [INFO ] [REMOTE ] AGRO: Full fetch complete (48824 records). [2025-10-23T19:46:37.588566] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-23T19:46:37.599608] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-23T19:46:38.041583] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-23T19:46:38.041723] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-23T19:46:38.042294] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-23T19:46:38.042349] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-23T19:46:38.043423] [DEBUG] [LOCAL ] AGRO: Trimmed 48824 records to 32732 (keeping 200 days of data) [2025-10-23T19:46:38.238761] [DEBUG] [LOCAL ] AGRO: Primary data saved (32732 records). [2025-10-23T19:46:38.238940] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-23T19:46:38.239174] [INFO ] [MAIN ] Update Progress: 59/2367 symbols completed. AGRO took 38.8s. Estimated remaining: 4h 16m 54s. Rate: 9.0 symbols/min [2025-10-23T19:46:38.437432] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T19:46:38.439917] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-23T19:46:38.446297] [INFO ] [REMOTE ] AHH: Full fetch complete (59447 records). [2025-10-23T19:46:38.446486] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-23T19:46:38.455161] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:38.455513] [DEBUG] [LOCAL ] AHT: No existing data file found in primary storage. [2025-10-23T19:46:38.455664] [WARN ] [MAIN ] AHT: No existing data found, performing full refresh instead. [2025-10-23T19:46:38.485790] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-23T19:46:38.485888] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-23T19:46:38.485939] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-10-23T19:46:38.485976] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-23T19:46:39.221517] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:39.224784] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-23T19:46:39.224444] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-23T19:46:39.226094] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-23T19:46:39.226829] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-23T19:46:39.227627] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-23T19:46:39.229025] [DEBUG] [LOCAL ] AHH: Trimmed 59447 records to 40406 (keeping 200 days of data) [2025-10-23T19:46:39.458435] [DEBUG] [LOCAL ] AHH: Primary data saved (40406 records). [2025-10-23T19:46:39.458748] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-23T19:46:39.458911] [INFO ] [MAIN ] Update Progress: 60/2367 symbols completed. AHH took 26.6s. Estimated remaining: 4h 13m 18s. Rate: 9.1 symbols/min [2025-10-23T19:46:39.642778] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:39.643083] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-23T19:46:39.643206] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-23T19:46:39.643305] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-23T19:46:39.643422] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-23T19:46:39.643558] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-23T19:46:39.643699] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-23T19:46:39.972084] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T19:46:40.004501] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-23T19:46:40.036559] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T19:46:40.074784] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:40.799435] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-23T19:46:41.599422] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-23T19:46:41.836593] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T19:46:41.845553] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T19:46:42.399442] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-23T19:46:43.199421] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-23T19:46:43.808272] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T19:46:43.905103] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T19:46:43.999404] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-23T19:46:44.033458] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-23T19:46:44.799452] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-23T19:46:45.504816] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T19:46:45.599403] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-23T19:46:45.655164] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T19:46:46.224609] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T19:46:46.399452] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-23T19:46:47.199430] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-23T19:46:47.999470] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-23T19:46:48.265769] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T19:46:48.273216] [INFO ] [REMOTE ] AGX: Full fetch complete (48919 records). [2025-10-23T19:46:48.273375] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-23T19:46:48.646875] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-23T19:46:48.727195] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T19:46:48.745314] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-23T19:46:48.745438] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-23T19:46:48.745994] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-23T19:46:48.746067] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-23T19:46:48.747159] [DEBUG] [LOCAL ] AGX: Trimmed 48919 records to 32812 (keeping 200 days of data) [2025-10-23T19:46:48.809896] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-23T19:46:48.955031] [DEBUG] [LOCAL ] AGX: Primary data saved (32812 records). [2025-10-23T19:46:48.955188] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-23T19:46:48.955263] [INFO ] [MAIN ] Update Progress: 61/2367 symbols completed. AGX took 40.1s. Estimated remaining: 4h 15m 1s. Rate: 9.0 symbols/min [2025-10-23T19:46:49.122469] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:49.122722] [DEBUG] [LOCAL ] AIG: No existing data file found in primary storage. [2025-10-23T19:46:49.122922] [WARN ] [MAIN ] AIG: No existing data found, performing full refresh instead. [2025-10-23T19:46:49.123088] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-23T19:46:49.123210] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-23T19:46:49.123283] [DEBUG] [LOCAL ] AIG: No primary data file found to delete. [2025-10-23T19:46:49.123412] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-23T19:46:49.472870] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:49.599439] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-23T19:46:50.399476] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-23T19:46:50.464226] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T19:46:51.199422] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-23T19:46:51.494046] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T19:46:51.999427] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-23T19:46:52.117826] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T19:46:52.126837] [INFO ] [REMOTE ] AHR: Full fetch complete (70787 records). [2025-10-23T19:46:52.127025] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-23T19:46:52.524707] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-23T19:46:52.524826] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-23T19:46:52.525810] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-23T19:46:52.525889] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-23T19:46:52.527359] [DEBUG] [LOCAL ] AHR: Trimmed 70787 records to 49276 (keeping 200 days of data) [2025-10-23T19:46:52.806703] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-23T19:46:52.901684] [DEBUG] [LOCAL ] AHR: Primary data saved (49276 records). [2025-10-23T19:46:52.901893] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-23T19:46:52.901996] [INFO ] [MAIN ] Update Progress: 62/2367 symbols completed. AHR took 35.9s. Estimated remaining: 4h 13m 15s. Rate: 9.1 symbols/min [2025-10-23T19:46:53.023196] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-23T19:46:53.304905] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:53.305155] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-23T19:46:53.305217] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-23T19:46:53.305315] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-23T19:46:53.305371] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-23T19:46:53.305432] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-23T19:46:53.305553] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-23T19:46:53.601811] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-23T19:46:53.709939] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T19:46:53.712246] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T19:46:53.854275] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:54.399413] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-23T19:46:55.101164] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-23T19:46:55.199410] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-23T19:46:55.829924] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-23T19:46:55.999436] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-23T19:46:56.107391] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-23T19:46:56.799423] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-23T19:46:56.996263] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:46:56.996558] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-23T19:46:56.996622] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:46:56.996700] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-23T19:46:56.996753] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:46:56.996797] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-23T19:46:56.996854] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-23T19:46:56.996893] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-23T19:46:56.996935] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-23T19:46:56.996984] [INFO ] [MAIN ] Update Progress: 63/2367 symbols completed. AII took 4.1s. Estimated remaining: 4h 11m 37s. Rate: 9.2 symbols/min [2025-10-23T19:46:57.196933] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:46:57.197114] [DEBUG] [LOCAL ] AIN: No existing data file found in primary storage. [2025-10-23T19:46:57.197186] [WARN ] [MAIN ] AIN: No existing data found, performing full refresh instead. [2025-10-23T19:46:57.197296] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-23T19:46:57.197400] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-23T19:46:57.197486] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-10-23T19:46:57.197557] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-23T19:46:57.595632] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:46:57.599382] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-23T19:46:57.730836] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T19:46:58.399437] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-23T19:46:58.642563] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T19:46:59.199507] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-23T19:46:59.999455] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-23T19:47:00.222430] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T19:47:00.224566] [INFO ] [REMOTE ] AHT: Full fetch complete (9075 records). [2025-10-23T19:47:00.248329] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-23T19:47:00.247632] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T19:47:00.646710] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-23T19:47:00.646825] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-23T19:47:00.647066] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-23T19:47:00.647110] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-23T19:47:00.647566] [DEBUG] [LOCAL ] AHT: Trimmed 9075 records to 6449 (keeping 200 days of data) [2025-10-23T19:47:00.683141] [DEBUG] [LOCAL ] AHT: Primary data saved (6449 records). [2025-10-23T19:47:00.683313] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-23T19:47:00.683394] [INFO ] [MAIN ] Update Progress: 64/2367 symbols completed. AHT took 22.4s. Estimated remaining: 4h 9m 47s. Rate: 9.2 symbols/min [2025-10-23T19:47:00.807763] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-23T19:47:00.874680] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:00.893841] [DEBUG] [LOCAL ] AIO: Loaded 12916 existing records from primary storage. [2025-10-23T19:47:00.894241] [INFO ] [MAIN ] AIO: Loaded 12916 existing records. [2025-10-23T19:47:01.121231] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:47:01.121584] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-23T19:47:01.121665] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-23T19:47:01.122007] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-23T19:47:01.122081] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-23T19:47:01.605268] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-23T19:47:01.615365] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:02.399462] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-23T19:47:02.440595] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-23T19:47:03.199731] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-23T19:47:03.798232] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-23T19:47:03.833879] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-23T19:47:03.971354] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T19:47:03.999461] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-23T19:47:04.595762] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T19:47:04.799441] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-23T19:47:05.499108] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-23T19:47:05.599421] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-23T19:47:05.995492] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T19:47:06.399457] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-23T19:47:06.462833] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T19:47:07.199478] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-23T19:47:07.999561] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-23T19:47:08.152249] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T19:47:08.441596] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T19:47:08.799445] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-23T19:47:09.599412] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-23T19:47:10.031463] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-23T19:47:10.250211] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-23T19:47:10.399426] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-23T19:47:11.199423] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-23T19:47:11.395265] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T19:47:11.425007] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T19:47:11.999414] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-23T19:47:12.349990] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T19:47:12.795038] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T19:47:12.799393] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-23T19:47:13.599413] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-23T19:47:14.399400] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-23T19:47:14.517837] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T19:47:14.547961] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T19:47:15.199420] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-23T19:47:15.877361] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T19:47:15.999392] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-23T19:47:16.799417] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-23T19:47:16.815078] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T19:47:17.016638] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-23T19:47:17.599426] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-23T19:47:18.110792] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T19:47:18.399430] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-23T19:47:19.199420] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-23T19:47:19.476531] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T19:47:19.999425] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-23T19:47:20.162054] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-23T19:47:20.254156] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T19:47:20.799448] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-23T19:47:20.842772] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T19:47:21.599407] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-23T19:47:22.399424] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-23T19:47:22.650883] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T19:47:22.865814] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T19:47:22.870979] [INFO ] [REMOTE ] AIN: Full fetch complete (33693 records). [2025-10-23T19:47:22.871092] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-23T19:47:23.213222] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-23T19:47:23.264509] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-23T19:47:23.264601] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-23T19:47:23.265052] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-23T19:47:23.265124] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-23T19:47:23.265982] [DEBUG] [LOCAL ] AIN: Trimmed 33693 records to 24456 (keeping 200 days of data) [2025-10-23T19:47:23.407059] [DEBUG] [LOCAL ] AIN: Primary data saved (24456 records). [2025-10-23T19:47:23.407247] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-23T19:47:23.407337] [INFO ] [MAIN ] Update Progress: 65/2367 symbols completed. AIN took 26.4s. Estimated remaining: 4h 19m 15s. Rate: 8.9 symbols/min [2025-10-23T19:47:23.580338] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:23.580517] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-23T19:47:23.580558] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-23T19:47:23.580629] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-23T19:47:23.580704] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-23T19:47:23.580768] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-23T19:47:23.580810] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-23T19:47:23.929597] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:23.999413] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-23T19:47:24.228152] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T19:47:24.232459] [INFO ] [REMOTE ] AIO: Full fetch complete (20100 records). [2025-10-23T19:47:24.232609] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-23T19:47:24.604101] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-23T19:47:24.604202] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-23T19:47:24.604518] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-23T19:47:24.604560] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-23T19:47:24.605158] [DEBUG] [LOCAL ] AIO: Trimmed 20100 records to 13054 (keeping 200 days of data) [2025-10-23T19:47:24.681920] [DEBUG] [LOCAL ] AIO: Primary data saved (13054 records). [2025-10-23T19:47:24.682070] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-23T19:47:24.682153] [INFO ] [MAIN ] Update Progress: 66/2367 symbols completed. AIO took 24.0s. Estimated remaining: 4h 15m 57s. Rate: 9.0 symbols/min [2025-10-23T19:47:24.804710] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-23T19:47:24.873146] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:24.912329] [DEBUG] [LOCAL ] AIT: Loaded 26566 existing records from primary storage. [2025-10-23T19:47:24.915816] [INFO ] [MAIN ] AIT: Loaded 26566 existing records. [2025-10-23T19:47:25.096020] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T19:47:25.161791] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-23T19:47:25.176362] [INFO ] [REMOTE ] AI: Full fetch complete (77914 records). [2025-10-23T19:47:25.176508] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-23T19:47:25.288155] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:47:25.295769] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-23T19:47:25.360343] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T19:47:25.375692] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-23T19:47:25.405165] [INFO ] [REMOTE ] AIG: Full fetch complete (77562 records). [2025-10-23T19:47:25.405335] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-23T19:47:25.425685] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-23T19:47:25.494605] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-23T19:47:25.618871] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-23T19:47:26.157029] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-23T19:47:26.157135] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-23T19:47:26.157980] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-23T19:47:26.158057] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-23T19:47:26.159517] [DEBUG] [LOCAL ] AI: Trimmed 77914 records to 54154 (keeping 200 days of data) [2025-10-23T19:47:26.529705] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T19:47:26.576368] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-23T19:47:26.735281] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-23T19:47:26.735395] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-23T19:47:26.736112] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-23T19:47:26.736195] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-23T19:47:26.737868] [DEBUG] [LOCAL ] AIG: Trimmed 77562 records to 53845 (keeping 200 days of data) [2025-10-23T19:47:26.930714] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:27.071867] [DEBUG] [LOCAL ] AI: Primary data saved (54154 records). [2025-10-23T19:47:27.072054] [INFO ] [MAIN ] AI: Full history saved. [2025-10-23T19:47:27.072162] [INFO ] [MAIN ] Update Progress: 67/2367 symbols completed. AI took 47.6s. Estimated remaining: 4h 13m 23s. Rate: 9.1 symbols/min [2025-10-23T19:47:27.220000] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-23T19:47:27.332121] [DEBUG] [LOCAL ] AIG: Primary data saved (53845 records). [2025-10-23T19:47:27.332305] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-23T19:47:27.332394] [INFO ] [MAIN ] Update Progress: 68/2367 symbols completed. AIG took 38.4s. Estimated remaining: 4h 9m 42s. Rate: 9.2 symbols/min [2025-10-23T19:47:27.430760] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:27.567705] [DEBUG] [LOCAL ] AIV: Loaded 41857 existing records from primary storage. [2025-10-23T19:47:27.568031] [INFO ] [MAIN ] AIV: Loaded 41857 existing records. [2025-10-23T19:47:27.646378] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:27.759390] [DEBUG] [LOCAL ] AIZ: Loaded 29244 existing records from primary storage. [2025-10-23T19:47:27.759700] [INFO ] [MAIN ] AIZ: Loaded 29244 existing records. [2025-10-23T19:47:27.883755] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:47:27.889001] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-23T19:47:27.889059] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-23T19:47:27.889322] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-23T19:47:27.889383] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-23T19:47:27.968763] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T19:47:28.015553] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-23T19:47:28.106615] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:47:28.111969] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-23T19:47:28.112035] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-23T19:47:28.112216] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-23T19:47:28.112263] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-23T19:47:28.591839] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T19:47:28.763275] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:28.805536] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-23T19:47:28.820546] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:29.399879] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T19:47:29.599425] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-23T19:47:30.399676] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-23T19:47:30.484097] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T19:47:30.717867] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T19:47:31.199452] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-23T19:47:31.575820] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T19:47:31.999392] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-23T19:47:32.272611] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T19:47:32.799390] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-23T19:47:33.376440] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T19:47:33.599397] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-23T19:47:33.987617] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T19:47:34.399442] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-23T19:47:34.755189] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T19:47:35.199417] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-23T19:47:35.855478] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T19:47:35.999409] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-23T19:47:36.664809] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T19:47:36.799401] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-23T19:47:37.459811] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T19:47:37.599412] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-23T19:47:38.077188] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T19:47:38.399419] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-23T19:47:39.019111] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T19:47:39.199443] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-23T19:47:39.877521] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T19:47:39.999424] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-23T19:47:40.710664] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T19:47:40.799447] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-23T19:47:41.445329] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T19:47:41.599445] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-23T19:47:42.319993] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T19:47:42.399401] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-23T19:47:42.962384] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T19:47:43.199414] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-23T19:47:43.545703] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T19:47:43.999409] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-23T19:47:44.055455] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T19:47:44.799439] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-23T19:47:45.599439] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-23T19:47:45.655151] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T19:47:45.661599] [INFO ] [REMOTE ] AIR: Full fetch complete (40361 records). [2025-10-23T19:47:45.661796] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-23T19:47:46.059891] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-23T19:47:46.060000] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-23T19:47:46.060439] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-23T19:47:46.060485] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-23T19:47:46.061394] [DEBUG] [LOCAL ] AIR: Trimmed 40361 records to 28815 (keeping 200 days of data) [2025-10-23T19:47:46.162938] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T19:47:46.251385] [DEBUG] [LOCAL ] AIR: Primary data saved (28815 records). [2025-10-23T19:47:46.251548] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-23T19:47:46.251626] [INFO ] [MAIN ] Update Progress: 69/2367 symbols completed. AIR took 22.8s. Estimated remaining: 4h 16m 28s. Rate: 9.0 symbols/min [2025-10-23T19:47:46.399696] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-23T19:47:46.425569] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:46.425741] [DEBUG] [LOCAL ] AIZN: No existing data file found in primary storage. [2025-10-23T19:47:46.425804] [WARN ] [MAIN ] AIZN: No existing data found, performing full refresh instead. [2025-10-23T19:47:46.425889] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-23T19:47:46.425942] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-23T19:47:46.426097] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-10-23T19:47:46.426166] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-23T19:47:46.607831] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-23T19:47:46.817188] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:47.199439] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-23T19:47:47.527912] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T19:47:47.999445] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-23T19:47:48.678910] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T19:47:48.799405] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-23T19:47:49.385968] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T19:47:49.599417] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-23T19:47:49.733332] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-23T19:47:50.399422] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-23T19:47:51.004313] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-23T19:47:51.123311] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T19:47:51.199434] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-23T19:47:51.999417] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-23T19:47:52.538018] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T19:47:52.799631] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-23T19:47:53.599401] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-23T19:47:53.688516] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T19:47:54.003869] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T19:47:54.399410] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-23T19:47:54.586785] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-23T19:47:55.199409] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-23T19:47:55.618605] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T19:47:55.622834] [INFO ] [REMOTE ] AIT: Full fetch complete (39090 records). [2025-10-23T19:47:55.622927] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-23T19:47:55.999602] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-23T19:47:56.010215] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-23T19:47:56.010281] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-23T19:47:56.010734] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-23T19:47:56.010810] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-23T19:47:56.011703] [DEBUG] [LOCAL ] AIT: Trimmed 39090 records to 26768 (keeping 200 days of data) [2025-10-23T19:47:56.177882] [DEBUG] [LOCAL ] AIT: Primary data saved (26768 records). [2025-10-23T19:47:56.178038] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-23T19:47:56.178165] [INFO ] [MAIN ] Update Progress: 70/2367 symbols completed. AIT took 31.5s. Estimated remaining: 4h 18m 8s. Rate: 8.9 symbols/min [2025-10-23T19:47:56.366069] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:56.409331] [DEBUG] [LOCAL ] AJG: Loaded 46386 existing records from primary storage. [2025-10-23T19:47:56.409674] [INFO ] [MAIN ] AJG: Loaded 46386 existing records. [2025-10-23T19:47:56.592805] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:47:56.592997] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-23T19:47:56.593045] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-23T19:47:56.594266] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-23T19:47:56.594338] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-23T19:47:56.813204] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-23T19:47:56.819126] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T19:47:57.014555] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:57.292950] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T19:47:57.352413] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T19:47:57.356886] [INFO ] [REMOTE ] AIZ: Full fetch complete (42747 records). [2025-10-23T19:47:57.356993] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-23T19:47:57.605717] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-23T19:47:57.731187] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-23T19:47:57.731287] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-23T19:47:57.731795] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-23T19:47:57.731893] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-23T19:47:57.732799] [DEBUG] [LOCAL ] AIZ: Trimmed 42747 records to 29404 (keeping 200 days of data) [2025-10-23T19:47:57.908662] [DEBUG] [LOCAL ] AIZ: Primary data saved (29404 records). [2025-10-23T19:47:57.908824] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-23T19:47:57.908909] [INFO ] [MAIN ] Update Progress: 71/2367 symbols completed. AIZ took 30.6s. Estimated remaining: 4h 15m 19s. Rate: 9.0 symbols/min [2025-10-23T19:47:58.074358] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:47:58.074541] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-23T19:47:58.074582] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-23T19:47:58.074677] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-23T19:47:58.074743] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-23T19:47:58.074794] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-23T19:47:58.074978] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-23T19:47:58.400820] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-23T19:47:58.422503] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:47:59.199458] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-23T19:47:59.458386] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T19:47:59.868885] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T19:47:59.999675] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-23T19:48:00.213789] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T19:48:00.222002] [INFO ] [REMOTE ] AIV: Full fetch complete (60396 records). [2025-10-23T19:48:00.222119] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-23T19:48:00.595934] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T19:48:00.618083] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-23T19:48:00.618183] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-23T19:48:00.618905] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-23T19:48:00.618981] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-23T19:48:00.620275] [DEBUG] [LOCAL ] AIV: Trimmed 60396 records to 42214 (keeping 200 days of data) [2025-10-23T19:48:00.826092] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-23T19:48:00.885895] [DEBUG] [LOCAL ] AIV: Primary data saved (42214 records). [2025-10-23T19:48:00.886069] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-23T19:48:00.886161] [INFO ] [MAIN ] Update Progress: 72/2367 symbols completed. AIV took 33.8s. Estimated remaining: 4h 13m 15s. Rate: 9.1 symbols/min [2025-10-23T19:48:01.115888] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:48:01.174332] [DEBUG] [LOCAL ] AKR: Loaded 46103 existing records from primary storage. [2025-10-23T19:48:01.174745] [INFO ] [MAIN ] AKR: Loaded 46103 existing records. [2025-10-23T19:48:01.435539] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:48:01.435850] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-23T19:48:01.435935] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-23T19:48:01.436225] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-23T19:48:01.436304] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-23T19:48:01.604533] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-23T19:48:01.947159] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:48:02.399426] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-23T19:48:02.716620] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T19:48:03.114145] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T19:48:03.199401] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-23T19:48:03.999449] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-23T19:48:04.224018] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-10-23T19:48:04.705144] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-23T19:48:04.799422] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-23T19:48:04.922198] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T19:48:05.599435] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-23T19:48:06.399449] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-23T19:48:06.691046] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T19:48:06.692545] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T19:48:06.880160] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T19:48:07.199437] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-23T19:48:07.676924] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T19:48:07.999441] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-23T19:48:08.306896] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-23T19:48:08.799409] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-23T19:48:09.599444] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-23T19:48:10.147509] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-23T19:48:10.399410] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-23T19:48:10.764007] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T19:48:11.199408] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-23T19:48:11.785840] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T19:48:12.002672] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-23T19:48:12.008415] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T19:48:12.547999] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T19:48:12.799431] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-23T19:48:13.599413] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-23T19:48:14.399440] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-23T19:48:14.581257] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T19:48:14.952271] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T19:48:15.198374] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T19:48:15.207182] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-23T19:48:15.651264] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-23T19:48:15.999419] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-23T19:48:16.799430] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-23T19:48:17.481990] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T19:48:17.483278] [INFO ] [REMOTE ] AIZN: Full fetch complete (5775 records). [2025-10-23T19:48:17.483371] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-23T19:48:17.603196] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-23T19:48:17.898089] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T19:48:17.929193] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-23T19:48:17.929298] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-23T19:48:17.929480] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-23T19:48:17.929525] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-23T19:48:17.929941] [DEBUG] [LOCAL ] AIZN: Trimmed 5775 records to 3838 (keeping 200 days of data) [2025-10-23T19:48:17.954018] [DEBUG] [LOCAL ] AIZN: Primary data saved (3838 records). [2025-10-23T19:48:17.954094] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-23T19:48:17.954163] [INFO ] [MAIN ] Update Progress: 73/2367 symbols completed. AIZN took 31.7s. Estimated remaining: 4h 18m 36s. Rate: 8.9 symbols/min [2025-10-23T19:48:18.118736] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:48:18.165136] [DEBUG] [LOCAL ] AL: Loaded 44805 existing records from primary storage. [2025-10-23T19:48:18.165444] [INFO ] [MAIN ] AL: Loaded 44805 existing records. [2025-10-23T19:48:18.337364] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:48:18.337536] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-23T19:48:18.337584] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-23T19:48:18.337831] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-23T19:48:18.337910] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-23T19:48:18.404560] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-23T19:48:18.688917] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:48:18.744717] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-23T19:48:19.144079] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T19:48:19.199447] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-23T19:48:19.543205] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-23T19:48:19.999615] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-23T19:48:20.799499] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-23T19:48:21.196127] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-23T19:48:21.511325] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T19:48:21.599436] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-23T19:48:22.352945] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T19:48:22.354403] [INFO ] [REMOTE ] AKA: Full fetch complete (2805 records). [2025-10-23T19:48:22.354491] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-23T19:48:22.405698] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-23T19:48:22.587163] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T19:48:22.587385] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T19:48:22.587428] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T19:48:22.587471] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-23T19:48:22.587533] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-23T19:48:22.587617] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-23T19:48:22.587708] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-23T19:48:22.587811] [INFO ] [MAIN ] Update Progress: 74/2367 symbols completed. AKA took 24.7s. Estimated remaining: 4h 17m 23s. Rate: 8.9 symbols/min [2025-10-23T19:48:22.765840] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:48:22.821785] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-23T19:48:22.822139] [INFO ] [MAIN ] ALB: Loaded 53362 existing records. [2025-10-23T19:48:22.994098] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:48:22.994357] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-23T19:48:22.994560] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-23T19:48:22.995059] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-23T19:48:22.995185] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-23T19:48:23.204549] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-23T19:48:23.371599] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:48:23.999454] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-23T19:48:24.064078] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T19:48:24.803908] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T19:48:24.805752] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-23T19:48:25.520620] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T19:48:25.599402] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-23T19:48:26.399419] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-23T19:48:26.464984] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T19:48:26.677895] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T19:48:27.199425] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-23T19:48:28.005394] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-23T19:48:28.024345] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T19:48:28.799424] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-23T19:48:28.895408] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T19:48:29.599487] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-23T19:48:30.074428] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T19:48:30.399399] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-23T19:48:30.587459] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:48:31.152938] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T19:48:31.199401] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-23T19:48:31.999408] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-23T19:48:32.414701] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-23T19:48:32.799419] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-23T19:48:33.152325] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T19:48:33.599450] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-23T19:48:33.829782] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T19:48:33.840741] [INFO ] [REMOTE ] AJG: Full fetch complete (68829 records). [2025-10-23T19:48:33.840873] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-23T19:48:34.117226] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T19:48:34.293610] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-23T19:48:34.293738] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-23T19:48:34.294406] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-23T19:48:34.294452] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-23T19:48:34.295699] [DEBUG] [LOCAL ] AJG: Trimmed 68829 records to 46707 (keeping 200 days of data) [2025-10-23T19:48:34.399527] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-23T19:48:34.586313] [DEBUG] [LOCAL ] AJG: Primary data saved (46707 records). [2025-10-23T19:48:34.586464] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-23T19:48:34.587126] [INFO ] [MAIN ] Update Progress: 75/2367 symbols completed. AJG took 38.4s. Estimated remaining: 4h 19m 58s. Rate: 8.8 symbols/min [2025-10-23T19:48:34.762444] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:48:34.815953] [DEBUG] [LOCAL ] ALC: Loaded 51212 existing records from primary storage. [2025-10-23T19:48:34.816285] [INFO ] [MAIN ] ALC: Loaded 51212 existing records. [2025-10-23T19:48:34.995688] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:48:34.995939] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-23T19:48:34.996152] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-23T19:48:34.996987] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-23T19:48:34.997114] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-23T19:48:35.204883] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-23T19:48:35.410066] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:48:35.559803] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T19:48:35.940484] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T19:48:35.999458] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-23T19:48:36.660144] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T19:48:36.799410] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-23T19:48:37.544041] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T19:48:37.599412] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-23T19:48:38.399399] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-23T19:48:38.567845] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T19:48:38.578034] [INFO ] [REMOTE ] AKR: Full fetch complete (65541 records). [2025-10-23T19:48:38.578205] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-23T19:48:38.988880] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-23T19:48:38.989014] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-23T19:48:38.989744] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-23T19:48:38.989836] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-23T19:48:38.991126] [DEBUG] [LOCAL ] AKR: Trimmed 65541 records to 46444 (keeping 200 days of data) [2025-10-23T19:48:39.107876] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T19:48:39.209061] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-23T19:48:39.332989] [DEBUG] [LOCAL ] AKR: Primary data saved (46444 records). [2025-10-23T19:48:39.333205] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-23T19:48:39.333326] [INFO ] [MAIN ] Update Progress: 76/2367 symbols completed. AKR took 38.4s. Estimated remaining: 4h 18m 49s. Rate: 8.9 symbols/min [2025-10-23T19:48:39.505332] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:48:39.533720] [DEBUG] [LOCAL ] ALE: Loaded 32075 existing records from primary storage. [2025-10-23T19:48:39.534021] [INFO ] [MAIN ] ALE: Loaded 32075 existing records. [2025-10-23T19:48:39.710164] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:48:39.710377] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-23T19:48:39.710439] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-23T19:48:39.710885] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-23T19:48:39.710965] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-23T19:48:40.004706] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-23T19:48:40.080430] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:48:40.408977] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T19:48:40.799408] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-23T19:48:40.935244] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T19:48:41.599421] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-23T19:48:41.786709] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T19:48:42.399423] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-23T19:48:42.932706] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T19:48:43.199417] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-23T19:48:43.382148] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T19:48:43.390418] [INFO ] [REMOTE ] AL: Full fetch complete (63740 records). [2025-10-23T19:48:43.390569] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-23T19:48:43.770919] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-23T19:48:43.771034] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-23T19:48:43.771848] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-23T19:48:43.771930] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-23T19:48:43.773268] [DEBUG] [LOCAL ] AL: Trimmed 63740 records to 45163 (keeping 200 days of data) [2025-10-23T19:48:43.999723] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-23T19:48:44.048536] [DEBUG] [LOCAL ] AL: Primary data saved (45163 records). [2025-10-23T19:48:44.048716] [INFO ] [MAIN ] AL: Full history saved. [2025-10-23T19:48:44.048818] [INFO ] [MAIN ] Update Progress: 77/2367 symbols completed. AL took 26.1s. Estimated remaining: 4h 17m 41s. Rate: 8.9 symbols/min [2025-10-23T19:48:44.182077] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T19:48:44.410576] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T19:48:44.799416] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-23T19:48:45.599417] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-23T19:48:45.842850] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T19:48:45.863231] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T19:48:46.399406] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-23T19:48:47.199424] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-23T19:48:47.246894] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T19:48:47.999440] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-23T19:48:48.443580] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T19:48:48.608919] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-23T19:48:48.799417] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-23T19:48:49.599441] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-23T19:48:49.655112] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T19:48:50.244330] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T19:48:50.399435] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-23T19:48:51.199459] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-23T19:48:51.481190] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T19:48:51.662694] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T19:48:51.999407] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-23T19:48:52.799427] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-23T19:48:52.857493] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T19:48:53.599477] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-23T19:48:53.992467] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T19:48:54.162383] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-23T19:48:54.399514] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-23T19:48:55.199451] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-23T19:48:55.676160] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T19:48:55.999407] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-23T19:48:56.454203] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T19:48:56.799407] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-23T19:48:57.036551] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-23T19:48:57.046009] [INFO ] [REMOTE ] ALB: Full fetch complete (77083 records). [2025-10-23T19:48:57.046219] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-23T19:48:57.453190] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-23T19:48:57.453288] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-23T19:48:57.454022] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-23T19:48:57.454098] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-23T19:48:57.455455] [DEBUG] [LOCAL ] ALB: Trimmed 77083 records to 53752 (keeping 200 days of data) [2025-10-23T19:48:57.804281] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T19:48:57.823567] [DEBUG] [LOCAL ] ALB: Primary data saved (53752 records). [2025-10-23T19:48:57.823706] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-23T19:48:57.823799] [INFO ] [MAIN ] Update Progress: 78/2367 symbols completed. ALB took 35.2s. Estimated remaining: 4h 20m 60s. Rate: 8.8 symbols/min [2025-10-23T19:48:57.825964] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-23T19:48:58.204770] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T19:48:58.399420] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-23T19:48:59.683136] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T19:48:59.694495] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-23T19:48:59.861592] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T19:48:59.999396] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-23T19:49:01.866944] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T19:49:01.874553] [INFO ] [REMOTE ] ALE: Full fetch complete (44366 records). [2025-10-23T19:49:01.874697] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-23T19:49:01.992580] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-23T19:49:02.037128] [INFO ] [REMOTE ] ALC: Full fetch complete (73916 records). [2025-10-23T19:49:02.037280] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-23T19:49:02.689061] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-23T19:49:02.689154] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-23T19:49:02.689629] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-23T19:49:02.690744] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-23T19:49:02.691591] [DEBUG] [LOCAL ] ALE: Trimmed 44366 records to 32276 (keeping 200 days of data) [2025-10-23T19:49:02.991374] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-23T19:49:02.991606] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-23T19:49:02.992299] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-23T19:49:02.992365] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-23T19:49:02.999722] [DEBUG] [LOCAL ] ALC: Trimmed 73916 records to 51590 (keeping 200 days of data) [2025-10-23T19:49:03.112395] [DEBUG] [LOCAL ] ALE: Primary data saved (32276 records). [2025-10-23T19:49:03.112553] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-23T19:49:03.112637] [INFO ] [MAIN ] Update Progress: 79/2367 symbols completed. ALE took 23.8s. Estimated remaining: 4h 20m 8s. Rate: 8.8 symbols/min [2025-10-23T19:49:03.313234] [DEBUG] [LOCAL ] ALC: Primary data saved (51590 records). [2025-10-23T19:49:03.313384] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-23T19:49:03.313470] [INFO ] [MAIN ] Update Progress: 80/2367 symbols completed. ALC took 28.7s. Estimated remaining: 4h 16m 52s. Rate: 8.9 symbols/min [2025-10-23T19:49:03.965402] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:04.006049] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:04.006215] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-23T19:49:04.006256] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-23T19:49:04.006329] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-23T19:49:04.006368] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-23T19:49:04.006411] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-23T19:49:04.006447] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-23T19:49:04.023370] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:04.039954] [DEBUG] [LOCAL ] ALG: Loaded 9714 existing records from primary storage. [2025-10-23T19:49:04.040382] [INFO ] [MAIN ] ALG: Loaded 9714 existing records. [2025-10-23T19:49:04.042019] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:04.210886] [DEBUG] [LOCAL ] ALIT: Loaded 52781 existing records from primary storage. [2025-10-23T19:49:04.220075] [INFO ] [MAIN ] ALIT: Loaded 52781 existing records. [2025-10-23T19:49:04.318624] [DEBUG] [LOCAL ] ALEX: Loaded 30810 existing records from primary storage. [2025-10-23T19:49:04.318922] [INFO ] [MAIN ] ALEX: Loaded 30810 existing records. [2025-10-23T19:49:04.783724] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:04.796196] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-23T19:49:04.796329] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-23T19:49:04.796615] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-23T19:49:04.796729] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-23T19:49:04.807665] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:04.807861] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-23T19:49:04.807908] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-23T19:49:04.808131] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-23T19:49:04.808190] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-23T19:49:05.045020] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:05.072238] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-23T19:49:05.072296] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-23T19:49:05.072471] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-23T19:49:05.072513] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-23T19:49:05.451637] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:05.452009] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-23T19:49:05.749983] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:49:05.753371] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-23T19:49:05.760632] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:49:05.771572] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-23T19:49:05.771722] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:49:05.771801] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-23T19:49:05.771873] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-23T19:49:05.771923] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-23T19:49:05.771977] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-23T19:49:05.772037] [INFO ] [MAIN ] Update Progress: 81/2367 symbols completed. ALH took 2.5s. Estimated remaining: 4h 14m 45s. Rate: 9.0 symbols/min [2025-10-23T19:49:06.115201] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:06.137220] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-23T19:49:06.086349] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:06.142069] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-23T19:49:06.273094] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:06.363039] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:06.363347] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-23T19:49:06.381886] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-23T19:49:06.382319] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-23T19:49:06.571882] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:06.572243] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-23T19:49:06.572383] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-23T19:49:06.572688] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-23T19:49:06.572823] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-23T19:49:06.913060] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:06.913413] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-23T19:49:07.087259] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T19:49:07.090254] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-23T19:49:07.271875] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T19:49:07.277753] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-23T19:49:07.864058] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T19:49:07.874459] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-23T19:49:07.984694] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T19:49:07.987495] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-23T19:49:08.336490] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T19:49:08.342181] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-23T19:49:08.575373] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T19:49:08.799484] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-23T19:49:08.933741] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T19:49:09.089122] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T19:49:09.479880] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T19:49:09.599399] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-23T19:49:09.698703] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T19:49:10.216425] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T19:49:10.399429] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-23T19:49:11.199425] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-23T19:49:12.038840] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-23T19:49:12.068770] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T19:49:12.210328] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T19:49:12.799437] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-23T19:49:13.599414] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-23T19:49:13.773298] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T19:49:14.114379] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T19:49:14.175241] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-23T19:49:14.399422] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-23T19:49:15.199441] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-23T19:49:15.399053] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T19:49:15.710262] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-23T19:49:15.999412] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-23T19:49:16.799401] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-23T19:49:16.858994] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T19:49:17.599439] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-23T19:49:18.187445] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T19:49:18.399426] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-23T19:49:19.198634] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T19:49:19.199616] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-23T19:49:19.287085] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-23T19:49:19.999403] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-23T19:49:20.351920] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T19:49:20.799431] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-23T19:49:21.599406] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-23T19:49:21.607733] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T19:49:21.610132] [INFO ] [REMOTE ] ALG: Full fetch complete (15256 records). [2025-10-23T19:49:21.610280] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-23T19:49:21.969798] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T19:49:22.108232] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-23T19:49:22.108387] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-23T19:49:22.108948] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-23T19:49:22.109044] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-23T19:49:22.109829] [DEBUG] [LOCAL ] ALG: Trimmed 15256 records to 9765 (keeping 200 days of data) [2025-10-23T19:49:22.179450] [DEBUG] [LOCAL ] ALG: Primary data saved (9765 records). [2025-10-23T19:49:22.179631] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-23T19:49:22.179790] [INFO ] [MAIN ] Update Progress: 82/2367 symbols completed. ALG took 18.9s. Estimated remaining: 4h 19m 9s. Rate: 8.8 symbols/min [2025-10-23T19:49:22.369554] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:22.399433] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-23T19:49:22.425638] [DEBUG] [LOCAL ] ALL: Loaded 49604 existing records from primary storage. [2025-10-23T19:49:22.426110] [INFO ] [MAIN ] ALL: Loaded 49604 existing records. [2025-10-23T19:49:22.642278] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:22.642605] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-23T19:49:22.642696] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-23T19:49:22.643091] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-23T19:49:22.643164] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-23T19:49:23.029687] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:23.056391] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T19:49:23.199417] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-23T19:49:23.999429] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-23T19:49:24.260409] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T19:49:24.532277] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T19:49:24.538461] [INFO ] [REMOTE ] ALEX: Full fetch complete (44564 records). [2025-10-23T19:49:24.538726] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-23T19:49:24.805848] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-23T19:49:24.951473] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-23T19:49:24.951616] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-23T19:49:24.952276] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-23T19:49:24.952350] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-23T19:49:24.953782] [DEBUG] [LOCAL ] ALEX: Trimmed 44564 records to 31013 (keeping 200 days of data) [2025-10-23T19:49:25.144215] [DEBUG] [LOCAL ] ALEX: Primary data saved (31013 records). [2025-10-23T19:49:25.144391] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-23T19:49:25.144491] [INFO ] [MAIN ] Update Progress: 83/2367 symbols completed. ALEX took 21.8s. Estimated remaining: 4h 17m 16s. Rate: 8.9 symbols/min [2025-10-23T19:49:25.313815] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:25.364461] [DEBUG] [LOCAL ] ALLE: Loaded 43945 existing records from primary storage. [2025-10-23T19:49:25.364841] [INFO ] [MAIN ] ALLE: Loaded 43945 existing records. [2025-10-23T19:49:25.555483] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T19:49:25.602719] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-23T19:49:25.627835] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:25.627994] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-23T19:49:25.628044] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-23T19:49:25.628316] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-23T19:49:25.628384] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-23T19:49:25.984753] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:26.305774] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T19:49:26.399386] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-23T19:49:27.199473] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-23T19:49:27.474610] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T19:49:27.999404] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-23T19:49:28.176516] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T19:49:28.620424] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T19:49:28.799409] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-23T19:49:29.307436] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T19:49:29.599405] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-23T19:49:30.372918] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T19:49:30.399419] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-23T19:49:31.199430] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-23T19:49:31.300491] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T19:49:31.999414] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-23T19:49:32.196388] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T19:49:32.799427] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-23T19:49:32.959742] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T19:49:33.599410] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-23T19:49:33.832895] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T19:49:34.399413] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-23T19:49:34.600874] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T19:49:35.199413] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-23T19:49:35.416345] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T19:49:35.999440] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-23T19:49:36.188350] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:49:36.799399] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-23T19:49:36.957666] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T19:49:37.599409] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-23T19:49:38.145730] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T19:49:38.155372] [INFO ] [REMOTE ] ALK: Full fetch complete (77039 records). [2025-10-23T19:49:38.155602] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-23T19:49:38.404163] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-23T19:49:38.415183] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T19:49:38.586673] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-23T19:49:38.586802] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-23T19:49:38.587547] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-23T19:49:38.587598] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-23T19:49:38.589142] [DEBUG] [LOCAL ] ALK: Trimmed 77039 records to 53477 (keeping 200 days of data) [2025-10-23T19:49:38.886568] [DEBUG] [LOCAL ] ALK: Primary data saved (53477 records). [2025-10-23T19:49:38.886772] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-23T19:49:38.887019] [INFO ] [MAIN ] Update Progress: 84/2367 symbols completed. ALK took 33.1s. Estimated remaining: 4h 20m 19s. Rate: 8.8 symbols/min [2025-10-23T19:49:39.057074] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:39.109624] [DEBUG] [LOCAL ] ALLY: Loaded 53222 existing records from primary storage. [2025-10-23T19:49:39.110021] [INFO ] [MAIN ] ALLY: Loaded 53222 existing records. [2025-10-23T19:49:39.203493] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-23T19:49:39.293999] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:39.294185] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-23T19:49:39.294233] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-23T19:49:39.294436] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-23T19:49:39.294497] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-23T19:49:39.514160] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T19:49:39.546076] [INFO ] [REMOTE ] ALIT: Full fetch complete (76622 records). [2025-10-23T19:49:39.546215] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-23T19:49:39.885664] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:40.002932] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-23T19:49:40.132582] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T19:49:40.165381] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-23T19:49:40.165469] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-23T19:49:40.166256] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-23T19:49:40.166330] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-23T19:49:40.167764] [DEBUG] [LOCAL ] ALIT: Trimmed 76622 records to 53163 (keeping 200 days of data) [2025-10-23T19:49:40.462506] [DEBUG] [LOCAL ] ALIT: Primary data saved (53163 records). [2025-10-23T19:49:40.462676] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-23T19:49:40.462789] [INFO ] [MAIN ] Update Progress: 85/2367 symbols completed. ALIT took 37.1s. Estimated remaining: 4h 17m 51s. Rate: 8.9 symbols/min [2025-10-23T19:49:40.636665] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:40.636840] [DEBUG] [LOCAL ] ALSN: No existing data file found in primary storage. [2025-10-23T19:49:40.636892] [WARN ] [MAIN ] ALSN: No existing data found, performing full refresh instead. [2025-10-23T19:49:40.636966] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-23T19:49:40.637010] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-23T19:49:40.637084] [DEBUG] [LOCAL ] ALSN: No primary data file found to delete. [2025-10-23T19:49:40.637154] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-23T19:49:40.799770] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-23T19:49:40.876603] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T19:49:41.039703] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:41.599428] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-23T19:49:41.843313] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T19:49:42.399425] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-23T19:49:42.659428] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T19:49:43.204774] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-23T19:49:43.212960] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T19:49:43.999415] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-23T19:49:44.044856] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T19:49:44.798430] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T19:49:44.800476] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-23T19:49:45.561295] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T19:49:45.599399] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-23T19:49:46.399487] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-23T19:49:46.613519] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T19:49:47.199424] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-23T19:49:47.284433] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T19:49:47.999430] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-23T19:49:48.165029] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T19:49:48.799429] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-23T19:49:48.896791] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T19:49:49.499895] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T19:49:49.599398] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-23T19:49:50.399431] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-23T19:49:50.448370] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T19:49:51.199417] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-23T19:49:51.256832] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T19:49:51.999425] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-23T19:49:52.204258] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T19:49:52.212896] [INFO ] [REMOTE ] ALL: Full fetch complete (72425 records). [2025-10-23T19:49:52.213045] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-23T19:49:52.636791] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-23T19:49:52.636896] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-23T19:49:52.637902] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-23T19:49:52.637977] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-23T19:49:52.639445] [DEBUG] [LOCAL ] ALL: Trimmed 72425 records to 49959 (keeping 200 days of data) [2025-10-23T19:49:52.821226] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-23T19:49:52.920924] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T19:49:52.995984] [DEBUG] [LOCAL ] ALL: Primary data saved (49959 records). [2025-10-23T19:49:52.996306] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-23T19:49:52.998120] [INFO ] [MAIN ] Update Progress: 86/2367 symbols completed. ALL took 30.8s. Estimated remaining: 4h 20m 17s. Rate: 8.8 symbols/min [2025-10-23T19:49:53.137534] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T19:49:53.213944] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:49:53.245070] [DEBUG] [LOCAL ] ALTG: Loaded 23079 existing records from primary storage. [2025-10-23T19:49:53.245493] [INFO ] [MAIN ] ALTG: Loaded 23079 existing records. [2025-10-23T19:49:53.434618] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:49:53.434834] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-23T19:49:53.434887] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-23T19:49:53.435066] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-23T19:49:53.435141] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-23T19:49:53.609797] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-23T19:49:53.814270] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:49:54.399416] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-23T19:49:54.845430] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T19:49:55.199404] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-23T19:49:55.355669] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T19:49:55.442099] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T19:49:55.862346] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T19:49:55.999392] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-23T19:49:56.799418] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-23T19:49:57.564393] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T19:49:57.599400] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-23T19:49:58.417690] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-23T19:49:58.441701] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T19:49:58.466192] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T19:49:59.199427] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-23T19:49:59.999407] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-23T19:50:00.035172] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T19:50:00.452602] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T19:50:00.799430] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-23T19:50:01.418370] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T19:50:01.599450] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-23T19:50:02.399414] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-23T19:50:02.903330] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-23T19:50:03.199435] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-23T19:50:03.771718] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-23T19:50:03.781001] [INFO ] [REMOTE ] ALLE: Full fetch complete (64976 records). [2025-10-23T19:50:03.781159] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-23T19:50:04.014778] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-23T19:50:04.183997] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-23T19:50:04.184118] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-23T19:50:04.184787] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-23T19:50:04.184864] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-23T19:50:04.186175] [DEBUG] [LOCAL ] ALLE: Trimmed 64976 records to 44288 (keeping 200 days of data) [2025-10-23T19:50:04.458834] [DEBUG] [LOCAL ] ALLE: Primary data saved (44288 records). [2025-10-23T19:50:04.459029] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-23T19:50:04.460381] [INFO ] [MAIN ] Update Progress: 87/2367 symbols completed. ALLE took 39.3s. Estimated remaining: 4h 22m 11s. Rate: 8.7 symbols/min [2025-10-23T19:50:04.632231] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:04.644715] [DEBUG] [LOCAL ] ALUR: Loaded 9277 existing records from primary storage. [2025-10-23T19:50:04.644959] [INFO ] [MAIN ] ALUR: Loaded 9277 existing records. [2025-10-23T19:50:04.829230] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:04.829418] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-23T19:50:04.829465] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-23T19:50:04.829700] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-23T19:50:04.829767] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-23T19:50:04.921275] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-23T19:50:04.951174] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-23T19:50:05.041129] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T19:50:05.069740] [INFO ] [REMOTE ] ALSN: Full fetch complete (62761 records). [2025-10-23T19:50:05.070452] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-23T19:50:05.528593] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T19:50:05.605806] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-23T19:50:05.628497] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:05.716612] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-23T19:50:05.716743] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-23T19:50:05.717377] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-23T19:50:05.717422] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-23T19:50:05.718688] [DEBUG] [LOCAL ] ALSN: Trimmed 62761 records to 43535 (keeping 200 days of data) [2025-10-23T19:50:05.976659] [DEBUG] [LOCAL ] ALSN: Primary data saved (43535 records). [2025-10-23T19:50:05.976838] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-23T19:50:05.976914] [INFO ] [MAIN ] Update Progress: 88/2367 symbols completed. ALSN took 25.5s. Estimated remaining: 4h 19m 45s. Rate: 8.8 symbols/min [2025-10-23T19:50:06.146586] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:06.196426] [DEBUG] [LOCAL ] ALV: Loaded 42191 existing records from primary storage. [2025-10-23T19:50:06.196802] [INFO ] [MAIN ] ALV: Loaded 42191 existing records. [2025-10-23T19:50:06.378674] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:06.378882] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-23T19:50:06.378931] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-23T19:50:06.379155] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-23T19:50:06.379216] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-23T19:50:06.400515] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-23T19:50:06.632369] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T19:50:06.774795] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:06.835483] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T19:50:07.199411] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-23T19:50:07.999472] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-23T19:50:08.728028] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-23T19:50:08.799410] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-23T19:50:09.265812] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T19:50:09.550971] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T19:50:09.599414] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-23T19:50:09.994526] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T19:50:10.399418] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-23T19:50:10.947138] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T19:50:11.186973] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T19:50:11.199393] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-23T19:50:11.999450] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-23T19:50:12.707127] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T19:50:12.799419] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-23T19:50:13.123045] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T19:50:13.599416] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-23T19:50:14.399766] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-23T19:50:14.402229] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T19:50:14.719914] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T19:50:15.199425] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-23T19:50:15.289273] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T19:50:15.999419] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-23T19:50:16.799410] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-23T19:50:17.030001] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T19:50:17.599404] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-23T19:50:17.773255] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T19:50:17.920065] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T19:50:18.399437] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-23T19:50:19.026207] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T19:50:19.199409] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-23T19:50:19.999422] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-23T19:50:20.116124] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T19:50:20.799393] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-23T19:50:20.862001] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T19:50:20.866975] [INFO ] [REMOTE ] ALTG: Full fetch complete (33401 records). [2025-10-23T19:50:20.867062] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-23T19:50:21.272630] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T19:50:21.305064] [INFO ] [REMOTE ] ALLY: Full fetch complete (77256 records). [2025-10-23T19:50:21.305259] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-23T19:50:21.313888] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-23T19:50:21.313978] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-23T19:50:21.314550] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-23T19:50:21.314620] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-23T19:50:21.319289] [DEBUG] [LOCAL ] ALTG: Trimmed 33401 records to 23210 (keeping 200 days of data) [2025-10-23T19:50:21.558411] [DEBUG] [LOCAL ] ALTG: Primary data saved (23210 records). [2025-10-23T19:50:21.558599] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-23T19:50:21.562169] [INFO ] [MAIN ] Update Progress: 89/2367 symbols completed. ALTG took 28.6s. Estimated remaining: 4h 23m 22s. Rate: 8.6 symbols/min [2025-10-23T19:50:21.611779] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-23T19:50:21.977197] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:22.031411] [DEBUG] [LOCAL ] ALX: Loaded 7271 existing records from primary storage. [2025-10-23T19:50:22.031715] [INFO ] [MAIN ] ALX: Loaded 7271 existing records. [2025-10-23T19:50:22.133283] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-23T19:50:22.133423] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-23T19:50:22.134331] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-23T19:50:22.134548] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-23T19:50:22.139064] [DEBUG] [LOCAL ] ALLY: Trimmed 77256 records to 53610 (keeping 200 days of data) [2025-10-23T19:50:22.327604] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T19:50:22.431008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-23T19:50:22.435402] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T19:50:22.558136] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:22.560981] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-23T19:50:22.561054] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-23T19:50:22.561224] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-23T19:50:22.561318] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-23T19:50:22.713384] [DEBUG] [LOCAL ] ALLY: Primary data saved (53610 records). [2025-10-23T19:50:22.713548] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-23T19:50:22.713660] [INFO ] [MAIN ] Update Progress: 90/2367 symbols completed. ALLY took 43.8s. Estimated remaining: 4h 20m 49s. Rate: 8.7 symbols/min [2025-10-23T19:50:23.037323] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:23.186679] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:23.205916] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-23T19:50:23.232209] [DEBUG] [LOCAL ] AM: Loaded 51849 existing records from primary storage. [2025-10-23T19:50:23.233247] [INFO ] [MAIN ] AM: Loaded 51849 existing records. [2025-10-23T19:50:23.412611] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:23.413044] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-23T19:50:23.413186] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-23T19:50:23.413557] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-23T19:50:23.413720] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-23T19:50:23.728971] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-23T19:50:23.789156] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:23.999434] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-23T19:50:24.081410] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T19:50:24.799413] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-23T19:50:25.473211] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T19:50:25.501785] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T19:50:25.599388] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-23T19:50:26.399442] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-23T19:50:27.199401] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-23T19:50:27.234866] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T19:50:27.377054] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T19:50:27.720485] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-23T19:50:27.999413] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-23T19:50:28.799447] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-23T19:50:29.599442] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-23T19:50:29.752028] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T19:50:30.095625] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T19:50:30.399403] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-23T19:50:30.466531] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T19:50:31.199410] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-23T19:50:31.804784] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T19:50:31.996518] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T19:50:32.007551] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-23T19:50:32.799433] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-23T19:50:32.875873] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-23T19:50:33.599416] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-23T19:50:34.371798] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T19:50:34.372804] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T19:50:34.399386] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-23T19:50:35.199443] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-23T19:50:35.999678] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-23T19:50:36.288376] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T19:50:36.300319] [INFO ] [REMOTE ] ALV: Full fetch complete (62430 records). [2025-10-23T19:50:36.300579] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-23T19:50:36.535438] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T19:50:36.695706] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-23T19:50:36.695812] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-23T19:50:36.696428] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-23T19:50:36.696471] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-23T19:50:36.697680] [DEBUG] [LOCAL ] ALV: Trimmed 62430 records to 42508 (keeping 200 days of data) [2025-10-23T19:50:36.799789] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-23T19:50:36.960559] [DEBUG] [LOCAL ] ALV: Primary data saved (42508 records). [2025-10-23T19:50:36.960729] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-23T19:50:36.960821] [INFO ] [MAIN ] Update Progress: 91/2367 symbols completed. ALV took 31.0s. Estimated remaining: 4h 23m 46s. Rate: 8.6 symbols/min [2025-10-23T19:50:37.070479] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T19:50:37.178129] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:37.223469] [DEBUG] [LOCAL ] AMBC: Loaded 35885 existing records from primary storage. [2025-10-23T19:50:37.224930] [INFO ] [MAIN ] AMBC: Loaded 35885 existing records. [2025-10-23T19:50:37.425987] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:37.426180] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-23T19:50:37.426229] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-23T19:50:37.426489] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-23T19:50:37.426551] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-23T19:50:37.604798] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-23T19:50:37.627404] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T19:50:37.793164] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:38.151228] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T19:50:38.399449] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-23T19:50:39.199424] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-23T19:50:39.999391] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-23T19:50:40.148922] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T19:50:40.348385] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T19:50:40.799405] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-23T19:50:41.009622] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T19:50:41.012301] [INFO ] [REMOTE ] ALX: Full fetch complete (8191 records). [2025-10-23T19:50:41.012418] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-23T19:50:41.205294] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-23T19:50:41.420031] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-23T19:50:41.420144] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-23T19:50:41.420398] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-23T19:50:41.420446] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-23T19:50:41.420937] [DEBUG] [LOCAL ] ALX: Trimmed 8191 records to 7365 (keeping 200 days of data) [2025-10-23T19:50:41.467928] [DEBUG] [LOCAL ] ALX: Primary data saved (7365 records). [2025-10-23T19:50:41.468240] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-23T19:50:41.468338] [INFO ] [MAIN ] Update Progress: 92/2367 symbols completed. ALX took 19.9s. Estimated remaining: 4h 22m 39s. Rate: 8.7 symbols/min [2025-10-23T19:50:41.605479] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-23T19:50:41.638685] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:41.677080] [DEBUG] [LOCAL ] AMBP: Loaded 44318 existing records from primary storage. [2025-10-23T19:50:41.677411] [INFO ] [MAIN ] AMBP: Loaded 44318 existing records. [2025-10-23T19:50:41.854774] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:41.854990] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-23T19:50:41.855037] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-23T19:50:41.855312] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-23T19:50:41.855372] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-23T19:50:42.204479] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:42.399424] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-23T19:50:43.199401] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-23T19:50:43.325743] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T19:50:43.651482] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T19:50:43.999425] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-23T19:50:44.799425] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-23T19:50:44.920785] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T19:50:45.599416] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-23T19:50:46.011452] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T19:50:46.399412] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-23T19:50:46.436669] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T19:50:46.438520] [INFO ] [REMOTE ] ALUR: Full fetch complete (18287 records). [2025-10-23T19:50:46.438624] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-23T19:50:46.538255] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T19:50:46.889552] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-23T19:50:46.889680] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-23T19:50:46.889978] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-23T19:50:46.890024] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-23T19:50:46.890623] [DEBUG] [LOCAL ] ALUR: Trimmed 18287 records to 9313 (keeping 200 days of data) [2025-10-23T19:50:46.941701] [DEBUG] [LOCAL ] ALUR: Primary data saved (9313 records). [2025-10-23T19:50:46.941856] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-23T19:50:46.941940] [INFO ] [MAIN ] Update Progress: 93/2367 symbols completed. ALUR took 42.5s. Estimated remaining: 4h 21m 56s. Rate: 8.7 symbols/min [2025-10-23T19:50:47.123441] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:47.123687] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-23T19:50:47.123752] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-23T19:50:47.123833] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-23T19:50:47.123875] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-23T19:50:47.123921] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-23T19:50:47.123958] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-23T19:50:47.204700] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-23T19:50:47.527214] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:47.999399] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-23T19:50:48.234499] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:50:48.234832] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-23T19:50:48.234930] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:50:48.234983] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-23T19:50:48.235026] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:50:48.235073] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-23T19:50:48.235139] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-23T19:50:48.235188] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-23T19:50:48.235241] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-23T19:50:48.235300] [INFO ] [MAIN ] Update Progress: 94/2367 symbols completed. AMBQ took 1.3s. Estimated remaining: 4h 19m 33s. Rate: 8.8 symbols/min [2025-10-23T19:50:48.299671] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T19:50:48.437078] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:48.483289] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-23T19:50:48.483676] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-23T19:50:48.659504] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:48.659747] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-23T19:50:48.659810] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-23T19:50:48.660064] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-23T19:50:48.660105] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-23T19:50:48.804494] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-23T19:50:49.014872] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:49.042577] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T19:50:49.599415] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-23T19:50:50.399408] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-23T19:50:51.166740] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-23T19:50:51.183706] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T19:50:51.199407] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-23T19:50:51.999438] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-23T19:50:52.792784] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-23T19:50:52.803773] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-23T19:50:52.912932] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T19:50:53.465425] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T19:50:53.475548] [INFO ] [REMOTE ] AM: Full fetch complete (75664 records). [2025-10-23T19:50:53.477766] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-23T19:50:53.604707] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-23T19:50:53.886090] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-23T19:50:53.886222] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-23T19:50:53.887259] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-23T19:50:53.887341] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-23T19:50:53.889015] [DEBUG] [LOCAL ] AM: Trimmed 75664 records to 52213 (keeping 200 days of data) [2025-10-23T19:50:54.004866] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T19:50:54.230537] [DEBUG] [LOCAL ] AM: Primary data saved (52213 records). [2025-10-23T19:50:54.230724] [INFO ] [MAIN ] AM: Full history saved. [2025-10-23T19:50:54.230824] [INFO ] [MAIN ] Update Progress: 95/2367 symbols completed. AM took 31.5s. Estimated remaining: 4h 19m 6s. Rate: 8.8 symbols/min [2025-10-23T19:50:54.402387] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-23T19:50:54.437584] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:50:54.483298] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-23T19:50:54.483629] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-23T19:50:54.679230] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:50:54.679432] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-23T19:50:54.679481] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-23T19:50:54.679819] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-23T19:50:54.679884] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-23T19:50:55.072486] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:50:55.199443] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-23T19:50:55.743221] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T19:50:55.877176] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-23T19:50:55.999394] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-23T19:50:56.526909] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T19:50:56.799450] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-23T19:50:57.599406] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-23T19:50:58.307146] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-23T19:50:58.400099] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T19:50:58.400238] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-23T19:50:59.150481] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T19:50:59.199384] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-23T19:50:59.811912] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-23T19:50:59.999414] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-23T19:51:00.799427] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-23T19:51:01.599435] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-23T19:51:01.716819] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-23T19:51:02.399416] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-23T19:51:02.752395] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-23T19:51:03.097105] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T19:51:03.199433] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-23T19:51:03.893847] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T19:51:03.999407] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-23T19:51:04.315314] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-23T19:51:04.799438] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-23T19:51:05.129584] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T19:51:05.605582] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-23T19:51:05.632594] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T19:51:05.867931] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T19:51:06.399413] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-23T19:51:07.199430] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-23T19:51:07.999436] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-23T19:51:08.359420] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-23T19:51:08.436861] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T19:51:08.805800] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-23T19:51:08.821482] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T19:51:09.542753] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T19:51:09.549247] [INFO ] [REMOTE ] AMBC: Full fetch complete (51901 records). [2025-10-23T19:51:09.549356] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-23T19:51:09.604829] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-23T19:51:09.993009] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-23T19:51:09.993107] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-23T19:51:09.993636] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-23T19:51:09.993728] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-23T19:51:09.994758] [DEBUG] [LOCAL ] AMBC: Trimmed 51901 records to 36148 (keeping 200 days of data) [2025-10-23T19:51:10.202941] [DEBUG] [LOCAL ] AMBC: Primary data saved (36148 records). [2025-10-23T19:51:10.203111] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-23T19:51:10.203200] [INFO ] [MAIN ] Update Progress: 96/2367 symbols completed. AMBC took 33.2s. Estimated remaining: 4h 22m 35s. Rate: 8.6 symbols/min [2025-10-23T19:51:10.322765] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T19:51:10.410403] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-23T19:51:10.452449] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:51:10.502845] [DEBUG] [LOCAL ] AME: Loaded 48418 existing records from primary storage. [2025-10-23T19:51:10.503190] [INFO ] [MAIN ] AME: Loaded 48418 existing records. [2025-10-23T19:51:10.694720] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:51:10.694937] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-23T19:51:10.694985] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-23T19:51:10.695200] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-23T19:51:10.695263] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-23T19:51:11.079066] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:51:11.200496] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T19:51:11.210826] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-23T19:51:11.999426] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-23T19:51:12.218210] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T19:51:12.799413] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-23T19:51:12.966377] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T19:51:13.599444] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-23T19:51:14.405773] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-23T19:51:14.432562] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-23T19:51:14.724089] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T19:51:15.163507] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T19:51:15.171043] [INFO ] [REMOTE ] AMBP: Full fetch complete (64992 records). [2025-10-23T19:51:15.171409] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-23T19:51:15.207827] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-23T19:51:15.576318] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-23T19:51:15.576580] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-23T19:51:15.577370] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-23T19:51:15.577501] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-23T19:51:15.578948] [DEBUG] [LOCAL ] AMBP: Trimmed 64992 records to 44670 (keeping 200 days of data) [2025-10-23T19:51:15.862115] [DEBUG] [LOCAL ] AMBP: Primary data saved (44670 records). [2025-10-23T19:51:15.862473] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-23T19:51:15.862712] [INFO ] [MAIN ] Update Progress: 97/2367 symbols completed. AMBP took 34.4s. Estimated remaining: 4h 21m 58s. Rate: 8.7 symbols/min [2025-10-23T19:51:16.009686] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-23T19:51:16.035665] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:51:16.056540] [DEBUG] [LOCAL ] AMG: Loaded 20036 existing records from primary storage. [2025-10-23T19:51:16.056857] [INFO ] [MAIN ] AMG: Loaded 20036 existing records. [2025-10-23T19:51:16.183555] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T19:51:16.276613] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:51:16.276855] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-23T19:51:16.276911] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-23T19:51:16.277082] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-23T19:51:16.277171] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-23T19:51:16.626713] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:51:16.799428] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-23T19:51:17.186508] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T19:51:17.599433] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-23T19:51:18.400495] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-23T19:51:18.519855] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T19:51:18.576500] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T19:51:18.636104] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-23T19:51:19.199414] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-23T19:51:19.938359] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T19:51:19.999413] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-23T19:51:20.657239] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-23T19:51:20.666752] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-23T19:51:20.666898] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-23T19:51:20.804568] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-23T19:51:21.090245] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-23T19:51:21.090354] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-23T19:51:21.091143] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-23T19:51:21.091218] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-23T19:51:21.092665] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 54060 (keeping 200 days of data) [2025-10-23T19:51:21.406541] [DEBUG] [LOCAL ] AMCR: Primary data saved (54060 records). [2025-10-23T19:51:21.406726] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-23T19:51:21.406822] [INFO ] [MAIN ] Update Progress: 98/2367 symbols completed. AMCR took 27.2s. Estimated remaining: 4h 21m 20s. Rate: 8.7 symbols/min [2025-10-23T19:51:21.594543] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:51:21.599395] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-23T19:51:21.654591] [DEBUG] [LOCAL ] AMH: Loaded 51830 existing records from primary storage. [2025-10-23T19:51:21.654981] [INFO ] [MAIN ] AMH: Loaded 51830 existing records. [2025-10-23T19:51:21.762596] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T19:51:21.884454] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:51:21.884669] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-23T19:51:21.884740] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-23T19:51:21.884973] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-23T19:51:21.885033] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-23T19:51:22.229049] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:51:22.399392] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-23T19:51:22.765392] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T19:51:22.940875] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-23T19:51:23.199412] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-23T19:51:23.999419] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-23T19:51:24.113435] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T19:51:24.369890] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T19:51:24.799454] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-23T19:51:25.599393] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-23T19:51:25.739126] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T19:51:25.993552] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T19:51:26.399443] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-23T19:51:27.199579] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-23T19:51:27.208433] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T19:51:27.999393] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-23T19:51:28.061792] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T19:51:28.220287] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T19:51:28.800853] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-23T19:51:29.599404] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-23T19:51:30.304305] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-23T19:51:30.399426] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-23T19:51:30.483727] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T19:51:31.199393] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-23T19:51:31.416609] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T19:51:31.516146] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T19:51:31.999421] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-23T19:51:32.799450] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-23T19:51:32.978818] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T19:51:33.599415] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-23T19:51:33.684811] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-23T19:51:33.695010] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-23T19:51:33.695150] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-23T19:51:34.101768] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-23T19:51:34.101868] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-23T19:51:34.102606] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-23T19:51:34.102676] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-23T19:51:34.104115] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54156 (keeping 200 days of data) [2025-10-23T19:51:34.411696] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-23T19:51:34.423680] [DEBUG] [LOCAL ] AMC: Primary data saved (54156 records). [2025-10-23T19:51:34.423870] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-23T19:51:34.423957] [INFO ] [MAIN ] Update Progress: 99/2367 symbols completed. AMC took 46.2s. Estimated remaining: 4h 23m 33s. Rate: 8.6 symbols/min [2025-10-23T19:51:34.509510] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T19:51:34.651396] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:51:34.694679] [DEBUG] [LOCAL ] AMN: Loaded 41641 existing records from primary storage. [2025-10-23T19:51:34.695182] [INFO ] [MAIN ] AMN: Loaded 41641 existing records. [2025-10-23T19:51:34.788566] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T19:51:34.903063] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:51:34.903263] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-23T19:51:34.903313] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-23T19:51:34.903590] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-23T19:51:34.903681] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-23T19:51:35.206033] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-23T19:51:35.303440] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:51:36.001716] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-23T19:51:36.159679] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T19:51:36.799424] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-23T19:51:36.975708] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T19:51:37.018938] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T19:51:37.022528] [INFO ] [REMOTE ] AMG: Full fetch complete (29524 records). [2025-10-23T19:51:37.022621] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-23T19:51:37.415021] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-23T19:51:37.415131] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-23T19:51:37.415503] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-23T19:51:37.415547] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-23T19:51:37.416426] [DEBUG] [LOCAL ] AMG: Trimmed 29524 records to 20186 (keeping 200 days of data) [2025-10-23T19:51:37.540341] [DEBUG] [LOCAL ] AMG: Primary data saved (20186 records). [2025-10-23T19:51:37.540492] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-23T19:51:37.540571] [INFO ] [MAIN ] Update Progress: 100/2367 symbols completed. AMG took 21.7s. Estimated remaining: 4h 21m 58s. Rate: 8.7 symbols/min [2025-10-23T19:51:37.604523] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-23T19:51:37.720399] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:51:37.754452] [DEBUG] [LOCAL ] AMP: Loaded 31807 existing records from primary storage. [2025-10-23T19:51:37.754749] [INFO ] [MAIN ] AMP: Loaded 31807 existing records. [2025-10-23T19:51:37.890573] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T19:51:37.974366] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:51:37.974550] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-23T19:51:37.974597] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-23T19:51:37.974851] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-23T19:51:37.974918] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-23T19:51:38.321402] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:51:38.399396] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-23T19:51:39.077201] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T19:51:39.085366] [INFO ] [REMOTE ] AME: Full fetch complete (70128 records). [2025-10-23T19:51:39.085492] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-23T19:51:39.204549] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-23T19:51:39.498866] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-23T19:51:39.499014] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-23T19:51:39.499734] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-23T19:51:39.499808] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-23T19:51:39.501219] [DEBUG] [LOCAL ] AME: Trimmed 70128 records to 48787 (keeping 200 days of data) [2025-10-23T19:51:39.666055] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T19:51:39.843550] [DEBUG] [LOCAL ] AME: Primary data saved (48787 records). [2025-10-23T19:51:39.843741] [INFO ] [MAIN ] AME: Full history saved. [2025-10-23T19:51:39.843863] [INFO ] [MAIN ] Update Progress: 101/2367 symbols completed. AME took 29.6s. Estimated remaining: 4h 20m 7s. Rate: 8.7 symbols/min [2025-10-23T19:51:40.000116] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-23T19:51:40.017801] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:51:40.017981] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-10-23T19:51:40.018022] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-10-23T19:51:40.018121] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-23T19:51:40.018177] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-23T19:51:40.018221] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-23T19:51:40.018257] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-23T19:51:40.386754] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:51:40.734325] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T19:51:40.799417] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-23T19:51:41.599438] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-23T19:51:41.762209] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T19:51:42.399421] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-23T19:51:42.643975] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T19:51:42.847635] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T19:51:43.199422] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-23T19:51:43.821918] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T19:51:43.999466] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-23T19:51:44.799408] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-23T19:51:44.847901] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T19:51:45.548552] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T19:51:45.599387] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-23T19:51:46.399724] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-23T19:51:46.514511] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T19:51:46.977321] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T19:51:47.199411] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-23T19:51:47.965977] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T19:51:47.999394] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-23T19:51:48.799396] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-23T19:51:49.082339] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T19:51:49.599396] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-23T19:51:50.080132] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-23T19:51:50.399427] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-23T19:51:50.478431] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T19:51:51.199402] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-23T19:51:51.275803] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T19:51:51.396723] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T19:51:51.999417] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-23T19:51:52.575844] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T19:51:52.799418] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-23T19:51:53.599430] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-23T19:51:53.873802] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T19:51:54.399393] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-23T19:51:54.636380] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T19:51:55.178963] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T19:51:55.199388] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-23T19:51:55.736733] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T19:51:55.999386] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-23T19:51:56.656026] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T19:51:56.799399] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-23T19:51:57.601168] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-23T19:51:57.612701] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T19:51:58.187377] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T19:51:58.399391] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-23T19:51:59.199396] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-23T19:51:59.463269] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T19:51:59.665315] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T19:51:59.999427] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-23T19:52:00.799429] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-23T19:52:01.599411] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-23T19:52:01.931937] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T19:52:02.017891] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-23T19:52:02.030784] [INFO ] [REMOTE ] AMH: Full fetch complete (75124 records). [2025-10-23T19:52:02.030944] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-23T19:52:02.404787] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-23T19:52:02.515087] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-23T19:52:02.515217] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-23T19:52:02.516116] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-23T19:52:02.516198] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-23T19:52:02.518113] [DEBUG] [LOCAL ] AMH: Trimmed 75124 records to 52212 (keeping 200 days of data) [2025-10-23T19:52:02.853076] [DEBUG] [LOCAL ] AMH: Primary data saved (52212 records). [2025-10-23T19:52:02.853256] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-23T19:52:02.853343] [INFO ] [MAIN ] Update Progress: 102/2367 symbols completed. AMH took 41.4s. Estimated remaining: 4h 25m 58s. Rate: 8.5 symbols/min [2025-10-23T19:52:03.025068] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:03.062873] [DEBUG] [LOCAL ] AMPY: Loaded 39376 existing records from primary storage. [2025-10-23T19:52:03.063198] [INFO ] [MAIN ] AMPY: Loaded 39376 existing records. [2025-10-23T19:52:03.240080] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:03.240297] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-23T19:52:03.240346] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-23T19:52:03.240527] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-23T19:52:03.240571] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-23T19:52:03.628234] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:03.628548] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-23T19:52:03.871492] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (3.07 seconds). [2025-10-23T19:52:03.999411] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-23T19:52:04.593135] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T19:52:04.614785] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-23T19:52:04.620732] [INFO ] [REMOTE ] AMP: Full fetch complete (47589 records). [2025-10-23T19:52:04.621000] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-23T19:52:04.807310] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-23T19:52:05.028078] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-23T19:52:05.028208] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-23T19:52:05.028787] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-23T19:52:05.028867] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-23T19:52:05.029933] [DEBUG] [LOCAL ] AMP: Trimmed 47589 records to 31992 (keeping 200 days of data) [2025-10-23T19:52:05.235345] [DEBUG] [LOCAL ] AMP: Primary data saved (31992 records). [2025-10-23T19:52:05.235491] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-23T19:52:05.236988] [INFO ] [MAIN ] Update Progress: 103/2367 symbols completed. AMP took 27.7s. Estimated remaining: 4h 24m 9s. Rate: 8.6 symbols/min [2025-10-23T19:52:05.415846] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:05.446174] [DEBUG] [LOCAL ] AMR: Loaded 28786 existing records from primary storage. [2025-10-23T19:52:05.446456] [INFO ] [MAIN ] AMR: Loaded 28786 existing records. [2025-10-23T19:52:05.535604] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (3.94 seconds). [2025-10-23T19:52:05.604484] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-23T19:52:05.684431] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:05.684749] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-23T19:52:05.684850] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-23T19:52:05.685245] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-23T19:52:05.685308] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-23T19:52:06.077670] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:06.096431] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T19:52:06.399404] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-23T19:52:06.797862] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-23T19:52:06.807974] [INFO ] [REMOTE ] AMN: Full fetch complete (60201 records). [2025-10-23T19:52:06.808140] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-23T19:52:07.194574] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-23T19:52:07.194694] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-23T19:52:07.195316] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-23T19:52:07.195366] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-23T19:52:07.196583] [DEBUG] [LOCAL ] AMN: Trimmed 60201 records to 41883 (keeping 200 days of data) [2025-10-23T19:52:07.242593] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-23T19:52:07.436005] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T19:52:07.472826] [DEBUG] [LOCAL ] AMN: Primary data saved (41883 records). [2025-10-23T19:52:07.473154] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-23T19:52:07.474240] [INFO ] [MAIN ] Update Progress: 104/2367 symbols completed. AMN took 33.1s. Estimated remaining: 4h 22m 18s. Rate: 8.6 symbols/min [2025-10-23T19:52:07.669207] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:07.706014] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T19:52:07.753948] [DEBUG] [LOCAL ] AMRC: Loaded 38551 existing records from primary storage. [2025-10-23T19:52:07.754249] [INFO ] [MAIN ] AMRC: Loaded 38551 existing records. [2025-10-23T19:52:07.928456] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:07.928633] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-23T19:52:07.928721] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-23T19:52:07.928938] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-23T19:52:07.928987] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-23T19:52:08.004451] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-23T19:52:08.223048] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T19:52:08.315634] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:08.799418] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-23T19:52:09.570101] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T19:52:09.599410] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-23T19:52:10.399418] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-23T19:52:10.819428] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T19:52:11.090276] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-23T19:52:11.199405] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-23T19:52:11.514081] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T19:52:11.999405] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-23T19:52:12.799457] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-23T19:52:13.240527] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T19:52:13.380387] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-23T19:52:13.392907] [INFO ] [REMOTE ] AMPX: Full fetch complete (75247 records). [2025-10-23T19:52:13.393152] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-23T19:52:13.604714] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-23T19:52:13.803025] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-23T19:52:13.803123] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-23T19:52:13.803850] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-23T19:52:13.803922] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-23T19:52:13.805290] [DEBUG] [LOCAL ] AMPX: Trimmed 75247 records to 52829 (keeping 200 days of data) [2025-10-23T19:52:14.105782] [DEBUG] [LOCAL ] AMPX: Primary data saved (52829 records). [2025-10-23T19:52:14.105940] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-23T19:52:14.106027] [INFO ] [MAIN ] Update Progress: 105/2367 symbols completed. AMPX took 34.3s. Estimated remaining: 4h 22m 4s. Rate: 8.6 symbols/min [2025-10-23T19:52:14.197589] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T19:52:14.303591] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:14.303963] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-23T19:52:14.304023] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-23T19:52:14.304175] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-23T19:52:14.304299] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-23T19:52:14.304369] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-23T19:52:14.304483] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-23T19:52:14.403035] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-23T19:52:14.668165] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:15.048409] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T19:52:15.199409] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-23T19:52:15.832546] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T19:52:15.999410] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-23T19:52:16.189827] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:52:16.190180] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-23T19:52:16.190265] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:52:16.190340] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-23T19:52:16.190412] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:52:16.190483] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-23T19:52:16.190556] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-23T19:52:16.190622] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-23T19:52:16.190727] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-23T19:52:16.190811] [INFO ] [MAIN ] Update Progress: 106/2367 symbols completed. AMRZ took 2.1s. Estimated remaining: 4h 20m 14s. Rate: 8.7 symbols/min [2025-10-23T19:52:16.365660] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:16.423766] [DEBUG] [LOCAL ] AMT: Loaded 52430 existing records from primary storage. [2025-10-23T19:52:16.424114] [INFO ] [MAIN ] AMT: Loaded 52430 existing records. [2025-10-23T19:52:16.625916] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:16.626122] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-23T19:52:16.626305] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-23T19:52:16.626688] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-23T19:52:16.626819] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-23T19:52:16.816560] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-23T19:52:16.835466] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T19:52:17.042030] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:17.599427] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-23T19:52:18.399421] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-23T19:52:18.434697] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T19:52:18.816123] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T19:52:19.199439] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-23T19:52:19.846497] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T19:52:19.999399] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-23T19:52:20.660119] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-23T19:52:20.799400] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-23T19:52:21.378762] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T19:52:21.599421] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-23T19:52:21.808758] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T19:52:22.399447] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-23T19:52:23.199445] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-23T19:52:23.540053] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T19:52:23.948867] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T19:52:23.999393] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-23T19:52:24.714721] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T19:52:24.799469] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-23T19:52:24.953068] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T19:52:25.599446] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-23T19:52:26.375030] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T19:52:26.399439] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-23T19:52:27.096911] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T19:52:27.199434] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-23T19:52:27.688576] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T19:52:27.999404] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-23T19:52:28.799433] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-23T19:52:29.181257] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T19:52:29.599444] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-23T19:52:30.090118] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T19:52:30.399398] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-23T19:52:30.563382] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-23T19:52:30.574553] [INFO ] [REMOTE ] AMPY: Full fetch complete (53434 records). [2025-10-23T19:52:30.574834] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-23T19:52:31.071228] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-23T19:52:31.071357] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-23T19:52:31.071996] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-23T19:52:31.072071] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-23T19:52:31.073309] [DEBUG] [LOCAL ] AMPY: Trimmed 53434 records to 39691 (keeping 200 days of data) [2025-10-23T19:52:31.227997] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-23T19:52:31.304549] [DEBUG] [LOCAL ] AMPY: Primary data saved (39691 records). [2025-10-23T19:52:31.304854] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-23T19:52:31.304997] [INFO ] [MAIN ] Update Progress: 107/2367 symbols completed. AMPY took 28.5s. Estimated remaining: 4h 23m 0s. Rate: 8.6 symbols/min [2025-10-23T19:52:31.509920] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T19:52:31.530828] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:31.551492] [DEBUG] [LOCAL ] AMTB: Loaded 20336 existing records from primary storage. [2025-10-23T19:52:31.551910] [INFO ] [MAIN ] AMTB: Loaded 20336 existing records. [2025-10-23T19:52:31.729590] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:31.730028] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-23T19:52:31.730155] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-23T19:52:31.730462] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-23T19:52:31.730588] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-23T19:52:31.815203] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T19:52:31.829379] [INFO ] [REMOTE ] AMR: Full fetch complete (40711 records). [2025-10-23T19:52:31.829672] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-23T19:52:31.999785] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-23T19:52:32.342969] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:32.499041] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-23T19:52:32.499167] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-23T19:52:32.499608] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-23T19:52:32.499681] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-23T19:52:32.500746] [DEBUG] [LOCAL ] AMR: Trimmed 40711 records to 28953 (keeping 200 days of data) [2025-10-23T19:52:32.620123] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T19:52:32.708545] [DEBUG] [LOCAL ] AMR: Primary data saved (28953 records). [2025-10-23T19:52:32.708757] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-23T19:52:32.708872] [INFO ] [MAIN ] Update Progress: 108/2367 symbols completed. AMR took 27.5s. Estimated remaining: 4h 20m 56s. Rate: 8.7 symbols/min [2025-10-23T19:52:32.804461] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-23T19:52:32.890712] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:32.898549] [DEBUG] [LOCAL ] AMTD: Loaded 3812 existing records from primary storage. [2025-10-23T19:52:32.898899] [INFO ] [MAIN ] AMTD: Loaded 3812 existing records. [2025-10-23T19:52:33.074683] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:33.075055] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-23T19:52:33.075193] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-23T19:52:33.075481] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-23T19:52:33.075557] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-23T19:52:33.421636] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:33.599428] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-23T19:52:34.051936] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T19:52:34.266610] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T19:52:34.399423] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-23T19:52:34.654351] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T19:52:35.199427] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-23T19:52:35.999396] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-23T19:52:36.194509] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T19:52:36.312887] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T19:52:36.428325] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-23T19:52:36.799464] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-23T19:52:37.599420] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-23T19:52:38.399433] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-23T19:52:38.514301] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T19:52:38.520116] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T19:52:38.529421] [INFO ] [REMOTE ] AMRC: Full fetch complete (54574 records). [2025-10-23T19:52:38.529662] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-23T19:52:38.980620] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T19:52:39.009565] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-23T19:52:39.009770] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-23T19:52:39.010913] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-23T19:52:39.011017] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-23T19:52:39.012785] [DEBUG] [LOCAL ] AMRC: Trimmed 54574 records to 38781 (keeping 200 days of data) [2025-10-23T19:52:39.212762] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-23T19:52:39.325489] [DEBUG] [LOCAL ] AMRC: Primary data saved (38781 records). [2025-10-23T19:52:39.326005] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-23T19:52:39.327531] [INFO ] [MAIN ] Update Progress: 109/2367 symbols completed. AMRC took 31.9s. Estimated remaining: 4h 20m 43s. Rate: 8.7 symbols/min [2025-10-23T19:52:39.580470] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:39.656597] [DEBUG] [LOCAL ] AMTM: Loaded 50253 existing records from primary storage. [2025-10-23T19:52:39.657103] [INFO ] [MAIN ] AMTM: Loaded 50253 existing records. [2025-10-23T19:52:39.770626] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-23T19:52:39.913562] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:39.913874] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-23T19:52:39.913946] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-23T19:52:39.914236] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-23T19:52:39.914303] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-23T19:52:40.004552] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-23T19:52:40.344121] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:40.799430] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-23T19:52:41.160691] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T19:52:41.599438] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-23T19:52:42.149369] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-23T19:52:42.399413] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-23T19:52:42.509535] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T19:52:42.870586] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T19:52:43.199411] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-23T19:52:43.999439] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-23T19:52:44.618569] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T19:52:44.736077] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T19:52:44.799409] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-23T19:52:45.599424] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-23T19:52:45.871713] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T19:52:46.399450] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-23T19:52:46.870989] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T19:52:47.200102] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-23T19:52:47.212479] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T19:52:47.999418] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-23T19:52:48.799415] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-23T19:52:49.057121] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T19:52:49.599399] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-23T19:52:49.813258] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T19:52:49.957599] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T19:52:50.399412] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-23T19:52:51.053876] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-23T19:52:51.199413] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-23T19:52:51.388759] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T19:52:51.999410] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-23T19:52:52.799418] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-23T19:52:53.005109] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T19:52:53.420890] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T19:52:53.599420] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-23T19:52:53.730940] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T19:52:54.364321] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T19:52:54.367897] [INFO ] [REMOTE ] AMTD: Full fetch complete (5362 records). [2025-10-23T19:52:54.367980] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-23T19:52:54.400480] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-23T19:52:54.747740] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-23T19:52:54.747856] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-23T19:52:54.747967] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-23T19:52:54.748009] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-23T19:52:54.748373] [DEBUG] [LOCAL ] AMTD: Trimmed 5362 records to 3818 (keeping 200 days of data) [2025-10-23T19:52:54.769014] [DEBUG] [LOCAL ] AMTD: Primary data saved (3818 records). [2025-10-23T19:52:54.769099] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-23T19:52:54.769170] [INFO ] [MAIN ] Update Progress: 110/2367 symbols completed. AMTD took 22.1s. Estimated remaining: 4h 23m 31s. Rate: 8.6 symbols/min [2025-10-23T19:52:54.935862] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:54.951487] [DEBUG] [LOCAL ] AMWL: Loaded 9814 existing records from primary storage. [2025-10-23T19:52:54.951762] [INFO ] [MAIN ] AMWL: Loaded 9814 existing records. [2025-10-23T19:52:55.123404] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:55.123555] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-23T19:52:55.123600] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-23T19:52:55.123771] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-23T19:52:55.123856] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-23T19:52:55.204659] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-23T19:52:55.478098] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:55.999393] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-23T19:52:56.398768] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T19:52:56.528601] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-23T19:52:56.540837] [INFO ] [REMOTE ] AMT: Full fetch complete (76167 records). [2025-10-23T19:52:56.540997] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-23T19:52:56.815716] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-23T19:52:56.955978] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-23T19:52:56.956082] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-23T19:52:56.956895] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-23T19:52:56.956968] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-23T19:52:56.958472] [DEBUG] [LOCAL ] AMT: Trimmed 76167 records to 52814 (keeping 200 days of data) [2025-10-23T19:52:57.322375] [DEBUG] [LOCAL ] AMT: Primary data saved (52814 records). [2025-10-23T19:52:57.322586] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-23T19:52:57.322730] [INFO ] [MAIN ] Update Progress: 111/2367 symbols completed. AMT took 41.1s. Estimated remaining: 4h 21m 53s. Rate: 8.6 symbols/min [2025-10-23T19:52:57.516099] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:52:57.566292] [DEBUG] [LOCAL ] AMX: Loaded 49176 existing records from primary storage. [2025-10-23T19:52:57.566613] [INFO ] [MAIN ] AMX: Loaded 49176 existing records. [2025-10-23T19:52:57.615700] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-23T19:52:57.735182] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T19:52:57.770684] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:52:57.770852] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-23T19:52:57.770902] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-23T19:52:57.771225] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-23T19:52:57.771287] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-23T19:52:57.900312] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T19:52:58.163690] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:52:58.399418] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-23T19:52:58.682362] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T19:52:59.199432] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-23T19:52:59.313919] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T19:52:59.999413] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-23T19:53:00.799456] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-23T19:53:01.514837] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-23T19:53:01.599448] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-23T19:53:02.111880] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-23T19:53:02.399421] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-23T19:53:02.513694] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T19:53:03.199437] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-23T19:53:03.999725] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-23T19:53:04.166307] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-23T19:53:04.654813] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T19:53:04.799429] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-23T19:53:04.920680] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T19:53:04.924529] [INFO ] [REMOTE ] AMTB: Full fetch complete (29656 records). [2025-10-23T19:53:04.924663] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-23T19:53:05.213926] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T19:53:05.374446] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-23T19:53:05.374546] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-23T19:53:05.374985] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-23T19:53:05.375058] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-23T19:53:05.375854] [DEBUG] [LOCAL ] AMTB: Trimmed 29656 records to 20600 (keeping 200 days of data) [2025-10-23T19:53:05.497215] [DEBUG] [LOCAL ] AMTB: Primary data saved (20600 records). [2025-10-23T19:53:05.497363] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-23T19:53:05.497441] [INFO ] [MAIN ] Update Progress: 112/2367 symbols completed. AMTB took 34.2s. Estimated remaining: 4h 22m 11s. Rate: 8.6 symbols/min [2025-10-23T19:53:05.604520] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-23T19:53:05.680035] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:05.713268] [DEBUG] [LOCAL ] AN: Loaded 31030 existing records from primary storage. [2025-10-23T19:53:05.713622] [INFO ] [MAIN ] AN: Loaded 31030 existing records. [2025-10-23T19:53:05.894543] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:05.894809] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-23T19:53:05.894885] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-23T19:53:05.895087] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-23T19:53:05.895158] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-23T19:53:06.274163] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:06.399427] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-23T19:53:06.454593] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T19:53:07.200096] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T19:53:07.204935] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-23T19:53:07.544757] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T19:53:07.981890] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T19:53:07.999433] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-23T19:53:08.799433] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-23T19:53:09.374737] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T19:53:09.599419] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-23T19:53:10.306952] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-23T19:53:10.390016] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T19:53:10.400135] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-23T19:53:11.199415] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-23T19:53:11.999425] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-23T19:53:12.111590] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T19:53:12.556388] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T19:53:12.799408] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-23T19:53:13.370953] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T19:53:13.599451] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-23T19:53:14.253133] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T19:53:14.399401] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-23T19:53:15.199424] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-23T19:53:15.479182] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T19:53:15.488362] [INFO ] [REMOTE ] AMTM: Full fetch complete (73594 records). [2025-10-23T19:53:15.488593] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-23T19:53:15.928376] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-23T19:53:15.928473] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-23T19:53:15.929210] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-23T19:53:15.929457] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-23T19:53:15.930903] [DEBUG] [LOCAL ] AMTM: Trimmed 73594 records to 50606 (keeping 200 days of data) [2025-10-23T19:53:16.003332] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-23T19:53:16.021703] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T19:53:16.061437] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T19:53:16.290127] [DEBUG] [LOCAL ] AMTM: Primary data saved (50606 records). [2025-10-23T19:53:16.290330] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-23T19:53:16.292047] [INFO ] [MAIN ] Update Progress: 113/2367 symbols completed. AMTM took 37.0s. Estimated remaining: 4h 23m 20s. Rate: 8.6 symbols/min [2025-10-23T19:53:16.483614] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:16.550561] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-23T19:53:16.551077] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-23T19:53:16.740639] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:16.740875] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-23T19:53:16.740923] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-23T19:53:16.741190] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-23T19:53:16.741253] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-23T19:53:16.800879] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-23T19:53:17.117388] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:17.591072] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T19:53:17.599390] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-23T19:53:17.697718] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T19:53:18.399453] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-23T19:53:18.964706] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T19:53:19.199417] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-23T19:53:19.999418] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-23T19:53:20.050812] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T19:53:20.102147] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T19:53:20.799410] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-23T19:53:21.351251] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T19:53:21.599421] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-23T19:53:22.418806] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T19:53:22.428666] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-23T19:53:22.941012] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T19:53:23.199417] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-23T19:53:23.999442] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-23T19:53:24.511527] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T19:53:24.751908] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-23T19:53:24.799480] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-23T19:53:25.068729] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T19:53:25.072013] [INFO ] [REMOTE ] AMWL: Full fetch complete (14867 records). [2025-10-23T19:53:25.072101] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-23T19:53:25.499908] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-23T19:53:25.500017] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-23T19:53:25.500396] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-23T19:53:25.500439] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-23T19:53:25.500958] [DEBUG] [LOCAL ] AMWL: Trimmed 14867 records to 9907 (keeping 200 days of data) [2025-10-23T19:53:25.553284] [DEBUG] [LOCAL ] AMWL: Primary data saved (9907 records). [2025-10-23T19:53:25.553442] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-23T19:53:25.553529] [INFO ] [MAIN ] Update Progress: 114/2367 symbols completed. AMWL took 30.8s. Estimated remaining: 4h 23m 57s. Rate: 8.5 symbols/min [2025-10-23T19:53:25.600879] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-23T19:53:25.728639] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:25.789842] [DEBUG] [LOCAL ] ANF: Loaded 52040 existing records from primary storage. [2025-10-23T19:53:25.790209] [INFO ] [MAIN ] ANF: Loaded 52040 existing records. [2025-10-23T19:53:25.964403] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:25.964603] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-23T19:53:25.964675] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-23T19:53:25.964933] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-23T19:53:25.964999] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-23T19:53:26.342130] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:26.399476] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-23T19:53:26.921703] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T19:53:27.205694] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-23T19:53:27.207507] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-23T19:53:27.999712] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-23T19:53:28.118851] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T19:53:28.799413] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-23T19:53:28.936214] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T19:53:29.599446] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-23T19:53:30.134896] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T19:53:30.140217] [INFO ] [REMOTE ] AN: Full fetch complete (47125 records). [2025-10-23T19:53:30.140341] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-23T19:53:30.400442] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-23T19:53:30.505291] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-23T19:53:30.594251] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-23T19:53:30.594389] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-23T19:53:30.595079] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-23T19:53:30.595161] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-23T19:53:30.596276] [DEBUG] [LOCAL ] AN: Trimmed 47125 records to 31320 (keeping 200 days of data) [2025-10-23T19:53:30.776469] [DEBUG] [LOCAL ] AN: Primary data saved (31320 records). [2025-10-23T19:53:30.776674] [INFO ] [MAIN ] AN: Full history saved. [2025-10-23T19:53:30.776892] [INFO ] [MAIN ] Update Progress: 115/2367 symbols completed. AN took 25.3s. Estimated remaining: 4h 23m 15s. Rate: 8.6 symbols/min [2025-10-23T19:53:30.941965] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:30.942275] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-23T19:53:30.942337] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-23T19:53:30.942490] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-23T19:53:30.942610] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-23T19:53:30.942715] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-23T19:53:30.942838] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-23T19:53:31.203415] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-23T19:53:31.321485] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:31.493530] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T19:53:31.505101] [INFO ] [REMOTE ] AMX: Full fetch complete (71035 records). [2025-10-23T19:53:31.505255] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-23T19:53:31.985181] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-23T19:53:31.985304] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-23T19:53:31.986129] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-23T19:53:31.986208] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-23T19:53:31.987771] [DEBUG] [LOCAL ] AMX: Trimmed 71035 records to 49530 (keeping 200 days of data) [2025-10-23T19:53:32.065160] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-23T19:53:32.201893] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T19:53:32.323534] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:53:32.339142] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-23T19:53:32.339272] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:53:32.339320] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-23T19:53:32.339356] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:53:32.339394] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-23T19:53:32.339460] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-23T19:53:32.339503] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-23T19:53:32.339603] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-23T19:53:32.380069] [INFO ] [MAIN ] Update Progress: 116/2367 symbols completed. ANGX took 1.6s. Estimated remaining: 4h 21m 23s. Rate: 8.6 symbols/min [2025-10-23T19:53:32.660229] [DEBUG] [LOCAL ] AMX: Primary data saved (49530 records). [2025-10-23T19:53:32.660417] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-23T19:53:32.660687] [INFO ] [MAIN ] Update Progress: 117/2367 symbols completed. AMX took 35.3s. Estimated remaining: 4h 19m 7s. Rate: 8.7 symbols/min [2025-10-23T19:53:32.749923] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:32.780409] [DEBUG] [LOCAL ] ANRO: Loaded 19715 existing records from primary storage. [2025-10-23T19:53:32.780723] [INFO ] [MAIN ] ANRO: Loaded 19715 existing records. [2025-10-23T19:53:32.810090] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-23T19:53:33.012899] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:33.013192] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-23T19:53:33.013247] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-23T19:53:33.013461] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-23T19:53:33.013524] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-23T19:53:33.315207] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-23T19:53:33.440726] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:33.599413] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-23T19:53:34.399398] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-23T19:53:34.560362] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T19:53:34.757273] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T19:53:35.199401] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-23T19:53:36.001252] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-23T19:53:36.249890] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T19:53:36.799424] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-23T19:53:37.043773] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-23T19:53:37.599445] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-23T19:53:37.795955] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T19:53:37.824333] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T19:53:38.399401] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-23T19:53:39.199420] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-23T19:53:39.490699] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T19:53:39.945386] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-23T19:53:39.999408] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-23T19:53:40.799434] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-23T19:53:41.188331] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T19:53:41.599431] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-23T19:53:41.842813] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-23T19:53:42.407180] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-23T19:53:42.432315] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-23T19:53:43.199446] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-23T19:53:43.503019] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T19:53:43.584831] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T19:53:43.999428] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-23T19:53:44.799454] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-23T19:53:44.927908] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T19:53:45.499523] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-23T19:53:45.599415] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-23T19:53:46.399468] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-23T19:53:46.434465] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T19:53:46.699070] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T19:53:47.199453] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-23T19:53:47.974301] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T19:53:47.999669] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-23T19:53:48.799459] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-23T19:53:48.868237] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-23T19:53:49.487750] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T19:53:49.493365] [INFO ] [REMOTE ] ANRO: Full fetch complete (30457 records). [2025-10-23T19:53:49.493458] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-23T19:53:49.605096] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-23T19:53:49.873366] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-23T19:53:49.873500] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-23T19:53:49.873952] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-23T19:53:49.874037] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-23T19:53:49.874747] [DEBUG] [LOCAL ] ANRO: Trimmed 30457 records to 19930 (keeping 200 days of data) [2025-10-23T19:53:49.980675] [DEBUG] [LOCAL ] ANRO: Primary data saved (19930 records). [2025-10-23T19:53:49.980845] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-23T19:53:49.980950] [INFO ] [MAIN ] Update Progress: 118/2367 symbols completed. ANRO took 17.6s. Estimated remaining: 4h 22m 19s. Rate: 8.6 symbols/min [2025-10-23T19:53:50.501236] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T19:53:50.513695] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-23T19:53:50.513966] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-23T19:53:50.734428] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T19:53:50.766965] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-23T19:53:51.005457] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-23T19:53:51.005662] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-23T19:53:51.006776] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-23T19:53:51.006862] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-23T19:53:51.009059] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 54156 (keeping 200 days of data) [2025-10-23T19:53:51.353379] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-23T19:53:51.353633] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-23T19:53:51.355048] [INFO ] [MAIN ] Update Progress: 119/2367 symbols completed. ANET took 35.1s. Estimated remaining: 4h 20m 26s. Rate: 8.6 symbols/min [2025-10-23T19:53:52.645477] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T19:53:52.656531] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-23T19:53:54.600939] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T19:53:54.613126] [INFO ] [REMOTE ] ANF: Full fetch complete (75785 records). [2025-10-23T19:53:54.613291] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-23T19:53:55.016602] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-23T19:53:55.016747] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-23T19:53:55.017508] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-23T19:53:55.017557] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-23T19:53:55.018987] [DEBUG] [LOCAL ] ANF: Trimmed 75785 records to 52408 (keeping 200 days of data) [2025-10-23T19:53:55.317878] [DEBUG] [LOCAL ] ANF: Primary data saved (52408 records). [2025-10-23T19:53:55.318048] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-23T19:53:55.318190] [INFO ] [MAIN ] Update Progress: 120/2367 symbols completed. ANF took 29.8s. Estimated remaining: 4h 19m 23s. Rate: 8.7 symbols/min [2025-10-23T19:53:56.043165] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:56.088560] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:56.108740] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:56.120922] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:56.130976] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-23T19:53:56.131075] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-23T19:53:56.131207] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-23T19:53:56.131310] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-23T19:53:56.131368] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-23T19:53:56.131407] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-23T19:53:56.169427] [DEBUG] [LOCAL ] ANVS: Loaded 23982 existing records from primary storage. [2025-10-23T19:53:56.175797] [DEBUG] [LOCAL ] AOMR: Loaded 16310 existing records from primary storage. [2025-10-23T19:53:56.176015] [INFO ] [MAIN ] AOMR: Loaded 16310 existing records. [2025-10-23T19:53:56.182411] [INFO ] [MAIN ] ANVS: Loaded 23982 existing records. [2025-10-23T19:53:56.272712] [DEBUG] [LOCAL ] AOD: Loaded 30865 existing records from primary storage. [2025-10-23T19:53:56.273004] [INFO ] [MAIN ] AOD: Loaded 30865 existing records. [2025-10-23T19:53:56.755235] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:56.761211] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-23T19:53:56.763195] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-23T19:53:56.763638] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-23T19:53:56.763801] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-23T19:53:57.083878] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:57.111376] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-23T19:53:57.111478] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-23T19:53:57.111771] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-23T19:53:57.111847] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-23T19:53:57.105707] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:57.124536] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-23T19:53:57.129166] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-23T19:53:57.132284] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-23T19:53:57.139475] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-23T19:53:57.524054] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:57.524517] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-23T19:53:57.829529] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:53:57.829987] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-23T19:53:57.830071] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:53:57.830111] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-23T19:53:57.830144] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:53:57.830181] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-23T19:53:57.830238] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-23T19:53:57.830276] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-23T19:53:57.830318] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-23T19:53:57.830367] [INFO ] [MAIN ] Update Progress: 121/2367 symbols completed. AOMD took 2.5s. Estimated remaining: 4h 17m 54s. Rate: 8.7 symbols/min [2025-10-23T19:53:58.253885] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:58.272157] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-23T19:53:58.408499] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:58.408872] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-23T19:53:58.434770] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:53:58.475089] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:58.475431] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-23T19:53:58.506564] [DEBUG] [LOCAL ] AON: Loaded 45033 existing records from primary storage. [2025-10-23T19:53:58.506982] [INFO ] [MAIN ] AON: Loaded 45033 existing records. [2025-10-23T19:53:58.680066] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:53:58.680270] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-23T19:53:58.680318] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-23T19:53:58.680799] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-23T19:53:58.680865] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-23T19:53:59.023747] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:53:59.024094] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-23T19:53:59.261552] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T19:53:59.264162] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-23T19:53:59.432898] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T19:53:59.440603] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-23T19:53:59.844139] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T19:53:59.851952] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-23T19:53:59.872149] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T19:53:59.876843] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-23T19:54:00.669022] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T19:54:00.677623] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-23T19:54:01.378101] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T19:54:01.383178] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-23T19:54:01.415997] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T19:54:01.424743] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-23T19:54:01.442683] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T19:54:01.599502] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-23T19:54:03.301270] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-23T19:54:03.309634] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-23T19:54:03.801523] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-23T19:54:03.810068] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-23T19:54:04.226703] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-23T19:54:04.233165] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-23T19:54:04.663175] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (3.06 seconds). [2025-10-23T19:54:04.804774] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-23T19:54:04.821088] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T19:54:05.036989] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T19:54:05.119057] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T19:54:05.599415] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-23T19:54:06.399424] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-23T19:54:06.444479] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T19:54:06.943711] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T19:54:07.199412] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-23T19:54:07.980687] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T19:54:07.999415] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-23T19:54:08.444915] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T19:54:08.525322] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-23T19:54:08.799424] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-23T19:54:09.599435] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-23T19:54:10.182080] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T19:54:10.399407] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-23T19:54:11.199429] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-23T19:54:11.289609] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:54:11.321882] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T19:54:11.999431] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-23T19:54:12.479806] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T19:54:12.799396] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-23T19:54:13.267158] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T19:54:13.599429] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-23T19:54:14.389118] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T19:54:14.399403] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-23T19:54:14.637942] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T19:54:15.199432] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-23T19:54:15.825408] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-23T19:54:15.999412] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-23T19:54:16.577934] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T19:54:16.799404] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-23T19:54:17.599442] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-23T19:54:17.698803] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T19:54:17.768611] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T19:54:18.399427] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-23T19:54:18.940488] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T19:54:19.199452] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-23T19:54:19.447903] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T19:54:19.999419] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-23T19:54:20.184154] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T19:54:20.799433] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-23T19:54:21.580008] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T19:54:21.599413] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-23T19:54:21.785307] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T19:54:21.789389] [INFO ] [REMOTE ] AOMR: Full fetch complete (23106 records). [2025-10-23T19:54:21.789570] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-23T19:54:22.178044] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-23T19:54:22.178168] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-23T19:54:22.178548] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-23T19:54:22.178603] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-23T19:54:22.179313] [DEBUG] [LOCAL ] AOMR: Trimmed 23106 records to 16387 (keeping 200 days of data) [2025-10-23T19:54:22.278675] [DEBUG] [LOCAL ] AOMR: Primary data saved (16387 records). [2025-10-23T19:54:22.278840] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-23T19:54:22.278941] [INFO ] [MAIN ] Update Progress: 122/2367 symbols completed. AOMR took 26.9s. Estimated remaining: 4h 23m 10s. Rate: 8.5 symbols/min [2025-10-23T19:54:22.404494] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-23T19:54:22.457205] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:22.493009] [DEBUG] [LOCAL ] AORT: Loaded 28916 existing records from primary storage. [2025-10-23T19:54:22.493306] [INFO ] [MAIN ] AORT: Loaded 28916 existing records. [2025-10-23T19:54:22.678922] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:54:22.679157] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-23T19:54:22.679359] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-23T19:54:22.679838] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-23T19:54:22.679905] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-23T19:54:22.854176] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T19:54:23.097889] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:23.199401] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-23T19:54:23.999421] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-23T19:54:24.227116] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T19:54:24.238246] [INFO ] [REMOTE ] AON: Full fetch complete (65180 records). [2025-10-23T19:54:24.238662] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-23T19:54:24.373508] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T19:54:24.802513] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-23T19:54:24.803968] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-23T19:54:24.804030] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-23T19:54:24.804958] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-23T19:54:24.805035] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-23T19:54:24.807254] [DEBUG] [LOCAL ] AON: Trimmed 65180 records to 45341 (keeping 200 days of data) [2025-10-23T19:54:25.150971] [DEBUG] [LOCAL ] AON: Primary data saved (45341 records). [2025-10-23T19:54:25.151168] [INFO ] [MAIN ] AON: Full history saved. [2025-10-23T19:54:25.153032] [INFO ] [MAIN ] Update Progress: 123/2367 symbols completed. AON took 27.3s. Estimated remaining: 4h 21m 47s. Rate: 8.6 symbols/min [2025-10-23T19:54:25.284520] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T19:54:25.301540] [INFO ] [REMOTE ] ANVS: Full fetch complete (36885 records). [2025-10-23T19:54:25.307031] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-23T19:54:25.576285] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:25.614658] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-23T19:54:25.674229] [DEBUG] [LOCAL ] AOS: Loaded 48646 existing records from primary storage. [2025-10-23T19:54:25.674686] [INFO ] [MAIN ] AOS: Loaded 48646 existing records. [2025-10-23T19:54:26.035449] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:54:26.035724] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-23T19:54:26.035814] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-23T19:54:26.036107] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-23T19:54:26.036172] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-23T19:54:26.262183] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T19:54:26.334686] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-23T19:54:26.334801] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-23T19:54:26.335460] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-23T19:54:26.335587] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-23T19:54:26.336393] [DEBUG] [LOCAL ] ANVS: Trimmed 36885 records to 24118 (keeping 200 days of data) [2025-10-23T19:54:26.412499] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-23T19:54:26.721407] [DEBUG] [LOCAL ] ANVS: Primary data saved (24118 records). [2025-10-23T19:54:26.721634] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-23T19:54:26.721812] [INFO ] [MAIN ] Update Progress: 124/2367 symbols completed. ANVS took 31.4s. Estimated remaining: 4h 20m 2s. Rate: 8.6 symbols/min [2025-10-23T19:54:26.796087] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:26.948988] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:26.960679] [DEBUG] [LOCAL ] AP: Loaded 7414 existing records from primary storage. [2025-10-23T19:54:26.961028] [INFO ] [MAIN ] AP: Loaded 7414 existing records. [2025-10-23T19:54:27.102158] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T19:54:27.108482] [INFO ] [REMOTE ] AOD: Full fetch complete (44951 records). [2025-10-23T19:54:27.108672] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-23T19:54:27.203754] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-23T19:54:27.353801] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:54:27.354017] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-23T19:54:27.354070] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-23T19:54:27.354229] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-23T19:54:27.354270] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-23T19:54:27.809017] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-23T19:54:27.809124] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-23T19:54:27.809694] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-23T19:54:27.823871] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-23T19:54:27.851000] [DEBUG] [LOCAL ] AOD: Trimmed 44951 records to 31093 (keeping 200 days of data) [2025-10-23T19:54:27.918483] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T19:54:28.001240] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-23T19:54:28.224876] [DEBUG] [LOCAL ] AOD: Primary data saved (31093 records). [2025-10-23T19:54:28.225016] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-23T19:54:28.225094] [INFO ] [MAIN ] Update Progress: 125/2367 symbols completed. AOD took 32.9s. Estimated remaining: 4h 18m 17s. Rate: 8.7 symbols/min [2025-10-23T19:54:28.276365] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:28.408535] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:28.408699] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-23T19:54:28.408759] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-23T19:54:28.408832] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-23T19:54:28.408872] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-23T19:54:28.408914] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-23T19:54:28.408947] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-23T19:54:28.771373] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:28.799408] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-23T19:54:29.054604] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T19:54:29.393028] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T19:54:29.494150] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T19:54:29.599414] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-23T19:54:30.399424] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-23T19:54:30.945936] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T19:54:31.199448] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-23T19:54:31.769387] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T19:54:31.991971] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T19:54:32.000779] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-23T19:54:32.799451] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-23T19:54:33.020617] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T19:54:33.599466] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-23T19:54:34.177473] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T19:54:34.222389] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T19:54:34.399426] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-23T19:54:35.199424] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-23T19:54:35.834760] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T19:54:35.999410] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-23T19:54:36.369197] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T19:54:36.613055] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T19:54:36.799418] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-23T19:54:37.599448] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-23T19:54:37.951477] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T19:54:38.399516] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-23T19:54:38.921312] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-23T19:54:39.199426] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-23T19:54:39.254306] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T19:54:40.006463] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T19:54:40.009402] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-23T19:54:40.780516] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T19:54:40.799414] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-23T19:54:41.599463] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-23T19:54:42.334492] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T19:54:42.399401] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-23T19:54:42.431382] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T19:54:43.154596] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T19:54:43.199451] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-23T19:54:43.999429] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-23T19:54:44.661593] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T19:54:44.799423] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-23T19:54:45.344545] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T19:54:45.599424] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-23T19:54:46.399438] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-23T19:54:46.625266] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T19:54:46.879294] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T19:54:47.121746] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T19:54:47.124820] [INFO ] [REMOTE ] AP: Full fetch complete (9112 records). [2025-10-23T19:54:47.124929] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-23T19:54:47.203859] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-23T19:54:47.517141] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-23T19:54:47.517250] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-23T19:54:47.517590] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-23T19:54:47.517743] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-23T19:54:47.518372] [DEBUG] [LOCAL ] AP: Trimmed 9112 records to 7470 (keeping 200 days of data) [2025-10-23T19:54:47.560331] [DEBUG] [LOCAL ] AP: Primary data saved (7470 records). [2025-10-23T19:54:47.560481] [INFO ] [MAIN ] AP: Full history saved. [2025-10-23T19:54:47.560724] [INFO ] [MAIN ] Update Progress: 126/2367 symbols completed. AP took 20.8s. Estimated remaining: 4h 21m 51s. Rate: 8.6 symbols/min [2025-10-23T19:54:47.729229] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:47.768268] [DEBUG] [LOCAL ] APD: Loaded 45416 existing records from primary storage. [2025-10-23T19:54:47.768580] [INFO ] [MAIN ] APD: Loaded 45416 existing records. [2025-10-23T19:54:47.943984] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:54:47.944195] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-23T19:54:47.944247] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-23T19:54:47.944588] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-23T19:54:47.944678] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-23T19:54:48.000151] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-23T19:54:48.320689] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:48.357933] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T19:54:48.799424] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-23T19:54:49.599397] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-23T19:54:49.685162] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:54:50.069627] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T19:54:50.074345] [INFO ] [REMOTE ] AORT: Full fetch complete (42464 records). [2025-10-23T19:54:50.074440] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-23T19:54:50.404507] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-23T19:54:50.443062] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-23T19:54:50.443169] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-23T19:54:50.443694] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-23T19:54:50.443851] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-23T19:54:50.444896] [DEBUG] [LOCAL ] AORT: Trimmed 42464 records to 29058 (keeping 200 days of data) [2025-10-23T19:54:50.608244] [DEBUG] [LOCAL ] AORT: Primary data saved (29058 records). [2025-10-23T19:54:50.608402] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-23T19:54:50.608482] [INFO ] [MAIN ] Update Progress: 127/2367 symbols completed. AORT took 28.3s. Estimated remaining: 4h 20m 34s. Rate: 8.6 symbols/min [2025-10-23T19:54:50.780976] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:50.830722] [DEBUG] [LOCAL ] APG: Loaded 50617 existing records from primary storage. [2025-10-23T19:54:50.831052] [INFO ] [MAIN ] APG: Loaded 50617 existing records. [2025-10-23T19:54:51.006086] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:54:51.006292] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-23T19:54:51.006339] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-23T19:54:51.006526] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-23T19:54:51.006568] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-23T19:54:51.103005] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T19:54:51.199496] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-23T19:54:51.407397] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:51.999457] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-23T19:54:52.040348] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T19:54:52.109859] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-23T19:54:52.799438] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-23T19:54:53.599412] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-23T19:54:53.895391] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-23T19:54:54.399457] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-23T19:54:54.578797] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T19:54:55.144919] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T19:54:55.199397] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-23T19:54:55.382588] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T19:54:55.999438] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-23T19:54:56.573948] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T19:54:56.799413] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-23T19:54:57.557144] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T19:54:57.562995] [INFO ] [REMOTE ] APAM: Full fetch complete (51988 records). [2025-10-23T19:54:57.563124] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-23T19:54:57.605806] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-23T19:54:57.958154] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-23T19:54:57.958268] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-23T19:54:57.958846] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-23T19:54:57.958919] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-23T19:54:57.960085] [DEBUG] [LOCAL ] APAM: Trimmed 51988 records to 35893 (keeping 200 days of data) [2025-10-23T19:54:58.177661] [DEBUG] [LOCAL ] APAM: Primary data saved (35893 records). [2025-10-23T19:54:58.177828] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-23T19:54:58.177912] [INFO ] [MAIN ] Update Progress: 128/2367 symbols completed. APAM took 30.0s. Estimated remaining: 4h 20m 38s. Rate: 8.6 symbols/min [2025-10-23T19:54:58.308831] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T19:54:58.388685] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:54:58.399387] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-23T19:54:58.446633] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-23T19:54:58.446997] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-23T19:54:58.623220] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:54:58.623481] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-23T19:54:58.623547] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-23T19:54:58.623857] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-23T19:54:58.623941] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-23T19:54:58.932537] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T19:54:59.024549] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:54:59.199420] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-23T19:54:59.999406] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-23T19:55:00.063148] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T19:55:00.799415] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-23T19:55:01.599424] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-23T19:55:01.700526] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-23T19:55:02.399400] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-23T19:55:02.736545] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-23T19:55:03.199422] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-23T19:55:04.272438] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (3.47 seconds). [2025-10-23T19:55:04.283685] [INFO ] [REMOTE ] AOS: Full fetch complete (71081 records). [2025-10-23T19:55:04.283859] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-23T19:55:04.698221] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-23T19:55:04.698324] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-23T19:55:04.699041] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-23T19:55:04.699116] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-23T19:55:04.700466] [DEBUG] [LOCAL ] AOS: Trimmed 71081 records to 49003 (keeping 200 days of data) [2025-10-23T19:55:04.992429] [DEBUG] [LOCAL ] AOS: Primary data saved (49003 records). [2025-10-23T19:55:04.992614] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-23T19:55:04.992749] [INFO ] [MAIN ] Update Progress: 129/2367 symbols completed. AOS took 39.8s. Estimated remaining: 4h 20m 28s. Rate: 8.6 symbols/min [2025-10-23T19:55:05.187798] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:55:05.196008] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (3.60 seconds). [2025-10-23T19:55:05.213720] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-23T19:55:05.256767] [DEBUG] [LOCAL ] APLE: Loaded 51958 existing records from primary storage. [2025-10-23T19:55:05.257098] [INFO ] [MAIN ] APLE: Loaded 51958 existing records. [2025-10-23T19:55:05.430833] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:55:05.431038] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-23T19:55:05.431086] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-23T19:55:05.431286] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-23T19:55:05.431328] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-23T19:55:05.778108] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:55:05.778373] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-23T19:55:06.173773] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (3.77 seconds). [2025-10-23T19:55:06.185098] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-23T19:55:06.271890] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-10-23T19:55:06.399452] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-23T19:55:07.246083] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T19:55:07.255976] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-23T19:55:08.059436] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T19:55:08.072741] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-23T19:55:08.201102] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T19:55:08.261252] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-23T19:55:08.799402] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-23T19:55:08.907941] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T19:55:09.599418] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-23T19:55:09.821820] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T19:55:10.399452] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-23T19:55:10.541151] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T19:55:11.199400] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-23T19:55:11.350704] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T19:55:11.943831] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T19:55:11.999436] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-23T19:55:12.799422] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-23T19:55:13.087174] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T19:55:13.517382] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T19:55:13.599426] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-23T19:55:14.399431] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-23T19:55:14.686960] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T19:55:14.953636] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T19:55:15.199425] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-23T19:55:15.999399] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-23T19:55:16.084093] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T19:55:16.799416] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-23T19:55:17.039478] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T19:55:17.599398] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-23T19:55:17.868619] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T19:55:18.024160] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T19:55:18.399425] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-23T19:55:19.089381] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T19:55:19.199423] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-23T19:55:19.999424] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-23T19:55:20.300188] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T19:55:20.799407] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-23T19:55:20.870092] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T19:55:21.599435] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-23T19:55:21.734277] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T19:55:22.399428] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-23T19:55:22.845366] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-23T19:55:23.200095] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-23T19:55:23.210283] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T19:55:23.218227] [INFO ] [REMOTE ] APD: Full fetch complete (67295 records). [2025-10-23T19:55:23.218357] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-23T19:55:23.628309] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-23T19:55:23.628407] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-23T19:55:23.629137] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-23T19:55:23.629218] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-23T19:55:23.630475] [DEBUG] [LOCAL ] APD: Trimmed 67295 records to 45754 (keeping 200 days of data) [2025-10-23T19:55:23.803755] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T19:55:23.998411] [DEBUG] [LOCAL ] APD: Primary data saved (45754 records). [2025-10-23T19:55:23.998574] [INFO ] [MAIN ] APD: Full history saved. [2025-10-23T19:55:23.998695] [INFO ] [MAIN ] Update Progress: 130/2367 symbols completed. APD took 36.4s. Estimated remaining: 4h 23m 48s. Rate: 8.5 symbols/min [2025-10-23T19:55:24.004810] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-23T19:55:24.182507] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:55:24.239409] [DEBUG] [LOCAL ] APO: Loaded 53388 existing records from primary storage. [2025-10-23T19:55:24.239745] [INFO ] [MAIN ] APO: Loaded 53388 existing records. [2025-10-23T19:55:24.414386] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:55:24.414585] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-23T19:55:24.414633] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-23T19:55:24.414980] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-23T19:55:24.415048] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-23T19:55:24.788414] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:55:24.799416] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-23T19:55:25.192810] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T19:55:25.599420] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-23T19:55:25.848892] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T19:55:26.399429] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-23T19:55:26.817917] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-23T19:55:26.827908] [INFO ] [REMOTE ] APG: Full fetch complete (72253 records). [2025-10-23T19:55:26.828277] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-23T19:55:27.024373] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T19:55:27.209914] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-23T19:55:27.375153] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-23T19:55:27.375262] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-23T19:55:27.376052] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-23T19:55:27.376126] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-23T19:55:27.377576] [DEBUG] [LOCAL ] APG: Trimmed 72253 records to 50997 (keeping 200 days of data) [2025-10-23T19:55:27.683949] [DEBUG] [LOCAL ] APG: Primary data saved (50997 records). [2025-10-23T19:55:27.684136] [INFO ] [MAIN ] APG: Full history saved. [2025-10-23T19:55:27.684396] [INFO ] [MAIN ] Update Progress: 131/2367 symbols completed. APG took 37.1s. Estimated remaining: 4h 22m 43s. Rate: 8.5 symbols/min [2025-10-23T19:55:27.859677] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:55:27.871463] [DEBUG] [LOCAL ] APOS: Loaded 7058 existing records from primary storage. [2025-10-23T19:55:27.874733] [INFO ] [MAIN ] APOS: Loaded 7058 existing records. [2025-10-23T19:55:28.004694] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-23T19:55:28.065939] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:55:28.066141] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-23T19:55:28.066192] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-23T19:55:28.066369] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-23T19:55:28.066431] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-23T19:55:28.318398] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T19:55:28.477245] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:55:28.799421] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-23T19:55:29.278446] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T19:55:29.376347] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-23T19:55:29.599427] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-23T19:55:29.729167] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T19:55:30.292872] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T19:55:30.399388] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-23T19:55:31.112296] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T19:55:31.199383] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-23T19:55:31.999420] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-23T19:55:32.799453] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-23T19:55:33.567791] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-23T19:55:33.577294] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-23T19:55:33.577434] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-23T19:55:33.611107] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-23T19:55:33.639726] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T19:55:34.004589] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T19:55:34.075616] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-23T19:55:34.075766] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-23T19:55:34.076585] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-23T19:55:34.076639] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-23T19:55:34.078257] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 54081 (keeping 200 days of data) [2025-10-23T19:55:34.407339] [DEBUG] [LOCAL ] APH: Primary data saved (54081 records). [2025-10-23T19:55:34.407507] [INFO ] [MAIN ] APH: Full history saved. [2025-10-23T19:55:34.407594] [INFO ] [MAIN ] Update Progress: 132/2367 symbols completed. APH took 36.2s. Estimated remaining: 4h 22m 30s. Rate: 8.5 symbols/min [2025-10-23T19:55:34.419700] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-23T19:55:34.583540] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:55:34.634731] [DEBUG] [LOCAL ] APTV: Loaded 51849 existing records from primary storage. [2025-10-23T19:55:34.635073] [INFO ] [MAIN ] APTV: Loaded 51849 existing records. [2025-10-23T19:55:34.814512] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:55:34.814747] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-23T19:55:34.814811] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-23T19:55:34.815036] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-23T19:55:34.815097] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-23T19:55:35.171140] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:55:35.199395] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-23T19:55:35.687050] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-23T19:55:35.696070] [INFO ] [REMOTE ] APLE: Full fetch complete (74787 records). [2025-10-23T19:55:35.696240] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-23T19:55:36.010079] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-23T19:55:36.050459] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T19:55:36.090274] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T19:55:36.181846] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-23T19:55:36.181943] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-23T19:55:36.182685] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-23T19:55:36.182757] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-23T19:55:36.184088] [DEBUG] [LOCAL ] APLE: Trimmed 74787 records to 52333 (keeping 200 days of data) [2025-10-23T19:55:36.493617] [DEBUG] [LOCAL ] APLE: Primary data saved (52333 records). [2025-10-23T19:55:36.493786] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-23T19:55:36.494837] [INFO ] [MAIN ] Update Progress: 133/2367 symbols completed. APLE took 31.5s. Estimated remaining: 4h 20m 60s. Rate: 8.6 symbols/min [2025-10-23T19:55:36.662862] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:55:36.663024] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-23T19:55:36.663069] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-23T19:55:36.663141] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-23T19:55:36.663187] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-23T19:55:36.663236] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-23T19:55:36.663276] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-23T19:55:36.811261] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-23T19:55:37.040698] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:55:37.599417] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-23T19:55:37.795507] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T19:55:38.341935] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T19:55:38.399414] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-23T19:55:38.823774] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-23T19:55:39.199436] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-23T19:55:39.801014] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T19:55:39.999423] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-23T19:55:40.785065] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T19:55:40.799387] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-23T19:55:41.329421] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-23T19:55:41.601969] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-23T19:55:41.604375] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T19:55:42.399431] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-23T19:55:42.986810] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T19:55:43.199429] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-23T19:55:43.254148] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T19:55:43.964414] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T19:55:43.999429] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-23T19:55:44.732590] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T19:55:44.734042] [INFO ] [REMOTE ] APOS: Full fetch complete (10238 records). [2025-10-23T19:55:44.734164] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-23T19:55:44.803965] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-23T19:55:45.123981] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-23T19:55:45.124098] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-23T19:55:45.124414] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-23T19:55:45.124459] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-23T19:55:45.125034] [DEBUG] [LOCAL ] APOS: Trimmed 10238 records to 7105 (keeping 200 days of data) [2025-10-23T19:55:45.166770] [DEBUG] [LOCAL ] APOS: Primary data saved (7105 records). [2025-10-23T19:55:45.166917] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-23T19:55:45.166996] [INFO ] [MAIN ] Update Progress: 134/2367 symbols completed. APOS took 17.5s. Estimated remaining: 4h 21m 21s. Rate: 8.5 symbols/min [2025-10-23T19:55:45.342953] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:55:45.351719] [DEBUG] [LOCAL ] AQNB: Loaded 3886 existing records from primary storage. [2025-10-23T19:55:45.351996] [INFO ] [MAIN ] AQNB: Loaded 3886 existing records. [2025-10-23T19:55:45.532404] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:55:45.532661] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-23T19:55:45.532735] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-23T19:55:45.533006] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-23T19:55:45.533069] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-23T19:55:45.604540] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-23T19:55:45.907908] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:55:46.399429] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-23T19:55:46.642785] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T19:55:47.199434] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-23T19:55:47.520325] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T19:55:47.999431] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-23T19:55:48.132636] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T19:55:48.480615] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-23T19:55:48.556568] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T19:55:48.799437] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-23T19:55:49.599427] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-23T19:55:50.399439] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-23T19:55:50.450275] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T19:55:50.870251] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-23T19:55:51.199405] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-23T19:55:51.544783] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T19:55:51.774553] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T19:55:51.999441] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-23T19:55:52.589722] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T19:55:52.799424] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-23T19:55:53.345998] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-23T19:55:53.599439] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-23T19:55:54.399419] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-23T19:55:55.062570] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T19:55:55.199411] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-23T19:55:55.336427] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T19:55:55.999425] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-23T19:55:56.799427] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-23T19:55:56.972946] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T19:55:57.599404] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-23T19:55:57.918334] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T19:55:58.399425] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-23T19:55:58.632091] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T19:55:59.191691] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T19:55:59.199408] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-23T19:55:59.287784] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:55:59.999398] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-23T19:56:00.799439] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-23T19:56:00.917302] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T19:56:01.599390] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-23T19:56:02.083496] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-23T19:56:02.399492] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-23T19:56:02.907146] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-23T19:56:02.917136] [INFO ] [REMOTE ] APO: Full fetch complete (77466 records). [2025-10-23T19:56:02.917356] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-23T19:56:02.989065] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T19:56:03.099627] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T19:56:03.204748] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-23T19:56:03.416626] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-23T19:56:03.416786] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-23T19:56:03.417577] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-23T19:56:03.417629] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-23T19:56:03.419248] [DEBUG] [LOCAL ] APO: Trimmed 77466 records to 53775 (keeping 200 days of data) [2025-10-23T19:56:03.758424] [DEBUG] [LOCAL ] APO: Primary data saved (53775 records). [2025-10-23T19:56:03.758589] [INFO ] [MAIN ] APO: Full history saved. [2025-10-23T19:56:03.758877] [INFO ] [MAIN ] Update Progress: 135/2367 symbols completed. APO took 39.8s. Estimated remaining: 4h 24m 25s. Rate: 8.4 symbols/min [2025-10-23T19:56:03.935697] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:03.935904] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-23T19:56:03.935964] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-23T19:56:03.936039] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-23T19:56:03.936080] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-23T19:56:03.936125] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-23T19:56:03.936180] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-23T19:56:04.000706] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-23T19:56:04.212131] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T19:56:04.249365] [INFO ] [REMOTE ] APTV: Full fetch complete (75798 records). [2025-10-23T19:56:04.249502] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-23T19:56:04.532725] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:04.798350] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-23T19:56:04.798472] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-23T19:56:04.799407] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-23T19:56:04.799489] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-23T19:56:04.800683] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-23T19:56:04.802069] [DEBUG] [LOCAL ] APTV: Trimmed 75798 records to 52199 (keeping 200 days of data) [2025-10-23T19:56:05.117094] [DEBUG] [LOCAL ] APTV: Primary data saved (52199 records). [2025-10-23T19:56:05.117273] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-23T19:56:05.117385] [INFO ] [MAIN ] Update Progress: 136/2367 symbols completed. APTV took 30.7s. Estimated remaining: 4h 22m 43s. Rate: 8.5 symbols/min [2025-10-23T19:56:05.296318] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:05.296510] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-23T19:56:05.296552] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-23T19:56:05.296626] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-23T19:56:05.296769] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-23T19:56:05.296838] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-23T19:56:05.296875] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-23T19:56:05.441880] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T19:56:05.595778] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T19:56:05.604572] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-23T19:56:05.708270] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:06.399426] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-23T19:56:07.034959] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T19:56:07.036021] [INFO ] [REMOTE ] AQNB: Full fetch complete (5381 records). [2025-10-23T19:56:07.036113] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-23T19:56:07.206232] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-23T19:56:07.493813] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T19:56:07.511884] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-23T19:56:07.512003] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-23T19:56:07.512265] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-23T19:56:07.512311] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-23T19:56:07.512718] [DEBUG] [LOCAL ] AQNB: Trimmed 5381 records to 3899 (keeping 200 days of data) [2025-10-23T19:56:07.537666] [DEBUG] [LOCAL ] AQNB: Primary data saved (3899 records). [2025-10-23T19:56:07.537779] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-23T19:56:07.537873] [INFO ] [MAIN ] Update Progress: 137/2367 symbols completed. AQNB took 22.4s. Estimated remaining: 4h 21m 21s. Rate: 8.5 symbols/min [2025-10-23T19:56:07.711802] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:07.711999] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-10-23T19:56:07.712040] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-10-23T19:56:07.712111] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-23T19:56:07.712150] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-23T19:56:07.712192] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-23T19:56:07.712227] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-23T19:56:08.004562] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-23T19:56:08.069231] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:08.799436] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-23T19:56:09.057824] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T19:56:09.608297] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-23T19:56:09.612295] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T19:56:09.646355] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T19:56:10.399437] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-23T19:56:11.169685] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T19:56:11.199381] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-23T19:56:11.999435] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-23T19:56:12.214734] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T19:56:12.377043] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T19:56:12.799411] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-23T19:56:12.879294] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-23T19:56:13.599463] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-23T19:56:14.399681] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-23T19:56:14.559714] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-23T19:56:14.636628] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T19:56:15.199498] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-23T19:56:15.950886] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T19:56:15.999436] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-23T19:56:16.730716] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T19:56:16.799389] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-23T19:56:17.599395] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-23T19:56:17.695628] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T19:56:18.381210] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T19:56:18.399386] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-23T19:56:19.199406] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-23T19:56:19.505132] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T19:56:19.839019] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T19:56:19.999398] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-23T19:56:20.223329] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T19:56:20.799416] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-23T19:56:21.594431] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T19:56:21.599393] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-23T19:56:21.902080] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T19:56:22.177454] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-23T19:56:22.399440] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-23T19:56:23.199439] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-23T19:56:23.934415] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T19:56:23.999410] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-23T19:56:24.799454] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-23T19:56:24.986340] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T19:56:25.531672] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T19:56:25.599437] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-23T19:56:25.830779] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T19:56:26.399406] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-23T19:56:27.199403] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-23T19:56:27.262520] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T19:56:27.463433] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T19:56:27.999444] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-23T19:56:28.799472] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-23T19:56:28.966956] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T19:56:29.009220] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T19:56:29.599421] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-23T19:56:30.304955] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T19:56:30.399409] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-23T19:56:30.816945] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T19:56:30.821543] [INFO ] [REMOTE ] ARDC: Full fetch complete (21593 records). [2025-10-23T19:56:30.821627] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-23T19:56:31.196437] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-23T19:56:31.196536] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-23T19:56:31.196912] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-23T19:56:31.196990] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-23T19:56:31.197569] [DEBUG] [LOCAL ] ARDC: Trimmed 21593 records to 15301 (keeping 200 days of data) [2025-10-23T19:56:31.199401] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-23T19:56:31.294527] [DEBUG] [LOCAL ] ARDC: Primary data saved (15301 records). [2025-10-23T19:56:31.294664] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-23T19:56:31.294758] [INFO ] [MAIN ] Update Progress: 138/2367 symbols completed. ARDC took 23.8s. Estimated remaining: 4h 25m 44s. Rate: 8.4 symbols/min [2025-10-23T19:56:31.460724] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:31.486297] [DEBUG] [LOCAL ] ARDT: Loaded 27391 existing records from primary storage. [2025-10-23T19:56:31.486597] [INFO ] [MAIN ] ARDT: Loaded 27391 existing records. [2025-10-23T19:56:31.662159] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:56:31.662384] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-23T19:56:31.662573] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-23T19:56:31.662993] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-23T19:56:31.663120] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-23T19:56:32.004521] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-23T19:56:32.041885] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:32.526696] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-23T19:56:32.538407] [INFO ] [REMOTE ] ARCO: Full fetch complete (64871 records). [2025-10-23T19:56:32.538756] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-23T19:56:32.804713] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-23T19:56:33.006916] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-23T19:56:33.007044] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-23T19:56:33.007834] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-23T19:56:33.007915] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-23T19:56:33.009285] [DEBUG] [LOCAL ] ARCO: Trimmed 64871 records to 44509 (keeping 200 days of data) [2025-10-23T19:56:33.312001] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-23T19:56:33.322592] [DEBUG] [LOCAL ] ARCO: Primary data saved (44509 records). [2025-10-23T19:56:33.322696] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-23T19:56:33.322783] [INFO ] [MAIN ] Update Progress: 139/2367 symbols completed. ARCO took 28.2s. Estimated remaining: 4h 24m 15s. Rate: 8.4 symbols/min [2025-10-23T19:56:33.332743] [INFO ] [REMOTE ] AR: Full fetch complete (77739 records). [2025-10-23T19:56:33.332872] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-23T19:56:33.747631] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:33.961327] [DEBUG] [LOCAL ] ARE: Loaded 50927 existing records from primary storage. [2025-10-23T19:56:33.965493] [INFO ] [MAIN ] ARE: Loaded 50927 existing records. [2025-10-23T19:56:33.963949] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T19:56:34.018075] [INFO ] [REMOTE ] AQN: Full fetch complete (75307 records). [2025-10-23T19:56:34.018289] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-23T19:56:34.179883] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-23T19:56:34.179986] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-23T19:56:34.181144] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-23T19:56:34.181232] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-23T19:56:34.179671] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T19:56:34.204336] [DEBUG] [LOCAL ] AR: Trimmed 77739 records to 53980 (keeping 200 days of data) [2025-10-23T19:56:34.220595] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-23T19:56:34.760548] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:56:34.760751] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-23T19:56:34.760814] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-23T19:56:34.761041] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-23T19:56:34.761108] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-23T19:56:35.080975] [DEBUG] [LOCAL ] AR: Primary data saved (53980 records). [2025-10-23T19:56:35.081138] [INFO ] [MAIN ] AR: Full history saved. [2025-10-23T19:56:35.081387] [INFO ] [MAIN ] Update Progress: 140/2367 symbols completed. AR took 31.3s. Estimated remaining: 4h 22m 42s. Rate: 8.5 symbols/min [2025-10-23T19:56:35.275287] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-23T19:56:35.275392] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-23T19:56:35.276229] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-23T19:56:35.276310] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-23T19:56:35.298491] [DEBUG] [LOCAL ] AQN: Trimmed 75307 records to 52016 (keeping 200 days of data) [2025-10-23T19:56:35.539469] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T19:56:35.555256] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-23T19:56:35.631996] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:35.827394] [DEBUG] [LOCAL ] ARES: Loaded 49676 existing records from primary storage. [2025-10-23T19:56:35.827743] [INFO ] [MAIN ] ARES: Loaded 49676 existing records. [2025-10-23T19:56:36.009610] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:36.018278] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-23T19:56:36.134266] [DEBUG] [LOCAL ] AQN: Primary data saved (52016 records). [2025-10-23T19:56:36.137925] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-23T19:56:36.138025] [INFO ] [MAIN ] Update Progress: 141/2367 symbols completed. AQN took 59.6s. Estimated remaining: 4h 21m 0s. Rate: 8.5 symbols/min [2025-10-23T19:56:36.198116] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:56:36.204149] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-23T19:56:36.204217] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-23T19:56:36.204472] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-23T19:56:36.204546] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-23T19:56:36.461567] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:36.461772] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-23T19:56:36.461825] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-23T19:56:36.461897] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-23T19:56:36.461935] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-23T19:56:36.461977] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-23T19:56:36.462012] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-23T19:56:37.002453] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:37.002817] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-23T19:56:37.125549] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:37.132865] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-23T19:56:37.150614] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T19:56:37.599429] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-23T19:56:37.836740] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T19:56:38.399433] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-23T19:56:38.618856] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T19:56:38.653884] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T19:56:38.857184] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T19:56:39.199415] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-23T19:56:39.999426] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-23T19:56:40.056473] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T19:56:40.271136] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T19:56:40.799407] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-23T19:56:41.599442] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-23T19:56:41.758975] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T19:56:42.399437] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-23T19:56:42.558492] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T19:56:43.087271] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T19:56:43.199428] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-23T19:56:43.999713] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-23T19:56:44.044143] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T19:56:44.091241] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T19:56:44.799424] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-23T19:56:45.599692] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-23T19:56:45.983489] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T19:56:46.399416] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-23T19:56:46.633356] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T19:56:47.033499] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T19:56:47.199423] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-23T19:56:47.735005] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T19:56:47.999421] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-23T19:56:48.799446] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-23T19:56:48.894911] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T19:56:49.599415] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-23T19:56:49.744041] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T19:56:50.399458] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-23T19:56:50.494073] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T19:56:50.839229] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T19:56:51.199430] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-23T19:56:51.277511] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-23T19:56:51.999433] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-23T19:56:52.732852] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T19:56:52.799401] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-23T19:56:53.599699] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-23T19:56:53.724910] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T19:56:54.399420] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-23T19:56:54.662993] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T19:56:55.111614] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T19:56:55.199462] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-23T19:56:55.493153] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T19:56:55.999423] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-23T19:56:56.799415] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-23T19:56:56.929851] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T19:56:57.332712] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T19:56:57.338228] [INFO ] [REMOTE ] ARDT: Full fetch complete (41561 records). [2025-10-23T19:56:57.338350] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-23T19:56:57.604508] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-23T19:56:57.724825] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-23T19:56:57.724927] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-23T19:56:57.725500] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-23T19:56:57.725543] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-23T19:56:57.726468] [DEBUG] [LOCAL ] ARDT: Trimmed 41561 records to 27612 (keeping 200 days of data) [2025-10-23T19:56:57.889705] [DEBUG] [LOCAL ] ARDT: Primary data saved (27612 records). [2025-10-23T19:56:57.889821] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-23T19:56:57.889919] [INFO ] [MAIN ] Update Progress: 142/2367 symbols completed. ARDT took 26.6s. Estimated remaining: 4h 24m 44s. Rate: 8.4 symbols/min [2025-10-23T19:56:58.066583] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:56:58.114182] [DEBUG] [LOCAL ] ARLO: Loaded 43510 existing records from primary storage. [2025-10-23T19:56:58.114489] [INFO ] [MAIN ] ARLO: Loaded 43510 existing records. [2025-10-23T19:56:58.295439] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:56:58.295680] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-23T19:56:58.295758] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-23T19:56:58.296168] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-23T19:56:58.296238] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-23T19:56:58.402690] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-23T19:56:58.695712] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T19:56:58.730493] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:56:59.207431] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-23T19:56:59.224230] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T19:56:59.999403] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-23T19:57:00.196118] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T19:57:00.272842] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T19:57:00.799447] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-23T19:57:01.599433] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-23T19:57:01.892923] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T19:57:02.399402] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-23T19:57:02.707174] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T19:57:03.199404] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-23T19:57:03.523244] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-23T19:57:03.533237] [INFO ] [REMOTE ] ARES: Full fetch complete (71723 records). [2025-10-23T19:57:03.533395] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-23T19:57:03.823542] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T19:57:03.968918] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-23T19:57:03.969154] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-23T19:57:03.969932] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-23T19:57:03.970072] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-23T19:57:03.971582] [DEBUG] [LOCAL ] ARES: Trimmed 71723 records to 50046 (keeping 200 days of data) [2025-10-23T19:57:04.026686] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-23T19:57:04.283328] [DEBUG] [LOCAL ] ARES: Primary data saved (50046 records). [2025-10-23T19:57:04.283668] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-23T19:57:04.283858] [INFO ] [MAIN ] Update Progress: 143/2367 symbols completed. ARES took 29.2s. Estimated remaining: 4h 24m 25s. Rate: 8.4 symbols/min [2025-10-23T19:57:04.451604] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:04.493626] [DEBUG] [LOCAL ] ARMK: Loaded 50369 existing records from primary storage. [2025-10-23T19:57:04.494001] [INFO ] [MAIN ] ARMK: Loaded 50369 existing records. [2025-10-23T19:57:04.667172] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:04.667372] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-23T19:57:04.667420] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-23T19:57:04.667731] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-23T19:57:04.667821] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-23T19:57:04.811550] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-23T19:57:05.046029] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:05.092103] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T19:57:05.599399] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-23T19:57:05.781210] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T19:57:06.399427] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-23T19:57:06.439757] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T19:57:07.139255] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T19:57:07.199416] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-23T19:57:07.900824] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T19:57:07.999404] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-23T19:57:08.799418] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-23T19:57:08.962668] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T19:57:08.970013] [INFO ] [REMOTE ] ARI: Full fetch complete (62244 records). [2025-10-23T19:57:08.970156] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-23T19:57:09.343639] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-23T19:57:09.343771] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-23T19:57:09.344409] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-23T19:57:09.344454] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-23T19:57:09.345608] [DEBUG] [LOCAL ] ARI: Trimmed 62244 records to 43804 (keeping 200 days of data) [2025-10-23T19:57:09.602257] [DEBUG] [LOCAL ] ARI: Primary data saved (43804 records). [2025-10-23T19:57:09.602434] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-23T19:57:09.602677] [INFO ] [MAIN ] Update Progress: 144/2367 symbols completed. ARI took 33.5s. Estimated remaining: 4h 23m 50s. Rate: 8.4 symbols/min [2025-10-23T19:57:09.616716] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-23T19:57:09.730799] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T19:57:09.763699] [INFO ] [REMOTE ] ARE: Full fetch complete (73035 records). [2025-10-23T19:57:09.763893] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-23T19:57:09.860083] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:09.860285] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-23T19:57:09.860326] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-23T19:57:09.860397] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-23T19:57:09.860436] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-23T19:57:09.860480] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-23T19:57:09.860557] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-23T19:57:10.436466] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T19:57:10.495131] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-23T19:57:10.634313] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-23T19:57:10.634408] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-23T19:57:10.635105] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-23T19:57:10.635177] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-23T19:57:10.639767] [DEBUG] [LOCAL ] ARE: Trimmed 73035 records to 51277 (keeping 200 days of data) [2025-10-23T19:57:10.743118] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:10.962567] [DEBUG] [LOCAL ] ARE: Primary data saved (51277 records). [2025-10-23T19:57:10.962766] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-23T19:57:10.962864] [INFO ] [MAIN ] Update Progress: 145/2367 symbols completed. ARE took 37.6s. Estimated remaining: 4h 22m 14s. Rate: 8.5 symbols/min [2025-10-23T19:57:11.163552] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:11.199414] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-23T19:57:11.225452] [DEBUG] [LOCAL ] ARR: Loaded 52091 existing records from primary storage. [2025-10-23T19:57:11.225845] [INFO ] [MAIN ] ARR: Loaded 52091 existing records. [2025-10-23T19:57:11.394237] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T19:57:11.466667] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:11.466888] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-23T19:57:11.467028] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-23T19:57:11.467263] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-23T19:57:11.467335] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-23T19:57:11.824176] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:11.969949] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T19:57:11.999387] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-23T19:57:12.799406] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-23T19:57:12.943836] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T19:57:13.314335] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T19:57:13.599424] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-23T19:57:14.399405] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-23T19:57:14.532275] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T19:57:15.199417] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-23T19:57:15.247802] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T19:57:16.001497] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-23T19:57:16.014708] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T19:57:16.545302] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T19:57:16.799433] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-23T19:57:17.599456] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-23T19:57:17.773629] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T19:57:18.399485] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-23T19:57:18.441321] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T19:57:19.176889] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T19:57:19.199391] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-23T19:57:19.999398] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-23T19:57:20.116336] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T19:57:20.799427] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-23T19:57:21.254434] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T19:57:21.599397] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-23T19:57:21.689342] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T19:57:21.700228] [INFO ] [REMOTE ] ARLO: Full fetch complete (63151 records). [2025-10-23T19:57:21.700400] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-23T19:57:22.126947] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-23T19:57:22.127051] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-23T19:57:22.127776] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-23T19:57:22.127866] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-23T19:57:22.129334] [DEBUG] [LOCAL ] ARLO: Trimmed 63151 records to 43851 (keeping 200 days of data) [2025-10-23T19:57:22.376747] [DEBUG] [LOCAL ] ARLO: Primary data saved (43851 records). [2025-10-23T19:57:22.376895] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-23T19:57:22.376981] [INFO ] [MAIN ] Update Progress: 146/2367 symbols completed. ARLO took 24.5s. Estimated remaining: 4h 23m 13s. Rate: 8.4 symbols/min [2025-10-23T19:57:22.400579] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-23T19:57:22.552122] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:22.596830] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T19:57:22.621984] [DEBUG] [LOCAL ] ARW: Loaded 33141 existing records from primary storage. [2025-10-23T19:57:22.622417] [INFO ] [MAIN ] ARW: Loaded 33141 existing records. [2025-10-23T19:57:22.793540] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:22.793791] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-23T19:57:22.793883] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-23T19:57:22.794130] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-23T19:57:22.794191] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-23T19:57:23.173463] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:23.199415] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-23T19:57:23.301390] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T19:57:23.999420] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-23T19:57:24.657824] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-23T19:57:24.719325] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-23T19:57:24.799407] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-23T19:57:25.599414] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-23T19:57:26.068364] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T19:57:26.399409] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-23T19:57:26.522016] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T19:57:26.565344] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T19:57:27.199429] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-23T19:57:27.999410] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-23T19:57:28.077700] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T19:57:28.754026] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T19:57:28.799383] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-23T19:57:29.384029] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T19:57:29.599411] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-23T19:57:30.399710] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-23T19:57:30.474039] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T19:57:30.992917] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T19:57:31.199419] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-23T19:57:31.999438] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-23T19:57:32.051733] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T19:57:32.799436] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-23T19:57:32.864678] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T19:57:33.599717] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-23T19:57:33.662676] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T19:57:34.399424] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-23T19:57:34.803779] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T19:57:35.169818] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T19:57:35.199446] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-23T19:57:35.999453] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-23T19:57:36.081236] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T19:57:36.799406] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T19:57:36.799456] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-23T19:57:37.599426] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-23T19:57:37.763331] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T19:57:37.772144] [INFO ] [REMOTE ] AROC: Full fetch complete (71418 records). [2025-10-23T19:57:37.772313] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-23T19:57:38.168267] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-23T19:57:38.168390] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-23T19:57:38.169156] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-23T19:57:38.169229] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-23T19:57:38.170769] [DEBUG] [LOCAL ] AROC: Trimmed 71418 records to 49443 (keeping 200 days of data) [2025-10-23T19:57:38.372372] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T19:57:38.385385] [INFO ] [REMOTE ] ARMK: Full fetch complete (73036 records). [2025-10-23T19:57:38.385588] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-23T19:57:38.409697] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-23T19:57:38.619495] [DEBUG] [LOCAL ] AROC: Primary data saved (49443 records). [2025-10-23T19:57:38.619682] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-23T19:57:38.619807] [INFO ] [MAIN ] Update Progress: 147/2367 symbols completed. AROC took 29.0s. Estimated remaining: 4h 25m 24s. Rate: 8.4 symbols/min [2025-10-23T19:57:38.988753] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:38.988959] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-23T19:57:38.989026] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-23T19:57:38.989144] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-23T19:57:38.989201] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-23T19:57:38.989248] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-23T19:57:38.989284] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-23T19:57:39.316433] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-23T19:57:39.316586] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-23T19:57:39.317697] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-23T19:57:39.317792] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-23T19:57:39.325168] [DEBUG] [LOCAL ] ARMK: Trimmed 73036 records to 50743 (keeping 200 days of data) [2025-10-23T19:57:39.591511] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T19:57:39.644991] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-23T19:57:39.837871] [DEBUG] [LOCAL ] ARMK: Primary data saved (50743 records). [2025-10-23T19:57:39.838168] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-23T19:57:39.838499] [INFO ] [MAIN ] Update Progress: 148/2367 symbols completed. ARMK took 35.6s. Estimated remaining: 4h 23m 48s. Rate: 8.4 symbols/min [2025-10-23T19:57:39.925908] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T19:57:40.021101] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-23T19:57:40.090258] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:40.171558] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:40.226032] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-23T19:57:40.226512] [INFO ] [MAIN ] AS: Loaded 53198 existing records. [2025-10-23T19:57:40.400981] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:40.401183] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-23T19:57:40.401230] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-23T19:57:40.401431] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-23T19:57:40.401491] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-23T19:57:40.744927] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:40.799383] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-23T19:57:41.393756] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T19:57:41.604536] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-23T19:57:41.623717] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T19:57:41.822598] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T19:57:41.822843] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-23T19:57:41.822928] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T19:57:41.823000] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-23T19:57:41.823067] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T19:57:41.823336] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-23T19:57:41.823424] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-23T19:57:41.823553] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-23T19:57:41.823661] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-23T19:57:41.823747] [INFO ] [MAIN ] Update Progress: 149/2367 symbols completed. ARX took 3.2s. Estimated remaining: 4h 22m 24s. Rate: 8.5 symbols/min [2025-10-23T19:57:41.986833] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:42.006978] [DEBUG] [LOCAL ] ASA: Loaded 15680 existing records from primary storage. [2025-10-23T19:57:42.007218] [INFO ] [MAIN ] ASA: Loaded 15680 existing records. [2025-10-23T19:57:42.180629] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:42.180809] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-23T19:57:42.180858] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-23T19:57:42.181020] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-23T19:57:42.181061] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-23T19:57:42.404722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-23T19:57:42.583755] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T19:57:42.624474] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:43.199433] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-23T19:57:43.999403] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-23T19:57:44.488815] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-23T19:57:44.500015] [INFO ] [REMOTE ] ARR: Full fetch complete (75511 records). [2025-10-23T19:57:44.500180] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-23T19:57:44.802141] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-23T19:57:44.933489] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T19:57:44.977286] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-23T19:57:44.977423] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-23T19:57:44.978259] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-23T19:57:44.978342] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-23T19:57:44.979934] [DEBUG] [LOCAL ] ARR: Trimmed 75511 records to 52475 (keeping 200 days of data) [2025-10-23T19:57:45.082037] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T19:57:45.308334] [DEBUG] [LOCAL ] ARR: Primary data saved (52475 records). [2025-10-23T19:57:45.308490] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-23T19:57:45.308587] [INFO ] [MAIN ] Update Progress: 150/2367 symbols completed. ARR took 34.3s. Estimated remaining: 4h 21m 23s. Rate: 8.5 symbols/min [2025-10-23T19:57:45.473748] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:45.520569] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-23T19:57:45.520949] [INFO ] [MAIN ] ASAN: Loaded 52732 existing records. [2025-10-23T19:57:45.600626] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-23T19:57:45.709457] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:45.709675] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-23T19:57:45.709743] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-23T19:57:45.710059] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-23T19:57:45.710125] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-23T19:57:46.078817] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:46.344767] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T19:57:46.399382] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-23T19:57:46.416527] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T19:57:47.199452] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-23T19:57:47.492289] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T19:57:47.999429] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-23T19:57:48.360946] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T19:57:48.799411] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-23T19:57:49.599512] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-23T19:57:49.625240] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T19:57:49.644081] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T19:57:50.399438] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-23T19:57:51.199454] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-23T19:57:51.305388] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T19:57:51.484757] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T19:57:51.999484] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-23T19:57:52.514556] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T19:57:52.522798] [INFO ] [REMOTE ] ARW: Full fetch complete (48693 records). [2025-10-23T19:57:52.522928] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-23T19:57:52.586181] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T19:57:52.804502] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-23T19:57:52.920708] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-23T19:57:52.920835] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-23T19:57:52.921370] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-23T19:57:52.921413] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-23T19:57:52.922419] [DEBUG] [LOCAL ] ARW: Trimmed 48693 records to 33415 (keeping 200 days of data) [2025-10-23T19:57:53.115545] [DEBUG] [LOCAL ] ARW: Primary data saved (33415 records). [2025-10-23T19:57:53.115730] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-23T19:57:53.115827] [INFO ] [MAIN ] Update Progress: 151/2367 symbols completed. ARW took 30.7s. Estimated remaining: 4h 21m 27s. Rate: 8.5 symbols/min [2025-10-23T19:57:53.282916] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:57:53.335729] [DEBUG] [LOCAL ] ASB: Loaded 49696 existing records from primary storage. [2025-10-23T19:57:53.336057] [INFO ] [MAIN ] ASB: Loaded 49696 existing records. [2025-10-23T19:57:53.513061] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:57:53.513256] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-23T19:57:53.513303] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-23T19:57:53.513573] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-23T19:57:53.513634] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-23T19:57:53.601867] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-23T19:57:53.864867] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T19:57:53.916990] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:57:54.399450] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-23T19:57:55.199418] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-23T19:57:55.438797] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T19:57:55.999731] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-23T19:57:56.200860] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T19:57:56.416452] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T19:57:56.799419] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-23T19:57:57.599396] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-23T19:57:57.767799] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T19:57:58.399401] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-23T19:57:58.597274] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T19:57:59.206903] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-23T19:57:59.224026] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T19:57:59.410841] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T19:57:59.999436] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-23T19:58:00.799438] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-23T19:58:01.510518] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T19:58:01.599419] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-23T19:58:02.082607] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-23T19:58:02.399441] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-23T19:58:03.017757] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-23T19:58:03.199399] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-23T19:58:03.829550] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-23T19:58:03.999409] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-23T19:58:04.285235] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T19:58:04.799399] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-23T19:58:05.041003] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T19:58:05.599441] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-23T19:58:05.809264] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T19:58:06.399442] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-23T19:58:06.585085] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T19:58:06.653028] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T19:58:07.199418] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-23T19:58:07.905968] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T19:58:07.999393] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-23T19:58:08.518543] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T19:58:08.523038] [INFO ] [REMOTE ] ASA: Full fetch complete (20806 records). [2025-10-23T19:58:08.523138] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-23T19:58:08.801299] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-23T19:58:08.907548] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-23T19:58:08.907687] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-23T19:58:08.908140] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-23T19:58:08.908214] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-23T19:58:08.908934] [DEBUG] [LOCAL ] ASA: Trimmed 20806 records to 15779 (keeping 200 days of data) [2025-10-23T19:58:08.998037] [DEBUG] [LOCAL ] ASA: Primary data saved (15779 records). [2025-10-23T19:58:08.998218] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-23T19:58:08.998301] [INFO ] [MAIN ] Update Progress: 152/2367 symbols completed. ASA took 27.2s. Estimated remaining: 4h 23m 28s. Rate: 8.4 symbols/min [2025-10-23T19:58:09.162011] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:58:09.169976] [DEBUG] [LOCAL ] ASBA: Loaded 3475 existing records from primary storage. [2025-10-23T19:58:09.170153] [INFO ] [MAIN ] ASBA: Loaded 3475 existing records. [2025-10-23T19:58:09.339680] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:58:09.339932] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-23T19:58:09.339984] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-23T19:58:09.340143] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-23T19:58:09.340204] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-23T19:58:09.604162] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-23T19:58:09.689873] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:58:10.124179] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-23T19:58:10.399434] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-23T19:58:10.502571] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T19:58:11.050716] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T19:58:11.087436] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-23T19:58:11.199428] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-23T19:58:11.999411] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-23T19:58:12.473558] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-23T19:58:12.799431] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-23T19:58:13.026089] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T19:58:13.599428] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-23T19:58:14.308000] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T19:58:14.399413] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-23T19:58:14.937289] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-23T19:58:15.199419] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-23T19:58:15.526112] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T19:58:15.596358] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-23T19:58:15.999422] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-23T19:58:16.799421] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-23T19:58:17.599430] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-23T19:58:18.016830] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-23T19:58:18.029164] [INFO ] [REMOTE ] AS: Full fetch complete (76920 records). [2025-10-23T19:58:18.029338] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-23T19:58:18.170440] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-23T19:58:18.415588] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-23T19:58:18.444357] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-23T19:58:18.444467] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-23T19:58:18.445316] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-23T19:58:18.445412] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-23T19:58:18.446932] [DEBUG] [LOCAL ] AS: Trimmed 76920 records to 53587 (keeping 200 days of data) [2025-10-23T19:58:18.771671] [DEBUG] [LOCAL ] AS: Primary data saved (53587 records). [2025-10-23T19:58:18.771837] [INFO ] [MAIN ] AS: Full history saved. [2025-10-23T19:58:18.771943] [INFO ] [MAIN ] Update Progress: 153/2367 symbols completed. AS took 38.9s. Estimated remaining: 4h 23m 59s. Rate: 8.4 symbols/min [2025-10-23T19:58:18.955329] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:58:18.989146] [DEBUG] [LOCAL ] ASC: Loaded 37184 existing records from primary storage. [2025-10-23T19:58:18.989442] [INFO ] [MAIN ] ASC: Loaded 37184 existing records. [2025-10-23T19:58:19.201201] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-23T19:58:19.191603] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:58:19.202794] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-23T19:58:19.202859] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-23T19:58:19.210425] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-23T19:58:19.208937] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-23T19:58:19.221680] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-23T19:58:19.221574] [INFO ] [REMOTE ] ASAN: Full fetch complete (76633 records). [2025-10-23T19:58:19.233032] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-23T19:58:19.682551] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-23T19:58:19.979841] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:58:20.002678] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-23T19:58:20.048458] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T19:58:20.054402] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-23T19:58:20.054461] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-23T19:58:20.055200] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-23T19:58:20.055273] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-23T19:58:20.056711] [DEBUG] [LOCAL ] ASAN: Trimmed 76633 records to 53116 (keeping 200 days of data) [2025-10-23T19:58:20.366119] [DEBUG] [LOCAL ] ASAN: Primary data saved (53116 records). [2025-10-23T19:58:20.366270] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-23T19:58:20.366351] [INFO ] [MAIN ] Update Progress: 154/2367 symbols completed. ASAN took 35.1s. Estimated remaining: 4h 22m 32s. Rate: 8.4 symbols/min [2025-10-23T19:58:20.533515] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:58:20.533705] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-10-23T19:58:20.533778] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-10-23T19:58:20.533963] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-23T19:58:20.534020] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-23T19:58:20.534074] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-10-23T19:58:20.534120] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-23T19:58:20.801229] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-23T19:58:20.920243] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:58:21.590302] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T19:58:21.599530] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-23T19:58:22.399398] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-23T19:58:22.462857] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T19:58:22.595313] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T19:58:22.964673] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-23T19:58:23.199432] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-23T19:58:23.999415] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-23T19:58:24.416060] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T19:58:24.799427] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-23T19:58:25.450683] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T19:58:25.519700] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T19:58:25.599413] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-23T19:58:26.399674] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-23T19:58:26.865500] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T19:58:27.199424] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-23T19:58:27.999416] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-23T19:58:28.118383] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T19:58:28.212686] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T19:58:28.635490] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T19:58:28.799407] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-23T19:58:29.377279] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T19:58:29.599473] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-23T19:58:30.399435] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-23T19:58:30.693675] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T19:58:31.199451] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-23T19:58:31.887869] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T19:58:31.999406] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-23T19:58:32.212412] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T19:58:32.799401] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-23T19:58:33.346612] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T19:58:33.599402] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-23T19:58:33.668511] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T19:58:34.264731] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T19:58:34.265962] [INFO ] [REMOTE ] ASBA: Full fetch complete (5208 records). [2025-10-23T19:58:34.266051] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-23T19:58:34.406308] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-23T19:58:34.630598] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-23T19:58:34.630705] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-23T19:58:34.630931] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-23T19:58:34.630993] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-23T19:58:34.631350] [DEBUG] [LOCAL ] ASBA: Trimmed 5208 records to 3490 (keeping 200 days of data) [2025-10-23T19:58:34.655938] [DEBUG] [LOCAL ] ASBA: Primary data saved (3490 records). [2025-10-23T19:58:34.656050] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-23T19:58:34.656153] [INFO ] [MAIN ] Update Progress: 155/2367 symbols completed. ASBA took 25.7s. Estimated remaining: 4h 24m 7s. Rate: 8.4 symbols/min [2025-10-23T19:58:34.820040] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:58:34.820147] [DEBUG] [LOCAL ] ASGI: No existing data file found in primary storage. [2025-10-23T19:58:34.820186] [WARN ] [MAIN ] ASGI: No existing data found, performing full refresh instead. [2025-10-23T19:58:34.820249] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-23T19:58:34.820288] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-23T19:58:34.820329] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-23T19:58:34.820363] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-23T19:58:35.160622] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:58:35.199394] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-23T19:58:35.999436] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-23T19:58:36.476111] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T19:58:36.799431] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-23T19:58:36.881841] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-23T19:58:36.893095] [INFO ] [REMOTE ] ASB: Full fetch complete (72273 records). [2025-10-23T19:58:36.893266] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-23T19:58:37.129562] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T19:58:37.323424] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-23T19:58:37.323534] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-23T19:58:37.324299] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-23T19:58:37.324373] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-23T19:58:37.325788] [DEBUG] [LOCAL ] ASB: Trimmed 72273 records to 50074 (keeping 200 days of data) [2025-10-23T19:58:37.606710] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-23T19:58:37.626065] [DEBUG] [LOCAL ] ASB: Primary data saved (50074 records). [2025-10-23T19:58:37.626363] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-23T19:58:37.626530] [INFO ] [MAIN ] Update Progress: 156/2367 symbols completed. ASB took 44.5s. Estimated remaining: 4h 23m 1s. Rate: 8.4 symbols/min [2025-10-23T19:58:37.814338] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:58:37.859942] [DEBUG] [LOCAL ] ASGN: Loaded 36689 existing records from primary storage. [2025-10-23T19:58:37.860278] [INFO ] [MAIN ] ASGN: Loaded 36689 existing records. [2025-10-23T19:58:38.052029] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:58:38.052277] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-23T19:58:38.052337] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-23T19:58:38.052686] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-23T19:58:38.052767] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-23T19:58:38.260385] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T19:58:38.404491] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-23T19:58:38.469965] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:58:38.767858] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T19:58:39.199422] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-23T19:58:39.934149] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T19:58:39.999411] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-23T19:58:40.179240] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T19:58:40.799441] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-23T19:58:41.350268] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T19:58:41.599421] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-23T19:58:41.820144] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T19:58:42.399438] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-23T19:58:42.444853] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T19:58:42.448510] [INFO ] [REMOTE ] ASG: Full fetch complete (30873 records). [2025-10-23T19:58:42.448736] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-23T19:58:42.813724] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-23T19:58:42.813859] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-23T19:58:42.814414] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-23T19:58:42.814479] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-23T19:58:42.815266] [DEBUG] [LOCAL ] ASG: Trimmed 30873 records to 19473 (keeping 200 days of data) [2025-10-23T19:58:42.922072] [DEBUG] [LOCAL ] ASG: Primary data saved (19473 records). [2025-10-23T19:58:42.922269] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-23T19:58:42.922362] [INFO ] [MAIN ] Update Progress: 157/2367 symbols completed. ASG took 22.6s. Estimated remaining: 4h 22m 28s. Rate: 8.4 symbols/min [2025-10-23T19:58:43.199425] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-23T19:58:43.816055] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T19:58:43.999412] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-23T19:58:44.217403] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T19:58:44.799449] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-23T19:58:45.526979] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T19:58:45.599386] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-23T19:58:46.136053] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T19:58:46.360897] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-23T19:58:46.399387] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-23T19:58:47.199423] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-23T19:58:47.888330] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T19:58:47.894752] [INFO ] [REMOTE ] ASC: Full fetch complete (56000 records). [2025-10-23T19:58:47.894878] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-23T19:58:48.004514] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-23T19:58:48.313165] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-23T19:58:48.313263] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-23T19:58:48.313873] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-23T19:58:48.313944] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-23T19:58:48.314991] [DEBUG] [LOCAL ] ASC: Trimmed 56000 records to 37473 (keeping 200 days of data) [2025-10-23T19:58:48.414512] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T19:58:48.544935] [DEBUG] [LOCAL ] ASC: Primary data saved (37473 records). [2025-10-23T19:58:48.545086] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-23T19:58:48.545166] [INFO ] [MAIN ] Update Progress: 158/2367 symbols completed. ASC took 29.8s. Estimated remaining: 4h 21m 60s. Rate: 8.4 symbols/min [2025-10-23T19:58:48.799401] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-23T19:58:49.514508] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T19:58:49.599386] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-23T19:58:49.826856] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T19:58:50.399458] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-23T19:58:51.005975] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T19:58:51.199433] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-23T19:58:51.646838] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T19:58:51.999700] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-23T19:58:52.494973] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T19:58:52.799708] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-23T19:58:53.160047] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T19:58:53.599425] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-23T19:58:54.319052] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T19:58:54.399462] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-23T19:58:54.763101] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T19:58:55.199433] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-23T19:58:55.864887] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T19:58:55.999397] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-23T19:58:56.362333] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T19:58:56.366699] [INFO ] [REMOTE ] ASGI: Full fetch complete (32899 records). [2025-10-23T19:58:56.366803] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-23T19:58:56.736905] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-23T19:58:56.737023] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-23T19:58:56.737482] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-23T19:58:56.737529] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-23T19:58:56.738561] [DEBUG] [LOCAL ] ASGI: Trimmed 32899 records to 23093 (keeping 200 days of data) [2025-10-23T19:58:56.900156] [DEBUG] [LOCAL ] ASGI: Primary data saved (23093 records). [2025-10-23T19:58:56.900354] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-23T19:58:56.900463] [INFO ] [MAIN ] Update Progress: 159/2367 symbols completed. ASGI took 22.2s. Estimated remaining: 4h 22m 10s. Rate: 8.4 symbols/min [2025-10-23T19:58:57.414033] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T19:58:57.422149] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-23T19:58:59.179447] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T19:58:59.189842] [INFO ] [REMOTE ] ASGN: Full fetch complete (53805 records). [2025-10-23T19:58:59.189985] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-23T19:58:59.566332] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-23T19:58:59.566448] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-23T19:58:59.567196] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-23T19:58:59.567277] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-23T19:58:59.568445] [DEBUG] [LOCAL ] ASGN: Trimmed 53805 records to 37036 (keeping 200 days of data) [2025-10-23T19:58:59.771679] [DEBUG] [LOCAL ] ASGN: Primary data saved (37036 records). [2025-10-23T19:58:59.771860] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-23T19:58:59.772095] [INFO ] [MAIN ] Update Progress: 160/2367 symbols completed. ASGN took 22.1s. Estimated remaining: 4h 21m 4s. Rate: 8.5 symbols/min [2025-10-23T19:59:00.406129] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:00.406339] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-10-23T19:59:00.406386] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-10-23T19:59:00.406459] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-23T19:59:00.406498] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-23T19:59:00.406541] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-23T19:59:00.406575] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-23T19:59:00.493583] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:00.537186] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:00.585568] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:00.609583] [DEBUG] [LOCAL ] ASIX: Loaded 22992 existing records from primary storage. [2025-10-23T19:59:00.620071] [INFO ] [MAIN ] ASIX: Loaded 22992 existing records. [2025-10-23T19:59:00.807605] [DEBUG] [LOCAL ] ASPN: Loaded 49875 existing records from primary storage. [2025-10-23T19:59:00.814463] [INFO ] [MAIN ] ASPN: Loaded 49875 existing records. [2025-10-23T19:59:00.808173] [DEBUG] [LOCAL ] ASH: Loaded 37383 existing records from primary storage. [2025-10-23T19:59:00.872333] [INFO ] [MAIN ] ASH: Loaded 37383 existing records. [2025-10-23T19:59:01.214088] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:01.214297] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-23T19:59:01.214346] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-23T19:59:01.214544] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-23T19:59:01.214606] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-23T19:59:01.472480] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:01.472734] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-23T19:59:01.472823] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-23T19:59:01.478381] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-23T19:59:01.478559] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-23T19:59:01.731154] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:01.734512] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-23T19:59:01.754028] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:01.754194] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-23T19:59:01.754242] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-23T19:59:01.754432] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-23T19:59:01.754492] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-23T19:59:02.428931] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:02.429291] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-23T19:59:02.615402] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:02.621040] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-23T19:59:02.689110] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T19:59:02.695990] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-23T19:59:02.693012] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:02.697873] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-23T19:59:03.363086] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T19:59:03.365715] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-23T19:59:03.435638] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-23T19:59:03.440605] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-23T19:59:03.811952] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T19:59:03.823317] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-23T19:59:03.840190] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T19:59:03.999415] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-23T19:59:04.400310] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T19:59:04.569910] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T19:59:04.799412] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-23T19:59:04.917066] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T19:59:04.933999] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T19:59:05.599422] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-23T19:59:05.864979] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T19:59:06.399444] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-23T19:59:06.948041] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T19:59:07.199411] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-23T19:59:07.209845] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T19:59:07.999432] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-23T19:59:08.473397] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T19:59:08.799428] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-23T19:59:09.207433] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T19:59:09.562183] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T19:59:09.599388] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-23T19:59:10.399392] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-23T19:59:11.186763] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T19:59:11.199409] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-23T19:59:11.331512] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T19:59:11.734703] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T19:59:11.999429] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-23T19:59:12.789514] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T19:59:12.799390] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-23T19:59:13.599404] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-23T19:59:13.702040] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T19:59:13.704029] [INFO ] [REMOTE ] ASR: Full fetch complete (12561 records). [2025-10-23T19:59:13.704129] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-23T19:59:14.106672] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-23T19:59:14.106802] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-23T19:59:14.107102] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-23T19:59:14.107172] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-23T19:59:14.107773] [DEBUG] [LOCAL ] ASR: Trimmed 12561 records to 9477 (keeping 200 days of data) [2025-10-23T19:59:14.167403] [DEBUG] [LOCAL ] ASR: Primary data saved (9477 records). [2025-10-23T19:59:14.167584] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-23T19:59:14.167735] [INFO ] [MAIN ] Update Progress: 161/2367 symbols completed. ASR took 14.4s. Estimated remaining: 4h 22m 37s. Rate: 8.4 symbols/min [2025-10-23T19:59:14.367785] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:14.404482] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-23T19:59:14.432047] [DEBUG] [LOCAL ] ASX: Loaded 52880 existing records from primary storage. [2025-10-23T19:59:14.432427] [INFO ] [MAIN ] ASX: Loaded 52880 existing records. [2025-10-23T19:59:14.620140] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:14.620363] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-23T19:59:14.620412] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-23T19:59:14.620599] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-23T19:59:14.620668] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-23T19:59:15.006906] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:15.199419] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-23T19:59:15.470319] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T19:59:15.868986] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T19:59:15.999404] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-23T19:59:16.799435] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-23T19:59:16.966247] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T19:59:17.601087] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-23T19:59:17.612289] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T19:59:18.399448] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-23T19:59:18.499604] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T19:59:19.199474] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-23T19:59:19.415499] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T19:59:19.766895] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T19:59:19.999419] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-23T19:59:20.799684] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-23T19:59:21.144620] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T19:59:21.243067] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T19:59:21.599436] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-23T19:59:21.910869] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T19:59:22.399436] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-23T19:59:23.199441] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-23T19:59:23.518755] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T19:59:23.531363] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T19:59:23.999414] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-23T19:59:24.799417] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-23T19:59:24.993899] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T19:59:25.157552] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T19:59:25.599438] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-23T19:59:26.296918] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T19:59:26.399401] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-23T19:59:27.199427] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-23T19:59:27.474322] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T19:59:27.928401] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T19:59:27.935187] [INFO ] [REMOTE ] ASH: Full fetch complete (55628 records). [2025-10-23T19:59:27.935314] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-23T19:59:28.004676] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-23T19:59:28.030824] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T19:59:28.345812] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-23T19:59:28.345939] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-23T19:59:28.346581] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-23T19:59:28.346636] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-23T19:59:28.347902] [DEBUG] [LOCAL ] ASH: Trimmed 55628 records to 37640 (keeping 200 days of data) [2025-10-23T19:59:28.565336] [DEBUG] [LOCAL ] ASH: Primary data saved (37640 records). [2025-10-23T19:59:28.565486] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-23T19:59:28.565565] [INFO ] [MAIN ] Update Progress: 162/2367 symbols completed. ASH took 28.8s. Estimated remaining: 4h 24m 8s. Rate: 8.3 symbols/min [2025-10-23T19:59:28.733624] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:28.775700] [DEBUG] [LOCAL ] ATEN: Loaded 37731 existing records from primary storage. [2025-10-23T19:59:28.776152] [INFO ] [MAIN ] ATEN: Loaded 37731 existing records. [2025-10-23T19:59:28.807455] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-23T19:59:28.968274] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:28.968476] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-23T19:59:28.968526] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-23T19:59:28.968806] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-23T19:59:28.968875] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-23T19:59:29.313063] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:29.599442] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-23T19:59:29.852091] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T19:59:30.332139] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T19:59:30.399393] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-23T19:59:30.729052] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T19:59:31.199409] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-23T19:59:31.999417] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-23T19:59:32.166159] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T19:59:32.607013] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T19:59:32.799415] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-23T19:59:32.870075] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T19:59:32.875424] [INFO ] [REMOTE ] ASIX: Full fetch complete (31078 records). [2025-10-23T19:59:32.875532] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-23T19:59:33.246871] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-23T19:59:33.246979] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-23T19:59:33.247379] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-23T19:59:33.247420] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-23T19:59:33.248182] [DEBUG] [LOCAL ] ASIX: Trimmed 31078 records to 23134 (keeping 200 days of data) [2025-10-23T19:59:33.383370] [DEBUG] [LOCAL ] ASIX: Primary data saved (23134 records). [2025-10-23T19:59:33.383564] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-23T19:59:33.383835] [INFO ] [MAIN ] Update Progress: 163/2367 symbols completed. ASIX took 33.6s. Estimated remaining: 4h 23m 29s. Rate: 8.4 symbols/min [2025-10-23T19:59:33.550383] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:33.583942] [DEBUG] [LOCAL ] ATGE: Loaded 30426 existing records from primary storage. [2025-10-23T19:59:33.584248] [INFO ] [MAIN ] ATGE: Loaded 30426 existing records. [2025-10-23T19:59:33.604950] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-23T19:59:33.767945] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:33.768163] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-23T19:59:33.768218] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-23T19:59:33.768403] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-23T19:59:33.768443] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-23T19:59:34.127437] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:34.279082] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T19:59:34.399388] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-23T19:59:35.199404] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-23T19:59:35.342447] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T19:59:35.999419] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-23T19:59:36.093705] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T19:59:36.215970] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T19:59:36.799407] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-23T19:59:37.599406] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-23T19:59:37.873326] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T19:59:37.885105] [INFO ] [REMOTE ] ASPN: Full fetch complete (72565 records). [2025-10-23T19:59:37.885239] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-23T19:59:38.290333] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-23T19:59:38.290459] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-23T19:59:38.291264] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-23T19:59:38.291340] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-23T19:59:38.292863] [DEBUG] [LOCAL ] ASPN: Trimmed 72565 records to 50218 (keeping 200 days of data) [2025-10-23T19:59:38.403005] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-23T19:59:38.411417] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T19:59:38.608370] [DEBUG] [LOCAL ] ASPN: Primary data saved (50218 records). [2025-10-23T19:59:38.608541] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-23T19:59:38.609718] [INFO ] [MAIN ] Update Progress: 164/2367 symbols completed. ASPN took 38.8s. Estimated remaining: 4h 22m 56s. Rate: 8.4 symbols/min [2025-10-23T19:59:38.775239] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:38.817169] [DEBUG] [LOCAL ] ATHM: Loaded 31208 existing records from primary storage. [2025-10-23T19:59:38.817472] [INFO ] [MAIN ] ATHM: Loaded 31208 existing records. [2025-10-23T19:59:39.022393] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:39.022588] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-23T19:59:39.022675] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-23T19:59:39.023020] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-23T19:59:39.023088] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-23T19:59:39.210702] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-23T19:59:39.397752] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T19:59:39.449028] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:39.792109] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T19:59:39.999469] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-23T19:59:40.799865] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-23T19:59:40.817945] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T19:59:41.599426] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-23T19:59:41.700218] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T19:59:42.251010] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T19:59:42.399419] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-23T19:59:42.938844] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T19:59:43.199433] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-23T19:59:43.868378] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T19:59:43.999428] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-23T19:59:44.799412] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-23T19:59:45.027892] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T19:59:45.547297] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T19:59:45.599388] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-23T19:59:46.256308] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T19:59:46.399402] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-23T19:59:47.103232] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T19:59:47.199409] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-23T19:59:47.825859] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T19:59:47.999408] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-23T19:59:48.328178] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T19:59:48.799438] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-23T19:59:49.599433] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-23T19:59:49.982475] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T19:59:50.136270] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T19:59:50.399422] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-23T19:59:51.013822] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T19:59:51.199414] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-23T19:59:51.830408] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T19:59:51.999420] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-23T19:59:52.545842] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T19:59:52.551808] [INFO ] [REMOTE ] ATEN: Full fetch complete (56736 records). [2025-10-23T19:59:52.551974] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-23T19:59:52.804769] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-23T19:59:52.935113] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-23T19:59:52.935241] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-23T19:59:52.936023] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-23T19:59:52.936123] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-23T19:59:52.937335] [DEBUG] [LOCAL ] ATEN: Trimmed 56736 records to 37929 (keeping 200 days of data) [2025-10-23T19:59:53.156251] [DEBUG] [LOCAL ] ATEN: Primary data saved (37929 records). [2025-10-23T19:59:53.156425] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-23T19:59:53.156504] [INFO ] [MAIN ] Update Progress: 165/2367 symbols completed. ATEN took 24.6s. Estimated remaining: 4h 24m 27s. Rate: 8.3 symbols/min [2025-10-23T19:59:53.331439] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:53.341774] [DEBUG] [LOCAL ] ATHS: Loaded 6496 existing records from primary storage. [2025-10-23T19:59:53.342032] [INFO ] [MAIN ] ATHS: Loaded 6496 existing records. [2025-10-23T19:59:53.539027] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:53.539307] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-23T19:59:53.539389] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-23T19:59:53.539577] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-23T19:59:53.539677] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-23T19:59:53.604319] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-23T19:59:53.991298] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:54.010367] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-23T19:59:54.020077] [INFO ] [REMOTE ] ASX: Full fetch complete (76791 records). [2025-10-23T19:59:54.020380] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-23T19:59:54.104803] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T19:59:54.404575] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-23T19:59:54.457560] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-23T19:59:54.457722] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-23T19:59:54.458682] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-23T19:59:54.458776] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-23T19:59:54.460820] [DEBUG] [LOCAL ] ASX: Trimmed 76791 records to 53258 (keeping 200 days of data) [2025-10-23T19:59:54.788637] [DEBUG] [LOCAL ] ASX: Primary data saved (53258 records). [2025-10-23T19:59:54.788833] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-23T19:59:54.788931] [INFO ] [MAIN ] Update Progress: 166/2367 symbols completed. ASX took 40.6s. Estimated remaining: 4h 23m 6s. Rate: 8.4 symbols/min [2025-10-23T19:59:54.960419] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T19:59:55.018591] [DEBUG] [LOCAL ] ATI: Loaded 51283 existing records from primary storage. [2025-10-23T19:59:55.019130] [INFO ] [MAIN ] ATI: Loaded 51283 existing records. [2025-10-23T19:59:55.204269] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-23T19:59:55.212365] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T19:59:55.257430] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T19:59:55.257661] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-23T19:59:55.257735] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-23T19:59:55.258020] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-23T19:59:55.258120] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-23T19:59:55.272342] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T19:59:55.609815] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T19:59:55.999443] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-23T19:59:56.566006] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T19:59:56.701228] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T19:59:56.799434] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-23T19:59:57.594846] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T19:59:57.599391] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-23T19:59:58.399469] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-23T19:59:58.873470] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T19:59:59.199424] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-23T19:59:59.978891] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T19:59:59.999444] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-23T20:00:00.630769] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T20:00:00.639594] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T20:00:00.799434] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-23T20:00:01.599483] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-23T20:00:02.087501] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T20:00:02.399464] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-23T20:00:03.132960] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T20:00:03.199453] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-23T20:00:03.317684] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T20:00:03.999454] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-23T20:00:04.799468] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-23T20:00:05.270531] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T20:00:05.275432] [INFO ] [REMOTE ] ATGE: Full fetch complete (45484 records). [2025-10-23T20:00:05.275575] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-23T20:00:05.614763] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-23T20:00:05.676534] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-23T20:00:05.676693] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-23T20:00:05.677291] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-23T20:00:05.677355] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-23T20:00:05.678588] [DEBUG] [LOCAL ] ATGE: Trimmed 45484 records to 30576 (keeping 200 days of data) [2025-10-23T20:00:05.869948] [DEBUG] [LOCAL ] ATGE: Primary data saved (30576 records). [2025-10-23T20:00:05.870123] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-23T20:00:05.870244] [INFO ] [MAIN ] Update Progress: 167/2367 symbols completed. ATGE took 32.5s. Estimated remaining: 4h 23m 50s. Rate: 8.3 symbols/min [2025-10-23T20:00:05.945567] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T20:00:06.052590] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:06.100360] [DEBUG] [LOCAL ] ATKR: Loaded 34853 existing records from primary storage. [2025-10-23T20:00:06.100729] [INFO ] [MAIN ] ATKR: Loaded 34853 existing records. [2025-10-23T20:00:06.281909] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:06.282161] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-23T20:00:06.282227] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-23T20:00:06.282494] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-23T20:00:06.282565] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-23T20:00:06.404721] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-23T20:00:06.650149] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:07.151778] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T20:00:07.205664] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-23T20:00:07.221404] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-23T20:00:07.999418] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-23T20:00:08.653536] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (3.04 seconds). [2025-10-23T20:00:08.799441] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-23T20:00:08.883473] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:00:09.459144] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T20:00:09.599454] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-23T20:00:10.399481] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-23T20:00:10.482002] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T20:00:10.957727] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T20:00:11.199474] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-23T20:00:11.565973] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T20:00:11.670792] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T20:00:11.999484] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-23T20:00:12.799427] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-23T20:00:13.593670] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T20:00:13.601063] [INFO ] [REMOTE ] ATHM: Full fetch complete (49438 records). [2025-10-23T20:00:13.601306] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-23T20:00:13.601698] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-23T20:00:13.986982] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-23T20:00:13.987079] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-23T20:00:13.987634] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-23T20:00:13.987733] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-23T20:00:13.988756] [DEBUG] [LOCAL ] ATHM: Trimmed 49438 records to 31467 (keeping 200 days of data) [2025-10-23T20:00:14.177188] [DEBUG] [LOCAL ] ATHM: Primary data saved (31467 records). [2025-10-23T20:00:14.177355] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-23T20:00:14.177437] [INFO ] [MAIN ] Update Progress: 168/2367 symbols completed. ATHM took 35.6s. Estimated remaining: 4h 23m 58s. Rate: 8.3 symbols/min [2025-10-23T20:00:14.343047] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:14.387592] [DEBUG] [LOCAL ] ATMU: Loaded 38718 existing records from primary storage. [2025-10-23T20:00:14.388129] [INFO ] [MAIN ] ATMU: Loaded 38718 existing records. [2025-10-23T20:00:14.399400] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-23T20:00:14.571545] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:14.571748] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-23T20:00:14.571808] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-23T20:00:14.572128] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-23T20:00:14.572195] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-23T20:00:14.911847] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-23T20:00:14.980238] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:15.199423] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-23T20:00:15.541248] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T20:00:15.861476] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T20:00:15.863117] [INFO ] [REMOTE ] ATHS: Full fetch complete (9614 records). [2025-10-23T20:00:15.863274] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-23T20:00:16.004715] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-23T20:00:16.274437] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-23T20:00:16.274544] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-23T20:00:16.274905] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-23T20:00:16.274979] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-23T20:00:16.275490] [DEBUG] [LOCAL ] ATHS: Trimmed 9614 records to 6531 (keeping 200 days of data) [2025-10-23T20:00:16.318762] [DEBUG] [LOCAL ] ATHS: Primary data saved (6531 records). [2025-10-23T20:00:16.318962] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-23T20:00:16.319205] [INFO ] [MAIN ] Update Progress: 169/2367 symbols completed. ATHS took 23.2s. Estimated remaining: 4h 22m 45s. Rate: 8.4 symbols/min [2025-10-23T20:00:16.511927] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:16.556437] [DEBUG] [LOCAL ] ATO: Loaded 41529 existing records from primary storage. [2025-10-23T20:00:16.556831] [INFO ] [MAIN ] ATO: Loaded 41529 existing records. [2025-10-23T20:00:16.778928] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:16.779218] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-23T20:00:16.779291] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-23T20:00:16.779549] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-23T20:00:16.779625] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-23T20:00:16.812898] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-23T20:00:16.895757] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T20:00:17.218720] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:17.403164] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:00:17.599444] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-23T20:00:18.399410] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-23T20:00:18.475512] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T20:00:19.199442] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-23T20:00:19.252778] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T20:00:19.999408] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-23T20:00:20.176955] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:00:20.717468] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T20:00:20.799441] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-23T20:00:21.395355] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T20:00:21.599429] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-23T20:00:22.026393] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T20:00:22.399448] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-23T20:00:22.934874] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T20:00:23.199427] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-23T20:00:23.999441] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-23T20:00:24.053448] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:00:24.799436] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-23T20:00:25.219722] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T20:00:25.503490] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T20:00:25.599445] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-23T20:00:25.683782] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-23T20:00:26.399416] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-23T20:00:27.199404] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-23T20:00:27.282478] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T20:00:27.802562] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T20:00:27.999406] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-23T20:00:28.799419] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-23T20:00:29.060953] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T20:00:29.281305] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T20:00:29.599407] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-23T20:00:30.180354] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:00:30.399429] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-23T20:00:31.054899] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T20:00:31.199408] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-23T20:00:31.876075] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T20:00:31.999419] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-23T20:00:32.799407] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-23T20:00:32.909248] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T20:00:33.595810] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T20:00:33.605866] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-23T20:00:34.264978] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T20:00:34.399418] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-23T20:00:35.199486] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-23T20:00:35.441132] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T20:00:35.452624] [INFO ] [REMOTE ] ATI: Full fetch complete (74071 records). [2025-10-23T20:00:35.452810] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-23T20:00:35.869268] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-23T20:00:35.869372] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-23T20:00:35.870162] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-23T20:00:35.870247] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-23T20:00:35.871699] [DEBUG] [LOCAL ] ATI: Trimmed 74071 records to 51668 (keeping 200 days of data) [2025-10-23T20:00:36.050276] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-23T20:00:36.097283] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:00:36.212488] [DEBUG] [LOCAL ] ATI: Primary data saved (51668 records). [2025-10-23T20:00:36.212692] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-23T20:00:36.212914] [INFO ] [MAIN ] Update Progress: 170/2367 symbols completed. ATI took 41.4s. Estimated remaining: 4h 25m 22s. Rate: 8.3 symbols/min [2025-10-23T20:00:36.398709] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:36.432859] [DEBUG] [LOCAL ] ATR: Loaded 30392 existing records from primary storage. [2025-10-23T20:00:36.433171] [INFO ] [MAIN ] ATR: Loaded 30392 existing records. [2025-10-23T20:00:36.616084] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:36.616292] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-23T20:00:36.616341] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-23T20:00:36.616571] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-23T20:00:36.616633] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-23T20:00:36.674530] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T20:00:36.806792] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-23T20:00:37.018271] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:37.402462] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T20:00:37.599418] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-23T20:00:38.400131] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-23T20:00:38.407526] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T20:00:39.125725] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T20:00:39.134594] [INFO ] [REMOTE ] ATMU: Full fetch complete (56866 records). [2025-10-23T20:00:39.134779] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-23T20:00:39.204700] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-23T20:00:39.525180] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T20:00:39.571385] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-23T20:00:39.571481] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-23T20:00:39.572125] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-23T20:00:39.572200] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-23T20:00:39.573338] [DEBUG] [LOCAL ] ATMU: Trimmed 56866 records to 38930 (keeping 200 days of data) [2025-10-23T20:00:39.807741] [DEBUG] [LOCAL ] ATMU: Primary data saved (38930 records). [2025-10-23T20:00:39.807943] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-23T20:00:39.809183] [INFO ] [MAIN ] Update Progress: 171/2367 symbols completed. ATMU took 25.6s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-10-23T20:00:39.980514] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:40.003537] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-23T20:00:40.005067] [DEBUG] [LOCAL ] ATS: Loaded 17012 existing records from primary storage. [2025-10-23T20:00:40.005326] [INFO ] [MAIN ] ATS: Loaded 17012 existing records. [2025-10-23T20:00:40.200773] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:40.200979] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-23T20:00:40.201026] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-23T20:00:40.201191] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-23T20:00:40.201233] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-23T20:00:40.549076] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T20:00:40.606093] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:40.799478] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-23T20:00:41.599419] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-23T20:00:41.813453] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T20:00:41.820379] [INFO ] [REMOTE ] ATKR: Full fetch complete (53132 records). [2025-10-23T20:00:41.820606] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-23T20:00:42.203688] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-23T20:00:42.203792] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-23T20:00:42.204412] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-23T20:00:42.204455] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-23T20:00:42.205585] [DEBUG] [LOCAL ] ATKR: Trimmed 53132 records to 35023 (keeping 200 days of data) [2025-10-23T20:00:42.361630] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T20:00:42.431254] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-23T20:00:42.484743] [DEBUG] [LOCAL ] ATKR: Primary data saved (35023 records). [2025-10-23T20:00:42.484915] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-23T20:00:42.485017] [INFO ] [MAIN ] Update Progress: 172/2367 symbols completed. ATKR took 36.6s. Estimated remaining: 4h 23m 23s. Rate: 8.3 symbols/min [2025-10-23T20:00:42.637503] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T20:00:42.715699] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:42.766380] [DEBUG] [LOCAL ] ATUS: Loaded 49957 existing records from primary storage. [2025-10-23T20:00:42.766816] [INFO ] [MAIN ] ATUS: Loaded 49957 existing records. [2025-10-23T20:00:43.019612] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:43.019868] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-23T20:00:43.019931] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-23T20:00:43.020119] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-23T20:00:43.020169] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-23T20:00:43.201667] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-23T20:00:43.431887] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:43.997044] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:00:44.003410] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-23T20:00:44.271500] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T20:00:44.799408] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-23T20:00:45.605257] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-23T20:00:45.607559] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T20:00:45.663205] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T20:00:46.399407] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-23T20:00:47.199396] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-23T20:00:47.458896] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:00:47.465577] [INFO ] [REMOTE ] ATO: Full fetch complete (60660 records). [2025-10-23T20:00:47.465712] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-23T20:00:47.852394] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-23T20:00:47.852489] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-23T20:00:47.853138] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-23T20:00:47.853209] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-23T20:00:47.854336] [DEBUG] [LOCAL ] ATO: Trimmed 60660 records to 41787 (keeping 200 days of data) [2025-10-23T20:00:48.034491] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-23T20:00:48.141245] [DEBUG] [LOCAL ] ATO: Primary data saved (41787 records). [2025-10-23T20:00:48.141383] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-23T20:00:48.141465] [INFO ] [MAIN ] Update Progress: 173/2367 symbols completed. ATO took 31.8s. Estimated remaining: 4h 22m 56s. Rate: 8.3 symbols/min [2025-10-23T20:00:48.174270] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T20:00:48.302031] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T20:00:48.391043] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:00:48.444063] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-23T20:00:48.444409] [INFO ] [MAIN ] AU: Loaded 53089 existing records. [2025-10-23T20:00:48.637138] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:00:48.637347] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-23T20:00:48.637394] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-23T20:00:48.637612] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-23T20:00:48.637708] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-23T20:00:48.804508] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-23T20:00:49.082802] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:00:49.455489] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T20:00:49.599424] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-23T20:00:50.399421] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-23T20:00:50.517779] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T20:00:50.681703] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T20:00:51.199422] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-23T20:00:51.999416] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-23T20:00:52.275740] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T20:00:52.366812] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T20:00:52.799440] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-23T20:00:53.363204] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T20:00:53.599440] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-23T20:00:54.354032] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T20:00:54.399412] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-23T20:00:55.199411] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-23T20:00:55.491525] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T20:00:55.800931] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T20:00:55.999412] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-23T20:00:56.799430] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-23T20:00:57.013568] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T20:00:57.299216] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T20:00:57.599423] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-23T20:00:57.864124] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T20:00:58.399418] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-23T20:00:58.952097] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T20:00:59.199430] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-23T20:00:59.493686] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T20:00:59.999407] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-23T20:01:00.799398] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-23T20:01:01.126738] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T20:01:01.592499] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-23T20:01:01.603582] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-23T20:01:02.399428] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-23T20:01:02.628778] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T20:01:03.199416] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-23T20:01:03.565612] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T20:01:03.999457] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-23T20:01:04.089254] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T20:01:04.399387] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T20:01:04.799429] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-23T20:01:05.599415] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-23T20:01:05.726982] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T20:01:06.133252] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T20:01:06.138490] [INFO ] [REMOTE ] ATR: Full fetch complete (43971 records). [2025-10-23T20:01:06.138622] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-23T20:01:06.408726] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-23T20:01:06.556958] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-23T20:01:06.557043] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-23T20:01:06.557571] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-23T20:01:06.557616] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-23T20:01:06.558596] [DEBUG] [LOCAL ] ATR: Trimmed 43971 records to 30587 (keeping 200 days of data) [2025-10-23T20:01:06.744844] [DEBUG] [LOCAL ] ATR: Primary data saved (30587 records). [2025-10-23T20:01:06.745010] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-23T20:01:06.745241] [INFO ] [MAIN ] Update Progress: 174/2367 symbols completed. ATR took 30.5s. Estimated remaining: 4h 25m 12s. Rate: 8.3 symbols/min [2025-10-23T20:01:06.920818] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:06.972339] [DEBUG] [LOCAL ] AUB: Loaded 45843 existing records from primary storage. [2025-10-23T20:01:06.972707] [INFO ] [MAIN ] AUB: Loaded 45843 existing records. [2025-10-23T20:01:07.157820] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:07.158106] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-23T20:01:07.158186] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-23T20:01:07.158477] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-23T20:01:07.158540] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-23T20:01:07.229948] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-23T20:01:07.580837] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:07.980432] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-23T20:01:07.999392] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-23T20:01:08.173374] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T20:01:08.176630] [INFO ] [REMOTE ] ATS: Full fetch complete (25458 records). [2025-10-23T20:01:08.176844] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-23T20:01:08.274496] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:01:08.673970] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-23T20:01:08.674153] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-23T20:01:08.674832] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-23T20:01:08.674911] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-23T20:01:08.675837] [DEBUG] [LOCAL ] ATS: Trimmed 25458 records to 17109 (keeping 200 days of data) [2025-10-23T20:01:08.786291] [DEBUG] [LOCAL ] ATS: Primary data saved (17109 records). [2025-10-23T20:01:08.786545] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-23T20:01:08.786699] [INFO ] [MAIN ] Update Progress: 175/2367 symbols completed. ATS took 29.0s. Estimated remaining: 4h 23m 60s. Rate: 8.3 symbols/min [2025-10-23T20:01:08.801368] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-23T20:01:08.988595] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:08.999546] [DEBUG] [LOCAL ] AUNA: Loaded 5250 existing records from primary storage. [2025-10-23T20:01:08.999943] [INFO ] [MAIN ] AUNA: Loaded 5250 existing records. [2025-10-23T20:01:09.196632] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:09.196943] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-23T20:01:09.197000] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-23T20:01:09.197171] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-23T20:01:09.197215] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-23T20:01:09.600918] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-23T20:01:09.607151] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:09.955035] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T20:01:10.399435] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-23T20:01:10.679915] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T20:01:11.168118] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T20:01:11.199404] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-23T20:01:11.999420] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-23T20:01:12.627232] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T20:01:12.668985] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-23T20:01:12.799431] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-23T20:01:13.450800] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T20:01:13.462370] [INFO ] [REMOTE ] ATUS: Full fetch complete (71469 records). [2025-10-23T20:01:13.462530] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-23T20:01:13.604709] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-23T20:01:13.870322] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T20:01:13.923917] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-23T20:01:13.924095] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-23T20:01:13.925178] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-23T20:01:13.925273] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-23T20:01:13.926742] [DEBUG] [LOCAL ] ATUS: Trimmed 71469 records to 50328 (keeping 200 days of data) [2025-10-23T20:01:14.235509] [DEBUG] [LOCAL ] ATUS: Primary data saved (50328 records). [2025-10-23T20:01:14.235721] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-23T20:01:14.235829] [INFO ] [MAIN ] Update Progress: 176/2367 symbols completed. ATUS took 31.8s. Estimated remaining: 4h 23m 31s. Rate: 8.3 symbols/min [2025-10-23T20:01:14.410622] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-23T20:01:14.454616] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:14.497121] [DEBUG] [LOCAL ] AVA: Loaded 38305 existing records from primary storage. [2025-10-23T20:01:14.497479] [INFO ] [MAIN ] AVA: Loaded 38305 existing records. [2025-10-23T20:01:14.671082] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:14.671277] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-23T20:01:14.671332] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-23T20:01:14.671518] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-23T20:01:14.671564] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-23T20:01:15.031522] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:15.199398] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-23T20:01:15.701912] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:01:16.004523] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-23T20:01:16.025360] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T20:01:16.665623] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T20:01:16.799430] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-23T20:01:17.599405] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-23T20:01:18.125028] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-23T20:01:18.193728] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T20:01:18.399431] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-23T20:01:19.024074] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:01:19.199444] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-23T20:01:19.962897] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:01:19.999402] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-23T20:01:20.799433] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-23T20:01:21.555637] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-23T20:01:21.564840] [INFO ] [REMOTE ] AU: Full fetch complete (76651 records). [2025-10-23T20:01:21.564986] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-23T20:01:21.625570] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-23T20:01:21.647823] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:01:22.008186] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T20:01:22.078707] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-23T20:01:22.078843] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-23T20:01:22.079800] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-23T20:01:22.079884] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-23T20:01:22.081460] [DEBUG] [LOCAL ] AU: Trimmed 76651 records to 53478 (keeping 200 days of data) [2025-10-23T20:01:22.267924] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T20:01:22.400443] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-23T20:01:22.408424] [DEBUG] [LOCAL ] AU: Primary data saved (53478 records). [2025-10-23T20:01:22.408635] [INFO ] [MAIN ] AU: Full history saved. [2025-10-23T20:01:22.408840] [INFO ] [MAIN ] Update Progress: 177/2367 symbols completed. AU took 34.3s. Estimated remaining: 4h 23m 35s. Rate: 8.3 symbols/min [2025-10-23T20:01:22.583718] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:22.598149] [DEBUG] [LOCAL ] AVAL: Loaded 8482 existing records from primary storage. [2025-10-23T20:01:22.598520] [INFO ] [MAIN ] AVAL: Loaded 8482 existing records. [2025-10-23T20:01:22.776280] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:22.776513] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-23T20:01:22.776600] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-23T20:01:22.776862] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-23T20:01:22.776943] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-23T20:01:23.137662] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:23.199404] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-23T20:01:23.884519] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T20:01:23.999498] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-23T20:01:24.095463] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-23T20:01:24.799423] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-23T20:01:25.393412] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T20:01:25.599438] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-23T20:01:25.697441] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:01:26.399441] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-23T20:01:26.535766] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T20:01:26.734325] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T20:01:27.199446] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-23T20:01:27.999441] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-23T20:01:28.805742] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-23T20:01:28.827974] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T20:01:28.932363] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T20:01:29.599432] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-23T20:01:30.160553] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T20:01:30.386847] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:01:30.399385] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-23T20:01:31.129421] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T20:01:31.199413] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-23T20:01:31.999430] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-23T20:01:32.104397] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-23T20:01:32.574820] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T20:01:32.799455] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-23T20:01:33.599475] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-23T20:01:34.385321] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T20:01:34.399394] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-23T20:01:35.007013] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T20:01:35.025233] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T20:01:35.199469] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-23T20:01:35.999418] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-23T20:01:36.573023] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T20:01:36.799401] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-23T20:01:37.293583] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-23T20:01:37.305142] [INFO ] [REMOTE ] AUB: Full fetch complete (66467 records). [2025-10-23T20:01:37.305300] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-23T20:01:37.600786] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-23T20:01:37.608979] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T20:01:37.754018] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-23T20:01:37.754104] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-23T20:01:37.754870] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-23T20:01:37.754944] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-23T20:01:37.756444] [DEBUG] [LOCAL ] AUB: Trimmed 66467 records to 46182 (keeping 200 days of data) [2025-10-23T20:01:38.025400] [DEBUG] [LOCAL ] AUB: Primary data saved (46182 records). [2025-10-23T20:01:38.025551] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-23T20:01:38.026981] [INFO ] [MAIN ] Update Progress: 178/2367 symbols completed. AUB took 31.3s. Estimated remaining: 4h 25m 11s. Rate: 8.3 symbols/min [2025-10-23T20:01:38.198361] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:38.248826] [DEBUG] [LOCAL ] AVB: Loaded 42169 existing records from primary storage. [2025-10-23T20:01:38.249149] [INFO ] [MAIN ] AVB: Loaded 42169 existing records. [2025-10-23T20:01:38.399936] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-23T20:01:38.433609] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:38.433816] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-23T20:01:38.433866] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-23T20:01:38.434092] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-23T20:01:38.434134] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-23T20:01:38.836888] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:39.186667] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T20:01:39.199533] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-23T20:01:39.207573] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T20:01:39.999419] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-23T20:01:40.561215] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T20:01:40.720182] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T20:01:40.799413] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-23T20:01:41.494253] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T20:01:41.599424] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-23T20:01:42.399437] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-23T20:01:43.044291] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T20:01:43.199428] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-23T20:01:43.279714] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T20:01:43.999401] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-23T20:01:44.090739] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T20:01:44.093904] [INFO ] [REMOTE ] AVAL: Full fetch complete (15064 records). [2025-10-23T20:01:44.093989] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-23T20:01:44.459381] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-23T20:01:44.459481] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-23T20:01:44.459791] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-23T20:01:44.459939] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-23T20:01:44.460461] [DEBUG] [LOCAL ] AVAL: Trimmed 15064 records to 8525 (keeping 200 days of data) [2025-10-23T20:01:44.509682] [DEBUG] [LOCAL ] AVAL: Primary data saved (8525 records). [2025-10-23T20:01:44.509846] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-23T20:01:44.509952] [INFO ] [MAIN ] Update Progress: 179/2367 symbols completed. AVAL took 22.1s. Estimated remaining: 4h 24m 54s. Rate: 8.3 symbols/min [2025-10-23T20:01:44.685678] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:44.686074] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-23T20:01:44.686133] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-23T20:01:44.686209] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-23T20:01:44.686268] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-23T20:01:44.686314] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-23T20:01:44.686350] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-23T20:01:44.791198] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T20:01:44.801583] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-23T20:01:44.801493] [INFO ] [REMOTE ] AUNA: Full fetch complete (7831 records). [2025-10-23T20:01:44.826278] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-23T20:01:45.328821] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:45.427612] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-23T20:01:45.427750] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-23T20:01:45.427974] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-23T20:01:45.428017] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-23T20:01:45.428486] [DEBUG] [LOCAL ] AUNA: Trimmed 7831 records to 5285 (keeping 200 days of data) [2025-10-23T20:01:45.458167] [DEBUG] [LOCAL ] AUNA: Primary data saved (5285 records). [2025-10-23T20:01:45.458326] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-23T20:01:45.458411] [INFO ] [MAIN ] Update Progress: 180/2367 symbols completed. AUNA took 36.7s. Estimated remaining: 4h 23m 30s. Rate: 8.3 symbols/min [2025-10-23T20:01:45.601780] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-23T20:01:45.628763] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:45.656599] [DEBUG] [LOCAL ] AVD: Loaded 21323 existing records from primary storage. [2025-10-23T20:01:45.656981] [INFO ] [MAIN ] AVD: Loaded 21323 existing records. [2025-10-23T20:01:45.825620] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:01:45.825998] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-23T20:01:45.826073] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:01:45.826115] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-23T20:01:45.826151] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:01:45.826187] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-23T20:01:45.826245] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-23T20:01:45.826286] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-23T20:01:45.826331] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-23T20:01:45.826382] [INFO ] [MAIN ] Update Progress: 181/2367 symbols completed. AVBC took 1.3s. Estimated remaining: 4h 22m 0s. Rate: 8.3 symbols/min [2025-10-23T20:01:45.865378] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:45.869980] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-23T20:01:45.870043] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-23T20:01:45.870294] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-23T20:01:45.870365] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-23T20:01:46.145463] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:46.295081] [DEBUG] [LOCAL ] AVK: Loaded 18618 existing records from primary storage. [2025-10-23T20:01:46.299308] [INFO ] [MAIN ] AVK: Loaded 18618 existing records. [2025-10-23T20:01:46.296330] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T20:01:46.400776] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-23T20:01:46.693775] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:46.714833] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:46.715014] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-23T20:01:46.715063] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-23T20:01:46.715329] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-23T20:01:46.715390] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-23T20:01:47.091952] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:47.199432] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-23T20:01:47.999696] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-23T20:01:48.038459] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T20:01:48.725092] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T20:01:48.734147] [INFO ] [REMOTE ] AVA: Full fetch complete (55474 records). [2025-10-23T20:01:48.734329] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-23T20:01:48.812985] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-23T20:01:49.174071] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-23T20:01:49.174351] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-23T20:01:49.175155] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-23T20:01:49.175294] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-23T20:01:49.176670] [DEBUG] [LOCAL ] AVA: Trimmed 55474 records to 38535 (keeping 200 days of data) [2025-10-23T20:01:49.283295] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T20:01:49.423713] [DEBUG] [LOCAL ] AVA: Primary data saved (38535 records). [2025-10-23T20:01:49.424048] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-23T20:01:49.424217] [INFO ] [MAIN ] Update Progress: 182/2367 symbols completed. AVA took 35.2s. Estimated remaining: 4h 21m 10s. Rate: 8.4 symbols/min [2025-10-23T20:01:49.596981] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:01:49.599390] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-23T20:01:49.635063] [DEBUG] [LOCAL ] AVNS: Loaded 33534 existing records from primary storage. [2025-10-23T20:01:49.635368] [INFO ] [MAIN ] AVNS: Loaded 33534 existing records. [2025-10-23T20:01:49.823692] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:01:49.823915] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-23T20:01:49.823968] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-23T20:01:49.824175] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-23T20:01:49.824241] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-23T20:01:50.234035] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:01:50.392782] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T20:01:50.400215] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-23T20:01:50.469380] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T20:01:51.199423] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-23T20:01:51.474961] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T20:01:51.999434] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-23T20:01:52.799421] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-23T20:01:52.918488] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T20:01:53.383873] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T20:01:53.599428] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-23T20:01:54.032757] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-23T20:01:54.399411] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-23T20:01:54.420996] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T20:01:55.199486] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-23T20:01:55.541689] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T20:01:55.999839] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-23T20:01:56.241689] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T20:01:56.799414] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-23T20:01:57.545847] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T20:01:57.599393] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-23T20:01:58.399427] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-23T20:01:58.497590] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T20:01:58.626309] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T20:01:59.199424] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-23T20:01:59.847983] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T20:01:59.929987] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T20:01:59.999387] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-23T20:02:00.799419] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-23T20:02:01.402319] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T20:02:01.599453] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-23T20:02:02.399433] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-23T20:02:03.077092] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-23T20:02:03.199418] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-23T20:02:03.361369] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T20:02:03.382917] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:02:03.999444] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-23T20:02:04.764090] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T20:02:04.799409] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-23T20:02:04.818266] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T20:02:05.599404] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-23T20:02:06.161350] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T20:02:06.399413] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-23T20:02:06.748720] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T20:02:07.111998] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T20:02:07.199413] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-23T20:02:07.999401] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-23T20:02:08.360737] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T20:02:08.799461] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-23T20:02:09.336893] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T20:02:09.599416] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-23T20:02:09.993874] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T20:02:10.399448] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-23T20:02:10.630864] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T20:02:11.199425] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-23T20:02:11.678222] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T20:02:11.999410] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-23T20:02:12.421336] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T20:02:12.799424] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-23T20:02:13.586469] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T20:02:13.599381] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-23T20:02:14.010381] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T20:02:14.015525] [INFO ] [REMOTE ] AVK: Full fetch complete (26679 records). [2025-10-23T20:02:14.015675] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-23T20:02:14.391192] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-23T20:02:14.391285] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-23T20:02:14.391683] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-23T20:02:14.391755] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-23T20:02:14.392376] [DEBUG] [LOCAL ] AVK: Trimmed 26679 records to 18738 (keeping 200 days of data) [2025-10-23T20:02:14.439716] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-23T20:02:14.511172] [DEBUG] [LOCAL ] AVK: Primary data saved (18738 records). [2025-10-23T20:02:14.511322] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-23T20:02:14.511403] [INFO ] [MAIN ] Update Progress: 183/2367 symbols completed. AVK took 28.7s. Estimated remaining: 4h 24m 37s. Rate: 8.3 symbols/min [2025-10-23T20:02:14.684565] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:14.729017] [DEBUG] [LOCAL ] AVNT: Loaded 38618 existing records from primary storage. [2025-10-23T20:02:14.729302] [INFO ] [MAIN ] AVNT: Loaded 38618 existing records. [2025-10-23T20:02:14.903945] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:14.904135] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-23T20:02:14.904181] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-23T20:02:14.904524] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-23T20:02:14.904567] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-23T20:02:15.204542] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-23T20:02:15.280588] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:15.411427] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T20:02:15.577292] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:02:15.584321] [INFO ] [REMOTE ] AVB: Full fetch complete (59422 records). [2025-10-23T20:02:15.584440] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-23T20:02:15.959612] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-23T20:02:15.959743] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-23T20:02:15.960373] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-23T20:02:15.960416] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-23T20:02:15.961597] [DEBUG] [LOCAL ] AVB: Trimmed 59422 records to 42433 (keeping 200 days of data) [2025-10-23T20:02:16.020286] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-23T20:02:16.235829] [DEBUG] [LOCAL ] AVB: Primary data saved (42433 records). [2025-10-23T20:02:16.235972] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-23T20:02:16.236051] [INFO ] [MAIN ] Update Progress: 184/2367 symbols completed. AVB took 38.2s. Estimated remaining: 4h 23m 24s. Rate: 8.3 symbols/min [2025-10-23T20:02:16.414107] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:16.466556] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-23T20:02:16.466960] [INFO ] [MAIN ] AVTR: Loaded 53571 existing records. [2025-10-23T20:02:16.654237] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:16.654452] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-23T20:02:16.654501] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-23T20:02:16.654798] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-23T20:02:16.654862] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-23T20:02:16.759344] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T20:02:16.800035] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-23T20:02:17.081927] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:17.303952] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T20:02:17.307205] [INFO ] [REMOTE ] AVD: Full fetch complete (32522 records). [2025-10-23T20:02:17.307362] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-23T20:02:17.604506] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-23T20:02:17.712563] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-23T20:02:17.712712] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-23T20:02:17.713301] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-23T20:02:17.713380] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-23T20:02:17.714392] [DEBUG] [LOCAL ] AVD: Trimmed 32522 records to 21435 (keeping 200 days of data) [2025-10-23T20:02:17.850796] [DEBUG] [LOCAL ] AVD: Primary data saved (21435 records). [2025-10-23T20:02:17.850990] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-23T20:02:17.851090] [INFO ] [MAIN ] Update Progress: 185/2367 symbols completed. AVD took 32.4s. Estimated remaining: 4h 22m 10s. Rate: 8.3 symbols/min [2025-10-23T20:02:18.074551] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T20:02:18.126348] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:18.179119] [DEBUG] [LOCAL ] AVY: Loaded 38119 existing records from primary storage. [2025-10-23T20:02:18.179484] [INFO ] [MAIN ] AVY: Loaded 38119 existing records. [2025-10-23T20:02:18.359489] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:18.359939] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-23T20:02:18.360003] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-23T20:02:18.360234] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-23T20:02:18.360296] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-23T20:02:18.404774] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-23T20:02:18.810995] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:18.989213] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T20:02:19.199419] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-23T20:02:19.847864] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T20:02:19.856959] [INFO ] [REMOTE ] AVNS: Full fetch complete (48379 records). [2025-10-23T20:02:19.857119] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-23T20:02:20.004694] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-23T20:02:20.269859] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-23T20:02:20.269956] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-23T20:02:20.270507] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-23T20:02:20.270549] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-23T20:02:20.271494] [DEBUG] [LOCAL ] AVNS: Trimmed 48379 records to 33758 (keeping 200 days of data) [2025-10-23T20:02:20.468395] [DEBUG] [LOCAL ] AVNS: Primary data saved (33758 records). [2025-10-23T20:02:20.468537] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-23T20:02:20.468616] [INFO ] [MAIN ] Update Progress: 186/2367 symbols completed. AVNS took 31.0s. Estimated remaining: 4h 21m 9s. Rate: 8.4 symbols/min [2025-10-23T20:02:20.663146] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:20.686563] [DEBUG] [LOCAL ] AWF: Loaded 24048 existing records from primary storage. [2025-10-23T20:02:20.686857] [INFO ] [MAIN ] AWF: Loaded 24048 existing records. [2025-10-23T20:02:20.799395] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-23T20:02:20.910784] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:20.914317] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-23T20:02:20.914387] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-23T20:02:20.914715] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-23T20:02:20.914849] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-23T20:02:20.933573] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T20:02:21.307117] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:21.609686] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-23T20:02:21.632828] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T20:02:21.733538] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T20:02:22.399408] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-23T20:02:23.102353] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T20:02:23.199403] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-23T20:02:23.696913] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-23T20:02:23.999422] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-23T20:02:24.799394] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-23T20:02:24.929048] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T20:02:25.535207] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T20:02:25.599446] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-23T20:02:25.989604] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T20:02:26.381968] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T20:02:26.399385] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-23T20:02:27.199433] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-23T20:02:27.604899] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T20:02:27.999417] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-23T20:02:28.799394] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-23T20:02:28.994408] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T20:02:29.599397] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-23T20:02:29.883784] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T20:02:29.915742] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T20:02:30.399418] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-23T20:02:31.016469] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T20:02:31.199406] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-23T20:02:31.875882] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T20:02:31.999404] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-23T20:02:32.505596] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T20:02:32.799430] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-23T20:02:33.599420] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-23T20:02:33.731623] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T20:02:33.862919] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T20:02:34.399427] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-23T20:02:34.590232] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T20:02:35.199411] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-23T20:02:35.903225] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T20:02:35.999410] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-23T20:02:36.683435] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T20:02:36.799405] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-23T20:02:37.492436] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T20:02:37.599407] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-23T20:02:38.047154] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T20:02:38.399414] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-23T20:02:39.059088] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T20:02:39.199484] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-23T20:02:39.445136] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T20:02:39.999444] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-23T20:02:40.799435] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-23T20:02:41.037308] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T20:02:41.554541] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T20:02:41.599388] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-23T20:02:42.404562] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-23T20:02:42.414619] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T20:02:42.421029] [INFO ] [REMOTE ] AVNT: Full fetch complete (56034 records). [2025-10-23T20:02:42.421140] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-23T20:02:42.801429] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-23T20:02:42.801537] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-23T20:02:42.802158] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-23T20:02:42.802230] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-23T20:02:42.803295] [DEBUG] [LOCAL ] AVNT: Trimmed 56034 records to 38855 (keeping 200 days of data) [2025-10-23T20:02:43.035688] [DEBUG] [LOCAL ] AVNT: Primary data saved (38855 records). [2025-10-23T20:02:43.035864] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-23T20:02:43.035967] [INFO ] [MAIN ] Update Progress: 187/2367 symbols completed. AVNT took 28.5s. Estimated remaining: 4h 24m 1s. Rate: 8.3 symbols/min [2025-10-23T20:02:43.203135] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-23T20:02:43.215682] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:43.240259] [DEBUG] [LOCAL ] AWI: Loaded 25139 existing records from primary storage. [2025-10-23T20:02:43.240548] [INFO ] [MAIN ] AWI: Loaded 25139 existing records. [2025-10-23T20:02:43.388663] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T20:02:43.488041] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:43.488305] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-23T20:02:43.488357] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-23T20:02:43.488746] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-23T20:02:43.488828] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-23T20:02:43.933370] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:43.999413] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-23T20:02:44.194096] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T20:02:44.201884] [INFO ] [REMOTE ] AVY: Full fetch complete (56737 records). [2025-10-23T20:02:44.202076] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-23T20:02:44.327690] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T20:02:44.644142] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-23T20:02:44.644258] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-23T20:02:44.644983] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-23T20:02:44.645064] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-23T20:02:44.646385] [DEBUG] [LOCAL ] AVY: Trimmed 56737 records to 38485 (keeping 200 days of data) [2025-10-23T20:02:44.824364] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-23T20:02:44.902145] [DEBUG] [LOCAL ] AVY: Primary data saved (38485 records). [2025-10-23T20:02:44.902322] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-23T20:02:44.903512] [INFO ] [MAIN ] Update Progress: 188/2367 symbols completed. AVY took 27.1s. Estimated remaining: 4h 22m 51s. Rate: 8.3 symbols/min [2025-10-23T20:02:45.077724] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:45.126588] [DEBUG] [LOCAL ] AWK: Loaded 48388 existing records from primary storage. [2025-10-23T20:02:45.126971] [INFO ] [MAIN ] AWK: Loaded 48388 existing records. [2025-10-23T20:02:45.308153] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:45.308379] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-23T20:02:45.308438] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-23T20:02:45.309191] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-23T20:02:45.309271] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-23T20:02:45.535519] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T20:02:45.593195] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T20:02:45.599404] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-23T20:02:45.788126] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:46.399438] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-23T20:02:47.021315] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T20:02:47.199437] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-23T20:02:47.999401] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-23T20:02:48.047418] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T20:02:48.328481] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T20:02:48.799409] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-23T20:02:49.094833] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T20:02:49.599422] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-23T20:02:50.399587] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-23T20:02:50.575493] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:02:50.771475] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T20:02:51.199409] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-23T20:02:51.536526] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T20:02:51.999420] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-23T20:02:52.799426] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-23T20:02:53.021037] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T20:02:53.033294] [INFO ] [REMOTE ] AVTR: Full fetch complete (77670 records). [2025-10-23T20:02:53.033437] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-23T20:02:53.440461] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-23T20:02:53.440561] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-23T20:02:53.441375] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-23T20:02:53.441449] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-23T20:02:53.442869] [DEBUG] [LOCAL ] AVTR: Trimmed 77670 records to 53961 (keeping 200 days of data) [2025-10-23T20:02:53.620699] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-23T20:02:53.746967] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T20:02:53.806296] [DEBUG] [LOCAL ] AVTR: Primary data saved (53961 records). [2025-10-23T20:02:53.806442] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-23T20:02:53.806522] [INFO ] [MAIN ] Update Progress: 189/2367 symbols completed. AVTR took 37.6s. Estimated remaining: 4h 23m 3s. Rate: 8.3 symbols/min [2025-10-23T20:02:53.976304] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:53.997574] [DEBUG] [LOCAL ] AWP: Loaded 21587 existing records from primary storage. [2025-10-23T20:02:53.998003] [INFO ] [MAIN ] AWP: Loaded 21587 existing records. [2025-10-23T20:02:54.108372] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T20:02:54.201107] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:54.201476] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-23T20:02:54.201611] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-23T20:02:54.201908] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-23T20:02:54.202039] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-23T20:02:54.400943] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-23T20:02:54.573537] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:55.090344] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T20:02:55.199396] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-23T20:02:55.999414] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-23T20:02:56.215429] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T20:02:56.331832] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T20:02:56.799409] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-23T20:02:57.290939] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T20:02:57.297689] [INFO ] [REMOTE ] AWF: Full fetch complete (36058 records). [2025-10-23T20:02:57.297779] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-23T20:02:57.604482] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-23T20:02:57.683776] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-23T20:02:57.683863] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-23T20:02:57.684308] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-23T20:02:57.684350] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-23T20:02:57.685116] [DEBUG] [LOCAL ] AWF: Trimmed 36058 records to 24216 (keeping 200 days of data) [2025-10-23T20:02:57.822592] [DEBUG] [LOCAL ] AWF: Primary data saved (24216 records). [2025-10-23T20:02:57.822768] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-23T20:02:57.822859] [INFO ] [MAIN ] Update Progress: 190/2367 symbols completed. AWF took 37.4s. Estimated remaining: 4h 22m 19s. Rate: 8.3 symbols/min [2025-10-23T20:02:57.990913] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:02:58.017196] [DEBUG] [LOCAL ] AWR: Loaded 22661 existing records from primary storage. [2025-10-23T20:02:58.017444] [INFO ] [MAIN ] AWR: Loaded 22661 existing records. [2025-10-23T20:02:58.201456] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:02:58.201661] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-23T20:02:58.201731] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-23T20:02:58.201904] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-23T20:02:58.201952] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-23T20:02:58.405107] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-23T20:02:58.626985] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:02:58.650350] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T20:02:58.671825] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T20:02:59.199427] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-23T20:02:59.655206] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T20:02:59.999402] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-23T20:03:00.314878] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T20:03:00.799408] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-23T20:03:01.599412] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-23T20:03:02.128374] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T20:03:02.354387] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-23T20:03:02.399418] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-23T20:03:02.621141] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T20:03:03.199427] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-23T20:03:03.803506] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T20:03:03.999420] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-23T20:03:04.490568] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T20:03:04.799423] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-23T20:03:05.587464] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T20:03:05.606326] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-23T20:03:05.591560] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T20:03:06.399422] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-23T20:03:06.498979] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T20:03:07.199419] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-23T20:03:07.999409] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-23T20:03:08.180291] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:03:08.506282] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T20:03:08.788260] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T20:03:08.799387] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-23T20:03:09.599409] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-23T20:03:09.835946] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T20:03:10.399411] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-23T20:03:10.746877] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T20:03:11.199454] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-23T20:03:11.448788] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T20:03:11.999410] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-23T20:03:12.495904] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T20:03:12.500438] [INFO ] [REMOTE ] AWI: Full fetch complete (36065 records). [2025-10-23T20:03:12.500591] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-23T20:03:12.780406] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T20:03:12.804511] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-23T20:03:12.914449] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-23T20:03:12.914569] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-23T20:03:12.915123] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-23T20:03:12.915196] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-23T20:03:12.916028] [DEBUG] [LOCAL ] AWI: Trimmed 36065 records to 25291 (keeping 200 days of data) [2025-10-23T20:03:13.070174] [DEBUG] [LOCAL ] AWI: Primary data saved (25291 records). [2025-10-23T20:03:13.070338] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-23T20:03:13.070471] [INFO ] [MAIN ] Update Progress: 191/2367 symbols completed. AWI took 30.0s. Estimated remaining: 4h 23m 43s. Rate: 8.3 symbols/min [2025-10-23T20:03:13.245684] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:03:13.275119] [DEBUG] [LOCAL ] AX: Loaded 27804 existing records from primary storage. [2025-10-23T20:03:13.275426] [INFO ] [MAIN ] AX: Loaded 27804 existing records. [2025-10-23T20:03:13.453988] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:03:13.454199] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-23T20:03:13.454250] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-23T20:03:13.454425] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-23T20:03:13.454470] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-23T20:03:13.604702] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-23T20:03:13.864948] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:03:14.399417] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-23T20:03:14.718285] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T20:03:14.817252] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T20:03:15.199408] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-23T20:03:15.605363] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T20:03:15.999406] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-23T20:03:16.371290] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T20:03:16.799391] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-23T20:03:16.943744] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T20:03:16.947386] [INFO ] [REMOTE ] AWP: Full fetch complete (31660 records). [2025-10-23T20:03:16.947536] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-23T20:03:17.333938] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-23T20:03:17.334036] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-23T20:03:17.334445] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-23T20:03:17.334486] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-23T20:03:17.335211] [DEBUG] [LOCAL ] AWP: Trimmed 31660 records to 21729 (keeping 200 days of data) [2025-10-23T20:03:17.454490] [DEBUG] [LOCAL ] AWP: Primary data saved (21729 records). [2025-10-23T20:03:17.454633] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-23T20:03:17.454765] [INFO ] [MAIN ] Update Progress: 192/2367 symbols completed. AWP took 23.6s. Estimated remaining: 4h 23m 3s. Rate: 8.3 symbols/min [2025-10-23T20:03:17.607254] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-23T20:03:17.645475] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:03:17.696912] [DEBUG] [LOCAL ] AXL: Loaded 50533 existing records from primary storage. [2025-10-23T20:03:17.697250] [INFO ] [MAIN ] AXL: Loaded 50533 existing records. [2025-10-23T20:03:17.879382] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:03:17.880724] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-23T20:03:17.880795] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-23T20:03:17.881569] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-23T20:03:17.881630] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-23T20:03:18.249278] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:03:18.399393] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-23T20:03:18.513734] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T20:03:18.742288] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T20:03:19.199418] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-23T20:03:19.999774] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T20:03:20.006526] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-23T20:03:20.199733] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-23T20:03:20.799419] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-23T20:03:21.599409] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-23T20:03:21.907791] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:03:21.916282] [INFO ] [REMOTE ] AWK: Full fetch complete (70886 records). [2025-10-23T20:03:21.916499] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-23T20:03:22.035349] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T20:03:22.340432] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T20:03:22.387761] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-23T20:03:22.387854] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-23T20:03:22.388636] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-23T20:03:22.388733] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-23T20:03:22.390163] [DEBUG] [LOCAL ] AWK: Trimmed 70886 records to 48705 (keeping 200 days of data) [2025-10-23T20:03:22.446414] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-23T20:03:22.706775] [DEBUG] [LOCAL ] AWK: Primary data saved (48705 records). [2025-10-23T20:03:22.706945] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-23T20:03:22.708133] [INFO ] [MAIN ] Update Progress: 193/2367 symbols completed. AWK took 37.8s. Estimated remaining: 4h 22m 33s. Rate: 8.3 symbols/min [2025-10-23T20:03:22.905214] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:03:22.958459] [DEBUG] [LOCAL ] AXP: Loaded 53162 existing records from primary storage. [2025-10-23T20:03:22.958836] [INFO ] [MAIN ] AXP: Loaded 53162 existing records. [2025-10-23T20:03:23.134633] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:03:23.134868] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-23T20:03:23.134925] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-23T20:03:23.135582] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-23T20:03:23.135678] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-23T20:03:23.204526] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-23T20:03:23.499953] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:03:24.004508] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-23T20:03:24.020728] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:03:24.148967] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T20:03:24.799447] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-23T20:03:25.184103] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T20:03:25.599434] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-23T20:03:26.399412] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-23T20:03:26.795085] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T20:03:26.804121] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T20:03:27.199432] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-23T20:03:27.486876] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T20:03:27.999792] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-23T20:03:28.001894] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T20:03:28.799450] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-23T20:03:29.599417] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-23T20:03:29.733858] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T20:03:30.041487] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T20:03:30.399624] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-23T20:03:31.199416] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-23T20:03:31.619611] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-23T20:03:31.717381] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T20:03:31.721815] [INFO ] [REMOTE ] AWR: Full fetch complete (32511 records). [2025-10-23T20:03:31.721909] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-23T20:03:32.003697] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-23T20:03:32.110268] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-23T20:03:32.110383] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-23T20:03:32.110904] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-23T20:03:32.110975] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-23T20:03:32.111929] [DEBUG] [LOCAL ] AWR: Trimmed 32511 records to 22853 (keeping 200 days of data) [2025-10-23T20:03:32.256251] [DEBUG] [LOCAL ] AWR: Primary data saved (22853 records). [2025-10-23T20:03:32.256392] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-23T20:03:32.256472] [INFO ] [MAIN ] Update Progress: 194/2367 symbols completed. AWR took 34.4s. Estimated remaining: 4h 22m 52s. Rate: 8.3 symbols/min [2025-10-23T20:03:32.452621] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:03:32.457048] [DEBUG] [LOCAL ] AXR: Loaded 2907 existing records from primary storage. [2025-10-23T20:03:32.457218] [INFO ] [MAIN ] AXR: Loaded 2907 existing records. [2025-10-23T20:03:32.561555] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T20:03:32.665145] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:03:32.665404] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-23T20:03:32.665464] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-23T20:03:32.665670] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-23T20:03:32.665754] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-23T20:03:32.804499] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-23T20:03:33.034884] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:03:33.315727] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T20:03:33.599434] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-23T20:03:34.034006] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T20:03:34.399419] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-23T20:03:35.177147] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:03:35.199383] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-23T20:03:35.768160] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-23T20:03:35.999430] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-23T20:03:36.266916] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T20:03:36.799464] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-23T20:03:37.309265] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T20:03:37.599419] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-23T20:03:38.399409] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-23T20:03:38.865374] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-23T20:03:38.912052] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T20:03:38.917201] [INFO ] [REMOTE ] AX: Full fetch complete (42143 records). [2025-10-23T20:03:38.917320] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-23T20:03:39.153583] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-23T20:03:39.200981] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-23T20:03:39.361396] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-23T20:03:39.361498] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-23T20:03:39.362044] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-23T20:03:39.362116] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-23T20:03:39.363091] [DEBUG] [LOCAL ] AX: Trimmed 42143 records to 27971 (keeping 200 days of data) [2025-10-23T20:03:39.518367] [DEBUG] [LOCAL ] AX: Primary data saved (27971 records). [2025-10-23T20:03:39.518514] [INFO ] [MAIN ] AX: Full history saved. [2025-10-23T20:03:39.518594] [INFO ] [MAIN ] Update Progress: 195/2367 symbols completed. AX took 26.4s. Estimated remaining: 4h 22m 45s. Rate: 8.3 symbols/min [2025-10-23T20:03:39.693430] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:03:39.693601] [DEBUG] [LOCAL ] AXS: No existing data file found in primary storage. [2025-10-23T20:03:39.693661] [WARN ] [MAIN ] AXS: No existing data found, performing full refresh instead. [2025-10-23T20:03:39.693766] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-23T20:03:39.693814] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-23T20:03:39.693865] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-10-23T20:03:39.693901] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-23T20:03:40.005501] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-23T20:03:40.052733] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:03:40.799406] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-23T20:03:41.292390] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T20:03:41.599430] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-23T20:03:41.679043] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T20:03:42.223587] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T20:03:42.399438] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-23T20:03:42.987251] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T20:03:43.199457] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-23T20:03:43.704132] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-23T20:03:43.999440] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-23T20:03:44.589796] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T20:03:44.799434] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-23T20:03:44.967709] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T20:03:45.206282] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-23T20:03:45.599432] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-23T20:03:46.171059] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-23T20:03:46.399420] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-23T20:03:47.199416] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-23T20:03:47.742853] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-23T20:03:47.809217] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T20:03:47.999421] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-23T20:03:48.799455] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-23T20:03:49.599429] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-23T20:03:49.743333] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T20:03:50.399406] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-23T20:03:50.853448] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-23T20:03:50.969509] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-23T20:03:51.021224] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T20:03:51.199425] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-23T20:03:51.999421] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-23T20:03:52.799412] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-23T20:03:53.151338] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T20:03:53.454006] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-23T20:03:53.599447] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-23T20:03:53.654951] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T20:03:54.399500] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-23T20:03:54.801275] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T20:03:54.978106] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T20:03:54.979303] [INFO ] [REMOTE ] AXR: Full fetch complete (4363 records). [2025-10-23T20:03:54.979391] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-23T20:03:55.204575] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-23T20:03:55.343380] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-23T20:03:55.343490] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-23T20:03:55.343711] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-23T20:03:55.343807] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-23T20:03:55.344190] [DEBUG] [LOCAL ] AXR: Trimmed 4363 records to 2921 (keeping 200 days of data) [2025-10-23T20:03:55.360720] [DEBUG] [LOCAL ] AXR: Primary data saved (2921 records). [2025-10-23T20:03:55.360810] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-23T20:03:55.360925] [INFO ] [MAIN ] Update Progress: 196/2367 symbols completed. AXR took 23.1s. Estimated remaining: 4h 24m 12s. Rate: 8.2 symbols/min [2025-10-23T20:03:55.528601] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:03:55.578216] [DEBUG] [LOCAL ] AXTA: Loaded 52290 existing records from primary storage. [2025-10-23T20:03:55.578628] [INFO ] [MAIN ] AXTA: Loaded 52290 existing records. [2025-10-23T20:03:55.755917] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:03:55.756095] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-23T20:03:55.756185] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-23T20:03:55.756432] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-23T20:03:55.756522] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-23T20:03:56.007059] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-23T20:03:56.114731] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:03:56.799418] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-23T20:03:57.371780] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-23T20:03:57.381159] [INFO ] [REMOTE ] AXL: Full fetch complete (73158 records). [2025-10-23T20:03:57.381305] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-23T20:03:57.611862] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-23T20:03:57.712887] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T20:03:57.813534] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-23T20:03:57.813636] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-23T20:03:57.814426] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-23T20:03:57.814499] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-23T20:03:57.815878] [DEBUG] [LOCAL ] AXL: Trimmed 73158 records to 50912 (keeping 200 days of data) [2025-10-23T20:03:58.105966] [DEBUG] [LOCAL ] AXL: Primary data saved (50912 records). [2025-10-23T20:03:58.106151] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-23T20:03:58.106287] [INFO ] [MAIN ] Update Progress: 197/2367 symbols completed. AXL took 40.7s. Estimated remaining: 4h 23m 15s. Rate: 8.2 symbols/min [2025-10-23T20:03:58.399458] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-23T20:03:58.522492] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T20:03:59.199433] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-23T20:03:59.513122] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T20:03:59.566433] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T20:03:59.999424] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-23T20:04:00.790732] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T20:04:00.800129] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-23T20:04:01.599407] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-23T20:04:01.977850] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T20:04:02.399418] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-23T20:04:03.719954] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-23T20:04:03.729574] [INFO ] [REMOTE ] AXP: Full fetch complete (77114 records). [2025-10-23T20:04:03.729895] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-23T20:04:03.854495] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-23T20:04:03.886563] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-23T20:04:04.122147] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T20:04:04.175702] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-23T20:04:04.199543] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-23T20:04:04.199631] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-23T20:04:04.200453] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-23T20:04:04.200673] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-23T20:04:04.202174] [DEBUG] [LOCAL ] AXP: Trimmed 77114 records to 53545 (keeping 200 days of data) [2025-10-23T20:04:04.540143] [DEBUG] [LOCAL ] AXP: Primary data saved (53545 records). [2025-10-23T20:04:04.540325] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-23T20:04:04.541459] [INFO ] [MAIN ] Update Progress: 198/2367 symbols completed. AXP took 41.8s. Estimated remaining: 4h 22m 58s. Rate: 8.2 symbols/min [2025-10-23T20:04:05.567550] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T20:04:05.576266] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-23T20:04:06.097543] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-23T20:04:06.108406] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-23T20:04:06.809586] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T20:04:06.816732] [INFO ] [REMOTE ] AXS: Full fetch complete (56201 records). [2025-10-23T20:04:06.816879] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-23T20:04:07.199196] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-23T20:04:07.199325] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-23T20:04:07.200023] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-23T20:04:07.200120] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-23T20:04:07.201397] [DEBUG] [LOCAL ] AXS: Trimmed 56201 records to 39045 (keeping 200 days of data) [2025-10-23T20:04:07.434187] [DEBUG] [LOCAL ] AXS: Primary data saved (39045 records). [2025-10-23T20:04:07.434358] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-23T20:04:07.434483] [INFO ] [MAIN ] Update Progress: 199/2367 symbols completed. AXS took 27.9s. Estimated remaining: 4h 22m 3s. Rate: 8.3 symbols/min [2025-10-23T20:04:07.864184] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T20:04:07.875387] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-23T20:04:10.878594] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-10-23T20:04:10.889623] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-23T20:04:12.408851] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T20:04:12.420373] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-23T20:04:13.880991] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T20:04:13.892262] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-23T20:04:15.823254] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T20:04:15.834895] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-23T20:04:17.972070] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T20:04:17.981359] [INFO ] [REMOTE ] AXTA: Full fetch complete (75485 records). [2025-10-23T20:04:17.981553] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-23T20:04:18.367280] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-23T20:04:18.367412] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-23T20:04:18.368286] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-23T20:04:18.368385] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-23T20:04:18.369864] [DEBUG] [LOCAL ] AXTA: Trimmed 75485 records to 52680 (keeping 200 days of data) [2025-10-23T20:04:18.666755] [DEBUG] [LOCAL ] AXTA: Primary data saved (52680 records). [2025-10-23T20:04:18.666918] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-23T20:04:18.667028] [INFO ] [MAIN ] Update Progress: 200/2367 symbols completed. AXTA took 23.3s. Estimated remaining: 4h 22m 39s. Rate: 8.3 symbols/min [2025-10-23T20:04:19.262037] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:19.315516] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:19.344333] [DEBUG] [LOCAL ] AYI: No existing data file found in primary storage. [2025-10-23T20:04:19.359720] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-10-23T20:04:19.361675] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-23T20:04:19.363542] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-23T20:04:19.363313] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:19.396167] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-23T20:04:19.400603] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-23T20:04:19.397505] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:19.401150] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-23T20:04:19.401240] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-23T20:04:19.401606] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-23T20:04:19.442196] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-23T20:04:19.458351] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-23T20:04:19.442491] [DEBUG] [LOCAL ] AZO: Loaded 10731 existing records from primary storage. [2025-10-23T20:04:19.458906] [INFO ] [MAIN ] AZO: Loaded 10731 existing records. [2025-10-23T20:04:19.458497] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-23T20:04:19.818487] [DEBUG] [LOCAL ] AZZ: Loaded 22928 existing records from primary storage. [2025-10-23T20:04:19.848623] [INFO ] [MAIN ] AZZ: Loaded 22928 existing records. [2025-10-23T20:04:20.029053] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:04:20.125745] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-23T20:04:20.140672] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-23T20:04:20.283735] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-23T20:04:20.288204] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-23T20:04:20.616560] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:04:20.682778] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-23T20:04:20.748991] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-23T20:04:20.766072] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:20.756680] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:20.766120] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-23T20:04:20.787411] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-23T20:04:20.787558] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-23T20:04:20.776923] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-23T20:04:21.379472] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:21.399841] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-23T20:04:21.524151] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:21.524578] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-23T20:04:22.135022] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T20:04:22.140949] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-23T20:04:22.293362] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T20:04:22.294167] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T20:04:22.303164] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-23T20:04:22.304072] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-23T20:04:22.338379] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:04:22.338941] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-23T20:04:22.339046] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:04:22.339160] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-23T20:04:22.339242] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:04:22.339327] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-23T20:04:22.339422] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-23T20:04:22.339494] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-23T20:04:22.339587] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-23T20:04:22.339846] [INFO ] [MAIN ] Update Progress: 201/2367 symbols completed. B took 3.7s. Estimated remaining: 4h 21m 53s. Rate: 8.3 symbols/min [2025-10-23T20:04:22.507852] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:22.557558] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-23T20:04:22.557913] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-23T20:04:22.674799] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T20:04:22.712983] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-23T20:04:22.754876] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:04:22.755087] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-23T20:04:22.755195] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-23T20:04:22.755846] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-23T20:04:22.755922] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-23T20:04:23.125216] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:23.126315] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T20:04:23.128972] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-23T20:04:23.130577] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-23T20:04:23.468556] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T20:04:23.473577] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-23T20:04:23.565877] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T20:04:23.570600] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-23T20:04:24.175598] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T20:04:24.179253] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-23T20:04:24.790121] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T20:04:24.795212] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-23T20:04:24.847382] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T20:04:24.853869] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-23T20:04:25.243167] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T20:04:25.246669] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-23T20:04:25.419299] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-23T20:04:25.429803] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-23T20:04:26.000513] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T20:04:26.007639] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-23T20:04:26.136389] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T20:04:26.144445] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-23T20:04:26.182176] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T20:04:26.185496] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-23T20:04:26.839715] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T20:04:26.843031] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-23T20:04:27.053818] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T20:04:27.199587] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-23T20:04:27.331784] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T20:04:27.506367] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-23T20:04:27.544965] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T20:04:27.999430] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-23T20:04:28.387492] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T20:04:28.799452] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-23T20:04:29.599427] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-23T20:04:30.124220] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T20:04:30.137541] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T20:04:30.399404] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-23T20:04:30.446873] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-23T20:04:31.199409] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-23T20:04:31.359882] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T20:04:31.999425] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-23T20:04:32.799408] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-23T20:04:33.326247] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T20:04:33.599420] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-23T20:04:33.771159] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T20:04:33.875967] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-23T20:04:34.399426] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-23T20:04:34.425954] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T20:04:34.428429] [INFO ] [REMOTE ] AZO: Full fetch complete (16023 records). [2025-10-23T20:04:34.428541] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-23T20:04:34.796734] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-23T20:04:34.796848] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-23T20:04:34.797232] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-23T20:04:34.797314] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-23T20:04:34.797928] [DEBUG] [LOCAL ] AZO: Trimmed 16023 records to 10939 (keeping 200 days of data) [2025-10-23T20:04:34.873377] [DEBUG] [LOCAL ] AZO: Primary data saved (10939 records). [2025-10-23T20:04:34.873625] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-23T20:04:34.873785] [INFO ] [MAIN ] Update Progress: 202/2367 symbols completed. AZO took 16.2s. Estimated remaining: 4h 22m 42s. Rate: 8.2 symbols/min [2025-10-23T20:04:35.054805] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:35.114376] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-23T20:04:35.114882] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-23T20:04:35.204692] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-23T20:04:35.311809] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:04:35.312132] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-23T20:04:35.312223] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-23T20:04:35.312704] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-23T20:04:35.312785] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-23T20:04:35.676230] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:35.999446] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-23T20:04:36.329001] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T20:04:36.799423] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-23T20:04:36.941274] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-23T20:04:37.070101] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T20:04:37.599425] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-23T20:04:37.897748] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T20:04:38.399444] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-23T20:04:39.199405] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-23T20:04:39.445053] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T20:04:39.999417] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-23T20:04:40.327699] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-23T20:04:40.799417] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-23T20:04:41.453682] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T20:04:41.459940] [INFO ] [REMOTE ] AZZ: Full fetch complete (32234 records). [2025-10-23T20:04:41.460126] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-23T20:04:41.616871] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-23T20:04:41.916848] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-23T20:04:41.917177] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-23T20:04:41.927826] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-23T20:04:41.928638] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-23T20:04:41.929280] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-23T20:04:41.931222] [DEBUG] [LOCAL ] AZZ: Trimmed 32234 records to 23076 (keeping 200 days of data) [2025-10-23T20:04:42.075243] [DEBUG] [LOCAL ] AZZ: Primary data saved (23076 records). [2025-10-23T20:04:42.075613] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-23T20:04:42.075759] [INFO ] [MAIN ] Update Progress: 203/2367 symbols completed. AZZ took 23.4s. Estimated remaining: 4h 22m 34s. Rate: 8.2 symbols/min [2025-10-23T20:04:42.168720] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T20:04:42.201157] [INFO ] [REMOTE ] AYI: Full fetch complete (36675 records). [2025-10-23T20:04:42.217018] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-23T20:04:42.372993] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:42.384517] [DEBUG] [LOCAL ] BAC: No existing data file found in primary storage. [2025-10-23T20:04:42.390198] [WARN ] [MAIN ] BAC: No existing data found, performing full refresh instead. [2025-10-23T20:04:42.405759] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-23T20:04:42.412325] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-23T20:04:42.438694] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-23T20:04:42.470196] [DEBUG] [LOCAL ] BAC: No primary data file found to delete. [2025-10-23T20:04:42.516399] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-23T20:04:42.923260] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-23T20:04:42.955782] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-23T20:04:42.983268] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-23T20:04:42.994293] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-23T20:04:43.059768] [DEBUG] [LOCAL ] AYI: Trimmed 36675 records to 24188 (keeping 200 days of data) [2025-10-23T20:04:43.063334] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:43.209607] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-23T20:04:43.227364] [DEBUG] [LOCAL ] AYI: Primary data saved (24188 records). [2025-10-23T20:04:43.227484] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-23T20:04:43.227593] [INFO ] [MAIN ] Update Progress: 204/2367 symbols completed. AYI took 24.6s. Estimated remaining: 4h 21m 22s. Rate: 8.3 symbols/min [2025-10-23T20:04:43.421498] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:43.421705] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-23T20:04:43.421781] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-23T20:04:43.421897] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-23T20:04:43.421971] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-23T20:04:43.422069] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-23T20:04:43.422165] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-23T20:04:43.827283] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:43.999440] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-23T20:04:44.258840] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-23T20:04:44.799419] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-23T20:04:45.105072] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-23T20:04:45.485105] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-23T20:04:45.599409] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-23T20:04:45.766202] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T20:04:46.399415] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-23T20:04:47.199419] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-23T20:04:47.625551] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-10-23T20:04:47.681951] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T20:04:47.861398] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-23T20:04:47.999419] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-23T20:04:48.799419] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-23T20:04:49.554131] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-23T20:04:49.599401] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-23T20:04:50.399418] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-23T20:04:50.736725] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-23T20:04:51.199501] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-23T20:04:51.365341] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-23T20:04:52.008235] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-23T20:04:52.011423] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T20:04:52.071094] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-23T20:04:52.799445] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-23T20:04:53.608596] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-23T20:04:53.611566] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-23T20:04:54.399396] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-23T20:04:54.551297] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T20:04:54.560543] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-23T20:04:54.560713] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-23T20:04:54.942047] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T20:04:55.007324] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-23T20:04:55.014361] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-23T20:04:55.015965] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-23T20:04:55.016431] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-23T20:04:55.018607] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54180 (keeping 200 days of data) [2025-10-23T20:04:55.170565] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-10-23T20:04:55.222370] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-23T20:04:55.390709] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-23T20:04:55.390882] [INFO ] [MAIN ] BA: Full history saved. [2025-10-23T20:04:55.391063] [INFO ] [MAIN ] Update Progress: 205/2367 symbols completed. BA took 33.1s. Estimated remaining: 4h 22m 7s. Rate: 8.2 symbols/min [2025-10-23T20:04:55.563876] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:04:55.598978] [DEBUG] [LOCAL ] BAK: Loaded 39419 existing records from primary storage. [2025-10-23T20:04:55.599332] [INFO ] [MAIN ] BAK: Loaded 39419 existing records. [2025-10-23T20:04:55.776703] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:04:55.776928] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-23T20:04:55.777002] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-23T20:04:55.777286] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-23T20:04:55.777360] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-23T20:04:56.018224] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-23T20:04:56.141386] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:04:56.799446] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-23T20:04:56.954919] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-23T20:04:57.050123] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T20:04:57.599446] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-23T20:04:58.347562] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:04:58.399428] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-23T20:04:58.456579] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-23T20:04:59.199427] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-23T20:04:59.903525] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T20:04:59.999419] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-23T20:05:00.442310] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-23T20:05:00.799422] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-23T20:05:01.599430] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-23T20:05:01.909860] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-23T20:05:02.399426] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-23T20:05:02.562700] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-23T20:05:02.664595] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T20:05:03.199443] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-23T20:05:03.896579] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (3.10 seconds). [2025-10-23T20:05:03.999441] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-23T20:05:04.160375] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T20:05:04.799435] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-23T20:05:05.602761] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-23T20:05:05.609063] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-23T20:05:05.976600] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T20:05:06.399420] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-23T20:05:06.463754] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-23T20:05:07.199446] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-23T20:05:07.331880] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T20:05:07.999423] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-23T20:05:08.592885] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-23T20:05:08.799433] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-23T20:05:08.997843] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T20:05:09.599418] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-23T20:05:10.296018] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (3.10 seconds). [2025-10-23T20:05:10.305677] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-23T20:05:10.305884] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-23T20:05:10.401302] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-23T20:05:10.786075] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-23T20:05:10.788870] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T20:05:10.788994] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-23T20:05:10.801058] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-23T20:05:10.801566] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-23T20:05:10.805458] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-23T20:05:11.200504] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-23T20:05:11.185772] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-23T20:05:11.204386] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T20:05:11.204484] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-23T20:05:11.215387] [INFO ] [MAIN ] Update Progress: 206/2367 symbols completed. BABA took 36.3s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-23T20:05:11.396211] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:11.446514] [DEBUG] [LOCAL ] BALL: Loaded 51932 existing records from primary storage. [2025-10-23T20:05:11.446915] [INFO ] [MAIN ] BALL: Loaded 51932 existing records. [2025-10-23T20:05:11.621555] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:05:11.621802] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-23T20:05:11.621879] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-23T20:05:11.622565] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-23T20:05:11.622639] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-23T20:05:11.999832] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-23T20:05:12.003935] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:12.781375] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-23T20:05:12.799414] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-23T20:05:13.610435] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-23T20:05:13.615304] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T20:05:13.770075] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-23T20:05:13.781758] [INFO ] [REMOTE ] BAH: Full fetch complete (75220 records). [2025-10-23T20:05:13.781962] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-23T20:05:14.200282] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-23T20:05:14.200391] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-23T20:05:14.201191] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-23T20:05:14.201289] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-23T20:05:14.202690] [DEBUG] [LOCAL ] BAH: Trimmed 75220 records to 52022 (keeping 200 days of data) [2025-10-23T20:05:14.410486] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-23T20:05:14.514704] [DEBUG] [LOCAL ] BAH: Primary data saved (52022 records). [2025-10-23T20:05:14.514862] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-23T20:05:14.514965] [INFO ] [MAIN ] Update Progress: 207/2367 symbols completed. BAH took 31.3s. Estimated remaining: 4h 22m 40s. Rate: 8.2 symbols/min [2025-10-23T20:05:14.684385] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:14.684597] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-23T20:05:14.684688] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-23T20:05:14.684798] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-23T20:05:14.684870] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-23T20:05:14.684954] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-23T20:05:14.685025] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-23T20:05:15.032661] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:15.199416] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-23T20:05:15.480582] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T20:05:15.533122] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-23T20:05:15.542722] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-23T20:05:15.542894] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-23T20:05:15.936220] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T20:05:15.967487] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-23T20:05:15.968143] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-23T20:05:15.969173] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-23T20:05:15.969577] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-23T20:05:15.970995] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54198 (keeping 200 days of data) [2025-10-23T20:05:16.025668] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-23T20:05:16.198476] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T20:05:16.323302] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-23T20:05:16.323478] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-23T20:05:16.323594] [INFO ] [MAIN ] Update Progress: 208/2367 symbols completed. BAC took 34.2s. Estimated remaining: 4h 21m 36s. Rate: 8.3 symbols/min [2025-10-23T20:05:16.506811] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:16.553715] [DEBUG] [LOCAL ] BAM: Loaded 52081 existing records from primary storage. [2025-10-23T20:05:16.554075] [INFO ] [MAIN ] BAM: Loaded 52081 existing records. [2025-10-23T20:05:16.742214] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:05:16.742421] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-23T20:05:16.742517] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-23T20:05:16.742876] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-23T20:05:16.742954] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-23T20:05:16.805941] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-23T20:05:17.096726] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:17.498614] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T20:05:17.599406] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-23T20:05:18.216129] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T20:05:18.399427] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-23T20:05:18.490293] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T20:05:19.199421] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-23T20:05:19.999441] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-23T20:05:20.214624] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T20:05:20.799414] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-23T20:05:20.890607] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T20:05:20.897875] [INFO ] [REMOTE ] BAK: Full fetch complete (56854 records). [2025-10-23T20:05:20.898009] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-23T20:05:21.287896] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-23T20:05:21.288002] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-23T20:05:21.288745] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-23T20:05:21.288823] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-23T20:05:21.289919] [DEBUG] [LOCAL ] BAK: Trimmed 56854 records to 39731 (keeping 200 days of data) [2025-10-23T20:05:21.503181] [DEBUG] [LOCAL ] BAK: Primary data saved (39731 records). [2025-10-23T20:05:21.503506] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-23T20:05:21.503942] [INFO ] [MAIN ] Update Progress: 209/2367 symbols completed. BAK took 26.1s. Estimated remaining: 4h 21m 7s. Rate: 8.3 symbols/min [2025-10-23T20:05:21.609334] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-23T20:05:21.687754] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:21.768688] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T20:05:21.770005] [DEBUG] [LOCAL ] BANC: Loaded 51385 existing records from primary storage. [2025-10-23T20:05:21.781880] [INFO ] [MAIN ] BANC: Loaded 51385 existing records. [2025-10-23T20:05:21.957411] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:05:21.957636] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-23T20:05:21.957755] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-23T20:05:21.958020] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-23T20:05:21.958101] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-23T20:05:22.312081] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:22.338689] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T20:05:22.369697] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T20:05:22.399449] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-23T20:05:23.199420] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-23T20:05:23.999411] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-23T20:05:24.084252] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:05:24.496344] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T20:05:24.799414] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-23T20:05:25.015578] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:05:25.599413] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-23T20:05:25.802717] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T20:05:26.399407] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-23T20:05:27.133174] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T20:05:27.199403] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-23T20:05:27.940945] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T20:05:27.999423] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-23T20:05:28.799413] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-23T20:05:28.916796] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T20:05:29.606088] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-23T20:05:29.638271] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T20:05:29.651789] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T20:05:30.399415] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-23T20:05:31.199409] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-23T20:05:31.373317] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T20:05:31.999418] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-23T20:05:32.079295] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T20:05:32.799417] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-23T20:05:33.075553] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T20:05:33.260246] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T20:05:33.599413] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-23T20:05:34.399412] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-23T20:05:34.444319] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-23T20:05:34.570839] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T20:05:35.199434] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-23T20:05:35.877391] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T20:05:35.999405] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-23T20:05:36.673525] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T20:05:36.799398] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-23T20:05:37.599400] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-23T20:05:37.652637] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T20:05:38.058755] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T20:05:38.399404] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-23T20:05:38.797624] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-23T20:05:38.807747] [INFO ] [REMOTE ] BALL: Full fetch complete (75624 records). [2025-10-23T20:05:38.807941] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-23T20:05:39.206376] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-23T20:05:39.210514] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-23T20:05:39.211013] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-23T20:05:39.212798] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-23T20:05:39.213051] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-23T20:05:39.214710] [DEBUG] [LOCAL ] BALL: Trimmed 75624 records to 52314 (keeping 200 days of data) [2025-10-23T20:05:39.537969] [DEBUG] [LOCAL ] BALL: Primary data saved (52314 records). [2025-10-23T20:05:39.538196] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-23T20:05:39.539429] [INFO ] [MAIN ] Update Progress: 210/2367 symbols completed. BALL took 28.3s. Estimated remaining: 4h 22m 50s. Rate: 8.2 symbols/min [2025-10-23T20:05:39.738282] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:39.770577] [DEBUG] [LOCAL ] BAP: Loaded 25563 existing records from primary storage. [2025-10-23T20:05:39.770973] [INFO ] [MAIN ] BAP: Loaded 25563 existing records. [2025-10-23T20:05:39.950810] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:05:39.951020] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-23T20:05:39.951096] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-23T20:05:39.951422] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-23T20:05:39.951500] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-23T20:05:40.005140] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-23T20:05:40.329579] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:40.362309] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T20:05:40.762946] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:05:40.799601] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T20:05:40.799712] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-23T20:05:41.599410] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-23T20:05:42.010576] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T20:05:42.399415] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-23T20:05:43.199443] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-23T20:05:43.257897] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T20:05:43.641961] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T20:05:43.999419] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-23T20:05:44.185025] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T20:05:44.188712] [INFO ] [REMOTE ] BALY: Full fetch complete (16234 records). [2025-10-23T20:05:44.188819] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-23T20:05:44.368964] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T20:05:44.369264] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:05:44.369336] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:05:44.369410] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-23T20:05:44.369499] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-23T20:05:44.369568] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-23T20:05:44.369675] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-23T20:05:44.369767] [INFO ] [MAIN ] Update Progress: 211/2367 symbols completed. BALY took 29.9s. Estimated remaining: 4h 22m 18s. Rate: 8.2 symbols/min [2025-10-23T20:05:44.534436] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:44.568398] [DEBUG] [LOCAL ] BARK: Loaded 38227 existing records from primary storage. [2025-10-23T20:05:44.568741] [INFO ] [MAIN ] BARK: Loaded 38227 existing records. [2025-10-23T20:05:44.742160] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:05:44.742372] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-23T20:05:44.742446] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-23T20:05:44.742692] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-23T20:05:44.742779] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-23T20:05:44.805851] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-23T20:05:45.093314] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:45.599397] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-23T20:05:45.701760] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T20:05:46.399436] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-23T20:05:46.462626] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T20:05:47.204494] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-23T20:05:47.215582] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T20:05:47.589517] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T20:05:47.999422] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-23T20:05:48.799417] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-23T20:05:48.943978] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T20:05:48.953162] [INFO ] [REMOTE ] BAM: Full fetch complete (75272 records). [2025-10-23T20:05:48.953355] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-23T20:05:49.390453] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T20:05:49.389354] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-23T20:05:49.396019] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-23T20:05:49.397504] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-23T20:05:49.397986] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-23T20:05:49.399395] [DEBUG] [LOCAL ] BAM: Trimmed 75272 records to 52467 (keeping 200 days of data) [2025-10-23T20:05:49.605202] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-23T20:05:49.710831] [DEBUG] [LOCAL ] BAM: Primary data saved (52467 records). [2025-10-23T20:05:49.710992] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-23T20:05:49.711099] [INFO ] [MAIN ] Update Progress: 212/2367 symbols completed. BAM took 33.4s. Estimated remaining: 4h 21m 50s. Rate: 8.2 symbols/min [2025-10-23T20:05:49.884009] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:05:49.931304] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-23T20:05:49.931662] [INFO ] [MAIN ] BAX: Loaded 53537 existing records. [2025-10-23T20:05:50.109845] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:05:50.110226] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-23T20:05:50.110302] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-23T20:05:50.110535] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-23T20:05:50.110610] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-23T20:05:50.419074] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T20:05:50.412143] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-23T20:05:50.505151] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:05:50.824779] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T20:05:51.199414] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-23T20:05:51.999403] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-23T20:05:52.110664] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:05:52.312339] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T20:05:52.799408] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-23T20:05:53.549266] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:05:53.599417] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-23T20:05:54.325186] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T20:05:54.399419] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-23T20:05:54.763423] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T20:05:55.199439] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-23T20:05:55.850750] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T20:05:55.999407] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-23T20:05:56.610730] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T20:05:56.725179] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T20:05:56.799406] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-23T20:05:57.599415] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-23T20:05:58.399396] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-23T20:05:58.531452] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T20:05:58.893792] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T20:05:59.199431] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-23T20:05:59.357390] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T20:05:59.999427] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-23T20:06:00.799419] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-23T20:06:00.974563] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:06:01.599426] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-23T20:06:01.889151] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T20:06:01.895891] [INFO ] [REMOTE ] BAP: Full fetch complete (37332 records). [2025-10-23T20:06:01.896103] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-23T20:06:02.278688] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T20:06:02.355998] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-23T20:06:02.356115] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-23T20:06:02.356623] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-23T20:06:02.356725] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-23T20:06:02.358119] [DEBUG] [LOCAL ] BAP: Trimmed 37332 records to 25703 (keeping 200 days of data) [2025-10-23T20:06:02.412482] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-23T20:06:02.531669] [DEBUG] [LOCAL ] BAP: Primary data saved (25703 records). [2025-10-23T20:06:02.531928] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-23T20:06:02.532181] [INFO ] [MAIN ] Update Progress: 213/2367 symbols completed. BAP took 23.0s. Estimated remaining: 4h 22m 39s. Rate: 8.2 symbols/min [2025-10-23T20:06:02.729872] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:02.752718] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:06:02.833046] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-23T20:06:02.833625] [INFO ] [MAIN ] BB: Loaded 52882 existing records. [2025-10-23T20:06:03.031882] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:03.032199] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-23T20:06:03.032300] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-23T20:06:03.032581] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-23T20:06:03.032701] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-23T20:06:03.206023] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-23T20:06:03.422385] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:03.999415] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-23T20:06:04.452716] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T20:06:04.799441] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-23T20:06:05.254675] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T20:06:05.266160] [INFO ] [REMOTE ] BANC: Full fetch complete (74639 records). [2025-10-23T20:06:05.266491] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-23T20:06:05.604162] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-23T20:06:05.694998] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-23T20:06:05.695169] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-23T20:06:05.696809] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-23T20:06:05.696902] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-23T20:06:05.699272] [DEBUG] [LOCAL ] BANC: Trimmed 74639 records to 51774 (keeping 200 days of data) [2025-10-23T20:06:06.045487] [DEBUG] [LOCAL ] BANC: Primary data saved (51774 records). [2025-10-23T20:06:06.045777] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-23T20:06:06.045974] [INFO ] [MAIN ] Update Progress: 214/2367 symbols completed. BANC took 44.5s. Estimated remaining: 4h 21m 53s. Rate: 8.2 symbols/min [2025-10-23T20:06:06.190146] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T20:06:06.278536] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:06.332756] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-23T20:06:06.333235] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-23T20:06:06.402782] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-23T20:06:06.525767] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:06.526174] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-23T20:06:06.526316] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-23T20:06:06.526709] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-23T20:06:06.526789] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-23T20:06:06.737011] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T20:06:06.940687] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:07.199421] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-23T20:06:07.382027] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:06:07.999430] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-23T20:06:08.333107] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:06:08.799408] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-23T20:06:09.599558] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-23T20:06:09.742261] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-23T20:06:09.812376] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-23T20:06:10.399422] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-23T20:06:10.563103] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T20:06:11.199416] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-23T20:06:11.562829] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T20:06:11.999428] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-23T20:06:12.583443] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T20:06:12.799419] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-23T20:06:13.245865] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-23T20:06:13.599420] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-23T20:06:13.926958] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T20:06:14.250949] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T20:06:14.399419] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-23T20:06:15.199405] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-23T20:06:15.999521] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-23T20:06:16.097734] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T20:06:16.104741] [INFO ] [REMOTE ] BARK: Full fetch complete (56140 records). [2025-10-23T20:06:16.104933] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-23T20:06:16.490753] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-23T20:06:16.490913] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-23T20:06:16.491729] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-23T20:06:16.491841] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-23T20:06:16.493263] [DEBUG] [LOCAL ] BARK: Trimmed 56140 records to 38445 (keeping 200 days of data) [2025-10-23T20:06:16.709556] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-10-23T20:06:16.752130] [DEBUG] [LOCAL ] BARK: Primary data saved (38445 records). [2025-10-23T20:06:16.752361] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-23T20:06:16.752490] [INFO ] [MAIN ] Update Progress: 215/2367 symbols completed. BARK took 32.4s. Estimated remaining: 4h 22m 20s. Rate: 8.2 symbols/min [2025-10-23T20:06:16.811363] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-23T20:06:16.931295] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:16.968412] [DEBUG] [LOCAL ] BBAR: Loaded 42605 existing records from primary storage. [2025-10-23T20:06:16.968795] [INFO ] [MAIN ] BBAR: Loaded 42605 existing records. [2025-10-23T20:06:17.150907] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:17.151139] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-23T20:06:17.151213] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-23T20:06:17.151548] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-23T20:06:17.151624] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-23T20:06:17.540824] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:17.543156] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-23T20:06:17.599403] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-23T20:06:18.017728] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-23T20:06:18.399452] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-23T20:06:19.199417] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-23T20:06:19.272079] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T20:06:19.999493] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-23T20:06:20.286538] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T20:06:20.799415] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-23T20:06:21.014085] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T20:06:21.554926] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T20:06:21.599391] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-23T20:06:22.399422] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-23T20:06:22.975318] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T20:06:23.105517] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T20:06:23.199422] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-23T20:06:23.769434] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (6.96 seconds). [2025-10-23T20:06:23.999413] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-23T20:06:24.498558] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-23T20:06:24.508296] [INFO ] [REMOTE ] BAX: Full fetch complete (77620 records). [2025-10-23T20:06:24.508444] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-23T20:06:24.811426] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-23T20:06:24.920213] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-23T20:06:24.920420] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-23T20:06:24.921273] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-23T20:06:24.921423] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-23T20:06:24.922991] [DEBUG] [LOCAL ] BAX: Trimmed 77620 records to 53927 (keeping 200 days of data) [2025-10-23T20:06:25.066817] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T20:06:25.268277] [DEBUG] [LOCAL ] BAX: Primary data saved (53927 records). [2025-10-23T20:06:25.268433] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-23T20:06:25.268518] [INFO ] [MAIN ] Update Progress: 216/2367 symbols completed. BAX took 35.6s. Estimated remaining: 4h 22m 25s. Rate: 8.2 symbols/min [2025-10-23T20:06:25.435056] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:25.435632] [DEBUG] [LOCAL ] BBD: No existing data file found in primary storage. [2025-10-23T20:06:25.435726] [WARN ] [MAIN ] BBD: No existing data found, performing full refresh instead. [2025-10-23T20:06:25.435834] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-23T20:06:25.435923] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-23T20:06:25.436007] [DEBUG] [LOCAL ] BBD: No primary data file found to delete. [2025-10-23T20:06:25.436072] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-23T20:06:25.606159] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-23T20:06:25.794904] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:25.940152] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T20:06:26.399448] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-23T20:06:27.199688] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-23T20:06:27.201546] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T20:06:27.507744] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-23T20:06:27.999456] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-23T20:06:28.476939] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-23T20:06:28.799544] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-23T20:06:29.599440] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-23T20:06:29.677261] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T20:06:30.046069] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T20:06:30.399482] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-23T20:06:31.199470] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-23T20:06:31.255543] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (4.06 seconds). [2025-10-23T20:06:31.979021] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T20:06:31.999402] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-23T20:06:32.801201] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-23T20:06:32.804496] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-10-23T20:06:33.055947] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T20:06:33.599500] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-23T20:06:33.744736] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T20:06:34.399566] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-23T20:06:35.121990] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-23T20:06:35.131734] [INFO ] [REMOTE ] BB: Full fetch complete (76969 records). [2025-10-23T20:06:35.131936] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-23T20:06:35.203152] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-23T20:06:35.567336] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T20:06:35.617017] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-23T20:06:35.617517] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-23T20:06:35.618459] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-23T20:06:35.618541] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-23T20:06:35.620022] [DEBUG] [LOCAL ] BB: Trimmed 76969 records to 53262 (keeping 200 days of data) [2025-10-23T20:06:35.916479] [DEBUG] [LOCAL ] BB: Primary data saved (53262 records). [2025-10-23T20:06:35.916689] [INFO ] [MAIN ] BB: Full history saved. [2025-10-23T20:06:35.917527] [INFO ] [MAIN ] Update Progress: 217/2367 symbols completed. BB took 33.4s. Estimated remaining: 4h 22m 51s. Rate: 8.2 symbols/min [2025-10-23T20:06:36.004599] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-23T20:06:36.108769] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:36.145423] [DEBUG] [LOCAL ] BBDC: Loaded 32835 existing records from primary storage. [2025-10-23T20:06:36.145834] [INFO ] [MAIN ] BBDC: Loaded 32835 existing records. [2025-10-23T20:06:36.349436] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:36.349729] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-23T20:06:36.349816] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-23T20:06:36.350186] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-23T20:06:36.350263] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-23T20:06:36.734681] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:36.764403] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T20:06:36.799401] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-23T20:06:37.601628] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-23T20:06:37.610028] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-10-23T20:06:37.967208] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T20:06:38.399430] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-23T20:06:38.705383] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T20:06:38.717771] [INFO ] [REMOTE ] BBAR: Full fetch complete (61282 records). [2025-10-23T20:06:38.717952] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-23T20:06:38.927695] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T20:06:39.128775] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-23T20:06:39.128885] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-23T20:06:39.129587] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-23T20:06:39.129693] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-23T20:06:39.130925] [DEBUG] [LOCAL ] BBAR: Trimmed 61282 records to 42977 (keeping 200 days of data) [2025-10-23T20:06:39.217267] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-23T20:06:39.393957] [DEBUG] [LOCAL ] BBAR: Primary data saved (42977 records). [2025-10-23T20:06:39.394143] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-23T20:06:39.394267] [INFO ] [MAIN ] Update Progress: 218/2367 symbols completed. BBAR took 22.6s. Estimated remaining: 4h 22m 5s. Rate: 8.2 symbols/min [2025-10-23T20:06:39.563786] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:39.570115] [DEBUG] [LOCAL ] BBDO: Loaded 4953 existing records from primary storage. [2025-10-23T20:06:39.570370] [INFO ] [MAIN ] BBDO: Loaded 4953 existing records. [2025-10-23T20:06:39.748797] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:39.749016] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-23T20:06:39.749096] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-23T20:06:39.749417] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-23T20:06:39.749744] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-23T20:06:40.003717] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-23T20:06:40.116575] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:40.148272] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T20:06:40.799489] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-23T20:06:40.906338] [DEBUG] [REMOTE ] BBDO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-23T20:06:40.906729] [WARN ] [REMOTE ] BBDO: No data returned for month 2025-01 [2025-10-23T20:06:40.906814] [FATAL] [REMOTE ] BBDO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:06:40.906886] [FATAL] [MAIN ] BBDO: Failed to fetch primary data. [2025-10-23T20:06:40.906951] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:06:40.907024] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-23T20:06:40.907115] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-23T20:06:40.907187] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-23T20:06:40.907375] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-23T20:06:40.907481] [INFO ] [MAIN ] Update Progress: 219/2367 symbols completed. BBDO took 1.5s. Estimated remaining: 4h 21m 1s. Rate: 8.2 symbols/min [2025-10-23T20:06:41.077821] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:41.095089] [DEBUG] [LOCAL ] BBN: Loaded 17840 existing records from primary storage. [2025-10-23T20:06:41.095349] [INFO ] [MAIN ] BBN: Loaded 17840 existing records. [2025-10-23T20:06:41.277317] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:41.277590] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-23T20:06:41.277778] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-23T20:06:41.278177] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-23T20:06:41.278254] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-23T20:06:41.591231] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T20:06:41.618002] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-23T20:06:41.686527] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:41.858796] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-23T20:06:42.399437] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-23T20:06:43.127873] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T20:06:43.199461] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-23T20:06:43.312433] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T20:06:43.999488] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-23T20:06:44.650343] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T20:06:44.799429] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-23T20:06:45.599486] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-23T20:06:46.359289] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T20:06:46.399450] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-23T20:06:46.527673] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T20:06:46.704938] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-23T20:06:47.199453] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-23T20:06:47.751701] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T20:06:47.999477] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-23T20:06:48.799422] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-23T20:06:48.987708] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T20:06:49.209913] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T20:06:49.599477] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-23T20:06:50.298697] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T20:06:50.399438] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-23T20:06:50.645770] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T20:06:51.199428] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-23T20:06:51.376443] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T20:06:51.999514] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-23T20:06:52.673062] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T20:06:52.799491] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-23T20:06:53.335304] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T20:06:53.599447] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-23T20:06:53.774984] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-23T20:06:54.399473] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-23T20:06:55.199430] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-23T20:06:55.618881] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-23T20:06:55.628843] [INFO ] [REMOTE ] BBD: Full fetch complete (77271 records). [2025-10-23T20:06:55.629051] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-23T20:06:56.009946] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-23T20:06:56.075091] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T20:06:56.168395] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-23T20:06:56.168515] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-23T20:06:56.169459] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-23T20:06:56.169542] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-23T20:06:56.171117] [DEBUG] [LOCAL ] BBD: Trimmed 77271 records to 53662 (keeping 200 days of data) [2025-10-23T20:06:56.497749] [DEBUG] [LOCAL ] BBD: Primary data saved (53662 records). [2025-10-23T20:06:56.497994] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-23T20:06:56.498161] [INFO ] [MAIN ] Update Progress: 220/2367 symbols completed. BBD took 31.2s. Estimated remaining: 4h 22m 15s. Rate: 8.2 symbols/min [2025-10-23T20:06:56.677251] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:56.677859] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-23T20:06:56.677944] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-23T20:06:56.678133] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-23T20:06:56.678221] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-23T20:06:56.678334] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-23T20:06:56.678427] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-23T20:06:56.804600] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-23T20:06:57.084918] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T20:06:57.089775] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:57.599446] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-23T20:06:57.994140] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:06:57.994689] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-23T20:06:57.994785] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:06:57.994867] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-23T20:06:57.994945] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:06:57.995020] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-23T20:06:57.995127] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-23T20:06:57.995200] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-23T20:06:57.995282] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-23T20:06:57.995419] [INFO ] [MAIN ] Update Progress: 221/2367 symbols completed. BBT took 1.5s. Estimated remaining: 4h 21m 11s. Rate: 8.2 symbols/min [2025-10-23T20:06:58.210930] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:06:58.214410] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-23T20:06:58.224955] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-23T20:06:58.225124] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-23T20:06:58.335089] [DEBUG] [LOCAL ] BBU: Loaded 5773 existing records from primary storage. [2025-10-23T20:06:58.352007] [INFO ] [MAIN ] BBU: Loaded 5773 existing records. [2025-10-23T20:06:58.403439] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-23T20:06:58.528629] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T20:06:58.679609] [INFO ] [REMOTE ] BBDC: Full fetch complete (48889 records). [2025-10-23T20:06:58.743865] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-23T20:06:58.796029] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:06:58.839127] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-23T20:06:58.846017] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-23T20:06:58.865272] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-23T20:06:58.899971] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-23T20:06:59.022068] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-23T20:06:59.039213] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-23T20:06:59.048687] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-23T20:06:59.090582] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-23T20:06:59.167752] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-23T20:06:59.871515] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:06:59.984006] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T20:06:59.956948] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-23T20:07:00.008713] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-23T20:07:00.010131] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-23T20:07:00.012696] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-23T20:07:00.018601] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-23T20:07:00.021493] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-23T20:07:00.026256] [DEBUG] [LOCAL ] BBDC: Trimmed 48889 records to 33064 (keeping 200 days of data) [2025-10-23T20:07:00.229207] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-23T20:07:00.233218] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-23T20:07:00.233829] [INFO ] [MAIN ] Update Progress: 222/2367 symbols completed. BBAI took 54.2s. Estimated remaining: 4h 20m 14s. Rate: 8.2 symbols/min [2025-10-23T20:07:00.484119] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:00.512136] [DEBUG] [LOCAL ] BBDC: Primary data saved (33064 records). [2025-10-23T20:07:00.512757] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-23T20:07:00.512890] [INFO ] [MAIN ] Update Progress: 223/2367 symbols completed. BBDC took 24.6s. Estimated remaining: 4h 18m 60s. Rate: 8.3 symbols/min [2025-10-23T20:07:00.512571] [DEBUG] [LOCAL ] BBUC: Loaded 13946 existing records from primary storage. [2025-10-23T20:07:00.545044] [INFO ] [MAIN ] BBUC: Loaded 13946 existing records. [2025-10-23T20:07:00.726773] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T20:07:00.824418] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-23T20:07:00.906060] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:00.898738] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:00.906548] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-23T20:07:00.906925] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-23T20:07:00.907134] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-23T20:07:00.907212] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-23T20:07:01.202544] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T20:07:01.309667] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-23T20:07:01.334542] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:01.335143] [INFO ] [MAIN ] BBVA: Loaded 49107 existing records. [2025-10-23T20:07:01.523499] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:01.523760] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-23T20:07:01.523841] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-23T20:07:01.524094] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-23T20:07:01.524183] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-23T20:07:01.607609] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-23T20:07:01.650434] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T20:07:01.891507] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:02.399412] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-23T20:07:02.702710] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T20:07:03.199435] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-23T20:07:03.999411] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-23T20:07:04.053018] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T20:07:04.157459] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T20:07:04.160501] [INFO ] [REMOTE ] BBN: Full fetch complete (25063 records). [2025-10-23T20:07:04.160613] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-23T20:07:04.553820] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-23T20:07:04.553965] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-23T20:07:04.554497] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-23T20:07:04.554576] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-23T20:07:04.555409] [DEBUG] [LOCAL ] BBN: Trimmed 25063 records to 17906 (keeping 200 days of data) [2025-10-23T20:07:04.668795] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T20:07:04.687173] [DEBUG] [LOCAL ] BBN: Primary data saved (17906 records). [2025-10-23T20:07:04.687357] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-23T20:07:04.687476] [INFO ] [MAIN ] Update Progress: 224/2367 symbols completed. BBN took 23.8s. Estimated remaining: 4h 18m 23s. Rate: 8.3 symbols/min [2025-10-23T20:07:04.804617] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-23T20:07:04.858712] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:04.885079] [DEBUG] [LOCAL ] BBW: Loaded 27233 existing records from primary storage. [2025-10-23T20:07:04.885369] [INFO ] [MAIN ] BBW: Loaded 27233 existing records. [2025-10-23T20:07:05.063243] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:05.063468] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-23T20:07:05.063546] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-23T20:07:05.063847] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-23T20:07:05.063941] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-23T20:07:05.434829] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T20:07:05.439980] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:05.599416] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-23T20:07:06.399448] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-23T20:07:06.965023] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T20:07:07.189246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T20:07:07.199384] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-23T20:07:07.929211] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-23T20:07:07.999463] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-23T20:07:08.799401] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-23T20:07:08.957684] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T20:07:09.132429] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T20:07:09.599446] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-23T20:07:10.399488] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-23T20:07:11.165709] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T20:07:11.201047] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-23T20:07:11.203964] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T20:07:11.680850] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-23T20:07:11.999470] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-23T20:07:12.799472] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-23T20:07:13.543829] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-23T20:07:13.599409] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-23T20:07:13.801563] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T20:07:13.960501] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-23T20:07:14.399464] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-23T20:07:15.171709] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T20:07:15.199423] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-23T20:07:15.910828] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T20:07:15.913353] [INFO ] [REMOTE ] BBU: Full fetch complete (7516 records). [2025-10-23T20:07:15.913441] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-23T20:07:16.004727] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-23T20:07:16.271592] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-23T20:07:16.271732] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-23T20:07:16.271943] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-23T20:07:16.272013] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-23T20:07:16.272459] [DEBUG] [LOCAL ] BBU: Trimmed 7516 records to 5819 (keeping 200 days of data) [2025-10-23T20:07:16.307127] [DEBUG] [LOCAL ] BBU: Primary data saved (5819 records). [2025-10-23T20:07:16.307293] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-23T20:07:16.307415] [INFO ] [MAIN ] Update Progress: 225/2367 symbols completed. BBU took 18.3s. Estimated remaining: 4h 18m 58s. Rate: 8.3 symbols/min [2025-10-23T20:07:16.471561] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:16.517113] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-23T20:07:16.517462] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-23T20:07:16.693557] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:16.693856] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-23T20:07:16.693935] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-23T20:07:16.694317] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-23T20:07:16.694393] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-23T20:07:16.804715] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-23T20:07:17.046040] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:17.258536] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T20:07:17.599437] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-23T20:07:18.399430] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-23T20:07:18.777240] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T20:07:18.855900] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T20:07:19.199537] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-23T20:07:19.999409] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-23T20:07:20.328405] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T20:07:20.799472] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-23T20:07:21.053177] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T20:07:21.311930] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-23T20:07:21.454747] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-23T20:07:21.599412] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-23T20:07:22.399401] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-23T20:07:22.409589] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T20:07:23.199425] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-23T20:07:23.547533] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:07:23.999407] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-23T20:07:24.044765] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T20:07:24.799444] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-23T20:07:25.599423] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-23T20:07:25.710249] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T20:07:26.399439] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-23T20:07:26.463976] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T20:07:26.715501] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T20:07:27.199447] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-23T20:07:27.999572] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-23T20:07:28.262331] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T20:07:28.755834] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T20:07:28.799425] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-23T20:07:29.163546] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T20:07:29.512169] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T20:07:29.599454] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-23T20:07:30.399451] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-23T20:07:31.199457] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-23T20:07:31.338564] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T20:07:31.999438] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-23T20:07:32.083630] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T20:07:32.286369] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T20:07:32.799422] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-23T20:07:33.599415] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-23T20:07:33.630003] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T20:07:34.063425] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T20:07:34.399495] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-23T20:07:35.199504] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-23T20:07:35.539032] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T20:07:35.976809] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T20:07:35.999390] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-23T20:07:36.799432] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-23T20:07:37.144777] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T20:07:37.153475] [INFO ] [REMOTE ] BBVA: Full fetch complete (71914 records). [2025-10-23T20:07:37.153680] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-23T20:07:37.543326] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-23T20:07:37.543448] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-23T20:07:37.544271] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-23T20:07:37.544350] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-23T20:07:37.545687] [DEBUG] [LOCAL ] BBVA: Trimmed 71914 records to 49463 (keeping 200 days of data) [2025-10-23T20:07:37.604364] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-23T20:07:37.679765] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T20:07:37.779853] [INFO ] [REMOTE ] BBUC: Full fetch complete (19358 records). [2025-10-23T20:07:37.786998] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T20:07:37.788094] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-23T20:07:37.833036] [INFO ] [REMOTE ] BBW: Full fetch complete (39565 records). [2025-10-23T20:07:37.845871] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-23T20:07:38.397321] [DEBUG] [LOCAL ] BBVA: Primary data saved (49463 records). [2025-10-23T20:07:38.423009] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-23T20:07:38.443952] [INFO ] [MAIN ] Update Progress: 226/2367 symbols completed. BBVA took 37.9s. Estimated remaining: 4h 21m 11s. Rate: 8.2 symbols/min [2025-10-23T20:07:38.778101] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-23T20:07:38.785688] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-23T20:07:38.792372] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-23T20:07:38.803370] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-23T20:07:38.785851] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-23T20:07:38.819739] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-23T20:07:38.849472] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-23T20:07:38.849856] [DEBUG] [LOCAL ] BBUC: Trimmed 19358 records to 14063 (keeping 200 days of data) [2025-10-23T20:07:38.850057] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-23T20:07:38.880830] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:38.882531] [DEBUG] [LOCAL ] BBW: Trimmed 39565 records to 27371 (keeping 200 days of data) [2025-10-23T20:07:39.074622] [DEBUG] [LOCAL ] BBUC: Primary data saved (14063 records). [2025-10-23T20:07:39.075142] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-23T20:07:39.075263] [INFO ] [MAIN ] Update Progress: 227/2367 symbols completed. BBUC took 38.8s. Estimated remaining: 4h 20m 1s. Rate: 8.2 symbols/min [2025-10-23T20:07:39.242075] [DEBUG] [LOCAL ] BBY: Loaded 53437 existing records from primary storage. [2025-10-23T20:07:39.287371] [INFO ] [MAIN ] BBY: Loaded 53437 existing records. [2025-10-23T20:07:39.304404] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:39.455399] [DEBUG] [LOCAL ] BBW: Primary data saved (27371 records). [2025-10-23T20:07:39.459396] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-23T20:07:39.482069] [INFO ] [MAIN ] Update Progress: 228/2367 symbols completed. BBW took 34.8s. Estimated remaining: 4h 18m 49s. Rate: 8.3 symbols/min [2025-10-23T20:07:39.574611] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:39.640047] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-23T20:07:39.639881] [DEBUG] [LOCAL ] BC: Loaded 43892 existing records from primary storage. [2025-10-23T20:07:39.651075] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-23T20:07:39.682737] [INFO ] [MAIN ] BC: Loaded 43892 existing records. [2025-10-23T20:07:39.683571] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-23T20:07:39.689732] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-23T20:07:40.003873] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-23T20:07:39.970201] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:40.094591] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-23T20:07:40.151779] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:40.217742] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-23T20:07:40.217865] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-23T20:07:40.257313] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-23T20:07:40.270303] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-23T20:07:40.370569] [DEBUG] [LOCAL ] BCAT: Loaded 34203 existing records from primary storage. [2025-10-23T20:07:40.460621] [INFO ] [MAIN ] BCAT: Loaded 34203 existing records. [2025-10-23T20:07:40.558126] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:40.569673] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-23T20:07:40.950765] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:40.962737] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-23T20:07:40.983940] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-23T20:07:41.027427] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-23T20:07:41.050197] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:41.050342] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-23T20:07:41.084004] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-23T20:07:41.414139] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:41.414523] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-23T20:07:42.028706] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T20:07:42.040552] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-23T20:07:42.331374] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T20:07:42.399503] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-23T20:07:42.469100] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-23T20:07:42.729992] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T20:07:43.199445] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-23T20:07:43.582848] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T20:07:43.999497] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-23T20:07:44.023895] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T20:07:44.267339] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T20:07:44.799511] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-23T20:07:45.599478] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-23T20:07:45.818112] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T20:07:45.883451] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T20:07:46.399447] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-23T20:07:47.199503] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-23T20:07:47.311670] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T20:07:47.744368] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T20:07:47.999479] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-23T20:07:48.799448] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-23T20:07:48.963689] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T20:07:49.599423] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-23T20:07:49.755065] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T20:07:50.242511] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T20:07:50.399418] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-23T20:07:51.199460] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-23T20:07:51.658159] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T20:07:51.667740] [INFO ] [REMOTE ] BBWI: Full fetch complete (77631 records). [2025-10-23T20:07:51.667913] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-23T20:07:52.009949] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-23T20:07:52.078907] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-23T20:07:52.079044] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-23T20:07:52.080161] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-23T20:07:52.080250] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-23T20:07:52.082066] [DEBUG] [LOCAL ] BBWI: Trimmed 77631 records to 53981 (keeping 200 days of data) [2025-10-23T20:07:52.341774] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T20:07:52.444842] [DEBUG] [LOCAL ] BBWI: Primary data saved (53981 records). [2025-10-23T20:07:52.445009] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-23T20:07:52.445125] [INFO ] [MAIN ] Update Progress: 229/2367 symbols completed. BBWI took 36.1s. Estimated remaining: 4h 19m 35s. Rate: 8.2 symbols/min [2025-10-23T20:07:52.639022] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:07:52.658055] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T20:07:52.687401] [DEBUG] [LOCAL ] BCC: Loaded 28624 existing records from primary storage. [2025-10-23T20:07:52.687750] [INFO ] [MAIN ] BCC: Loaded 28624 existing records. [2025-10-23T20:07:52.804494] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-23T20:07:52.868014] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:07:52.868360] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-23T20:07:52.868436] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-23T20:07:52.868686] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-23T20:07:52.868760] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-23T20:07:53.227492] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:07:53.599456] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-23T20:07:53.878373] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:07:54.399423] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-23T20:07:54.453415] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T20:07:55.199447] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-23T20:07:55.663240] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:07:55.734596] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T20:07:55.999425] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-23T20:07:56.754838] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T20:07:56.799405] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-23T20:07:57.280485] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T20:07:57.599463] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-23T20:07:58.404741] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-23T20:07:58.420572] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T20:07:59.199481] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-23T20:07:59.417074] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T20:07:59.844736] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T20:07:59.999464] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-23T20:08:00.348585] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T20:08:00.799424] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-23T20:08:01.599431] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-23T20:08:01.636915] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T20:08:02.399430] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-23T20:08:02.919573] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T20:08:03.199466] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-23T20:08:03.820080] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-23T20:08:03.999436] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-23T20:08:04.615635] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T20:08:04.655185] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-23T20:08:04.799467] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-23T20:08:05.599421] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-23T20:08:05.640710] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T20:08:05.647920] [INFO ] [REMOTE ] BC: Full fetch complete (63783 records). [2025-10-23T20:08:05.648114] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-23T20:08:06.065911] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-23T20:08:06.066122] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-23T20:08:06.066974] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-23T20:08:06.067151] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-23T20:08:06.068493] [DEBUG] [LOCAL ] BC: Trimmed 63783 records to 44257 (keeping 200 days of data) [2025-10-23T20:08:06.206028] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T20:08:06.368760] [DEBUG] [LOCAL ] BC: Primary data saved (44257 records). [2025-10-23T20:08:06.368942] [INFO ] [MAIN ] BC: Full history saved. [2025-10-23T20:08:06.369062] [INFO ] [MAIN ] Update Progress: 230/2367 symbols completed. BC took 27.3s. Estimated remaining: 4h 20m 30s. Rate: 8.2 symbols/min [2025-10-23T20:08:06.400337] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-23T20:08:06.537475] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:06.584505] [DEBUG] [LOCAL ] BCE: Loaded 52266 existing records from primary storage. [2025-10-23T20:08:06.584865] [INFO ] [MAIN ] BCE: Loaded 52266 existing records. [2025-10-23T20:08:06.757155] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:06.757410] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-23T20:08:06.757484] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-23T20:08:06.757768] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-23T20:08:06.757843] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-23T20:08:07.111010] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:07.199398] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-23T20:08:07.368172] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-23T20:08:07.544254] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-23T20:08:07.999439] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-23T20:08:08.804691] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-23T20:08:08.830139] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T20:08:09.316099] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T20:08:09.599433] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-23T20:08:10.399417] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-23T20:08:10.707018] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T20:08:10.861314] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T20:08:11.199455] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-23T20:08:11.875709] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T20:08:11.999463] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-23T20:08:12.548064] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T20:08:12.799487] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-23T20:08:13.599418] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-23T20:08:13.754921] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T20:08:14.399464] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-23T20:08:14.808013] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T20:08:15.141928] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T20:08:15.147884] [INFO ] [REMOTE ] BCC: Full fetch complete (41683 records). [2025-10-23T20:08:15.147998] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-23T20:08:15.210269] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-23T20:08:15.518526] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-23T20:08:15.518678] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-23T20:08:15.519243] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-23T20:08:15.519317] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-23T20:08:15.520381] [DEBUG] [LOCAL ] BCC: Trimmed 41683 records to 28829 (keeping 200 days of data) [2025-10-23T20:08:15.690608] [DEBUG] [LOCAL ] BCC: Primary data saved (28829 records). [2025-10-23T20:08:15.690788] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-23T20:08:15.690916] [INFO ] [MAIN ] Update Progress: 231/2367 symbols completed. BCC took 23.2s. Estimated remaining: 4h 20m 41s. Rate: 8.2 symbols/min [2025-10-23T20:08:15.862366] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:15.889327] [DEBUG] [LOCAL ] BCH: Loaded 30088 existing records from primary storage. [2025-10-23T20:08:15.889680] [INFO ] [MAIN ] BCH: Loaded 30088 existing records. [2025-10-23T20:08:16.008474] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-23T20:08:16.079358] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:16.079795] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-23T20:08:16.079934] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-23T20:08:16.080361] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-23T20:08:16.080461] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-23T20:08:16.384483] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T20:08:16.502823] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:16.799431] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-23T20:08:17.326376] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-23T20:08:17.335736] [INFO ] [REMOTE ] BBY: Full fetch complete (77400 records). [2025-10-23T20:08:17.335896] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-23T20:08:17.604607] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-23T20:08:17.775816] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-23T20:08:17.776335] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-23T20:08:17.777574] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T20:08:17.778604] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-23T20:08:17.784950] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-23T20:08:17.785239] [INFO ] [REMOTE ] BCAT: Full fetch complete (50129 records). [2025-10-23T20:08:17.785347] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-23T20:08:17.873604] [DEBUG] [LOCAL ] BBY: Trimmed 77400 records to 53823 (keeping 200 days of data) [2025-10-23T20:08:18.190195] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T20:08:18.305956] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-23T20:08:18.306999] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-23T20:08:18.308619] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-23T20:08:18.310883] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-23T20:08:18.333879] [DEBUG] [LOCAL ] BCAT: Trimmed 50129 records to 34467 (keeping 200 days of data) [2025-10-23T20:08:18.438635] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-23T20:08:18.744833] [DEBUG] [LOCAL ] BBY: Primary data saved (53823 records). [2025-10-23T20:08:18.752828] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-23T20:08:18.754779] [INFO ] [MAIN ] Update Progress: 232/2367 symbols completed. BBY took 40.3s. Estimated remaining: 4h 19m 54s. Rate: 8.2 symbols/min [2025-10-23T20:08:18.842397] [DEBUG] [LOCAL ] BCAT: Primary data saved (34467 records). [2025-10-23T20:08:18.866338] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-23T20:08:18.869378] [INFO ] [MAIN ] Update Progress: 233/2367 symbols completed. BCAT took 39.4s. Estimated remaining: 4h 18m 41s. Rate: 8.2 symbols/min [2025-10-23T20:08:19.014163] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:19.122329] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:19.146550] [DEBUG] [LOCAL ] BCO: Loaded 24959 existing records from primary storage. [2025-10-23T20:08:19.146941] [INFO ] [MAIN ] BCO: Loaded 24959 existing records. [2025-10-23T20:08:19.375737] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:19.379256] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-23T20:08:19.379367] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-23T20:08:19.379628] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-23T20:08:19.379756] [INFO ] [MAIN ] BCS: Loaded 53441 existing records. [2025-10-23T20:08:19.385257] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-23T20:08:19.402194] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-23T20:08:19.725255] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:19.775447] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-23T20:08:19.849975] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-23T20:08:19.850072] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-23T20:08:19.888629] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T20:08:19.899496] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-23T20:08:19.921728] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-23T20:08:19.921873] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-23T20:08:20.011360] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-23T20:08:20.208308] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:20.471306] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:20.799462] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-23T20:08:21.370245] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T20:08:21.599416] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-23T20:08:21.695228] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T20:08:21.958621] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T20:08:22.399492] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-23T20:08:22.695766] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T20:08:23.199415] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-23T20:08:23.509748] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T20:08:23.999442] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-23T20:08:24.430966] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-23T20:08:24.799476] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-23T20:08:25.599418] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-23T20:08:25.770992] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T20:08:26.399423] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-23T20:08:26.695999] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-23T20:08:26.783731] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T20:08:27.199425] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-23T20:08:27.950151] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T20:08:27.999402] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-23T20:08:28.423290] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T20:08:28.799429] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-23T20:08:29.599467] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-23T20:08:29.803470] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T20:08:30.399447] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-23T20:08:30.637740] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T20:08:31.070019] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T20:08:31.199391] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-23T20:08:31.704523] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T20:08:31.999444] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-23T20:08:32.799423] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-23T20:08:33.115493] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T20:08:33.321412] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-23T20:08:33.599434] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-23T20:08:34.399422] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-23T20:08:34.652728] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:08:34.661960] [INFO ] [REMOTE ] BCE: Full fetch complete (76106 records). [2025-10-23T20:08:34.662164] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-23T20:08:35.052826] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-23T20:08:35.052954] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-23T20:08:35.053802] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-23T20:08:35.053881] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-23T20:08:35.055301] [DEBUG] [LOCAL ] BCE: Trimmed 76106 records to 52643 (keeping 200 days of data) [2025-10-23T20:08:35.232336] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-23T20:08:35.383753] [DEBUG] [LOCAL ] BCE: Primary data saved (52643 records). [2025-10-23T20:08:35.384013] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-23T20:08:35.384135] [INFO ] [MAIN ] Update Progress: 234/2367 symbols completed. BCE took 29.0s. Estimated remaining: 4h 19m 58s. Rate: 8.2 symbols/min [2025-10-23T20:08:35.565140] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:35.583449] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T20:08:35.634957] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T20:08:35.657490] [DEBUG] [LOCAL ] BCSF: Loaded 28115 existing records from primary storage. [2025-10-23T20:08:35.657828] [INFO ] [MAIN ] BCSF: Loaded 28115 existing records. [2025-10-23T20:08:35.846388] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:35.846630] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-23T20:08:35.846722] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-23T20:08:35.846989] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-23T20:08:35.847066] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-23T20:08:36.004614] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-23T20:08:36.223313] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:36.302945] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T20:08:36.799453] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-23T20:08:36.912900] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T20:08:37.599478] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-23T20:08:37.889202] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T20:08:38.399482] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-23T20:08:38.807697] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T20:08:39.199456] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-23T20:08:39.416464] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T20:08:39.999481] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-23T20:08:40.799424] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-23T20:08:41.120894] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T20:08:41.236409] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T20:08:41.599455] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-23T20:08:41.701164] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T20:08:42.399470] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-23T20:08:42.976281] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T20:08:42.982430] [INFO ] [REMOTE ] BCH: Full fetch complete (41891 records). [2025-10-23T20:08:42.982598] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-23T20:08:43.204592] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-23T20:08:43.378622] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-23T20:08:43.378751] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-23T20:08:43.379383] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-23T20:08:43.379458] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-23T20:08:43.380346] [DEBUG] [LOCAL ] BCH: Trimmed 41891 records to 30215 (keeping 200 days of data) [2025-10-23T20:08:43.544479] [DEBUG] [LOCAL ] BCH: Primary data saved (30215 records). [2025-10-23T20:08:43.544633] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-23T20:08:43.544768] [INFO ] [MAIN ] Update Progress: 235/2367 symbols completed. BCH took 27.9s. Estimated remaining: 4h 19m 59s. Rate: 8.2 symbols/min [2025-10-23T20:08:43.710273] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:43.730288] [DEBUG] [LOCAL ] BCX: Loaded 22044 existing records from primary storage. [2025-10-23T20:08:43.730572] [INFO ] [MAIN ] BCX: Loaded 22044 existing records. [2025-10-23T20:08:43.908152] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:43.908471] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-23T20:08:43.908629] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-23T20:08:43.908870] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-23T20:08:43.908944] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-23T20:08:44.010000] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-23T20:08:44.294614] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:44.325593] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T20:08:44.640855] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T20:08:44.799437] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-23T20:08:45.122113] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T20:08:45.125525] [INFO ] [REMOTE ] BCO: Full fetch complete (36120 records). [2025-10-23T20:08:45.125620] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-23T20:08:45.490466] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-23T20:08:45.490569] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-23T20:08:45.491127] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-23T20:08:45.491206] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-23T20:08:45.492064] [DEBUG] [LOCAL ] BCO: Trimmed 36120 records to 25109 (keeping 200 days of data) [2025-10-23T20:08:45.599595] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-23T20:08:45.641971] [DEBUG] [LOCAL ] BCO: Primary data saved (25109 records). [2025-10-23T20:08:45.642097] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-23T20:08:45.642210] [INFO ] [MAIN ] Update Progress: 236/2367 symbols completed. BCO took 26.9s. Estimated remaining: 4h 19m 4s. Rate: 8.2 symbols/min [2025-10-23T20:08:45.806363] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:08:45.828620] [DEBUG] [LOCAL ] BDC: Loaded 24000 existing records from primary storage. [2025-10-23T20:08:45.828923] [INFO ] [MAIN ] BDC: Loaded 24000 existing records. [2025-10-23T20:08:46.003077] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:08:46.003241] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-23T20:08:46.003316] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-23T20:08:46.003687] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-23T20:08:46.003762] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-23T20:08:46.354683] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:08:46.399405] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-23T20:08:46.747093] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T20:08:46.860900] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T20:08:47.199429] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-23T20:08:47.539386] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T20:08:47.999444] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-23T20:08:48.391861] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T20:08:48.799426] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-23T20:08:49.188018] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T20:08:49.599424] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-23T20:08:50.405393] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-23T20:08:50.425899] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T20:08:51.010718] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T20:08:51.199446] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-23T20:08:51.710276] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T20:08:51.999428] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-23T20:08:52.302578] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T20:08:52.799420] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-23T20:08:53.257918] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:08:53.599427] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-23T20:08:53.798071] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-23T20:08:54.399446] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-23T20:08:55.199498] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-23T20:08:55.446224] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T20:08:55.473237] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T20:08:55.999437] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-23T20:08:56.125484] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T20:08:56.799446] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-23T20:08:57.599444] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-23T20:08:58.050428] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T20:08:58.328715] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-23T20:08:58.337931] [INFO ] [REMOTE ] BCS: Full fetch complete (77524 records). [2025-10-23T20:08:58.341309] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-23T20:08:58.404722] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-23T20:08:58.734498] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-23T20:08:58.734703] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-23T20:08:58.735681] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-23T20:08:58.735776] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-23T20:08:58.749718] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T20:08:58.755408] [DEBUG] [LOCAL ] BCS: Trimmed 77524 records to 53831 (keeping 200 days of data) [2025-10-23T20:08:59.069894] [DEBUG] [LOCAL ] BCS: Primary data saved (53831 records). [2025-10-23T20:08:59.070052] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-23T20:08:59.072007] [INFO ] [MAIN ] Update Progress: 237/2367 symbols completed. BCS took 40.2s. Estimated remaining: 4h 19m 52s. Rate: 8.2 symbols/min [2025-10-23T20:08:59.199423] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-23T20:08:59.645876] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T20:08:59.999426] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-23T20:09:00.453559] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T20:09:00.799436] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-23T20:09:01.599443] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-23T20:09:01.670782] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T20:09:02.399454] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-23T20:09:02.482584] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T20:09:03.199485] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-23T20:09:03.714585] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-23T20:09:03.869565] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T20:09:03.875941] [INFO ] [REMOTE ] BCSF: Full fetch complete (39792 records). [2025-10-23T20:09:03.876114] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-23T20:09:04.014891] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-23T20:09:04.254302] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-23T20:09:04.254438] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-23T20:09:04.255001] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-23T20:09:04.255086] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-23T20:09:04.255972] [DEBUG] [LOCAL ] BCSF: Trimmed 39792 records to 28326 (keeping 200 days of data) [2025-10-23T20:09:04.425391] [DEBUG] [LOCAL ] BCSF: Primary data saved (28326 records). [2025-10-23T20:09:04.425564] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-23T20:09:04.425709] [INFO ] [MAIN ] Update Progress: 238/2367 symbols completed. BCSF took 29.0s. Estimated remaining: 4h 19m 27s. Rate: 8.2 symbols/min [2025-10-23T20:09:04.590464] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T20:09:04.799545] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-23T20:09:04.836555] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T20:09:05.599413] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-23T20:09:05.992782] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T20:09:05.996931] [INFO ] [REMOTE ] BDC: Full fetch complete (35663 records). [2025-10-23T20:09:05.997046] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-23T20:09:06.362478] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-23T20:09:06.362588] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-23T20:09:06.363130] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-23T20:09:06.363206] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-23T20:09:06.364024] [DEBUG] [LOCAL ] BDC: Trimmed 35663 records to 24096 (keeping 200 days of data) [2025-10-23T20:09:06.509496] [DEBUG] [LOCAL ] BDC: Primary data saved (24096 records). [2025-10-23T20:09:06.509676] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-23T20:09:06.509795] [INFO ] [MAIN ] Update Progress: 239/2367 symbols completed. BDC took 20.9s. Estimated remaining: 4h 18m 33s. Rate: 8.2 symbols/min [2025-10-23T20:09:06.708971] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T20:09:06.714243] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-23T20:09:07.894679] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-23T20:09:07.900852] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-23T20:09:08.897947] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T20:09:08.902510] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-23T20:09:09.942340] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T20:09:09.946885] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-23T20:09:11.162201] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T20:09:11.167448] [INFO ] [REMOTE ] BCX: Full fetch complete (33643 records). [2025-10-23T20:09:11.167554] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-23T20:09:11.559125] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-23T20:09:11.559238] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-23T20:09:11.559838] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-23T20:09:11.559924] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-23T20:09:11.560867] [DEBUG] [LOCAL ] BCX: Trimmed 33643 records to 22191 (keeping 200 days of data) [2025-10-23T20:09:11.692776] [DEBUG] [LOCAL ] BCX: Primary data saved (22191 records). [2025-10-23T20:09:11.692950] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-23T20:09:11.693068] [INFO ] [MAIN ] Update Progress: 240/2367 symbols completed. BCX took 28.1s. Estimated remaining: 4h 18m 7s. Rate: 8.2 symbols/min [2025-10-23T20:09:12.252953] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:12.287591] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:12.360614] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:12.388876] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:12.389271] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-10-23T20:09:12.389459] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-10-23T20:09:12.389675] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-23T20:09:12.389737] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-23T20:09:12.389784] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-23T20:09:12.389819] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-23T20:09:12.559394] [DEBUG] [LOCAL ] BDJ: Loaded 29333 existing records from primary storage. [2025-10-23T20:09:12.594516] [INFO ] [MAIN ] BDJ: Loaded 29333 existing records. [2025-10-23T20:09:12.864210] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-23T20:09:12.926160] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-23T20:09:12.930157] [DEBUG] [LOCAL ] BDX: Loaded 52141 existing records from primary storage. [2025-10-23T20:09:12.982331] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:12.964521] [INFO ] [MAIN ] BDX: Loaded 52141 existing records. [2025-10-23T20:09:13.048085] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-23T20:09:13.069553] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:09:13.154259] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-23T20:09:13.222360] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-23T20:09:13.270552] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-23T20:09:13.311318] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-23T20:09:13.406542] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:09:13.462375] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:09:13.476780] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-23T20:09:13.494164] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-23T20:09:13.476986] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-23T20:09:13.516639] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-23T20:09:13.516856] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-23T20:09:13.516580] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-23T20:09:13.579429] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-23T20:09:13.617629] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-23T20:09:14.245531] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:14.307823] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-23T20:09:14.525435] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:14.549239] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:14.549699] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-23T20:09:14.550084] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-23T20:09:14.839540] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T20:09:14.849348] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-23T20:09:15.607091] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T20:09:15.613470] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-23T20:09:15.865604] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T20:09:15.876129] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-23T20:09:16.380470] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T20:09:16.389964] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-23T20:09:16.619232] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T20:09:16.629967] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-23T20:09:16.784581] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T20:09:16.799392] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-23T20:09:17.142764] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T20:09:17.599437] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-23T20:09:17.743221] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T20:09:17.852544] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T20:09:18.273600] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T20:09:18.399456] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-23T20:09:19.199420] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-23T20:09:19.315724] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T20:09:19.999430] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-23T20:09:20.493635] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T20:09:20.799476] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-23T20:09:20.919105] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T20:09:21.327931] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T20:09:21.599438] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-23T20:09:22.399416] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-23T20:09:22.757344] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T20:09:22.842319] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T20:09:23.199437] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-23T20:09:23.945583] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T20:09:23.999448] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-23T20:09:24.810086] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-23T20:09:24.816010] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T20:09:25.599413] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-23T20:09:25.978121] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T20:09:26.014053] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-23T20:09:26.399445] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-23T20:09:27.199438] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-23T20:09:27.414430] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:09:27.999407] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-23T20:09:28.148928] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T20:09:28.799438] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-23T20:09:28.834501] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T20:09:29.599480] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-23T20:09:30.138202] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-23T20:09:30.399441] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-23T20:09:30.689743] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T20:09:31.141060] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T20:09:31.199505] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-23T20:09:31.999454] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-23T20:09:32.569986] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T20:09:32.808704] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-23T20:09:32.814147] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-23T20:09:33.599454] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-23T20:09:33.856176] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T20:09:34.001951] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T20:09:34.399466] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-23T20:09:35.199567] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-23T20:09:35.999503] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-23T20:09:36.152773] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-23T20:09:36.229033] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T20:09:36.799436] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-23T20:09:36.939761] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-23T20:09:37.215035] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T20:09:37.599449] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-23T20:09:38.399458] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-23T20:09:38.647562] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:09:38.656588] [INFO ] [REMOTE ] BDX: Full fetch complete (75461 records). [2025-10-23T20:09:38.656811] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-23T20:09:39.088953] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-23T20:09:39.089100] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-23T20:09:39.090059] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-23T20:09:39.090145] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-23T20:09:39.091692] [DEBUG] [LOCAL ] BDX: Trimmed 75461 records to 52509 (keeping 200 days of data) [2025-10-23T20:09:39.200130] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-23T20:09:39.357787] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T20:09:39.464319] [DEBUG] [LOCAL ] BDX: Primary data saved (52509 records). [2025-10-23T20:09:39.464443] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-23T20:09:39.464551] [INFO ] [MAIN ] Update Progress: 241/2367 symbols completed. BDX took 27.8s. Estimated remaining: 4h 21m 1s. Rate: 8.1 symbols/min [2025-10-23T20:09:39.635500] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:39.635959] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-23T20:09:39.636029] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-23T20:09:39.636137] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-23T20:09:39.636206] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-23T20:09:39.636315] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-23T20:09:39.636382] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-23T20:09:39.828665] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T20:09:39.913836] [INFO ] [REMOTE ] BDJ: Full fetch complete (42771 records). [2025-10-23T20:09:39.937485] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-23T20:09:40.009192] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-23T20:09:40.139302] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:40.420356] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-23T20:09:40.420494] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-23T20:09:40.421460] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-23T20:09:40.421574] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-23T20:09:40.423090] [DEBUG] [LOCAL ] BDJ: Trimmed 42771 records to 29478 (keeping 200 days of data) [2025-10-23T20:09:40.611138] [DEBUG] [LOCAL ] BDJ: Primary data saved (29478 records). [2025-10-23T20:09:40.611334] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-23T20:09:40.612813] [INFO ] [MAIN ] Update Progress: 242/2367 symbols completed. BDJ took 28.9s. Estimated remaining: 4h 19m 59s. Rate: 8.2 symbols/min [2025-10-23T20:09:40.778275] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:40.809772] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-23T20:09:40.833555] [DEBUG] [LOCAL ] BEKE: Loaded 53197 existing records from primary storage. [2025-10-23T20:09:40.833950] [INFO ] [MAIN ] BEKE: Loaded 53197 existing records. [2025-10-23T20:09:41.006604] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:09:41.006842] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-23T20:09:41.006919] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-23T20:09:41.007420] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-23T20:09:41.007497] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-23T20:09:41.165515] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-23T20:09:41.412825] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:41.599409] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-23T20:09:41.774951] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T20:09:41.940490] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-23T20:09:41.950993] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-23T20:09:41.951188] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-23T20:09:42.365418] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-23T20:09:42.365560] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-23T20:09:42.366456] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-23T20:09:42.366539] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-23T20:09:42.368080] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 54051 (keeping 200 days of data) [2025-10-23T20:09:42.416725] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-23T20:09:42.705340] [DEBUG] [LOCAL ] BE: Primary data saved (54051 records). [2025-10-23T20:09:42.705524] [INFO ] [MAIN ] BE: Full history saved. [2025-10-23T20:09:42.705677] [INFO ] [MAIN ] Update Progress: 243/2367 symbols completed. BE took 31.0s. Estimated remaining: 4h 19m 6s. Rate: 8.2 symbols/min [2025-10-23T20:09:42.808421] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-23T20:09:42.881803] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:42.930555] [DEBUG] [LOCAL ] BEN: Loaded 53114 existing records from primary storage. [2025-10-23T20:09:42.930941] [INFO ] [MAIN ] BEN: Loaded 53114 existing records. [2025-10-23T20:09:43.125259] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:09:43.125602] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-23T20:09:43.125713] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-23T20:09:43.125945] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-23T20:09:43.126018] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-23T20:09:43.209728] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-23T20:09:43.504424] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:43.534367] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T20:09:43.999447] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-23T20:09:44.799429] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-23T20:09:45.040107] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T20:09:45.049155] [INFO ] [REMOTE ] BDN: Full fetch complete (69421 records). [2025-10-23T20:09:45.049375] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-23T20:09:45.473240] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-23T20:09:45.473396] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-23T20:09:45.474316] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-23T20:09:45.474399] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-23T20:09:45.475821] [DEBUG] [LOCAL ] BDN: Trimmed 69421 records to 47979 (keeping 200 days of data) [2025-10-23T20:09:45.602690] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-23T20:09:45.759531] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T20:09:45.825969] [DEBUG] [LOCAL ] BDN: Primary data saved (47979 records). [2025-10-23T20:09:45.826132] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-23T20:09:45.826252] [INFO ] [MAIN ] Update Progress: 244/2367 symbols completed. BDN took 34.1s. Estimated remaining: 4h 18m 22s. Rate: 8.2 symbols/min [2025-10-23T20:09:46.043948] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:09:46.080453] [DEBUG] [LOCAL ] BEP: Loaded 38937 existing records from primary storage. [2025-10-23T20:09:46.080842] [INFO ] [MAIN ] BEP: Loaded 38937 existing records. [2025-10-23T20:09:46.170154] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T20:09:46.279386] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:09:46.279772] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-23T20:09:46.279860] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-23T20:09:46.280524] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-23T20:09:46.280599] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-23T20:09:46.405738] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-23T20:09:46.687844] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:09:46.690034] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T20:09:46.821550] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-23T20:09:47.199474] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-23T20:09:47.999446] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-23T20:09:48.730975] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T20:09:48.799438] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-23T20:09:49.599461] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-23T20:09:49.947521] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T20:09:50.085296] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T20:09:50.359616] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T20:09:50.399404] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-23T20:09:51.199454] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-23T20:09:51.999428] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-23T20:09:52.213030] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T20:09:52.309936] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-23T20:09:52.799420] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-23T20:09:52.878886] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T20:09:53.599417] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-23T20:09:54.399491] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-23T20:09:54.580779] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T20:09:54.631255] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-23T20:09:55.199400] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-23T20:09:55.420013] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-23T20:09:55.479578] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T20:09:55.999447] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-23T20:09:56.799451] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-23T20:09:57.485241] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T20:09:57.599429] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-23T20:09:58.399442] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-23T20:09:58.732528] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T20:09:59.199439] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-23T20:09:59.341152] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T20:09:59.999433] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-23T20:10:00.069521] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T20:10:00.307962] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-23T20:10:00.799439] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-23T20:10:00.860810] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T20:10:01.438310] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T20:10:01.439819] [INFO ] [REMOTE ] BEDU: Full fetch complete (1334 records). [2025-10-23T20:10:01.439919] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-23T20:10:01.605126] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-23T20:10:01.641996] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-23T20:10:01.642942] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:10:01.643034] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:10:01.643126] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-23T20:10:01.643235] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-23T20:10:01.643326] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-23T20:10:01.643432] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-23T20:10:01.643721] [INFO ] [MAIN ] Update Progress: 245/2367 symbols completed. BEDU took 22.2s. Estimated remaining: 4h 19m 28s. Rate: 8.2 symbols/min [2025-10-23T20:10:01.849253] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:01.907602] [DEBUG] [LOCAL ] BEPC: Loaded 46357 existing records from primary storage. [2025-10-23T20:10:01.907979] [INFO ] [MAIN ] BEPC: Loaded 46357 existing records. [2025-10-23T20:10:02.087933] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:10:02.088235] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-23T20:10:02.088314] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-23T20:10:02.088542] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-23T20:10:02.088615] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-23T20:10:02.404553] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-23T20:10:02.470979] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:03.199485] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-23T20:10:04.004615] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-23T20:10:04.023487] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-23T20:10:04.799507] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-23T20:10:05.246369] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-23T20:10:05.599448] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-23T20:10:05.807918] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-23T20:10:06.292215] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-23T20:10:06.399432] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-23T20:10:06.579480] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:10:07.199469] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-23T20:10:07.637009] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T20:10:07.793973] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T20:10:07.999442] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-23T20:10:08.487262] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T20:10:08.799455] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-23T20:10:09.599452] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-23T20:10:09.988129] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T20:10:10.341625] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T20:10:10.399406] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-23T20:10:11.199413] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-23T20:10:11.615552] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T20:10:11.895295] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T20:10:11.999436] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-23T20:10:12.799445] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-23T20:10:13.091476] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T20:10:13.169109] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T20:10:13.599426] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-23T20:10:14.399413] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-23T20:10:14.893868] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-23T20:10:14.903102] [INFO ] [REMOTE ] BEKE: Full fetch complete (77329 records). [2025-10-23T20:10:14.903247] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-23T20:10:15.204495] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-23T20:10:15.300143] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-23T20:10:15.300437] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-23T20:10:15.301834] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-23T20:10:15.301939] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-23T20:10:15.303690] [DEBUG] [LOCAL ] BEKE: Trimmed 77329 records to 53575 (keeping 200 days of data) [2025-10-23T20:10:15.443167] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T20:10:15.662911] [DEBUG] [LOCAL ] BEKE: Primary data saved (53575 records). [2025-10-23T20:10:15.663109] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-23T20:10:15.663224] [INFO ] [MAIN ] Update Progress: 246/2367 symbols completed. BEKE took 35.1s. Estimated remaining: 4h 20m 18s. Rate: 8.1 symbols/min [2025-10-23T20:10:15.856866] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:15.857116] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-10-23T20:10:15.857207] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-10-23T20:10:15.857352] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-23T20:10:15.857440] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-23T20:10:15.857544] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-23T20:10:15.857630] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-23T20:10:16.004529] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-23T20:10:16.259077] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:16.279954] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T20:10:16.288036] [INFO ] [REMOTE ] BEP: Full fetch complete (59249 records). [2025-10-23T20:10:16.288229] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-23T20:10:16.668126] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-23T20:10:16.668398] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-23T20:10:16.669144] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-23T20:10:16.669227] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-23T20:10:16.670474] [DEBUG] [LOCAL ] BEP: Trimmed 59249 records to 39180 (keeping 200 days of data) [2025-10-23T20:10:16.840871] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-23T20:10:16.930318] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T20:10:16.951467] [DEBUG] [LOCAL ] BEP: Primary data saved (39180 records). [2025-10-23T20:10:16.951637] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-23T20:10:16.951814] [INFO ] [MAIN ] Update Progress: 247/2367 symbols completed. BEP took 31.1s. Estimated remaining: 4h 19m 19s. Rate: 8.2 symbols/min [2025-10-23T20:10:17.120118] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:17.126526] [DEBUG] [LOCAL ] BEPI: Loaded 3563 existing records from primary storage. [2025-10-23T20:10:17.126832] [INFO ] [MAIN ] BEPI: Loaded 3563 existing records. [2025-10-23T20:10:17.304139] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:10:17.304483] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-23T20:10:17.304587] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-23T20:10:17.308614] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-23T20:10:17.308781] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-23T20:10:17.308945] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-23T20:10:17.604584] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-23T20:10:17.674535] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:17.879272] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T20:10:17.888814] [INFO ] [REMOTE ] BEN: Full fetch complete (77065 records). [2025-10-23T20:10:17.889037] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-23T20:10:18.280833] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-23T20:10:18.280965] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-23T20:10:18.281848] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-23T20:10:18.281934] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-23T20:10:18.283466] [DEBUG] [LOCAL ] BEN: Trimmed 77065 records to 53501 (keeping 200 days of data) [2025-10-23T20:10:18.399704] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-23T20:10:18.604075] [DEBUG] [LOCAL ] BEN: Primary data saved (53501 records). [2025-10-23T20:10:18.604276] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-23T20:10:18.604430] [INFO ] [MAIN ] Update Progress: 248/2367 symbols completed. BEN took 35.9s. Estimated remaining: 4h 18m 23s. Rate: 8.2 symbols/min [2025-10-23T20:10:18.775844] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:18.781429] [DEBUG] [LOCAL ] BEPJ: Loaded 3041 existing records from primary storage. [2025-10-23T20:10:18.781742] [INFO ] [MAIN ] BEPJ: Loaded 3041 existing records. [2025-10-23T20:10:18.973954] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:10:18.977083] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-23T20:10:18.977212] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-23T20:10:18.978637] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-23T20:10:18.978837] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-23T20:10:18.978910] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-23T20:10:19.204592] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-23T20:10:19.361362] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:19.389004] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:10:19.814515] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T20:10:19.999484] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-23T20:10:20.473981] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T20:10:20.799433] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-23T20:10:21.371146] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-23T20:10:21.599428] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-23T20:10:22.223877] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T20:10:22.399476] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-23T20:10:23.156326] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T20:10:23.199444] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-23T20:10:23.818179] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T20:10:23.999433] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-23T20:10:24.799445] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-23T20:10:25.384513] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T20:10:25.604699] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-23T20:10:25.619434] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T20:10:26.191493] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T20:10:26.399473] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-23T20:10:26.834835] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T20:10:27.199481] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-23T20:10:27.668822] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T20:10:27.999478] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-23T20:10:28.302121] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-23T20:10:28.799437] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-23T20:10:29.437203] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T20:10:29.599476] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-23T20:10:30.399516] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-23T20:10:31.100196] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-23T20:10:31.199460] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-23T20:10:31.320565] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T20:10:31.808204] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T20:10:31.999447] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-23T20:10:32.681990] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-23T20:10:32.799405] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-23T20:10:33.243911] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T20:10:33.599431] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-23T20:10:34.399438] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-23T20:10:34.860415] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T20:10:35.212710] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-23T20:10:35.215222] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T20:10:35.745410] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-23T20:10:35.999436] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-23T20:10:36.590395] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-23T20:10:36.591457] [INFO ] [REMOTE ] BEPI: Full fetch complete (4673 records). [2025-10-23T20:10:36.591567] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-23T20:10:36.804540] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-23T20:10:36.946045] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-23T20:10:36.946165] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-23T20:10:36.946357] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-23T20:10:36.946432] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-23T20:10:36.946905] [DEBUG] [LOCAL ] BEPI: Trimmed 4673 records to 3579 (keeping 200 days of data) [2025-10-23T20:10:36.975326] [DEBUG] [LOCAL ] BEPI: Primary data saved (3579 records). [2025-10-23T20:10:36.975482] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-23T20:10:36.975604] [INFO ] [MAIN ] Update Progress: 249/2367 symbols completed. BEPI took 20.0s. Estimated remaining: 4h 19m 50s. Rate: 8.2 symbols/min [2025-10-23T20:10:37.153211] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:37.186528] [DEBUG] [LOCAL ] BFAM: Loaded 33784 existing records from primary storage. [2025-10-23T20:10:37.186862] [INFO ] [MAIN ] BFAM: Loaded 33784 existing records. [2025-10-23T20:10:37.361841] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:10:37.362026] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-23T20:10:37.362105] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-23T20:10:37.362314] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-23T20:10:37.362384] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-23T20:10:37.477873] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T20:10:37.604839] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-23T20:10:37.720980] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:38.303162] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T20:10:38.399480] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-23T20:10:38.960399] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-23T20:10:39.199515] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-23T20:10:39.999456] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-23T20:10:40.440974] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T20:10:40.799487] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-23T20:10:40.829433] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T20:10:41.247017] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T20:10:41.599473] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-23T20:10:42.194525] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T20:10:42.399434] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-23T20:10:43.199421] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-23T20:10:43.676114] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T20:10:43.676967] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4379 records). [2025-10-23T20:10:43.677054] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-23T20:10:44.007388] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-23T20:10:44.046179] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-23T20:10:44.046317] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-23T20:10:44.046790] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-23T20:10:44.046971] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-23T20:10:44.047451] [DEBUG] [LOCAL ] BEPJ: Trimmed 4379 records to 3089 (keeping 200 days of data) [2025-10-23T20:10:44.066024] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3089 records). [2025-10-23T20:10:44.066148] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-23T20:10:44.066374] [INFO ] [MAIN ] Update Progress: 250/2367 symbols completed. BEPJ took 25.5s. Estimated remaining: 4h 19m 40s. Rate: 8.2 symbols/min [2025-10-23T20:10:44.190388] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T20:10:44.248691] [INFO ] [REMOTE ] BEPC: Full fetch complete (68871 records). [2025-10-23T20:10:44.267905] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:44.264888] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-23T20:10:44.268170] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-10-23T20:10:44.268287] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-10-23T20:10:44.268398] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-23T20:10:44.268465] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-23T20:10:44.268528] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-23T20:10:44.268594] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-23T20:10:44.735536] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T20:10:44.802738] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-23T20:10:45.040358] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-23T20:10:45.051917] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-23T20:10:45.051834] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:45.053036] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-23T20:10:45.053428] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-23T20:10:45.054942] [DEBUG] [LOCAL ] BEPC: Trimmed 68871 records to 46678 (keeping 200 days of data) [2025-10-23T20:10:45.335033] [DEBUG] [LOCAL ] BEPC: Primary data saved (46678 records). [2025-10-23T20:10:45.335218] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-23T20:10:45.336464] [INFO ] [MAIN ] Update Progress: 251/2367 symbols completed. BEPC took 43.7s. Estimated remaining: 4h 18m 41s. Rate: 8.2 symbols/min [2025-10-23T20:10:45.503243] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:45.518919] [DEBUG] [LOCAL ] BFK: Loaded 13872 existing records from primary storage. [2025-10-23T20:10:45.519178] [INFO ] [MAIN ] BFK: Loaded 13872 existing records. [2025-10-23T20:10:45.608326] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-23T20:10:45.697156] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:10:45.697354] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-23T20:10:45.697429] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-23T20:10:45.697618] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-23T20:10:45.697726] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-23T20:10:46.054421] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:46.071867] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T20:10:46.399428] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-23T20:10:47.162327] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:10:47.199467] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-23T20:10:47.287279] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T20:10:47.999699] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-23T20:10:48.479867] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T20:10:48.799483] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-23T20:10:49.085849] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T20:10:49.599431] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-23T20:10:50.239533] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T20:10:50.371632] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T20:10:50.399455] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-23T20:10:51.199428] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-23T20:10:51.352907] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T20:10:51.999448] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-23T20:10:52.601816] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T20:10:52.799441] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-23T20:10:53.010797] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T20:10:53.358005] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T20:10:53.359466] [INFO ] [REMOTE ] BEPH: Full fetch complete (7526 records). [2025-10-23T20:10:53.359562] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-23T20:10:53.609252] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-23T20:10:53.731382] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-23T20:10:53.731523] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-23T20:10:53.731792] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-23T20:10:53.731872] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-23T20:10:53.732463] [DEBUG] [LOCAL ] BEPH: Trimmed 7526 records to 4915 (keeping 200 days of data) [2025-10-23T20:10:53.763102] [DEBUG] [LOCAL ] BEPH: Primary data saved (4915 records). [2025-10-23T20:10:53.763281] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-23T20:10:53.763392] [INFO ] [MAIN ] Update Progress: 252/2367 symbols completed. BEPH took 38.1s. Estimated remaining: 4h 18m 43s. Rate: 8.2 symbols/min [2025-10-23T20:10:53.933583] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:10:53.982341] [DEBUG] [LOCAL ] BFLY: Loaded 51865 existing records from primary storage. [2025-10-23T20:10:53.982690] [INFO ] [MAIN ] BFLY: Loaded 51865 existing records. [2025-10-23T20:10:54.156451] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:10:54.156732] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-23T20:10:54.156808] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-23T20:10:54.157040] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-23T20:10:54.157114] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-23T20:10:54.404560] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-23T20:10:54.508713] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:10:55.054947] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T20:10:55.199425] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-23T20:10:55.294914] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T20:10:55.999431] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-23T20:10:56.769674] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T20:10:56.799411] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-23T20:10:57.259568] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:10:57.599437] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-23T20:10:58.399421] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-23T20:10:58.558906] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T20:10:58.830295] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T20:10:59.199439] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-23T20:11:00.008413] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-23T20:11:00.038082] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T20:11:00.685076] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T20:11:00.799438] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-23T20:11:01.133983] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T20:11:01.599418] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-23T20:11:02.404597] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-23T20:11:02.413944] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T20:11:02.498979] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T20:11:03.199466] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-23T20:11:03.999421] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-23T20:11:04.466376] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-23T20:11:04.799535] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-23T20:11:04.935440] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T20:11:04.941795] [INFO ] [REMOTE ] BFAM: Full fetch complete (47364 records). [2025-10-23T20:11:04.941927] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-23T20:11:05.322834] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-23T20:11:05.322962] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-23T20:11:05.323675] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-23T20:11:05.323763] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-23T20:11:05.324981] [DEBUG] [LOCAL ] BFAM: Trimmed 47364 records to 34042 (keeping 200 days of data) [2025-10-23T20:11:05.526076] [DEBUG] [LOCAL ] BFAM: Primary data saved (34042 records). [2025-10-23T20:11:05.526295] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-23T20:11:05.526526] [INFO ] [MAIN ] Update Progress: 253/2367 symbols completed. BFAM took 28.6s. Estimated remaining: 4h 19m 13s. Rate: 8.2 symbols/min [2025-10-23T20:11:05.617085] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-23T20:11:05.653370] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T20:11:05.744207] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:05.755930] [DEBUG] [LOCAL ] BFS: Loaded 9560 existing records from primary storage. [2025-10-23T20:11:05.756201] [INFO ] [MAIN ] BFS: Loaded 9560 existing records. [2025-10-23T20:11:05.934093] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:05.934344] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-23T20:11:05.934438] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-23T20:11:05.934764] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-23T20:11:05.934856] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-23T20:11:06.302788] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:06.399395] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-23T20:11:06.428685] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T20:11:06.647671] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T20:11:07.158779] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T20:11:07.199442] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-23T20:11:07.999448] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-23T20:11:08.727457] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T20:11:08.799423] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-23T20:11:08.938852] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T20:11:09.553436] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T20:11:09.599409] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-23T20:11:10.375632] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T20:11:10.399415] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-23T20:11:11.199446] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-23T20:11:11.217774] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T20:11:11.999484] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-23T20:11:12.799432] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-23T20:11:12.827179] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T20:11:12.982034] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:11:13.599424] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-23T20:11:14.382591] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T20:11:14.399426] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-23T20:11:14.757762] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T20:11:15.125489] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T20:11:15.128565] [INFO ] [REMOTE ] BFK: Full fetch complete (19290 records). [2025-10-23T20:11:15.128703] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-23T20:11:15.204527] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-23T20:11:15.548738] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-23T20:11:15.548841] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-23T20:11:15.549280] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-23T20:11:15.549367] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-23T20:11:15.549959] [DEBUG] [LOCAL ] BFK: Trimmed 19290 records to 14005 (keeping 200 days of data) [2025-10-23T20:11:15.634874] [DEBUG] [LOCAL ] BFK: Primary data saved (14005 records). [2025-10-23T20:11:15.635030] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-23T20:11:15.635137] [INFO ] [MAIN ] Update Progress: 254/2367 symbols completed. BFK took 30.3s. Estimated remaining: 4h 19m 28s. Rate: 8.1 symbols/min [2025-10-23T20:11:15.800616] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:15.814069] [DEBUG] [LOCAL ] BFZ: Loaded 12049 existing records from primary storage. [2025-10-23T20:11:15.814297] [INFO ] [MAIN ] BFZ: Loaded 12049 existing records. [2025-10-23T20:11:15.987888] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:15.988131] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-23T20:11:15.988221] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-23T20:11:15.988427] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-23T20:11:15.988519] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-23T20:11:16.009085] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-23T20:11:16.350000] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:16.799439] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-23T20:11:16.903215] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-23T20:11:17.096893] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T20:11:17.590986] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T20:11:17.599391] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-23T20:11:18.399411] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-23T20:11:18.448236] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-23T20:11:19.199513] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-23T20:11:19.365565] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T20:11:19.999492] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-23T20:11:20.753574] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T20:11:20.799429] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-23T20:11:20.858404] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T20:11:21.599478] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-23T20:11:22.399451] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-23T20:11:23.199428] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-23T20:11:23.446370] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T20:11:23.485345] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-23T20:11:23.746037] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T20:11:23.748535] [INFO ] [REMOTE ] BFS: Full fetch complete (13063 records). [2025-10-23T20:11:23.748708] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-23T20:11:24.004527] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-23T20:11:24.119144] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-23T20:11:24.119266] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-23T20:11:24.119591] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-23T20:11:24.119688] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-23T20:11:24.120226] [DEBUG] [LOCAL ] BFS: Trimmed 13063 records to 9613 (keeping 200 days of data) [2025-10-23T20:11:24.173406] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T20:11:24.193133] [DEBUG] [LOCAL ] BFS: Primary data saved (9613 records). [2025-10-23T20:11:24.193237] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-23T20:11:24.193355] [INFO ] [MAIN ] Update Progress: 255/2367 symbols completed. BFS took 18.7s. Estimated remaining: 4h 19m 31s. Rate: 8.1 symbols/min [2025-10-23T20:11:24.363836] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:24.409008] [DEBUG] [LOCAL ] BG: Loaded 50547 existing records from primary storage. [2025-10-23T20:11:24.409328] [INFO ] [MAIN ] BG: Loaded 50547 existing records. [2025-10-23T20:11:24.582572] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:24.582773] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-23T20:11:24.582848] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-23T20:11:24.583084] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-23T20:11:24.583162] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-23T20:11:24.804882] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-23T20:11:24.950674] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:25.567436] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T20:11:25.599399] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-23T20:11:26.399418] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-23T20:11:26.645006] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:11:27.199523] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-23T20:11:27.402863] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T20:11:27.410280] [INFO ] [REMOTE ] BFH: Full fetch complete (60258 records). [2025-10-23T20:11:27.410424] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-23T20:11:27.797855] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-23T20:11:27.798089] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-23T20:11:27.798976] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-23T20:11:27.799058] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-23T20:11:27.800272] [DEBUG] [LOCAL ] BFH: Trimmed 60258 records to 41734 (keeping 200 days of data) [2025-10-23T20:11:27.928925] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T20:11:28.010753] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-23T20:11:28.086976] [DEBUG] [LOCAL ] BFH: Primary data saved (41734 records). [2025-10-23T20:11:28.087137] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-23T20:11:28.087242] [INFO ] [MAIN ] Update Progress: 256/2367 symbols completed. BFH took 44.0s. Estimated remaining: 4h 18m 55s. Rate: 8.2 symbols/min [2025-10-23T20:11:28.257294] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:28.274830] [DEBUG] [LOCAL ] BGB: Loaded 17618 existing records from primary storage. [2025-10-23T20:11:28.275106] [INFO ] [MAIN ] BGB: Loaded 17618 existing records. [2025-10-23T20:11:28.455317] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:28.455542] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-23T20:11:28.455622] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-23T20:11:28.455851] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-23T20:11:28.455938] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-23T20:11:28.811395] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-23T20:11:28.870034] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:29.158746] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T20:11:29.250459] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T20:11:29.436207] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-23T20:11:29.599425] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-23T20:11:30.399410] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-23T20:11:30.411424] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T20:11:31.199512] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-23T20:11:31.542840] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T20:11:31.999461] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-23T20:11:32.122203] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T20:11:32.799514] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-23T20:11:33.599463] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-23T20:11:33.658745] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:11:34.399447] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-23T20:11:34.702549] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T20:11:34.939981] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T20:11:34.949398] [INFO ] [REMOTE ] BFLY: Full fetch complete (75507 records). [2025-10-23T20:11:34.949573] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-23T20:11:35.205598] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-23T20:11:35.392251] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-23T20:11:35.392364] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-23T20:11:35.393229] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-23T20:11:35.393309] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-23T20:11:35.394684] [DEBUG] [LOCAL ] BFLY: Trimmed 75507 records to 52246 (keeping 200 days of data) [2025-10-23T20:11:35.681471] [DEBUG] [LOCAL ] BFLY: Primary data saved (52246 records). [2025-10-23T20:11:35.681662] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-23T20:11:35.681829] [INFO ] [MAIN ] Update Progress: 257/2367 symbols completed. BFLY took 41.9s. Estimated remaining: 4h 18m 49s. Rate: 8.2 symbols/min [2025-10-23T20:11:35.852100] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:35.869528] [DEBUG] [LOCAL ] BGH: Loaded 17133 existing records from primary storage. [2025-10-23T20:11:35.869820] [INFO ] [MAIN ] BGH: Loaded 17133 existing records. [2025-10-23T20:11:36.013548] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-23T20:11:36.056350] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:36.056702] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-23T20:11:36.056823] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-23T20:11:36.057032] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-23T20:11:36.057105] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-23T20:11:36.152995] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T20:11:36.452753] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T20:11:36.465262] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:36.799445] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-23T20:11:37.155527] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T20:11:37.599430] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-23T20:11:37.610108] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T20:11:38.399520] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-23T20:11:39.199469] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-23T20:11:39.335071] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T20:11:39.613389] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T20:11:39.984078] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T20:11:39.999421] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-23T20:11:40.542024] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-23T20:11:40.799437] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-23T20:11:41.599414] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-23T20:11:41.872540] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T20:11:42.399451] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-23T20:11:43.169903] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T20:11:43.199409] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-23T20:11:43.215995] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T20:11:43.999486] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-23T20:11:44.799401] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-23T20:11:44.880001] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-23T20:11:44.961682] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T20:11:45.599401] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-23T20:11:45.829874] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T20:11:45.832484] [INFO ] [REMOTE ] BFZ: Full fetch complete (17720 records). [2025-10-23T20:11:45.832586] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-23T20:11:46.190235] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-23T20:11:46.190371] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-23T20:11:46.190793] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-23T20:11:46.190880] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-23T20:11:46.191493] [DEBUG] [LOCAL ] BFZ: Trimmed 17720 records to 12179 (keeping 200 days of data) [2025-10-23T20:11:46.264891] [DEBUG] [LOCAL ] BFZ: Primary data saved (12179 records). [2025-10-23T20:11:46.265043] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-23T20:11:46.265155] [INFO ] [MAIN ] Update Progress: 258/2367 symbols completed. BFZ took 30.6s. Estimated remaining: 4h 19m 8s. Rate: 8.1 symbols/min [2025-10-23T20:11:46.408031] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-23T20:11:46.437012] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:46.451700] [DEBUG] [LOCAL ] BGR: Loaded 13405 existing records from primary storage. [2025-10-23T20:11:46.451988] [INFO ] [MAIN ] BGR: Loaded 13405 existing records. [2025-10-23T20:11:46.636943] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:46.637176] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-23T20:11:46.637252] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-23T20:11:46.637473] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-23T20:11:46.637550] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-23T20:11:47.013055] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:47.199413] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-23T20:11:47.268859] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:11:47.476360] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T20:11:47.999420] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-23T20:11:48.240982] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T20:11:48.799408] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-23T20:11:48.867050] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T20:11:49.599430] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-23T20:11:50.399422] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-23T20:11:50.614850] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T20:11:50.676309] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T20:11:51.199416] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-23T20:11:51.316720] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T20:11:51.934268] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T20:11:51.999406] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-23T20:11:52.799430] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-23T20:11:53.599414] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-23T20:11:53.731965] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T20:11:53.903107] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:11:53.911811] [INFO ] [REMOTE ] BG: Full fetch complete (73082 records). [2025-10-23T20:11:53.911958] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-23T20:11:54.307863] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-23T20:11:54.308320] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-23T20:11:54.309279] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-23T20:11:54.309361] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-23T20:11:54.310858] [DEBUG] [LOCAL ] BG: Trimmed 73082 records to 50877 (keeping 200 days of data) [2025-10-23T20:11:54.400863] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-23T20:11:54.422750] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T20:11:54.645919] [DEBUG] [LOCAL ] BG: Primary data saved (50877 records). [2025-10-23T20:11:54.646083] [INFO ] [MAIN ] BG: Full history saved. [2025-10-23T20:11:54.646198] [INFO ] [MAIN ] Update Progress: 259/2367 symbols completed. BG took 30.5s. Estimated remaining: 4h 19m 9s. Rate: 8.1 symbols/min [2025-10-23T20:11:54.811738] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:54.854761] [DEBUG] [LOCAL ] BGS: Loaded 50530 existing records from primary storage. [2025-10-23T20:11:54.855107] [INFO ] [MAIN ] BGS: Loaded 50530 existing records. [2025-10-23T20:11:55.029111] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:55.029416] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-23T20:11:55.029494] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-23T20:11:55.029849] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-23T20:11:55.029929] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-23T20:11:55.203490] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-23T20:11:55.379041] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T20:11:55.428089] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:55.999440] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-23T20:11:56.222314] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T20:11:56.226107] [INFO ] [REMOTE ] BGB: Full fetch complete (26594 records). [2025-10-23T20:11:56.226227] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-23T20:11:56.615002] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-23T20:11:56.615110] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-23T20:11:56.615549] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-23T20:11:56.615624] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-23T20:11:56.616583] [DEBUG] [LOCAL ] BGB: Trimmed 26594 records to 17727 (keeping 200 days of data) [2025-10-23T20:11:56.719621] [DEBUG] [LOCAL ] BGB: Primary data saved (17727 records). [2025-10-23T20:11:56.719914] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-23T20:11:56.720083] [INFO ] [MAIN ] Update Progress: 260/2367 symbols completed. BGB took 28.6s. Estimated remaining: 4h 18m 19s. Rate: 8.2 symbols/min [2025-10-23T20:11:56.804496] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-23T20:11:56.853411] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T20:11:56.916138] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:11:56.926981] [DEBUG] [LOCAL ] BGSF: Loaded 8227 existing records from primary storage. [2025-10-23T20:11:56.927245] [INFO ] [MAIN ] BGSF: Loaded 8227 existing records. [2025-10-23T20:11:57.142520] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:11:57.142789] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-23T20:11:57.142866] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-23T20:11:57.143057] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-23T20:11:57.143130] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-23T20:11:57.514147] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:11:57.599417] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-23T20:11:57.949908] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:11:58.399439] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-23T20:11:59.199442] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-23T20:11:59.285366] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T20:11:59.377721] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-23T20:11:59.999438] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-23T20:12:00.176371] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T20:12:00.799504] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-23T20:12:01.440298] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T20:12:01.599466] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-23T20:12:01.616513] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T20:12:02.399499] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-23T20:12:03.199484] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-23T20:12:03.703372] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T20:12:03.999477] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-23T20:12:04.544317] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-23T20:12:04.799446] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-23T20:12:04.975503] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:12:05.199152] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T20:12:05.599430] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-23T20:12:06.180612] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T20:12:06.399413] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-23T20:12:06.637491] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T20:12:06.953609] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-23T20:12:07.199458] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-23T20:12:07.999414] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-23T20:12:08.223743] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T20:12:08.465280] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T20:12:08.799504] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-23T20:12:09.539119] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T20:12:09.599422] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-23T20:12:10.399436] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-23T20:12:11.199404] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-23T20:12:11.308958] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T20:12:11.310122] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-23T20:12:11.963574] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T20:12:11.999466] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-23T20:12:12.799432] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-23T20:12:12.832344] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T20:12:13.393454] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T20:12:13.599448] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-23T20:12:14.399448] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-23T20:12:14.678869] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T20:12:14.681911] [INFO ] [REMOTE ] BGR: Full fetch complete (19915 records). [2025-10-23T20:12:14.682013] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-23T20:12:15.071695] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-23T20:12:15.071840] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-23T20:12:15.072336] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-23T20:12:15.072412] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-23T20:12:15.073227] [DEBUG] [LOCAL ] BGR: Trimmed 19915 records to 13505 (keeping 200 days of data) [2025-10-23T20:12:15.158266] [DEBUG] [LOCAL ] BGR: Primary data saved (13505 records). [2025-10-23T20:12:15.158512] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-23T20:12:15.158674] [INFO ] [MAIN ] Update Progress: 261/2367 symbols completed. BGR took 28.9s. Estimated remaining: 4h 19m 41s. Rate: 8.1 symbols/min [2025-10-23T20:12:15.204638] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-23T20:12:15.339682] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:15.358933] [DEBUG] [LOCAL ] BGT: Loaded 16184 existing records from primary storage. [2025-10-23T20:12:15.359317] [INFO ] [MAIN ] BGT: Loaded 16184 existing records. [2025-10-23T20:12:15.548325] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:12:15.548727] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-23T20:12:15.548814] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-23T20:12:15.549094] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-23T20:12:15.549174] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-23T20:12:15.928726] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:15.999422] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-23T20:12:16.265498] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:12:16.492818] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T20:12:16.799490] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-23T20:12:17.146559] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T20:12:17.150470] [INFO ] [REMOTE ] BGH: Full fetch complete (22986 records). [2025-10-23T20:12:17.150695] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-23T20:12:17.548741] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-23T20:12:17.548850] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-23T20:12:17.549312] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-23T20:12:17.549389] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-23T20:12:17.550081] [DEBUG] [LOCAL ] BGH: Trimmed 22986 records to 17182 (keeping 200 days of data) [2025-10-23T20:12:17.600373] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-23T20:12:17.654067] [DEBUG] [LOCAL ] BGH: Primary data saved (17182 records). [2025-10-23T20:12:17.654239] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-23T20:12:17.654355] [INFO ] [MAIN ] Update Progress: 262/2367 symbols completed. BGH took 42.0s. Estimated remaining: 4h 18m 54s. Rate: 8.1 symbols/min [2025-10-23T20:12:17.823671] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:17.836826] [DEBUG] [LOCAL ] BGX: Loaded 11188 existing records from primary storage. [2025-10-23T20:12:17.846601] [INFO ] [MAIN ] BGX: Loaded 11188 existing records. [2025-10-23T20:12:17.880016] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T20:12:17.933338] [INFO ] [REMOTE ] BGSF: Full fetch complete (9684 records). [2025-10-23T20:12:17.955246] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-23T20:12:18.130425] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:12:18.147545] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-23T20:12:18.169873] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-23T20:12:18.170395] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-23T20:12:18.181051] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-23T20:12:18.403353] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-23T20:12:18.778927] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T20:12:18.777605] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-23T20:12:18.809631] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-23T20:12:18.813815] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-23T20:12:18.814328] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-23T20:12:18.862630] [DEBUG] [LOCAL ] BGSF: Trimmed 9684 records to 8278 (keeping 200 days of data) [2025-10-23T20:12:18.925304] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:18.955516] [DEBUG] [LOCAL ] BGSF: Primary data saved (8278 records). [2025-10-23T20:12:18.955767] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-23T20:12:18.955910] [INFO ] [MAIN ] Update Progress: 263/2367 symbols completed. BGSF took 22.2s. Estimated remaining: 4h 17m 58s. Rate: 8.2 symbols/min [2025-10-23T20:12:19.137483] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:19.160334] [DEBUG] [LOCAL ] BGY: Loaded 21389 existing records from primary storage. [2025-10-23T20:12:19.160757] [INFO ] [MAIN ] BGY: Loaded 21389 existing records. [2025-10-23T20:12:19.204723] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-23T20:12:19.353979] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:12:19.354361] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-23T20:12:19.354449] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-23T20:12:19.354829] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-23T20:12:19.354912] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-23T20:12:19.726064] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:19.999460] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-23T20:12:20.199121] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T20:12:20.312821] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T20:12:20.799517] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-23T20:12:21.054058] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T20:12:21.599406] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-23T20:12:21.787958] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T20:12:22.390095] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T20:12:22.399387] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-23T20:12:23.154198] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T20:12:23.199414] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-23T20:12:23.999418] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-23T20:12:24.085470] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T20:12:24.799462] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-23T20:12:25.599418] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-23T20:12:25.774517] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:12:25.835315] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T20:12:26.399426] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-23T20:12:26.566036] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T20:12:27.199449] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-23T20:12:27.999496] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-23T20:12:28.143476] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T20:12:28.210394] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T20:12:28.799421] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-23T20:12:28.873794] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-23T20:12:29.594467] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T20:12:29.599393] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-23T20:12:30.386250] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T20:12:30.399405] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-23T20:12:31.199418] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-23T20:12:31.237232] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T20:12:31.999483] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-23T20:12:32.300391] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T20:12:32.672947] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T20:12:32.799461] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-23T20:12:33.567296] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T20:12:33.599436] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-23T20:12:34.399508] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-23T20:12:34.441507] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T20:12:35.199459] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-23T20:12:35.476996] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T20:12:35.999479] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-23T20:12:36.024994] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T20:12:36.799449] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-23T20:12:37.578135] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T20:12:37.599407] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-23T20:12:37.961826] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T20:12:38.399475] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-23T20:12:39.199455] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-23T20:12:39.256746] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T20:12:39.258104] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T20:12:39.271733] [INFO ] [REMOTE ] BGS: Full fetch complete (72648 records). [2025-10-23T20:12:39.271908] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-23T20:12:39.698535] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-23T20:12:39.698710] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-23T20:12:39.699745] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-23T20:12:39.699828] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-23T20:12:39.701209] [DEBUG] [LOCAL ] BGS: Trimmed 72648 records to 50870 (keeping 200 days of data) [2025-10-23T20:12:40.002949] [DEBUG] [LOCAL ] BGS: Primary data saved (50870 records). [2025-10-23T20:12:40.003068] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-23T20:12:40.003290] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-23T20:12:40.004361] [INFO ] [MAIN ] Update Progress: 264/2367 symbols completed. BGS took 45.4s. Estimated remaining: 4h 19m 40s. Rate: 8.1 symbols/min [2025-10-23T20:12:40.185388] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:40.185620] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-23T20:12:40.185731] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-23T20:12:40.185848] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-23T20:12:40.185920] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-23T20:12:40.185980] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-23T20:12:40.186043] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-23T20:12:40.350095] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T20:12:40.395020] [INFO ] [REMOTE ] BGX: Full fetch complete (16498 records). [2025-10-23T20:12:40.459638] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-23T20:12:40.773734] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:40.804581] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-23T20:12:40.992824] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-23T20:12:41.002067] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-23T20:12:41.003052] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-23T20:12:41.003395] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T20:12:41.003542] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-23T20:12:41.008429] [DEBUG] [LOCAL ] BGX: Trimmed 16498 records to 11274 (keeping 200 days of data) [2025-10-23T20:12:41.074092] [DEBUG] [LOCAL ] BGX: Primary data saved (11274 records). [2025-10-23T20:12:41.074250] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-23T20:12:41.074365] [INFO ] [MAIN ] Update Progress: 265/2367 symbols completed. BGX took 23.4s. Estimated remaining: 4h 18m 42s. Rate: 8.1 symbols/min [2025-10-23T20:12:41.237142] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:41.276696] [DEBUG] [LOCAL ] BHC: Loaded 46589 existing records from primary storage. [2025-10-23T20:12:41.277030] [INFO ] [MAIN ] BHC: Loaded 46589 existing records. [2025-10-23T20:12:41.457587] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:12:41.457873] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-23T20:12:41.457952] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-23T20:12:41.458218] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-23T20:12:41.458294] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-23T20:12:41.609218] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-23T20:12:41.841837] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:42.004474] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T20:12:42.399467] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-23T20:12:42.438145] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T20:12:43.199421] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-23T20:12:43.574982] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-23T20:12:43.804552] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T20:12:43.999473] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-23T20:12:44.799436] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-23T20:12:45.535995] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T20:12:45.599440] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-23T20:12:45.781397] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T20:12:45.784292] [INFO ] [REMOTE ] BGT: Full fetch complete (24199 records). [2025-10-23T20:12:45.784404] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-23T20:12:46.155491] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-23T20:12:46.155623] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-23T20:12:46.156140] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-23T20:12:46.156235] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-23T20:12:46.157074] [DEBUG] [LOCAL ] BGT: Trimmed 24199 records to 16269 (keeping 200 days of data) [2025-10-23T20:12:46.252145] [DEBUG] [LOCAL ] BGT: Primary data saved (16269 records). [2025-10-23T20:12:46.252320] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-23T20:12:46.252468] [INFO ] [MAIN ] Update Progress: 266/2367 symbols completed. BGT took 31.1s. Estimated remaining: 4h 18m 17s. Rate: 8.1 symbols/min [2025-10-23T20:12:46.387465] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T20:12:46.407019] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-23T20:12:46.437336] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:46.460705] [DEBUG] [LOCAL ] BHE: Loaded 23698 existing records from primary storage. [2025-10-23T20:12:46.461048] [INFO ] [MAIN ] BHE: Loaded 23698 existing records. [2025-10-23T20:12:46.636932] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:12:46.637150] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-23T20:12:46.637249] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-23T20:12:46.637507] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-23T20:12:46.637595] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-23T20:12:46.997868] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:47.199460] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-23T20:12:47.999396] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-23T20:12:48.043222] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T20:12:48.397398] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T20:12:48.602853] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T20:12:48.799436] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-23T20:12:49.599462] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-23T20:12:50.399428] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-23T20:12:50.399379] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T20:12:50.564768] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T20:12:51.199469] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-23T20:12:51.652126] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T20:12:51.999439] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-23T20:12:52.311864] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T20:12:52.799486] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-23T20:12:53.599405] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-23T20:12:53.753615] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T20:12:53.938353] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T20:12:54.399409] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-23T20:12:54.639540] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T20:12:55.199434] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-23T20:12:55.999431] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-23T20:12:56.034463] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T20:12:56.574990] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T20:12:56.799409] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-23T20:12:57.147983] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T20:12:57.152128] [INFO ] [REMOTE ] BGY: Full fetch complete (32931 records). [2025-10-23T20:12:57.152239] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-23T20:12:57.517335] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-23T20:12:57.517443] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-23T20:12:57.517953] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-23T20:12:57.518030] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-23T20:12:57.518832] [DEBUG] [LOCAL ] BGY: Trimmed 32931 records to 21463 (keeping 200 days of data) [2025-10-23T20:12:57.599892] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-23T20:12:57.643104] [DEBUG] [LOCAL ] BGY: Primary data saved (21463 records). [2025-10-23T20:12:57.643257] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-23T20:12:57.643386] [INFO ] [MAIN ] Update Progress: 267/2367 symbols completed. BGY took 38.7s. Estimated remaining: 4h 18m 42s. Rate: 8.1 symbols/min [2025-10-23T20:12:57.822267] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:12:57.845611] [DEBUG] [LOCAL ] BHK: Loaded 23957 existing records from primary storage. [2025-10-23T20:12:57.845974] [INFO ] [MAIN ] BHK: Loaded 23957 existing records. [2025-10-23T20:12:58.028635] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:12:58.028894] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-23T20:12:58.029157] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-23T20:12:58.029460] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-23T20:12:58.029563] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-23T20:12:58.320716] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T20:12:58.404585] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-23T20:12:58.432987] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:12:58.693509] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T20:12:59.199442] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-23T20:12:59.999403] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-23T20:13:00.078211] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T20:13:00.383397] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T20:13:00.799440] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-23T20:13:01.275042] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T20:13:01.599451] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-23T20:13:02.399410] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-23T20:13:02.744107] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T20:13:03.199450] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-23T20:13:03.352851] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T20:13:03.696932] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T20:13:03.999452] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-23T20:13:04.307864] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T20:13:04.799470] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-23T20:13:05.344708] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T20:13:05.599455] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-23T20:13:06.399454] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-23T20:13:06.451512] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T20:13:06.654112] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T20:13:06.656959] [INFO ] [REMOTE ] BH: Full fetch complete (19560 records). [2025-10-23T20:13:06.657049] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-23T20:13:07.024885] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-23T20:13:07.025056] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-23T20:13:07.025539] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-23T20:13:07.025684] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-23T20:13:07.035533] [DEBUG] [LOCAL ] BH: Trimmed 19560 records to 16562 (keeping 200 days of data) [2025-10-23T20:13:07.035940] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T20:13:07.135115] [DEBUG] [LOCAL ] BH: Primary data saved (16562 records). [2025-10-23T20:13:07.135243] [INFO ] [MAIN ] BH: Full history saved. [2025-10-23T20:13:07.135346] [INFO ] [MAIN ] Update Progress: 268/2367 symbols completed. BH took 27.1s. Estimated remaining: 4h 18m 51s. Rate: 8.1 symbols/min [2025-10-23T20:13:07.204550] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-23T20:13:07.305610] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:07.305831] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-23T20:13:07.305906] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-23T20:13:07.306021] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-23T20:13:07.306104] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-23T20:13:07.306187] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-23T20:13:07.306257] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-23T20:13:07.658728] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:07.999407] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-23T20:13:08.429991] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T20:13:08.799450] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-23T20:13:09.599440] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-23T20:13:09.775565] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T20:13:09.817333] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T20:13:10.399446] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-23T20:13:11.199416] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-23T20:13:11.600854] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T20:13:11.698301] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T20:13:11.999461] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-23T20:13:12.250771] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T20:13:12.799443] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-23T20:13:12.832143] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T20:13:13.599537] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-23T20:13:14.399472] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-23T20:13:14.667288] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T20:13:14.675538] [INFO ] [REMOTE ] BHC: Full fetch complete (67523 records). [2025-10-23T20:13:14.675708] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-23T20:13:14.798296] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T20:13:14.865465] [INFO ] [REMOTE ] BHE: Full fetch complete (36433 records). [2025-10-23T20:13:14.888590] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-23T20:13:15.201389] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-23T20:13:15.320905] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-23T20:13:15.321294] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-23T20:13:15.322231] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-23T20:13:15.343002] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-23T20:13:15.397195] [DEBUG] [LOCAL ] BHC: Trimmed 67523 records to 46912 (keeping 200 days of data) [2025-10-23T20:13:15.588935] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-23T20:13:15.592021] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-23T20:13:15.592564] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-23T20:13:15.592702] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-23T20:13:15.670553] [DEBUG] [LOCAL ] BHE: Trimmed 36433 records to 23812 (keeping 200 days of data) [2025-10-23T20:13:15.847758] [DEBUG] [LOCAL ] BHC: Primary data saved (46912 records). [2025-10-23T20:13:15.857843] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-23T20:13:15.858758] [INFO ] [MAIN ] Update Progress: 269/2367 symbols completed. BHC took 34.8s. Estimated remaining: 4h 18m 53s. Rate: 8.1 symbols/min [2025-10-23T20:13:15.968132] [DEBUG] [LOCAL ] BHE: Primary data saved (23812 records). [2025-10-23T20:13:15.992063] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-23T20:13:15.994522] [INFO ] [MAIN ] Update Progress: 270/2367 symbols completed. BHE took 29.7s. Estimated remaining: 4h 17m 50s. Rate: 8.1 symbols/min [2025-10-23T20:13:16.181045] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:16.286123] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:16.286695] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-23T20:13:16.286851] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-23T20:13:16.287287] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-23T20:13:16.287453] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-23T20:13:16.287548] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-23T20:13:16.287797] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-23T20:13:16.399486] [DEBUG] [LOCAL ] BHR: Loaded 21979 existing records from primary storage. [2025-10-23T20:13:16.457438] [INFO ] [MAIN ] BHR: Loaded 21979 existing records. [2025-10-23T20:13:16.466753] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-23T20:13:16.604181] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-23T20:13:16.979019] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:13:17.082353] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:13:17.097001] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-23T20:13:17.102027] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-23T20:13:17.131825] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-23T20:13:17.131550] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:17.132445] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-23T20:13:17.132540] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-23T20:13:17.600458] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:17.600620] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-23T20:13:17.968770] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-23T20:13:18.384068] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T20:13:18.399388] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-23T20:13:18.448822] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T20:13:19.199429] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-23T20:13:19.522296] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T20:13:19.999419] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-23T20:13:20.306252] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T20:13:20.799440] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-23T20:13:21.041546] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T20:13:21.163153] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-23T20:13:21.599475] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-23T20:13:22.399424] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-23T20:13:22.760258] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-23T20:13:23.199437] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-23T20:13:23.593616] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T20:13:23.999411] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-23T20:13:24.154630] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T20:13:24.799455] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-23T20:13:25.345267] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T20:13:25.350490] [INFO ] [REMOTE ] BHK: Full fetch complete (30670 records). [2025-10-23T20:13:25.350714] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-23T20:13:25.604721] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-23T20:13:25.720810] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-23T20:13:25.720917] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-23T20:13:25.721442] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-23T20:13:25.721520] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-23T20:13:25.722449] [DEBUG] [LOCAL ] BHK: Trimmed 30670 records to 24125 (keeping 200 days of data) [2025-10-23T20:13:25.859298] [DEBUG] [LOCAL ] BHK: Primary data saved (24125 records). [2025-10-23T20:13:25.859460] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-23T20:13:25.859580] [INFO ] [MAIN ] Update Progress: 271/2367 symbols completed. BHK took 28.2s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-10-23T20:13:25.961580] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-23T20:13:26.029747] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:26.074237] [DEBUG] [LOCAL ] BHVN: Loaded 50633 existing records from primary storage. [2025-10-23T20:13:26.074558] [INFO ] [MAIN ] BHVN: Loaded 50633 existing records. [2025-10-23T20:13:26.247724] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:13:26.247926] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-23T20:13:26.248000] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-23T20:13:26.248301] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-23T20:13:26.248375] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-23T20:13:26.404937] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-23T20:13:26.614455] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:26.643183] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T20:13:27.199391] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-23T20:13:27.596778] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T20:13:27.999482] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-23T20:13:28.799417] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-23T20:13:29.197755] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T20:13:29.605366] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-23T20:13:29.622285] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T20:13:29.982953] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-23T20:13:29.998635] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T20:13:30.399437] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-23T20:13:30.746077] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-23T20:13:31.199474] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-23T20:13:31.587315] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-23T20:13:31.999470] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-23T20:13:32.799449] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-23T20:13:33.599438] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-23T20:13:33.952477] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:13:34.135380] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-23T20:13:34.399441] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-23T20:13:35.058216] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T20:13:35.199425] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-23T20:13:35.617529] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-23T20:13:35.999440] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-23T20:13:36.054246] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T20:13:36.799414] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-23T20:13:37.115546] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T20:13:37.118205] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-23T20:13:37.599431] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-23T20:13:38.067559] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T20:13:38.068523] [INFO ] [REMOTE ] BHV: Full fetch complete (1411 records). [2025-10-23T20:13:38.068626] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-23T20:13:38.246436] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-23T20:13:38.246609] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:13:38.246699] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:13:38.246772] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-23T20:13:38.246845] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-23T20:13:38.246893] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-23T20:13:38.246970] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-23T20:13:38.247060] [INFO ] [MAIN ] Update Progress: 272/2367 symbols completed. BHV took 22.3s. Estimated remaining: 4h 18m 33s. Rate: 8.1 symbols/min [2025-10-23T20:13:38.424148] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:38.404487] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-23T20:13:38.473939] [DEBUG] [LOCAL ] BILL: Loaded 52500 existing records from primary storage. [2025-10-23T20:13:38.474283] [INFO ] [MAIN ] BILL: Loaded 52500 existing records. [2025-10-23T20:13:38.656952] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:13:38.657172] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-23T20:13:38.657248] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-23T20:13:38.657476] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-23T20:13:38.657550] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-23T20:13:39.002671] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:39.199446] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-23T20:13:39.999453] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-23T20:13:40.116156] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T20:13:40.799440] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-23T20:13:40.922742] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T20:13:41.599477] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-23T20:13:41.766926] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T20:13:41.910347] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T20:13:42.399433] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-23T20:13:43.199426] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-23T20:13:43.365830] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T20:13:43.999443] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-23T20:13:44.346920] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T20:13:44.655172] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-23T20:13:44.664561] [INFO ] [REMOTE ] BHP: Full fetch complete (77433 records). [2025-10-23T20:13:44.664743] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-23T20:13:44.805972] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-23T20:13:45.059702] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-23T20:13:45.059824] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-23T20:13:45.060704] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-23T20:13:45.060786] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-23T20:13:45.062251] [DEBUG] [LOCAL ] BHP: Trimmed 77433 records to 53753 (keeping 200 days of data) [2025-10-23T20:13:45.384396] [DEBUG] [LOCAL ] BHP: Primary data saved (53753 records). [2025-10-23T20:13:45.384631] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-23T20:13:45.384888] [INFO ] [MAIN ] Update Progress: 273/2367 symbols completed. BHP took 38.2s. Estimated remaining: 4h 18m 23s. Rate: 8.1 symbols/min [2025-10-23T20:13:45.555399] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:45.592073] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T20:13:45.603897] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-23T20:13:45.626194] [DEBUG] [LOCAL ] BIO: Loaded 23819 existing records from primary storage. [2025-10-23T20:13:45.626572] [INFO ] [MAIN ] BIO: Loaded 23819 existing records. [2025-10-23T20:13:45.821086] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:13:45.821312] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-23T20:13:45.821390] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-23T20:13:45.821712] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-23T20:13:45.821787] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-23T20:13:46.208905] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:46.224176] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T20:13:46.399434] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-23T20:13:47.199446] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-23T20:13:47.334415] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T20:13:47.706069] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T20:13:47.710788] [INFO ] [REMOTE ] BHR: Full fetch complete (31215 records). [2025-10-23T20:13:47.710887] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-23T20:13:48.004626] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-23T20:13:48.075739] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-23T20:13:48.075850] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-23T20:13:48.076372] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-23T20:13:48.076443] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-23T20:13:48.077201] [DEBUG] [LOCAL ] BHR: Trimmed 31215 records to 22181 (keeping 200 days of data) [2025-10-23T20:13:48.204573] [DEBUG] [LOCAL ] BHR: Primary data saved (22181 records). [2025-10-23T20:13:48.205215] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-23T20:13:48.205329] [INFO ] [MAIN ] Update Progress: 274/2367 symbols completed. BHR took 32.3s. Estimated remaining: 4h 17m 41s. Rate: 8.1 symbols/min [2025-10-23T20:13:48.373372] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:13:48.409522] [DEBUG] [LOCAL ] BIP: Loaded 38919 existing records from primary storage. [2025-10-23T20:13:48.409878] [INFO ] [MAIN ] BIP: Loaded 38919 existing records. [2025-10-23T20:13:48.588280] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:13:48.588522] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-23T20:13:48.588612] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-23T20:13:48.589207] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-23T20:13:48.589283] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-23T20:13:48.801414] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-23T20:13:48.954322] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:13:49.031209] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T20:13:49.150852] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T20:13:49.599411] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-23T20:13:50.399428] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-23T20:13:50.643123] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T20:13:51.017732] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T20:13:51.199416] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-23T20:13:51.544838] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T20:13:51.999437] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-23T20:13:52.619708] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:13:52.799439] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-23T20:13:53.392737] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T20:13:53.599447] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-23T20:13:54.399409] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-23T20:13:54.479425] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T20:13:54.886459] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T20:13:55.199455] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-23T20:13:55.999451] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-23T20:13:56.157986] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T20:13:56.772733] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T20:13:56.799396] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-23T20:13:57.599443] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-23T20:13:57.723924] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T20:13:58.247296] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T20:13:58.399446] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-23T20:13:59.199444] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-23T20:13:59.432387] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T20:13:59.990666] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T20:13:59.999399] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-23T20:14:00.608997] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T20:14:00.799457] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-23T20:14:01.599447] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-23T20:14:01.875478] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T20:14:02.399539] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-23T20:14:03.199511] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-23T20:14:03.680308] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T20:14:03.762981] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-23T20:14:03.999488] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-23T20:14:04.197578] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-23T20:14:04.765732] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T20:14:04.799454] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-23T20:14:05.360606] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T20:14:05.599487] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-23T20:14:06.399477] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-23T20:14:06.617821] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T20:14:07.199551] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-23T20:14:07.414351] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T20:14:07.656217] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T20:14:07.999459] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-23T20:14:08.799434] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-23T20:14:09.204213] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T20:14:09.599521] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-23T20:14:09.662168] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T20:14:09.825160] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T20:14:09.835141] [INFO ] [REMOTE ] BILL: Full fetch complete (76115 records). [2025-10-23T20:14:09.835370] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-23T20:14:10.267734] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-23T20:14:10.267883] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-23T20:14:10.268890] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-23T20:14:10.268980] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-23T20:14:10.270597] [DEBUG] [LOCAL ] BILL: Trimmed 76115 records to 52879 (keeping 200 days of data) [2025-10-23T20:14:10.436492] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-23T20:14:10.579504] [DEBUG] [LOCAL ] BILL: Primary data saved (52879 records). [2025-10-23T20:14:10.579699] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-23T20:14:10.580901] [INFO ] [MAIN ] Update Progress: 275/2367 symbols completed. BILL took 32.3s. Estimated remaining: 4h 19m 27s. Rate: 8.1 symbols/min [2025-10-23T20:14:10.750988] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:10.792953] [DEBUG] [LOCAL ] BIPC: Loaded 41113 existing records from primary storage. [2025-10-23T20:14:10.793273] [INFO ] [MAIN ] BIPC: Loaded 41113 existing records. [2025-10-23T20:14:10.965518] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:10.965777] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-23T20:14:10.965853] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-23T20:14:10.966152] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-23T20:14:10.966228] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-23T20:14:11.204817] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-23T20:14:11.313950] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:11.750929] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T20:14:11.760605] [INFO ] [REMOTE ] BHVN: Full fetch complete (70760 records). [2025-10-23T20:14:11.760862] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-23T20:14:12.006042] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-23T20:14:12.182109] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-23T20:14:12.182287] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-23T20:14:12.183478] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-23T20:14:12.183607] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-23T20:14:12.185944] [DEBUG] [LOCAL ] BHVN: Trimmed 70760 records to 51012 (keeping 200 days of data) [2025-10-23T20:14:12.499667] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T20:14:12.543494] [DEBUG] [LOCAL ] BHVN: Primary data saved (51012 records). [2025-10-23T20:14:12.543777] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-23T20:14:12.543922] [INFO ] [MAIN ] Update Progress: 276/2367 symbols completed. BHVN took 46.7s. Estimated remaining: 4h 18m 38s. Rate: 8.1 symbols/min [2025-10-23T20:14:12.727534] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:12.733058] [DEBUG] [LOCAL ] BIPH: Loaded 2352 existing records from primary storage. [2025-10-23T20:14:12.733262] [INFO ] [MAIN ] BIPH: Loaded 2352 existing records. [2025-10-23T20:14:12.804669] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-23T20:14:12.927805] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:12.928238] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-23T20:14:12.928552] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-23T20:14:12.929009] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-23T20:14:12.929090] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-23T20:14:13.136417] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T20:14:13.351960] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:13.599438] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-23T20:14:13.644142] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T20:14:14.098291] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T20:14:14.101959] [INFO ] [REMOTE ] BIO: Full fetch complete (34583 records). [2025-10-23T20:14:14.102056] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-23T20:14:14.405929] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-23T20:14:14.497501] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-23T20:14:14.497611] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-23T20:14:14.498205] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-23T20:14:14.498285] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-23T20:14:14.499163] [DEBUG] [LOCAL ] BIO: Trimmed 34583 records to 23969 (keeping 200 days of data) [2025-10-23T20:14:14.637688] [DEBUG] [LOCAL ] BIO: Primary data saved (23969 records). [2025-10-23T20:14:14.637852] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-23T20:14:14.637965] [INFO ] [MAIN ] Update Progress: 277/2367 symbols completed. BIO took 29.3s. Estimated remaining: 4h 17m 51s. Rate: 8.1 symbols/min [2025-10-23T20:14:15.186318] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T20:14:15.193473] [INFO ] [REMOTE ] BIP: Full fetch complete (57611 records). [2025-10-23T20:14:15.193602] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-23T20:14:15.225893] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-23T20:14:15.582035] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-23T20:14:15.582147] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-23T20:14:15.582948] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-23T20:14:15.583030] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-23T20:14:15.584245] [DEBUG] [LOCAL ] BIP: Trimmed 57611 records to 39164 (keeping 200 days of data) [2025-10-23T20:14:15.826626] [DEBUG] [LOCAL ] BIP: Primary data saved (39164 records). [2025-10-23T20:14:15.826808] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-23T20:14:15.826922] [INFO ] [MAIN ] Update Progress: 278/2367 symbols completed. BIP took 27.6s. Estimated remaining: 4h 16m 57s. Rate: 8.1 symbols/min [2025-10-23T20:14:15.875065] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T20:14:15.911733] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-23T20:14:15.999409] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-23T20:14:16.443610] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T20:14:16.799410] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-23T20:14:17.345204] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-23T20:14:17.599504] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-23T20:14:18.254912] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-23T20:14:18.399410] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-23T20:14:18.873181] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T20:14:19.199442] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-23T20:14:19.672623] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-23T20:14:19.999721] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-23T20:14:20.454738] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T20:14:20.799449] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-23T20:14:21.257197] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T20:14:21.599441] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-23T20:14:22.399500] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-23T20:14:22.876195] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-23T20:14:22.877500] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T20:14:23.199427] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-23T20:14:23.704505] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T20:14:23.705532] [INFO ] [REMOTE ] BIPH: Full fetch complete (3747 records). [2025-10-23T20:14:23.705627] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-23T20:14:24.007269] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-23T20:14:24.111532] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-23T20:14:24.111702] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-23T20:14:24.111906] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-23T20:14:24.112012] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-23T20:14:24.112546] [DEBUG] [LOCAL ] BIPH: Trimmed 3747 records to 2366 (keeping 200 days of data) [2025-10-23T20:14:24.128112] [DEBUG] [LOCAL ] BIPH: Primary data saved (2366 records). [2025-10-23T20:14:24.128215] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-23T20:14:24.128324] [INFO ] [MAIN ] Update Progress: 279/2367 symbols completed. BIPH took 11.6s. Estimated remaining: 4h 16m 56s. Rate: 8.1 symbols/min [2025-10-23T20:14:25.661374] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T20:14:25.671394] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-23T20:14:27.267949] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T20:14:27.277005] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-23T20:14:28.681536] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T20:14:28.689527] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-23T20:14:30.102105] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-23T20:14:30.111280] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-23T20:14:31.663730] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T20:14:31.672503] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-23T20:14:33.121407] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T20:14:33.130070] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-23T20:14:34.823846] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T20:14:34.831289] [INFO ] [REMOTE ] BIPC: Full fetch complete (60307 records). [2025-10-23T20:14:34.831417] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-23T20:14:35.207410] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-23T20:14:35.207547] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-23T20:14:35.208344] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-23T20:14:35.208432] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-23T20:14:35.209742] [DEBUG] [LOCAL ] BIPC: Trimmed 60307 records to 41390 (keeping 200 days of data) [2025-10-23T20:14:35.457161] [DEBUG] [LOCAL ] BIPC: Primary data saved (41390 records). [2025-10-23T20:14:35.457325] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-23T20:14:35.458246] [INFO ] [MAIN ] Update Progress: 280/2367 symbols completed. BIPC took 24.9s. Estimated remaining: 4h 17m 18s. Rate: 8.1 symbols/min [2025-10-23T20:14:36.157914] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:36.175344] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:36.174526] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:36.195004] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:36.202481] [DEBUG] [LOCAL ] BIPJ: Loaded 3106 existing records from primary storage. [2025-10-23T20:14:36.202915] [INFO ] [MAIN ] BIPJ: Loaded 3106 existing records. [2025-10-23T20:14:36.250254] [DEBUG] [LOCAL ] BIPI: Loaded 2816 existing records from primary storage. [2025-10-23T20:14:36.259502] [INFO ] [MAIN ] BIPI: Loaded 2816 existing records. [2025-10-23T20:14:36.452204] [DEBUG] [LOCAL ] BIT: Loaded 23774 existing records from primary storage. [2025-10-23T20:14:36.476579] [INFO ] [MAIN ] BIT: Loaded 23774 existing records. [2025-10-23T20:14:36.633525] [DEBUG] [LOCAL ] BIRK: Loaded 51188 existing records from primary storage. [2025-10-23T20:14:36.608495] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:36.677977] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-23T20:14:36.712457] [INFO ] [MAIN ] BIRK: Loaded 51188 existing records. [2025-10-23T20:14:36.715636] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:36.724792] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-23T20:14:36.725419] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-23T20:14:36.771593] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-23T20:14:36.771705] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-23T20:14:36.802620] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-23T20:14:36.979633] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:36.957000] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-23T20:14:37.035012] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-23T20:14:37.040731] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-23T20:14:37.040338] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-23T20:14:37.074513] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-23T20:14:37.183204] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:37.200961] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-23T20:14:37.116400] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-23T20:14:37.218725] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-23T20:14:37.335832] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-23T20:14:37.376806] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-23T20:14:37.965751] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:38.086588] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-23T20:14:38.386348] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:38.468936] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:38.497885] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-23T20:14:38.519159] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-23T20:14:38.539832] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:38.541185] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-23T20:14:38.843543] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T20:14:38.844795] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-23T20:14:38.998772] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-23T20:14:39.000137] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-23T20:14:39.463519] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-23T20:14:39.464811] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-23T20:14:39.548943] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T20:14:39.548825] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T20:14:39.550584] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-23T20:14:39.555488] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-23T20:14:39.906791] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-23T20:14:39.908823] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-23T20:14:39.990681] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-23T20:14:39.991877] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-23T20:14:40.201347] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T20:14:40.211488] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-23T20:14:40.481841] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-23T20:14:40.484032] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-23T20:14:40.552293] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-23T20:14:40.553871] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-23T20:14:40.587415] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T20:14:40.771617] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-23T20:14:40.799482] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-23T20:14:40.919888] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-23T20:14:41.256443] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T20:14:41.599483] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-23T20:14:41.653683] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T20:14:42.102007] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-23T20:14:42.399450] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-23T20:14:42.855858] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T20:14:43.199437] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-23T20:14:43.999418] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-23T20:14:44.611672] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T20:14:44.799438] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-23T20:14:44.853686] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:14:45.353361] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T20:14:45.599419] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-23T20:14:46.399458] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-23T20:14:46.581422] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T20:14:47.199448] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-23T20:14:47.980504] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T20:14:47.999410] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-23T20:14:48.223227] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T20:14:48.472419] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T20:14:48.799471] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-23T20:14:49.599435] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-23T20:14:50.054710] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T20:14:50.399426] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-23T20:14:50.586491] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T20:14:51.199451] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-23T20:14:51.365404] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T20:14:51.759760] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T20:14:51.760788] [INFO ] [REMOTE ] BIPI: Full fetch complete (4589 records). [2025-10-23T20:14:51.760874] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-23T20:14:52.004577] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-23T20:14:52.125516] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-23T20:14:52.125636] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-23T20:14:52.125856] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-23T20:14:52.125933] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-23T20:14:52.126334] [DEBUG] [LOCAL ] BIPI: Trimmed 4589 records to 2834 (keeping 200 days of data) [2025-10-23T20:14:52.146040] [DEBUG] [LOCAL ] BIPI: Primary data saved (2834 records). [2025-10-23T20:14:52.146198] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-23T20:14:52.146290] [INFO ] [MAIN ] Update Progress: 281/2367 symbols completed. BIPI took 16.7s. Estimated remaining: 4h 18m 20s. Rate: 8.1 symbols/min [2025-10-23T20:14:52.327464] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:52.375921] [DEBUG] [LOCAL ] BJ: Loaded 51505 existing records from primary storage. [2025-10-23T20:14:52.376258] [INFO ] [MAIN ] BJ: Loaded 51505 existing records. [2025-10-23T20:14:52.549988] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:52.550216] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-23T20:14:52.550290] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-23T20:14:52.550527] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-23T20:14:52.550601] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-23T20:14:52.804559] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-23T20:14:52.902843] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:53.138324] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T20:14:53.599411] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-23T20:14:54.399423] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-23T20:14:54.524490] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T20:14:54.577205] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T20:14:54.985278] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T20:14:55.199449] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-23T20:14:55.999409] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-23T20:14:56.566385] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T20:14:56.567377] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4162 records). [2025-10-23T20:14:56.567484] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-23T20:14:56.804503] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-23T20:14:56.938447] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-23T20:14:56.938568] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-23T20:14:56.938906] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-23T20:14:56.939005] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-23T20:14:56.939510] [DEBUG] [LOCAL ] BIPJ: Trimmed 4162 records to 3108 (keeping 200 days of data) [2025-10-23T20:14:56.957959] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3108 records). [2025-10-23T20:14:56.958116] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-23T20:14:56.958317] [INFO ] [MAIN ] Update Progress: 282/2367 symbols completed. BIPJ took 21.5s. Estimated remaining: 4h 17m 53s. Rate: 8.1 symbols/min [2025-10-23T20:14:57.133254] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:14:57.168106] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-23T20:14:57.225281] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-23T20:14:57.225637] [INFO ] [MAIN ] BK: Loaded 53546 existing records. [2025-10-23T20:14:57.404551] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:14:57.404799] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-23T20:14:57.404895] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-23T20:14:57.405164] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-23T20:14:57.405243] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-23T20:14:57.609418] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-23T20:14:57.759480] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:14:58.269631] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T20:14:58.399497] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-23T20:14:59.199416] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-23T20:14:59.285012] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:14:59.775786] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T20:14:59.999474] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-23T20:15:00.799432] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-23T20:15:00.969473] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T20:15:01.599496] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-23T20:15:01.692007] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T20:15:02.367674] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T20:15:02.399411] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-23T20:15:03.199435] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-23T20:15:03.999421] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-23T20:15:04.163542] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-23T20:15:04.638908] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-23T20:15:04.799421] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-23T20:15:05.449138] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-23T20:15:05.454484] [INFO ] [REMOTE ] BIT: Full fetch complete (32341 records). [2025-10-23T20:15:05.454617] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-23T20:15:05.604453] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-23T20:15:05.843563] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-23T20:15:05.843735] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-23T20:15:05.844390] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-23T20:15:05.844516] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-23T20:15:05.845605] [DEBUG] [LOCAL ] BIT: Trimmed 32341 records to 23886 (keeping 200 days of data) [2025-10-23T20:15:05.986745] [DEBUG] [LOCAL ] BIT: Primary data saved (23886 records). [2025-10-23T20:15:05.986903] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-23T20:15:05.987015] [INFO ] [MAIN ] Update Progress: 283/2367 symbols completed. BIT took 30.5s. Estimated remaining: 4h 17m 58s. Rate: 8.1 symbols/min [2025-10-23T20:15:06.167787] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:06.190495] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-23T20:15:06.248548] [DEBUG] [LOCAL ] BKD: Loaded 50408 existing records from primary storage. [2025-10-23T20:15:06.248978] [INFO ] [MAIN ] BKD: Loaded 50408 existing records. [2025-10-23T20:15:06.404538] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-23T20:15:06.433464] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:15:06.434186] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-23T20:15:06.434260] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-23T20:15:06.434503] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-23T20:15:06.434578] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-23T20:15:06.803026] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:15:06.828526] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-23T20:15:06.837836] [INFO ] [REMOTE ] BIRK: Full fetch complete (73391 records). [2025-10-23T20:15:06.838005] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-23T20:15:07.205065] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-23T20:15:07.223176] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-23T20:15:07.223421] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-23T20:15:07.225301] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-23T20:15:07.225489] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-23T20:15:07.227064] [DEBUG] [LOCAL ] BIRK: Trimmed 73391 records to 51506 (keeping 200 days of data) [2025-10-23T20:15:07.518993] [DEBUG] [LOCAL ] BIRK: Primary data saved (51506 records). [2025-10-23T20:15:07.519147] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-23T20:15:07.519258] [INFO ] [MAIN ] Update Progress: 284/2367 symbols completed. BIRK took 32.0s. Estimated remaining: 4h 17m 7s. Rate: 8.1 symbols/min [2025-10-23T20:15:07.693888] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:07.694142] [DEBUG] [LOCAL ] BKE: No existing data file found in primary storage. [2025-10-23T20:15:07.694219] [WARN ] [MAIN ] BKE: No existing data found, performing full refresh instead. [2025-10-23T20:15:07.694394] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-23T20:15:07.694498] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-23T20:15:07.694579] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-23T20:15:07.694668] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-23T20:15:07.900130] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T20:15:08.006147] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-23T20:15:08.097678] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:15:08.132320] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T20:15:08.799418] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-23T20:15:08.873698] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T20:15:09.599457] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-23T20:15:09.662685] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T20:15:10.399413] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-23T20:15:10.591307] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T20:15:11.176964] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T20:15:11.199400] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-23T20:15:11.363752] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T20:15:11.999445] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-23T20:15:12.802603] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-23T20:15:12.805700] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T20:15:13.428364] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T20:15:13.599417] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-23T20:15:14.185262] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:15:14.399441] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-23T20:15:15.190414] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T20:15:15.199384] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-23T20:15:15.999414] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-23T20:15:16.102609] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T20:15:16.685950] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T20:15:16.799404] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-23T20:15:17.599556] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-23T20:15:17.967075] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T20:15:18.399549] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-23T20:15:18.563146] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T20:15:19.199473] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-23T20:15:19.427718] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T20:15:19.727322] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T20:15:19.999472] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-23T20:15:20.484267] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T20:15:20.799435] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-23T20:15:21.599424] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-23T20:15:22.022638] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T20:15:22.119036] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T20:15:22.399463] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-23T20:15:23.199441] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-23T20:15:23.295737] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T20:15:23.999496] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-23T20:15:24.228010] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T20:15:24.295923] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T20:15:24.799437] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-23T20:15:25.599425] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-23T20:15:26.124029] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T20:15:26.272057] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T20:15:26.399448] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-23T20:15:27.038184] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T20:15:27.199430] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-23T20:15:27.999409] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-23T20:15:28.463955] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T20:15:28.473477] [INFO ] [REMOTE ] BK: Full fetch complete (77679 records). [2025-10-23T20:15:28.473638] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-23T20:15:28.660855] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T20:15:28.805582] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-23T20:15:28.906105] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-23T20:15:28.906212] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-23T20:15:28.907146] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-23T20:15:28.907230] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-23T20:15:28.908825] [DEBUG] [LOCAL ] BK: Trimmed 77679 records to 53936 (keeping 200 days of data) [2025-10-23T20:15:29.239119] [DEBUG] [LOCAL ] BK: Primary data saved (53936 records). [2025-10-23T20:15:29.239304] [INFO ] [MAIN ] BK: Full history saved. [2025-10-23T20:15:29.239430] [INFO ] [MAIN ] Update Progress: 285/2367 symbols completed. BK took 32.3s. Estimated remaining: 4h 18m 44s. Rate: 8.0 symbols/min [2025-10-23T20:15:29.413202] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:29.413382] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-23T20:15:29.413453] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-23T20:15:29.413571] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-23T20:15:29.413660] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-23T20:15:29.413738] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-23T20:15:29.413803] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-23T20:15:29.600857] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-23T20:15:29.777428] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:15:29.806491] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T20:15:29.996868] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T20:15:30.002615] [INFO ] [REMOTE ] BKE: Full fetch complete (50208 records). [2025-10-23T20:15:30.002797] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-23T20:15:30.370339] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-23T20:15:30.370448] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-23T20:15:30.371136] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-23T20:15:30.371215] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-23T20:15:30.372277] [DEBUG] [LOCAL ] BKE: Trimmed 50208 records to 33794 (keeping 200 days of data) [2025-10-23T20:15:30.423410] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-23T20:15:30.572469] [DEBUG] [LOCAL ] BKE: Primary data saved (33794 records). [2025-10-23T20:15:30.572635] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-23T20:15:30.572768] [INFO ] [MAIN ] Update Progress: 286/2367 symbols completed. BKE took 23.1s. Estimated remaining: 4h 17m 52s. Rate: 8.1 symbols/min [2025-10-23T20:15:30.738626] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:30.772387] [DEBUG] [LOCAL ] BKKT: Loaded 37391 existing records from primary storage. [2025-10-23T20:15:30.772709] [INFO ] [MAIN ] BKKT: Loaded 37391 existing records. [2025-10-23T20:15:30.951917] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:15:30.952119] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-23T20:15:30.952192] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-23T20:15:30.952439] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-23T20:15:30.952512] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-23T20:15:31.208543] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-23T20:15:31.314449] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:15:31.374974] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T20:15:31.999485] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-23T20:15:32.147202] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T20:15:32.799367] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T20:15:32.799423] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-23T20:15:33.381126] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T20:15:33.599437] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-23T20:15:34.399416] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-23T20:15:34.615225] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T20:15:34.924904] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T20:15:35.199438] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-23T20:15:35.704086] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T20:15:35.999436] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-23T20:15:36.799413] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-23T20:15:37.041110] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T20:15:37.049758] [INFO ] [REMOTE ] BKD: Full fetch complete (72052 records). [2025-10-23T20:15:37.049913] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-23T20:15:37.454817] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-23T20:15:37.454947] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-23T20:15:37.455820] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-23T20:15:37.455902] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-23T20:15:37.457307] [DEBUG] [LOCAL ] BKD: Trimmed 72052 records to 50716 (keeping 200 days of data) [2025-10-23T20:15:37.608893] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-23T20:15:37.737460] [DEBUG] [LOCAL ] BKD: Primary data saved (50716 records). [2025-10-23T20:15:37.737686] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-23T20:15:37.738791] [INFO ] [MAIN ] Update Progress: 287/2367 symbols completed. BKD took 31.8s. Estimated remaining: 4h 17m 43s. Rate: 8.1 symbols/min [2025-10-23T20:15:37.918958] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:37.952469] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T20:15:37.952817] [DEBUG] [LOCAL ] BKN: Loaded 7279 existing records from primary storage. [2025-10-23T20:15:37.962772] [INFO ] [MAIN ] BKN: Loaded 7279 existing records. [2025-10-23T20:15:37.998333] [INFO ] [REMOTE ] BJ: Full fetch complete (74384 records). [2025-10-23T20:15:38.014424] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-23T20:15:38.373869] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:15:38.405157] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-23T20:15:38.435049] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-23T20:15:38.486756] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-23T20:15:38.497298] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-23T20:15:38.750157] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-23T20:15:38.760866] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-23T20:15:38.791495] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-23T20:15:38.791674] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-23T20:15:38.903173] [DEBUG] [LOCAL ] BJ: Trimmed 74384 records to 51834 (keeping 200 days of data) [2025-10-23T20:15:38.914958] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-23T20:15:38.975677] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-23T20:15:39.185714] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:15:39.237349] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-23T20:15:39.325106] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T20:15:39.415081] [DEBUG] [LOCAL ] BJ: Primary data saved (51834 records). [2025-10-23T20:15:39.415284] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-23T20:15:39.415427] [INFO ] [MAIN ] Update Progress: 288/2367 symbols completed. BJ took 47.3s. Estimated remaining: 4h 16m 54s. Rate: 8.1 symbols/min [2025-10-23T20:15:39.585406] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:39.630101] [DEBUG] [LOCAL ] BKSY: Loaded 48912 existing records from primary storage. [2025-10-23T20:15:39.630434] [INFO ] [MAIN ] BKSY: Loaded 48912 existing records. [2025-10-23T20:15:39.810923] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:15:39.811142] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-23T20:15:39.811216] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-23T20:15:39.811555] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-23T20:15:39.811630] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-23T20:15:40.014984] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-23T20:15:40.132594] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-23T20:15:40.199902] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:15:40.513085] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T20:15:40.799486] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-23T20:15:41.069297] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T20:15:41.599446] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-23T20:15:41.993485] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T20:15:42.399415] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-23T20:15:43.060834] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T20:15:43.199453] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-23T20:15:43.227908] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T20:15:43.945914] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T20:15:43.999437] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-23T20:15:44.799452] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-23T20:15:45.378923] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T20:15:45.599459] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-23T20:15:46.399413] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-23T20:15:47.044171] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T20:15:47.199462] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-23T20:15:47.522226] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-23T20:15:47.784221] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:15:47.999419] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-23T20:15:48.810339] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-23T20:15:48.812938] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T20:15:49.599495] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-23T20:15:50.122758] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-23T20:15:50.399474] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-23T20:15:50.720467] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T20:15:50.799674] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T20:15:51.199429] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-23T20:15:51.999413] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-23T20:15:52.018121] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T20:15:52.148146] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T20:15:52.799448] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-23T20:15:53.535607] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T20:15:53.559059] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T20:15:53.599408] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-23T20:15:54.399435] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-23T20:15:55.199417] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-23T20:15:55.314978] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T20:15:55.984157] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T20:15:55.999396] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-23T20:15:56.358023] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T20:15:56.798704] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T20:15:56.799474] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-23T20:15:57.599451] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-23T20:15:58.399425] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-23T20:15:58.502101] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T20:15:58.871973] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T20:15:58.879159] [INFO ] [REMOTE ] BKH: Full fetch complete (53240 records). [2025-10-23T20:15:58.879310] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-23T20:15:59.204535] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-23T20:15:59.256143] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-23T20:15:59.256246] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-23T20:15:59.256927] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-23T20:15:59.257004] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-23T20:15:59.258183] [DEBUG] [LOCAL ] BKH: Trimmed 53240 records to 37650 (keeping 200 days of data) [2025-10-23T20:15:59.480213] [DEBUG] [LOCAL ] BKH: Primary data saved (37650 records). [2025-10-23T20:15:59.480376] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-23T20:15:59.480491] [INFO ] [MAIN ] Update Progress: 289/2367 symbols completed. BKH took 30.2s. Estimated remaining: 4h 18m 17s. Rate: 8.0 symbols/min [2025-10-23T20:15:59.653104] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:15:59.668758] [DEBUG] [LOCAL ] BKT: Loaded 12833 existing records from primary storage. [2025-10-23T20:15:59.669054] [INFO ] [MAIN ] BKT: Loaded 12833 existing records. [2025-10-23T20:15:59.844510] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:15:59.844762] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-23T20:15:59.844838] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-23T20:15:59.845075] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-23T20:15:59.845149] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-23T20:16:00.012426] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-23T20:16:00.204011] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:00.799471] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-23T20:16:00.886956] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-23T20:16:00.895920] [INFO ] [REMOTE ] BKKT: Full fetch complete (52046 records). [2025-10-23T20:16:00.896063] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-23T20:16:01.173276] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T20:16:01.316523] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-23T20:16:01.316672] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-23T20:16:01.317435] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-23T20:16:01.317516] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-23T20:16:01.318826] [DEBUG] [LOCAL ] BKKT: Trimmed 52046 records to 37753 (keeping 200 days of data) [2025-10-23T20:16:01.535266] [DEBUG] [LOCAL ] BKKT: Primary data saved (37753 records). [2025-10-23T20:16:01.535457] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-23T20:16:01.535572] [INFO ] [MAIN ] Update Progress: 290/2367 symbols completed. BKKT took 31.0s. Estimated remaining: 4h 17m 31s. Rate: 8.1 symbols/min [2025-10-23T20:16:01.600032] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-23T20:16:01.724273] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:01.762456] [DEBUG] [LOCAL ] BKU: Loaded 42169 existing records from primary storage. [2025-10-23T20:16:01.762826] [INFO ] [MAIN ] BKU: Loaded 42169 existing records. [2025-10-23T20:16:02.005817] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-23T20:16:02.009833] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:02.020069] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-23T20:16:02.020819] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-23T20:16:02.021328] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-23T20:16:02.021411] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-23T20:16:02.386173] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:02.399454] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-23T20:16:02.500161] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T20:16:02.865488] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T20:16:03.199483] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-23T20:16:03.999442] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-23T20:16:04.491549] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-23T20:16:04.799413] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-23T20:16:04.959385] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T20:16:05.309674] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-23T20:16:05.599424] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-23T20:16:06.350790] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T20:16:06.399404] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-23T20:16:07.199471] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-23T20:16:07.784062] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T20:16:07.999428] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-23T20:16:08.038000] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T20:16:08.039796] [INFO ] [REMOTE ] BKN: Full fetch complete (11054 records). [2025-10-23T20:16:08.039889] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-23T20:16:08.325420] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T20:16:08.438272] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-23T20:16:08.438397] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-23T20:16:08.438753] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-23T20:16:08.438870] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-23T20:16:08.439397] [DEBUG] [LOCAL ] BKN: Trimmed 11054 records to 7337 (keeping 200 days of data) [2025-10-23T20:16:08.483256] [DEBUG] [LOCAL ] BKN: Primary data saved (7337 records). [2025-10-23T20:16:08.483418] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-23T20:16:08.483549] [INFO ] [MAIN ] Update Progress: 291/2367 symbols completed. BKN took 30.7s. Estimated remaining: 4h 17m 20s. Rate: 8.1 symbols/min [2025-10-23T20:16:08.652126] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:08.679274] [DEBUG] [LOCAL ] BKV: Loaded 29342 existing records from primary storage. [2025-10-23T20:16:08.679560] [INFO ] [MAIN ] BKV: Loaded 29342 existing records. [2025-10-23T20:16:08.804522] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-23T20:16:08.859168] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:08.859517] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-23T20:16:08.859611] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-23T20:16:08.860006] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-23T20:16:08.860093] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-23T20:16:09.217982] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:09.599455] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-23T20:16:09.782519] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T20:16:10.292053] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-23T20:16:10.399508] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-23T20:16:10.995201] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:16:11.199538] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-23T20:16:11.999448] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-23T20:16:12.663103] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T20:16:12.778523] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-23T20:16:12.788311] [INFO ] [REMOTE ] BKSY: Full fetch complete (70621 records). [2025-10-23T20:16:12.788529] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-23T20:16:12.804747] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-23T20:16:13.229619] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-23T20:16:13.229806] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-23T20:16:13.231060] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-23T20:16:13.231150] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-23T20:16:13.233250] [DEBUG] [LOCAL ] BKSY: Trimmed 70621 records to 49291 (keeping 200 days of data) [2025-10-23T20:16:13.559543] [DEBUG] [LOCAL ] BKSY: Primary data saved (49291 records). [2025-10-23T20:16:13.559819] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-23T20:16:13.559966] [INFO ] [MAIN ] Update Progress: 292/2367 symbols completed. BKSY took 34.1s. Estimated remaining: 4h 16m 56s. Rate: 8.1 symbols/min [2025-10-23T20:16:13.605216] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-23T20:16:13.765235] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:13.802446] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T20:16:13.844378] [DEBUG] [LOCAL ] BLCO: Loaded 34928 existing records from primary storage. [2025-10-23T20:16:13.844837] [INFO ] [MAIN ] BLCO: Loaded 34928 existing records. [2025-10-23T20:16:14.033176] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:14.033517] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-23T20:16:14.033608] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-23T20:16:14.034013] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-23T20:16:14.034102] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-23T20:16:14.418968] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-23T20:16:14.426058] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:14.451012] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:16:14.606057] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-23T20:16:15.199453] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-23T20:16:15.999421] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-23T20:16:16.165166] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T20:16:16.456918] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T20:16:16.799440] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-23T20:16:17.554271] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:16:17.599486] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-23T20:16:18.045948] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T20:16:18.399453] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-23T20:16:19.192407] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T20:16:19.200072] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-23T20:16:19.999445] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-23T20:16:20.063133] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T20:16:20.700207] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T20:16:20.799401] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-23T20:16:20.927780] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T20:16:21.599435] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-23T20:16:22.399406] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-23T20:16:22.468118] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T20:16:22.574818] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:16:23.199462] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-23T20:16:23.968254] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T20:16:23.999409] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-23T20:16:24.804504] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-23T20:16:24.818107] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T20:16:25.507833] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T20:16:25.599450] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-23T20:16:26.399431] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-23T20:16:26.529467] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T20:16:26.953174] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T20:16:27.199414] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-23T20:16:27.460027] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T20:16:27.999431] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-23T20:16:28.797932] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T20:16:28.805922] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-23T20:16:29.170588] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T20:16:29.599417] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-23T20:16:30.399442] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-23T20:16:30.521897] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T20:16:31.199419] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-23T20:16:31.462411] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-23T20:16:31.471776] [INFO ] [REMOTE ] BKU: Full fetch complete (61055 records). [2025-10-23T20:16:31.471930] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-23T20:16:31.830537] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T20:16:31.918342] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-23T20:16:31.918475] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-23T20:16:31.919302] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-23T20:16:31.919400] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-23T20:16:31.920698] [DEBUG] [LOCAL ] BKU: Trimmed 61055 records to 42479 (keeping 200 days of data) [2025-10-23T20:16:32.006970] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-23T20:16:32.175992] [DEBUG] [LOCAL ] BKU: Primary data saved (42479 records). [2025-10-23T20:16:32.176164] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-23T20:16:32.176291] [INFO ] [MAIN ] Update Progress: 293/2367 symbols completed. BKU took 30.6s. Estimated remaining: 4h 18m 8s. Rate: 8.0 symbols/min [2025-10-23T20:16:32.353638] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:32.375082] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T20:16:32.404025] [DEBUG] [LOCAL ] BLD: Loaded 27046 existing records from primary storage. [2025-10-23T20:16:32.404312] [INFO ] [MAIN ] BLD: Loaded 27046 existing records. [2025-10-23T20:16:32.579468] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:32.579703] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-23T20:16:32.579780] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-23T20:16:32.580019] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-23T20:16:32.580090] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-23T20:16:32.809861] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-23T20:16:32.936235] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:33.213234] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T20:16:33.599494] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-23T20:16:34.179270] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T20:16:34.184936] [INFO ] [REMOTE ] BKV: Full fetch complete (44793 records). [2025-10-23T20:16:34.185046] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-23T20:16:34.404537] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-23T20:16:34.557474] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-23T20:16:34.557600] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-23T20:16:34.558532] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-23T20:16:34.558625] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-23T20:16:34.559716] [DEBUG] [LOCAL ] BKV: Trimmed 44793 records to 29546 (keeping 200 days of data) [2025-10-23T20:16:34.724718] [DEBUG] [LOCAL ] BKV: Primary data saved (29546 records). [2025-10-23T20:16:34.724882] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-23T20:16:34.724993] [INFO ] [MAIN ] Update Progress: 294/2367 symbols completed. BKV took 26.2s. Estimated remaining: 4h 17m 25s. Rate: 8.1 symbols/min [2025-10-23T20:16:34.893055] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:34.942458] [DEBUG] [LOCAL ] BLDR: Loaded 51855 existing records from primary storage. [2025-10-23T20:16:34.942822] [INFO ] [MAIN ] BLDR: Loaded 51855 existing records. [2025-10-23T20:16:35.121208] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:35.121436] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-23T20:16:35.121510] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-23T20:16:35.121765] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-23T20:16:35.121848] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-23T20:16:35.210794] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-23T20:16:35.408498] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T20:16:35.497991] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:35.999435] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-23T20:16:36.041926] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T20:16:36.429225] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T20:16:36.433236] [INFO ] [REMOTE ] BKT: Full fetch complete (16763 records). [2025-10-23T20:16:36.433327] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-23T20:16:36.787335] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-23T20:16:36.787448] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-23T20:16:36.787835] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-23T20:16:36.787911] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-23T20:16:36.788468] [DEBUG] [LOCAL ] BKT: Trimmed 16763 records to 12907 (keeping 200 days of data) [2025-10-23T20:16:36.820531] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-23T20:16:36.866801] [DEBUG] [LOCAL ] BKT: Primary data saved (12907 records). [2025-10-23T20:16:36.866954] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-23T20:16:36.867068] [INFO ] [MAIN ] Update Progress: 295/2367 symbols completed. BKT took 37.4s. Estimated remaining: 4h 16m 41s. Rate: 8.1 symbols/min [2025-10-23T20:16:37.033368] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:37.051628] [DEBUG] [LOCAL ] BLE: Loaded 13616 existing records from primary storage. [2025-10-23T20:16:37.051933] [INFO ] [MAIN ] BLE: Loaded 13616 existing records. [2025-10-23T20:16:37.225172] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:37.225372] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-23T20:16:37.225446] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-23T20:16:37.225694] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-23T20:16:37.225790] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-23T20:16:37.598284] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:37.599976] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T20:16:37.599308] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-23T20:16:38.231176] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T20:16:38.399416] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-23T20:16:38.599310] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T20:16:39.199427] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-23T20:16:39.785502] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T20:16:39.999426] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-23T20:16:40.799415] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-23T20:16:40.903977] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T20:16:41.111752] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T20:16:41.599430] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-23T20:16:42.279283] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T20:16:42.399491] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-23T20:16:42.513903] [DEBUG] [REMOTE ] BLDR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-23T20:16:42.514584] [WARN ] [REMOTE ] BLDR: No data returned for month 2025-02 [2025-10-23T20:16:42.514741] [FATAL] [REMOTE ] BLDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:16:42.514866] [FATAL] [MAIN ] BLDR: Failed to fetch primary data. [2025-10-23T20:16:42.514955] [WARN ] [MAIN ] BLDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:16:42.515053] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-23T20:16:42.515198] [DEBUG] [LOCAL ] BLDR: No primary data file found to delete. [2025-10-23T20:16:42.515294] [INFO ] [LOCAL ] BLDR: Starting deletion of derivative data. [2025-10-23T20:16:42.515498] [DEBUG] [LOCAL ] BLDR: Deleted derivative data file. [2025-10-23T20:16:42.515628] [INFO ] [MAIN ] Update Progress: 296/2367 symbols completed. BLDR took 7.8s. Estimated remaining: 4h 16m 21s. Rate: 8.1 symbols/min [2025-10-23T20:16:42.737230] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:42.771122] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T20:16:42.792458] [DEBUG] [LOCAL ] BLK: Loaded 34184 existing records from primary storage. [2025-10-23T20:16:42.792892] [INFO ] [MAIN ] BLK: Loaded 34184 existing records. [2025-10-23T20:16:43.015774] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:43.016000] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-23T20:16:43.016080] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-23T20:16:43.016308] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-23T20:16:43.016382] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-23T20:16:43.214116] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-23T20:16:43.412424] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:43.999430] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-23T20:16:44.248050] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T20:16:44.799453] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-23T20:16:45.599456] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-23T20:16:45.793760] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T20:16:46.033527] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T20:16:46.399438] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-23T20:16:46.922562] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T20:16:47.199448] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-23T20:16:47.557312] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T20:16:47.999468] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-23T20:16:48.537178] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T20:16:48.799407] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-23T20:16:49.387463] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T20:16:49.393160] [INFO ] [REMOTE ] BLCO: Full fetch complete (52323 records). [2025-10-23T20:16:49.393284] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-23T20:16:49.604579] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-23T20:16:49.776826] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-23T20:16:49.776934] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-23T20:16:49.777693] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-23T20:16:49.777776] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-23T20:16:49.778957] [DEBUG] [LOCAL ] BLCO: Trimmed 52323 records to 35092 (keeping 200 days of data) [2025-10-23T20:16:49.976790] [DEBUG] [LOCAL ] BLCO: Primary data saved (35092 records). [2025-10-23T20:16:49.976945] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-23T20:16:49.977071] [INFO ] [MAIN ] Update Progress: 297/2367 symbols completed. BLCO took 36.4s. Estimated remaining: 4h 16m 14s. Rate: 8.1 symbols/min [2025-10-23T20:16:50.151751] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:50.195343] [DEBUG] [LOCAL ] BLND: Loaded 49215 existing records from primary storage. [2025-10-23T20:16:50.195741] [INFO ] [MAIN ] BLND: Loaded 49215 existing records. [2025-10-23T20:16:50.384418] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:16:50.401140] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-23T20:16:50.401052] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-23T20:16:50.402161] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-23T20:16:50.403355] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T20:16:50.409877] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-23T20:16:50.410574] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-23T20:16:50.764417] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:51.199420] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-23T20:16:51.360588] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T20:16:51.549970] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T20:16:51.999444] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-23T20:16:52.744022] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T20:16:52.799447] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-23T20:16:52.963069] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T20:16:53.599441] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-23T20:16:54.399398] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-23T20:16:54.810809] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T20:16:55.114077] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T20:16:55.199409] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-23T20:16:55.437015] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T20:16:55.999465] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-23T20:16:56.799547] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-23T20:16:57.256160] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:16:57.463285] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T20:16:57.466075] [INFO ] [REMOTE ] BLE: Full fetch complete (19502 records). [2025-10-23T20:16:57.466208] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-23T20:16:57.604530] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-23T20:16:57.893121] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-23T20:16:57.893423] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-23T20:16:57.894451] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-23T20:16:57.894693] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-23T20:16:57.923195] [DEBUG] [LOCAL ] BLE: Trimmed 19502 records to 13680 (keeping 200 days of data) [2025-10-23T20:16:57.929883] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T20:16:58.036878] [DEBUG] [LOCAL ] BLE: Primary data saved (13680 records). [2025-10-23T20:16:58.037178] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-23T20:16:58.037324] [INFO ] [MAIN ] Update Progress: 298/2367 symbols completed. BLE took 21.2s. Estimated remaining: 4h 16m 11s. Rate: 8.1 symbols/min [2025-10-23T20:16:58.217931] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:16:58.218285] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-23T20:16:58.218360] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-23T20:16:58.218483] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-23T20:16:58.218564] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-23T20:16:58.218677] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-23T20:16:58.218753] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-23T20:16:58.403566] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-23T20:16:58.605816] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:16:59.199470] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-23T20:16:59.563632] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T20:16:59.999450] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-23T20:17:00.315455] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T20:17:00.589256] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T20:17:00.799439] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-23T20:17:01.599452] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-23T20:17:01.995819] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T20:17:02.399505] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-23T20:17:03.086478] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-23T20:17:03.092742] [INFO ] [REMOTE ] BLD: Full fetch complete (39873 records). [2025-10-23T20:17:03.093035] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-23T20:17:03.210346] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-23T20:17:03.576849] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-23T20:17:03.576966] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-23T20:17:03.577529] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-23T20:17:03.577605] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-23T20:17:03.578676] [DEBUG] [LOCAL ] BLD: Trimmed 39873 records to 27205 (keeping 200 days of data) [2025-10-23T20:17:03.665458] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:17:03.684734] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-23T20:17:03.686931] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:17:03.690756] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-23T20:17:03.700963] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:17:03.701071] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-23T20:17:03.718440] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-23T20:17:03.731215] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-23T20:17:03.731583] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-23T20:17:03.737688] [INFO ] [MAIN ] Update Progress: 299/2367 symbols completed. BLSH took 5.7s. Estimated remaining: 4h 15m 51s. Rate: 8.1 symbols/min [2025-10-23T20:17:03.743923] [DEBUG] [LOCAL ] BLD: Primary data saved (27205 records). [2025-10-23T20:17:03.787145] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-23T20:17:03.813453] [INFO ] [MAIN ] Update Progress: 300/2367 symbols completed. BLD took 31.6s. Estimated remaining: 4h 14m 53s. Rate: 8.1 symbols/min [2025-10-23T20:17:04.025563] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:04.037194] [DEBUG] [LOCAL ] BLW: No existing data file found in primary storage. [2025-10-23T20:17:04.037678] [WARN ] [MAIN ] BLW: No existing data found, performing full refresh instead. [2025-10-23T20:17:04.048287] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-23T20:17:04.077240] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-23T20:17:04.110416] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:04.108919] [DEBUG] [LOCAL ] BLW: No primary data file found to delete. [2025-10-23T20:17:04.111129] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-23T20:17:04.248982] [DEBUG] [LOCAL ] BLX: Loaded 15410 existing records from primary storage. [2025-10-23T20:17:04.278429] [INFO ] [MAIN ] BLX: Loaded 15410 existing records. [2025-10-23T20:17:04.575157] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-23T20:17:04.646777] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:04.647292] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-23T20:17:04.692116] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-23T20:17:04.692518] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-23T20:17:04.709548] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-23T20:17:04.729791] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-23T20:17:04.729540] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:04.804276] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-23T20:17:05.087285] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-23T20:17:05.108399] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:05.599434] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-23T20:17:05.907044] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T20:17:06.399442] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-23T20:17:06.671274] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T20:17:06.757403] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T20:17:07.192672] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T20:17:07.199393] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-23T20:17:07.999441] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-23T20:17:08.334806] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T20:17:08.799440] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-23T20:17:09.599455] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-23T20:17:09.731589] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T20:17:10.399425] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-23T20:17:10.633932] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T20:17:10.748214] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T20:17:11.199470] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-23T20:17:11.558455] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T20:17:11.999448] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-23T20:17:12.461539] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T20:17:12.799437] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-23T20:17:12.888966] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T20:17:13.599464] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-23T20:17:14.399483] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-23T20:17:14.613433] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T20:17:15.199421] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-23T20:17:15.342956] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T20:17:15.632844] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T20:17:15.999439] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-23T20:17:16.123098] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T20:17:16.799499] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-23T20:17:17.599437] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-23T20:17:17.738173] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T20:17:17.925561] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-23T20:17:17.932897] [INFO ] [REMOTE ] BLK: Full fetch complete (52952 records). [2025-10-23T20:17:17.933117] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-23T20:17:18.332384] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-23T20:17:18.332527] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-23T20:17:18.333321] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-23T20:17:18.333403] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-23T20:17:18.334681] [DEBUG] [LOCAL ] BLK: Trimmed 52952 records to 34356 (keeping 200 days of data) [2025-10-23T20:17:18.400369] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-23T20:17:18.553736] [DEBUG] [LOCAL ] BLK: Primary data saved (34356 records). [2025-10-23T20:17:18.553892] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-23T20:17:18.555127] [INFO ] [MAIN ] Update Progress: 301/2367 symbols completed. BLK took 36.0s. Estimated remaining: 4h 15m 36s. Rate: 8.1 symbols/min [2025-10-23T20:17:18.720470] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:18.757536] [DEBUG] [LOCAL ] BMA: Loaded 36532 existing records from primary storage. [2025-10-23T20:17:18.757935] [INFO ] [MAIN ] BMA: Loaded 36532 existing records. [2025-10-23T20:17:18.933189] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:18.934033] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-23T20:17:18.934111] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-23T20:17:18.934349] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-23T20:17:18.934420] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-23T20:17:19.207415] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-23T20:17:19.322908] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:19.419202] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T20:17:19.501715] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T20:17:19.999441] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-23T20:17:20.469368] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T20:17:20.799410] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-23T20:17:21.102167] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T20:17:21.599423] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-23T20:17:22.399396] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-23T20:17:22.491559] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T20:17:23.132464] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T20:17:23.135535] [INFO ] [REMOTE ] BLW: Full fetch complete (19135 records). [2025-10-23T20:17:23.135662] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-23T20:17:23.204550] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-23T20:17:23.510071] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-23T20:17:23.510352] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-23T20:17:23.510877] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-23T20:17:23.511022] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-23T20:17:23.511740] [DEBUG] [LOCAL ] BLW: Trimmed 19135 records to 13028 (keeping 200 days of data) [2025-10-23T20:17:23.600516] [DEBUG] [LOCAL ] BLW: Primary data saved (13028 records). [2025-10-23T20:17:23.600967] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-23T20:17:23.612956] [INFO ] [MAIN ] Update Progress: 302/2367 symbols completed. BLW took 19.9s. Estimated remaining: 4h 15m 13s. Rate: 8.1 symbols/min [2025-10-23T20:17:23.642513] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T20:17:23.831004] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:23.842350] [DEBUG] [LOCAL ] BME: Loaded 11221 existing records from primary storage. [2025-10-23T20:17:23.842664] [INFO ] [MAIN ] BME: Loaded 11221 existing records. [2025-10-23T20:17:24.012491] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-23T20:17:24.020505] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:24.021725] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-23T20:17:24.021821] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-23T20:17:24.022120] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-23T20:17:24.022216] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-23T20:17:24.398393] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:24.799418] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-23T20:17:24.882110] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T20:17:25.258983] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T20:17:25.599432] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-23T20:17:26.399416] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-23T20:17:26.644908] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T20:17:26.689081] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T20:17:27.199454] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-23T20:17:27.975415] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T20:17:27.999402] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-23T20:17:28.799449] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-23T20:17:29.079590] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T20:17:29.089943] [INFO ] [REMOTE ] BLND: Full fetch complete (72214 records). [2025-10-23T20:17:29.090277] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-23T20:17:29.506188] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-23T20:17:29.506340] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-23T20:17:29.507382] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-23T20:17:29.507470] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-23T20:17:29.509107] [DEBUG] [LOCAL ] BLND: Trimmed 72214 records to 49593 (keeping 200 days of data) [2025-10-23T20:17:29.608894] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-23T20:17:29.813594] [DEBUG] [LOCAL ] BLND: Primary data saved (49593 records). [2025-10-23T20:17:29.814912] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:17:29.815028] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-23T20:17:29.833024] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T20:17:29.836630] [INFO ] [MAIN ] Update Progress: 303/2367 symbols completed. BLND took 39.9s. Estimated remaining: 4h 14m 57s. Rate: 8.1 symbols/min [2025-10-23T20:17:30.012741] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:30.038134] [DEBUG] [LOCAL ] BMEZ: Loaded 25062 existing records from primary storage. [2025-10-23T20:17:30.038436] [INFO ] [MAIN ] BMEZ: Loaded 25062 existing records. [2025-10-23T20:17:30.223058] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:30.223317] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-23T20:17:30.223396] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-23T20:17:30.223605] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-23T20:17:30.223716] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-23T20:17:30.408590] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-23T20:17:30.589296] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:30.594847] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T20:17:31.199450] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-23T20:17:31.942094] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T20:17:31.999449] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-23T20:17:32.809116] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-23T20:17:32.817489] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T20:17:32.947774] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T20:17:33.599469] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-23T20:17:33.856520] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T20:17:34.399409] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-23T20:17:34.687902] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T20:17:35.199443] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-23T20:17:35.558168] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T20:17:35.999454] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-23T20:17:36.410172] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T20:17:36.799500] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-23T20:17:37.018443] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T20:17:37.022238] [INFO ] [REMOTE ] BLX: Full fetch complete (22446 records). [2025-10-23T20:17:37.022370] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-23T20:17:37.410111] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-23T20:17:37.410261] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-23T20:17:37.411090] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-23T20:17:37.411175] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-23T20:17:37.412214] [DEBUG] [LOCAL ] BLX: Trimmed 22446 records to 15499 (keeping 200 days of data) [2025-10-23T20:17:37.509080] [DEBUG] [LOCAL ] BLX: Primary data saved (15499 records). [2025-10-23T20:17:37.509340] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-23T20:17:37.509504] [INFO ] [MAIN ] Update Progress: 304/2367 symbols completed. BLX took 33.7s. Estimated remaining: 4h 14m 51s. Rate: 8.1 symbols/min [2025-10-23T20:17:37.602986] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-23T20:17:37.692393] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:37.717871] [DEBUG] [LOCAL ] BMI: Loaded 24901 existing records from primary storage. [2025-10-23T20:17:37.718259] [INFO ] [MAIN ] BMI: Loaded 24901 existing records. [2025-10-23T20:17:37.896325] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:37.905742] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T20:17:37.905972] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-23T20:17:37.909053] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-23T20:17:37.910291] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-23T20:17:37.910375] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-23T20:17:38.259284] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:38.399414] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-23T20:17:39.199413] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-23T20:17:39.291562] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T20:17:39.674898] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T20:17:39.999453] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-23T20:17:40.191710] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T20:17:40.799446] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-23T20:17:41.109200] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T20:17:41.599433] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-23T20:17:42.236070] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T20:17:42.399434] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-23T20:17:43.206972] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-23T20:17:43.223473] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T20:17:43.999416] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-23T20:17:44.197570] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T20:17:44.280950] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T20:17:44.799445] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-23T20:17:45.289062] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T20:17:45.599430] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-23T20:17:45.635942] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T20:17:46.399441] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-23T20:17:47.131007] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T20:17:47.199447] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-23T20:17:47.999464] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-23T20:17:48.209868] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T20:17:48.217830] [INFO ] [REMOTE ] BMA: Full fetch complete (52425 records). [2025-10-23T20:17:48.217958] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-23T20:17:48.348194] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:17:48.613847] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-23T20:17:48.613958] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-23T20:17:48.614601] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-23T20:17:48.614693] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-23T20:17:48.615797] [DEBUG] [LOCAL ] BMA: Trimmed 52425 records to 36874 (keeping 200 days of data) [2025-10-23T20:17:48.811420] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-23T20:17:48.843017] [DEBUG] [LOCAL ] BMA: Primary data saved (36874 records). [2025-10-23T20:17:48.843193] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-23T20:17:48.844150] [INFO ] [MAIN ] Update Progress: 305/2367 symbols completed. BMA took 30.3s. Estimated remaining: 4h 15m 11s. Rate: 8.1 symbols/min [2025-10-23T20:17:49.016727] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:49.021545] [DEBUG] [LOCAL ] BMN: Loaded 2644 existing records from primary storage. [2025-10-23T20:17:49.021783] [INFO ] [MAIN ] BMN: Loaded 2644 existing records. [2025-10-23T20:17:49.193841] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:49.194031] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-23T20:17:49.194104] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-23T20:17:49.194269] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-23T20:17:49.194339] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-23T20:17:49.550534] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T20:17:49.562883] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:49.599405] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-23T20:17:49.833234] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T20:17:50.330254] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T20:17:50.399440] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-23T20:17:51.003502] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T20:17:51.199447] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-23T20:17:51.999438] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-23T20:17:52.763451] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T20:17:52.799416] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-23T20:17:52.965783] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T20:17:52.968527] [INFO ] [REMOTE ] BME: Full fetch complete (15602 records). [2025-10-23T20:17:52.968620] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-23T20:17:53.357624] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-23T20:17:53.357753] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-23T20:17:53.358162] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-23T20:17:53.358247] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-23T20:17:53.358800] [DEBUG] [LOCAL ] BME: Trimmed 15602 records to 11273 (keeping 200 days of data) [2025-10-23T20:17:53.425840] [DEBUG] [LOCAL ] BME: Primary data saved (11273 records). [2025-10-23T20:17:53.426010] [INFO ] [MAIN ] BME: Full history saved. [2025-10-23T20:17:53.426125] [INFO ] [MAIN ] Update Progress: 306/2367 symbols completed. BME took 29.8s. Estimated remaining: 4h 14m 44s. Rate: 8.1 symbols/min [2025-10-23T20:17:53.591172] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:17:53.599434] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-23T20:17:53.630545] [DEBUG] [LOCAL ] BMO: Loaded 40992 existing records from primary storage. [2025-10-23T20:17:53.630876] [INFO ] [MAIN ] BMO: Loaded 40992 existing records. [2025-10-23T20:17:53.808684] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:17:53.808929] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-23T20:17:53.809003] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-23T20:17:53.809341] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-23T20:17:53.809415] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-23T20:17:54.172733] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:17:54.174229] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T20:17:54.178254] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T20:17:54.399363] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-23T20:17:55.199566] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-23T20:17:55.999413] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-23T20:17:56.077088] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:17:56.497877] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T20:17:56.730564] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T20:17:56.799432] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-23T20:17:57.599433] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-23T20:17:58.065919] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T20:17:58.399465] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-23T20:17:58.697095] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T20:17:59.199416] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-23T20:17:59.999488] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-23T20:18:00.136402] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T20:18:00.799499] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-23T20:18:01.217015] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T20:18:01.390136] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T20:18:01.599469] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-23T20:18:02.399473] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-23T20:18:02.432553] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T20:18:03.070374] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-23T20:18:03.199414] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-23T20:18:03.776082] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T20:18:03.999422] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-23T20:18:04.799417] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-23T20:18:05.067071] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T20:18:05.579215] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T20:18:05.599403] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-23T20:18:06.199296] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T20:18:06.399456] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-23T20:18:06.988997] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T20:18:06.997010] [INFO ] [REMOTE ] BMI: Full fetch complete (34271 records). [2025-10-23T20:18:06.997145] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T20:18:06.998559] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-23T20:18:07.204798] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-23T20:18:07.376958] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-23T20:18:07.377074] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-23T20:18:07.377590] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-23T20:18:07.377689] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-23T20:18:07.378517] [DEBUG] [LOCAL ] BMI: Trimmed 34271 records to 25126 (keeping 200 days of data) [2025-10-23T20:18:07.533933] [DEBUG] [LOCAL ] BMI: Primary data saved (25126 records). [2025-10-23T20:18:07.534534] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-23T20:18:07.534717] [INFO ] [MAIN ] Update Progress: 307/2367 symbols completed. BMI took 30.0s. Estimated remaining: 4h 15m 21s. Rate: 8.1 symbols/min [2025-10-23T20:18:07.701992] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:07.751087] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-23T20:18:07.751461] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-23T20:18:07.928531] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:07.928786] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-23T20:18:07.928901] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-23T20:18:07.929594] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-23T20:18:07.929723] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-23T20:18:07.999432] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-23T20:18:08.014310] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T20:18:08.293209] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:08.799446] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-23T20:18:09.331778] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T20:18:09.336481] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39332 records). [2025-10-23T20:18:09.336609] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-23T20:18:09.604549] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-23T20:18:09.753570] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-23T20:18:09.753754] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-23T20:18:09.754495] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-23T20:18:09.754595] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-23T20:18:09.755774] [DEBUG] [LOCAL ] BMEZ: Trimmed 39332 records to 25188 (keeping 200 days of data) [2025-10-23T20:18:09.913025] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25188 records). [2025-10-23T20:18:09.913188] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-23T20:18:09.913309] [INFO ] [MAIN ] Update Progress: 308/2367 symbols completed. BMEZ took 40.1s. Estimated remaining: 4h 14m 40s. Rate: 8.1 symbols/min [2025-10-23T20:18:10.078398] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:10.125948] [DEBUG] [LOCAL ] BN: Loaded 52983 existing records from primary storage. [2025-10-23T20:18:10.126275] [INFO ] [MAIN ] BN: Loaded 52983 existing records. [2025-10-23T20:18:10.298792] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:10.298992] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-23T20:18:10.299066] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-23T20:18:10.299276] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-23T20:18:10.299359] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-23T20:18:10.401454] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-23T20:18:10.665306] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:10.905333] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-23T20:18:11.199466] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-23T20:18:11.310094] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-23T20:18:11.357590] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T20:18:11.999534] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-23T20:18:12.799410] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-23T20:18:13.260348] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-23T20:18:13.599462] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-23T20:18:14.103987] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T20:18:14.381774] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T20:18:14.399401] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-23T20:18:15.199450] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-23T20:18:15.843860] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-23T20:18:15.999415] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-23T20:18:16.331612] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T20:18:16.606020] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T20:18:16.799450] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-23T20:18:17.209757] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-23T20:18:17.419804] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T20:18:17.420891] [INFO ] [REMOTE ] BMN: Full fetch complete (3732 records). [2025-10-23T20:18:17.420979] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-23T20:18:17.607982] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-23T20:18:17.781845] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-23T20:18:17.781960] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-23T20:18:17.782092] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-23T20:18:17.782159] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-23T20:18:17.782593] [DEBUG] [LOCAL ] BMN: Trimmed 3732 records to 2661 (keeping 200 days of data) [2025-10-23T20:18:17.799122] [DEBUG] [LOCAL ] BMN: Primary data saved (2661 records). [2025-10-23T20:18:17.799269] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-23T20:18:17.799404] [INFO ] [MAIN ] Update Progress: 309/2367 symbols completed. BMN took 29.0s. Estimated remaining: 4h 14m 36s. Rate: 8.1 symbols/min [2025-10-23T20:18:17.966414] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:17.994070] [DEBUG] [LOCAL ] BNED: Loaded 28217 existing records from primary storage. [2025-10-23T20:18:17.994403] [INFO ] [MAIN ] BNED: Loaded 28217 existing records. [2025-10-23T20:18:18.168972] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:18.169210] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-23T20:18:18.169286] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-23T20:18:18.169632] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-23T20:18:18.169757] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-23T20:18:18.406999] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-23T20:18:18.522367] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:19.199428] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-23T20:18:19.443997] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:18:19.999464] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-23T20:18:20.610151] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-23T20:18:20.753262] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:18:20.799396] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-23T20:18:21.599423] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-23T20:18:21.688833] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T20:18:21.749559] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T20:18:22.399508] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-23T20:18:23.199418] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-23T20:18:23.312686] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T20:18:23.999410] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-23T20:18:24.083727] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T20:18:24.799420] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-23T20:18:24.926839] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T20:18:24.933920] [INFO ] [REMOTE ] BMO: Full fetch complete (59922 records). [2025-10-23T20:18:24.934065] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-23T20:18:25.307893] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-23T20:18:25.307998] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-23T20:18:25.308740] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-23T20:18:25.308817] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-23T20:18:25.309987] [DEBUG] [LOCAL ] BMO: Trimmed 59922 records to 41220 (keeping 200 days of data) [2025-10-23T20:18:25.559001] [DEBUG] [LOCAL ] BMO: Primary data saved (41220 records). [2025-10-23T20:18:25.559135] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-23T20:18:25.559251] [INFO ] [MAIN ] Update Progress: 310/2367 symbols completed. BMO took 32.1s. Estimated remaining: 4h 14m 31s. Rate: 8.1 symbols/min [2025-10-23T20:18:25.604549] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-23T20:18:25.731980] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:25.738953] [DEBUG] [LOCAL ] BNH: Loaded 4701 existing records from primary storage. [2025-10-23T20:18:25.739145] [INFO ] [MAIN ] BNH: Loaded 4701 existing records. [2025-10-23T20:18:25.916471] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:25.916838] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-23T20:18:25.917035] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-23T20:18:25.917262] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-23T20:18:25.917388] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-23T20:18:26.241730] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-23T20:18:26.328613] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:26.399405] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-23T20:18:27.115887] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T20:18:27.199403] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-23T20:18:27.247547] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T20:18:27.249268] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-23T20:18:27.999434] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-23T20:18:28.799424] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-23T20:18:29.094770] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T20:18:29.599430] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-23T20:18:30.240620] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T20:18:30.346268] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-23T20:18:30.399420] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-23T20:18:31.199431] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-23T20:18:31.406531] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T20:18:31.774963] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:18:31.999465] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-23T20:18:32.799442] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-23T20:18:33.249900] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-23T20:18:33.538624] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T20:18:33.599481] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-23T20:18:34.049451] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T20:18:34.399509] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-23T20:18:35.117951] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T20:18:35.199478] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-23T20:18:35.906363] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-23T20:18:35.999479] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-23T20:18:36.018017] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T20:18:36.799433] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-23T20:18:37.599404] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-23T20:18:38.167027] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-23T20:18:38.399475] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-23T20:18:38.979824] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T20:18:39.119068] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T20:18:39.199469] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-23T20:18:39.965258] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T20:18:39.999415] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-23T20:18:40.382336] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:18:40.394613] [INFO ] [REMOTE ] BN: Full fetch complete (76956 records). [2025-10-23T20:18:40.394858] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-23T20:18:40.783296] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-23T20:18:40.783423] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-23T20:18:40.784407] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-23T20:18:40.784501] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-23T20:18:40.786211] [DEBUG] [LOCAL ] BN: Trimmed 76956 records to 53372 (keeping 200 days of data) [2025-10-23T20:18:40.839530] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-23T20:18:41.108076] [DEBUG] [LOCAL ] BN: Primary data saved (53372 records). [2025-10-23T20:18:41.108262] [INFO ] [MAIN ] BN: Full history saved. [2025-10-23T20:18:41.108379] [INFO ] [MAIN ] Update Progress: 311/2367 symbols completed. BN took 31.2s. Estimated remaining: 4h 15m 17s. Rate: 8.1 symbols/min [2025-10-23T20:18:41.278477] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:41.283585] [DEBUG] [LOCAL ] BNJ: Loaded 2500 existing records from primary storage. [2025-10-23T20:18:41.283830] [INFO ] [MAIN ] BNJ: Loaded 2500 existing records. [2025-10-23T20:18:41.459540] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:41.459940] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-23T20:18:41.460015] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-23T20:18:41.460198] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-23T20:18:41.460270] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-23T20:18:41.603770] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-23T20:18:41.651519] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T20:18:41.830483] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:42.258768] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-23T20:18:42.399443] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-23T20:18:42.783306] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T20:18:42.815429] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-23T20:18:43.199430] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-23T20:18:43.999446] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-23T20:18:44.516465] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T20:18:44.585811] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T20:18:44.799513] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-23T20:18:45.517439] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T20:18:45.599487] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-23T20:18:46.371078] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T20:18:46.399405] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-23T20:18:47.172619] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T20:18:47.174364] [INFO ] [REMOTE ] BNH: Full fetch complete (6862 records). [2025-10-23T20:18:47.174460] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-23T20:18:47.205436] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-23T20:18:47.540882] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-23T20:18:47.541023] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-23T20:18:47.541317] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-23T20:18:47.541406] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-23T20:18:47.541922] [DEBUG] [LOCAL ] BNH: Trimmed 6862 records to 4720 (keeping 200 days of data) [2025-10-23T20:18:47.575083] [DEBUG] [LOCAL ] BNH: Primary data saved (4720 records). [2025-10-23T20:18:47.575316] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-23T20:18:47.575466] [INFO ] [MAIN ] Update Progress: 312/2367 symbols completed. BNH took 22.0s. Estimated remaining: 4h 15m 3s. Rate: 8.1 symbols/min [2025-10-23T20:18:47.760410] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:47.807736] [DEBUG] [LOCAL ] BNL: Loaded 47073 existing records from primary storage. [2025-10-23T20:18:47.808244] [INFO ] [MAIN ] BNL: Loaded 47073 existing records. [2025-10-23T20:18:47.998747] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:47.999113] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-23T20:18:47.999197] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-23T20:18:47.999454] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-23T20:18:47.999626] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-23T20:18:48.001137] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-23T20:18:48.410125] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:48.799477] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-23T20:18:49.347537] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T20:18:49.351724] [INFO ] [REMOTE ] BNED: Full fetch complete (41786 records). [2025-10-23T20:18:49.351828] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-23T20:18:49.607508] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-23T20:18:49.740354] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-23T20:18:49.740598] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-23T20:18:49.741346] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-23T20:18:49.755740] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-23T20:18:49.768882] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-23T20:18:49.778127] [DEBUG] [LOCAL ] BNED: Trimmed 41786 records to 28371 (keeping 200 days of data) [2025-10-23T20:18:49.779556] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-23T20:18:49.779793] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-23T20:18:50.126079] [DEBUG] [LOCAL ] BNED: Primary data saved (28371 records). [2025-10-23T20:18:50.162084] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-23T20:18:50.187785] [INFO ] [MAIN ] Update Progress: 313/2367 symbols completed. BNED took 32.4s. Estimated remaining: 4h 14m 24s. Rate: 8.1 symbols/min [2025-10-23T20:18:50.417218] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T20:18:50.477729] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-23T20:18:50.520756] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-23T20:18:50.530086] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-23T20:18:50.531225] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-23T20:18:50.531348] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-23T20:18:50.558108] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:50.568380] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54147 (keeping 200 days of data) [2025-10-23T20:18:50.584911] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T20:18:50.938666] [DEBUG] [LOCAL ] BNS: Loaded 51416 existing records from primary storage. [2025-10-23T20:18:50.950761] [INFO ] [MAIN ] BNS: Loaded 51416 existing records. [2025-10-23T20:18:51.084102] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-23T20:18:51.099871] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-23T20:18:51.115255] [INFO ] [MAIN ] Update Progress: 314/2367 symbols completed. BMY took 43.6s. Estimated remaining: 4h 13m 34s. Rate: 8.1 symbols/min [2025-10-23T20:18:51.203325] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-23T20:18:51.225811] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:51.246899] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T20:18:51.249564] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-23T20:18:51.280274] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-23T20:18:51.285051] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-23T20:18:51.301038] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-23T20:18:51.456772] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:18:51.534912] [DEBUG] [LOCAL ] BNT: Loaded 3527 existing records from primary storage. [2025-10-23T20:18:51.545195] [INFO ] [MAIN ] BNT: Loaded 3527 existing records. [2025-10-23T20:18:51.928639] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:18:51.965221] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-23T20:18:51.969015] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-23T20:18:51.968813] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:51.969401] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-23T20:18:51.969492] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-23T20:18:52.004507] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-23T20:18:52.341760] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:18:52.799440] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-23T20:18:52.899843] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T20:18:53.491011] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-23T20:18:53.599434] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-23T20:18:53.678213] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T20:18:54.211203] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T20:18:54.399445] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-23T20:18:55.122518] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T20:18:55.199444] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-23T20:18:55.999450] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-23T20:18:56.799415] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-23T20:18:57.263202] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-23T20:18:57.548294] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-23T20:18:57.599415] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-23T20:18:57.942843] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T20:18:58.399406] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-23T20:18:58.469444] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T20:18:59.199448] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-23T20:18:59.999412] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-23T20:19:00.082990] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T20:19:00.387512] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:19:00.799439] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-23T20:19:00.932922] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T20:19:01.599447] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-23T20:19:02.399445] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-23T20:19:03.075631] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T20:19:03.199481] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-23T20:19:03.208803] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T20:19:03.736394] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-23T20:19:03.860352] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T20:19:03.999468] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-23T20:19:04.704180] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-23T20:19:04.799490] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-23T20:19:05.599461] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-23T20:19:06.399443] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-23T20:19:06.617727] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:19:07.117600] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T20:19:07.199399] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-23T20:19:07.613809] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-23T20:19:07.761522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T20:19:07.762872] [INFO ] [REMOTE ] BNJ: Full fetch complete (3862 records). [2025-10-23T20:19:07.762990] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-23T20:19:08.004593] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-23T20:19:08.131980] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-23T20:19:08.132103] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-23T20:19:08.132288] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-23T20:19:08.132364] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-23T20:19:08.132811] [DEBUG] [LOCAL ] BNJ: Trimmed 3862 records to 2508 (keeping 200 days of data) [2025-10-23T20:19:08.148968] [DEBUG] [LOCAL ] BNJ: Primary data saved (2508 records). [2025-10-23T20:19:08.149063] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-23T20:19:08.149173] [INFO ] [MAIN ] Update Progress: 315/2367 symbols completed. BNJ took 27.0s. Estimated remaining: 4h 14m 29s. Rate: 8.1 symbols/min [2025-10-23T20:19:08.344801] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:08.354815] [DEBUG] [LOCAL ] BNY: Loaded 7253 existing records from primary storage. [2025-10-23T20:19:08.355071] [INFO ] [MAIN ] BNY: Loaded 7253 existing records. [2025-10-23T20:19:08.541195] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:19:08.541454] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-23T20:19:08.541530] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-23T20:19:08.541807] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-23T20:19:08.541880] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-23T20:19:08.806191] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-23T20:19:08.916208] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:09.599401] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-23T20:19:09.731449] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T20:19:10.328817] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T20:19:10.399405] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-23T20:19:10.623279] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:19:11.107535] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T20:19:11.199436] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-23T20:19:11.999442] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-23T20:19:12.540707] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T20:19:12.799410] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-23T20:19:13.034141] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T20:19:13.401293] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T20:19:13.599487] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-23T20:19:14.399480] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-23T20:19:15.071905] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T20:19:15.122339] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T20:19:15.123987] [INFO ] [REMOTE ] BNT: Full fetch complete (4854 records). [2025-10-23T20:19:15.124078] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-23T20:19:15.204544] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-23T20:19:15.499876] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-23T20:19:15.499983] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-23T20:19:15.500214] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-23T20:19:15.500271] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-23T20:19:15.500709] [DEBUG] [LOCAL ] BNT: Trimmed 4854 records to 3545 (keeping 200 days of data) [2025-10-23T20:19:15.521714] [DEBUG] [LOCAL ] BNT: Primary data saved (3545 records). [2025-10-23T20:19:15.521817] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-23T20:19:15.521901] [INFO ] [MAIN ] Update Progress: 316/2367 symbols completed. BNT took 24.4s. Estimated remaining: 4h 14m 21s. Rate: 8.1 symbols/min [2025-10-23T20:19:15.699844] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:15.719343] [DEBUG] [LOCAL ] BOC: Loaded 18186 existing records from primary storage. [2025-10-23T20:19:15.719625] [INFO ] [MAIN ] BOC: Loaded 18186 existing records. [2025-10-23T20:19:15.909063] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:19:15.909292] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-23T20:19:15.909381] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-23T20:19:15.909608] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-23T20:19:15.909718] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-23T20:19:16.008697] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-23T20:19:16.096690] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T20:19:16.323476] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:16.799493] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-23T20:19:17.599457] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-23T20:19:18.189281] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T20:19:18.399425] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-23T20:19:18.455905] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T20:19:18.600937] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T20:19:19.201313] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-23T20:19:19.999423] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-23T20:19:20.377308] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T20:19:20.430473] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T20:19:20.799462] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-23T20:19:21.599425] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-23T20:19:21.930836] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T20:19:22.399512] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-23T20:19:22.624572] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T20:19:22.634444] [INFO ] [REMOTE ] BNS: Full fetch complete (74611 records). [2025-10-23T20:19:22.634685] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-23T20:19:22.749783] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T20:19:23.061333] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-23T20:19:23.061490] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-23T20:19:23.062793] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-23T20:19:23.062883] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-23T20:19:23.065028] [DEBUG] [LOCAL ] BNS: Trimmed 74611 records to 51760 (keeping 200 days of data) [2025-10-23T20:19:23.198441] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T20:19:23.202338] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-23T20:19:23.412272] [DEBUG] [LOCAL ] BNS: Primary data saved (51760 records). [2025-10-23T20:19:23.412540] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-23T20:19:23.412705] [INFO ] [MAIN ] Update Progress: 317/2367 symbols completed. BNS took 33.2s. Estimated remaining: 4h 14m 17s. Rate: 8.1 symbols/min [2025-10-23T20:19:23.999451] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-23T20:19:24.799452] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-23T20:19:24.856991] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T20:19:24.979163] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:19:25.599430] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-23T20:19:25.896212] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-23T20:19:26.399494] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-23T20:19:26.407466] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T20:19:27.199518] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-23T20:19:27.999490] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-23T20:19:28.162435] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T20:19:28.253731] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:19:28.263521] [INFO ] [REMOTE ] BNL: Full fetch complete (67234 records). [2025-10-23T20:19:28.263752] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-23T20:19:28.670828] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-23T20:19:28.670985] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-23T20:19:28.672070] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-23T20:19:28.672169] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-23T20:19:28.674123] [DEBUG] [LOCAL ] BNL: Trimmed 67234 records to 47358 (keeping 200 days of data) [2025-10-23T20:19:28.799510] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-23T20:19:28.988567] [DEBUG] [LOCAL ] BNL: Primary data saved (47358 records). [2025-10-23T20:19:28.988844] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-23T20:19:28.989006] [INFO ] [MAIN ] Update Progress: 318/2367 symbols completed. BNL took 41.4s. Estimated remaining: 4h 13m 57s. Rate: 8.1 symbols/min [2025-10-23T20:19:29.026960] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T20:19:29.599563] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-23T20:19:29.774537] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T20:19:30.399486] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-23T20:19:30.768417] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T20:19:31.199434] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-23T20:19:31.261205] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T20:19:31.999510] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-23T20:19:32.248362] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T20:19:32.799557] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-23T20:19:32.909907] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T20:19:32.913755] [INFO ] [REMOTE ] BNY: Full fetch complete (10370 records). [2025-10-23T20:19:32.914081] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-23T20:19:33.299065] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-23T20:19:33.299236] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-23T20:19:33.299732] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-23T20:19:33.299815] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-23T20:19:33.300448] [DEBUG] [LOCAL ] BNY: Trimmed 10370 records to 7273 (keeping 200 days of data) [2025-10-23T20:19:33.347709] [DEBUG] [LOCAL ] BNY: Primary data saved (7273 records). [2025-10-23T20:19:33.347938] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-23T20:19:33.348291] [INFO ] [MAIN ] Update Progress: 319/2367 symbols completed. BNY took 25.2s. Estimated remaining: 4h 13m 30s. Rate: 8.1 symbols/min [2025-10-23T20:19:33.907024] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T20:19:33.915310] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-23T20:19:35.134492] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T20:19:35.141741] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-23T20:19:36.343364] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T20:19:36.348074] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-23T20:19:37.497497] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T20:19:37.501607] [INFO ] [REMOTE ] BOC: Full fetch complete (25809 records). [2025-10-23T20:19:37.501827] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-23T20:19:37.894861] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-23T20:19:37.895020] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-23T20:19:37.895866] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-23T20:19:37.895947] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-23T20:19:37.897020] [DEBUG] [LOCAL ] BOC: Trimmed 25809 records to 18283 (keeping 200 days of data) [2025-10-23T20:19:38.008543] [DEBUG] [LOCAL ] BOC: Primary data saved (18283 records). [2025-10-23T20:19:38.008835] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-23T20:19:38.008977] [INFO ] [MAIN ] Update Progress: 320/2367 symbols completed. BOC took 22.5s. Estimated remaining: 4h 13m 5s. Rate: 8.1 symbols/min [2025-10-23T20:19:38.720045] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:38.627179] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:38.776854] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:38.757200] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:38.833367] [DEBUG] [LOCAL ] BOE: Loaded 18068 existing records from primary storage. [2025-10-23T20:19:38.834271] [INFO ] [MAIN ] BOE: Loaded 18068 existing records. [2025-10-23T20:19:38.977567] [DEBUG] [LOCAL ] BOH: Loaded 30638 existing records from primary storage. [2025-10-23T20:19:39.000299] [DEBUG] [LOCAL ] BOND: Loaded 32409 existing records from primary storage. [2025-10-23T20:19:38.983391] [DEBUG] [LOCAL ] BOOT: Loaded 39419 existing records from primary storage. [2025-10-23T20:19:39.000719] [INFO ] [MAIN ] BOND: Loaded 32409 existing records. [2025-10-23T20:19:38.994446] [INFO ] [MAIN ] BOH: Loaded 30638 existing records. [2025-10-23T20:19:39.012115] [INFO ] [MAIN ] BOOT: Loaded 39419 existing records. [2025-10-23T20:19:39.278832] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:19:39.400512] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-23T20:19:39.408153] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-23T20:19:39.479287] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-23T20:19:39.484628] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-23T20:19:39.679936] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:19:39.692679] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:19:39.650487] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:19:39.718095] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-23T20:19:39.743045] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-23T20:19:39.758882] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-23T20:19:39.748430] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-23T20:19:39.766008] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-23T20:19:39.770094] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-23T20:19:39.770707] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-23T20:19:39.775906] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-23T20:19:39.781072] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-23T20:19:39.812232] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-23T20:19:39.786347] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-23T20:19:39.812321] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-23T20:19:40.557380] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:40.626020] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-23T20:19:41.178740] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:41.185689] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:41.195725] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-23T20:19:41.225820] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:41.226439] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-23T20:19:41.227381] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-23T20:19:41.872909] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T20:19:41.877942] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-23T20:19:42.763853] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T20:19:42.789081] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-23T20:19:42.794962] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T20:19:42.803199] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-23T20:19:42.817716] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T20:19:42.822670] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-23T20:19:42.853060] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T20:19:42.862750] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-23T20:19:44.076757] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T20:19:44.082322] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-23T20:19:44.237304] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T20:19:44.243871] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-23T20:19:44.368139] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T20:19:44.693484] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T20:19:44.799455] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-23T20:19:44.900595] [DEBUG] [REMOTE ] BOOT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-23T20:19:44.901115] [WARN ] [REMOTE ] BOOT: No data returned for month 2025-03 [2025-10-23T20:19:44.901210] [FATAL] [REMOTE ] BOOT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:19:44.901344] [FATAL] [MAIN ] BOOT: Failed to fetch primary data. [2025-10-23T20:19:44.901429] [WARN ] [MAIN ] BOOT: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:19:44.901513] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-23T20:19:44.901619] [DEBUG] [LOCAL ] BOOT: No primary data file found to delete. [2025-10-23T20:19:44.901724] [INFO ] [LOCAL ] BOOT: Starting deletion of derivative data. [2025-10-23T20:19:44.902177] [DEBUG] [LOCAL ] BOOT: Deleted derivative data file. [2025-10-23T20:19:44.902298] [INFO ] [MAIN ] Update Progress: 321/2367 symbols completed. BOOT took 6.9s. Estimated remaining: 4h 12m 54s. Rate: 8.1 symbols/min [2025-10-23T20:19:45.096090] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:19:45.096379] [DEBUG] [LOCAL ] BORR: No existing data file found in primary storage. [2025-10-23T20:19:45.096461] [WARN ] [MAIN ] BORR: No existing data found, performing full refresh instead. [2025-10-23T20:19:45.096598] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-23T20:19:45.096697] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-23T20:19:45.096783] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-23T20:19:45.096863] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-23T20:19:45.534798] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T20:19:45.580558] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:19:45.600383] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-23T20:19:45.605675] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T20:19:46.399431] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-23T20:19:47.200856] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-23T20:19:47.206355] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T20:19:47.980794] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T20:19:47.999397] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-23T20:19:48.301966] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T20:19:48.799460] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-23T20:19:49.493450] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T20:19:49.599475] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-23T20:19:50.399447] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-23T20:19:50.479901] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T20:19:51.199426] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-23T20:19:51.623131] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T20:19:51.661110] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:19:51.999558] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-23T20:19:52.609243] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T20:19:52.799448] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-23T20:19:53.093450] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T20:19:53.599488] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-23T20:19:54.176729] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:19:54.274960] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-23T20:19:54.399551] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-23T20:19:55.199509] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-23T20:19:55.999456] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-23T20:19:56.390089] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T20:19:56.469052] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T20:19:56.799522] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-23T20:19:57.282711] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T20:19:57.599434] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-23T20:19:58.399504] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-23T20:19:59.144855] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T20:19:59.199401] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-23T20:19:59.396933] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-23T20:19:59.640824] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T20:19:59.645449] [INFO ] [REMOTE ] BOE: Full fetch complete (26871 records). [2025-10-23T20:19:59.645560] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-23T20:20:00.009957] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-23T20:20:00.061766] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-23T20:20:00.062031] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-23T20:20:00.062578] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-23T20:20:00.062699] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-23T20:20:00.063693] [DEBUG] [LOCAL ] BOE: Trimmed 26871 records to 18140 (keeping 200 days of data) [2025-10-23T20:20:00.177862] [DEBUG] [LOCAL ] BOE: Primary data saved (18140 records). [2025-10-23T20:20:00.178093] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-23T20:20:00.178256] [INFO ] [MAIN ] Update Progress: 322/2367 symbols completed. BOE took 22.2s. Estimated remaining: 4h 13m 37s. Rate: 8.1 symbols/min [2025-10-23T20:20:00.380963] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:00.405326] [DEBUG] [LOCAL ] BOW: Loaded 22829 existing records from primary storage. [2025-10-23T20:20:00.405617] [INFO ] [MAIN ] BOW: Loaded 22829 existing records. [2025-10-23T20:20:00.586771] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:00.604383] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-23T20:20:00.604533] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-23T20:20:00.605201] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-23T20:20:00.605290] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-23T20:20:00.605947] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T20:20:00.805636] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-23T20:20:00.974874] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:01.599484] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-23T20:20:02.399464] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-23T20:20:03.163119] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-10-23T20:20:03.199398] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-23T20:20:03.556355] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T20:20:03.620927] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-23T20:20:03.999454] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-23T20:20:04.628917] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-23T20:20:04.799432] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-23T20:20:04.870103] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:20:05.597291] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T20:20:05.603326] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-23T20:20:05.605068] [INFO ] [REMOTE ] BOH: Full fetch complete (45401 records). [2025-10-23T20:20:05.605185] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-23T20:20:06.002869] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-23T20:20:06.002984] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-23T20:20:06.003613] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-23T20:20:06.003707] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-23T20:20:06.004668] [DEBUG] [LOCAL ] BOH: Trimmed 45401 records to 30852 (keeping 200 days of data) [2025-10-23T20:20:06.203529] [DEBUG] [LOCAL ] BOH: Primary data saved (30852 records). [2025-10-23T20:20:06.203735] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-23T20:20:06.205266] [INFO ] [MAIN ] Update Progress: 323/2367 symbols completed. BOH took 28.2s. Estimated remaining: 4h 13m 20s. Rate: 8.1 symbols/min [2025-10-23T20:20:06.377527] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:06.405084] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-23T20:20:06.427445] [DEBUG] [LOCAL ] BOX: Loaded 50125 existing records from primary storage. [2025-10-23T20:20:06.427868] [INFO ] [MAIN ] BOX: Loaded 50125 existing records. [2025-10-23T20:20:06.610013] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:06.610242] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-23T20:20:06.610333] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-23T20:20:06.610708] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-23T20:20:06.610798] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-23T20:20:06.969811] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:07.001790] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-23T20:20:07.185009] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T20:20:07.199394] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-23T20:20:07.277842] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T20:20:07.999443] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-23T20:20:08.799454] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-23T20:20:09.349431] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-23T20:20:09.599472] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-23T20:20:09.997014] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T20:20:10.030032] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-23T20:20:10.399454] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-23T20:20:11.199484] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-23T20:20:11.662481] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T20:20:11.823822] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T20:20:11.999452] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-23T20:20:12.727318] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T20:20:12.734459] [INFO ] [REMOTE ] BOND: Full fetch complete (46654 records). [2025-10-23T20:20:12.734700] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-23T20:20:12.809469] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-23T20:20:13.136900] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-23T20:20:13.137386] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-23T20:20:13.138194] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-23T20:20:13.138280] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-23T20:20:13.139502] [DEBUG] [LOCAL ] BOND: Trimmed 46654 records to 32652 (keeping 200 days of data) [2025-10-23T20:20:13.339547] [DEBUG] [LOCAL ] BOND: Primary data saved (32652 records). [2025-10-23T20:20:13.339768] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-23T20:20:13.339951] [INFO ] [MAIN ] Update Progress: 324/2367 symbols completed. BOND took 35.3s. Estimated remaining: 4h 13m 11s. Rate: 8.1 symbols/min [2025-10-23T20:20:13.511450] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:13.563609] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-23T20:20:13.564022] [INFO ] [MAIN ] BP: Loaded 53706 existing records. [2025-10-23T20:20:13.600150] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-23T20:20:13.756620] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:13.771085] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-23T20:20:13.771187] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-23T20:20:13.772410] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T20:20:13.772474] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-23T20:20:13.778358] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-23T20:20:14.124269] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:14.399430] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-23T20:20:14.975752] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T20:20:15.018094] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:20:15.199480] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-23T20:20:15.371161] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-23T20:20:15.999443] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-23T20:20:16.799417] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-23T20:20:17.267059] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T20:20:17.599460] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-23T20:20:18.347476] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-23T20:20:18.399493] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-23T20:20:18.672740] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T20:20:19.199469] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-23T20:20:19.535174] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T20:20:19.544099] [INFO ] [REMOTE ] BORR: Full fetch complete (74536 records). [2025-10-23T20:20:19.544295] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-23T20:20:19.934666] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-23T20:20:19.934796] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-23T20:20:19.935689] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-23T20:20:19.935776] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-23T20:20:19.937265] [DEBUG] [LOCAL ] BORR: Trimmed 74536 records to 51455 (keeping 200 days of data) [2025-10-23T20:20:20.016017] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-23T20:20:20.221910] [DEBUG] [LOCAL ] BORR: Primary data saved (51455 records). [2025-10-23T20:20:20.222085] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-23T20:20:20.222193] [INFO ] [MAIN ] Update Progress: 325/2367 symbols completed. BORR took 35.3s. Estimated remaining: 4h 13m 0s. Rate: 8.1 symbols/min [2025-10-23T20:20:20.392600] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:20.425041] [DEBUG] [LOCAL ] BR: Loaded 34554 existing records from primary storage. [2025-10-23T20:20:20.425405] [INFO ] [MAIN ] BR: Loaded 34554 existing records. [2025-10-23T20:20:20.606689] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:20.606999] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-23T20:20:20.607150] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-23T20:20:20.607416] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-23T20:20:20.607533] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-23T20:20:20.743981] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-23T20:20:20.806262] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-23T20:20:21.017689] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:21.046468] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T20:20:21.295842] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T20:20:21.599453] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-23T20:20:22.399443] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-23T20:20:22.942019] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T20:20:23.105094] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T20:20:23.199412] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-23T20:20:23.999410] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-23T20:20:24.178365] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T20:20:24.799430] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-23T20:20:25.307741] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-23T20:20:25.599440] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-23T20:20:25.959882] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T20:20:26.342159] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T20:20:26.399453] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-23T20:20:26.812733] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T20:20:27.199462] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-23T20:20:28.001128] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-23T20:20:28.003536] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T20:20:28.799423] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-23T20:20:29.085245] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T20:20:29.599426] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-23T20:20:30.399469] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-23T20:20:30.575210] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T20:20:30.816881] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-23T20:20:30.821898] [INFO ] [REMOTE ] BOW: Full fetch complete (32109 records). [2025-10-23T20:20:30.822011] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-23T20:20:31.199409] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-23T20:20:31.199731] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-23T20:20:31.199814] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-23T20:20:31.200440] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-23T20:20:31.200720] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-23T20:20:31.202283] [DEBUG] [LOCAL ] BOW: Trimmed 32109 records to 22949 (keeping 200 days of data) [2025-10-23T20:20:31.337351] [DEBUG] [LOCAL ] BOW: Primary data saved (22949 records). [2025-10-23T20:20:31.337572] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-23T20:20:31.337856] [INFO ] [MAIN ] Update Progress: 326/2367 symbols completed. BOW took 31.2s. Estimated remaining: 4h 13m 16s. Rate: 8.1 symbols/min [2025-10-23T20:20:31.518325] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:31.548925] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T20:20:31.606680] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-23T20:20:31.607045] [INFO ] [MAIN ] BRBR: Loaded 51828 existing records. [2025-10-23T20:20:31.834396] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:31.834662] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-23T20:20:31.834739] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-23T20:20:31.835010] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-23T20:20:31.835087] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-23T20:20:31.999503] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-23T20:20:32.210129] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:32.743783] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-23T20:20:32.799447] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-23T20:20:32.968987] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T20:20:33.599446] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-23T20:20:33.947931] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T20:20:34.399468] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-23T20:20:34.447286] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T20:20:35.164158] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T20:20:35.199396] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-23T20:20:35.999439] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-23T20:20:36.285298] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T20:20:36.799517] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-23T20:20:36.899498] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:20:37.599429] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-23T20:20:37.995314] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T20:20:38.072988] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T20:20:38.399446] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-23T20:20:39.046089] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T20:20:39.199458] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-23T20:20:39.999511] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-23T20:20:40.535993] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T20:20:40.544615] [INFO ] [REMOTE ] BOX: Full fetch complete (72307 records). [2025-10-23T20:20:40.544791] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-23T20:20:40.812335] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-23T20:20:40.950692] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-23T20:20:40.950830] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-23T20:20:40.951678] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-23T20:20:40.951761] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-23T20:20:40.953212] [DEBUG] [LOCAL ] BOX: Trimmed 72307 records to 50435 (keeping 200 days of data) [2025-10-23T20:20:41.248879] [DEBUG] [LOCAL ] BOX: Primary data saved (50435 records). [2025-10-23T20:20:41.249129] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-23T20:20:41.249262] [INFO ] [MAIN ] Update Progress: 327/2367 symbols completed. BOX took 35.0s. Estimated remaining: 4h 13m 24s. Rate: 8.1 symbols/min [2025-10-23T20:20:41.424396] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:41.447709] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T20:20:41.469370] [DEBUG] [LOCAL ] BRC: Loaded 18341 existing records from primary storage. [2025-10-23T20:20:41.469632] [INFO ] [MAIN ] BRC: Loaded 18341 existing records. [2025-10-23T20:20:41.611601] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-23T20:20:41.653799] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:41.654283] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-23T20:20:41.654376] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-23T20:20:41.654749] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-23T20:20:41.654828] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-23T20:20:41.765001] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-23T20:20:42.060850] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:42.399437] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-23T20:20:43.105632] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T20:20:43.113037] [INFO ] [REMOTE ] BR: Full fetch complete (49995 records). [2025-10-23T20:20:43.113196] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-23T20:20:43.200895] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-23T20:20:43.503892] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-23T20:20:43.555874] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-23T20:20:43.556419] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-23T20:20:43.557139] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-23T20:20:43.557219] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-23T20:20:43.558296] [DEBUG] [LOCAL ] BR: Trimmed 49995 records to 34763 (keeping 200 days of data) [2025-10-23T20:20:43.779151] [DEBUG] [LOCAL ] BR: Primary data saved (34763 records). [2025-10-23T20:20:43.779351] [INFO ] [MAIN ] BR: Full history saved. [2025-10-23T20:20:43.779473] [INFO ] [MAIN ] Update Progress: 328/2367 symbols completed. BR took 23.6s. Estimated remaining: 4h 12m 46s. Rate: 8.1 symbols/min [2025-10-23T20:20:43.963696] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:44.004942] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-23T20:20:44.007790] [DEBUG] [LOCAL ] BRCC: Loaded 40024 existing records from primary storage. [2025-10-23T20:20:44.008154] [INFO ] [MAIN ] BRCC: Loaded 40024 existing records. [2025-10-23T20:20:44.187684] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:44.188399] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-23T20:20:44.188505] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-23T20:20:44.188779] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-23T20:20:44.188855] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-23T20:20:44.552913] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T20:20:44.564746] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-23T20:20:44.601135] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:44.799432] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-23T20:20:45.599441] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-23T20:20:46.399461] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-23T20:20:46.559172] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-23T20:20:46.833798] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T20:20:47.158904] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T20:20:47.199417] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-23T20:20:47.999430] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-23T20:20:48.084254] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:20:48.690379] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T20:20:48.799440] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-23T20:20:49.599451] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-23T20:20:50.049608] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T20:20:50.375898] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-23T20:20:50.399512] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-23T20:20:50.886720] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T20:20:51.199441] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-23T20:20:51.999465] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-23T20:20:52.766546] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-23T20:20:52.775982] [INFO ] [REMOTE ] BP: Full fetch complete (77881 records). [2025-10-23T20:20:52.776168] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-23T20:20:52.812314] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-23T20:20:53.185264] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:20:53.252763] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-23T20:20:53.252893] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-23T20:20:53.253851] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-23T20:20:53.253950] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-23T20:20:53.255499] [DEBUG] [LOCAL ] BP: Trimmed 77881 records to 54096 (keeping 200 days of data) [2025-10-23T20:20:53.579497] [DEBUG] [LOCAL ] BP: Primary data saved (54096 records). [2025-10-23T20:20:53.579690] [INFO ] [MAIN ] BP: Full history saved. [2025-10-23T20:20:53.580033] [INFO ] [MAIN ] Update Progress: 329/2367 symbols completed. BP took 40.2s. Estimated remaining: 4h 12m 53s. Rate: 8.1 symbols/min [2025-10-23T20:20:53.604510] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-23T20:20:53.758611] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:53.758903] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-23T20:20:53.758992] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-23T20:20:53.759128] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-23T20:20:53.759219] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-23T20:20:53.759346] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-23T20:20:53.759510] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-23T20:20:53.985710] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-23T20:20:54.171144] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:54.182852] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T20:20:54.399443] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-23T20:20:54.759775] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:20:54.760127] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-23T20:20:54.760233] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:20:54.760307] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-23T20:20:54.760376] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:20:54.760450] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-23T20:20:54.760544] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-23T20:20:54.760621] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-23T20:20:54.760743] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-23T20:20:54.760830] [INFO ] [MAIN ] Update Progress: 330/2367 symbols completed. BRCE took 1.2s. Estimated remaining: 4h 12m 7s. Rate: 8.1 symbols/min [2025-10-23T20:20:54.941565] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:54.942011] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-23T20:20:54.942306] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-23T20:20:54.942513] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-23T20:20:54.942613] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-23T20:20:54.942901] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-23T20:20:54.955925] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-23T20:20:55.012995] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T20:20:55.206061] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-23T20:20:55.350470] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:55.999438] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-23T20:20:56.799447] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-23T20:20:57.100550] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:20:57.101079] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-23T20:20:57.101181] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:20:57.101262] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-23T20:20:57.101337] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:20:57.101419] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-23T20:20:57.101531] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-23T20:20:57.101610] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-23T20:20:57.101749] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-23T20:20:57.101846] [INFO ] [MAIN ] Update Progress: 331/2367 symbols completed. BRIE took 2.3s. Estimated remaining: 4h 11m 28s. Rate: 8.1 symbols/min [2025-10-23T20:20:57.322057] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:20:57.326751] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-23T20:20:57.356887] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T20:20:57.406526] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-23T20:20:57.406915] [INFO ] [MAIN ] BRO: Loaded 52096 existing records. [2025-10-23T20:20:57.589281] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:20:57.589555] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-23T20:20:57.589664] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-23T20:20:57.589918] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-23T20:20:57.589995] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-23T20:20:57.604705] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-23T20:20:57.971925] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:20:58.399444] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-23T20:20:59.077095] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T20:20:59.199452] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-23T20:20:59.767594] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T20:20:59.999487] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-23T20:21:00.799431] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-23T20:21:01.599512] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-23T20:21:01.816855] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-23T20:21:02.399455] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-23T20:21:02.529946] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-23T20:21:02.800783] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T20:21:03.199425] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-23T20:21:03.267206] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-23T20:21:03.999432] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-23T20:21:04.148891] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T20:21:04.799422] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-23T20:21:05.069700] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T20:21:05.132815] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T20:21:05.599444] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-23T20:21:06.399432] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-23T20:21:06.613485] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T20:21:07.199427] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-23T20:21:07.551529] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:21:07.657474] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T20:21:07.660876] [INFO ] [REMOTE ] BRC: Full fetch complete (28299 records). [2025-10-23T20:21:07.660972] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-23T20:21:08.010820] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-23T20:21:08.061548] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-23T20:21:08.061693] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-23T20:21:08.062215] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-23T20:21:08.062295] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-23T20:21:08.063026] [DEBUG] [LOCAL ] BRC: Trimmed 28299 records to 18403 (keeping 200 days of data) [2025-10-23T20:21:08.175539] [DEBUG] [LOCAL ] BRC: Primary data saved (18403 records). [2025-10-23T20:21:08.175741] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-23T20:21:08.175856] [INFO ] [MAIN ] Update Progress: 332/2367 symbols completed. BRC took 26.9s. Estimated remaining: 4h 11m 43s. Rate: 8.1 symbols/min [2025-10-23T20:21:08.341314] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:08.389747] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-23T20:21:08.390130] [INFO ] [MAIN ] BROS: Loaded 53301 existing records. [2025-10-23T20:21:08.566618] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:21:08.566974] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-23T20:21:08.567195] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-23T20:21:08.567480] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-23T20:21:08.567564] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-23T20:21:08.814471] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-23T20:21:08.788478] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T20:21:09.013802] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:09.599430] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-23T20:21:10.129919] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-23T20:21:10.399482] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-23T20:21:10.863175] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T20:21:10.872438] [INFO ] [REMOTE ] BRBR: Full fetch complete (73226 records). [2025-10-23T20:21:10.872600] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-23T20:21:11.202454] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-23T20:21:11.305749] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-23T20:21:11.305870] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-23T20:21:11.306935] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-23T20:21:11.307018] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-23T20:21:11.308717] [DEBUG] [LOCAL ] BRBR: Trimmed 73226 records to 52189 (keeping 200 days of data) [2025-10-23T20:21:11.658551] [DEBUG] [LOCAL ] BRBR: Primary data saved (52189 records). [2025-10-23T20:21:11.658815] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-23T20:21:11.659998] [INFO ] [MAIN ] Update Progress: 333/2367 symbols completed. BRBR took 40.3s. Estimated remaining: 4h 11m 12s. Rate: 8.1 symbols/min [2025-10-23T20:21:11.894743] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:11.895233] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-23T20:21:11.895574] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-23T20:21:11.898891] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T20:21:11.908247] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-23T20:21:11.925638] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-23T20:21:11.943509] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T20:21:11.942501] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-23T20:21:11.951169] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-23T20:21:11.957338] [INFO ] [REMOTE ] BRCC: Full fetch complete (57290 records). [2025-10-23T20:21:11.969666] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-23T20:21:12.005443] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-23T20:21:12.724547] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:12.761051] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-23T20:21:12.761853] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-23T20:21:12.762790] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-23T20:21:12.763024] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-23T20:21:12.764322] [DEBUG] [LOCAL ] BRCC: Trimmed 57290 records to 40288 (keeping 200 days of data) [2025-10-23T20:21:12.808223] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-23T20:21:12.990966] [DEBUG] [LOCAL ] BRCC: Primary data saved (40288 records). [2025-10-23T20:21:12.991157] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-23T20:21:12.992213] [INFO ] [MAIN ] Update Progress: 334/2367 symbols completed. BRCC took 29.2s. Estimated remaining: 4h 10m 27s. Rate: 8.1 symbols/min [2025-10-23T20:21:13.177419] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:21:13.179836] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:13.198858] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-23T20:21:13.199008] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:21:13.199130] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-23T20:21:13.199605] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:21:13.199741] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-23T20:21:13.200345] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-23T20:21:13.201543] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T20:21:13.212306] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-23T20:21:13.213396] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-23T20:21:13.213671] [INFO ] [MAIN ] Update Progress: 335/2367 symbols completed. BRSL took 1.6s. Estimated remaining: 4h 9m 36s. Rate: 8.1 symbols/min [2025-10-23T20:21:13.408314] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:13.419452] [DEBUG] [LOCAL ] BRSP: Loaded 36477 existing records from primary storage. [2025-10-23T20:21:13.419745] [INFO ] [MAIN ] BRSP: Loaded 36477 existing records. [2025-10-23T20:21:13.538327] [DEBUG] [LOCAL ] BRT: Loaded 5261 existing records from primary storage. [2025-10-23T20:21:13.566321] [INFO ] [MAIN ] BRT: Loaded 5261 existing records. [2025-10-23T20:21:13.622438] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-23T20:21:13.639962] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:21:13.660702] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-23T20:21:13.678477] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-23T20:21:13.699915] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-23T20:21:13.721494] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-23T20:21:13.919889] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:21:13.932804] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-23T20:21:13.933042] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-23T20:21:13.933547] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-23T20:21:13.949223] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-23T20:21:14.502015] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:14.524052] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-23T20:21:14.596420] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:14.635070] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-23T20:21:15.199447] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-23T20:21:15.490734] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:21:15.999425] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-23T20:21:16.252676] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T20:21:16.799428] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-23T20:21:16.862584] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T20:21:17.241104] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T20:21:17.599471] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-23T20:21:18.399425] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-23T20:21:18.621345] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:21:18.781912] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T20:21:19.199440] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-23T20:21:19.999432] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-23T20:21:20.593984] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-23T20:21:20.660715] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T20:21:20.799462] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-23T20:21:21.185835] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T20:21:21.599474] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-23T20:21:22.399468] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-23T20:21:23.125746] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-23T20:21:23.199467] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-23T20:21:23.306633] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T20:21:23.632168] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T20:21:23.999521] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-23T20:21:24.783409] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T20:21:24.799428] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-23T20:21:25.361632] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-23T20:21:25.589280] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T20:21:25.599422] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-23T20:21:26.399434] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-23T20:21:27.199409] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-23T20:21:27.451936] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T20:21:27.999515] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-23T20:21:28.342962] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-23T20:21:28.685289] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-23T20:21:28.799472] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-23T20:21:29.476537] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T20:21:29.599504] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-23T20:21:30.399501] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-23T20:21:31.050989] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-23T20:21:31.094150] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T20:21:31.199525] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-23T20:21:31.476427] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T20:21:31.487894] [INFO ] [REMOTE ] BRO: Full fetch complete (75146 records). [2025-10-23T20:21:31.488584] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-23T20:21:31.875885] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-23T20:21:31.978945] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-23T20:21:31.979072] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-23T20:21:31.980141] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-23T20:21:31.980232] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-23T20:21:31.981884] [DEBUG] [LOCAL ] BRO: Trimmed 75146 records to 52483 (keeping 200 days of data) [2025-10-23T20:21:32.039624] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-23T20:21:32.314241] [DEBUG] [LOCAL ] BRO: Primary data saved (52483 records). [2025-10-23T20:21:32.314433] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-23T20:21:32.314555] [INFO ] [MAIN ] Update Progress: 336/2367 symbols completed. BRO took 35.2s. Estimated remaining: 4h 10m 40s. Rate: 8.1 symbols/min [2025-10-23T20:21:32.499960] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:32.500184] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-23T20:21:32.500270] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-23T20:21:32.500403] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-23T20:21:32.500490] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-23T20:21:32.500590] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-23T20:21:32.500699] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-23T20:21:32.805368] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-23T20:21:32.883602] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:33.589778] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T20:21:33.603069] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-23T20:21:33.605765] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T20:21:34.399439] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-23T20:21:35.006504] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:21:35.199445] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-23T20:21:35.832111] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T20:21:35.999471] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-23T20:21:36.332522] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T20:21:36.799432] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-23T20:21:37.599432] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-23T20:21:38.308436] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-23T20:21:38.397436] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T20:21:38.399381] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-23T20:21:38.487134] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T20:21:39.199420] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-23T20:21:39.274997] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T20:21:39.277045] [INFO ] [REMOTE ] BRT: Full fetch complete (7156 records). [2025-10-23T20:21:39.277144] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-23T20:21:39.626959] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-23T20:21:39.627069] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-23T20:21:39.627293] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-23T20:21:39.627375] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-23T20:21:39.627802] [DEBUG] [LOCAL ] BRT: Trimmed 7156 records to 5310 (keeping 200 days of data) [2025-10-23T20:21:39.659259] [DEBUG] [LOCAL ] BRT: Primary data saved (5310 records). [2025-10-23T20:21:39.659368] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-23T20:21:39.659471] [INFO ] [MAIN ] Update Progress: 337/2367 symbols completed. BRT took 26.4s. Estimated remaining: 4h 10m 32s. Rate: 8.1 symbols/min [2025-10-23T20:21:39.830882] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:39.880430] [DEBUG] [LOCAL ] BRX: Loaded 51818 existing records from primary storage. [2025-10-23T20:21:39.880825] [INFO ] [MAIN ] BRX: Loaded 51818 existing records. [2025-10-23T20:21:40.004588] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-23T20:21:40.060950] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:21:40.061120] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-23T20:21:40.061195] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-23T20:21:40.061469] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-23T20:21:40.061545] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-23T20:21:40.403021] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:40.799449] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-23T20:21:41.560430] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-23T20:21:41.570019] [INFO ] [REMOTE ] BROS: Full fetch complete (77271 records). [2025-10-23T20:21:41.570171] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-23T20:21:41.604562] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-23T20:21:41.740639] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T20:21:41.998096] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-23T20:21:41.998210] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-23T20:21:41.999126] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-23T20:21:41.999210] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-23T20:21:42.000664] [DEBUG] [LOCAL ] BROS: Trimmed 77271 records to 53688 (keeping 200 days of data) [2025-10-23T20:21:42.307117] [DEBUG] [LOCAL ] BROS: Primary data saved (53688 records). [2025-10-23T20:21:42.307373] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-23T20:21:42.307537] [INFO ] [MAIN ] Update Progress: 338/2367 symbols completed. BROS took 34.1s. Estimated remaining: 4h 9m 56s. Rate: 8.1 symbols/min [2025-10-23T20:21:42.404618] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-23T20:21:42.500868] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:42.501522] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-23T20:21:42.502114] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-23T20:21:42.502411] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-23T20:21:42.502610] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-23T20:21:42.514120] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-23T20:21:42.545151] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-23T20:21:42.579900] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T20:21:42.615221] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T20:21:42.919574] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:43.199453] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-23T20:21:43.999450] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-23T20:21:44.151751] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T20:21:44.559390] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T20:21:44.799440] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-23T20:21:45.599438] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-23T20:21:45.738027] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T20:21:46.168046] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T20:21:46.399432] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-23T20:21:46.750788] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:21:47.199434] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-23T20:21:47.900621] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T20:21:47.999436] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-23T20:21:48.315823] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T20:21:48.799439] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-23T20:21:49.599408] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-23T20:21:49.893741] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T20:21:50.045620] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T20:21:50.399427] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-23T20:21:51.199412] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-23T20:21:51.257516] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T20:21:51.794322] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T20:21:51.999429] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-23T20:21:52.799426] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-23T20:21:53.204097] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T20:21:53.554745] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:21:53.599455] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-23T20:21:54.004285] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T20:21:54.399440] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-23T20:21:55.204847] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-23T20:21:55.217125] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T20:21:55.225124] [INFO ] [REMOTE ] BRSP: Full fetch complete (54034 records). [2025-10-23T20:21:55.225323] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-23T20:21:55.609235] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-23T20:21:55.609479] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-23T20:21:55.610252] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-23T20:21:55.610391] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-23T20:21:55.629368] [DEBUG] [LOCAL ] BRSP: Trimmed 54034 records to 36715 (keeping 200 days of data) [2025-10-23T20:21:55.630180] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T20:21:55.844186] [DEBUG] [LOCAL ] BRSP: Primary data saved (36715 records). [2025-10-23T20:21:55.844385] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-23T20:21:55.845395] [INFO ] [MAIN ] Update Progress: 339/2367 symbols completed. BRSP took 42.9s. Estimated remaining: 4h 10m 25s. Rate: 8.1 symbols/min [2025-10-23T20:21:56.000454] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-23T20:21:56.011050] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:21:56.049168] [DEBUG] [LOCAL ] BSBR: Loaded 35877 existing records from primary storage. [2025-10-23T20:21:56.049494] [INFO ] [MAIN ] BSBR: Loaded 35877 existing records. [2025-10-23T20:21:56.223196] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:21:56.223422] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-23T20:21:56.223515] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-23T20:21:56.223825] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-23T20:21:56.223917] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-23T20:21:56.583773] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:21:56.785176] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:21:56.799386] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-23T20:21:57.448933] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T20:21:57.599445] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-23T20:21:58.399412] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-23T20:21:58.730267] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T20:21:59.070853] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T20:21:59.199458] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-23T20:21:59.903411] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T20:21:59.999397] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-23T20:22:00.799500] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-23T20:22:01.580372] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-23T20:22:01.600207] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T20:22:01.600838] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-23T20:22:01.606553] [INFO ] [REMOTE ] BRW: Full fetch complete (30184 records). [2025-10-23T20:22:01.606703] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-23T20:22:02.007422] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-23T20:22:02.007569] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-23T20:22:02.008290] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-23T20:22:02.008389] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-23T20:22:02.009435] [DEBUG] [LOCAL ] BRW: Trimmed 30184 records to 21145 (keeping 200 days of data) [2025-10-23T20:22:02.143126] [DEBUG] [LOCAL ] BRW: Primary data saved (21145 records). [2025-10-23T20:22:02.143306] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-23T20:22:02.143442] [INFO ] [MAIN ] Update Progress: 340/2367 symbols completed. BRW took 29.8s. Estimated remaining: 4h 10m 11s. Rate: 8.1 symbols/min [2025-10-23T20:22:02.334381] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:02.345200] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-10-23T20:22:02.345500] [INFO ] [MAIN ] BSL: Loaded 7898 existing records. [2025-10-23T20:22:02.411718] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-23T20:22:02.542576] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:02.542872] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-23T20:22:02.542969] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-23T20:22:02.543331] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-23T20:22:02.543425] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-23T20:22:02.896823] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:03.206384] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-23T20:22:03.208631] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T20:22:03.528851] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-23T20:22:03.663692] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T20:22:03.999469] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-23T20:22:04.112274] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T20:22:04.799498] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-23T20:22:05.599412] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-23T20:22:05.940796] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T20:22:05.941787] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T20:22:06.399449] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-23T20:22:06.786562] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T20:22:07.199450] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-23T20:22:07.999457] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-23T20:22:08.668250] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-23T20:22:08.776048] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T20:22:08.799400] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-23T20:22:09.145156] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:22:09.599449] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-23T20:22:09.952379] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:22:10.399433] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-23T20:22:11.020243] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T20:22:11.026106] [INFO ] [REMOTE ] BSAC: Full fetch complete (45247 records). [2025-10-23T20:22:11.026294] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-23T20:22:11.200111] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-23T20:22:11.400986] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-23T20:22:11.401110] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-23T20:22:11.401763] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-23T20:22:11.401846] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-23T20:22:11.402887] [DEBUG] [LOCAL ] BSAC: Trimmed 45247 records to 33040 (keeping 200 days of data) [2025-10-23T20:22:11.591785] [DEBUG] [LOCAL ] BSAC: Primary data saved (33040 records). [2025-10-23T20:22:11.591971] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-23T20:22:11.592080] [INFO ] [MAIN ] Update Progress: 341/2367 symbols completed. BSAC took 29.3s. Estimated remaining: 4h 10m 16s. Rate: 8.1 symbols/min [2025-10-23T20:22:11.758936] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:11.789482] [DEBUG] [LOCAL ] BSM: Loaded 32282 existing records from primary storage. [2025-10-23T20:22:11.789813] [INFO ] [MAIN ] BSM: Loaded 32282 existing records. [2025-10-23T20:22:11.964807] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:11.965024] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-23T20:22:11.965103] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-23T20:22:11.965375] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-23T20:22:11.965452] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-23T20:22:12.007235] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-23T20:22:12.341521] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:12.382880] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:22:12.393125] [INFO ] [REMOTE ] BRX: Full fetch complete (75151 records). [2025-10-23T20:22:12.393420] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-23T20:22:12.805808] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-23T20:22:12.838363] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-23T20:22:12.838511] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-23T20:22:12.839521] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-23T20:22:12.839611] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-23T20:22:12.841283] [DEBUG] [LOCAL ] BRX: Trimmed 75151 records to 52194 (keeping 200 days of data) [2025-10-23T20:22:13.056333] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T20:22:13.185578] [DEBUG] [LOCAL ] BRX: Primary data saved (52194 records). [2025-10-23T20:22:13.185861] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-23T20:22:13.187306] [INFO ] [MAIN ] Update Progress: 342/2367 symbols completed. BRX took 33.5s. Estimated remaining: 4h 9m 34s. Rate: 8.1 symbols/min [2025-10-23T20:22:13.393966] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-23T20:22:13.397611] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:13.428895] [DEBUG] [LOCAL ] BST: Loaded 18388 existing records from primary storage. [2025-10-23T20:22:13.429265] [INFO ] [MAIN ] BST: Loaded 18388 existing records. [2025-10-23T20:22:13.613782] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-23T20:22:13.620117] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:13.621443] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-23T20:22:13.621532] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-23T20:22:13.621786] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-23T20:22:13.621884] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-23T20:22:13.984855] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:14.282501] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T20:22:14.399461] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-23T20:22:14.568519] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T20:22:15.199502] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-23T20:22:15.969232] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:22:15.999396] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-23T20:22:16.799446] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-23T20:22:17.243757] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-23T20:22:17.511138] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T20:22:17.599459] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-23T20:22:17.701997] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T20:22:18.399493] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-23T20:22:19.005178] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T20:22:19.199417] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-23T20:22:19.301229] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:22:19.999442] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-23T20:22:20.671112] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T20:22:20.799437] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-23T20:22:21.380402] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T20:22:21.599409] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-23T20:22:21.739545] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T20:22:22.399443] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-23T20:22:23.199425] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-23T20:22:23.303748] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T20:22:23.372548] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T20:22:23.374890] [INFO ] [REMOTE ] BSL: Full fetch complete (12968 records). [2025-10-23T20:22:23.374981] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-23T20:22:23.747124] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-23T20:22:23.747234] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-23T20:22:23.747559] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-23T20:22:23.747638] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-23T20:22:23.748402] [DEBUG] [LOCAL ] BSL: Trimmed 12968 records to 7937 (keeping 200 days of data) [2025-10-23T20:22:23.798760] [DEBUG] [LOCAL ] BSL: Primary data saved (7937 records). [2025-10-23T20:22:23.798928] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-23T20:22:23.799043] [INFO ] [MAIN ] Update Progress: 343/2367 symbols completed. BSL took 21.7s. Estimated remaining: 4h 9m 46s. Rate: 8.1 symbols/min [2025-10-23T20:22:23.968715] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:23.992026] [DEBUG] [LOCAL ] BSTZ: Loaded 24418 existing records from primary storage. [2025-10-23T20:22:23.992361] [INFO ] [MAIN ] BSTZ: Loaded 24418 existing records. [2025-10-23T20:22:24.004987] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-23T20:22:24.169690] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:24.169907] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-23T20:22:24.169997] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-23T20:22:24.170263] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-23T20:22:24.170360] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-23T20:22:24.529498] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:24.808681] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-23T20:22:24.813240] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T20:22:25.599485] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-23T20:22:25.904121] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T20:22:26.399463] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-23T20:22:26.496062] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T20:22:27.122685] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T20:22:27.199453] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-23T20:22:27.999446] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-23T20:22:28.063575] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T20:22:28.069911] [INFO ] [REMOTE ] BSBR: Full fetch complete (50999 records). [2025-10-23T20:22:28.070030] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-23T20:22:28.458322] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-23T20:22:28.458452] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-23T20:22:28.459217] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-23T20:22:28.459303] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-23T20:22:28.460556] [DEBUG] [LOCAL ] BSBR: Trimmed 50999 records to 36041 (keeping 200 days of data) [2025-10-23T20:22:28.672558] [DEBUG] [LOCAL ] BSBR: Primary data saved (36041 records). [2025-10-23T20:22:28.672765] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-23T20:22:28.672915] [INFO ] [MAIN ] Update Progress: 344/2367 symbols completed. BSBR took 32.8s. Estimated remaining: 4h 9m 24s. Rate: 8.1 symbols/min [2025-10-23T20:22:28.813766] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-23T20:22:28.851567] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:28.875503] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T20:22:28.936067] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-23T20:22:28.936551] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-23T20:22:29.125317] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:29.125666] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-23T20:22:29.125749] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-23T20:22:29.126035] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-23T20:22:29.126112] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-23T20:22:29.505796] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:29.520384] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T20:22:29.599448] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-23T20:22:30.213956] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T20:22:30.399451] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-23T20:22:31.199498] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-23T20:22:31.407286] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T20:22:31.720601] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T20:22:31.999484] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-23T20:22:32.561971] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T20:22:32.799491] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-23T20:22:33.599473] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-23T20:22:34.031861] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T20:22:34.120770] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T20:22:34.399509] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-23T20:22:34.955036] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T20:22:35.199517] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-23T20:22:35.985853] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T20:22:35.999405] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-23T20:22:36.445524] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T20:22:36.799489] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-23T20:22:37.146938] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:22:37.599470] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-23T20:22:38.399468] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-23T20:22:38.900003] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T20:22:38.949583] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-23T20:22:39.199460] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-23T20:22:39.856841] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T20:22:39.862189] [INFO ] [REMOTE ] BSM: Full fetch complete (46800 records). [2025-10-23T20:22:39.862333] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-23T20:22:40.004494] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-23T20:22:40.241898] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-23T20:22:40.242040] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-23T20:22:40.242742] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-23T20:22:40.242824] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-23T20:22:40.243943] [DEBUG] [LOCAL ] BSM: Trimmed 46800 records to 32463 (keeping 200 days of data) [2025-10-23T20:22:40.432113] [DEBUG] [LOCAL ] BSM: Primary data saved (32463 records). [2025-10-23T20:22:40.432265] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-23T20:22:40.432379] [INFO ] [MAIN ] Update Progress: 345/2367 symbols completed. BSM took 28.8s. Estimated remaining: 4h 9m 42s. Rate: 8.1 symbols/min [2025-10-23T20:22:40.604392] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:40.620926] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T20:22:40.630299] [DEBUG] [LOCAL ] BTA: Loaded 5760 existing records from primary storage. [2025-10-23T20:22:40.630548] [INFO ] [MAIN ] BTA: Loaded 5760 existing records. [2025-10-23T20:22:40.806030] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:40.802447] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-23T20:22:40.806329] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-23T20:22:40.807111] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-23T20:22:40.807313] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-23T20:22:40.807386] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-23T20:22:41.133837] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T20:22:41.217717] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:41.599440] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-23T20:22:42.399420] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-23T20:22:42.622588] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T20:22:42.827462] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T20:22:43.199452] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-23T20:22:43.999429] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-23T20:22:44.113623] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T20:22:44.263373] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T20:22:44.799435] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-23T20:22:45.579510] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T20:22:45.599398] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-23T20:22:46.224349] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-23T20:22:46.399400] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-23T20:22:46.788539] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T20:22:47.128226] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T20:22:47.199413] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-23T20:22:47.999425] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-23T20:22:48.028846] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T20:22:48.799427] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-23T20:22:49.271294] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T20:22:49.599436] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-23T20:22:50.007165] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T20:22:50.353627] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T20:22:50.399426] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-23T20:22:51.158488] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T20:22:51.199443] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-23T20:22:51.999432] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-23T20:22:52.254536] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-23T20:22:52.257764] [INFO ] [REMOTE ] BST: Full fetch complete (28240 records). [2025-10-23T20:22:52.257871] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-23T20:22:52.630474] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-23T20:22:52.630584] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-23T20:22:52.631209] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-23T20:22:52.631289] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-23T20:22:52.632111] [DEBUG] [LOCAL ] BST: Trimmed 28240 records to 18480 (keeping 200 days of data) [2025-10-23T20:22:52.741392] [DEBUG] [LOCAL ] BST: Primary data saved (18480 records). [2025-10-23T20:22:52.741546] [INFO ] [MAIN ] BST: Full history saved. [2025-10-23T20:22:52.741708] [INFO ] [MAIN ] Update Progress: 346/2367 symbols completed. BST took 39.6s. Estimated remaining: 4h 10m 3s. Rate: 8.1 symbols/min [2025-10-23T20:22:52.809250] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-23T20:22:52.928496] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:52.980945] [DEBUG] [LOCAL ] BTE: Loaded 52696 existing records from primary storage. [2025-10-23T20:22:52.981288] [INFO ] [MAIN ] BTE: Loaded 52696 existing records. [2025-10-23T20:22:53.170376] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:53.170785] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-23T20:22:53.170995] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-23T20:22:53.171322] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-23T20:22:53.171477] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-23T20:22:53.299714] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T20:22:53.604711] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-23T20:22:53.708285] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:22:54.399498] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-23T20:22:54.563814] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T20:22:55.199498] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-23T20:22:55.462892] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-23T20:22:55.999475] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-23T20:22:56.157368] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T20:22:56.799456] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-23T20:22:57.123700] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-23T20:22:57.599464] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-23T20:22:58.022463] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-23T20:22:58.190821] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T20:22:58.196196] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36322 records). [2025-10-23T20:22:58.196405] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-23T20:22:58.406117] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-23T20:22:58.593348] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-23T20:22:58.593482] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-23T20:22:58.594134] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-23T20:22:58.594218] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-23T20:22:58.595260] [DEBUG] [LOCAL ] BSTZ: Trimmed 36322 records to 24564 (keeping 200 days of data) [2025-10-23T20:22:58.745785] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24564 records). [2025-10-23T20:22:58.745961] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-23T20:22:58.746079] [INFO ] [MAIN ] Update Progress: 347/2367 symbols completed. BSTZ took 34.9s. Estimated remaining: 4h 9m 47s. Rate: 8.1 symbols/min [2025-10-23T20:22:58.931846] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:22:58.984239] [DEBUG] [LOCAL ] BTI: Loaded 53592 existing records from primary storage. [2025-10-23T20:22:58.984894] [INFO ] [MAIN ] BTI: Loaded 53592 existing records. [2025-10-23T20:22:59.174293] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T20:22:59.197816] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:22:59.200834] [INFO ] [REMOTE ] BTA: Full fetch complete (9195 records). [2025-10-23T20:22:59.200964] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-23T20:22:59.202218] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-23T20:22:59.201978] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-23T20:22:59.221597] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-23T20:22:59.304537] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-23T20:22:59.328919] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-23T20:22:59.426406] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T20:23:00.046874] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-23T20:23:00.047334] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-23T20:23:00.059197] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-23T20:23:00.070401] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-23T20:23:00.102077] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-23T20:23:00.140011] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:00.141566] [DEBUG] [LOCAL ] BTA: Trimmed 9195 records to 5788 (keeping 200 days of data) [2025-10-23T20:23:00.179878] [DEBUG] [LOCAL ] BTA: Primary data saved (5788 records). [2025-10-23T20:23:00.180090] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-23T20:23:00.180230] [INFO ] [MAIN ] Update Progress: 348/2367 symbols completed. BTA took 19.7s. Estimated remaining: 4h 9m 5s. Rate: 8.1 symbols/min [2025-10-23T20:23:00.361825] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:00.374265] [DEBUG] [LOCAL ] BTO: Loaded 8703 existing records from primary storage. [2025-10-23T20:23:00.374594] [INFO ] [MAIN ] BTO: Loaded 8703 existing records. [2025-10-23T20:23:00.570837] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:00.571149] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-23T20:23:00.571240] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-23T20:23:00.571493] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-23T20:23:00.571574] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-23T20:23:00.812082] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-23T20:23:00.990196] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:01.599487] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-23T20:23:05.415367] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (3.82 seconds). [2025-10-23T20:23:05.417893] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-23T20:23:06.035235] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (5.99 seconds). [2025-10-23T20:23:06.046120] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-23T20:23:06.467754] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T20:23:06.470418] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-23T20:23:06.886905] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (7.69 seconds). [2025-10-23T20:23:06.898915] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-23T20:23:07.304404] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T20:23:07.307281] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-23T20:23:07.786998] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (6.97 seconds). [2025-10-23T20:23:07.797397] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-23T20:23:08.161915] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-23T20:23:08.173089] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-23T20:23:08.353177] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T20:23:08.356297] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-23T20:23:08.766350] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:23:08.799401] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-23T20:23:09.046741] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T20:23:09.599432] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-23T20:23:10.062570] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-23T20:23:10.255861] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-23T20:23:10.265971] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T20:23:10.399424] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-23T20:23:11.199431] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-23T20:23:11.999408] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-23T20:23:12.098605] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-23T20:23:12.231227] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T20:23:12.799432] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-23T20:23:13.351546] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-23T20:23:13.599414] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-23T20:23:14.355067] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T20:23:14.399442] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-23T20:23:14.848322] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-23T20:23:15.010020] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-23T20:23:15.019379] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-23T20:23:15.019543] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-23T20:23:15.202775] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-23T20:23:15.424756] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-23T20:23:15.424884] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-23T20:23:15.425813] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-23T20:23:15.425896] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-23T20:23:15.427465] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 54078 (keeping 200 days of data) [2025-10-23T20:23:15.756306] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-23T20:23:15.756497] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-23T20:23:15.757843] [INFO ] [MAIN ] Update Progress: 349/2367 symbols completed. BSX took 47.1s. Estimated remaining: 4h 9m 45s. Rate: 8.1 symbols/min [2025-10-23T20:23:15.929955] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:15.947700] [DEBUG] [LOCAL ] BTT: Loaded 15359 existing records from primary storage. [2025-10-23T20:23:15.947974] [INFO ] [MAIN ] BTT: Loaded 15359 existing records. [2025-10-23T20:23:16.010370] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-23T20:23:16.127981] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:16.128359] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-23T20:23:16.128467] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-23T20:23:16.128802] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-23T20:23:16.128882] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-23T20:23:16.320288] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T20:23:16.499902] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:16.540424] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T20:23:16.799444] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-23T20:23:17.599412] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-23T20:23:17.912758] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T20:23:18.165536] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-23T20:23:18.399465] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-23T20:23:19.199463] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-23T20:23:19.522751] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-23T20:23:19.922086] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-23T20:23:19.999468] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-23T20:23:20.799423] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-23T20:23:21.131503] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T20:23:21.199121] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-23T20:23:21.522725] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T20:23:21.524967] [INFO ] [REMOTE ] BTO: Full fetch complete (13236 records). [2025-10-23T20:23:21.525059] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-23T20:23:21.604527] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-23T20:23:21.906022] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-23T20:23:21.906153] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-23T20:23:21.906531] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-23T20:23:21.906610] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-23T20:23:21.907184] [DEBUG] [LOCAL ] BTO: Trimmed 13236 records to 8744 (keeping 200 days of data) [2025-10-23T20:23:21.959790] [DEBUG] [LOCAL ] BTO: Primary data saved (8744 records). [2025-10-23T20:23:21.959949] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-23T20:23:21.960078] [INFO ] [MAIN ] Update Progress: 350/2367 symbols completed. BTO took 21.8s. Estimated remaining: 4h 9m 31s. Rate: 8.1 symbols/min [2025-10-23T20:23:22.142073] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:22.192750] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-23T20:23:22.193097] [INFO ] [MAIN ] BTU: Loaded 53337 existing records. [2025-10-23T20:23:22.369154] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:22.369395] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-23T20:23:22.369485] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-23T20:23:22.369779] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-23T20:23:22.369853] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-23T20:23:22.404604] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-23T20:23:22.728083] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:23.199428] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-23T20:23:23.707054] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-23T20:23:23.999432] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-23T20:23:24.582114] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-23T20:23:24.799405] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-23T20:23:25.299083] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T20:23:25.375452] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T20:23:25.599445] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-23T20:23:26.399434] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-23T20:23:27.002913] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T20:23:27.199415] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-23T20:23:27.586555] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T20:23:27.663053] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-23T20:23:27.999432] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-23T20:23:28.799433] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-23T20:23:29.599456] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-23T20:23:29.641236] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-23T20:23:30.140812] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-23T20:23:30.399403] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-23T20:23:30.740598] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T20:23:30.749672] [INFO ] [REMOTE ] BTE: Full fetch complete (76346 records). [2025-10-23T20:23:30.749829] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-23T20:23:30.840162] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T20:23:31.148868] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-23T20:23:31.148999] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-23T20:23:31.149980] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-23T20:23:31.150065] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-23T20:23:31.151588] [DEBUG] [LOCAL ] BTE: Trimmed 76346 records to 53081 (keeping 200 days of data) [2025-10-23T20:23:31.201052] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-23T20:23:31.456057] [DEBUG] [LOCAL ] BTE: Primary data saved (53081 records). [2025-10-23T20:23:31.456226] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-23T20:23:31.457259] [INFO ] [MAIN ] Update Progress: 351/2367 symbols completed. BTE took 38.7s. Estimated remaining: 4h 9m 35s. Rate: 8.1 symbols/min [2025-10-23T20:23:31.624467] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:31.624689] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-23T20:23:31.624781] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-23T20:23:31.624904] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-23T20:23:31.624983] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-23T20:23:31.625064] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-23T20:23:31.625131] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-23T20:23:31.975678] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:31.999409] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-23T20:23:32.296041] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:23:32.296398] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-23T20:23:32.296488] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:23:32.296560] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-23T20:23:32.296629] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:23:32.296728] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-23T20:23:32.296822] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-23T20:23:32.296892] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-23T20:23:32.296972] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-23T20:23:32.297056] [INFO ] [MAIN ] Update Progress: 352/2367 symbols completed. BTX took 0.8s. Estimated remaining: 4h 8m 50s. Rate: 8.1 symbols/min [2025-10-23T20:23:32.499555] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:32.501159] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-23T20:23:32.533182] [DEBUG] [LOCAL ] BTZ: Loaded 22396 existing records from primary storage. [2025-10-23T20:23:32.533523] [INFO ] [MAIN ] BTZ: Loaded 22396 existing records. [2025-10-23T20:23:32.707101] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:32.707317] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-23T20:23:32.707393] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-23T20:23:32.707621] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-23T20:23:32.707734] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-23T20:23:32.804523] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-23T20:23:33.058697] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:33.461424] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-23T20:23:33.599419] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-23T20:23:33.948484] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T20:23:34.399469] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-23T20:23:34.968980] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T20:23:35.199455] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-23T20:23:35.999423] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-23T20:23:36.333177] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T20:23:36.574002] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-23T20:23:36.583513] [INFO ] [REMOTE ] BTI: Full fetch complete (77651 records). [2025-10-23T20:23:36.583730] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-23T20:23:36.809221] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-23T20:23:36.996256] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-23T20:23:36.996387] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-23T20:23:36.997416] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-23T20:23:36.997517] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-23T20:23:36.999130] [DEBUG] [LOCAL ] BTI: Trimmed 77651 records to 53980 (keeping 200 days of data) [2025-10-23T20:23:37.325755] [DEBUG] [LOCAL ] BTI: Primary data saved (53980 records). [2025-10-23T20:23:37.325916] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-23T20:23:37.326026] [INFO ] [MAIN ] Update Progress: 353/2367 symbols completed. BTI took 38.6s. Estimated remaining: 4h 8m 29s. Rate: 8.1 symbols/min [2025-10-23T20:23:37.497364] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:37.545128] [DEBUG] [LOCAL ] BUD: Loaded 52597 existing records from primary storage. [2025-10-23T20:23:37.545465] [INFO ] [MAIN ] BUD: Loaded 52597 existing records. [2025-10-23T20:23:37.605324] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-23T20:23:37.759342] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:37.759595] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-23T20:23:37.759712] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-23T20:23:37.760002] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-23T20:23:37.760078] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-23T20:23:38.149420] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:38.162535] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T20:23:38.198546] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-23T20:23:38.399404] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-23T20:23:38.742284] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-23T20:23:39.199428] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-23T20:23:39.790867] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T20:23:39.999469] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-23T20:23:40.799436] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-23T20:23:41.168843] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-23T20:23:41.438011] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T20:23:41.451038] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T20:23:41.453675] [INFO ] [REMOTE ] BTT: Full fetch complete (22528 records). [2025-10-23T20:23:41.453844] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-23T20:23:41.604519] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-23T20:23:41.849800] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-23T20:23:41.849914] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-23T20:23:41.850391] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-23T20:23:41.850481] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-23T20:23:41.851147] [DEBUG] [LOCAL ] BTT: Trimmed 22528 records to 15457 (keeping 200 days of data) [2025-10-23T20:23:41.942477] [DEBUG] [LOCAL ] BTT: Primary data saved (15457 records). [2025-10-23T20:23:41.942639] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-23T20:23:41.942788] [INFO ] [MAIN ] Update Progress: 354/2367 symbols completed. BTT took 26.2s. Estimated remaining: 4h 8m 6s. Rate: 8.1 symbols/min [2025-10-23T20:23:42.118381] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:42.131847] [DEBUG] [LOCAL ] BUI: Loaded 11824 existing records from primary storage. [2025-10-23T20:23:42.132135] [INFO ] [MAIN ] BUI: Loaded 11824 existing records. [2025-10-23T20:23:42.341701] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:42.341934] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-23T20:23:42.342011] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-23T20:23:42.342202] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-23T20:23:42.342275] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-23T20:23:42.404565] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-23T20:23:42.698962] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:43.199435] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-23T20:23:43.785676] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T20:23:43.999436] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-23T20:23:44.521890] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-23T20:23:44.590853] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T20:23:44.799435] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-23T20:23:45.599460] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-23T20:23:46.026480] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T20:23:46.362998] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T20:23:46.399459] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-23T20:23:46.942436] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-23T20:23:47.199454] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-23T20:23:47.430176] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T20:23:47.999491] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-23T20:23:48.799423] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-23T20:23:48.928106] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T20:23:49.599461] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-23T20:23:50.106597] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-23T20:23:50.399533] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-23T20:23:50.871550] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T20:23:51.199428] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-23T20:23:51.999450] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-23T20:23:52.071417] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (3.27 seconds). [2025-10-23T20:23:52.464001] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:23:52.661958] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T20:23:52.799462] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-23T20:23:52.953937] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T20:23:53.599528] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-23T20:23:54.399434] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-23T20:23:55.199447] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-23T20:23:55.292492] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-23T20:23:55.623705] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-23T20:23:55.628187] [INFO ] [REMOTE ] BTZ: Full fetch complete (33223 records). [2025-10-23T20:23:55.628294] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-23T20:23:56.013897] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-23T20:23:56.032055] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-23T20:23:56.032216] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-23T20:23:56.033505] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-23T20:23:56.033748] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-23T20:23:56.035144] [DEBUG] [LOCAL ] BTZ: Trimmed 33223 records to 22521 (keeping 200 days of data) [2025-10-23T20:23:56.188245] [DEBUG] [LOCAL ] BTZ: Primary data saved (22521 records). [2025-10-23T20:23:56.188477] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-23T20:23:56.188673] [INFO ] [MAIN ] Update Progress: 355/2367 symbols completed. BTZ took 23.9s. Estimated remaining: 4h 8m 37s. Rate: 8.1 symbols/min [2025-10-23T20:23:56.367534] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:56.420939] [DEBUG] [LOCAL ] BUR: Loaded 45446 existing records from primary storage. [2025-10-23T20:23:56.421609] [INFO ] [MAIN ] BUR: Loaded 45446 existing records. [2025-10-23T20:23:56.628092] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:56.628849] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-23T20:23:56.629115] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-23T20:23:56.629682] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-23T20:23:56.629774] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-23T20:23:56.779400] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-23T20:23:56.863629] [INFO ] [REMOTE ] BTU: Full fetch complete (77302 records). [2025-10-23T20:23:56.928815] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-23T20:23:57.147913] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:57.159017] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-23T20:23:57.252411] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T20:23:57.470403] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-23T20:23:57.470580] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-23T20:23:57.472138] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-23T20:23:57.472234] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-23T20:23:57.474678] [DEBUG] [LOCAL ] BTU: Trimmed 77302 records to 53724 (keeping 200 days of data) [2025-10-23T20:23:57.599445] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-23T20:23:57.832738] [DEBUG] [LOCAL ] BTU: Primary data saved (53724 records). [2025-10-23T20:23:57.833182] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-23T20:23:57.833510] [INFO ] [MAIN ] Update Progress: 356/2367 symbols completed. BTU took 35.9s. Estimated remaining: 4h 7m 57s. Rate: 8.1 symbols/min [2025-10-23T20:23:58.017458] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:23:58.048019] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-23T20:23:58.098869] [DEBUG] [LOCAL ] BURL: Loaded 45416 existing records from primary storage. [2025-10-23T20:23:58.099315] [INFO ] [MAIN ] BURL: Loaded 45416 existing records. [2025-10-23T20:23:58.304093] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:23:58.304405] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-23T20:23:58.304495] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-23T20:23:58.305142] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-23T20:23:58.305228] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-23T20:23:58.406503] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-23T20:23:58.490322] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T20:23:58.704807] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:23:58.873305] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T20:23:59.199451] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-23T20:23:59.999465] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-23T20:24:00.168932] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T20:24:00.625602] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T20:24:00.799456] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-23T20:24:01.599429] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-23T20:24:02.088472] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-23T20:24:02.399421] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-23T20:24:03.199426] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-23T20:24:03.551555] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-23T20:24:03.649168] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T20:24:03.999408] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-23T20:24:04.237192] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T20:24:04.268526] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T20:24:04.799430] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-23T20:24:05.599423] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-23T20:24:05.907267] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T20:24:06.044527] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-23T20:24:06.399440] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-23T20:24:07.199403] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-23T20:24:07.444395] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T20:24:07.999497] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-23T20:24:08.274571] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-23T20:24:08.799419] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-23T20:24:08.928397] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T20:24:08.937685] [INFO ] [REMOTE ] BUD: Full fetch complete (76485 records). [2025-10-23T20:24:08.937826] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-23T20:24:09.329595] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-23T20:24:09.329816] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-23T20:24:09.330749] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-23T20:24:09.330829] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-23T20:24:09.332281] [DEBUG] [LOCAL ] BUD: Trimmed 76485 records to 52986 (keeping 200 days of data) [2025-10-23T20:24:09.582526] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:24:09.602887] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-23T20:24:09.679502] [DEBUG] [LOCAL ] BUD: Primary data saved (52986 records). [2025-10-23T20:24:09.679669] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-23T20:24:09.679786] [INFO ] [MAIN ] Update Progress: 357/2367 symbols completed. BUD took 32.4s. Estimated remaining: 4h 8m 15s. Rate: 8.1 symbols/min [2025-10-23T20:24:10.399409] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-23T20:24:10.459265] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:24:10.657171] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T20:24:11.199478] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-23T20:24:11.999422] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-23T20:24:12.179236] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:24:12.799404] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-23T20:24:13.134515] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-23T20:24:13.297231] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T20:24:13.599475] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-23T20:24:14.399461] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-23T20:24:14.549036] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T20:24:15.199445] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-23T20:24:15.573008] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T20:24:15.611304] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T20:24:15.614068] [INFO ] [REMOTE ] BUI: Full fetch complete (16513 records). [2025-10-23T20:24:15.614162] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-23T20:24:15.973055] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-23T20:24:15.973169] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-23T20:24:15.973587] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-23T20:24:15.973705] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-23T20:24:15.974292] [DEBUG] [LOCAL ] BUI: Trimmed 16513 records to 11873 (keeping 200 days of data) [2025-10-23T20:24:16.004386] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-23T20:24:16.048018] [DEBUG] [LOCAL ] BUI: Primary data saved (11873 records). [2025-10-23T20:24:16.048190] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-23T20:24:16.048307] [INFO ] [MAIN ] Update Progress: 358/2367 symbols completed. BUI took 34.1s. Estimated remaining: 4h 8m 1s. Rate: 8.1 symbols/min [2025-10-23T20:24:17.124322] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T20:24:17.135774] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-23T20:24:17.785323] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:24:17.794508] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-23T20:24:19.662869] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-23T20:24:19.672970] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-23T20:24:19.705418] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T20:24:19.716171] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-23T20:24:21.456436] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T20:24:21.465377] [INFO ] [REMOTE ] BUR: Full fetch complete (64646 records). [2025-10-23T20:24:21.465538] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-23T20:24:21.814545] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:24:21.879066] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-23T20:24:21.899406] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-23T20:24:21.899523] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-23T20:24:21.900381] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-23T20:24:21.900464] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-23T20:24:21.901786] [DEBUG] [LOCAL ] BUR: Trimmed 64646 records to 45815 (keeping 200 days of data) [2025-10-23T20:24:22.162743] [DEBUG] [LOCAL ] BUR: Primary data saved (45815 records). [2025-10-23T20:24:22.162899] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-23T20:24:22.163938] [INFO ] [MAIN ] Update Progress: 359/2367 symbols completed. BUR took 26.0s. Estimated remaining: 4h 7m 47s. Rate: 8.1 symbols/min [2025-10-23T20:24:24.398830] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-23T20:24:24.409523] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-23T20:24:26.113207] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T20:24:26.121504] [INFO ] [REMOTE ] BURL: Full fetch complete (65788 records). [2025-10-23T20:24:26.121748] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-23T20:24:26.513410] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-23T20:24:26.513532] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-23T20:24:26.514471] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-23T20:24:26.514555] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-23T20:24:26.515987] [DEBUG] [LOCAL ] BURL: Trimmed 65788 records to 45718 (keeping 200 days of data) [2025-10-23T20:24:26.788101] [DEBUG] [LOCAL ] BURL: Primary data saved (45718 records). [2025-10-23T20:24:26.788263] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-23T20:24:26.788379] [INFO ] [MAIN ] Update Progress: 360/2367 symbols completed. BURL took 29.0s. Estimated remaining: 4h 7m 24s. Rate: 8.1 symbols/min [2025-10-23T20:24:27.503203] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:27.504867] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:27.537259] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:27.538630] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-23T20:24:27.556161] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-23T20:24:27.558349] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:27.558677] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-23T20:24:27.558864] [DEBUG] [LOCAL ] BW: No existing data file found in primary storage. [2025-10-23T20:24:27.558787] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-23T20:24:27.559087] [WARN ] [MAIN ] BW: No existing data found, performing full refresh instead. [2025-10-23T20:24:27.559033] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-23T20:24:27.559303] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-23T20:24:27.559453] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-23T20:24:27.571103] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-23T20:24:27.571454] [DEBUG] [LOCAL ] BW: No primary data file found to delete. [2025-10-23T20:24:27.596229] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-23T20:24:27.719619] [DEBUG] [LOCAL ] BUXX: Loaded 15332 existing records from primary storage. [2025-10-23T20:24:27.779468] [INFO ] [MAIN ] BUXX: Loaded 15332 existing records. [2025-10-23T20:24:28.204799] [DEBUG] [LOCAL ] BVN: Loaded 44515 existing records from primary storage. [2025-10-23T20:24:28.339582] [INFO ] [MAIN ] BVN: Loaded 44515 existing records. [2025-10-23T20:24:28.308189] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:24:28.370553] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-23T20:24:28.370750] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-23T20:24:28.397315] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-23T20:24:28.412913] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-23T20:24:28.718769] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:28.776931] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-23T20:24:28.772979] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:28.778339] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-23T20:24:28.955304] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:24:29.015330] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-23T20:24:29.042230] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-23T20:24:29.058464] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-23T20:24:29.079290] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-23T20:24:29.232620] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:29.263086] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-23T20:24:29.539497] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:29.540024] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-23T20:24:30.280699] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T20:24:30.283505] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-23T20:24:30.486514] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T20:24:30.493422] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-23T20:24:31.182617] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T20:24:31.190974] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-23T20:24:31.322135] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-23T20:24:31.323321] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T20:24:31.335966] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-23T20:24:31.336855] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-23T20:24:32.167152] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T20:24:32.175818] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-23T20:24:32.487987] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T20:24:32.492084] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-23T20:24:32.560677] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T20:24:32.569908] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-23T20:24:32.894026] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T20:24:32.902161] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-23T20:24:33.261749] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T20:24:33.266207] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-23T20:24:34.033729] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T20:24:34.042848] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-23T20:24:34.271193] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T20:24:34.295544] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-23T20:24:34.296637] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-23T20:24:34.399421] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-23T20:24:34.706978] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T20:24:35.199437] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-23T20:24:35.800410] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T20:24:35.853116] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T20:24:35.977927] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T20:24:35.999403] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-23T20:24:36.118061] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:24:36.799464] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-23T20:24:37.471615] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T20:24:37.599443] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-23T20:24:37.940402] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T20:24:38.399467] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-23T20:24:39.199550] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-23T20:24:39.506028] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T20:24:39.755541] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-23T20:24:39.999497] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-23T20:24:40.647119] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T20:24:40.799410] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-23T20:24:41.592382] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T20:24:41.601552] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-23T20:24:42.404677] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-23T20:24:42.416529] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T20:24:42.722395] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T20:24:43.199466] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-23T20:24:43.707735] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T20:24:43.999476] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-23T20:24:44.799460] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-23T20:24:44.926984] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T20:24:45.288175] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T20:24:45.599430] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-23T20:24:46.399472] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-23T20:24:46.533749] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T20:24:47.199512] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-23T20:24:47.269331] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:24:47.310068] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T20:24:47.313631] [INFO ] [REMOTE ] BUXX: Full fetch complete (20803 records). [2025-10-23T20:24:47.313764] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-23T20:24:47.703456] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-23T20:24:47.703605] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-23T20:24:47.704204] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-23T20:24:47.704286] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-23T20:24:47.705114] [DEBUG] [LOCAL ] BUXX: Trimmed 20803 records to 15467 (keeping 200 days of data) [2025-10-23T20:24:47.807218] [DEBUG] [LOCAL ] BUXX: Primary data saved (15467 records). [2025-10-23T20:24:47.807460] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-23T20:24:47.807600] [INFO ] [MAIN ] Update Progress: 361/2367 symbols completed. BUXX took 21.0s. Estimated remaining: 4h 8m 32s. Rate: 8.1 symbols/min [2025-10-23T20:24:48.001371] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:47.999577] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-23T20:24:48.060328] [DEBUG] [LOCAL ] BWA: Loaded 52078 existing records from primary storage. [2025-10-23T20:24:48.061013] [INFO ] [MAIN ] BWA: Loaded 52078 existing records. [2025-10-23T20:24:48.249611] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:24:48.249957] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-23T20:24:48.250050] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-23T20:24:48.250860] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-23T20:24:48.250956] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-23T20:24:48.640130] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:48.799515] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-23T20:24:48.902440] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T20:24:49.599508] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-23T20:24:49.694413] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T20:24:49.940960] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T20:24:50.399469] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-23T20:24:51.199482] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-23T20:24:51.477792] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T20:24:51.487793] [INFO ] [REMOTE ] BVN: Full fetch complete (63550 records). [2025-10-23T20:24:51.488081] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-23T20:24:51.932856] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-23T20:24:51.933118] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-23T20:24:51.953980] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-23T20:24:51.954438] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-23T20:24:51.956304] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T20:24:51.965312] [INFO ] [REMOTE ] BV: Full fetch complete (55041 records). [2025-10-23T20:24:51.965488] [DEBUG] [LOCAL ] BVN: Trimmed 63550 records to 44895 (keeping 200 days of data) [2025-10-23T20:24:51.965825] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-23T20:24:52.049678] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-23T20:24:52.634815] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-23T20:24:52.635559] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-23T20:24:52.637089] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-23T20:24:52.648049] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-23T20:24:52.672915] [DEBUG] [LOCAL ] BV: Trimmed 55041 records to 38734 (keeping 200 days of data) [2025-10-23T20:24:52.778489] [DEBUG] [LOCAL ] BVN: Primary data saved (44895 records). [2025-10-23T20:24:52.780682] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-23T20:24:52.784934] [INFO ] [MAIN ] Update Progress: 362/2367 symbols completed. BVN took 26.0s. Estimated remaining: 4h 8m 11s. Rate: 8.1 symbols/min [2025-10-23T20:24:53.100606] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:53.125163] [DEBUG] [LOCAL ] BV: Primary data saved (38734 records). [2025-10-23T20:24:53.125874] [INFO ] [MAIN ] BV: Full history saved. [2025-10-23T20:24:53.126190] [INFO ] [MAIN ] Update Progress: 363/2367 symbols completed. BV took 26.3s. Estimated remaining: 4h 7m 25s. Rate: 8.1 symbols/min [2025-10-23T20:24:53.216593] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-23T20:24:53.283411] [DEBUG] [LOCAL ] BWG: Loaded 12559 existing records from primary storage. [2025-10-23T20:24:53.297142] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-23T20:24:53.299052] [INFO ] [MAIN ] BWG: Loaded 12559 existing records. [2025-10-23T20:24:53.449432] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:53.573805] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:24:53.575373] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-23T20:24:53.575456] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-23T20:24:53.575726] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-23T20:24:53.575802] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-23T20:24:53.780760] [DEBUG] [LOCAL ] BWLP: Loaded 32092 existing records from primary storage. [2025-10-23T20:24:53.807167] [INFO ] [MAIN ] BWLP: Loaded 32092 existing records. [2025-10-23T20:24:54.194077] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:54.230771] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-23T20:24:54.233277] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:24:54.235141] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-23T20:24:54.235416] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-23T20:24:54.236502] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-23T20:24:54.236611] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-23T20:24:54.388430] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-23T20:24:54.442818] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-23T20:24:54.673021] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:54.995854] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T20:24:55.199466] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-23T20:24:55.463010] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T20:24:55.999449] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-23T20:24:56.384050] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T20:24:56.562406] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-23T20:24:56.571381] [INFO ] [REMOTE ] BW: Full fetch complete (59320 records). [2025-10-23T20:24:56.571594] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-23T20:24:56.808566] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-23T20:24:56.896378] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T20:24:56.995665] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-23T20:24:56.995843] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-23T20:24:56.997006] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-23T20:24:56.997092] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-23T20:24:56.999045] [DEBUG] [LOCAL ] BW: Trimmed 59320 records to 40674 (keeping 200 days of data) [2025-10-23T20:24:57.245322] [DEBUG] [LOCAL ] BW: Primary data saved (40674 records). [2025-10-23T20:24:57.245552] [INFO ] [MAIN ] BW: Full history saved. [2025-10-23T20:24:57.245797] [INFO ] [MAIN ] Update Progress: 364/2367 symbols completed. BW took 30.4s. Estimated remaining: 4h 6m 59s. Rate: 8.1 symbols/min [2025-10-23T20:24:57.426834] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:24:57.427126] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-10-23T20:24:57.427232] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-10-23T20:24:57.427390] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-23T20:24:57.427467] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-23T20:24:57.427568] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-23T20:24:57.427707] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-23T20:24:57.608214] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-23T20:24:57.808802] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:24:58.399427] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-23T20:24:58.551573] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T20:24:58.577751] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T20:24:59.199448] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-23T20:24:59.999475] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-23T20:25:00.328501] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T20:25:00.349460] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:25:00.799413] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-23T20:25:01.017264] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T20:25:01.599499] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-23T20:25:02.035584] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T20:25:02.399501] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-23T20:25:03.199467] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-23T20:25:03.999460] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-23T20:25:04.056077] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T20:25:04.072608] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-23T20:25:04.103709] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-23T20:25:04.720978] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T20:25:04.799442] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-23T20:25:05.599437] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-23T20:25:06.399404] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-23T20:25:06.855605] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-23T20:25:06.875036] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T20:25:07.175478] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T20:25:07.199388] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-23T20:25:07.999413] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-23T20:25:08.086886] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T20:25:08.799432] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-23T20:25:09.599446] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-23T20:25:09.751168] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T20:25:09.862329] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T20:25:10.399468] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-23T20:25:11.199523] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-23T20:25:11.498185] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T20:25:11.914478] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T20:25:11.999531] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-23T20:25:12.256589] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T20:25:12.799423] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-23T20:25:13.599441] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-23T20:25:14.171143] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-23T20:25:14.399431] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-23T20:25:14.506893] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T20:25:14.540661] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T20:25:15.199409] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-23T20:25:15.355513] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T20:25:15.999423] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-23T20:25:16.250161] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T20:25:16.799418] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-23T20:25:16.954369] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T20:25:16.956393] [INFO ] [REMOTE ] BWG: Full fetch complete (17647 records). [2025-10-23T20:25:16.956502] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-23T20:25:17.324686] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-23T20:25:17.324804] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-23T20:25:17.325259] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-23T20:25:17.325335] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-23T20:25:17.325946] [DEBUG] [LOCAL ] BWG: Trimmed 17647 records to 12676 (keeping 200 days of data) [2025-10-23T20:25:17.397281] [DEBUG] [LOCAL ] BWG: Primary data saved (12676 records). [2025-10-23T20:25:17.397438] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-23T20:25:17.397549] [INFO ] [MAIN ] Update Progress: 365/2367 symbols completed. BWG took 24.6s. Estimated remaining: 4h 8m 2s. Rate: 8.1 symbols/min [2025-10-23T20:25:17.566965] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:25:17.573340] [DEBUG] [LOCAL ] BWNB: Loaded 4051 existing records from primary storage. [2025-10-23T20:25:17.573525] [INFO ] [MAIN ] BWNB: Loaded 4051 existing records. [2025-10-23T20:25:17.604779] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-23T20:25:17.761515] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:25:17.762372] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T20:25:17.764765] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-23T20:25:17.765473] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-23T20:25:17.765673] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-23T20:25:17.765763] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-23T20:25:18.118984] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:25:18.399462] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-23T20:25:19.137793] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T20:25:19.199466] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-23T20:25:19.435631] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T20:25:19.964939] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T20:25:19.966550] [INFO ] [REMOTE ] BWMX: Full fetch complete (9919 records). [2025-10-23T20:25:19.966637] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-23T20:25:20.005301] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-23T20:25:20.330569] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-23T20:25:20.330703] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-23T20:25:20.331028] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-23T20:25:20.331105] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-23T20:25:20.331576] [DEBUG] [LOCAL ] BWMX: Trimmed 9919 records to 7900 (keeping 200 days of data) [2025-10-23T20:25:20.380949] [DEBUG] [LOCAL ] BWMX: Primary data saved (7900 records). [2025-10-23T20:25:20.381121] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-23T20:25:20.381228] [INFO ] [MAIN ] Update Progress: 366/2367 symbols completed. BWMX took 23.1s. Estimated remaining: 4h 7m 30s. Rate: 8.1 symbols/min [2025-10-23T20:25:20.552429] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:25:20.556054] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-23T20:25:20.563507] [DEBUG] [LOCAL ] BWSN: Loaded 5048 existing records from primary storage. [2025-10-23T20:25:20.563773] [INFO ] [MAIN ] BWSN: Loaded 5048 existing records. [2025-10-23T20:25:20.744791] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:25:20.745120] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-23T20:25:20.745214] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-23T20:25:20.745447] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-23T20:25:20.745551] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-23T20:25:20.804669] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-23T20:25:21.103950] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:25:21.545029] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T20:25:21.599434] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-23T20:25:22.399437] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-23T20:25:23.140297] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T20:25:23.199407] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-23T20:25:23.953373] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T20:25:23.999400] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-23T20:25:24.342694] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T20:25:24.799492] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-23T20:25:25.144159] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T20:25:25.340622] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-23T20:25:25.599439] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-23T20:25:26.399460] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-23T20:25:27.199427] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-23T20:25:27.490097] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T20:25:27.499429] [INFO ] [REMOTE ] BWA: Full fetch complete (75888 records). [2025-10-23T20:25:27.499586] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-23T20:25:27.823909] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T20:25:27.935960] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-23T20:25:27.936101] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T20:25:27.937568] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-23T20:25:27.939409] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-23T20:25:27.939495] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-23T20:25:27.940872] [DEBUG] [LOCAL ] BWA: Trimmed 75888 records to 52452 (keeping 200 days of data) [2025-10-23T20:25:28.001469] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-23T20:25:28.251088] [DEBUG] [LOCAL ] BWA: Primary data saved (52452 records). [2025-10-23T20:25:28.251281] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-23T20:25:28.251427] [INFO ] [MAIN ] Update Progress: 367/2367 symbols completed. BWA took 40.4s. Estimated remaining: 4h 7m 25s. Rate: 8.1 symbols/min [2025-10-23T20:25:28.432601] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:25:28.473969] [DEBUG] [LOCAL ] BWXT: Loaded 47260 existing records from primary storage. [2025-10-23T20:25:28.474287] [INFO ] [MAIN ] BWXT: Loaded 47260 existing records. [2025-10-23T20:25:28.658858] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:25:28.659050] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-23T20:25:28.659122] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-23T20:25:28.659436] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-23T20:25:28.659507] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-23T20:25:28.806621] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-23T20:25:29.014858] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:25:29.594250] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T20:25:29.600568] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-23T20:25:29.792313] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T20:25:30.399469] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-23T20:25:31.090773] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T20:25:31.199433] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-23T20:25:31.384371] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T20:25:31.830760] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T20:25:31.999447] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-23T20:25:32.799445] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-23T20:25:33.400604] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T20:25:33.599439] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-23T20:25:34.019000] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-23T20:25:34.321431] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T20:25:34.399488] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-23T20:25:35.077045] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-23T20:25:35.199418] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-23T20:25:35.999437] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-23T20:25:36.708120] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T20:25:36.806403] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-23T20:25:36.809575] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T20:25:36.816200] [INFO ] [REMOTE ] BWLP: Full fetch complete (47751 records). [2025-10-23T20:25:36.816315] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-23T20:25:37.195977] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-23T20:25:37.196091] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-23T20:25:37.196790] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-23T20:25:37.196869] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-23T20:25:37.197923] [DEBUG] [LOCAL ] BWLP: Trimmed 47751 records to 32265 (keeping 200 days of data) [2025-10-23T20:25:37.385957] [DEBUG] [LOCAL ] BWLP: Primary data saved (32265 records). [2025-10-23T20:25:37.386132] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-23T20:25:37.386256] [INFO ] [MAIN ] Update Progress: 368/2367 symbols completed. BWLP took 44.3s. Estimated remaining: 4h 7m 27s. Rate: 8.1 symbols/min [2025-10-23T20:25:37.552697] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:25:37.552876] [DEBUG] [LOCAL ] BX: No existing data file found in primary storage. [2025-10-23T20:25:37.552945] [WARN ] [MAIN ] BX: No existing data found, performing full refresh instead. [2025-10-23T20:25:37.553051] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-23T20:25:37.553120] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-23T20:25:37.553188] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-10-23T20:25:37.553249] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-23T20:25:37.606719] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-23T20:25:37.907361] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:25:38.399470] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-23T20:25:38.452572] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-23T20:25:38.777986] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T20:25:39.019889] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T20:25:39.020928] [INFO ] [REMOTE ] BWNB: Full fetch complete (5585 records). [2025-10-23T20:25:39.021016] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-23T20:25:39.206338] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-23T20:25:39.391990] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-23T20:25:39.392098] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-23T20:25:39.392332] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-23T20:25:39.392407] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-23T20:25:39.392966] [DEBUG] [LOCAL ] BWNB: Trimmed 5585 records to 4067 (keeping 200 days of data) [2025-10-23T20:25:39.417049] [DEBUG] [LOCAL ] BWNB: Primary data saved (4067 records). [2025-10-23T20:25:39.417145] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-23T20:25:39.417232] [INFO ] [MAIN ] Update Progress: 369/2367 symbols completed. BWNB took 22.0s. Estimated remaining: 4h 6m 50s. Rate: 8.1 symbols/min [2025-10-23T20:25:39.596620] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:25:39.596839] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-10-23T20:25:39.596910] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-10-23T20:25:39.596995] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-23T20:25:39.597059] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-23T20:25:39.597116] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-23T20:25:39.597176] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-23T20:25:39.955168] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:25:39.999392] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-23T20:25:40.704510] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T20:25:40.799428] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-23T20:25:41.302543] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T20:25:41.599439] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-23T20:25:41.843528] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T20:25:42.266108] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T20:25:42.399430] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-23T20:25:43.199431] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-23T20:25:43.999424] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-23T20:25:44.219716] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T20:25:44.616436] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-23T20:25:44.667989] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T20:25:44.799444] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-23T20:25:45.599442] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-23T20:25:46.300776] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T20:25:46.399447] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-23T20:25:46.488359] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T20:25:47.199428] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-23T20:25:47.236760] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T20:25:47.999571] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-23T20:25:48.028602] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T20:25:48.588440] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T20:25:48.799524] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-23T20:25:49.599455] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-23T20:25:50.399472] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-23T20:25:50.666729] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T20:25:50.726390] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T20:25:50.883092] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T20:25:50.884501] [INFO ] [REMOTE ] BWSN: Full fetch complete (6407 records). [2025-10-23T20:25:50.884589] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-23T20:25:51.210344] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-23T20:25:51.254931] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-23T20:25:51.255037] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-23T20:25:51.255280] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-23T20:25:51.255376] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-23T20:25:51.256035] [DEBUG] [LOCAL ] BWSN: Trimmed 6407 records to 5082 (keeping 200 days of data) [2025-10-23T20:25:51.286710] [DEBUG] [LOCAL ] BWSN: Primary data saved (5082 records). [2025-10-23T20:25:51.286825] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-23T20:25:51.287001] [INFO ] [MAIN ] Update Progress: 370/2367 symbols completed. BWSN took 30.9s. Estimated remaining: 4h 7m 7s. Rate: 8.1 symbols/min [2025-10-23T20:25:51.453704] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:25:51.453896] [DEBUG] [LOCAL ] BXMT: No existing data file found in primary storage. [2025-10-23T20:25:51.453983] [WARN ] [MAIN ] BXMT: No existing data found, performing full refresh instead. [2025-10-23T20:25:51.454182] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-23T20:25:51.454266] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-23T20:25:51.454409] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-23T20:25:51.454526] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-23T20:25:51.799285] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:25:51.999521] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-23T20:25:52.158398] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T20:25:52.799468] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-23T20:25:53.599470] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-23T20:25:53.927411] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T20:25:53.961374] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-23T20:25:54.399484] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-23T20:25:55.199448] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-23T20:25:55.508833] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T20:25:55.999418] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-23T20:25:56.332245] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T20:25:56.704219] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-23T20:25:56.799440] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-23T20:25:57.517064] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-23T20:25:57.599478] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-23T20:25:57.854745] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T20:25:58.399519] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-23T20:25:59.199461] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-23T20:25:59.370320] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T20:25:59.999457] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-23T20:26:00.450411] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T20:26:00.799441] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-23T20:26:01.599450] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-23T20:26:02.167384] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-10-23T20:26:02.335941] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-23T20:26:02.399416] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-23T20:26:02.964269] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-23T20:26:02.983801] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T20:26:02.987388] [INFO ] [REMOTE ] BXC: Full fetch complete (18324 records). [2025-10-23T20:26:02.987502] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-23T20:26:03.204745] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-23T20:26:03.362581] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-23T20:26:03.362717] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-23T20:26:03.363197] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-23T20:26:03.363278] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-23T20:26:03.363912] [DEBUG] [LOCAL ] BXC: Trimmed 18324 records to 13472 (keeping 200 days of data) [2025-10-23T20:26:03.440368] [DEBUG] [LOCAL ] BXC: Primary data saved (13472 records). [2025-10-23T20:26:03.440531] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-23T20:26:03.440639] [INFO ] [MAIN ] Update Progress: 371/2367 symbols completed. BXC took 24.0s. Estimated remaining: 4h 7m 25s. Rate: 8.1 symbols/min [2025-10-23T20:26:03.611732] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:03.611946] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-10-23T20:26:03.612019] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-10-23T20:26:03.612128] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-23T20:26:03.612199] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-23T20:26:03.612287] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-23T20:26:03.612359] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-23T20:26:03.958355] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:03.999396] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-23T20:26:04.549705] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-23T20:26:04.799432] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-23T20:26:04.985294] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T20:26:05.258940] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T20:26:05.267740] [INFO ] [REMOTE ] BWXT: Full fetch complete (68106 records). [2025-10-23T20:26:05.267912] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-23T20:26:05.607333] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-23T20:26:05.655076] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-23T20:26:05.655211] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-23T20:26:05.656109] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-23T20:26:05.656192] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-23T20:26:05.657675] [DEBUG] [LOCAL ] BWXT: Trimmed 68106 records to 47605 (keeping 200 days of data) [2025-10-23T20:26:05.962603] [DEBUG] [LOCAL ] BWXT: Primary data saved (47605 records). [2025-10-23T20:26:05.962787] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-23T20:26:05.962898] [INFO ] [MAIN ] Update Progress: 372/2367 symbols completed. BWXT took 37.7s. Estimated remaining: 4h 6m 51s. Rate: 8.1 symbols/min [2025-10-23T20:26:06.135705] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:06.180936] [DEBUG] [LOCAL ] BXP: Loaded 49849 existing records from primary storage. [2025-10-23T20:26:06.181259] [INFO ] [MAIN ] BXP: Loaded 49849 existing records. [2025-10-23T20:26:06.371156] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:26:06.371410] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-23T20:26:06.371488] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-23T20:26:06.371742] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-23T20:26:06.371834] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-23T20:26:06.403218] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-23T20:26:06.741161] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:06.769242] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T20:26:06.922956] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T20:26:07.199427] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-23T20:26:07.999482] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-23T20:26:08.390805] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T20:26:08.550529] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-23T20:26:08.799498] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-23T20:26:09.612927] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-23T20:26:09.616184] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T20:26:09.774477] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T20:26:10.399442] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-23T20:26:11.199459] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-23T20:26:11.641880] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T20:26:11.747389] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-23T20:26:11.999475] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-23T20:26:12.799456] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-23T20:26:12.869044] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T20:26:13.599471] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-23T20:26:13.933515] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T20:26:14.345825] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-23T20:26:14.399450] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-23T20:26:15.199417] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-23T20:26:15.507624] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T20:26:15.999488] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-23T20:26:16.634551] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-23T20:26:16.799440] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-23T20:26:17.164779] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T20:26:17.259254] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T20:26:17.599484] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-23T20:26:17.810137] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T20:26:18.399440] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-23T20:26:18.688851] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T20:26:19.199458] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-23T20:26:19.999412] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-23T20:26:20.218053] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T20:26:20.392807] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T20:26:20.799483] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-23T20:26:20.973693] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T20:26:20.983547] [INFO ] [REMOTE ] BX: Full fetch complete (77220 records). [2025-10-23T20:26:20.983846] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-23T20:26:20.985621] [FATAL] [VALIDATOR ] BX: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:26:20.985870] [FATAL] [MAIN ] BX: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:26:20.985956] [WARN ] [MAIN ] BX: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:26:20.986053] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-23T20:26:20.986186] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-10-23T20:26:20.986265] [INFO ] [LOCAL ] BX: Starting deletion of derivative data. [2025-10-23T20:26:20.986366] [DEBUG] [LOCAL ] BX: No derivative data file found to delete. [2025-10-23T20:26:20.986484] [INFO ] [MAIN ] Update Progress: 373/2367 symbols completed. BX took 43.6s. Estimated remaining: 4h 7m 24s. Rate: 8.1 symbols/min [2025-10-23T20:26:21.161110] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:21.161350] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-10-23T20:26:21.161427] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-10-23T20:26:21.161518] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-23T20:26:21.161586] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-23T20:26:21.161697] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-23T20:26:21.161769] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-23T20:26:21.532445] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:21.599430] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-23T20:26:22.399441] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-23T20:26:22.692341] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T20:26:23.199418] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-23T20:26:23.389200] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T20:26:23.541609] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-23T20:26:23.545714] [INFO ] [REMOTE ] BXMX: Full fetch complete (28587 records). [2025-10-23T20:26:23.545824] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-23T20:26:23.907666] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-23T20:26:23.907798] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-23T20:26:23.908366] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-23T20:26:23.908443] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-23T20:26:23.909287] [DEBUG] [LOCAL ] BXMX: Trimmed 28587 records to 19294 (keeping 200 days of data) [2025-10-23T20:26:24.002692] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-23T20:26:24.026264] [DEBUG] [LOCAL ] BXMX: Primary data saved (19294 records). [2025-10-23T20:26:24.026427] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-23T20:26:24.026532] [INFO ] [MAIN ] Update Progress: 374/2367 symbols completed. BXMX took 20.6s. Estimated remaining: 4h 6m 53s. Rate: 8.1 symbols/min [2025-10-23T20:26:24.196788] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:24.217313] [DEBUG] [LOCAL ] BY: Loaded 21636 existing records from primary storage. [2025-10-23T20:26:24.217618] [INFO ] [MAIN ] BY: Loaded 21636 existing records. [2025-10-23T20:26:24.409163] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:26:24.409401] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-23T20:26:24.409482] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-23T20:26:24.409864] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-23T20:26:24.409938] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-23T20:26:24.759374] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:24.799446] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-23T20:26:25.202233] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-23T20:26:25.211261] [INFO ] [REMOTE ] BXMT: Full fetch complete (69880 records). [2025-10-23T20:26:25.211396] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-23T20:26:25.600818] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-23T20:26:25.618037] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-23T20:26:25.618517] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-23T20:26:25.620316] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-23T20:26:25.620520] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-23T20:26:25.622469] [DEBUG] [LOCAL ] BXMT: Trimmed 69880 records to 47621 (keeping 200 days of data) [2025-10-23T20:26:25.867859] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T20:26:25.959794] [DEBUG] [LOCAL ] BXMT: Primary data saved (47621 records). [2025-10-23T20:26:25.964969] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-23T20:26:25.965421] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T20:26:25.965600] [INFO ] [MAIN ] Update Progress: 375/2367 symbols completed. BXMT took 34.7s. Estimated remaining: 4h 6m 17s. Rate: 8.1 symbols/min [2025-10-23T20:26:26.142688] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:26.179881] [DEBUG] [LOCAL ] BYD: Loaded 44941 existing records from primary storage. [2025-10-23T20:26:26.180202] [INFO ] [MAIN ] BYD: Loaded 44941 existing records. [2025-10-23T20:26:26.365174] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:26:26.365365] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-23T20:26:26.365439] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-23T20:26:26.365896] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-23T20:26:26.365973] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-23T20:26:26.404632] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-23T20:26:26.725366] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:27.199457] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-23T20:26:27.492445] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T20:26:27.999433] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-23T20:26:28.258092] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T20:26:28.555512] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T20:26:28.799418] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-23T20:26:29.438843] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T20:26:29.599452] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-23T20:26:30.399473] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-23T20:26:30.695456] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T20:26:31.199457] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-23T20:26:31.362626] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T20:26:31.474162] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T20:26:31.999456] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-23T20:26:32.799456] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-23T20:26:33.160348] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T20:26:33.183060] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T20:26:33.599437] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-23T20:26:34.399414] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-23T20:26:34.742328] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T20:26:35.199420] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-23T20:26:35.578896] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T20:26:35.999440] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-23T20:26:36.357576] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T20:26:36.656169] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T20:26:36.799445] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-23T20:26:36.953772] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T20:26:37.599435] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-23T20:26:38.399430] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-23T20:26:38.811794] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T20:26:39.199445] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-23T20:26:39.472816] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:26:39.999438] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-23T20:26:40.192611] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T20:26:40.280300] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T20:26:40.799436] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-23T20:26:41.599490] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-23T20:26:41.902303] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T20:26:42.062942] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:26:42.399475] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-23T20:26:43.179444] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T20:26:43.199402] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-23T20:26:43.648840] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T20:26:43.999483] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-23T20:26:44.799437] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-23T20:26:45.156996] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T20:26:45.599421] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-23T20:26:45.733344] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T20:26:46.399418] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-23T20:26:46.509129] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T20:26:46.518762] [INFO ] [REMOTE ] BXP: Full fetch complete (72253 records). [2025-10-23T20:26:46.518949] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-23T20:26:46.897664] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-23T20:26:46.897779] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-23T20:26:46.898689] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-23T20:26:46.898772] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-23T20:26:46.900170] [DEBUG] [LOCAL ] BXP: Trimmed 72253 records to 50203 (keeping 200 days of data) [2025-10-23T20:26:47.205136] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-23T20:26:47.209806] [DEBUG] [LOCAL ] BXP: Primary data saved (50203 records). [2025-10-23T20:26:47.209993] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-23T20:26:47.210137] [INFO ] [MAIN ] Update Progress: 376/2367 symbols completed. BXP took 41.2s. Estimated remaining: 4h 7m 23s. Rate: 8.0 symbols/min [2025-10-23T20:26:47.389746] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:47.402912] [DEBUG] [LOCAL ] BYM: Loaded 11369 existing records from primary storage. [2025-10-23T20:26:47.403156] [INFO ] [MAIN ] BYM: Loaded 11369 existing records. [2025-10-23T20:26:47.585490] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:26:47.586060] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-23T20:26:47.586243] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-23T20:26:47.586584] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-23T20:26:47.586709] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-23T20:26:47.731692] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-23T20:26:47.729838] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-23T20:26:48.009059] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-23T20:26:48.017122] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:48.799436] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-23T20:26:48.947312] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T20:26:49.311852] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T20:26:49.599482] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-23T20:26:49.775239] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T20:26:50.399447] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-23T20:26:51.199425] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-23T20:26:51.451489] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:26:51.460810] [INFO ] [REMOTE ] BXSL: Full fetch complete (70074 records). [2025-10-23T20:26:51.460968] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-23T20:26:51.618857] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T20:26:51.651112] [INFO ] [REMOTE ] BY: Full fetch complete (29591 records). [2025-10-23T20:26:51.697580] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-23T20:26:52.010127] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-23T20:26:52.013886] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-23T20:26:52.021152] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-23T20:26:52.048563] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-23T20:26:52.095547] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-23T20:26:52.161752] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T20:26:52.167075] [DEBUG] [LOCAL ] BXSL: Trimmed 70074 records to 48587 (keeping 200 days of data) [2025-10-23T20:26:52.300454] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-23T20:26:52.300573] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-23T20:26:52.309426] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-23T20:26:52.335610] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-23T20:26:52.348289] [DEBUG] [LOCAL ] BY: Trimmed 29591 records to 21757 (keeping 200 days of data) [2025-10-23T20:26:52.582542] [DEBUG] [LOCAL ] BY: Primary data saved (21757 records). [2025-10-23T20:26:52.583388] [INFO ] [MAIN ] BY: Full history saved. [2025-10-23T20:26:52.584697] [INFO ] [MAIN ] Update Progress: 377/2367 symbols completed. BY took 28.6s. Estimated remaining: 4h 7m 4s. Rate: 8.1 symbols/min [2025-10-23T20:26:52.822939] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:52.803721] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-23T20:26:52.840859] [DEBUG] [LOCAL ] BXSL: Primary data saved (48587 records). [2025-10-23T20:26:52.841489] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-23T20:26:52.841624] [INFO ] [MAIN ] Update Progress: 378/2367 symbols completed. BXSL took 31.9s. Estimated remaining: 4h 6m 19s. Rate: 8.1 symbols/min [2025-10-23T20:26:53.082946] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:26:53.085050] [DEBUG] [LOCAL ] BZH: Loaded 32065 existing records from primary storage. [2025-10-23T20:26:53.085477] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-10-23T20:26:53.086125] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-10-23T20:26:53.086011] [INFO ] [MAIN ] BZH: Loaded 32065 existing records. [2025-10-23T20:26:53.086320] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-23T20:26:53.091688] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-23T20:26:53.119456] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-23T20:26:53.151624] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-23T20:26:53.437364] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:26:53.458238] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-23T20:26:53.519809] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-23T20:26:53.578144] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-23T20:26:53.578283] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-23T20:26:53.756758] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:53.762808] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-23T20:26:53.961224] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T20:26:54.026602] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:26:54.090032] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T20:26:54.399420] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-23T20:26:55.195025] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T20:26:55.199387] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-23T20:26:55.999425] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-23T20:26:56.182198] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-23T20:26:56.220886] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T20:26:56.799433] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-23T20:26:57.401528] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:26:57.599459] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-23T20:26:58.399400] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-23T20:26:58.502910] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T20:26:58.592471] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T20:26:59.199484] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-23T20:26:59.999437] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-23T20:27:00.503360] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-23T20:27:00.799449] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-23T20:27:01.599458] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-23T20:27:02.103017] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-23T20:27:02.206169] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-23T20:27:02.399426] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-23T20:27:02.643963] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T20:27:03.186472] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-23T20:27:03.199400] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-23T20:27:03.999422] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-23T20:27:04.405932] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-23T20:27:04.413898] [INFO ] [REMOTE ] BYD: Full fetch complete (65484 records). [2025-10-23T20:27:04.414050] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-23T20:27:04.723048] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T20:27:04.807847] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-23T20:27:04.811208] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-23T20:27:04.812021] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-23T20:27:04.812869] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-23T20:27:04.813042] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-23T20:27:04.814393] [DEBUG] [LOCAL ] BYD: Trimmed 65484 records to 45312 (keeping 200 days of data) [2025-10-23T20:27:05.097298] [DEBUG] [LOCAL ] BYD: Primary data saved (45312 records). [2025-10-23T20:27:05.097467] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-23T20:27:05.097577] [INFO ] [MAIN ] Update Progress: 379/2367 symbols completed. BYD took 39.1s. Estimated remaining: 4h 6m 37s. Rate: 8.1 symbols/min [2025-10-23T20:27:05.269139] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:05.288620] [DEBUG] [LOCAL ] CAAP: Loaded 19805 existing records from primary storage. [2025-10-23T20:27:05.288920] [INFO ] [MAIN ] CAAP: Loaded 19805 existing records. [2025-10-23T20:27:05.464668] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:27:05.464938] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-23T20:27:05.465029] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-23T20:27:05.465234] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-23T20:27:05.465308] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-23T20:27:05.605124] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-23T20:27:05.828263] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:05.917329] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-23T20:27:06.333069] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T20:27:06.399404] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-23T20:27:06.776802] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T20:27:07.199489] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-23T20:27:08.003532] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-23T20:27:08.007690] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T20:27:08.799449] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-23T20:27:08.860800] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T20:27:08.863071] [INFO ] [REMOTE ] BYM: Full fetch complete (17171 records). [2025-10-23T20:27:08.863162] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-23T20:27:09.237523] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-23T20:27:09.237670] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-23T20:27:09.238157] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-23T20:27:09.238236] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-23T20:27:09.238838] [DEBUG] [LOCAL ] BYM: Trimmed 17171 records to 11423 (keeping 200 days of data) [2025-10-23T20:27:09.307866] [DEBUG] [LOCAL ] BYM: Primary data saved (11423 records). [2025-10-23T20:27:09.308072] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-23T20:27:09.308190] [INFO ] [MAIN ] Update Progress: 380/2367 symbols completed. BYM took 22.1s. Estimated remaining: 4h 6m 12s. Rate: 8.1 symbols/min [2025-10-23T20:27:09.486341] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:09.525580] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-23T20:27:09.542725] [DEBUG] [LOCAL ] CABO: Loaded 16659 existing records from primary storage. [2025-10-23T20:27:09.543598] [INFO ] [MAIN ] CABO: Loaded 16659 existing records. [2025-10-23T20:27:09.607670] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-23T20:27:09.725729] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:27:09.725971] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-23T20:27:09.726046] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-23T20:27:09.726289] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-23T20:27:09.726363] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-23T20:27:10.079579] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:10.372728] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T20:27:10.399399] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-23T20:27:11.199437] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-23T20:27:11.813447] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-23T20:27:11.814318] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T20:27:11.999421] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-23T20:27:12.107200] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T20:27:12.799444] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-23T20:27:13.599427] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-23T20:27:13.941995] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T20:27:14.399438] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-23T20:27:14.485832] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-23T20:27:14.983163] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T20:27:15.199454] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-23T20:27:15.348760] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T20:27:15.999454] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-23T20:27:16.799533] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-23T20:27:17.275821] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T20:27:17.553621] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-23T20:27:17.599419] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-23T20:27:18.089688] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T20:27:18.399460] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-23T20:27:19.199447] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-23T20:27:20.002539] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-23T20:27:20.027444] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-23T20:27:20.029437] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T20:27:20.548853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T20:27:20.799436] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-23T20:27:21.289562] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T20:27:21.591466] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T20:27:21.599975] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-23T20:27:21.601548] [INFO ] [REMOTE ] C: Full fetch complete (77528 records). [2025-10-23T20:27:21.601708] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-23T20:27:21.602530] [FATAL] [VALIDATOR ] C: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:27:21.602619] [FATAL] [MAIN ] C: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:27:21.602709] [WARN ] [MAIN ] C: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:27:21.602782] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-23T20:27:21.602873] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-23T20:27:21.602945] [INFO ] [LOCAL ] C: Starting deletion of derivative data. [2025-10-23T20:27:21.603023] [DEBUG] [LOCAL ] C: No derivative data file found to delete. [2025-10-23T20:27:21.603114] [INFO ] [MAIN ] Update Progress: 381/2367 symbols completed. C took 28.8s. Estimated remaining: 4h 6m 30s. Rate: 8.1 symbols/min [2025-10-23T20:27:21.772575] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:21.793518] [DEBUG] [LOCAL ] CACI: Loaded 22378 existing records from primary storage. [2025-10-23T20:27:21.793822] [INFO ] [MAIN ] CACI: Loaded 22378 existing records. [2025-10-23T20:27:21.964743] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:27:21.964958] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-23T20:27:21.965034] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-23T20:27:21.965239] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-23T20:27:21.965310] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-23T20:27:22.305536] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:22.399396] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-23T20:27:22.845235] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T20:27:23.199496] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-23T20:27:23.868137] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T20:27:23.980510] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T20:27:23.999389] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-23T20:27:24.799418] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-23T20:27:25.176235] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T20:27:25.599422] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-23T20:27:26.301159] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T20:27:26.399418] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-23T20:27:26.857257] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T20:27:27.199444] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-23T20:27:27.999443] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-23T20:27:28.059866] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:27:28.682852] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T20:27:28.799407] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-23T20:27:29.306396] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T20:27:29.599467] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-23T20:27:29.831471] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T20:27:29.836845] [INFO ] [REMOTE ] BZH: Full fetch complete (47225 records). [2025-10-23T20:27:29.837013] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-23T20:27:30.233365] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-23T20:27:30.233499] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-23T20:27:30.234194] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-23T20:27:30.234278] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-23T20:27:30.235564] [DEBUG] [LOCAL ] BZH: Trimmed 47225 records to 32220 (keeping 200 days of data) [2025-10-23T20:27:30.411696] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-23T20:27:30.420504] [DEBUG] [LOCAL ] BZH: Primary data saved (32220 records). [2025-10-23T20:27:30.420677] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-23T20:27:30.421810] [INFO ] [MAIN ] Update Progress: 382/2367 symbols completed. BZH took 37.8s. Estimated remaining: 4h 6m 30s. Rate: 8.1 symbols/min [2025-10-23T20:27:30.618420] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:30.664765] [DEBUG] [LOCAL ] CADE: Loaded 49685 existing records from primary storage. [2025-10-23T20:27:30.665104] [INFO ] [MAIN ] CADE: Loaded 49685 existing records. [2025-10-23T20:27:30.844499] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:27:30.856375] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-23T20:27:30.856540] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-23T20:27:30.857821] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-23T20:27:30.857744] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:27:30.858089] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-23T20:27:31.204035] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-23T20:27:31.207524] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:31.999455] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-23T20:27:32.190959] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T20:27:32.476402] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T20:27:32.799501] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-23T20:27:33.599437] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-23T20:27:33.710103] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T20:27:34.196452] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T20:27:34.399573] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-23T20:27:34.966835] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T20:27:35.199436] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-23T20:27:35.315562] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T20:27:35.319897] [INFO ] [REMOTE ] CAAP: Full fetch complete (27925 records). [2025-10-23T20:27:35.320017] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-23T20:27:35.685860] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-23T20:27:35.685990] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-23T20:27:35.686538] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-23T20:27:35.686617] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-23T20:27:35.687531] [DEBUG] [LOCAL ] CAAP: Trimmed 27925 records to 20016 (keeping 200 days of data) [2025-10-23T20:27:35.799570] [DEBUG] [LOCAL ] CAAP: Primary data saved (20016 records). [2025-10-23T20:27:35.799739] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-23T20:27:35.799847] [INFO ] [MAIN ] Update Progress: 383/2367 symbols completed. CAAP took 30.7s. Estimated remaining: 4h 6m 12s. Rate: 8.1 symbols/min [2025-10-23T20:27:35.974416] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:36.008059] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-23T20:27:36.010584] [DEBUG] [LOCAL ] CAE: Loaded 39045 existing records from primary storage. [2025-10-23T20:27:36.010863] [INFO ] [MAIN ] CAE: Loaded 39045 existing records. [2025-10-23T20:27:36.194442] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:27:36.194808] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-23T20:27:36.194885] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-23T20:27:36.195118] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-23T20:27:36.195202] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-23T20:27:36.459488] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:27:36.583186] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:36.799409] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-23T20:27:37.285140] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T20:27:37.599455] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-23T20:27:38.158032] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T20:27:38.399433] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-23T20:27:39.189891] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T20:27:39.199401] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-23T20:27:39.999418] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-23T20:27:40.024223] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T20:27:40.541017] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T20:27:40.799415] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-23T20:27:41.089043] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T20:27:41.599438] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-23T20:27:42.399437] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-23T20:27:42.732615] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T20:27:43.200727] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-23T20:27:43.202968] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T20:27:43.297784] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T20:27:43.999426] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-23T20:27:44.301732] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T20:27:44.799422] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-23T20:27:45.194036] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T20:27:45.197706] [INFO ] [REMOTE ] CACI: Full fetch complete (38468 records). [2025-10-23T20:27:45.197811] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-23T20:27:45.590674] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-23T20:27:45.590786] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-23T20:27:45.591399] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-23T20:27:45.591481] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-23T20:27:45.592368] [DEBUG] [LOCAL ] CACI: Trimmed 38468 records to 22671 (keeping 200 days of data) [2025-10-23T20:27:45.641216] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-23T20:27:45.730110] [DEBUG] [LOCAL ] CACI: Primary data saved (22671 records). [2025-10-23T20:27:45.730301] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-23T20:27:45.730434] [INFO ] [MAIN ] Update Progress: 384/2367 symbols completed. CACI took 24.1s. Estimated remaining: 4h 6m 17s. Rate: 8.1 symbols/min [2025-10-23T20:27:45.900777] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:45.901007] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-10-23T20:27:45.901095] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-10-23T20:27:45.901238] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-23T20:27:45.901331] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-23T20:27:45.901446] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-23T20:27:45.901534] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-23T20:27:46.273283] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:46.399399] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-23T20:27:46.512703] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T20:27:46.657983] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T20:27:46.660328] [INFO ] [REMOTE ] CABO: Full fetch complete (23197 records). [2025-10-23T20:27:46.660423] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-23T20:27:47.021414] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-23T20:27:47.021519] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-23T20:27:47.021992] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-23T20:27:47.022068] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-23T20:27:47.022729] [DEBUG] [LOCAL ] CABO: Trimmed 23197 records to 16738 (keeping 200 days of data) [2025-10-23T20:27:47.119829] [DEBUG] [LOCAL ] CABO: Primary data saved (16738 records). [2025-10-23T20:27:47.119987] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-23T20:27:47.120098] [INFO ] [MAIN ] Update Progress: 385/2367 symbols completed. CABO took 37.8s. Estimated remaining: 4h 5m 38s. Rate: 8.1 symbols/min [2025-10-23T20:27:47.204231] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T20:27:47.214617] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-23T20:27:47.296108] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:27:47.345012] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-23T20:27:47.345364] [INFO ] [MAIN ] CAG: Loaded 53666 existing records. [2025-10-23T20:27:47.517993] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:27:47.518242] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-23T20:27:47.518316] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-23T20:27:47.518549] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-23T20:27:47.518621] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-23T20:27:47.865464] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:27:47.999398] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-23T20:27:48.799412] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-23T20:27:49.009503] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T20:27:49.549320] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:27:49.599402] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-23T20:27:50.397403] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T20:27:50.400549] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-23T20:27:51.199449] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-23T20:27:51.271428] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T20:27:51.999489] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-23T20:27:52.217283] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:27:52.799472] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-23T20:27:52.974435] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T20:27:53.599428] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-23T20:27:54.028686] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T20:27:54.399474] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-23T20:27:54.748139] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T20:27:55.199534] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-23T20:27:55.234025] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T20:27:55.999414] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-23T20:27:56.466962] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T20:27:56.703370] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T20:27:56.799458] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-23T20:27:57.031968] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T20:27:57.599465] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-23T20:27:58.169516] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T20:27:58.303951] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T20:27:58.399463] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-23T20:27:59.199444] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-23T20:27:59.943754] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T20:27:59.999401] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-23T20:28:00.228365] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T20:28:00.799469] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-23T20:28:00.860834] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T20:28:01.599482] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-23T20:28:02.399450] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-23T20:28:02.978713] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T20:28:03.083622] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T20:28:03.199486] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-23T20:28:03.497926] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T20:28:03.999453] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-23T20:28:04.696976] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T20:28:04.799427] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-23T20:28:05.029789] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T20:28:05.038915] [INFO ] [REMOTE ] CADE: Full fetch complete (70785 records). [2025-10-23T20:28:05.039057] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-23T20:28:05.425355] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-23T20:28:05.425480] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-23T20:28:05.426376] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-23T20:28:05.426461] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-23T20:28:05.427930] [DEBUG] [LOCAL ] CADE: Trimmed 70785 records to 50063 (keeping 200 days of data) [2025-10-23T20:28:05.602972] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-23T20:28:05.732933] [DEBUG] [LOCAL ] CADE: Primary data saved (50063 records). [2025-10-23T20:28:05.733113] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-23T20:28:05.734112] [INFO ] [MAIN ] Update Progress: 386/2367 symbols completed. CADE took 35.3s. Estimated remaining: 4h 6m 28s. Rate: 8.0 symbols/min [2025-10-23T20:28:05.902739] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:05.955525] [DEBUG] [LOCAL ] CAH: Loaded 51420 existing records from primary storage. [2025-10-23T20:28:05.955878] [INFO ] [MAIN ] CAH: Loaded 51420 existing records. [2025-10-23T20:28:06.138126] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:06.138342] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-23T20:28:06.138424] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-23T20:28:06.138700] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-23T20:28:06.138775] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-23T20:28:06.408325] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-23T20:28:06.500688] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:06.755222] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T20:28:06.900489] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T20:28:07.094543] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T20:28:07.199426] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-23T20:28:07.999442] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-23T20:28:08.799445] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-23T20:28:09.383314] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T20:28:09.400794] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T20:28:09.599462] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-23T20:28:09.943461] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T20:28:10.399436] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-23T20:28:11.199492] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-23T20:28:11.828699] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-23T20:28:11.896511] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T20:28:11.999422] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-23T20:28:12.799410] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-23T20:28:12.840162] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T20:28:13.484899] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T20:28:13.486212] [INFO ] [REMOTE ] CAF: Full fetch complete (5564 records). [2025-10-23T20:28:13.486300] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-23T20:28:13.604587] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-23T20:28:13.853849] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-23T20:28:13.853954] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-23T20:28:13.854166] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-23T20:28:13.854259] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-23T20:28:13.854710] [DEBUG] [LOCAL ] CAF: Trimmed 5564 records to 3501 (keeping 200 days of data) [2025-10-23T20:28:13.875806] [DEBUG] [LOCAL ] CAF: Primary data saved (3501 records). [2025-10-23T20:28:13.876041] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-23T20:28:13.876305] [INFO ] [MAIN ] Update Progress: 387/2367 symbols completed. CAF took 28.1s. Estimated remaining: 4h 6m 24s. Rate: 8.0 symbols/min [2025-10-23T20:28:14.056414] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:14.140829] [DEBUG] [LOCAL ] CAL: Loaded 42762 existing records from primary storage. [2025-10-23T20:28:14.141591] [INFO ] [MAIN ] CAL: Loaded 42762 existing records. [2025-10-23T20:28:14.178547] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-23T20:28:14.334636] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:14.334888] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-23T20:28:14.334965] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-23T20:28:14.335219] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-23T20:28:14.335294] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-23T20:28:14.407531] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-23T20:28:14.688063] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:15.199438] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-23T20:28:15.766246] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-23T20:28:15.999452] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-23T20:28:16.526015] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T20:28:16.565206] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-23T20:28:16.799433] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-23T20:28:17.599412] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-23T20:28:17.683444] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T20:28:17.690473] [INFO ] [REMOTE ] CAE: Full fetch complete (56570 records). [2025-10-23T20:28:17.690623] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-23T20:28:18.102678] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-23T20:28:18.102814] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-23T20:28:18.103532] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-23T20:28:18.103610] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-23T20:28:18.104733] [DEBUG] [LOCAL ] CAE: Trimmed 56570 records to 39307 (keeping 200 days of data) [2025-10-23T20:28:18.320371] [DEBUG] [LOCAL ] CAE: Primary data saved (39307 records). [2025-10-23T20:28:18.320542] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-23T20:28:18.320678] [INFO ] [MAIN ] Update Progress: 388/2367 symbols completed. CAE took 42.5s. Estimated remaining: 4h 6m 2s. Rate: 8.0 symbols/min [2025-10-23T20:28:18.413986] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-23T20:28:18.498881] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:18.532119] [DEBUG] [LOCAL ] CALX: Loaded 37238 existing records from primary storage. [2025-10-23T20:28:18.532475] [INFO ] [MAIN ] CALX: Loaded 37238 existing records. [2025-10-23T20:28:18.725581] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:18.726124] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-23T20:28:18.726364] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-23T20:28:18.726848] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-23T20:28:18.726929] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-23T20:28:19.088821] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:19.131286] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-23T20:28:19.199431] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-23T20:28:19.234149] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T20:28:19.999479] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-23T20:28:20.633460] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-23T20:28:20.643398] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-23T20:28:20.643615] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-23T20:28:20.807434] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-23T20:28:21.075347] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-23T20:28:21.075520] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-23T20:28:21.076842] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-23T20:28:21.076937] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-23T20:28:21.079369] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 54056 (keeping 200 days of data) [2025-10-23T20:28:21.375901] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-23T20:28:21.474217] [DEBUG] [LOCAL ] CAG: Primary data saved (54056 records). [2025-10-23T20:28:21.474449] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-23T20:28:21.474590] [INFO ] [MAIN ] Update Progress: 389/2367 symbols completed. CAG took 34.4s. Estimated remaining: 4h 5m 32s. Rate: 8.1 symbols/min [2025-10-23T20:28:21.604581] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-23T20:28:21.657113] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:21.685191] [DEBUG] [LOCAL ] CANG: Loaded 27031 existing records from primary storage. [2025-10-23T20:28:21.685542] [INFO ] [MAIN ] CANG: Loaded 27031 existing records. [2025-10-23T20:28:21.865183] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:21.865606] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-23T20:28:21.865864] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-23T20:28:21.866163] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-23T20:28:21.866288] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-23T20:28:21.996793] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T20:28:22.274214] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:22.296235] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T20:28:22.399488] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-23T20:28:23.199398] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-23T20:28:23.558742] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T20:28:23.874071] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T20:28:23.999490] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-23T20:28:24.773126] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T20:28:24.799397] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-23T20:28:25.599424] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-23T20:28:25.668839] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T20:28:26.147348] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T20:28:26.399520] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-23T20:28:27.199484] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-23T20:28:27.435501] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T20:28:27.999423] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-23T20:28:28.489098] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-23T20:28:28.619029] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T20:28:28.799446] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-23T20:28:29.599411] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-23T20:28:29.701120] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T20:28:29.989211] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T20:28:30.399439] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-23T20:28:31.199486] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-23T20:28:31.640178] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T20:28:31.999450] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-23T20:28:32.063083] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T20:28:32.467695] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T20:28:32.799441] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-23T20:28:33.599452] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-23T20:28:33.895164] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:28:33.904432] [INFO ] [REMOTE ] CAH: Full fetch complete (74856 records). [2025-10-23T20:28:33.904593] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-23T20:28:34.308448] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-23T20:28:34.308617] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-23T20:28:34.309491] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-23T20:28:34.309587] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-23T20:28:34.311064] [DEBUG] [LOCAL ] CAH: Trimmed 74856 records to 51788 (keeping 200 days of data) [2025-10-23T20:28:34.404682] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-23T20:28:34.665814] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T20:28:34.681397] [DEBUG] [LOCAL ] CAH: Primary data saved (51788 records). [2025-10-23T20:28:34.681581] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-23T20:28:34.683082] [INFO ] [MAIN ] Update Progress: 390/2367 symbols completed. CAH took 28.9s. Estimated remaining: 4h 5m 54s. Rate: 8.0 symbols/min [2025-10-23T20:28:34.857299] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:34.864982] [DEBUG] [LOCAL ] CAPL: Loaded 5383 existing records from primary storage. [2025-10-23T20:28:34.865259] [INFO ] [MAIN ] CAPL: Loaded 5383 existing records. [2025-10-23T20:28:35.042328] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T20:28:35.067395] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:35.067911] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-23T20:28:35.068113] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-23T20:28:35.068472] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-23T20:28:35.068564] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-23T20:28:35.205301] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-23T20:28:35.433391] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:35.989254] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T20:28:35.999424] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-23T20:28:36.799413] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-23T20:28:37.072721] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T20:28:37.599467] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-23T20:28:37.688151] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T20:28:37.811579] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T20:28:38.399441] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-23T20:28:38.466933] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T20:28:39.199488] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-23T20:28:39.963488] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T20:28:39.999443] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-23T20:28:40.799426] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-23T20:28:40.847948] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T20:28:41.007955] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T20:28:41.599449] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-23T20:28:42.153105] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T20:28:42.399432] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-23T20:28:43.122698] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T20:28:43.199411] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-23T20:28:43.850382] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T20:28:43.861382] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T20:28:43.999411] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-23T20:28:44.799456] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-23T20:28:45.477341] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T20:28:45.483353] [INFO ] [REMOTE ] CALX: Full fetch complete (54119 records). [2025-10-23T20:28:45.483523] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-23T20:28:45.604560] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-23T20:28:45.864141] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-23T20:28:45.864255] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-23T20:28:45.864995] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-23T20:28:45.865074] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-23T20:28:45.866168] [DEBUG] [LOCAL ] CALX: Trimmed 54119 records to 37506 (keeping 200 days of data) [2025-10-23T20:28:46.074699] [DEBUG] [LOCAL ] CALX: Primary data saved (37506 records). [2025-10-23T20:28:46.074962] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-23T20:28:46.075089] [INFO ] [MAIN ] Update Progress: 391/2367 symbols completed. CALX took 27.8s. Estimated remaining: 4h 6m 6s. Rate: 8.0 symbols/min [2025-10-23T20:28:46.239220] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T20:28:46.267291] [INFO ] [REMOTE ] CANG: Full fetch complete (39315 records). [2025-10-23T20:28:46.271666] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-23T20:28:46.271452] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:46.411916] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-23T20:28:46.639242] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-23T20:28:46.659357] [INFO ] [MAIN ] CARR: Loaded 53603 existing records. [2025-10-23T20:28:46.768601] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-23T20:28:46.789297] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-23T20:28:46.789954] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-23T20:28:46.790069] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-23T20:28:46.834742] [DEBUG] [LOCAL ] CANG: Trimmed 39315 records to 27174 (keeping 200 days of data) [2025-10-23T20:28:46.871289] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:46.871849] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-23T20:28:46.871931] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-23T20:28:46.872204] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-23T20:28:46.872278] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-23T20:28:47.320314] [DEBUG] [LOCAL ] CANG: Primary data saved (27174 records). [2025-10-23T20:28:47.326242] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-23T20:28:47.371465] [INFO ] [MAIN ] Update Progress: 392/2367 symbols completed. CANG took 25.9s. Estimated remaining: 4h 5m 28s. Rate: 8.0 symbols/min [2025-10-23T20:28:47.408425] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:47.418154] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-23T20:28:47.582188] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:47.592785] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T20:28:47.626833] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-23T20:28:47.671311] [DEBUG] [LOCAL ] CARS: Loaded 39772 existing records from primary storage. [2025-10-23T20:28:47.671733] [INFO ] [MAIN ] CARS: Loaded 39772 existing records. [2025-10-23T20:28:47.855959] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:47.856192] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-23T20:28:47.856269] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-23T20:28:47.856773] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-23T20:28:47.856849] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-23T20:28:48.009538] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-23T20:28:48.212785] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:48.799461] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-23T20:28:49.085846] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T20:28:49.474909] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T20:28:49.599400] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-23T20:28:50.369670] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T20:28:50.399404] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-23T20:28:51.190069] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T20:28:51.199393] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-23T20:28:51.585749] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T20:28:51.999424] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-23T20:28:52.777505] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T20:28:52.784792] [INFO ] [REMOTE ] CAL: Full fetch complete (61889 records). [2025-10-23T20:28:52.784919] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-23T20:28:52.805940] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-23T20:28:53.166243] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-23T20:28:53.166351] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-23T20:28:53.167136] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-23T20:28:53.167214] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-23T20:28:53.168581] [DEBUG] [LOCAL ] CAL: Trimmed 61889 records to 43036 (keeping 200 days of data) [2025-10-23T20:28:53.425816] [DEBUG] [LOCAL ] CAL: Primary data saved (43036 records). [2025-10-23T20:28:53.426113] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-23T20:28:53.427276] [INFO ] [MAIN ] Update Progress: 393/2367 symbols completed. CAL took 39.6s. Estimated remaining: 4h 5m 13s. Rate: 8.0 symbols/min [2025-10-23T20:28:53.571954] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:28:53.620930] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-23T20:28:53.625488] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:28:53.681306] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-23T20:28:53.681786] [INFO ] [MAIN ] CAT: Loaded 52953 existing records. [2025-10-23T20:28:53.860254] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:28:53.860496] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-23T20:28:53.860573] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-23T20:28:53.860853] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-23T20:28:53.860926] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-23T20:28:54.206182] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:28:54.346292] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T20:28:54.399457] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-23T20:28:54.685168] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T20:28:55.199420] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-23T20:28:55.999494] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-23T20:28:56.694713] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T20:28:56.758425] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T20:28:56.799447] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-23T20:28:57.309124] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-23T20:28:57.599452] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-23T20:28:58.399455] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-23T20:28:59.199440] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-23T20:28:59.243788] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-23T20:28:59.867353] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-23T20:28:59.875959] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-23T20:28:59.999424] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-23T20:29:00.799465] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-23T20:29:01.154210] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-23T20:29:01.599516] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-23T20:29:02.083692] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T20:29:02.399424] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-23T20:29:02.594553] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-23T20:29:03.199414] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-23T20:29:03.417771] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:29:03.999416] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-23T20:29:04.092986] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T20:29:04.094422] [INFO ] [REMOTE ] CAPL: Full fetch complete (8717 records). [2025-10-23T20:29:04.094515] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-23T20:29:04.445674] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-23T20:29:04.445797] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-23T20:29:04.446042] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-23T20:29:04.446119] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-23T20:29:04.446529] [DEBUG] [LOCAL ] CAPL: Trimmed 8717 records to 5425 (keeping 200 days of data) [2025-10-23T20:29:04.478873] [DEBUG] [LOCAL ] CAPL: Primary data saved (5425 records). [2025-10-23T20:29:04.478967] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-23T20:29:04.479048] [INFO ] [MAIN ] Update Progress: 394/2367 symbols completed. CAPL took 29.8s. Estimated remaining: 4h 5m 24s. Rate: 8.0 symbols/min [2025-10-23T20:29:04.647722] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:04.656037] [DEBUG] [LOCAL ] CATO: Loaded 6647 existing records from primary storage. [2025-10-23T20:29:04.656272] [INFO ] [MAIN ] CATO: Loaded 6647 existing records. [2025-10-23T20:29:04.811116] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-23T20:29:04.849840] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:04.850320] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-23T20:29:04.850396] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-23T20:29:04.850564] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-23T20:29:04.850636] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-23T20:29:05.233952] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:05.263002] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-10-23T20:29:05.507499] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T20:29:05.599401] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-23T20:29:06.399408] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-23T20:29:06.487332] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T20:29:06.742689] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T20:29:07.199430] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-23T20:29:07.999460] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-23T20:29:08.097865] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T20:29:08.502535] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T20:29:08.799430] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-23T20:29:09.599428] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-23T20:29:09.986848] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T20:29:10.419531] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-23T20:29:10.439258] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T20:29:11.199445] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-23T20:29:11.400540] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T20:29:11.825197] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-23T20:29:11.999415] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-23T20:29:12.799430] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-23T20:29:13.208811] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T20:29:13.599510] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-23T20:29:14.093755] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T20:29:14.399412] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-23T20:29:14.863195] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T20:29:14.897319] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T20:29:15.199423] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-23T20:29:15.999433] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-23T20:29:16.804809] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-23T20:29:16.819427] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T20:29:16.880323] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-23T20:29:17.599438] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-23T20:29:17.725195] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T20:29:17.765609] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T20:29:17.774891] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-23T20:29:17.775042] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-23T20:29:18.165891] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-23T20:29:18.166001] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-23T20:29:18.166915] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-23T20:29:18.166993] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-23T20:29:18.168430] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53993 (keeping 200 days of data) [2025-10-23T20:29:18.400360] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-23T20:29:18.505842] [DEBUG] [LOCAL ] CARR: Primary data saved (53993 records). [2025-10-23T20:29:18.506052] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-23T20:29:18.506194] [INFO ] [MAIN ] Update Progress: 395/2367 symbols completed. CARR took 32.4s. Estimated remaining: 4h 5m 49s. Rate: 8.0 symbols/min [2025-10-23T20:29:18.671057] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:18.717291] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-23T20:29:18.717666] [INFO ] [MAIN ] CAVA: Loaded 53551 existing records. [2025-10-23T20:29:18.895152] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:18.895380] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-23T20:29:18.895458] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-23T20:29:18.895806] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-23T20:29:18.895880] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-23T20:29:19.210037] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-23T20:29:19.251446] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:19.272167] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T20:29:19.280194] [INFO ] [REMOTE ] CARS: Full fetch complete (56611 records). [2025-10-23T20:29:19.280338] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-23T20:29:19.666769] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-23T20:29:19.666891] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-23T20:29:19.667701] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-23T20:29:19.667784] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-23T20:29:19.669379] [DEBUG] [LOCAL ] CARS: Trimmed 56611 records to 40089 (keeping 200 days of data) [2025-10-23T20:29:19.902430] [DEBUG] [LOCAL ] CARS: Primary data saved (40089 records). [2025-10-23T20:29:19.902636] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-23T20:29:19.902807] [INFO ] [MAIN ] Update Progress: 396/2367 symbols completed. CARS took 32.5s. Estimated remaining: 4h 5m 11s. Rate: 8.0 symbols/min [2025-10-23T20:29:20.005519] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-23T20:29:20.078678] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:20.121749] [DEBUG] [LOCAL ] CB: Loaded 49964 existing records from primary storage. [2025-10-23T20:29:20.122102] [INFO ] [MAIN ] CB: Loaded 49964 existing records. [2025-10-23T20:29:20.230845] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T20:29:20.312145] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:20.313180] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-23T20:29:20.313315] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-23T20:29:20.313746] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-23T20:29:20.313826] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-23T20:29:20.684401] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:20.722332] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-23T20:29:20.799426] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-23T20:29:21.599451] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-23T20:29:22.290754] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-23T20:29:22.399413] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-23T20:29:22.586361] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-23T20:29:22.712518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T20:29:23.199449] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-23T20:29:23.999398] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-23T20:29:24.366514] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T20:29:24.799415] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-23T20:29:24.977685] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T20:29:25.599445] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-23T20:29:26.151690] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T20:29:26.160930] [INFO ] [REMOTE ] CAT: Full fetch complete (76870 records). [2025-10-23T20:29:26.161102] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-23T20:29:26.422710] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-23T20:29:26.554826] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-23T20:29:26.554926] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-23T20:29:26.555814] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-23T20:29:26.555892] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-23T20:29:26.557316] [DEBUG] [LOCAL ] CAT: Trimmed 76870 records to 53317 (keeping 200 days of data) [2025-10-23T20:29:26.892257] [DEBUG] [LOCAL ] CAT: Primary data saved (53317 records). [2025-10-23T20:29:26.892445] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-23T20:29:26.892557] [INFO ] [MAIN ] Update Progress: 397/2367 symbols completed. CAT took 33.5s. Estimated remaining: 4h 5m 2s. Rate: 8.0 symbols/min [2025-10-23T20:29:27.203538] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-23T20:29:27.214747] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-23T20:29:27.275689] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T20:29:27.608341] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T20:29:27.999462] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-23T20:29:28.799501] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-23T20:29:29.503213] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-23T20:29:29.599406] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-23T20:29:29.645551] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T20:29:30.351073] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-23T20:29:30.399394] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-23T20:29:31.199451] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-23T20:29:31.903315] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-23T20:29:31.999388] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-23T20:29:32.194264] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-23T20:29:32.432366] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T20:29:32.799426] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-23T20:29:33.370523] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T20:29:33.599451] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-23T20:29:34.214634] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-23T20:29:34.399486] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-23T20:29:35.199474] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-23T20:29:35.220326] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-23T20:29:35.222795] [INFO ] [REMOTE ] CATO: Full fetch complete (10626 records). [2025-10-23T20:29:35.223005] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-23T20:29:35.601030] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-23T20:29:35.601217] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-23T20:29:35.610476] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-23T20:29:35.623311] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-23T20:29:35.629027] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-23T20:29:35.629191] [DEBUG] [LOCAL ] CATO: Trimmed 10626 records to 6677 (keeping 200 days of data) [2025-10-23T20:29:35.679002] [DEBUG] [LOCAL ] CATO: Primary data saved (6677 records). [2025-10-23T20:29:35.679173] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-23T20:29:35.679338] [INFO ] [MAIN ] Update Progress: 398/2367 symbols completed. CATO took 31.2s. Estimated remaining: 4h 5m 1s. Rate: 8.0 symbols/min [2025-10-23T20:29:35.999444] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-23T20:29:37.565736] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-23T20:29:37.577325] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-23T20:29:38.546479] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-23T20:29:38.557748] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-23T20:29:40.195976] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-23T20:29:40.207480] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-23T20:29:40.423183] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:29:40.434042] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-23T20:29:42.331436] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T20:29:42.342581] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-23T20:29:42.431444] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-23T20:29:42.442960] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-23T20:29:44.600336] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-23T20:29:44.609425] [INFO ] [REMOTE ] CB: Full fetch complete (72874 records). [2025-10-23T20:29:44.609602] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-23T20:29:45.030545] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-23T20:29:45.032022] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-23T20:29:45.032312] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-23T20:29:45.041825] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-23T20:29:45.042354] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-23T20:29:45.042954] [INFO ] [REMOTE ] CAVA: Full fetch complete (77449 records). [2025-10-23T20:29:45.043329] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-23T20:29:45.049483] [DEBUG] [LOCAL ] CB: Trimmed 72874 records to 50346 (keeping 200 days of data) [2025-10-23T20:29:45.687634] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-23T20:29:45.696902] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-23T20:29:45.710382] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-23T20:29:45.712822] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-23T20:29:45.719550] [DEBUG] [LOCAL ] CAVA: Trimmed 77449 records to 53932 (keeping 200 days of data) [2025-10-23T20:29:45.883606] [DEBUG] [LOCAL ] CB: Primary data saved (50346 records). [2025-10-23T20:29:45.889701] [INFO ] [MAIN ] CB: Full history saved. [2025-10-23T20:29:45.906981] [INFO ] [MAIN ] Update Progress: 399/2367 symbols completed. CB took 26.0s. Estimated remaining: 4h 5m 7s. Rate: 8.0 symbols/min [2025-10-23T20:29:46.106393] [DEBUG] [LOCAL ] CAVA: Primary data saved (53932 records). [2025-10-23T20:29:46.106562] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-23T20:29:46.106701] [INFO ] [MAIN ] Update Progress: 400/2367 symbols completed. CAVA took 27.6s. Estimated remaining: 4h 4m 24s. Rate: 8.0 symbols/min [2025-10-23T20:29:46.774203] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:46.777788] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:46.714154] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:46.784180] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-23T20:29:46.811939] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:46.812025] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-23T20:29:46.813028] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-23T20:29:46.816334] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-23T20:29:46.816714] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-23T20:29:46.817027] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-23T20:29:46.819635] [DEBUG] [LOCAL ] CBNA: Loaded 2864 existing records from primary storage. [2025-10-23T20:29:46.819977] [INFO ] [MAIN ] CBNA: Loaded 2864 existing records. [2025-10-23T20:29:46.885359] [DEBUG] [LOCAL ] CBAN: Loaded 10154 existing records from primary storage. [2025-10-23T20:29:46.976954] [INFO ] [MAIN ] CBAN: Loaded 10154 existing records. [2025-10-23T20:29:47.026563] [DEBUG] [LOCAL ] CBL: Loaded 16048 existing records from primary storage. [2025-10-23T20:29:47.035914] [INFO ] [MAIN ] CBL: Loaded 16048 existing records. [2025-10-23T20:29:47.519319] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:47.602519] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-23T20:29:47.613952] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-23T20:29:47.686377] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-23T20:29:47.686564] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-23T20:29:47.775510] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:47.838782] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-23T20:29:47.903385] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-23T20:29:47.847276] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:47.915915] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:47.916161] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-23T20:29:47.937220] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-23T20:29:47.937293] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-23T20:29:47.952541] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-23T20:29:47.952822] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-23T20:29:47.953204] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-23T20:29:47.969201] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-23T20:29:48.385115] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:29:48.439026] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-23T20:29:48.458599] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:29:48.592380] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-23T20:29:48.608353] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:29:48.645231] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-23T20:29:48.730729] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-23T20:29:48.816786] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-23T20:29:48.842951] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-23T20:29:48.849605] [INFO ] [MAIN ] Update Progress: 401/2367 symbols completed. CBO took 2.7s. Estimated remaining: 4h 3m 53s. Rate: 8.1 symbols/min [2025-10-23T20:29:48.892611] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:48.967622] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-23T20:29:49.059174] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:49.073790] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:49.082907] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-23T20:29:49.083120] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-23T20:29:49.207595] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:29:49.251500] [DEBUG] [LOCAL ] CBRE: Loaded 50278 existing records from primary storage. [2025-10-23T20:29:49.251902] [INFO ] [MAIN ] CBRE: Loaded 50278 existing records. [2025-10-23T20:29:49.422494] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:29:49.422745] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-23T20:29:49.422828] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-23T20:29:49.423166] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-23T20:29:49.423241] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-23T20:29:49.786762] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:29:49.787126] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-23T20:29:49.903451] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T20:29:49.905484] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-23T20:29:50.123194] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T20:29:50.126141] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-23T20:29:50.330972] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T20:29:50.335235] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-23T20:29:50.439789] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T20:29:50.441169] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-23T20:29:51.051843] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T20:29:51.053351] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-23T20:29:51.110831] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T20:29:51.114233] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-23T20:29:51.489172] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T20:29:51.493844] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-23T20:29:51.752423] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T20:29:51.754050] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T20:29:51.755552] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-23T20:29:51.999426] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-23T20:29:52.224521] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T20:29:52.521720] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T20:29:52.530826] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T20:29:52.799424] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-23T20:29:53.599413] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-23T20:29:53.882308] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T20:29:53.911622] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T20:29:54.399434] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-23T20:29:54.881866] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T20:29:55.125767] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T20:29:55.199421] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-23T20:29:55.745626] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-23T20:29:55.999447] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-23T20:29:56.657277] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-23T20:29:56.799418] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-23T20:29:57.599419] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-23T20:29:57.977215] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T20:29:58.399467] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-23T20:29:59.199407] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-23T20:29:59.362696] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T20:29:59.460099] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T20:29:59.999429] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-23T20:30:00.271322] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T20:30:00.654529] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T20:30:00.799446] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-23T20:30:01.599485] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-23T20:30:02.399412] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-23T20:30:02.495137] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T20:30:02.496076] [INFO ] [REMOTE ] CBNA: Full fetch complete (4280 records). [2025-10-23T20:30:02.496163] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-23T20:30:02.496552] [FATAL] [VALIDATOR ] CBNA: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:30:02.496631] [FATAL] [MAIN ] CBNA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:30:02.496735] [WARN ] [MAIN ] CBNA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:30:02.496812] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-23T20:30:02.496910] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-10-23T20:30:02.496985] [INFO ] [LOCAL ] CBNA: Starting deletion of derivative data. [2025-10-23T20:30:02.497149] [DEBUG] [LOCAL ] CBNA: Deleted derivative data file. [2025-10-23T20:30:02.497258] [INFO ] [MAIN ] Update Progress: 402/2367 symbols completed. CBNA took 16.4s. Estimated remaining: 4h 4m 16s. Rate: 8.0 symbols/min [2025-10-23T20:30:02.663819] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:02.712573] [DEBUG] [LOCAL ] CBT: Loaded 30925 existing records from primary storage. [2025-10-23T20:30:02.712886] [INFO ] [MAIN ] CBT: Loaded 30925 existing records. [2025-10-23T20:30:02.885746] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:30:02.885896] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-23T20:30:02.885970] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-23T20:30:02.886173] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-23T20:30:02.886240] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-23T20:30:03.203386] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-23T20:30:03.238534] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:03.620976] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-23T20:30:03.800942] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T20:30:03.999457] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-23T20:30:04.423845] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T20:30:04.799425] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-23T20:30:05.271847] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T20:30:05.599431] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-23T20:30:06.022694] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T20:30:06.399424] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-23T20:30:06.540616] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-23T20:30:07.199426] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-23T20:30:07.455394] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T20:30:07.999432] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-23T20:30:08.808134] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-23T20:30:08.812361] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T20:30:08.829342] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T20:30:08.833138] [INFO ] [REMOTE ] CBL: Full fetch complete (24732 records). [2025-10-23T20:30:08.833272] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-23T20:30:09.239218] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-23T20:30:09.239348] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-23T20:30:09.239917] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-23T20:30:09.240015] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-23T20:30:09.240791] [DEBUG] [LOCAL ] CBL: Trimmed 24732 records to 16114 (keeping 200 days of data) [2025-10-23T20:30:09.333522] [DEBUG] [LOCAL ] CBL: Primary data saved (16114 records). [2025-10-23T20:30:09.333713] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-23T20:30:09.333844] [INFO ] [MAIN ] Update Progress: 403/2367 symbols completed. CBL took 23.2s. Estimated remaining: 4h 4m 5s. Rate: 8.0 symbols/min [2025-10-23T20:30:09.509762] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:09.529363] [DEBUG] [LOCAL ] CBU: Loaded 22633 existing records from primary storage. [2025-10-23T20:30:09.529635] [INFO ] [MAIN ] CBU: Loaded 22633 existing records. [2025-10-23T20:30:09.604710] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-23T20:30:09.719048] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:30:09.719248] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-23T20:30:09.719322] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-23T20:30:09.719559] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-23T20:30:09.719636] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-23T20:30:09.825081] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T20:30:10.073316] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:10.399462] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-23T20:30:11.199413] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-23T20:30:11.262685] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T20:30:11.265089] [INFO ] [REMOTE ] CBAN: Full fetch complete (16261 records). [2025-10-23T20:30:11.265273] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-23T20:30:11.352671] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T20:30:11.645051] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-23T20:30:11.645150] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-23T20:30:11.645515] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-23T20:30:11.645613] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-23T20:30:11.646221] [DEBUG] [LOCAL ] CBAN: Trimmed 16261 records to 10233 (keeping 200 days of data) [2025-10-23T20:30:11.705233] [DEBUG] [LOCAL ] CBAN: Primary data saved (10233 records). [2025-10-23T20:30:11.705388] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-23T20:30:11.705517] [INFO ] [MAIN ] Update Progress: 404/2367 symbols completed. CBAN took 25.6s. Estimated remaining: 4h 3m 33s. Rate: 8.1 symbols/min [2025-10-23T20:30:11.887662] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:11.888009] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-23T20:30:11.888088] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-23T20:30:11.888226] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-23T20:30:11.888319] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-23T20:30:11.888433] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-23T20:30:11.888521] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-23T20:30:12.003971] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-23T20:30:12.263451] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:12.799399] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-23T20:30:13.074105] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:30:13.524387] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T20:30:13.599391] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-23T20:30:14.285615] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T20:30:14.399410] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-23T20:30:15.165475] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T20:30:15.199392] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-23T20:30:15.348286] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T20:30:15.999444] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-23T20:30:16.792519] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-23T20:30:16.799509] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-23T20:30:17.131785] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:30:17.132169] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-23T20:30:17.132267] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:30:17.132369] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-23T20:30:17.132460] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:30:17.132552] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-23T20:30:17.132706] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-23T20:30:17.132796] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-23T20:30:17.132961] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-23T20:30:17.133080] [INFO ] [MAIN ] Update Progress: 405/2367 symbols completed. CBX took 5.4s. Estimated remaining: 4h 3m 16s. Rate: 8.1 symbols/min [2025-10-23T20:30:17.299888] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:17.330898] [DEBUG] [LOCAL ] CBZ: Loaded 34267 existing records from primary storage. [2025-10-23T20:30:17.331239] [INFO ] [MAIN ] CBZ: Loaded 34267 existing records. [2025-10-23T20:30:17.507506] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:30:17.507742] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-23T20:30:17.507840] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-23T20:30:17.508134] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-23T20:30:17.508212] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-23T20:30:17.602134] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-23T20:30:17.887107] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:17.912886] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T20:30:18.399469] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-23T20:30:19.068373] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T20:30:19.199422] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-23T20:30:19.850497] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T20:30:19.999437] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-23T20:30:20.744718] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T20:30:20.799442] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-23T20:30:20.862631] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T20:30:21.599469] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-23T20:30:22.399412] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-23T20:30:22.593995] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T20:30:22.911090] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T20:30:23.199442] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-23T20:30:23.552424] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T20:30:23.999473] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-23T20:30:24.802350] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-23T20:30:24.808031] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T20:30:25.421932] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T20:30:25.599437] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-23T20:30:25.863489] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T20:30:26.399474] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-23T20:30:26.707167] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T20:30:26.714213] [INFO ] [REMOTE ] CBT: Full fetch complete (45806 records). [2025-10-23T20:30:26.714446] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-23T20:30:27.211573] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-23T20:30:27.241815] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-23T20:30:27.241989] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-23T20:30:27.243442] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-23T20:30:27.243775] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-23T20:30:27.245426] [DEBUG] [LOCAL ] CBT: Trimmed 45806 records to 31110 (keeping 200 days of data) [2025-10-23T20:30:27.493870] [DEBUG] [LOCAL ] CBT: Primary data saved (31110 records). [2025-10-23T20:30:27.494058] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-23T20:30:27.494181] [INFO ] [MAIN ] Update Progress: 406/2367 symbols completed. CBT took 25.0s. Estimated remaining: 4h 3m 23s. Rate: 8.1 symbols/min [2025-10-23T20:30:27.681572] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:27.736957] [DEBUG] [LOCAL ] CC: Loaded 53015 existing records from primary storage. [2025-10-23T20:30:27.737400] [INFO ] [MAIN ] CC: Loaded 53015 existing records. [2025-10-23T20:30:27.928303] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:30:27.928549] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-23T20:30:27.928628] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-23T20:30:27.929037] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-23T20:30:27.929114] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-23T20:30:28.006883] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-23T20:30:28.294966] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:28.319325] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-23T20:30:28.328328] [INFO ] [REMOTE ] CBRE: Full fetch complete (73766 records). [2025-10-23T20:30:28.328522] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-23T20:30:28.688794] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T20:30:28.761132] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-23T20:30:28.761267] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-23T20:30:28.762287] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-23T20:30:28.762372] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-23T20:30:28.763984] [DEBUG] [LOCAL ] CBRE: Trimmed 73766 records to 50665 (keeping 200 days of data) [2025-10-23T20:30:28.815441] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-23T20:30:29.071247] [DEBUG] [LOCAL ] CBRE: Primary data saved (50665 records). [2025-10-23T20:30:29.071428] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-23T20:30:29.071542] [INFO ] [MAIN ] Update Progress: 407/2367 symbols completed. CBRE took 40.1s. Estimated remaining: 4h 2m 47s. Rate: 8.1 symbols/min [2025-10-23T20:30:29.242922] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:29.290951] [DEBUG] [LOCAL ] CCI: Loaded 53109 existing records from primary storage. [2025-10-23T20:30:29.291305] [INFO ] [MAIN ] CCI: Loaded 53109 existing records. [2025-10-23T20:30:29.481171] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:30:29.481399] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-23T20:30:29.481472] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-23T20:30:29.481822] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-23T20:30:29.481895] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-23T20:30:29.603784] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-23T20:30:29.819384] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T20:30:29.904806] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:30.399446] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-23T20:30:30.700909] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T20:30:31.199456] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-23T20:30:31.294471] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T20:30:31.999488] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-23T20:30:32.137396] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T20:30:32.799524] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-23T20:30:32.951458] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T20:30:33.146858] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T20:30:33.599463] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-23T20:30:34.399435] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-23T20:30:34.803526] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T20:30:35.070888] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T20:30:35.199440] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-23T20:30:35.999441] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-23T20:30:36.357771] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T20:30:36.799454] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-23T20:30:37.139566] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T20:30:37.599482] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-23T20:30:37.752038] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T20:30:38.399435] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-23T20:30:39.199413] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-23T20:30:39.656386] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-23T20:30:39.801506] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T20:30:39.999411] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-23T20:30:40.063390] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-10-23T20:30:40.533439] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T20:30:40.799429] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-23T20:30:41.599404] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-23T20:30:42.133677] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T20:30:42.399439] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-23T20:30:42.503146] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T20:30:42.583034] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T20:30:43.199476] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-23T20:30:43.999480] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-23T20:30:44.200367] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T20:30:44.799419] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-23T20:30:45.146049] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T20:30:45.599429] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-23T20:30:45.667882] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T20:30:46.399418] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-23T20:30:46.530001] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T20:30:47.199476] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-23T20:30:47.612141] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T20:30:47.831465] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T20:30:47.840902] [INFO ] [REMOTE ] CBZ: Full fetch complete (46430 records). [2025-10-23T20:30:47.841061] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-23T20:30:48.002785] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-23T20:30:48.230482] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-23T20:30:48.230600] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-23T20:30:48.231320] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-23T20:30:48.231398] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-23T20:30:48.232669] [DEBUG] [LOCAL ] CBZ: Trimmed 46430 records to 34489 (keeping 200 days of data) [2025-10-23T20:30:48.442064] [DEBUG] [LOCAL ] CBZ: Primary data saved (34489 records). [2025-10-23T20:30:48.442230] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-23T20:30:48.442390] [INFO ] [MAIN ] Update Progress: 408/2367 symbols completed. CBZ took 31.3s. Estimated remaining: 4h 3m 37s. Rate: 8.0 symbols/min [2025-10-23T20:30:48.611272] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:48.611475] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-23T20:30:48.611555] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-23T20:30:48.611662] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-23T20:30:48.611736] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-23T20:30:48.611830] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-23T20:30:48.611899] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-23T20:30:48.805490] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-23T20:30:48.977270] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:49.258456] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-23T20:30:49.599492] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-23T20:30:50.153328] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-23T20:30:50.158419] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T20:30:50.170352] [INFO ] [REMOTE ] CBU: Full fetch complete (32731 records). [2025-10-23T20:30:50.170488] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-23T20:30:50.404704] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-23T20:30:50.544596] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-23T20:30:50.544733] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-23T20:30:50.545296] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-23T20:30:50.545372] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-23T20:30:50.546331] [DEBUG] [LOCAL ] CBU: Trimmed 32731 records to 22766 (keeping 200 days of data) [2025-10-23T20:30:50.680469] [DEBUG] [LOCAL ] CBU: Primary data saved (22766 records). [2025-10-23T20:30:50.680621] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-23T20:30:50.680758] [INFO ] [MAIN ] Update Progress: 409/2367 symbols completed. CBU took 41.3s. Estimated remaining: 4h 3m 4s. Rate: 8.1 symbols/min [2025-10-23T20:30:50.846237] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:30:50.861432] [DEBUG] [LOCAL ] CCIF: Loaded 15143 existing records from primary storage. [2025-10-23T20:30:50.861694] [INFO ] [MAIN ] CCIF: Loaded 15143 existing records. [2025-10-23T20:30:51.036058] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:30:51.036335] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-23T20:30:51.036462] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-23T20:30:51.036724] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-23T20:30:51.036796] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-23T20:30:51.140421] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T20:30:51.217009] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-23T20:30:51.404782] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:30:51.520024] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T20:30:51.702566] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-23T20:30:51.999420] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-23T20:30:52.587502] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T20:30:52.799413] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-23T20:30:53.335614] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-23T20:30:53.599454] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-23T20:30:54.399490] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-23T20:30:54.986082] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T20:30:55.199409] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-23T20:30:55.639379] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T20:30:55.652935] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T20:30:55.999458] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-23T20:30:56.799457] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-23T20:30:57.106025] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T20:30:57.599419] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-23T20:30:57.964614] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T20:30:58.399450] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-23T20:30:58.859710] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T20:30:59.199443] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-23T20:30:59.666842] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T20:30:59.676070] [INFO ] [REMOTE ] CCI: Full fetch complete (77101 records). [2025-10-23T20:30:59.676243] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-23T20:30:59.779829] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T20:31:00.013202] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-23T20:31:00.072443] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-23T20:31:00.072557] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-23T20:31:00.073485] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-23T20:31:00.073566] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-23T20:31:00.075137] [DEBUG] [LOCAL ] CCI: Trimmed 77101 records to 53497 (keeping 200 days of data) [2025-10-23T20:31:00.414475] [DEBUG] [LOCAL ] CCI: Primary data saved (53497 records). [2025-10-23T20:31:00.414796] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-23T20:31:00.414914] [INFO ] [MAIN ] Update Progress: 410/2367 symbols completed. CCI took 31.3s. Estimated remaining: 4h 3m 8s. Rate: 8.0 symbols/min [2025-10-23T20:31:00.579075] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:00.624790] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-23T20:31:00.625131] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-23T20:31:00.799130] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:00.799364] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-23T20:31:00.799434] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-23T20:31:00.799564] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-23T20:31:00.800436] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-23T20:31:00.800512] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-23T20:31:01.156227] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:01.137599] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T20:31:01.599447] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-23T20:31:02.399495] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-23T20:31:02.860473] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T20:31:02.861441] [INFO ] [REMOTE ] CCIA: Full fetch complete (2181 records). [2025-10-23T20:31:02.861528] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-23T20:31:02.990830] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-23T20:31:03.052030] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T20:31:03.052232] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:31:03.052305] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:31:03.052378] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-23T20:31:03.052467] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-23T20:31:03.052538] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-23T20:31:03.052617] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-23T20:31:03.052727] [INFO ] [MAIN ] Update Progress: 411/2367 symbols completed. CCIA took 14.6s. Estimated remaining: 4h 2m 37s. Rate: 8.1 symbols/min [2025-10-23T20:31:03.199936] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-23T20:31:03.218994] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:03.261882] [DEBUG] [LOCAL ] CCK: Loaded 46505 existing records from primary storage. [2025-10-23T20:31:03.262236] [INFO ] [MAIN ] CCK: Loaded 46505 existing records. [2025-10-23T20:31:03.435156] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:03.435369] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-23T20:31:03.435450] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-23T20:31:03.435748] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-23T20:31:03.435822] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-23T20:31:03.783201] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:03.999402] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-23T20:31:04.298944] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-23T20:31:04.799410] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-23T20:31:04.890305] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-23T20:31:05.599426] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-23T20:31:06.052261] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T20:31:06.053316] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T20:31:06.399506] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-23T20:31:07.199428] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-23T20:31:07.449207] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T20:31:07.999469] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-23T20:31:08.326541] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T20:31:08.799446] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-23T20:31:09.350606] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-23T20:31:09.599447] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-23T20:31:09.887835] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T20:31:10.399415] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-23T20:31:10.508841] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T20:31:10.845848] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T20:31:10.854975] [INFO ] [REMOTE ] CC: Full fetch complete (76222 records). [2025-10-23T20:31:10.855142] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-23T20:31:11.202500] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-23T20:31:11.246197] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-23T20:31:11.246302] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-23T20:31:11.247284] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-23T20:31:11.247368] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-23T20:31:11.249035] [DEBUG] [LOCAL ] CC: Trimmed 76222 records to 53392 (keeping 200 days of data) [2025-10-23T20:31:11.565898] [DEBUG] [LOCAL ] CC: Primary data saved (53392 records). [2025-10-23T20:31:11.566109] [INFO ] [MAIN ] CC: Full history saved. [2025-10-23T20:31:11.566227] [INFO ] [MAIN ] Update Progress: 412/2367 symbols completed. CC took 44.1s. Estimated remaining: 4h 2m 35s. Rate: 8.1 symbols/min [2025-10-23T20:31:11.758536] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:11.808270] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-23T20:31:11.808604] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-23T20:31:11.985362] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:11.985553] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-23T20:31:11.985626] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-23T20:31:11.985874] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-23T20:31:11.985951] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-23T20:31:12.016417] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-23T20:31:12.348871] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:12.382132] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T20:31:12.408697] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T20:31:12.799435] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-23T20:31:13.599448] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-23T20:31:14.043858] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T20:31:14.220923] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-23T20:31:14.399408] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-23T20:31:15.199428] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-23T20:31:15.602625] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T20:31:15.999430] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-23T20:31:16.102624] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-23T20:31:16.804601] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-23T20:31:16.821031] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T20:31:17.599433] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-23T20:31:18.296028] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-23T20:31:18.399424] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-23T20:31:19.199417] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-23T20:31:19.237340] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-23T20:31:19.495366] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T20:31:19.527072] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T20:31:19.999490] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-23T20:31:20.799482] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-23T20:31:21.575632] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-23T20:31:21.599396] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-23T20:31:22.300995] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-23T20:31:22.399485] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-23T20:31:23.199505] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-23T20:31:23.391732] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-23T20:31:23.412749] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T20:31:23.416227] [INFO ] [REMOTE ] CCIF: Full fetch complete (21871 records). [2025-10-23T20:31:23.416345] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-23T20:31:23.800436] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-23T20:31:23.800712] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-23T20:31:23.801738] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-23T20:31:23.801822] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-23T20:31:23.803111] [DEBUG] [LOCAL ] CCIF: Trimmed 21871 records to 15230 (keeping 200 days of data) [2025-10-23T20:31:23.918572] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-23T20:31:23.965116] [DEBUG] [LOCAL ] CCIF: Primary data saved (15230 records). [2025-10-23T20:31:23.965407] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-23T20:31:23.965730] [INFO ] [MAIN ] Update Progress: 413/2367 symbols completed. CCIF took 33.3s. Estimated remaining: 4h 2m 51s. Rate: 8.0 symbols/min [2025-10-23T20:31:24.004697] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-23T20:31:24.209221] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:24.267877] [DEBUG] [LOCAL ] CCO: Loaded 48537 existing records from primary storage. [2025-10-23T20:31:24.268511] [INFO ] [MAIN ] CCO: Loaded 48537 existing records. [2025-10-23T20:31:24.467917] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:24.468173] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-23T20:31:24.468251] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-23T20:31:24.468547] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-23T20:31:24.468625] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-23T20:31:24.804576] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-23T20:31:24.835753] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:25.092754] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T20:31:25.599487] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-23T20:31:26.399510] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-23T20:31:26.692421] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-23T20:31:27.074033] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-23T20:31:27.199460] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-23T20:31:27.445139] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T20:31:27.999535] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-23T20:31:28.001949] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T20:31:28.799461] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-23T20:31:29.422306] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-23T20:31:29.599416] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-23T20:31:30.399476] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-23T20:31:30.458308] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T20:31:30.551006] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-23T20:31:31.199475] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-23T20:31:31.965050] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T20:31:31.999396] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-23T20:31:32.187709] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-23T20:31:32.799418] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-23T20:31:32.894791] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T20:31:33.599427] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-23T20:31:33.753930] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T20:31:33.762407] [INFO ] [REMOTE ] CCK: Full fetch complete (68195 records). [2025-10-23T20:31:33.762549] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-23T20:31:34.162765] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-23T20:31:34.162889] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-23T20:31:34.163780] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-23T20:31:34.163861] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-23T20:31:34.165412] [DEBUG] [LOCAL ] CCK: Trimmed 68195 records to 46879 (keeping 200 days of data) [2025-10-23T20:31:34.401407] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-23T20:31:34.450962] [DEBUG] [LOCAL ] CCK: Primary data saved (46879 records). [2025-10-23T20:31:34.451108] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-23T20:31:34.452050] [INFO ] [MAIN ] Update Progress: 414/2367 symbols completed. CCK took 31.4s. Estimated remaining: 4h 2m 58s. Rate: 8.0 symbols/min [2025-10-23T20:31:34.620069] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:34.631001] [DEBUG] [LOCAL ] CCRD: Loaded 9562 existing records from primary storage. [2025-10-23T20:31:34.631262] [INFO ] [MAIN ] CCRD: Loaded 9562 existing records. [2025-10-23T20:31:34.804515] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:34.804807] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-23T20:31:34.804881] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-23T20:31:34.805035] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-23T20:31:34.805102] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-23T20:31:35.166525] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:35.192701] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-23T20:31:35.206304] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-23T20:31:35.226768] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-23T20:31:35.228546] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T20:31:35.229003] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-23T20:31:35.619442] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-23T20:31:35.619575] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-23T20:31:35.620541] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-23T20:31:35.620660] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-23T20:31:35.622057] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 54080 (keeping 200 days of data) [2025-10-23T20:31:35.926860] [DEBUG] [LOCAL ] CCJ: Primary data saved (54080 records). [2025-10-23T20:31:35.927022] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-23T20:31:35.927151] [INFO ] [MAIN ] Update Progress: 415/2367 symbols completed. CCJ took 35.5s. Estimated remaining: 4h 2m 22s. Rate: 8.1 symbols/min [2025-10-23T20:31:36.004508] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-23T20:31:36.060299] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T20:31:36.104761] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:36.134334] [DEBUG] [LOCAL ] CCS: Loaded 29903 existing records from primary storage. [2025-10-23T20:31:36.134630] [INFO ] [MAIN ] CCS: Loaded 29903 existing records. [2025-10-23T20:31:36.307049] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:36.307277] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-23T20:31:36.307367] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-23T20:31:36.307822] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-23T20:31:36.307913] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-23T20:31:36.671099] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:36.799401] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-23T20:31:36.929786] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-23T20:31:37.599420] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-23T20:31:38.335595] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T20:31:38.374021] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T20:31:38.399394] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-23T20:31:38.500556] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-23T20:31:38.891521] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-23T20:31:39.199444] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-23T20:31:39.999502] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-23T20:31:40.748946] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-23T20:31:40.799405] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-23T20:31:41.521568] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T20:31:41.599391] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-23T20:31:41.863059] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-23T20:31:42.399408] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-23T20:31:42.611673] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T20:31:43.199434] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-23T20:31:43.972328] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:31:43.999459] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-23T20:31:44.799399] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-23T20:31:45.025316] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T20:31:45.056843] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T20:31:45.599415] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-23T20:31:46.025685] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-23T20:31:46.399447] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-23T20:31:47.199413] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-23T20:31:47.401890] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T20:31:47.999451] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-23T20:31:48.778019] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T20:31:48.799395] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-23T20:31:48.971709] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-23T20:31:49.144918] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T20:31:49.599438] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-23T20:31:50.399421] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-23T20:31:50.485275] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T20:31:51.199400] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-23T20:31:51.281199] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T20:31:51.402421] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T20:31:51.999505] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-23T20:31:52.619363] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T20:31:52.799475] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-23T20:31:53.599426] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-23T20:31:53.813469] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T20:31:54.399510] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-23T20:31:54.992103] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T20:31:55.207495] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-23T20:31:55.230204] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-23T20:31:55.313028] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T20:31:55.315030] [INFO ] [REMOTE ] CCRD: Full fetch complete (11770 records). [2025-10-23T20:31:55.315123] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-23T20:31:55.672328] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-23T20:31:55.672445] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-23T20:31:55.672798] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-23T20:31:55.672901] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-23T20:31:55.673449] [DEBUG] [LOCAL ] CCRD: Trimmed 11770 records to 9620 (keeping 200 days of data) [2025-10-23T20:31:55.730456] [DEBUG] [LOCAL ] CCRD: Primary data saved (9620 records). [2025-10-23T20:31:55.730629] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-23T20:31:55.730770] [INFO ] [MAIN ] Update Progress: 416/2367 symbols completed. CCRD took 21.3s. Estimated remaining: 4h 3m 13s. Rate: 8.0 symbols/min [2025-10-23T20:31:55.898124] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:55.918735] [DEBUG] [LOCAL ] CCU: Loaded 21640 existing records from primary storage. [2025-10-23T20:31:55.919035] [INFO ] [MAIN ] CCU: Loaded 21640 existing records. [2025-10-23T20:31:56.009426] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-23T20:31:56.105020] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:31:56.105277] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-23T20:31:56.105356] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-23T20:31:56.105600] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-23T20:31:56.105709] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-23T20:31:56.481291] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:56.799452] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-23T20:31:57.111784] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:31:57.120456] [INFO ] [REMOTE ] CCO: Full fetch complete (67388 records). [2025-10-23T20:31:57.120610] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-23T20:31:57.570678] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-23T20:31:57.571394] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-23T20:31:57.572970] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-23T20:31:57.572024] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T20:31:57.573139] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-23T20:31:57.580990] [DEBUG] [LOCAL ] CCO: Trimmed 67388 records to 48899 (keeping 200 days of data) [2025-10-23T20:31:57.624753] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-23T20:31:57.849281] [DEBUG] [LOCAL ] CCO: Primary data saved (48899 records). [2025-10-23T20:31:57.849449] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-23T20:31:57.850361] [INFO ] [MAIN ] Update Progress: 417/2367 symbols completed. CCO took 33.9s. Estimated remaining: 4h 2m 40s. Rate: 8.0 symbols/min [2025-10-23T20:31:58.021976] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:31:58.022171] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-23T20:31:58.022244] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-23T20:31:58.022361] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-23T20:31:58.022438] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-23T20:31:58.022524] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-23T20:31:58.022596] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-23T20:31:58.156261] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T20:31:58.405321] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:31:58.405460] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-23T20:31:59.162705] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T20:31:59.199418] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-23T20:31:59.537576] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-23T20:31:59.741524] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T20:31:59.999471] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-23T20:32:00.799446] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-23T20:32:01.599399] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-23T20:32:01.919758] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T20:32:02.399496] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-23T20:32:02.494997] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T20:32:03.199416] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-23T20:32:03.591041] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-23T20:32:03.595765] [INFO ] [REMOTE ] CCS: Full fetch complete (44726 records). [2025-10-23T20:32:03.595874] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-23T20:32:03.702571] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-23T20:32:03.996719] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-23T20:32:03.996556] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T20:32:04.002720] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-23T20:32:04.002917] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-23T20:32:04.005097] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-23T20:32:04.005268] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-23T20:32:04.006195] [DEBUG] [LOCAL ] CCS: Trimmed 44726 records to 30142 (keeping 200 days of data) [2025-10-23T20:32:04.183363] [DEBUG] [LOCAL ] CCS: Primary data saved (30142 records). [2025-10-23T20:32:04.183523] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-23T20:32:04.183634] [INFO ] [MAIN ] Update Progress: 418/2367 symbols completed. CCS took 28.3s. Estimated remaining: 4h 2m 28s. Rate: 8.0 symbols/min [2025-10-23T20:32:04.352387] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:04.402973] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-23T20:32:04.403319] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-23T20:32:04.580090] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:32:04.580301] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-23T20:32:04.580383] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-23T20:32:04.580614] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-23T20:32:04.580719] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-23T20:32:04.804689] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-23T20:32:04.947260] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:05.015669] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T20:32:05.024507] [INFO ] [REMOTE ] CCL: Full fetch complete (77590 records). [2025-10-23T20:32:05.024684] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-23T20:32:05.025524] [FATAL] [VALIDATOR ] CCL: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:32:05.025605] [FATAL] [MAIN ] CCL: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:32:05.025832] [WARN ] [MAIN ] CCL: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:32:05.025923] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-23T20:32:05.026026] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-10-23T20:32:05.026100] [INFO ] [LOCAL ] CCL: Starting deletion of derivative data. [2025-10-23T20:32:05.026319] [DEBUG] [LOCAL ] CCL: Deleted derivative data file. [2025-10-23T20:32:05.026444] [INFO ] [MAIN ] Update Progress: 419/2367 symbols completed. CCL took 53.5s. Estimated remaining: 4h 1m 49s. Rate: 8.1 symbols/min [2025-10-23T20:32:05.194114] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:05.204506] [DEBUG] [LOCAL ] CDLR: Loaded 10195 existing records from primary storage. [2025-10-23T20:32:05.204768] [INFO ] [MAIN ] CDLR: Loaded 10195 existing records. [2025-10-23T20:32:05.380980] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T20:32:05.385767] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:32:05.385987] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-23T20:32:05.386073] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-23T20:32:05.387071] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-23T20:32:05.387141] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-23T20:32:05.604597] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-23T20:32:05.738593] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:06.399446] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-23T20:32:06.716759] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-23T20:32:07.199512] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-23T20:32:07.808832] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-23T20:32:07.999441] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-23T20:32:08.785137] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-23T20:32:08.799388] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-23T20:32:09.599452] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-23T20:32:10.022159] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T20:32:10.050077] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:32:10.050402] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-23T20:32:10.050491] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:32:10.050603] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-23T20:32:10.050699] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:32:10.050773] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-23T20:32:10.050865] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-23T20:32:10.050938] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-23T20:32:10.051039] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-23T20:32:10.051138] [INFO ] [MAIN ] Update Progress: 420/2367 symbols completed. CCZ took 12.2s. Estimated remaining: 4h 1m 31s. Rate: 8.1 symbols/min [2025-10-23T20:32:10.280323] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:10.282753] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-23T20:32:10.332263] [DEBUG] [LOCAL ] CDP: Loaded 42262 existing records from primary storage. [2025-10-23T20:32:10.332577] [INFO ] [MAIN ] CDP: Loaded 42262 existing records. [2025-10-23T20:32:10.404569] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-23T20:32:10.515385] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:32:10.515596] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-23T20:32:10.515692] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-23T20:32:10.516059] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-23T20:32:10.516135] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-23T20:32:10.913187] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:11.199437] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-23T20:32:11.999729] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-23T20:32:12.508566] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T20:32:12.706779] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T20:32:12.785214] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T20:32:12.799434] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-23T20:32:13.599503] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-23T20:32:14.399462] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-23T20:32:14.532528] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T20:32:15.155828] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T20:32:15.199403] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-23T20:32:15.999459] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-23T20:32:16.418589] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-23T20:32:16.477010] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T20:32:16.799453] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-23T20:32:17.599462] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-23T20:32:17.738733] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T20:32:17.767555] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T20:32:18.399447] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-23T20:32:19.199468] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-23T20:32:19.737966] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-23T20:32:19.999406] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-23T20:32:20.101365] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T20:32:20.191251] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T20:32:20.799450] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-23T20:32:21.599413] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-23T20:32:21.994095] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-23T20:32:22.034813] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T20:32:22.399400] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-23T20:32:22.618994] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T20:32:23.199508] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-23T20:32:23.597693] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T20:32:23.999416] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-23T20:32:24.799417] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-23T20:32:25.122301] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T20:32:25.125561] [INFO ] [REMOTE ] CCU: Full fetch complete (32312 records). [2025-10-23T20:32:25.125680] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-23T20:32:25.507875] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-23T20:32:25.508018] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-23T20:32:25.531200] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-23T20:32:25.531356] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-23T20:32:25.533188] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-23T20:32:25.542934] [DEBUG] [LOCAL ] CCU: Trimmed 32312 records to 21744 (keeping 200 days of data) [2025-10-23T20:32:25.624243] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-23T20:32:25.666885] [DEBUG] [LOCAL ] CCU: Primary data saved (21744 records). [2025-10-23T20:32:25.667038] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-23T20:32:25.667148] [INFO ] [MAIN ] Update Progress: 421/2367 symbols completed. CCU took 29.9s. Estimated remaining: 4h 2m 1s. Rate: 8.0 symbols/min [2025-10-23T20:32:25.831756] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:25.852612] [DEBUG] [LOCAL ] CDRE: Loaded 24728 existing records from primary storage. [2025-10-23T20:32:25.852945] [INFO ] [MAIN ] CDRE: Loaded 24728 existing records. [2025-10-23T20:32:26.025480] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:32:26.025734] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-23T20:32:26.025816] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-23T20:32:26.026061] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-23T20:32:26.026152] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-23T20:32:26.386960] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:26.399392] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-23T20:32:27.111560] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-23T20:32:27.149710] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T20:32:27.199407] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-23T20:32:27.727729] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T20:32:27.999454] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-23T20:32:28.799426] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-23T20:32:28.900467] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T20:32:29.599446] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-23T20:32:29.736774] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T20:32:29.864568] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:32:30.399461] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-23T20:32:31.199428] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-23T20:32:31.286100] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T20:32:31.668425] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T20:32:31.999418] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-23T20:32:32.114205] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T20:32:32.799445] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-23T20:32:33.599417] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-23T20:32:34.002416] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T20:32:34.399416] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-23T20:32:34.446837] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-23T20:32:35.199424] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-23T20:32:35.310201] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T20:32:35.345626] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T20:32:35.999432] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-23T20:32:36.799477] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-23T20:32:36.894731] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T20:32:37.599415] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-23T20:32:37.762056] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-23T20:32:37.771301] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-23T20:32:37.771467] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-23T20:32:38.166584] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-23T20:32:38.166721] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-23T20:32:38.167632] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-23T20:32:38.167729] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-23T20:32:38.169258] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 54034 (keeping 200 days of data) [2025-10-23T20:32:38.401180] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-23T20:32:38.488234] [DEBUG] [LOCAL ] CDE: Primary data saved (54034 records). [2025-10-23T20:32:38.488384] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-23T20:32:38.490171] [INFO ] [MAIN ] Update Progress: 422/2367 symbols completed. CDE took 34.3s. Estimated remaining: 4h 2m 18s. Rate: 8.0 symbols/min [2025-10-23T20:32:38.632056] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T20:32:38.708571] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:38.713592] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T20:32:38.711784] [INFO ] [REMOTE ] CDLR: Full fetch complete (14246 records). [2025-10-23T20:32:38.722379] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-23T20:32:39.063267] [DEBUG] [LOCAL ] CE: Loaded 51253 existing records from primary storage. [2025-10-23T20:32:39.099910] [INFO ] [MAIN ] CE: Loaded 51253 existing records. [2025-10-23T20:32:39.194134] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-23T20:32:39.200578] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-23T20:32:39.213999] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-23T20:32:39.239210] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-23T20:32:39.239576] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-23T20:32:39.279705] [DEBUG] [LOCAL ] CDLR: Trimmed 14246 records to 10267 (keeping 200 days of data) [2025-10-23T20:32:39.344135] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:32:39.362992] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-23T20:32:39.363384] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-23T20:32:39.363816] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-23T20:32:39.363920] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-23T20:32:39.498562] [DEBUG] [LOCAL ] CDLR: Primary data saved (10267 records). [2025-10-23T20:32:39.514053] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-23T20:32:39.532502] [INFO ] [MAIN ] Update Progress: 423/2367 symbols completed. CDLR took 34.5s. Estimated remaining: 4h 1m 41s. Rate: 8.0 symbols/min [2025-10-23T20:32:39.946461] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:39.941337] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:39.946990] [DEBUG] [LOCAL ] CEE: No existing data file found in primary storage. [2025-10-23T20:32:39.947079] [WARN ] [MAIN ] CEE: No existing data found, performing full refresh instead. [2025-10-23T20:32:39.947219] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-23T20:32:39.947297] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-23T20:32:39.947490] [DEBUG] [LOCAL ] CEE: No primary data file found to delete. [2025-10-23T20:32:39.947576] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-23T20:32:40.018359] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-23T20:32:40.082364] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T20:32:40.346726] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:40.637637] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T20:32:40.645224] [INFO ] [REMOTE ] CDP: Full fetch complete (62121 records). [2025-10-23T20:32:40.645372] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-23T20:32:40.805071] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-23T20:32:41.034736] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-23T20:32:41.034844] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-23T20:32:41.035681] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-23T20:32:41.035769] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-23T20:32:41.037017] [DEBUG] [LOCAL ] CDP: Trimmed 62121 records to 42604 (keeping 200 days of data) [2025-10-23T20:32:41.289059] [DEBUG] [LOCAL ] CDP: Primary data saved (42604 records). [2025-10-23T20:32:41.289230] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-23T20:32:41.290274] [INFO ] [MAIN ] Update Progress: 424/2367 symbols completed. CDP took 31.2s. Estimated remaining: 4h 1m 8s. Rate: 8.1 symbols/min [2025-10-23T20:32:41.463548] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:41.492346] [DEBUG] [LOCAL ] CEPU: Loaded 27008 existing records from primary storage. [2025-10-23T20:32:41.492698] [INFO ] [MAIN ] CEPU: Loaded 27008 existing records. [2025-10-23T20:32:41.604508] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-23T20:32:41.679196] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:32:41.683147] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-23T20:32:41.683346] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-23T20:32:41.684033] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T20:32:41.685285] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-23T20:32:41.685880] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-23T20:32:42.043927] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:42.071026] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-23T20:32:42.399490] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-23T20:32:43.057488] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T20:32:43.199421] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-23T20:32:43.417317] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T20:32:43.999427] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-23T20:32:44.799409] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-23T20:32:45.599395] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-23T20:32:45.626416] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-23T20:32:45.968259] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T20:32:46.149570] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-23T20:32:46.399474] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-23T20:32:46.820997] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T20:32:47.199430] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-23T20:32:47.670370] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T20:32:47.999483] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-23T20:32:48.799426] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-23T20:32:49.209885] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T20:32:49.347212] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T20:32:49.599463] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-23T20:32:50.151587] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T20:32:50.399462] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-23T20:32:50.958965] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T20:32:51.199466] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-23T20:32:51.999404] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-23T20:32:52.411388] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T20:32:52.586825] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T20:32:52.679529] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T20:32:52.799482] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-23T20:32:53.531947] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T20:32:53.599427] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-23T20:32:54.317939] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-23T20:32:54.399473] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-23T20:32:55.199437] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-23T20:32:55.639474] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T20:32:55.643928] [INFO ] [REMOTE ] CDRE: Full fetch complete (35009 records). [2025-10-23T20:32:55.644038] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-23T20:32:56.001525] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-23T20:32:56.039051] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-23T20:32:56.039148] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-23T20:32:56.039899] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-23T20:32:56.040078] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-23T20:32:56.040985] [DEBUG] [LOCAL ] CDRE: Trimmed 35009 records to 24851 (keeping 200 days of data) [2025-10-23T20:32:56.186571] [DEBUG] [LOCAL ] CDRE: Primary data saved (24851 records). [2025-10-23T20:32:56.186751] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-23T20:32:56.186865] [INFO ] [MAIN ] Update Progress: 425/2367 symbols completed. CDRE took 30.5s. Estimated remaining: 4h 1m 34s. Rate: 8.0 symbols/min [2025-10-23T20:32:56.369160] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:32:56.369372] [DEBUG] [LOCAL ] CF: No existing data file found in primary storage. [2025-10-23T20:32:56.369450] [WARN ] [MAIN ] CF: No existing data found, performing full refresh instead. [2025-10-23T20:32:56.369560] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-23T20:32:56.369632] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-23T20:32:56.369737] [DEBUG] [LOCAL ] CF: No primary data file found to delete. [2025-10-23T20:32:56.369809] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-23T20:32:56.755940] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:32:56.762620] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T20:32:56.799438] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-23T20:32:57.006496] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T20:32:57.599446] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-23T20:32:57.784526] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-23T20:32:58.399445] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-23T20:32:58.984258] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T20:32:59.199440] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-23T20:32:59.976390] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T20:32:59.999396] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-23T20:33:00.240317] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T20:33:00.682292] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T20:33:00.683500] [INFO ] [REMOTE ] CEE: Full fetch complete (10150 records). [2025-10-23T20:33:00.683609] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-23T20:33:00.804683] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-23T20:33:01.074284] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-23T20:33:01.074434] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-23T20:33:01.074905] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-23T20:33:01.074990] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-23T20:33:01.075522] [DEBUG] [LOCAL ] CEE: Trimmed 10150 records to 5144 (keeping 200 days of data) [2025-10-23T20:33:01.109364] [DEBUG] [LOCAL ] CEE: Primary data saved (5144 records). [2025-10-23T20:33:01.109923] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-23T20:33:01.110105] [INFO ] [MAIN ] Update Progress: 426/2367 symbols completed. CEE took 21.6s. Estimated remaining: 4h 1m 15s. Rate: 8.0 symbols/min [2025-10-23T20:33:01.293368] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:01.341094] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-23T20:33:01.341440] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-23T20:33:01.547166] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:01.547402] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-23T20:33:01.547479] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-23T20:33:01.547750] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-23T20:33:01.547841] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-23T20:33:01.610249] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-23T20:33:01.954158] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:02.399514] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-23T20:33:03.199465] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-23T20:33:04.277127] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-23T20:33:04.282367] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-23T20:33:04.451866] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (3.65 seconds). [2025-10-23T20:33:04.741422] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-23T20:33:04.799424] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-23T20:33:05.169267] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T20:33:05.251677] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T20:33:05.599455] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-23T20:33:06.399414] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-23T20:33:06.564261] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T20:33:07.199414] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-23T20:33:07.436994] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T20:33:07.999441] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-23T20:33:08.414134] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T20:33:08.438180] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T20:33:08.799439] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-23T20:33:09.599432] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-23T20:33:09.798862] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T20:33:10.371069] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T20:33:10.399410] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-23T20:33:11.199434] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-23T20:33:11.383815] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T20:33:11.999424] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-23T20:33:12.236337] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T20:33:12.799470] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-23T20:33:13.178338] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T20:33:13.599417] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-23T20:33:13.730970] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T20:33:14.399426] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-23T20:33:14.701124] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:33:14.710028] [INFO ] [REMOTE ] CE: Full fetch complete (74786 records). [2025-10-23T20:33:14.710173] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-23T20:33:15.101609] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-23T20:33:15.101871] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-23T20:33:15.103062] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-23T20:33:15.103141] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-23T20:33:15.104550] [DEBUG] [LOCAL ] CE: Trimmed 74786 records to 51618 (keeping 200 days of data) [2025-10-23T20:33:15.202879] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-23T20:33:15.416836] [DEBUG] [LOCAL ] CE: Primary data saved (51618 records). [2025-10-23T20:33:15.417074] [INFO ] [MAIN ] CE: Full history saved. [2025-10-23T20:33:15.417266] [INFO ] [MAIN ] Update Progress: 427/2367 symbols completed. CE took 36.9s. Estimated remaining: 4h 1m 39s. Rate: 8.0 symbols/min [2025-10-23T20:33:15.589903] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:15.590174] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-23T20:33:15.590317] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-23T20:33:15.590533] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-23T20:33:15.590625] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-23T20:33:15.590735] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-23T20:33:15.590876] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-23T20:33:15.781225] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-23T20:33:16.010283] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-23T20:33:16.013904] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:16.349462] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T20:33:16.799428] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-23T20:33:16.881205] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T20:33:16.887337] [INFO ] [REMOTE ] CEPU: Full fetch complete (39742 records). [2025-10-23T20:33:16.887447] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-23T20:33:17.140020] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:33:17.167691] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-23T20:33:17.178198] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:33:17.178343] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-23T20:33:17.178414] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:33:17.189315] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-23T20:33:17.199706] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-23T20:33:17.222249] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-23T20:33:17.257719] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-23T20:33:17.267532] [INFO ] [MAIN ] Update Progress: 428/2367 symbols completed. CFND took 1.9s. Estimated remaining: 4h 1m 6s. Rate: 8.0 symbols/min [2025-10-23T20:33:17.267457] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-23T20:33:17.267679] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-23T20:33:17.268393] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-23T20:33:17.279762] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-23T20:33:17.370054] [DEBUG] [LOCAL ] CEPU: Trimmed 39742 records to 27303 (keeping 200 days of data) [2025-10-23T20:33:17.522571] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:17.534249] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-10-23T20:33:17.542297] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-10-23T20:33:17.546502] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-23T20:33:17.547105] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-23T20:33:17.550494] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-23T20:33:17.550578] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-23T20:33:17.603539] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-23T20:33:17.746562] [DEBUG] [LOCAL ] CEPU: Primary data saved (27303 records). [2025-10-23T20:33:17.812636] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-23T20:33:17.850801] [INFO ] [MAIN ] Update Progress: 429/2367 symbols completed. CEPU took 36.6s. Estimated remaining: 4h 0m 27s. Rate: 8.1 symbols/min [2025-10-23T20:33:18.092404] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:18.135627] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:18.167085] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-23T20:33:18.206546] [DEBUG] [LOCAL ] CGAU: Loaded 43921 existing records from primary storage. [2025-10-23T20:33:18.206924] [INFO ] [MAIN ] CGAU: Loaded 43921 existing records. [2025-10-23T20:33:18.379118] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:18.379360] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-23T20:33:18.379458] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-23T20:33:18.379765] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-23T20:33:18.379856] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-23T20:33:18.410202] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-23T20:33:18.732153] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:19.199435] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-23T20:33:19.578979] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T20:33:19.999414] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-23T20:33:20.067682] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T20:33:20.799485] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-23T20:33:20.857480] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T20:33:21.599419] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-23T20:33:22.002354] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T20:33:22.399477] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-23T20:33:22.873548] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T20:33:23.003524] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T20:33:23.199448] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-23T20:33:23.999415] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-23T20:33:24.226261] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T20:33:24.799464] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-23T20:33:24.868714] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T20:33:25.609485] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-23T20:33:25.614077] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T20:33:26.399438] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-23T20:33:26.762423] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T20:33:27.199440] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-23T20:33:27.421986] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T20:33:27.936186] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T20:33:27.999402] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-23T20:33:28.799465] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-23T20:33:28.950176] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T20:33:29.599419] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-23T20:33:29.781466] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T20:33:30.399445] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-23T20:33:30.675487] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T20:33:31.199448] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-23T20:33:31.559217] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T20:33:31.568107] [INFO ] [REMOTE ] CF: Full fetch complete (75593 records). [2025-10-23T20:33:31.568257] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-23T20:33:31.960067] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-23T20:33:31.960286] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-23T20:33:31.961233] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-23T20:33:31.961318] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-23T20:33:31.962929] [DEBUG] [LOCAL ] CF: Trimmed 75593 records to 52489 (keeping 200 days of data) [2025-10-23T20:33:32.017589] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-23T20:33:32.112140] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T20:33:32.310567] [DEBUG] [LOCAL ] CF: Primary data saved (52489 records). [2025-10-23T20:33:32.310755] [INFO ] [MAIN ] CF: Full history saved. [2025-10-23T20:33:32.310862] [INFO ] [MAIN ] Update Progress: 430/2367 symbols completed. CF took 36.1s. Estimated remaining: 4h 0m 51s. Rate: 8.0 symbols/min [2025-10-23T20:33:32.476184] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:32.479955] [DEBUG] [LOCAL ] CGV: Loaded 1359 existing records from primary storage. [2025-10-23T20:33:32.480137] [INFO ] [MAIN ] CGV: Loaded 1359 existing records. [2025-10-23T20:33:32.655633] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:32.655872] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-23T20:33:32.655946] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-23T20:33:32.656195] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-23T20:33:32.656284] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-23T20:33:32.809072] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-23T20:33:32.936701] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T20:33:33.038951] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:33.599433] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-23T20:33:34.090902] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T20:33:34.100333] [INFO ] [REMOTE ] CFG: Full fetch complete (77775 records). [2025-10-23T20:33:34.100514] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-23T20:33:34.405773] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-23T20:33:34.510609] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-23T20:33:34.510865] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-23T20:33:34.511823] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-23T20:33:34.511902] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-23T20:33:34.513373] [DEBUG] [LOCAL ] CFG: Trimmed 77775 records to 54013 (keeping 200 days of data) [2025-10-23T20:33:34.668552] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T20:33:34.882892] [DEBUG] [LOCAL ] CFG: Primary data saved (54013 records). [2025-10-23T20:33:34.883088] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-23T20:33:34.883305] [INFO ] [MAIN ] Update Progress: 431/2367 symbols completed. CFG took 33.8s. Estimated remaining: 4h 0m 22s. Rate: 8.1 symbols/min [2025-10-23T20:33:35.069564] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:35.075434] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T20:33:35.076629] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T20:33:35.109193] [DEBUG] [LOCAL ] CHCT: Loaded 24266 existing records from primary storage. [2025-10-23T20:33:35.109708] [INFO ] [MAIN ] CHCT: Loaded 24266 existing records. [2025-10-23T20:33:35.204617] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-23T20:33:35.303762] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:35.304086] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-23T20:33:35.304173] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-23T20:33:35.304556] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-23T20:33:35.304637] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-23T20:33:35.686184] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:35.999436] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-23T20:33:36.799428] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-23T20:33:36.845586] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T20:33:37.418803] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T20:33:37.591705] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T20:33:37.599388] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-23T20:33:38.399458] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-23T20:33:39.199444] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-23T20:33:39.340550] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T20:33:39.722823] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T20:33:39.754638] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-23T20:33:39.999451] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-23T20:33:40.799476] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-23T20:33:41.279537] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T20:33:41.599439] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-23T20:33:42.026541] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T20:33:42.399455] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-23T20:33:42.967097] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T20:33:43.199450] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-23T20:33:43.914479] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T20:33:43.999462] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-23T20:33:44.128473] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T20:33:44.137019] [INFO ] [REMOTE ] CFR: Full fetch complete (48639 records). [2025-10-23T20:33:44.137173] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-23T20:33:44.518257] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-23T20:33:44.518374] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-23T20:33:44.519077] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-23T20:33:44.519157] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-23T20:33:44.520194] [DEBUG] [LOCAL ] CFR: Trimmed 48639 records to 32608 (keeping 200 days of data) [2025-10-23T20:33:44.720065] [DEBUG] [LOCAL ] CFR: Primary data saved (32608 records). [2025-10-23T20:33:44.720251] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-23T20:33:44.720355] [INFO ] [MAIN ] Update Progress: 432/2367 symbols completed. CFR took 27.5s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-10-23T20:33:44.804688] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-23T20:33:44.891344] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:44.937868] [DEBUG] [LOCAL ] CHD: Loaded 52320 existing records from primary storage. [2025-10-23T20:33:44.938238] [INFO ] [MAIN ] CHD: Loaded 52320 existing records. [2025-10-23T20:33:45.112402] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:45.112600] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-23T20:33:45.112703] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-23T20:33:45.112958] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-23T20:33:45.113031] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-23T20:33:45.472170] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:45.559914] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T20:33:45.599482] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-23T20:33:46.399398] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-23T20:33:46.802801] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-23T20:33:47.072429] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T20:33:47.199405] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-23T20:33:47.695039] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T20:33:47.824134] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T20:33:47.999419] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-23T20:33:48.799445] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-23T20:33:49.383303] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T20:33:49.599428] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-23T20:33:49.823087] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T20:33:50.399468] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-23T20:33:51.012314] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T20:33:51.199465] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-23T20:33:51.713702] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-23T20:33:51.999452] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-23T20:33:52.465215] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T20:33:52.562528] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-23T20:33:52.799439] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-23T20:33:53.599492] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-23T20:33:54.399465] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-23T20:33:54.967834] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T20:33:54.968744] [INFO ] [REMOTE ] CGV: Full fetch complete (2225 records). [2025-10-23T20:33:54.968833] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-23T20:33:55.208627] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-23T20:33:55.327043] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-23T20:33:55.340149] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-23T20:33:55.340860] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-23T20:33:55.341515] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T20:33:55.346497] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-23T20:33:55.347207] [DEBUG] [LOCAL ] CGV: Trimmed 2225 records to 1368 (keeping 200 days of data) [2025-10-23T20:33:55.355546] [DEBUG] [LOCAL ] CGV: Primary data saved (1368 records). [2025-10-23T20:33:55.355628] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-23T20:33:55.355748] [INFO ] [MAIN ] Update Progress: 433/2367 symbols completed. CGV took 23.0s. Estimated remaining: 4h 0m 32s. Rate: 8.0 symbols/min [2025-10-23T20:33:55.523290] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:55.539452] [DEBUG] [LOCAL ] CHE: Loaded 15327 existing records from primary storage. [2025-10-23T20:33:55.539709] [INFO ] [MAIN ] CHE: Loaded 15327 existing records. [2025-10-23T20:33:55.721051] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:55.721390] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-23T20:33:55.721536] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-23T20:33:55.721798] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-23T20:33:55.721907] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-23T20:33:55.933266] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-10-23T20:33:56.003214] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-23T20:33:56.123973] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:56.799499] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-23T20:33:57.268765] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T20:33:57.277852] [INFO ] [REMOTE ] CGAU: Full fetch complete (62139 records). [2025-10-23T20:33:57.278046] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-23T20:33:57.604601] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-23T20:33:57.673886] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-23T20:33:57.674084] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-23T20:33:57.675075] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-23T20:33:57.675337] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-23T20:33:57.676981] [DEBUG] [LOCAL ] CGAU: Trimmed 62139 records to 44258 (keeping 200 days of data) [2025-10-23T20:33:57.778319] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:33:57.957394] [DEBUG] [LOCAL ] CGAU: Primary data saved (44258 records). [2025-10-23T20:33:57.957558] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-23T20:33:57.957696] [INFO ] [MAIN ] Update Progress: 434/2367 symbols completed. CGAU took 40.1s. Estimated remaining: 4h 0m 3s. Rate: 8.1 symbols/min [2025-10-23T20:33:58.133756] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:33:58.186229] [DEBUG] [LOCAL ] CHGG: Loaded 47586 existing records from primary storage. [2025-10-23T20:33:58.186639] [INFO ] [MAIN ] CHGG: Loaded 47586 existing records. [2025-10-23T20:33:58.365357] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:33:58.365605] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-23T20:33:58.365743] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-23T20:33:58.366045] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-23T20:33:58.366128] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-23T20:33:58.408360] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-23T20:33:58.729474] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:33:58.860027] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:33:59.008713] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:33:59.199419] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-23T20:33:59.340522] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-23T20:33:59.999438] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-23T20:34:00.799515] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-23T20:34:01.599418] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-23T20:34:01.961847] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-23T20:34:02.356283] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-23T20:34:02.399414] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-23T20:34:02.897242] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T20:34:03.040943] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-23T20:34:03.199439] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-23T20:34:03.999416] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-23T20:34:04.532247] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-23T20:34:04.663045] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T20:34:04.799427] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-23T20:34:05.599451] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-23T20:34:05.964175] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-23T20:34:06.020128] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T20:34:06.399448] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-23T20:34:07.199423] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-23T20:34:07.663154] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T20:34:07.999433] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-23T20:34:08.456572] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-23T20:34:08.475206] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T20:34:08.799442] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-23T20:34:09.260922] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T20:34:09.265388] [INFO ] [REMOTE ] CHCT: Full fetch complete (34692 records). [2025-10-23T20:34:09.265548] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-23T20:34:09.608545] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-23T20:34:09.651066] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-23T20:34:09.651187] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-23T20:34:09.651823] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-23T20:34:09.651908] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-23T20:34:09.652870] [DEBUG] [LOCAL ] CHCT: Trimmed 34692 records to 24374 (keeping 200 days of data) [2025-10-23T20:34:09.799376] [DEBUG] [LOCAL ] CHCT: Primary data saved (24374 records). [2025-10-23T20:34:09.799580] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-23T20:34:09.799756] [INFO ] [MAIN ] Update Progress: 435/2367 symbols completed. CHCT took 34.9s. Estimated remaining: 4h 0m 15s. Rate: 8.0 symbols/min [2025-10-23T20:34:09.990195] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:34:09.987259] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T20:34:10.027085] [DEBUG] [LOCAL ] CHH: Loaded 32225 existing records from primary storage. [2025-10-23T20:34:10.027381] [INFO ] [MAIN ] CHH: Loaded 32225 existing records. [2025-10-23T20:34:10.204556] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:34:10.204809] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-23T20:34:10.204885] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-23T20:34:10.205097] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-23T20:34:10.205181] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-23T20:34:10.406327] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-23T20:34:10.555124] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:34:11.199448] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-23T20:34:11.942882] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T20:34:11.984513] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-23T20:34:11.999402] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-23T20:34:12.799483] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-23T20:34:12.920286] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T20:34:13.070350] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:34:13.599449] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-23T20:34:14.399415] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-23T20:34:14.722484] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T20:34:15.199427] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-23T20:34:15.473328] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:34:15.695999] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T20:34:15.999466] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-23T20:34:16.799413] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-23T20:34:16.880324] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T20:34:17.112318] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T20:34:17.115676] [INFO ] [REMOTE ] CHE: Full fetch complete (20548 records). [2025-10-23T20:34:17.115770] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-23T20:34:17.481092] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-23T20:34:17.481199] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-23T20:34:17.481639] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-23T20:34:17.481738] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-23T20:34:17.482408] [DEBUG] [LOCAL ] CHE: Trimmed 20548 records to 15444 (keeping 200 days of data) [2025-10-23T20:34:17.579841] [DEBUG] [LOCAL ] CHE: Primary data saved (15444 records). [2025-10-23T20:34:17.580006] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-23T20:34:17.580116] [INFO ] [MAIN ] Update Progress: 436/2367 symbols completed. CHE took 22.2s. Estimated remaining: 4h 0m 9s. Rate: 8.0 symbols/min [2025-10-23T20:34:17.610934] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-23T20:34:17.754662] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:34:17.774828] [DEBUG] [LOCAL ] CHMI: Loaded 21188 existing records from primary storage. [2025-10-23T20:34:17.775088] [INFO ] [MAIN ] CHMI: Loaded 21188 existing records. [2025-10-23T20:34:17.947215] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:34:17.947427] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-23T20:34:17.947502] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-23T20:34:17.947764] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-23T20:34:17.947839] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-23T20:34:18.294995] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:34:18.399422] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-23T20:34:18.671576] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T20:34:18.999999] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-23T20:34:19.199453] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-23T20:34:19.620514] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T20:34:19.999444] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-23T20:34:20.799459] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-23T20:34:20.957893] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T20:34:20.966744] [INFO ] [REMOTE ] CHD: Full fetch complete (74991 records). [2025-10-23T20:34:20.966924] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-23T20:34:21.377084] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-23T20:34:21.377262] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-23T20:34:21.378162] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-23T20:34:21.378246] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-23T20:34:21.379712] [DEBUG] [LOCAL ] CHD: Trimmed 74991 records to 52693 (keeping 200 days of data) [2025-10-23T20:34:21.601527] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-23T20:34:21.617442] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T20:34:21.741991] [DEBUG] [LOCAL ] CHD: Primary data saved (52693 records). [2025-10-23T20:34:21.742166] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-23T20:34:21.742259] [INFO ] [MAIN ] Update Progress: 437/2367 symbols completed. CHD took 37.0s. Estimated remaining: 3h 59m 47s. Rate: 8.0 symbols/min [2025-10-23T20:34:22.399480] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-23T20:34:22.483552] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T20:34:23.199478] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-23T20:34:23.490007] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T20:34:23.638573] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-23T20:34:23.999447] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-23T20:34:24.531854] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T20:34:24.799436] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-23T20:34:25.599449] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-23T20:34:26.099505] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:34:26.166066] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T20:34:26.399436] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-23T20:34:26.684476] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-23T20:34:27.199444] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-23T20:34:27.999439] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-23T20:34:28.058341] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T20:34:28.723178] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T20:34:28.799418] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-23T20:34:29.599405] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-23T20:34:30.072203] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T20:34:30.338169] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T20:34:30.399422] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-23T20:34:30.865870] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T20:34:31.199456] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-23T20:34:31.987633] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T20:34:31.999401] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-23T20:34:32.459782] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:34:32.799454] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-23T20:34:33.254505] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T20:34:33.260826] [INFO ] [REMOTE ] CHH: Full fetch complete (47580 records). [2025-10-23T20:34:33.260940] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-23T20:34:33.606072] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-23T20:34:33.638304] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-23T20:34:33.638432] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-23T20:34:33.639135] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-23T20:34:33.639216] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-23T20:34:33.640277] [DEBUG] [LOCAL ] CHH: Trimmed 47580 records to 32509 (keeping 200 days of data) [2025-10-23T20:34:33.840385] [DEBUG] [LOCAL ] CHH: Primary data saved (32509 records). [2025-10-23T20:34:33.840562] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-23T20:34:33.840700] [INFO ] [MAIN ] Update Progress: 438/2367 symbols completed. CHH took 24.0s. Estimated remaining: 3h 59m 60s. Rate: 8.0 symbols/min [2025-10-23T20:34:34.724945] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-23T20:34:34.733415] [INFO ] [REMOTE ] CHGG: Full fetch complete (69906 records). [2025-10-23T20:34:34.733572] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-23T20:34:34.930382] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T20:34:35.036769] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-23T20:34:35.164020] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-23T20:34:35.164148] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-23T20:34:35.165129] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-23T20:34:35.165227] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-23T20:34:35.166660] [DEBUG] [LOCAL ] CHGG: Trimmed 69906 records to 47817 (keeping 200 days of data) [2025-10-23T20:34:35.430191] [DEBUG] [LOCAL ] CHGG: Primary data saved (47817 records). [2025-10-23T20:34:35.430359] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-23T20:34:35.431507] [INFO ] [MAIN ] Update Progress: 439/2367 symbols completed. CHGG took 37.5s. Estimated remaining: 3h 59m 27s. Rate: 8.1 symbols/min [2025-10-23T20:34:36.359007] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T20:34:36.363459] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-23T20:34:37.742630] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T20:34:37.748089] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-23T20:34:38.986920] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T20:34:38.990812] [INFO ] [REMOTE ] CHMI: Full fetch complete (31311 records). [2025-10-23T20:34:38.990916] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-23T20:34:39.365578] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-23T20:34:39.365711] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-23T20:34:39.366334] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-23T20:34:39.366415] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-23T20:34:39.367265] [DEBUG] [LOCAL ] CHMI: Trimmed 31311 records to 21277 (keeping 200 days of data) [2025-10-23T20:34:39.486419] [DEBUG] [LOCAL ] CHMI: Primary data saved (21277 records). [2025-10-23T20:34:39.486565] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-23T20:34:39.486695] [INFO ] [MAIN ] Update Progress: 440/2367 symbols completed. CHMI took 21.9s. Estimated remaining: 3h 59m 4s. Rate: 8.1 symbols/min [2025-10-23T20:34:40.040891] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:34:40.177363] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:34:40.122810] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:34:40.210736] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:34:40.210801] [DEBUG] [LOCAL ] CHWY: No existing data file found in primary storage. [2025-10-23T20:34:40.211382] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-23T20:34:40.211486] [WARN ] [MAIN ] CHWY: No existing data found, performing full refresh instead. [2025-10-23T20:34:40.211682] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-23T20:34:40.211767] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-23T20:34:40.211533] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-23T20:34:40.211870] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-23T20:34:40.212052] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-23T20:34:40.211978] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-23T20:34:40.233742] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-23T20:34:40.268394] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-23T20:34:40.293386] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-23T20:34:40.303332] [DEBUG] [LOCAL ] CHN: Loaded 4983 existing records from primary storage. [2025-10-23T20:34:40.392536] [INFO ] [MAIN ] CHN: Loaded 4983 existing records. [2025-10-23T20:34:40.763515] [DEBUG] [LOCAL ] CHPT: Loaded 47004 existing records from primary storage. [2025-10-23T20:34:40.817202] [INFO ] [MAIN ] CHPT: Loaded 47004 existing records. [2025-10-23T20:34:41.176628] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:34:41.251423] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:34:41.257223] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-23T20:34:41.256556] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-23T20:34:41.290498] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-23T20:34:41.300991] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-23T20:34:41.374264] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-23T20:34:41.444666] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:34:41.426090] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:34:41.464746] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-23T20:34:41.465071] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-23T20:34:41.465225] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-23T20:34:41.537506] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-23T20:34:41.538043] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-23T20:34:42.108909] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:34:42.109267] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-23T20:34:42.186913] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:34:42.187219] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-23T20:34:42.702399] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T20:34:42.706158] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-23T20:34:43.487807] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-23T20:34:43.498508] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-23T20:34:43.513080] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:34:43.515016] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-23T20:34:43.859730] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T20:34:43.864134] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-23T20:34:44.064400] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-23T20:34:44.066369] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-23T20:34:44.652136] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-23T20:34:44.662837] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-23T20:34:44.749115] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T20:34:44.799425] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-23T20:34:44.843363] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T20:34:45.599424] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-23T20:34:45.763786] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-23T20:34:45.976012] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T20:34:46.399421] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-23T20:34:46.473898] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T20:34:46.884692] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-23T20:34:47.199420] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-23T20:34:47.584743] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T20:34:47.999435] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-23T20:34:48.799490] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-23T20:34:49.261337] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-23T20:34:49.599461] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-23T20:34:50.020954] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T20:34:50.376517] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-23T20:34:50.399396] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-23T20:34:50.404844] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T20:34:51.199458] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-23T20:34:51.999432] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-23T20:34:52.343068] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T20:34:52.763536] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-23T20:34:52.799394] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-23T20:34:53.599437] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-23T20:34:53.975195] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T20:34:54.232472] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-23T20:34:54.399464] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-23T20:34:55.152168] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T20:34:55.205213] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-23T20:34:55.212088] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-23T20:34:55.974863] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T20:34:55.999413] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-23T20:34:56.799481] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-23T20:34:57.520758] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T20:34:57.599481] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-23T20:34:58.312364] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-23T20:34:58.399427] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-23T20:34:58.630554] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T20:34:59.199448] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-23T20:34:59.999414] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-23T20:35:00.354752] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T20:35:00.799454] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-23T20:35:01.599508] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-23T20:35:01.949609] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:35:02.031361] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T20:35:02.033212] [INFO ] [REMOTE ] CHN: Full fetch complete (7547 records). [2025-10-23T20:35:02.033346] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-23T20:35:02.401296] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-23T20:35:02.464667] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-23T20:35:02.465226] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-23T20:35:02.467313] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-23T20:35:02.466632] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-10-23T20:35:02.467544] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-23T20:35:02.480113] [DEBUG] [LOCAL ] CHN: Trimmed 7547 records to 5027 (keeping 200 days of data) [2025-10-23T20:35:02.519814] [DEBUG] [LOCAL ] CHN: Primary data saved (5027 records). [2025-10-23T20:35:02.520009] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-23T20:35:02.520133] [INFO ] [MAIN ] Update Progress: 441/2367 symbols completed. CHN took 23.0s. Estimated remaining: 4h 0m 5s. Rate: 8.0 symbols/min [2025-10-23T20:35:02.692273] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:02.692502] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-23T20:35:02.692573] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-23T20:35:02.692709] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-23T20:35:02.692780] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-23T20:35:02.692837] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-23T20:35:02.692900] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-23T20:35:03.054994] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:03.199458] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-23T20:35:03.776858] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T20:35:03.780395] [INFO ] [REMOTE ] CHT: Full fetch complete (27619 records). [2025-10-23T20:35:03.780509] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-23T20:35:04.002701] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-23T20:35:04.163049] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-23T20:35:04.163280] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-23T20:35:04.163992] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-23T20:35:04.164142] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-23T20:35:04.165219] [DEBUG] [LOCAL ] CHT: Trimmed 27619 records to 19339 (keeping 200 days of data) [2025-10-23T20:35:04.278511] [DEBUG] [LOCAL ] CHT: Primary data saved (19339 records). [2025-10-23T20:35:04.278761] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-23T20:35:04.279002] [INFO ] [MAIN ] Update Progress: 442/2367 symbols completed. CHT took 24.8s. Estimated remaining: 3h 59m 33s. Rate: 8.0 symbols/min [2025-10-23T20:35:04.493121] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-10-23T20:35:04.496080] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:04.524143] [DEBUG] [LOCAL ] CIA: Loaded 16492 existing records from primary storage. [2025-10-23T20:35:04.524387] [INFO ] [MAIN ] CIA: Loaded 16492 existing records. [2025-10-23T20:35:04.699108] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:35:04.699373] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-23T20:35:04.699455] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-23T20:35:04.699704] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-23T20:35:04.699779] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-23T20:35:04.800767] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-23T20:35:05.080883] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:05.599520] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-23T20:35:06.608138] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-23T20:35:06.617188] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-23T20:35:06.654001] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (3.45 seconds). [2025-10-23T20:35:07.077609] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T20:35:07.199426] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-23T20:35:07.716682] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-23T20:35:07.999419] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-23T20:35:08.799408] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-23T20:35:09.039982] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-23T20:35:09.476257] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-23T20:35:09.599443] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-23T20:35:10.082896] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-23T20:35:10.399438] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-23T20:35:11.199435] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-23T20:35:11.469368] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-23T20:35:11.529255] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T20:35:11.999443] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-23T20:35:12.057293] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:35:12.799429] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-23T20:35:13.170437] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T20:35:13.177178] [INFO ] [REMOTE ] CHPT: Full fetch complete (70933 records). [2025-10-23T20:35:13.177315] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-23T20:35:13.582969] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-23T20:35:13.583077] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-23T20:35:13.583938] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-23T20:35:13.584015] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-23T20:35:13.585326] [DEBUG] [LOCAL ] CHPT: Trimmed 70933 records to 47199 (keeping 200 days of data) [2025-10-23T20:35:13.634537] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-23T20:35:13.854659] [DEBUG] [LOCAL ] CHPT: Primary data saved (47199 records). [2025-10-23T20:35:13.854806] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-23T20:35:13.854911] [INFO ] [MAIN ] Update Progress: 443/2367 symbols completed. CHPT took 34.4s. Estimated remaining: 3h 59m 34s. Rate: 8.0 symbols/min [2025-10-23T20:35:14.037040] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:14.067770] [DEBUG] [LOCAL ] CIB: Loaded 30292 existing records from primary storage. [2025-10-23T20:35:14.068103] [INFO ] [MAIN ] CIB: Loaded 30292 existing records. [2025-10-23T20:35:14.248459] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:35:14.248800] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-23T20:35:14.248933] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-23T20:35:14.249211] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-23T20:35:14.249287] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-23T20:35:14.585139] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-23T20:35:14.659058] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-23T20:35:14.658456] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:14.820463] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T20:35:15.182799] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-23T20:35:15.199398] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-23T20:35:15.999434] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-23T20:35:16.140171] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T20:35:16.149415] [INFO ] [REMOTE ] CHWY: Full fetch complete (77391 records). [2025-10-23T20:35:16.149615] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-23T20:35:16.150601] [FATAL] [VALIDATOR ] CHWY: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:35:16.150741] [FATAL] [MAIN ] CHWY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:35:16.150825] [WARN ] [MAIN ] CHWY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:35:16.150901] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-23T20:35:16.150995] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-23T20:35:16.151067] [INFO ] [LOCAL ] CHWY: Starting deletion of derivative data. [2025-10-23T20:35:16.151148] [DEBUG] [LOCAL ] CHWY: No derivative data file found to delete. [2025-10-23T20:35:16.151242] [INFO ] [MAIN ] Update Progress: 444/2367 symbols completed. CHWY took 36.7s. Estimated remaining: 3h 59m 4s. Rate: 8.0 symbols/min [2025-10-23T20:35:16.336600] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:16.336831] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-23T20:35:16.336903] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-23T20:35:16.337055] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-23T20:35:16.337127] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-23T20:35:16.337209] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-23T20:35:16.337277] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-23T20:35:16.700387] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:16.786889] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T20:35:16.799401] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-23T20:35:17.599441] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-23T20:35:17.683563] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:35:18.399523] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-23T20:35:18.497375] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T20:35:18.895913] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-23T20:35:19.199471] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-23T20:35:19.626065] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T20:35:19.849331] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-23T20:35:19.999435] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-23T20:35:20.799446] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-23T20:35:21.599445] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-23T20:35:22.055414] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T20:35:22.355543] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T20:35:22.378731] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T20:35:22.399435] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-23T20:35:23.199418] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-23T20:35:23.999435] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-23T20:35:24.166440] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T20:35:24.563842] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-23T20:35:24.763057] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T20:35:24.799410] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-23T20:35:25.340139] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-23T20:35:25.599448] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-23T20:35:26.137252] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T20:35:26.399447] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-23T20:35:27.075201] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T20:35:27.199432] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-23T20:35:27.999449] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-23T20:35:28.799419] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-23T20:35:29.228728] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T20:35:29.251084] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T20:35:29.393935] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T20:35:29.599428] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-23T20:35:30.054577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T20:35:30.399439] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-23T20:35:31.199453] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-23T20:35:31.499711] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T20:35:31.999435] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-23T20:35:32.799439] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-23T20:35:33.164560] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-23T20:35:33.471175] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T20:35:33.500522] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T20:35:33.599432] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-23T20:35:34.399434] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-23T20:35:35.120268] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T20:35:35.199415] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-23T20:35:35.477564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T20:35:35.999438] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-23T20:35:36.645049] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T20:35:36.799445] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-23T20:35:37.235299] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T20:35:37.236114] [INFO ] [REMOTE ] CICB: Full fetch complete (1932 records). [2025-10-23T20:35:37.236222] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-23T20:35:37.415584] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-23T20:35:37.415795] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:35:37.415882] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:35:37.415975] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-23T20:35:37.416090] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-23T20:35:37.416179] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-23T20:35:37.416285] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-23T20:35:37.416398] [INFO ] [MAIN ] Update Progress: 445/2367 symbols completed. CICB took 21.3s. Estimated remaining: 3h 59m 57s. Rate: 8.0 symbols/min [2025-10-23T20:35:37.588637] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:37.599441] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-23T20:35:37.640765] [DEBUG] [LOCAL ] CIEN: Loaded 52121 existing records from primary storage. [2025-10-23T20:35:37.641112] [INFO ] [MAIN ] CIEN: Loaded 52121 existing records. [2025-10-23T20:35:37.826868] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:35:37.827185] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-23T20:35:37.827361] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-23T20:35:37.827746] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-23T20:35:37.827848] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-23T20:35:37.950987] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T20:35:38.007742] [INFO ] [REMOTE ] CI: Full fetch complete (72019 records). [2025-10-23T20:35:38.017765] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-23T20:35:38.403097] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-23T20:35:38.484995] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:38.654568] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-23T20:35:38.680509] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-23T20:35:38.680718] [INFO ] [REMOTE ] CIA: Full fetch complete (23205 records). [2025-10-23T20:35:38.680777] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-23T20:35:38.681616] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-23T20:35:38.681735] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-23T20:35:38.681838] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-23T20:35:38.790824] [DEBUG] [LOCAL ] CI: Trimmed 72019 records to 49907 (keeping 200 days of data) [2025-10-23T20:35:39.184723] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-23T20:35:39.187366] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-23T20:35:39.188149] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-23T20:35:39.189077] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-23T20:35:39.199730] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-23T20:35:39.201801] [DEBUG] [LOCAL ] CIA: Trimmed 23205 records to 16554 (keeping 200 days of data) [2025-10-23T20:35:39.400411] [DEBUG] [LOCAL ] CIA: Primary data saved (16554 records). [2025-10-23T20:35:39.407139] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-23T20:35:39.407500] [INFO ] [MAIN ] Update Progress: 446/2367 symbols completed. CIA took 35.1s. Estimated remaining: 3h 59m 25s. Rate: 8.0 symbols/min [2025-10-23T20:35:39.634906] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:39.671909] [DEBUG] [LOCAL ] CIF: Loaded 3978 existing records from primary storage. [2025-10-23T20:35:39.672029] [DEBUG] [LOCAL ] CI: Primary data saved (49907 records). [2025-10-23T20:35:39.672499] [INFO ] [MAIN ] CIF: Loaded 3978 existing records. [2025-10-23T20:35:39.672605] [INFO ] [MAIN ] CI: Full history saved. [2025-10-23T20:35:39.716719] [INFO ] [MAIN ] Update Progress: 447/2367 symbols completed. CI took 37.2s. Estimated remaining: 3h 58m 47s. Rate: 8.0 symbols/min [2025-10-23T20:35:39.986960] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:35:40.015127] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-23T20:35:40.037310] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-23T20:35:40.039211] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-23T20:35:40.038970] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:40.045207] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-23T20:35:40.068519] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:35:40.144991] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-23T20:35:40.381878] [DEBUG] [LOCAL ] CIG: Loaded 44526 existing records from primary storage. [2025-10-23T20:35:40.414836] [INFO ] [MAIN ] CIG: Loaded 44526 existing records. [2025-10-23T20:35:40.556490] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:40.635490] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:35:40.635746] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-23T20:35:40.635864] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-23T20:35:40.636106] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-23T20:35:40.636183] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-23T20:35:40.807680] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-23T20:35:40.989024] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:41.227372] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T20:35:41.510044] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T20:35:41.599428] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-23T20:35:41.989594] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T20:35:42.399438] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-23T20:35:43.175490] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T20:35:43.199390] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-23T20:35:43.252005] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T20:35:43.999426] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-23T20:35:44.114315] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T20:35:44.799464] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-23T20:35:45.427326] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T20:35:45.432806] [INFO ] [REMOTE ] CIB: Full fetch complete (45434 records). [2025-10-23T20:35:45.432917] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-23T20:35:45.605505] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-23T20:35:45.819543] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-23T20:35:45.819683] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-23T20:35:45.820363] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-23T20:35:45.820442] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-23T20:35:45.821523] [DEBUG] [LOCAL ] CIB: Trimmed 45434 records to 30473 (keeping 200 days of data) [2025-10-23T20:35:45.994711] [DEBUG] [LOCAL ] CIB: Primary data saved (30473 records). [2025-10-23T20:35:45.994871] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-23T20:35:45.994986] [INFO ] [MAIN ] Update Progress: 448/2367 symbols completed. CIB took 32.1s. Estimated remaining: 3h 58m 35s. Rate: 8.0 symbols/min [2025-10-23T20:35:46.170525] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:35:46.186612] [DEBUG] [LOCAL ] CII: Loaded 15134 existing records from primary storage. [2025-10-23T20:35:46.186898] [INFO ] [MAIN ] CII: Loaded 15134 existing records. [2025-10-23T20:35:46.366384] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:35:46.366688] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-23T20:35:46.366766] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-23T20:35:46.366999] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-23T20:35:46.367074] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-23T20:35:46.409360] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-23T20:35:46.664687] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T20:35:46.758562] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:35:46.789056] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:35:47.199446] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-23T20:35:47.999502] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-23T20:35:48.184228] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T20:35:48.799437] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-23T20:35:48.824886] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T20:35:49.518464] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T20:35:49.599415] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-23T20:35:49.855004] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T20:35:50.399430] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-23T20:35:51.014897] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:35:51.199430] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-23T20:35:51.999421] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-23T20:35:52.380446] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T20:35:52.799419] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-23T20:35:52.884083] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T20:35:53.269265] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T20:35:53.599442] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-23T20:35:54.354383] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T20:35:54.399483] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-23T20:35:54.805121] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T20:35:54.873156] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T20:35:55.199457] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-23T20:35:55.999445] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-23T20:35:56.799443] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-23T20:35:57.191770] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T20:35:57.599528] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-23T20:35:57.677621] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T20:35:58.086744] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T20:35:58.399514] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-23T20:35:59.199414] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-23T20:35:59.392324] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T20:35:59.614611] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T20:35:59.999447] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-23T20:36:00.799444] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-23T20:36:01.599442] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-23T20:36:02.137744] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-23T20:36:02.372492] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-23T20:36:02.399408] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-23T20:36:02.501713] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-23T20:36:02.655844] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T20:36:03.199438] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-23T20:36:03.999464] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-23T20:36:04.053590] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T20:36:04.312004] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T20:36:04.799494] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-23T20:36:05.599430] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-23T20:36:06.211538] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-23T20:36:06.220679] [INFO ] [REMOTE ] CIEN: Full fetch complete (75840 records). [2025-10-23T20:36:06.220823] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-23T20:36:06.400776] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-23T20:36:06.448305] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T20:36:06.633875] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T20:36:06.666203] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-23T20:36:06.666429] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-23T20:36:06.667391] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-23T20:36:06.667499] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-23T20:36:06.669367] [DEBUG] [LOCAL ] CIEN: Trimmed 75840 records to 52498 (keeping 200 days of data) [2025-10-23T20:36:06.966857] [DEBUG] [LOCAL ] CIEN: Primary data saved (52498 records). [2025-10-23T20:36:06.967028] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-23T20:36:06.967945] [INFO ] [MAIN ] Update Progress: 449/2367 symbols completed. CIEN took 29.6s. Estimated remaining: 3h 59m 25s. Rate: 8.0 symbols/min [2025-10-23T20:36:07.136843] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:07.195094] [DEBUG] [LOCAL ] CIM: Loaded 37394 existing records from primary storage. [2025-10-23T20:36:07.195500] [INFO ] [MAIN ] CIM: Loaded 37394 existing records. [2025-10-23T20:36:07.206736] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-23T20:36:07.374793] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:07.374978] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-23T20:36:07.375064] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-23T20:36:07.375260] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-23T20:36:07.375335] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-23T20:36:07.696932] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T20:36:07.752706] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:07.999402] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-23T20:36:08.799434] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-23T20:36:08.994879] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T20:36:09.483526] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T20:36:09.499083] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T20:36:09.500270] [INFO ] [REMOTE ] CIF: Full fetch complete (6560 records). [2025-10-23T20:36:09.500363] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-23T20:36:09.604771] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-23T20:36:09.928755] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-23T20:36:09.928874] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-23T20:36:09.929203] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-23T20:36:09.929292] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-23T20:36:09.929789] [DEBUG] [LOCAL ] CIF: Trimmed 6560 records to 3992 (keeping 200 days of data) [2025-10-23T20:36:09.957097] [DEBUG] [LOCAL ] CIF: Primary data saved (3992 records). [2025-10-23T20:36:09.957235] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-23T20:36:09.957367] [INFO ] [MAIN ] Update Progress: 450/2367 symbols completed. CIF took 30.5s. Estimated remaining: 3h 58m 58s. Rate: 8.0 symbols/min [2025-10-23T20:36:10.132742] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:10.137930] [DEBUG] [LOCAL ] CIMN: Loaded 2705 existing records from primary storage. [2025-10-23T20:36:10.138151] [INFO ] [MAIN ] CIMN: Loaded 2705 existing records. [2025-10-23T20:36:10.311533] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:10.311801] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-23T20:36:10.311898] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-23T20:36:10.312085] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-23T20:36:10.312175] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-23T20:36:10.408735] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-23T20:36:10.670710] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:10.719856] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T20:36:11.199445] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-23T20:36:11.999420] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-23T20:36:12.030438] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T20:36:12.802128] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-23T20:36:12.802379] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T20:36:12.986487] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T20:36:13.599424] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-23T20:36:13.928068] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T20:36:14.399430] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-23T20:36:15.199408] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-23T20:36:15.422835] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T20:36:15.431468] [INFO ] [REMOTE ] CIG: Full fetch complete (62755 records). [2025-10-23T20:36:15.431665] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-23T20:36:15.814185] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-23T20:36:15.814297] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-23T20:36:15.815086] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-23T20:36:15.815166] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-23T20:36:15.816579] [DEBUG] [LOCAL ] CIG: Trimmed 62755 records to 44791 (keeping 200 days of data) [2025-10-23T20:36:16.017860] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-23T20:36:16.104448] [DEBUG] [LOCAL ] CIG: Primary data saved (44791 records). [2025-10-23T20:36:16.104670] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-23T20:36:16.104913] [INFO ] [MAIN ] Update Progress: 451/2367 symbols completed. CIG took 36.4s. Estimated remaining: 3h 58m 45s. Rate: 8.0 symbols/min [2025-10-23T20:36:16.319441] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:16.322359] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-23T20:36:16.322267] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T20:36:16.322792] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-23T20:36:16.335804] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-23T20:36:16.336979] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-23T20:36:16.337608] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-23T20:36:16.337716] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-23T20:36:16.518704] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T20:36:16.606482] [INFO ] [REMOTE ] CII: Full fetch complete (22852 records). [2025-10-23T20:36:16.637161] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-23T20:36:16.811569] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-23T20:36:16.837851] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T20:36:16.890592] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:17.127097] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-23T20:36:17.127224] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-23T20:36:17.127794] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-23T20:36:17.127889] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-23T20:36:17.128617] [DEBUG] [LOCAL ] CII: Trimmed 22852 records to 15213 (keeping 200 days of data) [2025-10-23T20:36:17.219934] [DEBUG] [LOCAL ] CII: Primary data saved (15213 records). [2025-10-23T20:36:17.220096] [INFO ] [MAIN ] CII: Full history saved. [2025-10-23T20:36:17.220207] [INFO ] [MAIN ] Update Progress: 452/2367 symbols completed. CII took 31.2s. Estimated remaining: 3h 58m 11s. Rate: 8.0 symbols/min [2025-10-23T20:36:17.394465] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:17.394768] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-23T20:36:17.394844] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-23T20:36:17.394959] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-23T20:36:17.395028] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-23T20:36:17.395112] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-23T20:36:17.395182] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-23T20:36:17.609232] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-23T20:36:17.756026] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:18.384898] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T20:36:18.399429] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-23T20:36:18.600884] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T20:36:19.009392] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T20:36:19.199484] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-23T20:36:19.604691] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:36:19.605076] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-23T20:36:19.605185] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:36:19.605356] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-23T20:36:19.605442] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:36:19.605536] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-23T20:36:19.605688] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-23T20:36:19.605787] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-23T20:36:19.605938] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-23T20:36:19.606051] [INFO ] [MAIN ] Update Progress: 453/2367 symbols completed. CIMP took 2.4s. Estimated remaining: 3h 57m 42s. Rate: 8.1 symbols/min [2025-10-23T20:36:19.794741] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:19.818045] [DEBUG] [LOCAL ] CINT: Loaded 20384 existing records from primary storage. [2025-10-23T20:36:19.818353] [INFO ] [MAIN ] CINT: Loaded 20384 existing records. [2025-10-23T20:36:20.004541] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-23T20:36:20.039097] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:20.040163] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-23T20:36:20.040244] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-23T20:36:20.040450] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-23T20:36:20.040525] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-23T20:36:20.428138] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:20.721290] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T20:36:20.799436] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-23T20:36:21.551476] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-23T20:36:21.599450] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-23T20:36:22.399437] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-23T20:36:23.199435] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-23T20:36:23.249281] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T20:36:23.271938] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T20:36:23.999465] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-23T20:36:24.478054] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T20:36:24.752001] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-23T20:36:24.799424] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-23T20:36:25.494496] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T20:36:25.599437] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-23T20:36:26.201861] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T20:36:26.399440] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-23T20:36:27.199446] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-23T20:36:27.760139] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T20:36:27.978444] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T20:36:27.999461] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-23T20:36:28.799442] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-23T20:36:29.212895] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T20:36:29.321098] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-23T20:36:29.599450] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-23T20:36:29.989893] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-23T20:36:30.399451] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-23T20:36:30.986785] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T20:36:31.199440] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-23T20:36:31.999440] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-23T20:36:32.431394] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-23T20:36:32.799417] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-23T20:36:33.378166] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T20:36:33.606853] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-23T20:36:33.611508] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T20:36:34.159567] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T20:36:34.399435] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-23T20:36:35.199453] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-23T20:36:35.545331] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:36:35.999462] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-23T20:36:36.799446] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-23T20:36:36.976460] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T20:36:37.150049] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:36:37.530486] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T20:36:37.599461] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-23T20:36:38.399492] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-23T20:36:38.721411] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T20:36:39.199506] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-23T20:36:40.006340] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-23T20:36:40.022043] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T20:36:40.034685] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T20:36:40.576220] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T20:36:40.577347] [INFO ] [REMOTE ] CIMN: Full fetch complete (3901 records). [2025-10-23T20:36:40.577435] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-23T20:36:40.805381] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-23T20:36:40.932963] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-23T20:36:40.933082] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-23T20:36:40.933232] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-23T20:36:40.933301] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-23T20:36:40.933732] [DEBUG] [LOCAL ] CIMN: Trimmed 3901 records to 2715 (keeping 200 days of data) [2025-10-23T20:36:40.950074] [DEBUG] [LOCAL ] CIMN: Primary data saved (2715 records). [2025-10-23T20:36:40.950189] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-23T20:36:40.950275] [INFO ] [MAIN ] Update Progress: 454/2367 symbols completed. CIMN took 31.0s. Estimated remaining: 3h 58m 33s. Rate: 8.0 symbols/min [2025-10-23T20:36:41.128077] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:41.156712] [DEBUG] [LOCAL ] CIO: Loaded 21207 existing records from primary storage. [2025-10-23T20:36:41.157017] [INFO ] [MAIN ] CIO: Loaded 21207 existing records. [2025-10-23T20:36:41.333050] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:41.333249] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-23T20:36:41.333322] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-23T20:36:41.333523] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-23T20:36:41.333593] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-23T20:36:41.602832] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-23T20:36:41.684813] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:42.399415] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-23T20:36:42.635273] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T20:36:42.653377] [INFO ] [REMOTE ] CIM: Full fetch complete (54849 records). [2025-10-23T20:36:42.654121] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-23T20:36:42.654446] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T20:36:43.078959] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-23T20:36:43.079074] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-23T20:36:43.079875] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-23T20:36:43.079956] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-23T20:36:43.081108] [DEBUG] [LOCAL ] CIM: Trimmed 54849 records to 37666 (keeping 200 days of data) [2025-10-23T20:36:43.200276] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-23T20:36:43.304798] [DEBUG] [LOCAL ] CIM: Primary data saved (37666 records). [2025-10-23T20:36:43.304977] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-23T20:36:43.305977] [INFO ] [MAIN ] Update Progress: 455/2367 symbols completed. CIM took 36.3s. Estimated remaining: 3h 58m 4s. Rate: 8.0 symbols/min [2025-10-23T20:36:43.477563] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:43.505925] [DEBUG] [LOCAL ] CION: Loaded 28073 existing records from primary storage. [2025-10-23T20:36:43.506208] [INFO ] [MAIN ] CION: Loaded 28073 existing records. [2025-10-23T20:36:43.685122] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:43.685421] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-23T20:36:43.685495] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-23T20:36:43.685765] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-23T20:36:43.685839] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-23T20:36:43.823103] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T20:36:44.004603] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-23T20:36:44.089506] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:44.422558] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T20:36:44.695553] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T20:36:44.696743] [INFO ] [REMOTE ] CIMO: Full fetch complete (4541 records). [2025-10-23T20:36:44.696833] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-23T20:36:44.802696] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-23T20:36:44.882340] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T20:36:44.882556] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:36:44.882637] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:36:44.882793] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-23T20:36:44.882902] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-23T20:36:44.883004] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-23T20:36:44.883138] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-23T20:36:44.883269] [INFO ] [MAIN ] Update Progress: 456/2367 symbols completed. CIMO took 28.8s. Estimated remaining: 3h 57m 32s. Rate: 8.0 symbols/min [2025-10-23T20:36:45.050179] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:45.096862] [DEBUG] [LOCAL ] CIVI: Loaded 52730 existing records from primary storage. [2025-10-23T20:36:45.097190] [INFO ] [MAIN ] CIVI: Loaded 52730 existing records. [2025-10-23T20:36:45.270758] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:45.270929] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-23T20:36:45.271003] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-23T20:36:45.271226] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-23T20:36:45.271303] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-23T20:36:45.610461] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-23T20:36:45.615312] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:46.269687] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T20:36:46.399472] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-23T20:36:46.811026] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T20:36:47.199474] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-23T20:36:47.680811] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T20:36:47.999473] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-23T20:36:48.799423] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-23T20:36:49.034923] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T20:36:49.061260] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T20:36:49.599422] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-23T20:36:50.004075] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T20:36:50.399428] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-23T20:36:51.199452] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-23T20:36:51.314046] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T20:36:51.646344] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T20:36:51.999432] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-23T20:36:52.651532] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T20:36:52.656985] [INFO ] [REMOTE ] CINT: Full fetch complete (28569 records). [2025-10-23T20:36:52.657090] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-23T20:36:52.805409] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-23T20:36:53.047185] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-23T20:36:53.047292] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-23T20:36:53.047872] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-23T20:36:53.047986] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-23T20:36:53.048731] [DEBUG] [LOCAL ] CINT: Trimmed 28569 records to 20616 (keeping 200 days of data) [2025-10-23T20:36:53.162457] [DEBUG] [LOCAL ] CINT: Primary data saved (20616 records). [2025-10-23T20:36:53.162613] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-23T20:36:53.162747] [INFO ] [MAIN ] Update Progress: 457/2367 symbols completed. CINT took 33.6s. Estimated remaining: 3h 57m 28s. Rate: 8.0 symbols/min [2025-10-23T20:36:53.344063] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:36:53.391967] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-23T20:36:53.392304] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-23T20:36:53.578191] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:36:53.578409] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-23T20:36:53.578486] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-23T20:36:53.578767] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-23T20:36:53.578843] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-23T20:36:53.610562] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-23T20:36:53.968469] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:36:54.003258] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T20:36:54.399481] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-23T20:36:54.465909] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:36:54.879300] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T20:36:55.199431] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-23T20:36:55.999404] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-23T20:36:56.410093] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T20:36:56.693733] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T20:36:56.799412] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-23T20:36:56.922708] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T20:36:57.599493] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-23T20:36:58.399445] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-23T20:36:58.854866] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T20:36:58.911984] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T20:36:59.199435] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-23T20:36:59.875330] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T20:36:59.999455] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-23T20:37:00.799460] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-23T20:37:01.599426] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-23T20:37:01.845805] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T20:37:02.066438] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-10-23T20:37:02.399436] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-23T20:37:03.199491] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-23T20:37:03.238935] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T20:37:03.861200] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-10-23T20:37:03.999446] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-23T20:37:04.425176] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T20:37:04.799433] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-23T20:37:04.888955] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-23T20:37:05.243195] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T20:37:05.599728] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-23T20:37:06.253108] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T20:37:06.399464] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-23T20:37:06.988247] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T20:37:06.993442] [INFO ] [REMOTE ] CIO: Full fetch complete (29860 records). [2025-10-23T20:37:06.993546] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-23T20:37:07.204785] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-23T20:37:07.358058] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-23T20:37:07.358169] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-23T20:37:07.358799] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-23T20:37:07.358879] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-23T20:37:07.359707] [DEBUG] [LOCAL ] CIO: Trimmed 29860 records to 21445 (keeping 200 days of data) [2025-10-23T20:37:07.477046] [DEBUG] [LOCAL ] CIO: Primary data saved (21445 records). [2025-10-23T20:37:07.477196] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-23T20:37:07.477331] [INFO ] [MAIN ] Update Progress: 458/2367 symbols completed. CIO took 26.5s. Estimated remaining: 3h 57m 49s. Rate: 8.0 symbols/min [2025-10-23T20:37:07.644565] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:37:07.678722] [DEBUG] [LOCAL ] CLB: Loaded 33453 existing records from primary storage. [2025-10-23T20:37:07.679062] [INFO ] [MAIN ] CLB: Loaded 33453 existing records. [2025-10-23T20:37:07.852006] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:37:07.852210] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-23T20:37:07.852284] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-23T20:37:07.852673] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-23T20:37:07.852748] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-23T20:37:08.007887] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-23T20:37:08.206740] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:37:08.526854] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T20:37:08.555415] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T20:37:08.799432] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-23T20:37:09.599470] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-23T20:37:10.120344] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-23T20:37:10.399402] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-23T20:37:10.525703] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T20:37:10.972616] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T20:37:11.199459] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-23T20:37:11.999422] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-23T20:37:12.642994] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-23T20:37:12.696796] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T20:37:12.799433] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-23T20:37:13.330052] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T20:37:13.335945] [INFO ] [REMOTE ] CION: Full fetch complete (40632 records). [2025-10-23T20:37:13.336232] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-23T20:37:13.604825] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-23T20:37:13.715001] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-23T20:37:13.715113] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-23T20:37:13.716253] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-23T20:37:13.716342] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-23T20:37:13.717664] [DEBUG] [LOCAL ] CION: Trimmed 40632 records to 28261 (keeping 200 days of data) [2025-10-23T20:37:13.877563] [DEBUG] [LOCAL ] CION: Primary data saved (28261 records). [2025-10-23T20:37:13.877746] [INFO ] [MAIN ] CION: Full history saved. [2025-10-23T20:37:13.877863] [INFO ] [MAIN ] Update Progress: 459/2367 symbols completed. CION took 30.6s. Estimated remaining: 3h 57m 37s. Rate: 8.0 symbols/min [2025-10-23T20:37:14.044694] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:37:14.044886] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-10-23T20:37:14.044956] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-10-23T20:37:14.045039] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-23T20:37:14.045084] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-23T20:37:14.045127] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-23T20:37:14.045191] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-23T20:37:14.403278] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-23T20:37:14.403180] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:37:14.424474] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T20:37:15.199408] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-23T20:37:15.935071] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-23T20:37:15.999437] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-23T20:37:16.451393] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T20:37:16.505621] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:37:16.799439] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-23T20:37:17.599458] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-23T20:37:18.113885] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T20:37:18.234051] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T20:37:18.399446] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-23T20:37:19.199444] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-23T20:37:19.353022] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T20:37:19.999429] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-23T20:37:20.796071] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-23T20:37:20.809622] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-23T20:37:21.240847] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T20:37:21.267571] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T20:37:21.599433] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-23T20:37:21.879030] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T20:37:22.399463] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-23T20:37:23.199447] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-23T20:37:23.715573] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-23T20:37:23.725355] [INFO ] [REMOTE ] CIVI: Full fetch complete (76084 records). [2025-10-23T20:37:23.725518] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-23T20:37:23.911347] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T20:37:24.004528] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-23T20:37:24.159713] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-23T20:37:24.159835] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-23T20:37:24.160840] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-23T20:37:24.160924] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-23T20:37:24.162405] [DEBUG] [LOCAL ] CIVI: Trimmed 76084 records to 53109 (keeping 200 days of data) [2025-10-23T20:37:24.478965] [DEBUG] [LOCAL ] CIVI: Primary data saved (53109 records). [2025-10-23T20:37:24.479125] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-23T20:37:24.479237] [INFO ] [MAIN ] Update Progress: 460/2367 symbols completed. CIVI took 39.6s. Estimated remaining: 3h 57m 42s. Rate: 8.0 symbols/min [2025-10-23T20:37:24.658409] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:37:24.684109] [DEBUG] [LOCAL ] CLDT: Loaded 25165 existing records from primary storage. [2025-10-23T20:37:24.684426] [INFO ] [MAIN ] CLDT: Loaded 25165 existing records. [2025-10-23T20:37:24.804523] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-23T20:37:24.864719] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:37:24.865015] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-23T20:37:24.865090] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-23T20:37:24.865384] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-23T20:37:24.865456] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-23T20:37:25.218472] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:37:25.315415] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T20:37:25.503527] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-23T20:37:25.599405] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-23T20:37:26.318507] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T20:37:26.399443] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-23T20:37:27.199415] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-23T20:37:27.442725] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T20:37:27.460180] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-23T20:37:27.461238] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-23T20:37:27.461135] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T20:37:27.854699] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-23T20:37:27.854817] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-23T20:37:27.855728] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-23T20:37:27.855808] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-23T20:37:27.857383] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 54039 (keeping 200 days of data) [2025-10-23T20:37:28.033758] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-23T20:37:28.186390] [DEBUG] [LOCAL ] CL: Primary data saved (54039 records). [2025-10-23T20:37:28.186553] [INFO ] [MAIN ] CL: Full history saved. [2025-10-23T20:37:28.186665] [INFO ] [MAIN ] Update Progress: 461/2367 symbols completed. CL took 35.0s. Estimated remaining: 3h 57m 19s. Rate: 8.0 symbols/min [2025-10-23T20:37:28.358744] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:37:28.405901] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-23T20:37:28.406228] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-23T20:37:28.604353] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T20:37:28.603387] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:37:28.611414] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-23T20:37:28.611503] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-23T20:37:28.612066] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-23T20:37:28.612141] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-23T20:37:28.808085] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-23T20:37:28.985751] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T20:37:28.990202] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:37:29.599470] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-23T20:37:30.224286] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T20:37:30.295377] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T20:37:30.399417] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-23T20:37:31.199417] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-23T20:37:31.321523] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T20:37:31.999429] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-23T20:37:32.439135] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T20:37:32.799437] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-23T20:37:33.599430] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-23T20:37:33.810698] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T20:37:34.206490] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-23T20:37:34.399418] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-23T20:37:35.199447] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-23T20:37:35.234602] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T20:37:35.999453] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-23T20:37:36.415425] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T20:37:36.419598] [INFO ] [REMOTE ] CLCO: Full fetch complete (22816 records). [2025-10-23T20:37:36.419713] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-23T20:37:36.790372] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-23T20:37:36.812508] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-23T20:37:36.799699] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-23T20:37:36.817033] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-23T20:37:36.818204] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-23T20:37:36.828184] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-23T20:37:36.829519] [DEBUG] [LOCAL ] CLCO: Trimmed 22816 records to 13277 (keeping 200 days of data) [2025-10-23T20:37:36.901454] [DEBUG] [LOCAL ] CLCO: Primary data saved (13277 records). [2025-10-23T20:37:36.901613] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-23T20:37:36.901724] [INFO ] [MAIN ] Update Progress: 462/2367 symbols completed. CLCO took 23.0s. Estimated remaining: 3h 57m 17s. Rate: 8.0 symbols/min [2025-10-23T20:37:37.071751] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:37:37.098005] [DEBUG] [LOCAL ] CLH: Loaded 27584 existing records from primary storage. [2025-10-23T20:37:37.098366] [INFO ] [MAIN ] CLH: Loaded 27584 existing records. [2025-10-23T20:37:37.282000] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:37:37.282321] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-23T20:37:37.282416] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-23T20:37:37.282775] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-23T20:37:37.282852] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-23T20:37:37.649380] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:37:37.627996] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-23T20:37:37.666538] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T20:37:37.673267] [INFO ] [REMOTE ] CLB: Full fetch complete (47482 records). [2025-10-23T20:37:37.673395] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-23T20:37:38.055949] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-23T20:37:38.056077] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-23T20:37:38.056846] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-23T20:37:38.056942] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-23T20:37:38.058003] [DEBUG] [LOCAL ] CLB: Trimmed 47482 records to 33810 (keeping 200 days of data) [2025-10-23T20:37:38.273207] [DEBUG] [LOCAL ] CLB: Primary data saved (33810 records). [2025-10-23T20:37:38.274692] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T20:37:38.274035] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-23T20:37:38.275787] [INFO ] [MAIN ] Update Progress: 463/2367 symbols completed. CLB took 30.8s. Estimated remaining: 3h 56m 44s. Rate: 8.0 symbols/min [2025-10-23T20:37:38.404552] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-23T20:37:38.459012] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:37:38.472410] [DEBUG] [LOCAL ] CLPR: Loaded 9996 existing records from primary storage. [2025-10-23T20:37:38.472682] [INFO ] [MAIN ] CLPR: Loaded 9996 existing records. [2025-10-23T20:37:38.645218] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:37:38.645454] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-23T20:37:38.645579] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-23T20:37:38.645847] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-23T20:37:38.645930] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-23T20:37:38.993922] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:37:39.199437] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-23T20:37:39.789712] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T20:37:39.986926] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-23T20:37:39.999391] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-23T20:37:40.385480] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T20:37:40.799443] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-23T20:37:41.599496] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-23T20:37:42.324673] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T20:37:42.399413] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-23T20:37:42.426350] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T20:37:42.472076] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-23T20:37:43.199471] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-23T20:37:43.697939] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T20:37:43.999416] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-23T20:37:44.049849] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T20:37:44.799457] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-23T20:37:45.599463] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-23T20:37:45.883127] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T20:37:46.386313] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-23T20:37:46.399396] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-23T20:37:47.113559] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T20:37:47.199417] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-23T20:37:47.999439] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-23T20:37:48.729467] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-23T20:37:48.799413] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-23T20:37:48.945303] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T20:37:49.366704] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T20:37:49.599440] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-23T20:37:50.399424] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-23T20:37:50.755786] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T20:37:51.203876] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T20:37:51.202561] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-23T20:37:51.247409] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-23T20:37:51.999480] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-23T20:37:52.502607] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T20:37:52.799494] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-23T20:37:52.909541] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T20:37:53.599464] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-23T20:37:54.072072] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T20:37:54.399427] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-23T20:37:54.538725] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T20:37:55.199446] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-23T20:37:55.999508] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-23T20:37:56.680256] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-23T20:37:56.709471] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T20:37:56.799403] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-23T20:37:56.947253] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T20:37:57.599450] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-23T20:37:58.050737] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T20:37:58.399745] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-23T20:37:59.199440] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-23T20:37:59.401783] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T20:37:59.782358] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-23T20:37:59.999434] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-23T20:38:00.697251] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T20:38:00.799451] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-23T20:38:01.599458] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-23T20:38:02.399434] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-23T20:38:02.444599] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-23T20:38:02.454134] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-23T20:38:02.454320] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-23T20:38:02.777889] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:38:02.803981] [INFO ] [REMOTE ] CLDT: Full fetch complete (37655 records). [2025-10-23T20:38:02.837755] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-23T20:38:02.890301] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-23T20:38:02.890561] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-23T20:38:02.891559] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-23T20:38:02.924432] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-23T20:38:03.005969] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54131 (keeping 200 days of data) [2025-10-23T20:38:03.289477] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T20:38:03.312182] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-23T20:38:03.416959] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-23T20:38:03.422311] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T20:38:03.428395] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-23T20:38:03.431252] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-23T20:38:03.431438] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-23T20:38:03.490603] [DEBUG] [LOCAL ] CLDT: Trimmed 37655 records to 25339 (keeping 200 days of data) [2025-10-23T20:38:03.768730] [DEBUG] [LOCAL ] CLDT: Primary data saved (25339 records). [2025-10-23T20:38:03.770467] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-23T20:38:03.770872] [INFO ] [MAIN ] Update Progress: 464/2367 symbols completed. CLDT took 39.3s. Estimated remaining: 3h 57m 51s. Rate: 8.0 symbols/min [2025-10-23T20:38:03.957112] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:03.955574] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-23T20:38:03.957342] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-23T20:38:03.957728] [INFO ] [MAIN ] Update Progress: 465/2367 symbols completed. CLF took 35.8s. Estimated remaining: 3h 57m 13s. Rate: 8.0 symbols/min [2025-10-23T20:38:04.012418] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-23T20:38:04.131919] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:04.168920] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-23T20:38:04.169337] [INFO ] [MAIN ] CLS: Loaded 53563 existing records. [2025-10-23T20:38:04.366352] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T20:38:04.375998] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:04.379079] [INFO ] [REMOTE ] CLPR: Full fetch complete (15838 records). [2025-10-23T20:38:04.379337] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-23T20:38:04.394487] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-23T20:38:04.394248] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-23T20:38:04.395674] [DEBUG] [LOCAL ] CLVT: Loaded 51912 existing records from primary storage. [2025-10-23T20:38:04.395720] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-23T20:38:04.407868] [INFO ] [MAIN ] CLVT: Loaded 51912 existing records. [2025-10-23T20:38:04.407988] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-23T20:38:04.992270] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:05.083992] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-23T20:38:05.108170] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-23T20:38:05.144430] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-23T20:38:05.242722] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-23T20:38:05.233393] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-23T20:38:05.253044] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-23T20:38:05.289880] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-23T20:38:05.322668] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-23T20:38:05.370186] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:05.383831] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-23T20:38:05.398242] [DEBUG] [LOCAL ] CLPR: Trimmed 15838 records to 10044 (keeping 200 days of data) [2025-10-23T20:38:05.691203] [DEBUG] [LOCAL ] CLPR: Primary data saved (10044 records). [2025-10-23T20:38:05.767318] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-23T20:38:05.772885] [INFO ] [MAIN ] Update Progress: 466/2367 symbols completed. CLPR took 27.5s. Estimated remaining: 3h 56m 43s. Rate: 8.0 symbols/min [2025-10-23T20:38:05.772740] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:05.793615] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-23T20:38:05.853248] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T20:38:05.965125] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:05.985406] [DEBUG] [LOCAL ] CLW: Loaded 21127 existing records from primary storage. [2025-10-23T20:38:05.985690] [INFO ] [MAIN ] CLW: Loaded 21127 existing records. [2025-10-23T20:38:06.160205] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:06.160402] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-23T20:38:06.160474] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-23T20:38:06.160707] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-23T20:38:06.160786] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-23T20:38:06.408119] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-23T20:38:06.513626] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:07.199474] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-23T20:38:07.743305] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T20:38:07.848677] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-23T20:38:07.877343] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T20:38:07.883268] [INFO ] [REMOTE ] CLH: Full fetch complete (42219 records). [2025-10-23T20:38:07.883443] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-23T20:38:08.004612] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-23T20:38:08.265108] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-23T20:38:08.265218] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-23T20:38:08.266010] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-23T20:38:08.266098] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-23T20:38:08.267152] [DEBUG] [LOCAL ] CLH: Trimmed 42219 records to 27786 (keeping 200 days of data) [2025-10-23T20:38:08.430007] [DEBUG] [LOCAL ] CLH: Primary data saved (27786 records). [2025-10-23T20:38:08.430173] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-23T20:38:08.430316] [INFO ] [MAIN ] Update Progress: 467/2367 symbols completed. CLH took 31.5s. Estimated remaining: 3h 56m 16s. Rate: 8.0 symbols/min [2025-10-23T20:38:08.603976] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:08.661256] [DEBUG] [LOCAL ] CLX: Loaded 51814 existing records from primary storage. [2025-10-23T20:38:08.661815] [INFO ] [MAIN ] CLX: Loaded 51814 existing records. [2025-10-23T20:38:08.800437] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-23T20:38:08.844494] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:08.845153] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-23T20:38:08.845347] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-23T20:38:08.862072] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-23T20:38:08.862673] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T20:38:08.862851] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-23T20:38:09.219381] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:09.599481] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-23T20:38:10.094538] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-23T20:38:10.399423] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-23T20:38:11.032983] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T20:38:11.174046] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-23T20:38:11.199398] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-23T20:38:11.999455] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-23T20:38:12.290770] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T20:38:12.799443] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-23T20:38:13.599429] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-23T20:38:13.797175] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-23T20:38:13.913970] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T20:38:14.399425] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-23T20:38:14.417894] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T20:38:14.730726] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:38:15.199462] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-23T20:38:15.999426] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-23T20:38:16.424488] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T20:38:16.799453] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-23T20:38:17.106468] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T20:38:17.290402] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T20:38:17.599446] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-23T20:38:18.399418] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-23T20:38:19.101684] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-23T20:38:19.199397] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-23T20:38:19.249838] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T20:38:19.523316] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T20:38:19.999441] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-23T20:38:20.799443] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-23T20:38:21.402709] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T20:38:21.599400] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-23T20:38:21.916541] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-23T20:38:22.399469] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-23T20:38:22.686227] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T20:38:22.710744] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T20:38:23.199442] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-23T20:38:23.999428] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-23T20:38:24.458395] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T20:38:24.803835] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-23T20:38:24.809255] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-23T20:38:25.599440] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-23T20:38:25.988802] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T20:38:26.055346] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T20:38:26.399441] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-23T20:38:27.199426] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-23T20:38:27.544736] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T20:38:27.999438] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-23T20:38:28.671469] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-23T20:38:28.799443] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-23T20:38:29.195286] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T20:38:29.599418] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-23T20:38:29.678099] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T20:38:30.399431] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-23T20:38:30.843989] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T20:38:30.847975] [INFO ] [REMOTE ] CLW: Full fetch complete (33630 records). [2025-10-23T20:38:30.848081] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-23T20:38:31.208847] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-23T20:38:31.241779] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-23T20:38:31.242799] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-23T20:38:31.243590] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-23T20:38:31.243915] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-23T20:38:31.244938] [DEBUG] [LOCAL ] CLW: Trimmed 33630 records to 21377 (keeping 200 days of data) [2025-10-23T20:38:31.363400] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-23T20:38:31.407915] [DEBUG] [LOCAL ] CLW: Primary data saved (21377 records). [2025-10-23T20:38:31.408070] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-23T20:38:31.408178] [INFO ] [MAIN ] Update Progress: 468/2367 symbols completed. CLW took 25.6s. Estimated remaining: 3h 57m 11s. Rate: 8.0 symbols/min [2025-10-23T20:38:31.573981] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:31.623889] [DEBUG] [LOCAL ] CM: Loaded 48431 existing records from primary storage. [2025-10-23T20:38:31.624232] [INFO ] [MAIN ] CM: Loaded 48431 existing records. [2025-10-23T20:38:31.804602] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:31.804847] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-23T20:38:31.804942] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-23T20:38:31.805278] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-23T20:38:31.805367] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-23T20:38:32.006106] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-23T20:38:32.168152] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:32.408872] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T20:38:32.799410] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-23T20:38:32.853627] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T20:38:33.599424] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-23T20:38:34.399431] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-23T20:38:34.553279] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-23T20:38:34.589188] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T20:38:35.199441] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-23T20:38:35.780704] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T20:38:35.999443] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-23T20:38:36.123467] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T20:38:36.793374] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T20:38:36.801940] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-23T20:38:37.599451] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-23T20:38:38.012555] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T20:38:38.399491] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-23T20:38:38.688357] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T20:38:38.697354] [INFO ] [REMOTE ] CLVT: Full fetch complete (75403 records). [2025-10-23T20:38:38.697513] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-23T20:38:39.087755] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-23T20:38:39.087897] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-23T20:38:39.088920] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-23T20:38:39.089028] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-23T20:38:39.090497] [DEBUG] [LOCAL ] CLVT: Trimmed 75403 records to 52276 (keeping 200 days of data) [2025-10-23T20:38:39.241044] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-23T20:38:39.385551] [DEBUG] [LOCAL ] CLVT: Primary data saved (52276 records). [2025-10-23T20:38:39.385759] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-23T20:38:39.385874] [INFO ] [MAIN ] Update Progress: 469/2367 symbols completed. CLVT took 35.4s. Estimated remaining: 3h 57m 6s. Rate: 8.0 symbols/min [2025-10-23T20:38:39.560364] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:39.589600] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:38:39.638808] [DEBUG] [LOCAL ] CMA: Loaded 50170 existing records from primary storage. [2025-10-23T20:38:39.639180] [INFO ] [MAIN ] CMA: Loaded 50170 existing records. [2025-10-23T20:38:39.819148] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:39.819368] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-23T20:38:39.819450] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-23T20:38:39.819818] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-23T20:38:39.819893] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-23T20:38:40.006038] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-23T20:38:40.193207] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:40.246877] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:38:40.256220] [INFO ] [REMOTE ] CLX: Full fetch complete (73878 records). [2025-10-23T20:38:40.256433] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-23T20:38:40.662057] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-23T20:38:40.662199] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-23T20:38:40.663399] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-23T20:38:40.684618] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-23T20:38:40.686453] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T20:38:40.695758] [DEBUG] [LOCAL ] CLX: Trimmed 73878 records to 52189 (keeping 200 days of data) [2025-10-23T20:38:40.695877] [INFO ] [REMOTE ] CLS: Full fetch complete (77327 records). [2025-10-23T20:38:40.696154] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-23T20:38:40.697547] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:38:40.697728] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:38:40.697797] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:38:40.697875] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-23T20:38:40.697993] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-23T20:38:40.698068] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-23T20:38:40.698704] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-10-23T20:38:40.698822] [INFO ] [MAIN ] Update Progress: 470/2367 symbols completed. CLS took 36.9s. Estimated remaining: 3h 56m 33s. Rate: 8.0 symbols/min [2025-10-23T20:38:40.809898] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-23T20:38:41.009352] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:41.144976] [DEBUG] [LOCAL ] CMBT: Loaded 27509 existing records from primary storage. [2025-10-23T20:38:41.150903] [INFO ] [MAIN ] CMBT: Loaded 27509 existing records. [2025-10-23T20:38:41.411505] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:41.413950] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-23T20:38:41.414047] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-23T20:38:41.416566] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-23T20:38:41.417384] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-23T20:38:41.570910] [DEBUG] [LOCAL ] CLX: Primary data saved (52189 records). [2025-10-23T20:38:41.589676] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-23T20:38:41.606546] [INFO ] [MAIN ] Update Progress: 471/2367 symbols completed. CLX took 33.2s. Estimated remaining: 3h 55m 59s. Rate: 8.0 symbols/min [2025-10-23T20:38:41.946135] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:38:41.990873] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:41.991527] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-23T20:38:42.023774] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T20:38:42.070222] [DEBUG] [LOCAL ] CMC: Loaded 45548 existing records from primary storage. [2025-10-23T20:38:42.070637] [INFO ] [MAIN ] CMC: Loaded 45548 existing records. [2025-10-23T20:38:42.254723] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:38:42.255059] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-23T20:38:42.255267] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-23T20:38:42.255563] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-23T20:38:42.255816] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-23T20:38:42.408304] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-23T20:38:42.637093] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T20:38:42.675126] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:38:43.199456] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-23T20:38:43.999446] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-23T20:38:44.110300] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-23T20:38:44.493287] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-23T20:38:44.799450] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-23T20:38:45.134057] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:38:45.599424] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-23T20:38:45.831302] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T20:38:45.948023] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T20:38:46.399428] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-23T20:38:47.199455] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-23T20:38:47.479779] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T20:38:47.523252] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T20:38:47.999513] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-23T20:38:48.799445] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-23T20:38:49.073541] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T20:38:49.207712] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T20:38:49.599473] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-23T20:38:50.399472] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-23T20:38:50.445873] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T20:38:51.199498] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-23T20:38:51.682459] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-23T20:38:51.999499] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-23T20:38:52.336829] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T20:38:52.799471] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-23T20:38:53.180815] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T20:38:53.387713] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T20:38:53.599448] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-23T20:38:54.399473] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-23T20:38:54.604702] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T20:38:55.199470] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-23T20:38:55.614563] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-23T20:38:55.999461] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-23T20:38:56.306561] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T20:38:56.799428] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-23T20:38:57.119835] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-23T20:38:57.168310] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T20:38:57.599471] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-23T20:38:58.399479] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-23T20:38:58.555715] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T20:38:59.204569] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-23T20:38:59.228425] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T20:39:00.005847] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-23T20:39:00.012697] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T20:39:00.322855] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T20:39:00.799466] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-23T20:39:01.599489] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-23T20:39:02.071866] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T20:39:02.399463] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-23T20:39:02.920739] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T20:39:03.199482] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-23T20:39:03.572475] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T20:39:03.999427] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-23T20:39:04.127689] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T20:39:04.799444] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-23T20:39:04.907359] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T20:39:05.599447] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-23T20:39:05.778976] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T20:39:05.787899] [INFO ] [REMOTE ] CM: Full fetch complete (69779 records). [2025-10-23T20:39:05.788175] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-23T20:39:06.185954] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-23T20:39:06.186068] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-23T20:39:06.187020] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-23T20:39:06.187109] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-23T20:39:06.188610] [DEBUG] [LOCAL ] CM: Trimmed 69779 records to 48681 (keeping 200 days of data) [2025-10-23T20:39:06.409400] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-23T20:39:06.498602] [DEBUG] [LOCAL ] CM: Primary data saved (48681 records). [2025-10-23T20:39:06.498818] [INFO ] [MAIN ] CM: Full history saved. [2025-10-23T20:39:06.499781] [INFO ] [MAIN ] Update Progress: 472/2367 symbols completed. CM took 35.1s. Estimated remaining: 3h 57m 2s. Rate: 8.0 symbols/min [2025-10-23T20:39:06.680258] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:06.688548] [DEBUG] [LOCAL ] CMCM: Loaded 4828 existing records from primary storage. [2025-10-23T20:39:06.688833] [INFO ] [MAIN ] CMCM: Loaded 4828 existing records. [2025-10-23T20:39:06.890769] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:06.891103] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-23T20:39:06.891222] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-23T20:39:06.891540] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-23T20:39:06.891716] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-23T20:39:07.283552] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:07.284614] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-23T20:39:07.289030] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-23T20:39:07.325533] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T20:39:07.334419] [INFO ] [REMOTE ] CMBT: Full fetch complete (34169 records). [2025-10-23T20:39:07.334564] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-23T20:39:07.707188] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-23T20:39:07.707309] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-23T20:39:07.707881] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-23T20:39:07.707999] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-23T20:39:07.708930] [DEBUG] [LOCAL ] CMBT: Trimmed 34169 records to 27899 (keeping 200 days of data) [2025-10-23T20:39:07.876872] [DEBUG] [LOCAL ] CMBT: Primary data saved (27899 records). [2025-10-23T20:39:07.877043] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-23T20:39:07.877174] [INFO ] [MAIN ] Update Progress: 473/2367 symbols completed. CMBT took 27.2s. Estimated remaining: 3h 56m 30s. Rate: 8.0 symbols/min [2025-10-23T20:39:08.002109] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-23T20:39:08.053945] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:08.055175] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-23T20:39:08.055278] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-23T20:39:08.055487] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-23T20:39:08.055629] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-23T20:39:08.056023] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-23T20:39:08.056231] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-23T20:39:08.221135] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T20:39:08.280246] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T20:39:08.498361] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:08.799459] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-23T20:39:09.599447] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-23T20:39:09.626200] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T20:39:09.897872] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:39:09.906965] [INFO ] [REMOTE ] CMA: Full fetch complete (73528 records). [2025-10-23T20:39:09.907115] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-23T20:39:10.329539] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-23T20:39:10.329690] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-23T20:39:10.330546] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-23T20:39:10.330625] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-23T20:39:10.332075] [DEBUG] [LOCAL ] CMA: Trimmed 73528 records to 50557 (keeping 200 days of data) [2025-10-23T20:39:10.421637] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-23T20:39:10.638877] [DEBUG] [LOCAL ] CMA: Primary data saved (50557 records). [2025-10-23T20:39:10.639042] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-23T20:39:10.639157] [INFO ] [MAIN ] Update Progress: 474/2367 symbols completed. CMA took 31.3s. Estimated remaining: 3h 56m 3s. Rate: 8.0 symbols/min [2025-10-23T20:39:10.808549] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:10.808776] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-23T20:39:10.808850] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-23T20:39:10.808962] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-23T20:39:10.809034] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-23T20:39:10.809117] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-23T20:39:10.809208] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-23T20:39:11.178042] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:11.199400] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-23T20:39:11.269712] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T20:39:11.333151] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T20:39:11.999478] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-23T20:39:12.640191] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T20:39:12.799450] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-23T20:39:13.391145] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T20:39:13.499163] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T20:39:13.599417] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-23T20:39:14.399479] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-23T20:39:15.199465] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-23T20:39:15.478437] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T20:39:15.486999] [INFO ] [REMOTE ] CMC: Full fetch complete (67256 records). [2025-10-23T20:39:15.487174] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-23T20:39:15.556157] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T20:39:15.877667] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-23T20:39:15.877769] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-23T20:39:15.878619] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-23T20:39:15.878718] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-23T20:39:15.880090] [DEBUG] [LOCAL ] CMC: Trimmed 67256 records to 45922 (keeping 200 days of data) [2025-10-23T20:39:16.001983] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-23T20:39:16.153375] [DEBUG] [LOCAL ] CMC: Primary data saved (45922 records). [2025-10-23T20:39:16.153560] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-23T20:39:16.153753] [INFO ] [MAIN ] Update Progress: 475/2367 symbols completed. CMC took 34.5s. Estimated remaining: 3h 55m 48s. Rate: 8.0 symbols/min [2025-10-23T20:39:16.321975] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:16.358979] [DEBUG] [LOCAL ] CMI: Loaded 41637 existing records from primary storage. [2025-10-23T20:39:16.359301] [INFO ] [MAIN ] CMI: Loaded 41637 existing records. [2025-10-23T20:39:16.533957] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:16.534161] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-23T20:39:16.534235] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-23T20:39:16.534451] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-23T20:39:16.534521] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-23T20:39:16.810307] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-23T20:39:16.895831] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:16.913718] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T20:39:17.224125] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:39:17.224557] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-23T20:39:17.224681] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:39:17.224779] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-23T20:39:17.224867] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:39:17.224966] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-23T20:39:17.225088] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-23T20:39:17.225178] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-23T20:39:17.225291] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-23T20:39:17.225398] [INFO ] [MAIN ] Update Progress: 476/2367 symbols completed. CMDB took 9.3s. Estimated remaining: 3h 55m 15s. Rate: 8.0 symbols/min [2025-10-23T20:39:17.405491] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:17.438552] [DEBUG] [LOCAL ] CMP: Loaded 35683 existing records from primary storage. [2025-10-23T20:39:17.438965] [INFO ] [MAIN ] CMP: Loaded 35683 existing records. [2025-10-23T20:39:17.623737] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:17.602464] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-23T20:39:17.625071] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-23T20:39:17.625193] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-23T20:39:17.634679] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-23T20:39:17.652929] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-23T20:39:17.651190] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-23T20:39:18.034912] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:18.399442] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-23T20:39:19.199446] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-23T20:39:19.495685] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T20:39:19.966160] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T20:39:19.999417] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-23T20:39:20.799411] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-23T20:39:20.846537] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-23T20:39:21.556907] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T20:39:21.599408] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-23T20:39:22.407472] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T20:39:22.405886] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-23T20:39:22.599347] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T20:39:23.199436] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-23T20:39:23.997846] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T20:39:24.004955] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-23T20:39:24.799421] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-23T20:39:25.067459] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T20:39:25.540636] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T20:39:25.542197] [INFO ] [REMOTE ] CMCM: Full fetch complete (7073 records). [2025-10-23T20:39:25.542316] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-23T20:39:25.604704] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-23T20:39:25.902084] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-23T20:39:25.902210] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-23T20:39:25.902475] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-23T20:39:25.902549] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-23T20:39:25.903126] [DEBUG] [LOCAL ] CMCM: Trimmed 7073 records to 4858 (keeping 200 days of data) [2025-10-23T20:39:25.932048] [DEBUG] [LOCAL ] CMCM: Primary data saved (4858 records). [2025-10-23T20:39:25.932228] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-23T20:39:25.932372] [INFO ] [MAIN ] Update Progress: 477/2367 symbols completed. CMCM took 19.4s. Estimated remaining: 3h 55m 13s. Rate: 8.0 symbols/min [2025-10-23T20:39:26.354932] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-23T20:39:26.399401] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-23T20:39:27.199413] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-23T20:39:27.257336] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:39:27.999442] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-23T20:39:28.895753] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-23T20:39:28.907140] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-23T20:39:29.208252] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T20:39:29.599440] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-23T20:39:29.781012] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T20:39:30.399443] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-23T20:39:31.063762] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-23T20:39:31.199404] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-23T20:39:31.473257] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:39:31.999406] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-23T20:39:32.220841] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T20:39:32.799441] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-23T20:39:33.609857] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T20:39:33.618007] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-23T20:39:33.649687] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-23T20:39:34.399419] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-23T20:39:34.475083] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T20:39:35.199454] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-23T20:39:35.574925] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T20:39:35.999434] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-23T20:39:36.982516] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T20:39:36.994491] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-23T20:39:37.005713] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-23T20:39:37.599428] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-23T20:39:37.792232] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T20:39:38.170506] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T20:39:38.399541] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-23T20:39:39.199449] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-23T20:39:40.054611] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-23T20:39:40.066212] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-23T20:39:40.151288] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T20:39:40.566565] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T20:39:40.799460] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-23T20:39:41.599442] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-23T20:39:42.788016] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-23T20:39:42.798057] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-23T20:39:42.798266] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-23T20:39:43.097712] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-23T20:39:43.165495] [INFO ] [REMOTE ] CMP: Full fetch complete (51507 records). [2025-10-23T20:39:43.229582] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-23T20:39:43.545567] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-23T20:39:43.580529] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:39:43.590966] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-23T20:39:43.608781] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-23T20:39:43.631456] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-23T20:39:43.655733] [INFO ] [REMOTE ] CMI: Full fetch complete (61177 records). [2025-10-23T20:39:43.668364] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-23T20:39:43.734864] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54112 (keeping 200 days of data) [2025-10-23T20:39:44.244118] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-23T20:39:44.262038] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-23T20:39:44.268556] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-23T20:39:44.268699] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-23T20:39:44.381712] [DEBUG] [LOCAL ] CMP: Trimmed 51507 records to 35825 (keeping 200 days of data) [2025-10-23T20:39:44.566762] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-23T20:39:44.568723] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-23T20:39:44.577363] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-23T20:39:44.579600] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-23T20:39:44.690743] [DEBUG] [LOCAL ] CMI: Trimmed 61177 records to 41922 (keeping 200 days of data) [2025-10-23T20:39:44.944285] [DEBUG] [LOCAL ] CMG: Primary data saved (54112 records). [2025-10-23T20:39:44.973428] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-23T20:39:44.977363] [INFO ] [MAIN ] Update Progress: 478/2367 symbols completed. CMG took 34.3s. Estimated remaining: 3h 55m 51s. Rate: 8.0 symbols/min [2025-10-23T20:39:45.024146] [DEBUG] [LOCAL ] CMP: Primary data saved (35825 records). [2025-10-23T20:39:45.028315] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-23T20:39:45.028466] [INFO ] [MAIN ] Update Progress: 479/2367 symbols completed. CMP took 27.8s. Estimated remaining: 3h 55m 14s. Rate: 8.0 symbols/min [2025-10-23T20:39:45.156285] [DEBUG] [LOCAL ] CMI: Primary data saved (41922 records). [2025-10-23T20:39:45.156445] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-23T20:39:45.157521] [INFO ] [MAIN ] Update Progress: 480/2367 symbols completed. CMI took 29.0s. Estimated remaining: 3h 54m 38s. Rate: 8.0 symbols/min [2025-10-23T20:39:45.751907] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:45.811448] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:45.844051] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:45.853424] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:45.860366] [DEBUG] [LOCAL ] CMSA: Loaded 3471 existing records from primary storage. [2025-10-23T20:39:45.860835] [INFO ] [MAIN ] CMSA: Loaded 3471 existing records. [2025-10-23T20:39:46.089837] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:46.091140] [DEBUG] [LOCAL ] CMRE: Loaded 35651 existing records from primary storage. [2025-10-23T20:39:46.091427] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-23T20:39:46.103089] [INFO ] [MAIN ] CMRE: Loaded 35651 existing records. [2025-10-23T20:39:46.103250] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-23T20:39:46.147343] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-23T20:39:46.147875] [DEBUG] [LOCAL ] CMPO: Loaded 38424 existing records from primary storage. [2025-10-23T20:39:46.192285] [DEBUG] [LOCAL ] CMS: Loaded 52551 existing records from primary storage. [2025-10-23T20:39:46.208179] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-23T20:39:46.223207] [INFO ] [MAIN ] CMS: Loaded 52551 existing records. [2025-10-23T20:39:46.208274] [INFO ] [MAIN ] CMPO: Loaded 38424 existing records. [2025-10-23T20:39:46.516090] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:46.571869] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-23T20:39:46.587429] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-23T20:39:46.659960] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-23T20:39:46.675064] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-23T20:39:46.746215] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:46.855457] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-23T20:39:46.892113] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-23T20:39:46.950803] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:46.983183] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-23T20:39:46.988364] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-23T20:39:47.020456] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-23T20:39:47.020559] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-23T20:39:47.102591] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-23T20:39:47.161730] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-23T20:39:47.361720] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:47.421881] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-23T20:39:47.878905] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:47.919276] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-23T20:39:48.038991] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:48.076637] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-23T20:39:48.115304] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:48.115775] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-23T20:39:48.408318] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T20:39:48.409819] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-23T20:39:48.978229] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T20:39:48.979475] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-23T20:39:49.374388] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T20:39:49.380933] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-23T20:39:49.598905] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-23T20:39:49.600232] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-23T20:39:49.830585] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T20:39:49.839219] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-23T20:39:49.937246] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T20:39:49.947553] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-23T20:39:50.440423] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T20:39:50.442127] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-23T20:39:50.994906] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T20:39:51.044705] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T20:39:51.199437] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-23T20:39:51.633333] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T20:39:51.932972] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T20:39:51.999424] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-23T20:39:52.207303] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-23T20:39:52.799445] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-23T20:39:53.599457] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-23T20:39:53.833124] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T20:39:54.322232] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T20:39:54.399425] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-23T20:39:54.779189] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T20:39:55.089570] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T20:39:55.199416] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-23T20:39:55.999446] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-23T20:39:56.799416] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-23T20:39:56.895329] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T20:39:57.247019] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T20:39:57.599422] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-23T20:39:57.641307] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T20:39:58.186827] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-23T20:39:58.187872] [INFO ] [REMOTE ] CMSA: Full fetch complete (4819 records). [2025-10-23T20:39:58.187999] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-23T20:39:58.404693] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-23T20:39:58.542089] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-23T20:39:58.542207] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-23T20:39:58.542412] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-23T20:39:58.542509] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-23T20:39:58.542975] [DEBUG] [LOCAL ] CMSA: Trimmed 4819 records to 3498 (keeping 200 days of data) [2025-10-23T20:39:58.564020] [DEBUG] [LOCAL ] CMSA: Primary data saved (3498 records). [2025-10-23T20:39:58.564126] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-23T20:39:58.564248] [INFO ] [MAIN ] Update Progress: 481/2367 symbols completed. CMSA took 13.4s. Estimated remaining: 3h 54m 54s. Rate: 8.0 symbols/min [2025-10-23T20:39:58.733335] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:39:58.740149] [DEBUG] [LOCAL ] CMSC: Loaded 4809 existing records from primary storage. [2025-10-23T20:39:58.740410] [INFO ] [MAIN ] CMSC: Loaded 4809 existing records. [2025-10-23T20:39:58.914316] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:39:58.914500] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-23T20:39:58.914590] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-23T20:39:58.914810] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-23T20:39:58.914899] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-23T20:39:59.204571] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-23T20:39:59.265284] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:39:59.999444] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-23T20:40:00.535929] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T20:40:00.799452] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-23T20:40:00.808775] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T20:40:01.066574] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T20:40:01.599461] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-23T20:40:02.399482] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-23T20:40:02.887564] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T20:40:02.929238] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T20:40:03.199451] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-23T20:40:03.999409] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-23T20:40:04.053883] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T20:40:04.799447] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-23T20:40:05.001051] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-23T20:40:05.599412] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-23T20:40:05.651738] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-23T20:40:05.821765] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:40:06.399456] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-23T20:40:07.202257] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-23T20:40:07.203724] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T20:40:07.491778] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T20:40:07.999491] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-23T20:40:08.779153] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:40:08.799400] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-23T20:40:09.596387] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T20:40:09.603794] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-23T20:40:10.342837] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T20:40:10.399406] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-23T20:40:11.198204] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T20:40:11.199448] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-23T20:40:11.807264] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T20:40:11.999425] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-23T20:40:12.799441] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-23T20:40:13.065143] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T20:40:13.599416] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-23T20:40:13.620360] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T20:40:13.906777] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T20:40:14.399434] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-23T20:40:15.199411] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-23T20:40:15.284684] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T20:40:15.943454] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T20:40:15.999464] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-23T20:40:16.161406] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T20:40:16.799398] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-23T20:40:16.872137] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T20:40:17.599451] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-23T20:40:18.290718] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T20:40:18.399428] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-23T20:40:19.199424] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-23T20:40:19.248822] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T20:40:19.834445] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T20:40:19.840417] [INFO ] [REMOTE ] CMPO: Full fetch complete (58032 records). [2025-10-23T20:40:19.840552] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-23T20:40:20.011717] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-23T20:40:20.248775] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-23T20:40:20.248909] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-23T20:40:20.249752] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-23T20:40:20.249833] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-23T20:40:20.251019] [DEBUG] [LOCAL ] CMPO: Trimmed 58032 records to 38603 (keeping 200 days of data) [2025-10-23T20:40:20.486760] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T20:40:20.528130] [DEBUG] [LOCAL ] CMPO: Primary data saved (38603 records). [2025-10-23T20:40:20.528317] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-23T20:40:20.528429] [INFO ] [MAIN ] Update Progress: 482/2367 symbols completed. CMPO took 35.4s. Estimated remaining: 3h 55m 43s. Rate: 8.0 symbols/min [2025-10-23T20:40:20.726484] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:40:20.735451] [DEBUG] [LOCAL ] CMSD: Loaded 7603 existing records from primary storage. [2025-10-23T20:40:20.735706] [INFO ] [MAIN ] CMSD: Loaded 7603 existing records. [2025-10-23T20:40:20.807919] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-23T20:40:20.942048] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:40:20.942336] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-23T20:40:20.942443] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-23T20:40:20.942724] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-23T20:40:20.942806] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-23T20:40:21.300515] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:40:21.563272] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T20:40:21.564622] [INFO ] [REMOTE ] CMSC: Full fetch complete (6900 records). [2025-10-23T20:40:21.564753] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-23T20:40:21.604730] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-23T20:40:21.697868] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T20:40:21.754826] [INFO ] [REMOTE ] CMRE: Full fetch complete (51167 records). [2025-10-23T20:40:21.758196] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-23T20:40:22.128928] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-23T20:40:22.135938] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-23T20:40:22.145135] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-23T20:40:22.168308] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-23T20:40:22.253570] [DEBUG] [LOCAL ] CMSC: Trimmed 6900 records to 4826 (keeping 200 days of data) [2025-10-23T20:40:22.371914] [DEBUG] [LOCAL ] CMSC: Primary data saved (4826 records). [2025-10-23T20:40:22.397503] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-23T20:40:22.410884] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-23T20:40:22.413606] [INFO ] [MAIN ] Update Progress: 483/2367 symbols completed. CMSC took 23.8s. Estimated remaining: 3h 55m 13s. Rate: 8.0 symbols/min [2025-10-23T20:40:22.413772] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-23T20:40:22.426070] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-23T20:40:22.426848] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-23T20:40:22.437032] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-23T20:40:22.521358] [DEBUG] [LOCAL ] CMRE: Trimmed 51167 records to 35849 (keeping 200 days of data) [2025-10-23T20:40:22.677893] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:40:22.812883] [DEBUG] [LOCAL ] CMTG: Loaded 35217 existing records from primary storage. [2025-10-23T20:40:22.822591] [DEBUG] [LOCAL ] CMRE: Primary data saved (35849 records). [2025-10-23T20:40:22.822941] [INFO ] [MAIN ] CMTG: Loaded 35217 existing records. [2025-10-23T20:40:22.823058] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-23T20:40:22.828741] [INFO ] [MAIN ] Update Progress: 484/2367 symbols completed. CMRE took 37.7s. Estimated remaining: 3h 54m 38s. Rate: 8.0 symbols/min [2025-10-23T20:40:23.181277] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:40:23.160924] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:40:23.181549] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-23T20:40:23.181916] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-23T20:40:23.182148] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-23T20:40:23.182230] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-23T20:40:23.315331] [DEBUG] [LOCAL ] CMU: Loaded 6348 existing records from primary storage. [2025-10-23T20:40:23.323586] [INFO ] [MAIN ] CMU: Loaded 6348 existing records. [2025-10-23T20:40:23.791906] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:40:23.796304] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T20:40:23.795705] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:40:23.796707] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-23T20:40:23.800833] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-23T20:40:23.800992] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-23T20:40:23.801307] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-23T20:40:23.801523] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-23T20:40:23.927442] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-23T20:40:23.965459] [INFO ] [REMOTE ] CMS: Full fetch complete (76253 records). [2025-10-23T20:40:23.987985] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-23T20:40:24.004662] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-23T20:40:24.371612] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:40:24.589210] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-23T20:40:24.589341] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-23T20:40:24.590341] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-23T20:40:24.590425] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-23T20:40:24.591950] [DEBUG] [LOCAL ] CMS: Trimmed 76253 records to 52913 (keeping 200 days of data) [2025-10-23T20:40:24.808307] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-23T20:40:24.922216] [DEBUG] [LOCAL ] CMS: Primary data saved (52913 records). [2025-10-23T20:40:24.922372] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-23T20:40:24.924235] [INFO ] [MAIN ] Update Progress: 485/2367 symbols completed. CMS took 39.8s. Estimated remaining: 3h 54m 10s. Rate: 8.0 symbols/min [2025-10-23T20:40:25.037023] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T20:40:25.103748] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:40:25.134166] [DEBUG] [LOCAL ] CNA: Loaded 32534 existing records from primary storage. [2025-10-23T20:40:25.134504] [INFO ] [MAIN ] CNA: Loaded 32534 existing records. [2025-10-23T20:40:25.334800] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:40:25.336092] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T20:40:25.336416] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-23T20:40:25.343590] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-23T20:40:25.344664] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-23T20:40:25.344760] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-23T20:40:25.604527] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-23T20:40:25.693839] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:40:25.926700] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T20:40:26.399415] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-23T20:40:26.560497] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-23T20:40:27.191965] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T20:40:27.199397] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-23T20:40:27.999414] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-23T20:40:28.179071] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T20:40:28.799407] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-23T20:40:29.030316] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T20:40:29.599410] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-23T20:40:29.842099] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-23T20:40:30.399420] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-23T20:40:30.505865] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T20:40:31.199410] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-23T20:40:31.776100] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T20:40:31.830747] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T20:40:31.999428] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-23T20:40:32.799424] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-23T20:40:33.599428] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-23T20:40:34.110322] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-23T20:40:34.324816] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T20:40:34.399414] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-23T20:40:35.172902] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:40:35.199392] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-23T20:40:35.270998] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T20:40:35.999434] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-23T20:40:36.758408] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T20:40:36.799414] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-23T20:40:36.933458] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T20:40:37.599443] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-23T20:40:38.305608] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T20:40:38.399397] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-23T20:40:38.517477] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T20:40:39.199390] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-23T20:40:39.830315] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T20:40:39.844059] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-23T20:40:39.999432] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-23T20:40:40.776431] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T20:40:40.799394] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-23T20:40:41.599404] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-23T20:40:41.673474] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T20:40:42.393770] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T20:40:42.399385] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-23T20:40:43.020362] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T20:40:43.021571] [INFO ] [REMOTE ] CMU: Full fetch complete (9475 records). [2025-10-23T20:40:43.021681] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-23T20:40:43.208617] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-23T20:40:43.384628] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-23T20:40:43.384749] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-23T20:40:43.385051] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-23T20:40:43.385147] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-23T20:40:43.385638] [DEBUG] [LOCAL ] CMU: Trimmed 9475 records to 6355 (keeping 200 days of data) [2025-10-23T20:40:43.420970] [DEBUG] [LOCAL ] CMU: Primary data saved (6355 records). [2025-10-23T20:40:43.421095] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-23T20:40:43.421224] [INFO ] [MAIN ] Update Progress: 486/2367 symbols completed. CMU took 20.6s. Estimated remaining: 3h 54m 45s. Rate: 8.0 symbols/min [2025-10-23T20:40:43.589705] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:40:43.637917] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-23T20:40:43.638308] [INFO ] [MAIN ] CNC: Loaded 53779 existing records. [2025-10-23T20:40:43.814238] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:40:43.814500] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-23T20:40:43.814591] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-23T20:40:43.814942] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-23T20:40:43.815042] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-23T20:40:44.009154] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-23T20:40:44.169556] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:40:44.716902] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T20:40:44.718619] [INFO ] [REMOTE ] CMSD: Full fetch complete (11435 records). [2025-10-23T20:40:44.718737] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-23T20:40:44.804614] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-23T20:40:45.037665] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T20:40:45.134381] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-23T20:40:45.134492] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-23T20:40:45.134887] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-23T20:40:45.134966] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-23T20:40:45.135491] [DEBUG] [LOCAL ] CMSD: Trimmed 11435 records to 7641 (keeping 200 days of data) [2025-10-23T20:40:45.184316] [DEBUG] [LOCAL ] CMSD: Primary data saved (7641 records). [2025-10-23T20:40:45.184466] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-23T20:40:45.184582] [INFO ] [MAIN ] Update Progress: 487/2367 symbols completed. CMSD took 24.7s. Estimated remaining: 3h 54m 16s. Rate: 8.0 symbols/min [2025-10-23T20:40:45.371326] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:40:45.371577] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-23T20:40:45.371697] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-23T20:40:45.371854] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-23T20:40:45.371958] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-23T20:40:45.372078] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-23T20:40:45.372181] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-23T20:40:45.610156] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-23T20:40:45.765134] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:40:46.276847] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T20:40:46.399464] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-23T20:40:47.199440] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-23T20:40:47.285708] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T20:40:47.670133] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T20:40:47.999505] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-23T20:40:48.546947] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-23T20:40:48.799416] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-23T20:40:49.559305] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-23T20:40:49.599415] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-23T20:40:50.399423] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-23T20:40:50.516232] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T20:40:51.199426] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-23T20:40:51.274464] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T20:40:51.825405] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T20:40:51.999415] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-23T20:40:52.147999] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T20:40:52.799445] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-23T20:40:53.492994] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-23T20:40:53.586216] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T20:40:53.599389] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-23T20:40:54.399450] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-23T20:40:55.027308] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T20:40:55.199472] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-23T20:40:55.666223] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T20:40:55.999475] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-23T20:40:56.376208] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T20:40:56.799445] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-23T20:40:57.599427] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-23T20:40:58.036820] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T20:40:58.329686] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T20:40:58.399406] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-23T20:40:58.771473] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T20:40:59.199506] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-23T20:40:59.999508] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-23T20:41:00.448081] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T20:41:00.700293] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T20:41:00.799469] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-23T20:41:01.599420] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-23T20:41:01.810637] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T20:41:02.399482] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-23T20:41:02.579531] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T20:41:02.584574] [INFO ] [REMOTE ] CMTG: Full fetch complete (52831 records). [2025-10-23T20:41:02.584729] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-23T20:41:02.961790] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-23T20:41:02.961917] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-23T20:41:02.962682] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-23T20:41:02.962787] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-23T20:41:02.963923] [DEBUG] [LOCAL ] CMTG: Trimmed 52831 records to 35366 (keeping 200 days of data) [2025-10-23T20:41:03.155976] [DEBUG] [LOCAL ] CMTG: Primary data saved (35366 records). [2025-10-23T20:41:03.156141] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-23T20:41:03.156280] [INFO ] [MAIN ] Update Progress: 488/2367 symbols completed. CMTG took 40.7s. Estimated remaining: 3h 54m 49s. Rate: 8.0 symbols/min [2025-10-23T20:41:03.210812] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-23T20:41:03.330730] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:03.336947] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-23T20:41:03.337161] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T20:41:03.337318] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-23T20:41:03.340131] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-23T20:41:03.340221] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-23T20:41:03.340322] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-23T20:41:03.340409] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-23T20:41:03.704727] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:03.756562] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-23T20:41:03.999437] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-23T20:41:04.438381] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T20:41:04.446424] [INFO ] [REMOTE ] CNA: Full fetch complete (46088 records). [2025-10-23T20:41:04.446622] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-23T20:41:04.806872] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-23T20:41:04.824380] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-23T20:41:04.824494] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-23T20:41:04.825517] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-23T20:41:04.825740] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-23T20:41:04.827227] [DEBUG] [LOCAL ] CNA: Trimmed 46088 records to 32677 (keeping 200 days of data) [2025-10-23T20:41:05.025572] [DEBUG] [LOCAL ] CNA: Primary data saved (32677 records). [2025-10-23T20:41:05.025757] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-23T20:41:05.025871] [INFO ] [MAIN ] Update Progress: 489/2367 symbols completed. CNA took 40.1s. Estimated remaining: 3h 54m 19s. Rate: 8.0 symbols/min [2025-10-23T20:41:05.190442] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:05.248341] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-23T20:41:05.248737] [INFO ] [MAIN ] CNI: Loaded 51658 existing records. [2025-10-23T20:41:05.425522] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:41:05.425799] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-23T20:41:05.425893] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-23T20:41:05.426133] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-23T20:41:05.426223] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-23T20:41:05.624283] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-23T20:41:05.792885] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:05.940449] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T20:41:06.120080] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-23T20:41:06.399442] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-23T20:41:07.199459] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-23T20:41:07.719055] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T20:41:07.999440] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-23T20:41:08.309608] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T20:41:08.799420] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-23T20:41:09.129115] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T20:41:09.599431] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-23T20:41:10.404566] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-23T20:41:10.428887] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-23T20:41:10.792734] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:41:11.199447] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-23T20:41:11.275569] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T20:41:11.790198] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-23T20:41:11.999464] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-23T20:41:12.799415] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-23T20:41:13.218750] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T20:41:13.599430] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-23T20:41:14.399489] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-23T20:41:14.444313] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T20:41:14.446797] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-23T20:41:14.460491] [INFO ] [REMOTE ] CNF: Full fetch complete (12978 records). [2025-10-23T20:41:14.461469] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-23T20:41:14.875455] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-23T20:41:14.875637] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-23T20:41:14.876044] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-23T20:41:14.876285] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-23T20:41:14.904483] [DEBUG] [LOCAL ] CNF: Trimmed 12978 records to 10614 (keeping 200 days of data) [2025-10-23T20:41:14.906462] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T20:41:14.977183] [DEBUG] [LOCAL ] CNF: Primary data saved (10614 records). [2025-10-23T20:41:14.977355] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-23T20:41:14.977466] [INFO ] [MAIN ] Update Progress: 490/2367 symbols completed. CNF took 29.8s. Estimated remaining: 3h 54m 21s. Rate: 8.0 symbols/min [2025-10-23T20:41:15.145538] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:15.192506] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-23T20:41:15.192865] [INFO ] [MAIN ] CNK: Loaded 52908 existing records. [2025-10-23T20:41:15.205777] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-23T20:41:15.369519] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:41:15.369766] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-23T20:41:15.369844] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-23T20:41:15.370192] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-23T20:41:15.370274] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-23T20:41:15.725470] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:15.999460] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-23T20:41:16.799418] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-23T20:41:17.118459] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-23T20:41:17.599452] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-23T20:41:17.844047] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T20:41:17.947597] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-23T20:41:18.399418] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-23T20:41:18.801023] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T20:41:19.043185] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T20:41:19.199457] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-23T20:41:19.999441] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-23T20:41:20.324337] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-23T20:41:20.799473] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-23T20:41:21.191798] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T20:41:21.599449] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-23T20:41:22.034037] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T20:41:22.356324] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T20:41:22.399420] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-23T20:41:23.199436] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-23T20:41:23.602714] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-23T20:41:23.873680] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T20:41:23.999410] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-23T20:41:24.799482] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-23T20:41:25.244115] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-23T20:41:25.599415] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-23T20:41:25.977012] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T20:41:26.399462] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-23T20:41:27.199450] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-23T20:41:27.309976] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-23T20:41:27.320734] [INFO ] [REMOTE ] CNC: Full fetch complete (77861 records). [2025-10-23T20:41:27.321020] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-23T20:41:27.748558] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-23T20:41:27.748796] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-23T20:41:27.750058] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-23T20:41:27.750311] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-23T20:41:27.771746] [DEBUG] [LOCAL ] CNC: Trimmed 77861 records to 54169 (keeping 200 days of data) [2025-10-23T20:41:27.789095] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T20:41:28.008549] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-23T20:41:28.164987] [DEBUG] [LOCAL ] CNC: Primary data saved (54169 records). [2025-10-23T20:41:28.165153] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-23T20:41:28.165269] [INFO ] [MAIN ] Update Progress: 491/2367 symbols completed. CNC took 44.7s. Estimated remaining: 3h 54m 36s. Rate: 8.0 symbols/min [2025-10-23T20:41:28.337539] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:28.337866] [DEBUG] [LOCAL ] CNM: No existing data file found in primary storage. [2025-10-23T20:41:28.338095] [WARN ] [MAIN ] CNM: No existing data found, performing full refresh instead. [2025-10-23T20:41:28.338227] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-23T20:41:28.338416] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-23T20:41:28.338522] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-23T20:41:28.338609] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-23T20:41:28.472716] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T20:41:28.745879] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:28.799411] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-23T20:41:28.886123] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T20:41:29.599423] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-23T20:41:30.105861] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:41:30.399443] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-23T20:41:30.569869] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T20:41:31.199406] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-23T20:41:31.295988] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:41:31.999403] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-23T20:41:32.359588] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T20:41:32.799438] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-23T20:41:32.932116] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T20:41:33.599421] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-23T20:41:33.842821] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T20:41:33.852890] [INFO ] [REMOTE ] CNH: Full fetch complete (77708 records). [2025-10-23T20:41:33.853132] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-23T20:41:34.245463] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-23T20:41:34.245574] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-23T20:41:34.246510] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-23T20:41:34.246593] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-23T20:41:34.248098] [DEBUG] [LOCAL ] CNH: Trimmed 77708 records to 53936 (keeping 200 days of data) [2025-10-23T20:41:34.416708] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-23T20:41:34.567445] [DEBUG] [LOCAL ] CNH: Primary data saved (53936 records). [2025-10-23T20:41:34.567575] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-23T20:41:34.567721] [INFO ] [MAIN ] Update Progress: 492/2367 symbols completed. CNH took 31.4s. Estimated remaining: 3h 54m 24s. Rate: 8.0 symbols/min [2025-10-23T20:41:34.737577] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:34.771366] [DEBUG] [LOCAL ] CNMD: Loaded 32058 existing records from primary storage. [2025-10-23T20:41:34.771774] [INFO ] [MAIN ] CNMD: Loaded 32058 existing records. [2025-10-23T20:41:34.957882] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-23T20:41:34.985860] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:41:34.986450] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-23T20:41:34.986532] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-23T20:41:34.986753] [INFO ] [REMOTE ] CNI: Full fetch complete (74845 records). [2025-10-23T20:41:34.986810] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-23T20:41:34.986943] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-23T20:41:34.987010] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-23T20:41:35.760359] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-23T20:41:35.767044] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-23T20:41:35.768071] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-23T20:41:35.766755] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:35.768541] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-23T20:41:35.768177] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-23T20:41:35.770896] [DEBUG] [LOCAL ] CNI: Trimmed 74845 records to 52019 (keeping 200 days of data) [2025-10-23T20:41:35.890442] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-23T20:41:36.022205] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-23T20:41:36.125944] [DEBUG] [LOCAL ] CNI: Primary data saved (52019 records). [2025-10-23T20:41:36.126111] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-23T20:41:36.127833] [INFO ] [MAIN ] Update Progress: 493/2367 symbols completed. CNI took 31.1s. Estimated remaining: 3h 53m 54s. Rate: 8.0 symbols/min [2025-10-23T20:41:36.300620] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:36.301001] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-23T20:41:36.301159] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-23T20:41:36.301411] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-23T20:41:36.301616] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-23T20:41:36.301784] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-23T20:41:36.301870] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-23T20:41:36.665695] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-23T20:41:36.717815] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:36.799451] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-23T20:41:37.340063] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T20:41:37.599416] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-23T20:41:38.115131] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T20:41:38.238461] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-23T20:41:38.399407] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-23T20:41:39.199479] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-23T20:41:39.554096] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:41:39.999434] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-23T20:41:40.228873] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T20:41:40.488939] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T20:41:40.802807] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-23T20:41:40.808222] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T20:41:40.817907] [INFO ] [REMOTE ] CNK: Full fetch complete (75901 records). [2025-10-23T20:41:40.818087] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-23T20:41:40.818978] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:41:40.819119] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:41:40.819189] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:41:40.819263] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-23T20:41:40.819354] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-23T20:41:40.819425] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-23T20:41:40.819630] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-23T20:41:40.820399] [INFO ] [MAIN ] Update Progress: 494/2367 symbols completed. CNK took 25.8s. Estimated remaining: 3h 53m 36s. Rate: 8.0 symbols/min [2025-10-23T20:41:40.991556] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:41.030815] [DEBUG] [LOCAL ] CNO: Loaded 40344 existing records from primary storage. [2025-10-23T20:41:41.031117] [INFO ] [MAIN ] CNO: Loaded 40344 existing records. [2025-10-23T20:41:41.209902] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:41:41.210118] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-23T20:41:41.210191] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-23T20:41:41.210493] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-23T20:41:41.210566] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-23T20:41:41.555499] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:41.599475] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-23T20:41:42.399422] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-23T20:41:42.634403] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T20:41:43.199467] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-23T20:41:43.248748] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T20:41:43.681066] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T20:41:43.999444] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-23T20:41:44.582189] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T20:41:44.799441] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-23T20:41:45.599445] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-23T20:41:45.890352] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T20:41:46.399451] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-23T20:41:46.652306] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T20:41:47.199428] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-23T20:41:47.289923] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T20:41:47.624896] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T20:41:47.999510] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-23T20:41:48.799534] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-23T20:41:49.303818] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:41:49.583130] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T20:41:49.599398] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-23T20:41:50.399413] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-23T20:41:50.688176] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T20:41:50.729383] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T20:41:51.199484] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-23T20:41:51.798768] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T20:41:51.999508] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-23T20:41:52.673959] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T20:41:52.799480] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-23T20:41:53.599471] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-23T20:41:53.885728] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T20:41:54.399443] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-23T20:41:54.427598] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T20:41:55.044503] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T20:41:55.199434] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-23T20:41:55.999435] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-23T20:41:56.243198] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T20:41:56.252914] [INFO ] [REMOTE ] CNM: Full fetch complete (73776 records). [2025-10-23T20:41:56.253090] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-23T20:41:56.657216] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-23T20:41:56.657347] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-23T20:41:56.658353] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-23T20:41:56.658458] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-23T20:41:56.659957] [DEBUG] [LOCAL ] CNM: Trimmed 73776 records to 51372 (keeping 200 days of data) [2025-10-23T20:41:56.821832] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-23T20:41:56.962667] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T20:41:56.979762] [DEBUG] [LOCAL ] CNM: Primary data saved (51372 records). [2025-10-23T20:41:56.987855] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-23T20:41:56.988016] [INFO ] [MAIN ] Update Progress: 495/2367 symbols completed. CNM took 28.8s. Estimated remaining: 3h 54m 1s. Rate: 8.0 symbols/min [2025-10-23T20:41:57.155008] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:41:57.202859] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-23T20:41:57.203215] [INFO ] [MAIN ] CNP: Loaded 53475 existing records. [2025-10-23T20:41:57.385160] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:41:57.385376] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-23T20:41:57.385451] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-23T20:41:57.385746] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-23T20:41:57.385818] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-23T20:41:57.618866] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-23T20:41:57.743995] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:41:57.766162] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T20:41:58.111805] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T20:41:58.399470] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-23T20:41:59.199425] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-23T20:41:59.413021] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T20:41:59.999475] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-23T20:42:00.382165] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-23T20:42:00.639990] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T20:42:00.799480] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-23T20:42:01.599491] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-23T20:42:02.030550] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T20:42:02.399444] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-23T20:42:03.199459] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-23T20:42:03.482486] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-23T20:42:03.591901] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-23T20:42:03.984221] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T20:42:03.999415] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-23T20:42:04.799433] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-23T20:42:04.866547] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T20:42:05.599440] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-23T20:42:06.012547] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T20:42:06.069315] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T20:42:06.076093] [INFO ] [REMOTE ] CNO: Full fetch complete (60821 records). [2025-10-23T20:42:06.076220] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-23T20:42:06.409519] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-23T20:42:06.465589] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-23T20:42:06.465731] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-23T20:42:06.466533] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-23T20:42:06.466623] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-23T20:42:06.468008] [DEBUG] [LOCAL ] CNO: Trimmed 60821 records to 40585 (keeping 200 days of data) [2025-10-23T20:42:06.707393] [DEBUG] [LOCAL ] CNO: Primary data saved (40585 records). [2025-10-23T20:42:06.707547] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-23T20:42:06.708526] [INFO ] [MAIN ] Update Progress: 496/2367 symbols completed. CNO took 25.9s. Estimated remaining: 3h 54m 2s. Rate: 8.0 symbols/min [2025-10-23T20:42:06.887932] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:06.914323] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T20:42:06.977315] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-23T20:42:06.977704] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-10-23T20:42:07.157774] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:42:07.158028] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-23T20:42:07.158108] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-23T20:42:07.158333] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-23T20:42:07.158404] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-23T20:42:07.204531] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-23T20:42:07.521475] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:07.999462] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-23T20:42:08.428489] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T20:42:08.799415] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-23T20:42:08.881404] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T20:42:09.599440] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-23T20:42:10.064971] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T20:42:10.363974] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:42:10.399409] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-23T20:42:10.995023] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T20:42:11.000728] [INFO ] [REMOTE ] CNMD: Full fetch complete (47393 records). [2025-10-23T20:42:11.000911] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-23T20:42:11.204712] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-23T20:42:11.380996] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-23T20:42:11.381099] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-23T20:42:11.381830] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-23T20:42:11.381911] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-23T20:42:11.382889] [DEBUG] [LOCAL ] CNMD: Trimmed 47393 records to 32316 (keeping 200 days of data) [2025-10-23T20:42:11.572730] [DEBUG] [LOCAL ] CNMD: Primary data saved (32316 records). [2025-10-23T20:42:11.572887] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-23T20:42:11.572995] [INFO ] [MAIN ] Update Progress: 497/2367 symbols completed. CNMD took 37.0s. Estimated remaining: 3h 53m 45s. Rate: 8.0 symbols/min [2025-10-23T20:42:11.752780] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:11.752932] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-23T20:42:11.753002] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-23T20:42:11.753110] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-23T20:42:11.753162] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-23T20:42:11.753237] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-23T20:42:11.753315] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-23T20:42:12.004502] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-23T20:42:12.115053] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:12.364905] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-23T20:42:12.417062] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T20:42:12.423051] [INFO ] [REMOTE ] CNNE: Full fetch complete (50617 records). [2025-10-23T20:42:12.423169] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-23T20:42:12.804267] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-23T20:42:12.804167] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-23T20:42:12.804768] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-23T20:42:12.806450] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-23T20:42:12.806614] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-23T20:42:12.808033] [DEBUG] [LOCAL ] CNNE: Trimmed 50617 records to 35966 (keeping 200 days of data) [2025-10-23T20:42:13.028618] [DEBUG] [LOCAL ] CNNE: Primary data saved (35966 records). [2025-10-23T20:42:13.028853] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-23T20:42:13.028990] [INFO ] [MAIN ] Update Progress: 498/2367 symbols completed. CNNE took 36.9s. Estimated remaining: 3h 53m 14s. Rate: 8.0 symbols/min [2025-10-23T20:42:13.201831] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:13.202056] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-23T20:42:13.202128] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-23T20:42:13.202214] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-23T20:42:13.202282] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-23T20:42:13.202341] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-23T20:42:13.202405] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-23T20:42:13.559676] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:13.599397] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-23T20:42:13.962622] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-23T20:42:14.253325] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T20:42:14.399437] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-23T20:42:15.199472] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-23T20:42:15.605461] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T20:42:15.808851] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T20:42:15.999497] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-23T20:42:16.799404] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-23T20:42:16.988586] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T20:42:17.032813] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T20:42:17.599460] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-23T20:42:18.399450] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-23T20:42:18.909625] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T20:42:18.989444] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-23T20:42:19.199450] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-23T20:42:19.999452] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-23T20:42:20.469206] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-23T20:42:20.542448] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T20:42:20.799452] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-23T20:42:21.599438] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-23T20:42:21.906071] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T20:42:22.108124] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T20:42:22.399438] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-23T20:42:23.199425] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-23T20:42:23.577018] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T20:42:23.600098] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T20:42:23.999439] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-23T20:42:24.799451] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-23T20:42:25.293996] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T20:42:25.317333] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T20:42:25.599418] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-23T20:42:26.248973] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T20:42:26.258171] [INFO ] [REMOTE ] CNP: Full fetch complete (77555 records). [2025-10-23T20:42:26.258328] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-23T20:42:26.407329] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-23T20:42:26.653849] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-23T20:42:26.653976] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-23T20:42:26.655003] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-23T20:42:26.655105] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-23T20:42:26.656590] [DEBUG] [LOCAL ] CNP: Trimmed 77555 records to 53865 (keeping 200 days of data) [2025-10-23T20:42:26.772822] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T20:42:27.001407] [DEBUG] [LOCAL ] CNP: Primary data saved (53865 records). [2025-10-23T20:42:27.001585] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-23T20:42:27.001725] [INFO ] [MAIN ] Update Progress: 499/2367 symbols completed. CNP took 30.0s. Estimated remaining: 3h 53m 31s. Rate: 8.0 symbols/min [2025-10-23T20:42:27.171146] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:27.171353] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-23T20:42:27.171422] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-23T20:42:27.171513] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-23T20:42:27.171595] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-23T20:42:27.171698] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-23T20:42:27.171751] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-23T20:42:27.204585] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-23T20:42:27.518815] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:27.999420] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-23T20:42:28.290155] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T20:42:28.491532] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T20:42:28.799435] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-23T20:42:29.599399] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-23T20:42:29.782051] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:42:30.190901] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T20:42:30.195983] [INFO ] [REMOTE ] CNS: Full fetch complete (31431 records). [2025-10-23T20:42:30.196131] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-23T20:42:30.404790] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-23T20:42:30.581907] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-23T20:42:30.582025] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-23T20:42:30.582627] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-23T20:42:30.582724] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-23T20:42:30.583524] [DEBUG] [LOCAL ] CNS: Trimmed 31431 records to 21443 (keeping 200 days of data) [2025-10-23T20:42:30.710544] [DEBUG] [LOCAL ] CNS: Primary data saved (21443 records). [2025-10-23T20:42:30.710716] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-23T20:42:30.710820] [INFO ] [MAIN ] Update Progress: 500/2367 symbols completed. CNS took 17.7s. Estimated remaining: 3h 53m 9s. Rate: 8.0 symbols/min [2025-10-23T20:42:30.881239] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:30.919355] [DEBUG] [LOCAL ] CODI: Loaded 41954 existing records from primary storage. [2025-10-23T20:42:30.919735] [INFO ] [MAIN ] CODI: Loaded 41954 existing records. [2025-10-23T20:42:31.098826] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:42:31.099022] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-23T20:42:31.099104] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-23T20:42:31.099333] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-23T20:42:31.099409] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-23T20:42:31.201468] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-23T20:42:31.467917] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:31.632870] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T20:42:31.999416] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-23T20:42:32.531400] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-23T20:42:32.799436] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-23T20:42:32.889779] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T20:42:33.599427] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-23T20:42:33.774479] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T20:42:34.410070] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-23T20:42:34.415850] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T20:42:34.913347] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T20:42:35.199445] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-23T20:42:35.999414] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-23T20:42:36.067532] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:42:36.799444] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-23T20:42:37.270793] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-23T20:42:37.295378] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T20:42:37.599445] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-23T20:42:38.399448] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-23T20:42:38.642059] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T20:42:38.765019] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T20:42:39.199502] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-23T20:42:39.999497] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-23T20:42:40.194227] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T20:42:40.799409] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-23T20:42:41.069364] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T20:42:41.526498] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T20:42:41.599416] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-23T20:42:42.199207] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T20:42:42.399463] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-23T20:42:43.199447] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-23T20:42:43.312631] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T20:42:43.999554] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-23T20:42:44.137049] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T20:42:44.763925] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T20:42:44.799468] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-23T20:42:45.599466] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-23T20:42:45.642730] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T20:42:45.653764] [INFO ] [REMOTE ] CNQ: Full fetch complete (77742 records). [2025-10-23T20:42:45.653946] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-23T20:42:46.150851] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-23T20:42:46.151019] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-23T20:42:46.152179] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-23T20:42:46.152271] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-23T20:42:46.154045] [DEBUG] [LOCAL ] CNQ: Trimmed 77742 records to 53972 (keeping 200 days of data) [2025-10-23T20:42:46.301929] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T20:42:46.399967] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-23T20:42:46.535502] [DEBUG] [LOCAL ] CNQ: Primary data saved (53972 records). [2025-10-23T20:42:46.535813] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-23T20:42:46.536922] [INFO ] [MAIN ] Update Progress: 501/2367 symbols completed. CNQ took 39.8s. Estimated remaining: 3h 53m 33s. Rate: 8.0 symbols/min [2025-10-23T20:42:46.711274] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:46.771855] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-23T20:42:46.772362] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-23T20:42:46.974307] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:42:46.974626] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-23T20:42:46.974744] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-23T20:42:46.975060] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-23T20:42:46.975150] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-23T20:42:47.206322] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-23T20:42:47.375195] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:47.524279] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T20:42:47.935108] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T20:42:47.999407] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-23T20:42:48.799440] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-23T20:42:49.052733] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T20:42:49.599479] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-23T20:42:49.682510] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T20:42:49.690734] [INFO ] [REMOTE ] CNR: Full fetch complete (63188 records). [2025-10-23T20:42:49.690916] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-23T20:42:49.884226] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-23T20:42:49.884891] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:42:49.884966] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:42:49.885046] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-23T20:42:49.885167] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-23T20:42:49.885243] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-23T20:42:49.885303] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-23T20:42:49.885394] [INFO ] [MAIN ] Update Progress: 502/2367 symbols completed. CNR took 38.3s. Estimated remaining: 3h 53m 10s. Rate: 8.0 symbols/min [2025-10-23T20:42:50.063592] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:50.063825] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-23T20:42:50.063897] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-23T20:42:50.063981] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-23T20:42:50.064048] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-23T20:42:50.064129] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-23T20:42:50.064200] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-23T20:42:50.400204] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-23T20:42:50.423484] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:50.715984] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T20:42:51.199433] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-23T20:42:51.541836] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T20:42:51.999474] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-23T20:42:52.160700] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T20:42:52.799492] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-23T20:42:53.030755] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T20:42:53.599416] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-23T20:42:53.850368] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T20:42:54.399519] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-23T20:42:54.459749] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T20:42:55.199457] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-23T20:42:55.705052] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T20:42:55.999410] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-23T20:42:56.237791] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T20:42:56.246828] [INFO ] [REMOTE ] CNX: Full fetch complete (74934 records). [2025-10-23T20:42:56.246990] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-23T20:42:56.650217] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-23T20:42:56.650329] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-23T20:42:56.651324] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-23T20:42:56.651406] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-23T20:42:56.652892] [DEBUG] [LOCAL ] CNX: Trimmed 74934 records to 51709 (keeping 200 days of data) [2025-10-23T20:42:56.835354] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-23T20:42:56.977878] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:42:57.001383] [DEBUG] [LOCAL ] CNX: Primary data saved (51709 records). [2025-10-23T20:42:57.001523] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-23T20:42:57.001623] [INFO ] [MAIN ] Update Progress: 503/2367 symbols completed. CNX took 30.0s. Estimated remaining: 3h 53m 1s. Rate: 8.0 symbols/min [2025-10-23T20:42:57.171566] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:42:57.221360] [DEBUG] [LOCAL ] COLD: Loaded 52485 existing records from primary storage. [2025-10-23T20:42:57.221761] [INFO ] [MAIN ] COLD: Loaded 52485 existing records. [2025-10-23T20:42:57.401887] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:42:57.402133] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-23T20:42:57.402208] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-23T20:42:57.402430] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-23T20:42:57.402504] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-23T20:42:57.608473] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-23T20:42:57.755332] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:42:58.408313] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-23T20:42:58.414490] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-23T20:42:58.999995] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-23T20:42:59.199450] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-23T20:42:59.578936] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T20:42:59.588384] [INFO ] [REMOTE ] CODI: Full fetch complete (53958 records). [2025-10-23T20:42:59.588558] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-23T20:43:00.014682] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-23T20:43:00.028310] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-23T20:43:00.029394] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-23T20:43:00.030327] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-23T20:43:00.030440] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-23T20:43:00.032071] [DEBUG] [LOCAL ] CODI: Trimmed 53958 records to 42256 (keeping 200 days of data) [2025-10-23T20:43:00.259525] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T20:43:00.315863] [DEBUG] [LOCAL ] CODI: Primary data saved (42256 records). [2025-10-23T20:43:00.316023] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-23T20:43:00.316138] [INFO ] [MAIN ] Update Progress: 504/2367 symbols completed. CODI took 29.6s. Estimated remaining: 3h 52m 38s. Rate: 8.0 symbols/min [2025-10-23T20:43:00.514076] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:00.565110] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-23T20:43:00.565479] [INFO ] [MAIN ] COMP: Loaded 53404 existing records. [2025-10-23T20:43:00.769492] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:43:00.769780] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-23T20:43:00.769858] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-23T20:43:00.770090] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-23T20:43:00.770175] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-23T20:43:00.807131] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-23T20:43:01.180115] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:01.599443] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-23T20:43:02.119207] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-10-23T20:43:02.399451] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-23T20:43:02.646420] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-23T20:43:03.199506] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-23T20:43:03.688762] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-23T20:43:03.915239] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-23T20:43:03.999424] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-23T20:43:04.414808] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T20:43:04.799456] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-23T20:43:05.341762] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-23T20:43:05.599428] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-23T20:43:05.834056] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T20:43:06.399461] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-23T20:43:06.859180] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:43:07.199493] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-23T20:43:07.934202] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-23T20:43:07.999414] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-23T20:43:08.143032] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T20:43:08.799427] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-23T20:43:08.964985] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T20:43:09.599412] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-23T20:43:10.120701] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T20:43:10.399416] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-23T20:43:10.745285] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T20:43:11.199467] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-23T20:43:11.570314] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T20:43:11.999435] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-23T20:43:12.150434] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T20:43:12.799444] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-23T20:43:13.251589] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-23T20:43:13.599422] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-23T20:43:14.164590] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-23T20:43:14.399449] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-23T20:43:14.795886] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-23T20:43:14.805230] [INFO ] [REMOTE ] COF: Full fetch complete (77710 records). [2025-10-23T20:43:14.805408] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-23T20:43:15.209904] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-23T20:43:15.236135] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-23T20:43:15.236262] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-23T20:43:15.237218] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-23T20:43:15.237412] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-23T20:43:15.239097] [DEBUG] [LOCAL ] COF: Trimmed 77710 records to 54015 (keeping 200 days of data) [2025-10-23T20:43:15.573946] [DEBUG] [LOCAL ] COF: Primary data saved (54015 records). [2025-10-23T20:43:15.574101] [INFO ] [MAIN ] COF: Full history saved. [2025-10-23T20:43:15.575278] [INFO ] [MAIN ] Update Progress: 505/2367 symbols completed. COF took 29.0s. Estimated remaining: 3h 52m 59s. Rate: 8.0 symbols/min [2025-10-23T20:43:15.745766] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:15.746118] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-23T20:43:15.746207] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-23T20:43:15.746503] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-23T20:43:15.746581] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-23T20:43:15.763271] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-23T20:43:15.768488] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-23T20:43:15.877028] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T20:43:16.020220] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-23T20:43:16.176952] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:16.295070] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T20:43:16.799448] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-23T20:43:17.526501] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-23T20:43:17.599397] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-23T20:43:18.005418] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T20:43:18.348956] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T20:43:18.399406] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-23T20:43:19.199420] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-23T20:43:19.280156] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:43:19.999487] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-23T20:43:20.315104] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T20:43:20.799502] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-23T20:43:21.534350] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-23T20:43:21.599403] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-23T20:43:21.823545] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:43:22.399427] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-23T20:43:22.671067] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T20:43:23.199456] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-23T20:43:23.968353] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-23T20:43:23.999400] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-23T20:43:24.386922] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T20:43:24.799438] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-23T20:43:25.144625] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T20:43:25.153338] [INFO ] [REMOTE ] COHR: Full fetch complete (77076 records). [2025-10-23T20:43:25.153484] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-23T20:43:25.154235] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:43:25.154317] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:43:25.154385] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:43:25.154456] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-23T20:43:25.154546] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-23T20:43:25.154615] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-23T20:43:25.154722] [DEBUG] [LOCAL ] COHR: No derivative data file found to delete. [2025-10-23T20:43:25.154813] [INFO ] [MAIN ] Update Progress: 506/2367 symbols completed. COHR took 35.3s. Estimated remaining: 3h 52m 59s. Rate: 8.0 symbols/min [2025-10-23T20:43:25.353998] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:25.357150] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-23T20:43:25.368119] [INFO ] [REMOTE ] COLD: Full fetch complete (74923 records). [2025-10-23T20:43:25.368358] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-23T20:43:25.558157] [DEBUG] [LOCAL ] COOK: Loaded 24851 existing records from primary storage. [2025-10-23T20:43:25.581513] [INFO ] [MAIN ] COOK: Loaded 24851 existing records. [2025-10-23T20:43:25.608804] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-23T20:43:25.966935] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:43:25.967200] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-23T20:43:25.967704] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-23T20:43:25.967609] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-23T20:43:25.969371] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-23T20:43:25.969248] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-23T20:43:25.969548] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-23T20:43:25.969866] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-23T20:43:25.969960] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-23T20:43:26.068702] [DEBUG] [LOCAL ] COLD: Trimmed 74923 records to 52875 (keeping 200 days of data) [2025-10-23T20:43:26.448145] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:26.448602] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-23T20:43:26.471986] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T20:43:26.701128] [DEBUG] [LOCAL ] COLD: Primary data saved (52875 records). [2025-10-23T20:43:26.701308] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-23T20:43:26.701436] [INFO ] [MAIN ] Update Progress: 507/2367 symbols completed. COLD took 29.7s. Estimated remaining: 3h 52m 30s. Rate: 8.0 symbols/min [2025-10-23T20:43:26.866352] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:26.921794] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-23T20:43:26.922181] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-23T20:43:27.095201] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:43:27.095433] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-23T20:43:27.095527] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-23T20:43:27.095803] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-23T20:43:27.095896] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-23T20:43:27.204566] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-23T20:43:27.475212] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:27.656429] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T20:43:27.707297] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T20:43:27.999459] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-23T20:43:28.799424] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-23T20:43:29.143456] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T20:43:29.599402] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-23T20:43:29.809790] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T20:43:30.136522] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-23T20:43:30.399468] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-23T20:43:31.185245] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T20:43:31.199398] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-23T20:43:31.999450] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-23T20:43:32.458609] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T20:43:32.586317] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-23T20:43:32.799440] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-23T20:43:33.599411] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-23T20:43:34.170754] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T20:43:34.189428] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-23T20:43:34.399441] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-23T20:43:35.158968] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T20:43:35.174721] [INFO ] [REMOTE ] COMP: Full fetch complete (77413 records). [2025-10-23T20:43:35.175070] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-23T20:43:35.204571] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-23T20:43:35.611955] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-23T20:43:35.612125] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-23T20:43:35.613293] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-23T20:43:35.613384] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-23T20:43:35.615633] [DEBUG] [LOCAL ] COMP: Trimmed 77413 records to 53793 (keeping 200 days of data) [2025-10-23T20:43:35.999850] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-23T20:43:36.007194] [DEBUG] [LOCAL ] COMP: Primary data saved (53793 records). [2025-10-23T20:43:36.009049] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-23T20:43:36.009218] [INFO ] [MAIN ] Update Progress: 508/2367 symbols completed. COMP took 35.7s. Estimated remaining: 3h 52m 29s. Rate: 8.0 symbols/min [2025-10-23T20:43:36.217832] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:36.287979] [DEBUG] [LOCAL ] COR: Loaded 46258 existing records from primary storage. [2025-10-23T20:43:36.288590] [INFO ] [MAIN ] COR: Loaded 46258 existing records. [2025-10-23T20:43:36.593220] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:43:36.593800] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-23T20:43:36.594123] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-23T20:43:36.594562] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-23T20:43:36.594693] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-23T20:43:37.101591] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-23T20:43:37.108815] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:37.122125] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-23T20:43:37.121802] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T20:43:37.387585] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T20:43:37.599471] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-23T20:43:38.399454] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-23T20:43:38.721062] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T20:43:38.801048] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T20:43:39.199482] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-23T20:43:39.924148] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T20:43:39.999431] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-23T20:43:40.799431] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-23T20:43:40.833782] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T20:43:41.599437] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-23T20:43:42.025279] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-23T20:43:42.399442] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-23T20:43:43.030138] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-23T20:43:43.184317] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T20:43:43.199414] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-23T20:43:43.671224] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T20:43:43.999444] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-23T20:43:44.799429] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-23T20:43:44.979253] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:43:45.323772] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T20:43:45.599448] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-23T20:43:46.399456] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-23T20:43:47.037966] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-23T20:43:47.085484] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T20:43:47.199419] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-23T20:43:47.999411] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-23T20:43:48.381853] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T20:43:48.799487] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-23T20:43:49.340045] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-23T20:43:49.391221] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T20:43:49.395955] [INFO ] [REMOTE ] COOK: Full fetch complete (33143 records). [2025-10-23T20:43:49.396078] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-23T20:43:49.604532] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-23T20:43:49.775909] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-23T20:43:49.776016] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-23T20:43:49.776586] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-23T20:43:49.776682] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-23T20:43:49.777449] [DEBUG] [LOCAL ] COOK: Trimmed 33143 records to 24994 (keeping 200 days of data) [2025-10-23T20:43:49.914873] [DEBUG] [LOCAL ] COOK: Primary data saved (24994 records). [2025-10-23T20:43:49.915045] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-23T20:43:49.915187] [INFO ] [MAIN ] Update Progress: 509/2367 symbols completed. COOK took 24.8s. Estimated remaining: 3h 52m 45s. Rate: 8.0 symbols/min [2025-10-23T20:43:50.090836] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:50.091076] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-23T20:43:50.091147] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-23T20:43:50.091258] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-23T20:43:50.091328] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-23T20:43:50.091409] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-23T20:43:50.091479] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-23T20:43:50.378775] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T20:43:50.402260] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-23T20:43:50.420416] [INFO ] [REMOTE ] CON: Full fetch complete (56708 records). [2025-10-23T20:43:50.438382] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-23T20:43:50.644316] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:50.930388] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-23T20:43:50.930499] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-23T20:43:50.931288] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-23T20:43:50.931365] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-23T20:43:50.932535] [DEBUG] [LOCAL ] CON: Trimmed 56708 records to 39033 (keeping 200 days of data) [2025-10-23T20:43:51.177324] [DEBUG] [LOCAL ] CON: Primary data saved (39033 records). [2025-10-23T20:43:51.177492] [INFO ] [MAIN ] CON: Full history saved. [2025-10-23T20:43:51.177618] [INFO ] [MAIN ] Update Progress: 510/2367 symbols completed. CON took 35.6s. Estimated remaining: 3h 52m 15s. Rate: 8.0 symbols/min [2025-10-23T20:43:51.209105] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-23T20:43:51.351500] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:51.400202] [DEBUG] [LOCAL ] COUR: Loaded 49401 existing records from primary storage. [2025-10-23T20:43:51.400548] [INFO ] [MAIN ] COUR: Loaded 49401 existing records. [2025-10-23T20:43:51.577819] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:43:51.578066] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-23T20:43:51.578141] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-23T20:43:51.578387] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-23T20:43:51.578464] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-23T20:43:51.941381] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:51.975526] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-23T20:43:51.999400] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-23T20:43:52.532983] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T20:43:52.799456] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-23T20:43:53.589732] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-23T20:43:53.600144] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-23T20:43:53.891736] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T20:43:54.399413] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-23T20:43:54.584623] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T20:43:55.199416] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-23T20:43:55.621514] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-23T20:43:55.999426] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-23T20:43:56.101892] [DEBUG] [REMOTE ] COR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-23T20:43:56.102169] [WARN ] [REMOTE ] COR: No data returned for month 2025-06 [2025-10-23T20:43:56.102256] [FATAL] [REMOTE ] COR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:43:56.102360] [FATAL] [MAIN ] COR: Failed to fetch primary data. [2025-10-23T20:43:56.102433] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:43:56.102542] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-23T20:43:56.102637] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-23T20:43:56.102735] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-23T20:43:56.103668] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-23T20:43:56.105290] [INFO ] [MAIN ] Update Progress: 511/2367 symbols completed. COR took 20.1s. Estimated remaining: 3h 51m 58s. Rate: 8.0 symbols/min [2025-10-23T20:43:56.279069] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:56.330819] [DEBUG] [LOCAL ] CP: Loaded 53228 existing records from primary storage. [2025-10-23T20:43:56.331395] [INFO ] [MAIN ] CP: Loaded 53228 existing records. [2025-10-23T20:43:56.512835] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:43:56.513198] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-23T20:43:56.513285] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-23T20:43:56.513708] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-23T20:43:56.513785] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-23T20:43:56.649163] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-23T20:43:56.806856] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-23T20:43:56.927424] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:43:57.173041] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T20:43:57.599434] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-23T20:43:58.399491] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-23T20:43:58.959823] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T20:43:58.969294] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-23T20:43:58.969487] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-23T20:43:59.216751] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-23T20:43:59.383124] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-23T20:43:59.383373] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-23T20:43:59.384458] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-23T20:43:59.384572] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-23T20:43:59.413310] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54117 (keeping 200 days of data) [2025-10-23T20:43:59.415006] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T20:43:59.752202] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-23T20:43:59.752390] [INFO ] [MAIN ] COP: Full history saved. [2025-10-23T20:43:59.752530] [INFO ] [MAIN ] Update Progress: 512/2367 symbols completed. COP took 33.1s. Estimated remaining: 3h 51m 36s. Rate: 8.0 symbols/min [2025-10-23T20:43:59.934198] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:43:59.963853] [DEBUG] [LOCAL ] CPA: Loaded 27769 existing records from primary storage. [2025-10-23T20:43:59.964190] [INFO ] [MAIN ] CPA: Loaded 27769 existing records. [2025-10-23T20:44:00.007138] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-23T20:44:00.152071] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:44:00.152426] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-23T20:44:00.152618] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-23T20:44:00.152934] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-23T20:44:00.153029] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-23T20:44:00.371523] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T20:44:00.583019] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:44:00.799420] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-23T20:44:01.599438] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-23T20:44:02.325182] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-23T20:44:02.367679] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (3.15 seconds). [2025-10-23T20:44:02.399469] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-23T20:44:03.199409] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-23T20:44:03.674629] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-23T20:44:03.709258] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-23T20:44:03.999437] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-23T20:44:04.655044] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-23T20:44:04.799407] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-23T20:44:05.348492] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-23T20:44:05.599427] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-23T20:44:05.899805] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T20:44:06.399428] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-23T20:44:06.773920] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T20:44:07.199422] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-23T20:44:07.395034] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T20:44:07.999435] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-23T20:44:08.168122] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T20:44:08.281179] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T20:44:08.799461] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-23T20:44:09.599431] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-23T20:44:10.078118] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T20:44:10.399447] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-23T20:44:10.527571] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T20:44:11.199422] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-23T20:44:11.356906] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T20:44:11.999422] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-23T20:44:12.299447] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T20:44:12.799425] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-23T20:44:13.277246] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T20:44:13.599416] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-23T20:44:14.035234] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T20:44:14.399423] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-23T20:44:14.785776] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T20:44:15.199430] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-23T20:44:15.567476] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T20:44:15.959301] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:44:15.999461] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-23T20:44:16.799422] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-23T20:44:17.243384] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T20:44:17.253159] [INFO ] [REMOTE ] COTY: Full fetch complete (77276 records). [2025-10-23T20:44:17.253363] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-23T20:44:17.609278] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-23T20:44:17.659111] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-23T20:44:17.659261] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-23T20:44:17.660391] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-23T20:44:17.660587] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-23T20:44:17.662149] [DEBUG] [LOCAL ] COTY: Trimmed 77276 records to 53642 (keeping 200 days of data) [2025-10-23T20:44:17.983659] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T20:44:18.014550] [DEBUG] [LOCAL ] COTY: Primary data saved (53642 records). [2025-10-23T20:44:18.014728] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-23T20:44:18.014833] [INFO ] [MAIN ] Update Progress: 513/2367 symbols completed. COTY took 28.1s. Estimated remaining: 3h 52m 8s. Rate: 8.0 symbols/min [2025-10-23T20:44:18.179887] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:44:18.180105] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-23T20:44:18.180184] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-23T20:44:18.180295] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-23T20:44:18.180369] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-23T20:44:18.180450] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-23T20:44:18.180518] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-23T20:44:18.404989] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-23T20:44:18.548694] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:44:18.576626] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:44:19.144563] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T20:44:19.199407] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-23T20:44:19.999418] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-23T20:44:20.354320] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T20:44:20.364151] [INFO ] [REMOTE ] COUR: Full fetch complete (71213 records). [2025-10-23T20:44:20.364383] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-23T20:44:20.677093] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T20:44:20.815766] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-23T20:44:20.811410] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-23T20:44:20.815915] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-23T20:44:20.817024] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-23T20:44:20.818003] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-23T20:44:20.819576] [DEBUG] [LOCAL ] COUR: Trimmed 71213 records to 49789 (keeping 200 days of data) [2025-10-23T20:44:21.101673] [DEBUG] [LOCAL ] COUR: Primary data saved (49789 records). [2025-10-23T20:44:21.101832] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-23T20:44:21.102898] [INFO ] [MAIN ] Update Progress: 514/2367 symbols completed. COUR took 29.9s. Estimated remaining: 3h 51m 44s. Rate: 8.0 symbols/min [2025-10-23T20:44:21.273377] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:44:21.306530] [DEBUG] [LOCAL ] CPAY: Loaded 30086 existing records from primary storage. [2025-10-23T20:44:21.306836] [INFO ] [MAIN ] CPAY: Loaded 30086 existing records. [2025-10-23T20:44:21.481140] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:44:21.481373] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-23T20:44:21.481452] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-23T20:44:21.481745] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-23T20:44:21.481819] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-23T20:44:21.604531] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-23T20:44:21.848019] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:44:22.069771] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T20:44:22.114442] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-23T20:44:22.342280] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T20:44:22.399406] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-23T20:44:23.199475] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-23T20:44:23.752036] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T20:44:23.999428] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-23T20:44:24.799417] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-23T20:44:25.216967] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-23T20:44:25.336983] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-23T20:44:25.503329] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T20:44:25.599433] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-23T20:44:26.399451] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-23T20:44:26.914582] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T20:44:26.929066] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-23T20:44:27.199431] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-23T20:44:27.999448] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-23T20:44:28.537402] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-23T20:44:28.800889] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-23T20:44:28.809353] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T20:44:29.351938] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-23T20:44:29.599450] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-23T20:44:30.399467] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-23T20:44:31.120266] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T20:44:31.199446] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-23T20:44:31.999424] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-23T20:44:32.352190] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:44:32.525550] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-23T20:44:32.805434] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-23T20:44:32.820771] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T20:44:33.599465] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-23T20:44:34.399434] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-23T20:44:34.628180] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T20:44:34.637366] [INFO ] [REMOTE ] CP: Full fetch complete (77303 records). [2025-10-23T20:44:34.637511] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-23T20:44:35.035691] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-23T20:44:35.035892] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-23T20:44:35.037061] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-23T20:44:35.037161] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-23T20:44:35.038809] [DEBUG] [LOCAL ] CP: Trimmed 77303 records to 53617 (keeping 200 days of data) [2025-10-23T20:44:35.154729] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T20:44:35.249556] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-23T20:44:35.400124] [DEBUG] [LOCAL ] CP: Primary data saved (53617 records). [2025-10-23T20:44:35.400294] [INFO ] [MAIN ] CP: Full history saved. [2025-10-23T20:44:35.400407] [INFO ] [MAIN ] Update Progress: 515/2367 symbols completed. CP took 39.3s. Estimated remaining: 3h 52m 1s. Rate: 8.0 symbols/min [2025-10-23T20:44:35.571979] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:44:35.587718] [DEBUG] [LOCAL ] CPF: Loaded 15178 existing records from primary storage. [2025-10-23T20:44:35.588018] [INFO ] [MAIN ] CPF: Loaded 15178 existing records. [2025-10-23T20:44:35.742397] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T20:44:35.786665] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:44:35.787196] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-23T20:44:35.787109] [INFO ] [REMOTE ] CPA: Full fetch complete (41068 records). [2025-10-23T20:44:35.787351] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-23T20:44:35.787574] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-23T20:44:35.787864] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-23T20:44:35.788064] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-23T20:44:36.004292] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-23T20:44:36.590533] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:44:36.607465] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-23T20:44:36.607736] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-23T20:44:36.609003] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-23T20:44:36.609254] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-23T20:44:36.610508] [DEBUG] [LOCAL ] CPA: Trimmed 41068 records to 27920 (keeping 200 days of data) [2025-10-23T20:44:36.678261] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-23T20:44:36.790324] [DEBUG] [LOCAL ] CPA: Primary data saved (27920 records). [2025-10-23T20:44:36.790752] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-23T20:44:36.790971] [INFO ] [MAIN ] Update Progress: 516/2367 symbols completed. CPA took 37.0s. Estimated remaining: 3h 51m 32s. Rate: 8.0 symbols/min [2025-10-23T20:44:36.803059] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-23T20:44:36.925379] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T20:44:37.000526] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:44:37.015616] [DEBUG] [LOCAL ] CPK: Loaded 13889 existing records from primary storage. [2025-10-23T20:44:37.015942] [INFO ] [MAIN ] CPK: Loaded 13889 existing records. [2025-10-23T20:44:37.194801] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:44:37.195076] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-23T20:44:37.195152] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-23T20:44:37.195393] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-23T20:44:37.195468] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-23T20:44:37.322871] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-23T20:44:37.550907] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:44:37.599405] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-23T20:44:38.399488] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-23T20:44:38.983272] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:44:39.199437] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-23T20:44:39.314588] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T20:44:39.999451] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-23T20:44:40.482983] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T20:44:40.536256] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T20:44:40.799454] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-23T20:44:41.599424] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-23T20:44:41.956924] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T20:44:42.399441] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-23T20:44:42.587622] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T20:44:43.199441] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-23T20:44:43.883606] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T20:44:43.901697] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-23T20:44:43.999528] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-23T20:44:44.799410] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-23T20:44:45.200263] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T20:44:45.599403] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-23T20:44:45.984018] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T20:44:46.258361] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T20:44:46.259306] [INFO ] [REMOTE ] CPAC: Full fetch complete (1786 records). [2025-10-23T20:44:46.259404] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-23T20:44:46.404627] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-23T20:44:46.442734] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T20:44:46.443055] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:44:46.443160] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:44:46.443264] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-23T20:44:46.443384] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-23T20:44:46.443488] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-23T20:44:46.443602] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-23T20:44:46.443743] [INFO ] [MAIN ] Update Progress: 517/2367 symbols completed. CPAC took 28.4s. Estimated remaining: 3h 51m 32s. Rate: 8.0 symbols/min [2025-10-23T20:44:47.199446] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-23T20:44:47.524719] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T20:44:47.999475] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-23T20:44:48.520976] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T20:44:48.799433] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-23T20:44:48.978788] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T20:44:49.599511] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-23T20:44:50.242335] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T20:44:50.399512] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-23T20:44:50.809404] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T20:44:51.199430] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-23T20:44:51.740459] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-23T20:44:51.999428] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-23T20:44:52.199029] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T20:44:52.799473] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-23T20:44:53.355079] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-23T20:44:53.360482] [INFO ] [REMOTE ] CPAY: Full fetch complete (44687 records). [2025-10-23T20:44:53.360671] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-23T20:44:53.611567] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-23T20:44:53.765818] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-23T20:44:53.765952] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-23T20:44:53.766755] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-23T20:44:53.766842] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-23T20:44:53.768093] [DEBUG] [LOCAL ] CPAY: Trimmed 44687 records to 30232 (keeping 200 days of data) [2025-10-23T20:44:53.970066] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T20:44:53.985711] [DEBUG] [LOCAL ] CPAY: Primary data saved (30232 records). [2025-10-23T20:44:53.985897] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-23T20:44:53.987084] [INFO ] [MAIN ] Update Progress: 518/2367 symbols completed. CPAY took 32.9s. Estimated remaining: 3h 51m 25s. Rate: 8.0 symbols/min [2025-10-23T20:44:54.399466] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-23T20:44:54.695396] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T20:44:55.199493] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-23T20:44:55.470314] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T20:44:55.475259] [INFO ] [REMOTE ] CPK: Full fetch complete (18823 records). [2025-10-23T20:44:55.475394] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-23T20:44:55.835683] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-23T20:44:55.835808] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-23T20:44:55.836197] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-23T20:44:55.836271] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-23T20:44:55.836872] [DEBUG] [LOCAL ] CPK: Trimmed 18823 records to 14004 (keeping 200 days of data) [2025-10-23T20:44:55.923835] [DEBUG] [LOCAL ] CPK: Primary data saved (14004 records). [2025-10-23T20:44:55.924013] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-23T20:44:55.924128] [INFO ] [MAIN ] Update Progress: 519/2367 symbols completed. CPK took 19.1s. Estimated remaining: 3h 50m 57s. Rate: 8.0 symbols/min [2025-10-23T20:44:56.059234] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T20:44:56.063012] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-23T20:44:57.217708] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T20:44:57.221790] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-23T20:44:58.555151] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-23T20:44:58.558959] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-23T20:44:59.653694] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T20:44:59.659227] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-23T20:45:00.748596] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T20:45:00.751823] [INFO ] [REMOTE ] CPF: Full fetch complete (23222 records). [2025-10-23T20:45:00.751920] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-23T20:45:01.107720] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-23T20:45:01.107844] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-23T20:45:01.108498] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-23T20:45:01.108583] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-23T20:45:01.109398] [DEBUG] [LOCAL ] CPF: Trimmed 23222 records to 15267 (keeping 200 days of data) [2025-10-23T20:45:01.199373] [DEBUG] [LOCAL ] CPF: Primary data saved (15267 records). [2025-10-23T20:45:01.199539] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-23T20:45:01.199675] [INFO ] [MAIN ] Update Progress: 520/2367 symbols completed. CPF took 25.8s. Estimated remaining: 3h 50m 42s. Rate: 8.0 symbols/min [2025-10-23T20:45:01.794689] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:01.861149] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-10-23T20:45:01.924350] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:01.922401] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:01.946528] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:01.946916] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-10-23T20:45:01.949374] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-23T20:45:01.950286] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-23T20:45:01.950830] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-23T20:45:01.950910] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-23T20:45:02.148375] [DEBUG] [LOCAL ] CPS: Loaded 24879 existing records from primary storage. [2025-10-23T20:45:02.227436] [INFO ] [MAIN ] CPS: Loaded 24879 existing records. [2025-10-23T20:45:02.355671] [DEBUG] [LOCAL ] CPRI: Loaded 52430 existing records from primary storage. [2025-10-23T20:45:02.409671] [DEBUG] [LOCAL ] CPT: Loaded 44485 existing records from primary storage. [2025-10-23T20:45:02.415430] [INFO ] [MAIN ] CPRI: Loaded 52430 existing records. [2025-10-23T20:45:02.432404] [INFO ] [MAIN ] CPT: Loaded 44485 existing records. [2025-10-23T20:45:02.721535] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:02.782047] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-23T20:45:02.851131] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:02.851467] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-23T20:45:02.873003] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-23T20:45:02.953739] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-23T20:45:02.984851] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:02.990263] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-23T20:45:03.010275] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-23T20:45:03.026315] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-23T20:45:03.100698] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:03.113722] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-23T20:45:03.123351] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-23T20:45:03.140783] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-23T20:45:03.123560] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-23T20:45:03.167515] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-23T20:45:03.207064] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-23T20:45:03.920668] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:03.978187] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-23T20:45:04.237109] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:04.243101] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:04.243555] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-23T20:45:04.243825] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-23T20:45:05.683108] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T20:45:05.688161] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-23T20:45:05.907998] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (3.13 seconds). [2025-10-23T20:45:05.919228] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-23T20:45:06.039225] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T20:45:06.049698] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-23T20:45:06.188870] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T20:45:06.197868] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-23T20:45:07.000205] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T20:45:07.005759] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-23T20:45:08.090512] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-23T20:45:08.103255] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-23T20:45:08.129915] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:45:08.149605] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-23T20:45:08.157062] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T20:45:08.163624] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-23T20:45:08.198244] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-23T20:45:08.799449] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-23T20:45:09.517880] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T20:45:09.599454] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-23T20:45:09.752144] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:45:10.168430] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T20:45:10.399463] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-23T20:45:11.157738] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:45:11.199397] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-23T20:45:11.344609] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-23T20:45:11.999412] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-23T20:45:12.289625] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T20:45:12.419104] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T20:45:12.799440] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-23T20:45:13.599418] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-23T20:45:13.887437] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T20:45:14.399427] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-23T20:45:14.638566] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T20:45:15.199433] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-23T20:45:15.731248] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T20:45:15.999416] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-23T20:45:16.354843] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T20:45:16.494289] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T20:45:16.799421] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-23T20:45:17.599484] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-23T20:45:17.889812] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T20:45:17.943151] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T20:45:18.399426] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-23T20:45:19.199431] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-23T20:45:19.476064] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T20:45:19.708037] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T20:45:19.999441] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-23T20:45:20.799452] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-23T20:45:21.379105] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T20:45:21.385050] [INFO ] [REMOTE ] CPS: Full fetch complete (36594 records). [2025-10-23T20:45:21.385206] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-23T20:45:21.608971] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-23T20:45:21.767028] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-23T20:45:21.767180] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-23T20:45:21.767984] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-23T20:45:21.768079] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-23T20:45:21.769420] [DEBUG] [LOCAL ] CPS: Trimmed 36594 records to 25046 (keeping 200 days of data) [2025-10-23T20:45:21.881804] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-23T20:45:21.953415] [DEBUG] [LOCAL ] CPS: Primary data saved (25046 records). [2025-10-23T20:45:21.953596] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-23T20:45:21.953738] [INFO ] [MAIN ] Update Progress: 521/2367 symbols completed. CPS took 20.7s. Estimated remaining: 3h 51m 21s. Rate: 8.0 symbols/min [2025-10-23T20:45:22.135487] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:22.153103] [DEBUG] [LOCAL ] CQP: Loaded 18676 existing records from primary storage. [2025-10-23T20:45:22.153409] [INFO ] [MAIN ] CQP: Loaded 18676 existing records. [2025-10-23T20:45:22.353245] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:22.353480] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-23T20:45:22.353555] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-23T20:45:22.353772] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-23T20:45:22.353851] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-23T20:45:22.401905] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-23T20:45:22.719556] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:22.749155] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T20:45:23.199444] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-23T20:45:23.785201] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T20:45:23.999417] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-23T20:45:24.591212] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T20:45:24.759250] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-23T20:45:24.799403] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-23T20:45:25.599411] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-23T20:45:25.666984] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:45:26.399428] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-23T20:45:26.520186] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T20:45:27.199443] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-23T20:45:27.692328] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T20:45:27.999429] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-23T20:45:28.102437] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-23T20:45:28.708221] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T20:45:28.800792] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-23T20:45:28.804535] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-23T20:45:29.599440] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-23T20:45:30.399432] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-23T20:45:30.573877] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T20:45:30.581741] [INFO ] [REMOTE ] CPT: Full fetch complete (64752 records). [2025-10-23T20:45:30.581890] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-23T20:45:30.966604] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-23T20:45:30.966735] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-23T20:45:30.967549] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-23T20:45:30.967626] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-23T20:45:30.968999] [DEBUG] [LOCAL ] CPT: Trimmed 64752 records to 44826 (keeping 200 days of data) [2025-10-23T20:45:31.199763] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-23T20:45:31.243808] [DEBUG] [LOCAL ] CPT: Primary data saved (44826 records). [2025-10-23T20:45:31.243948] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-23T20:45:31.245760] [INFO ] [MAIN ] Update Progress: 522/2367 symbols completed. CPT took 30.0s. Estimated remaining: 3h 51m 20s. Rate: 8.0 symbols/min [2025-10-23T20:45:31.418787] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:31.443597] [DEBUG] [LOCAL ] CR: Loaded 23949 existing records from primary storage. [2025-10-23T20:45:31.443984] [INFO ] [MAIN ] CR: Loaded 23949 existing records. [2025-10-23T20:45:31.656785] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:31.652315] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-23T20:45:31.657015] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-23T20:45:31.667289] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-23T20:45:31.668405] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-23T20:45:31.668489] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-23T20:45:32.007465] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-23T20:45:32.033165] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:32.145810] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T20:45:32.799434] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-23T20:45:32.888862] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-23T20:45:33.552595] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T20:45:33.561537] [INFO ] [REMOTE ] CPRI: Full fetch complete (76226 records). [2025-10-23T20:45:33.561700] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-23T20:45:33.604963] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-23T20:45:33.968237] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-23T20:45:33.968378] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-23T20:45:33.969509] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-23T20:45:33.969637] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-23T20:45:33.971271] [DEBUG] [LOCAL ] CPRI: Trimmed 76226 records to 52812 (keeping 200 days of data) [2025-10-23T20:45:34.162828] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T20:45:34.301001] [DEBUG] [LOCAL ] CPRI: Primary data saved (52812 records). [2025-10-23T20:45:34.301166] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-23T20:45:34.301291] [INFO ] [MAIN ] Update Progress: 523/2367 symbols completed. CPRI took 33.1s. Estimated remaining: 3h 50m 57s. Rate: 8.0 symbols/min [2025-10-23T20:45:34.403734] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-23T20:45:34.476045] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:34.485516] [DEBUG] [LOCAL ] CRBD: Loaded 8761 existing records from primary storage. [2025-10-23T20:45:34.485761] [INFO ] [MAIN ] CRBD: Loaded 8761 existing records. [2025-10-23T20:45:34.671906] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:34.672122] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-23T20:45:34.672197] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-23T20:45:34.672429] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-23T20:45:34.672502] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-23T20:45:35.038729] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T20:45:35.042923] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:35.199448] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-23T20:45:35.641203] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T20:45:35.999430] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-23T20:45:36.080744] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T20:45:36.799514] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-23T20:45:37.254772] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T20:45:37.599478] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-23T20:45:38.399417] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-23T20:45:38.494798] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T20:45:39.027379] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-23T20:45:39.199432] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-23T20:45:39.790973] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T20:45:39.999428] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-23T20:45:40.799431] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-23T20:45:40.831146] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T20:45:41.448518] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-23T20:45:41.459046] [INFO ] [REMOTE ] CPNG: Full fetch complete (77790 records). [2025-10-23T20:45:41.459302] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-23T20:45:41.606529] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-23T20:45:41.912544] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-23T20:45:41.913447] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T20:45:41.913616] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-23T20:45:41.918133] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-23T20:45:41.918675] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-23T20:45:41.920265] [DEBUG] [LOCAL ] CPNG: Trimmed 77790 records to 54069 (keeping 200 days of data) [2025-10-23T20:45:42.237383] [DEBUG] [LOCAL ] CPNG: Primary data saved (54069 records). [2025-10-23T20:45:42.237568] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-23T20:45:42.237702] [INFO ] [MAIN ] Update Progress: 524/2367 symbols completed. CPNG took 41.0s. Estimated remaining: 3h 50m 51s. Rate: 8.0 symbols/min [2025-10-23T20:45:42.402168] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-23T20:45:42.426420] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:42.476049] [DEBUG] [LOCAL ] CRBG: Loaded 52600 existing records from primary storage. [2025-10-23T20:45:42.476438] [INFO ] [MAIN ] CRBG: Loaded 52600 existing records. [2025-10-23T20:45:42.649354] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:42.649576] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-23T20:45:42.649675] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-23T20:45:42.649900] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-23T20:45:42.649972] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-23T20:45:43.011352] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:43.155369] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T20:45:43.199416] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-23T20:45:43.280981] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-23T20:45:43.999515] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-23T20:45:44.237025] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T20:45:44.799439] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-23T20:45:45.500258] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T20:45:45.599448] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-23T20:45:46.399491] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-23T20:45:46.528622] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T20:45:46.531487] [INFO ] [REMOTE ] CQP: Full fetch complete (29588 records). [2025-10-23T20:45:46.531585] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-23T20:45:46.861425] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T20:45:46.948783] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-23T20:45:46.948889] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-23T20:45:46.949417] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-23T20:45:46.949520] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-23T20:45:46.950288] [DEBUG] [LOCAL ] CQP: Trimmed 29588 records to 18778 (keeping 200 days of data) [2025-10-23T20:45:47.047527] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T20:45:47.070327] [DEBUG] [LOCAL ] CQP: Primary data saved (18778 records). [2025-10-23T20:45:47.070469] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-23T20:45:47.070576] [INFO ] [MAIN ] Update Progress: 525/2367 symbols completed. CQP took 25.1s. Estimated remaining: 3h 50m 34s. Rate: 8.0 symbols/min [2025-10-23T20:45:47.209488] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-23T20:45:47.241994] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:45:47.280070] [DEBUG] [LOCAL ] CRC: Loaded 44118 existing records from primary storage. [2025-10-23T20:45:47.280420] [INFO ] [MAIN ] CRC: Loaded 44118 existing records. [2025-10-23T20:45:47.462242] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:45:47.462479] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-23T20:45:47.462558] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-23T20:45:47.462846] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-23T20:45:47.462920] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-23T20:45:47.814398] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:45:47.999434] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-23T20:45:48.487560] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T20:45:48.799446] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-23T20:45:49.599423] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-23T20:45:49.801359] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T20:45:49.829866] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T20:45:50.399439] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-23T20:45:51.193396] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T20:45:51.201051] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-23T20:45:51.999422] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-23T20:45:52.175302] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T20:45:52.440157] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T20:45:52.799457] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-23T20:45:53.269610] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T20:45:53.599496] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-23T20:45:54.399426] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-23T20:45:54.522775] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T20:45:54.774620] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T20:45:55.199443] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-23T20:45:55.593311] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T20:45:55.999465] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-23T20:45:56.799446] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-23T20:45:57.111895] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T20:45:57.187454] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T20:45:57.599407] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-23T20:45:58.083530] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T20:45:58.399430] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-23T20:45:59.199426] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-23T20:45:59.255038] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T20:45:59.498288] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T20:45:59.999438] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-23T20:46:00.799479] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-23T20:46:01.547555] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-23T20:46:01.595782] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T20:46:01.597532] [INFO ] [REMOTE ] CRBD: Full fetch complete (12902 records). [2025-10-23T20:46:01.597699] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-23T20:46:01.609544] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-23T20:46:01.901107] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-23T20:46:02.017299] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-23T20:46:02.017413] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-23T20:46:02.017890] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-23T20:46:02.018034] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-23T20:46:02.018611] [DEBUG] [LOCAL ] CRBD: Trimmed 12902 records to 8790 (keeping 200 days of data) [2025-10-23T20:46:02.072263] [DEBUG] [LOCAL ] CRBD: Primary data saved (8790 records). [2025-10-23T20:46:02.072455] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-23T20:46:02.072621] [INFO ] [MAIN ] Update Progress: 526/2367 symbols completed. CRBD took 27.8s. Estimated remaining: 3h 50m 53s. Rate: 8.0 symbols/min [2025-10-23T20:46:02.242341] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:02.242568] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-23T20:46:02.242660] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-23T20:46:02.242772] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-23T20:46:02.242841] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-23T20:46:02.242921] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-23T20:46:02.242989] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-23T20:46:02.413587] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-23T20:46:02.593963] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:03.199440] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-23T20:46:03.741983] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T20:46:03.746402] [INFO ] [REMOTE ] CR: Full fetch complete (34792 records). [2025-10-23T20:46:03.746573] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-23T20:46:04.003039] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-23T20:46:04.122490] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-23T20:46:04.133517] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-23T20:46:04.139362] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-23T20:46:04.152224] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-23T20:46:04.155108] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-23T20:46:04.166246] [DEBUG] [LOCAL ] CR: Trimmed 34792 records to 24152 (keeping 200 days of data) [2025-10-23T20:46:04.320906] [DEBUG] [LOCAL ] CR: Primary data saved (24152 records). [2025-10-23T20:46:04.321076] [INFO ] [MAIN ] CR: Full history saved. [2025-10-23T20:46:04.321218] [INFO ] [MAIN ] Update Progress: 527/2367 symbols completed. CR took 33.1s. Estimated remaining: 3h 50m 27s. Rate: 8.0 symbols/min [2025-10-23T20:46:04.416331] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:46:04.432405] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-23T20:46:04.447859] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:46:04.472090] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-23T20:46:04.479389] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:46:04.497113] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:04.494672] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-23T20:46:04.497539] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-23T20:46:04.497615] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-23T20:46:04.497728] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-23T20:46:04.497815] [INFO ] [MAIN ] Update Progress: 528/2367 symbols completed. CRCL took 2.4s. Estimated remaining: 3h 49m 54s. Rate: 8.0 symbols/min [2025-10-23T20:46:04.690026] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:04.710819] [DEBUG] [LOCAL ] CRGY: Loaded 52497 existing records from primary storage. [2025-10-23T20:46:04.711283] [INFO ] [MAIN ] CRGY: Loaded 52497 existing records. [2025-10-23T20:46:04.810282] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-23T20:46:04.919206] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:04.919814] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-23T20:46:04.919935] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-23T20:46:04.920260] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-23T20:46:04.920532] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-23T20:46:05.086952] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T20:46:05.099612] [DEBUG] [LOCAL ] CRH: Loaded 53422 existing records from primary storage. [2025-10-23T20:46:05.154943] [INFO ] [MAIN ] CRH: Loaded 53422 existing records. [2025-10-23T20:46:05.533427] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:05.552143] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-23T20:46:05.554392] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-23T20:46:05.572321] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-23T20:46:05.604470] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-23T20:46:05.604264] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-23T20:46:05.622271] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:05.971049] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:06.399425] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-23T20:46:06.896086] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-23T20:46:07.109622] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T20:46:07.199446] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-23T20:46:07.999511] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-23T20:46:08.591490] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T20:46:08.799425] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-23T20:46:08.990150] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T20:46:09.599414] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-23T20:46:09.962839] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T20:46:10.399411] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-23T20:46:10.700944] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-23T20:46:10.932004] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T20:46:11.199473] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-23T20:46:11.999406] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-23T20:46:12.350800] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:46:12.799419] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-23T20:46:13.492205] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-23T20:46:13.599443] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-23T20:46:13.795013] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T20:46:14.399456] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-23T20:46:14.629696] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T20:46:15.199493] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-23T20:46:15.850032] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-23T20:46:15.999414] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-23T20:46:16.065129] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T20:46:16.799445] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-23T20:46:17.093586] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T20:46:17.599451] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-23T20:46:18.348898] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-23T20:46:18.399421] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-23T20:46:18.531716] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T20:46:18.541112] [INFO ] [REMOTE ] CRBG: Full fetch complete (76042 records). [2025-10-23T20:46:18.541304] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-23T20:46:18.943532] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-23T20:46:18.943633] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-23T20:46:18.944663] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-23T20:46:18.944744] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-23T20:46:18.946271] [DEBUG] [LOCAL ] CRBG: Trimmed 76042 records to 52974 (keeping 200 days of data) [2025-10-23T20:46:19.220754] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-23T20:46:19.267130] [DEBUG] [LOCAL ] CRBG: Primary data saved (52974 records). [2025-10-23T20:46:19.267277] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-23T20:46:19.268244] [INFO ] [MAIN ] Update Progress: 529/2367 symbols completed. CRBG took 37.0s. Estimated remaining: 3h 50m 11s. Rate: 8.0 symbols/min [2025-10-23T20:46:19.437424] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:19.488539] [DEBUG] [LOCAL ] CRI: Loaded 49486 existing records from primary storage. [2025-10-23T20:46:19.489032] [INFO ] [MAIN ] CRI: Loaded 49486 existing records. [2025-10-23T20:46:19.667145] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:19.667382] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-23T20:46:19.667544] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-23T20:46:19.668070] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-23T20:46:19.684002] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-23T20:46:19.797467] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-23T20:46:20.004562] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-23T20:46:20.068732] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:20.448765] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-23T20:46:20.633627] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T20:46:20.641496] [INFO ] [REMOTE ] CRC: Full fetch complete (63025 records). [2025-10-23T20:46:20.641753] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-23T20:46:20.805028] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-23T20:46:21.036682] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-23T20:46:21.036797] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-23T20:46:21.037601] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-23T20:46:21.037706] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-23T20:46:21.039057] [DEBUG] [LOCAL ] CRC: Trimmed 63025 records to 44391 (keeping 200 days of data) [2025-10-23T20:46:21.300028] [DEBUG] [LOCAL ] CRC: Primary data saved (44391 records). [2025-10-23T20:46:21.300196] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-23T20:46:21.300312] [INFO ] [MAIN ] Update Progress: 530/2367 symbols completed. CRC took 34.2s. Estimated remaining: 3h 49m 45s. Rate: 8.0 symbols/min [2025-10-23T20:46:21.468108] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:21.515142] [DEBUG] [LOCAL ] CRK: Loaded 52226 existing records from primary storage. [2025-10-23T20:46:21.515485] [INFO ] [MAIN ] CRK: Loaded 52226 existing records. [2025-10-23T20:46:21.614383] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-23T20:46:21.705179] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:21.705505] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-23T20:46:21.705583] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-23T20:46:21.705947] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-23T20:46:21.706021] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-23T20:46:22.062372] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:22.092625] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T20:46:22.399411] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-23T20:46:22.568598] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T20:46:23.199438] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-23T20:46:23.891310] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-23T20:46:23.999471] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-23T20:46:24.410749] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T20:46:24.799404] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-23T20:46:24.919475] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T20:46:25.599397] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-23T20:46:26.167088] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T20:46:26.399401] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-23T20:46:26.666329] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T20:46:27.092527] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T20:46:27.199407] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-23T20:46:27.999416] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-23T20:46:28.297018] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T20:46:28.799434] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-23T20:46:28.964175] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T20:46:29.599472] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-23T20:46:29.933198] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T20:46:30.399461] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-23T20:46:30.888017] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-23T20:46:31.199425] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-23T20:46:31.517539] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T20:46:31.999416] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-23T20:46:32.297280] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T20:46:32.799425] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-23T20:46:32.882335] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T20:46:32.891831] [INFO ] [REMOTE ] CRH: Full fetch complete (77514 records). [2025-10-23T20:46:32.892007] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-23T20:46:33.279931] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-23T20:46:33.280052] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-23T20:46:33.281178] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-23T20:46:33.281259] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-23T20:46:33.282723] [DEBUG] [LOCAL ] CRH: Trimmed 77514 records to 53784 (keeping 200 days of data) [2025-10-23T20:46:33.601681] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-23T20:46:33.614881] [DEBUG] [LOCAL ] CRH: Primary data saved (53784 records). [2025-10-23T20:46:33.615081] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-23T20:46:33.616009] [INFO ] [MAIN ] Update Progress: 531/2367 symbols completed. CRH took 29.1s. Estimated remaining: 3h 49m 54s. Rate: 8.0 symbols/min [2025-10-23T20:46:33.791942] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:33.847329] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T20:46:33.872366] [DEBUG] [LOCAL ] CRL: Loaded 42624 existing records from primary storage. [2025-10-23T20:46:33.872727] [INFO ] [MAIN ] CRL: Loaded 42624 existing records. [2025-10-23T20:46:34.055392] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:34.055602] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-23T20:46:34.055708] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-23T20:46:34.055935] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-23T20:46:34.056008] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-23T20:46:34.426059] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:34.426131] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-23T20:46:34.550849] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T20:46:35.199430] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-23T20:46:35.395081] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T20:46:35.999441] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-23T20:46:36.233593] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T20:46:36.799447] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-23T20:46:37.177867] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:46:37.187030] [INFO ] [REMOTE ] CRGY: Full fetch complete (76156 records). [2025-10-23T20:46:37.187231] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-23T20:46:37.579176] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-23T20:46:37.579302] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-23T20:46:37.580261] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-23T20:46:37.580342] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-23T20:46:37.581755] [DEBUG] [LOCAL ] CRGY: Trimmed 76156 records to 52885 (keeping 200 days of data) [2025-10-23T20:46:37.637259] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-23T20:46:37.814866] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T20:46:37.923840] [DEBUG] [LOCAL ] CRGY: Primary data saved (52885 records). [2025-10-23T20:46:37.923993] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-23T20:46:37.924139] [INFO ] [MAIN ] Update Progress: 532/2367 symbols completed. CRGY took 33.6s. Estimated remaining: 3h 49m 35s. Rate: 8.0 symbols/min [2025-10-23T20:46:38.112329] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:38.163574] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-23T20:46:38.163970] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-23T20:46:38.349603] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:38.349858] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-23T20:46:38.349933] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-23T20:46:38.350266] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-23T20:46:38.350341] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-23T20:46:38.405456] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-23T20:46:38.711777] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:38.782792] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T20:46:39.199440] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-23T20:46:39.415351] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:46:39.892578] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T20:46:39.999399] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-23T20:46:40.799427] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-23T20:46:41.226909] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T20:46:41.599411] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-23T20:46:41.882419] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T20:46:42.399445] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-23T20:46:43.199556] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-23T20:46:43.419332] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-23T20:46:43.567221] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T20:46:43.882855] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T20:46:43.999431] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-23T20:46:44.799423] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-23T20:46:45.198153] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T20:46:45.599414] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-23T20:46:45.844897] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T20:46:46.399434] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-23T20:46:47.199430] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-23T20:46:47.319349] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-23T20:46:47.490824] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T20:46:47.999437] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-23T20:46:48.131189] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T20:46:48.799452] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-23T20:46:49.126195] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T20:46:49.599436] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-23T20:46:50.399474] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-23T20:46:50.468782] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-23T20:46:50.627124] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T20:46:50.635767] [INFO ] [REMOTE ] CRI: Full fetch complete (71012 records). [2025-10-23T20:46:50.635936] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-23T20:46:51.102701] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-23T20:46:51.102916] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-23T20:46:51.104019] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-23T20:46:51.104112] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-23T20:46:51.105825] [DEBUG] [LOCAL ] CRI: Trimmed 71012 records to 49854 (keeping 200 days of data) [2025-10-23T20:46:51.201144] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-23T20:46:51.449190] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:46:51.464037] [INFO ] [REMOTE ] CRK: Full fetch complete (75806 records). [2025-10-23T20:46:51.465918] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-23T20:46:51.514700] [DEBUG] [LOCAL ] CRI: Primary data saved (49854 records). [2025-10-23T20:46:51.546542] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-23T20:46:51.552560] [INFO ] [MAIN ] Update Progress: 533/2367 symbols completed. CRI took 32.3s. Estimated remaining: 3h 49m 49s. Rate: 8.0 symbols/min [2025-10-23T20:46:51.925567] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:52.089822] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-23T20:46:52.090066] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-23T20:46:52.091054] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-23T20:46:52.091198] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-23T20:46:52.117423] [DEBUG] [LOCAL ] CRK: Trimmed 75806 records to 52603 (keeping 200 days of data) [2025-10-23T20:46:52.118934] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T20:46:52.129860] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-23T20:46:52.259980] [DEBUG] [LOCAL ] CRS: Loaded 43101 existing records from primary storage. [2025-10-23T20:46:52.272096] [INFO ] [MAIN ] CRS: Loaded 43101 existing records. [2025-10-23T20:46:52.560146] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:52.572385] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-23T20:46:52.573140] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-23T20:46:52.578615] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-23T20:46:52.578755] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-23T20:46:52.824886] [DEBUG] [LOCAL ] CRK: Primary data saved (52603 records). [2025-10-23T20:46:52.840866] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-23T20:46:52.907875] [INFO ] [MAIN ] Update Progress: 534/2367 symbols completed. CRK took 31.6s. Estimated remaining: 3h 49m 20s. Rate: 8.0 symbols/min [2025-10-23T20:46:53.181092] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:53.204234] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-23T20:46:53.206238] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:46:53.215405] [DEBUG] [LOCAL ] CRT: Loaded 4763 existing records from primary storage. [2025-10-23T20:46:53.215733] [INFO ] [MAIN ] CRT: Loaded 4763 existing records. [2025-10-23T20:46:53.400273] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:46:53.400596] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-23T20:46:53.400704] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-23T20:46:53.400890] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-23T20:46:53.400964] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-23T20:46:53.758869] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:46:53.759491] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-23T20:46:53.795287] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-23T20:46:54.014721] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T20:46:54.399493] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-23T20:46:54.563303] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T20:46:54.677127] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T20:46:55.199438] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-23T20:46:55.999425] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-23T20:46:56.148954] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T20:46:56.799416] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-23T20:46:56.958477] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T20:46:57.599469] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-23T20:46:57.605845] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T20:46:58.399440] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-23T20:46:58.612810] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-23T20:46:59.014099] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T20:46:59.199514] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-23T20:46:59.937763] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T20:46:59.999403] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-23T20:47:00.799422] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-23T20:47:01.599457] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-23T20:47:01.611720] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-23T20:47:01.623126] [INFO ] [REMOTE ] CRL: Full fetch complete (63680 records). [2025-10-23T20:47:01.623339] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-23T20:47:02.032814] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-23T20:47:02.032993] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-23T20:47:02.034043] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-23T20:47:02.034185] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-23T20:47:02.035765] [DEBUG] [LOCAL ] CRL: Trimmed 63680 records to 42952 (keeping 200 days of data) [2025-10-23T20:47:02.255368] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-23T20:47:02.310574] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-23T20:47:02.346233] [DEBUG] [LOCAL ] CRL: Primary data saved (42952 records). [2025-10-23T20:47:02.346404] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-23T20:47:02.347312] [INFO ] [MAIN ] Update Progress: 535/2367 symbols completed. CRL took 28.7s. Estimated remaining: 3h 49m 19s. Rate: 8.0 symbols/min [2025-10-23T20:47:02.404584] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-23T20:47:02.519477] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:02.560887] [DEBUG] [LOCAL ] CSAN: Loaded 42220 existing records from primary storage. [2025-10-23T20:47:02.561216] [INFO ] [MAIN ] CSAN: Loaded 42220 existing records. [2025-10-23T20:47:02.737904] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:47:02.738126] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-23T20:47:02.738200] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-23T20:47:02.738415] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-23T20:47:02.738486] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-23T20:47:03.087587] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:03.199402] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-23T20:47:03.778487] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-10-23T20:47:03.999423] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-23T20:47:04.405362] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-23T20:47:04.498472] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T20:47:04.799463] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-23T20:47:05.599412] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-23T20:47:05.745197] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T20:47:06.399483] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-23T20:47:06.833492] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-23T20:47:07.123136] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T20:47:07.199463] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-23T20:47:07.489854] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T20:47:07.999453] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-23T20:47:08.056199] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T20:47:08.799503] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-23T20:47:09.583695] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T20:47:09.599394] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-23T20:47:09.686255] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-23T20:47:10.399483] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-23T20:47:11.151150] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T20:47:11.199411] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-23T20:47:11.999493] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-23T20:47:12.804998] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-23T20:47:12.821576] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T20:47:12.836474] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T20:47:13.002952] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-23T20:47:13.599501] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-23T20:47:14.340377] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T20:47:14.399421] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-23T20:47:14.746090] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-23T20:47:15.174315] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T20:47:15.175994] [INFO ] [REMOTE ] CRT: Full fetch complete (7360 records). [2025-10-23T20:47:15.176092] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-23T20:47:15.207297] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-23T20:47:15.544389] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-23T20:47:15.544523] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-23T20:47:15.544838] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-23T20:47:15.544920] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-23T20:47:15.545357] [DEBUG] [LOCAL ] CRT: Trimmed 7360 records to 4832 (keeping 200 days of data) [2025-10-23T20:47:15.572767] [DEBUG] [LOCAL ] CRT: Primary data saved (4832 records). [2025-10-23T20:47:15.572877] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-23T20:47:15.572987] [INFO ] [MAIN ] Update Progress: 536/2367 symbols completed. CRT took 22.6s. Estimated remaining: 3h 49m 31s. Rate: 8.0 symbols/min [2025-10-23T20:47:15.737635] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:15.767519] [DEBUG] [LOCAL ] CSL: Loaded 31148 existing records from primary storage. [2025-10-23T20:47:15.767841] [INFO ] [MAIN ] CSL: Loaded 31148 existing records. [2025-10-23T20:47:15.940174] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:47:15.940391] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-23T20:47:15.940469] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-23T20:47:15.940764] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-23T20:47:15.940841] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-23T20:47:16.004690] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-23T20:47:16.292114] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:16.799426] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-23T20:47:17.063582] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T20:47:17.599436] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-23T20:47:17.848135] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T20:47:18.399462] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-23T20:47:19.000463] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:47:19.199411] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-23T20:47:19.468033] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-23T20:47:19.999434] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-23T20:47:20.069031] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T20:47:20.799452] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-23T20:47:20.836216] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T20:47:21.599428] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-23T20:47:21.799405] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T20:47:22.399527] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-23T20:47:22.473772] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T20:47:22.867703] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T20:47:23.199448] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-23T20:47:23.999440] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-23T20:47:24.122142] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T20:47:24.129191] [INFO ] [REMOTE ] CRS: Full fetch complete (62311 records). [2025-10-23T20:47:24.129389] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-23T20:47:24.130228] [FATAL] [VALIDATOR ] CRS: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:47:24.130337] [FATAL] [MAIN ] CRS: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:47:24.130419] [WARN ] [MAIN ] CRS: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:47:24.130510] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-23T20:47:24.130621] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-23T20:47:24.130735] [INFO ] [LOCAL ] CRS: Starting deletion of derivative data. [2025-10-23T20:47:24.130926] [DEBUG] [LOCAL ] CRS: Deleted derivative data file. [2025-10-23T20:47:24.131055] [INFO ] [MAIN ] Update Progress: 537/2367 symbols completed. CRS took 32.6s. Estimated remaining: 3h 49m 27s. Rate: 8.0 symbols/min [2025-10-23T20:47:24.298741] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:24.312380] [DEBUG] [LOCAL ] CSR: Loaded 13395 existing records from primary storage. [2025-10-23T20:47:24.312692] [INFO ] [MAIN ] CSR: Loaded 13395 existing records. [2025-10-23T20:47:24.487294] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:47:24.487541] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-23T20:47:24.487636] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-23T20:47:24.487896] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-23T20:47:24.488014] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-23T20:47:24.804550] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-23T20:47:24.876278] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:24.954361] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-23T20:47:24.963827] [INFO ] [REMOTE ] CRM: Full fetch complete (77946 records). [2025-10-23T20:47:24.963966] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-23T20:47:25.357466] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-23T20:47:25.357889] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-23T20:47:25.358987] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-23T20:47:25.359284] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-23T20:47:25.360921] [DEBUG] [LOCAL ] CRM: Trimmed 77946 records to 54160 (keeping 200 days of data) [2025-10-23T20:47:25.473187] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T20:47:25.605953] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-23T20:47:25.729734] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-23T20:47:25.729889] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-23T20:47:25.731401] [INFO ] [MAIN ] Update Progress: 538/2367 symbols completed. CRM took 47.8s. Estimated remaining: 3h 48m 60s. Rate: 8.0 symbols/min [2025-10-23T20:47:25.897755] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:25.897924] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-23T20:47:25.901361] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-23T20:47:25.901489] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-23T20:47:25.901534] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-23T20:47:25.901580] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-23T20:47:25.901617] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-23T20:47:26.256516] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:26.280851] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T20:47:26.399407] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-23T20:47:26.668479] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T20:47:27.199430] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-23T20:47:27.999422] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-23T20:47:28.105623] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T20:47:28.184719] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T20:47:28.799446] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-23T20:47:29.599480] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-23T20:47:30.410519] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-23T20:47:30.413027] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-23T20:47:30.787326] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T20:47:30.862391] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T20:47:31.199417] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-23T20:47:31.303379] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T20:47:31.999451] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-23T20:47:32.672007] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T20:47:32.799480] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-23T20:47:33.148768] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:47:33.599465] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-23T20:47:34.399436] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-23T20:47:34.427504] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-23T20:47:34.434319] [INFO ] [REMOTE ] CSAN: Full fetch complete (60230 records). [2025-10-23T20:47:34.434453] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-23T20:47:34.758111] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T20:47:34.831024] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-23T20:47:34.831144] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-23T20:47:34.831951] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-23T20:47:34.832047] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-23T20:47:34.833285] [DEBUG] [LOCAL ] CSAN: Trimmed 60230 records to 42520 (keeping 200 days of data) [2025-10-23T20:47:35.075212] [DEBUG] [LOCAL ] CSAN: Primary data saved (42520 records). [2025-10-23T20:47:35.075367] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-23T20:47:35.076313] [INFO ] [MAIN ] Update Progress: 539/2367 symbols completed. CSAN took 32.7s. Estimated remaining: 3h 48m 58s. Rate: 8.0 symbols/min [2025-10-23T20:47:35.213678] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-23T20:47:35.245817] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:35.260688] [DEBUG] [LOCAL ] CSV: Loaded 12427 existing records from primary storage. [2025-10-23T20:47:35.260948] [INFO ] [MAIN ] CSV: Loaded 12427 existing records. [2025-10-23T20:47:35.434483] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:47:35.434763] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-23T20:47:35.434870] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-23T20:47:35.435136] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-23T20:47:35.435212] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-23T20:47:35.801010] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:35.924603] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T20:47:35.999420] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-23T20:47:36.240780] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T20:47:36.799436] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-23T20:47:37.599406] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-23T20:47:37.852222] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T20:47:37.989466] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:47:38.385366] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T20:47:38.399400] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-23T20:47:39.199428] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-23T20:47:39.480400] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T20:47:39.999463] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-23T20:47:40.799409] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-23T20:47:41.079896] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T20:47:41.100522] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T20:47:41.599423] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-23T20:47:41.947238] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T20:47:42.399473] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-23T20:47:43.202036] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-23T20:47:43.206756] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T20:47:43.247528] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-23T20:47:43.967877] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T20:47:43.999409] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-23T20:47:44.799459] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-23T20:47:45.599434] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-23T20:47:45.663548] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T20:47:45.831374] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T20:47:45.834373] [INFO ] [REMOTE ] CSR: Full fetch complete (17973 records). [2025-10-23T20:47:45.834462] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-23T20:47:46.197144] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-23T20:47:46.197251] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-23T20:47:46.197686] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-23T20:47:46.197763] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-23T20:47:46.198348] [DEBUG] [LOCAL ] CSR: Trimmed 17973 records to 13476 (keeping 200 days of data) [2025-10-23T20:47:46.280890] [DEBUG] [LOCAL ] CSR: Primary data saved (13476 records). [2025-10-23T20:47:46.281058] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-23T20:47:46.281175] [INFO ] [MAIN ] Update Progress: 540/2367 symbols completed. CSR took 22.1s. Estimated remaining: 3h 49m 3s. Rate: 8.0 symbols/min [2025-10-23T20:47:46.404615] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-23T20:47:46.464813] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:46.465000] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-23T20:47:46.465072] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-23T20:47:46.465183] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-23T20:47:46.465254] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-23T20:47:46.465335] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-23T20:47:46.465407] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-23T20:47:46.833578] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:47.199416] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-23T20:47:47.285467] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T20:47:47.552091] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:47:47.552541] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-23T20:47:47.553499] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T20:47:47.553674] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:47:47.557715] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-23T20:47:47.557797] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:47:47.557898] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-23T20:47:47.558054] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-23T20:47:47.558151] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-23T20:47:47.558265] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-23T20:47:47.558379] [INFO ] [MAIN ] Update Progress: 541/2367 symbols completed. CSW took 1.3s. Estimated remaining: 3h 48m 35s. Rate: 8.0 symbols/min [2025-10-23T20:47:47.723892] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:47.732621] [DEBUG] [LOCAL ] CTBB: Loaded 6394 existing records from primary storage. [2025-10-23T20:47:47.732900] [INFO ] [MAIN ] CTBB: Loaded 6394 existing records. [2025-10-23T20:47:47.906176] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:47:47.906473] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-23T20:47:47.906566] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-23T20:47:47.906819] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-23T20:47:47.906896] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-23T20:47:48.004562] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-23T20:47:48.265254] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:48.799485] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-23T20:47:49.529985] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T20:47:49.535696] [INFO ] [REMOTE ] CSL: Full fetch complete (45748 records). [2025-10-23T20:47:49.535862] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-23T20:47:49.604709] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-23T20:47:49.914852] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-23T20:47:49.914976] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-23T20:47:49.915741] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-23T20:47:49.915879] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-23T20:47:49.916911] [DEBUG] [LOCAL ] CSL: Trimmed 45748 records to 31384 (keeping 200 days of data) [2025-10-23T20:47:50.106675] [DEBUG] [LOCAL ] CSL: Primary data saved (31384 records). [2025-10-23T20:47:50.106861] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-23T20:47:50.107035] [INFO ] [MAIN ] Update Progress: 542/2367 symbols completed. CSL took 34.5s. Estimated remaining: 3h 48m 11s. Rate: 8.0 symbols/min [2025-10-23T20:47:50.280248] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:47:50.288057] [DEBUG] [LOCAL ] CTDD: Loaded 5135 existing records from primary storage. [2025-10-23T20:47:50.288334] [INFO ] [MAIN ] CTDD: Loaded 5135 existing records. [2025-10-23T20:47:50.402197] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-23T20:47:50.496316] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T20:47:50.502261] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:47:50.512034] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-23T20:47:50.512307] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-23T20:47:50.513242] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-23T20:47:50.513334] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-23T20:47:50.638907] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T20:47:50.876409] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:47:51.199419] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-23T20:47:51.373176] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T20:47:51.931734] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T20:47:51.999453] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-23T20:47:52.799433] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-23T20:47:52.926451] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T20:47:53.599551] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-23T20:47:54.368849] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T20:47:54.399423] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-23T20:47:54.660285] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T20:47:55.199437] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-23T20:47:55.353998] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T20:47:55.999426] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-23T20:47:56.223196] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T20:47:56.799448] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-23T20:47:56.940666] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T20:47:57.599433] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-23T20:47:57.910509] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T20:47:58.320161] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T20:47:58.399415] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-23T20:47:59.172963] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T20:47:59.199420] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-23T20:47:59.999409] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-23T20:48:00.082003] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T20:48:00.799449] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-23T20:48:01.114427] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T20:48:01.599485] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-23T20:48:02.399433] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-23T20:48:02.591663] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T20:48:02.593988] [INFO ] [REMOTE ] CSV: Full fetch complete (19016 records). [2025-10-23T20:48:02.594095] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-23T20:48:02.969132] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-23T20:48:02.969242] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-23T20:48:02.969714] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-23T20:48:02.969791] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-23T20:48:02.970360] [DEBUG] [LOCAL ] CSV: Trimmed 19016 records to 12479 (keeping 200 days of data) [2025-10-23T20:48:03.043059] [DEBUG] [LOCAL ] CSV: Primary data saved (12479 records). [2025-10-23T20:48:03.043341] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-23T20:48:03.043481] [INFO ] [MAIN ] Update Progress: 543/2367 symbols completed. CSV took 28.0s. Estimated remaining: 3h 48m 21s. Rate: 8.0 symbols/min [2025-10-23T20:48:03.094150] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T20:48:03.208730] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-23T20:48:03.226737] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:03.227680] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-23T20:48:03.227753] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-23T20:48:03.227866] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-23T20:48:03.227969] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-23T20:48:03.228054] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-23T20:48:03.228123] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-23T20:48:03.574231] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:03.999421] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-23T20:48:04.159730] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T20:48:04.213984] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T20:48:04.799471] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-23T20:48:04.923224] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T20:48:05.138755] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T20:48:05.139039] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-23T20:48:05.139111] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:48:05.139181] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-23T20:48:05.139248] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:48:05.139321] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-23T20:48:05.139412] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-23T20:48:05.139480] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-23T20:48:05.139557] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-23T20:48:05.139638] [INFO ] [MAIN ] Update Progress: 544/2367 symbols completed. CTEV took 2.1s. Estimated remaining: 3h 47m 56s. Rate: 8.0 symbols/min [2025-10-23T20:48:05.311920] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:05.312135] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-23T20:48:05.312207] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-23T20:48:05.312317] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-23T20:48:05.312417] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-23T20:48:05.312503] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-23T20:48:05.312570] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-23T20:48:05.601425] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-23T20:48:05.682886] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:06.399452] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-23T20:48:07.167612] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T20:48:07.199401] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-23T20:48:07.445832] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T20:48:07.891760] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T20:48:07.999428] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-23T20:48:08.799486] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-23T20:48:08.829108] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T20:48:09.575951] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T20:48:09.599417] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-23T20:48:10.399451] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-23T20:48:11.199480] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-23T20:48:11.242158] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T20:48:11.323490] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T20:48:11.332457] [INFO ] [REMOTE ] CSTM: Full fetch complete (69553 records). [2025-10-23T20:48:11.332609] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-23T20:48:11.763491] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-23T20:48:11.763624] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-23T20:48:11.764602] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-23T20:48:11.764714] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-23T20:48:11.766348] [DEBUG] [LOCAL ] CSTM: Trimmed 69553 records to 47799 (keeping 200 days of data) [2025-10-23T20:48:12.005713] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-23T20:48:12.071615] [DEBUG] [LOCAL ] CSTM: Primary data saved (47799 records). [2025-10-23T20:48:12.071841] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-23T20:48:12.071957] [INFO ] [MAIN ] Update Progress: 545/2367 symbols completed. CSTM took 46.3s. Estimated remaining: 3h 47m 46s. Rate: 8.0 symbols/min [2025-10-23T20:48:12.267956] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:12.303838] [DEBUG] [LOCAL ] CTOS: Loaded 37221 existing records from primary storage. [2025-10-23T20:48:12.304148] [INFO ] [MAIN ] CTOS: Loaded 37221 existing records. [2025-10-23T20:48:12.429502] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T20:48:12.500076] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:48:12.500280] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-23T20:48:12.500354] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-23T20:48:12.500634] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-23T20:48:12.500743] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-23T20:48:12.782092] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T20:48:12.799464] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-23T20:48:12.866222] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:13.599431] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-23T20:48:13.646972] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T20:48:13.649065] [INFO ] [REMOTE ] CTBB: Full fetch complete (10065 records). [2025-10-23T20:48:13.649198] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-23T20:48:14.055005] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-23T20:48:14.055172] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-23T20:48:14.055719] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-23T20:48:14.055828] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-23T20:48:14.056842] [DEBUG] [LOCAL ] CTBB: Trimmed 10065 records to 6424 (keeping 200 days of data) [2025-10-23T20:48:14.101394] [DEBUG] [LOCAL ] CTBB: Primary data saved (6424 records). [2025-10-23T20:48:14.101626] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-23T20:48:14.101789] [INFO ] [MAIN ] Update Progress: 546/2367 symbols completed. CTBB took 26.5s. Estimated remaining: 3h 47m 21s. Rate: 8.0 symbols/min [2025-10-23T20:48:14.280193] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:14.326844] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T20:48:14.328332] [INFO ] [REMOTE ] CTDD: Full fetch complete (7913 records). [2025-10-23T20:48:14.328441] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-23T20:48:14.404542] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-23T20:48:14.477250] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-23T20:48:14.513727] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-23T20:48:14.915429] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:48:14.922148] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-23T20:48:14.922400] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-23T20:48:14.922511] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-23T20:48:14.922824] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-23T20:48:14.922996] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-23T20:48:14.923048] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-23T20:48:14.923807] [DEBUG] [LOCAL ] CTDD: Trimmed 7913 records to 5159 (keeping 200 days of data) [2025-10-23T20:48:14.923855] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-23T20:48:14.924335] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-23T20:48:15.085139] [DEBUG] [LOCAL ] CTDD: Primary data saved (5159 records). [2025-10-23T20:48:15.108287] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-23T20:48:15.124028] [INFO ] [MAIN ] Update Progress: 547/2367 symbols completed. CTDD took 25.0s. Estimated remaining: 3h 46m 52s. Rate: 8.0 symbols/min [2025-10-23T20:48:15.235975] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-23T20:48:15.537508] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:15.557805] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:15.598917] [DEBUG] [LOCAL ] CTRE: Loaded 49425 existing records from primary storage. [2025-10-23T20:48:15.599240] [INFO ] [MAIN ] CTRE: Loaded 49425 existing records. [2025-10-23T20:48:15.779477] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:48:15.779742] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-23T20:48:15.779820] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-23T20:48:15.780047] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-23T20:48:15.780118] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-23T20:48:16.001190] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-23T20:48:16.102172] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T20:48:16.174033] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:16.799448] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-23T20:48:16.917017] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:48:17.599457] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-23T20:48:18.187586] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T20:48:18.267726] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T20:48:18.399459] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-23T20:48:19.017242] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:48:19.199422] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-23T20:48:19.999447] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-23T20:48:20.044854] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T20:48:20.708397] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T20:48:20.799446] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-23T20:48:21.449789] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T20:48:21.599423] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-23T20:48:22.399421] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-23T20:48:22.546142] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T20:48:23.199421] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-23T20:48:23.350276] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T20:48:23.999424] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-23T20:48:24.348368] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T20:48:24.753567] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T20:48:24.799395] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-23T20:48:25.599421] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-23T20:48:25.655254] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T20:48:26.037469] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T20:48:26.399424] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-23T20:48:26.964732] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T20:48:27.199419] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-23T20:48:27.999467] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-23T20:48:28.304498] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T20:48:28.799421] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-23T20:48:28.868229] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T20:48:29.599449] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-23T20:48:30.028853] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T20:48:30.205559] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T20:48:30.399467] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-23T20:48:30.988464] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T20:48:31.199447] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-23T20:48:31.999483] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-23T20:48:32.380312] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T20:48:32.509300] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T20:48:32.799464] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-23T20:48:33.448743] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T20:48:33.599445] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-23T20:48:34.399411] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-23T20:48:34.745481] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T20:48:35.205108] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-23T20:48:35.213614] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T20:48:35.999449] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-23T20:48:36.207782] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T20:48:36.799436] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-23T20:48:37.189474] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T20:48:37.242729] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T20:48:37.599438] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-23T20:48:38.399456] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-23T20:48:38.690720] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T20:48:39.116480] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T20:48:39.199448] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-23T20:48:39.903977] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T20:48:39.999413] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-23T20:48:40.687155] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T20:48:40.692986] [INFO ] [REMOTE ] CTO: Full fetch complete (41430 records). [2025-10-23T20:48:40.693139] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-23T20:48:40.804588] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-23T20:48:41.068637] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-23T20:48:41.068790] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-23T20:48:41.069494] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-23T20:48:41.069574] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-23T20:48:41.070695] [DEBUG] [LOCAL ] CTO: Trimmed 41430 records to 27572 (keeping 200 days of data) [2025-10-23T20:48:41.237542] [DEBUG] [LOCAL ] CTO: Primary data saved (27572 records). [2025-10-23T20:48:41.237738] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-23T20:48:41.237855] [INFO ] [MAIN ] Update Progress: 548/2367 symbols completed. CTO took 36.1s. Estimated remaining: 3h 47m 46s. Rate: 8.0 symbols/min [2025-10-23T20:48:41.404825] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:41.405010] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-23T20:48:41.405078] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-23T20:48:41.405186] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-23T20:48:41.405255] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-23T20:48:41.405335] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-23T20:48:41.405403] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-23T20:48:41.614714] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-23T20:48:41.761077] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:42.028771] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T20:48:42.399458] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-23T20:48:43.017138] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-23T20:48:43.049984] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T20:48:43.057364] [INFO ] [REMOTE ] CTOS: Full fetch complete (53946 records). [2025-10-23T20:48:43.057551] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-23T20:48:43.201267] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-23T20:48:43.438235] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-23T20:48:43.438355] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-23T20:48:43.439192] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-23T20:48:43.439297] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-23T20:48:43.440456] [DEBUG] [LOCAL ] CTOS: Trimmed 53946 records to 37510 (keeping 200 days of data) [2025-10-23T20:48:43.649093] [DEBUG] [LOCAL ] CTOS: Primary data saved (37510 records). [2025-10-23T20:48:43.649260] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-23T20:48:43.649374] [INFO ] [MAIN ] Update Progress: 549/2367 symbols completed. CTOS took 31.6s. Estimated remaining: 3h 47m 21s. Rate: 8.0 symbols/min [2025-10-23T20:48:43.819603] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:43.839871] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T20:48:43.861065] [DEBUG] [LOCAL ] CTS: Loaded 19510 existing records from primary storage. [2025-10-23T20:48:43.861466] [INFO ] [MAIN ] CTS: Loaded 19510 existing records. [2025-10-23T20:48:44.004555] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-23T20:48:44.043209] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:48:44.043525] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-23T20:48:44.043601] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-23T20:48:44.043835] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-23T20:48:44.043907] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-23T20:48:44.390470] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:44.799448] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-23T20:48:45.373267] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T20:48:45.599485] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-23T20:48:45.965800] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T20:48:45.974897] [INFO ] [REMOTE ] CTRE: Full fetch complete (71314 records). [2025-10-23T20:48:45.975051] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-23T20:48:46.076237] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T20:48:46.373085] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-23T20:48:46.373200] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-23T20:48:46.374120] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-23T20:48:46.374199] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-23T20:48:46.375553] [DEBUG] [LOCAL ] CTRE: Trimmed 71314 records to 49781 (keeping 200 days of data) [2025-10-23T20:48:46.428369] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-23T20:48:46.673532] [DEBUG] [LOCAL ] CTRE: Primary data saved (49781 records). [2025-10-23T20:48:46.673718] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-23T20:48:46.673830] [INFO ] [MAIN ] Update Progress: 550/2367 symbols completed. CTRE took 31.5s. Estimated remaining: 3h 46m 59s. Rate: 8.0 symbols/min [2025-10-23T20:48:46.839957] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:46.887155] [DEBUG] [LOCAL ] CTVA: Loaded 53308 existing records from primary storage. [2025-10-23T20:48:46.887503] [INFO ] [MAIN ] CTVA: Loaded 53308 existing records. [2025-10-23T20:48:47.069117] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:48:47.069355] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-23T20:48:47.069438] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-23T20:48:47.069717] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-23T20:48:47.069799] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-23T20:48:47.208467] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-23T20:48:47.429953] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:47.659691] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T20:48:47.794940] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T20:48:47.999403] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-23T20:48:48.438571] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T20:48:48.799462] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-23T20:48:49.599427] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-23T20:48:49.850332] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T20:48:49.859806] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-23T20:48:49.859984] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-23T20:48:50.251265] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-23T20:48:50.251393] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-23T20:48:50.252456] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-23T20:48:50.252544] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-23T20:48:50.254105] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 54037 (keeping 200 days of data) [2025-10-23T20:48:50.425259] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-23T20:48:50.579561] [DEBUG] [LOCAL ] CTRA: Primary data saved (54037 records). [2025-10-23T20:48:50.579755] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-23T20:48:50.580950] [INFO ] [MAIN ] Update Progress: 551/2367 symbols completed. CTRA took 36.5s. Estimated remaining: 3h 46m 40s. Rate: 8.0 symbols/min [2025-10-23T20:48:50.752123] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:48:50.752427] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-23T20:48:50.752526] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-23T20:48:50.752813] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-23T20:48:50.753003] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-23T20:48:50.753227] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-23T20:48:50.753413] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-23T20:48:50.884274] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-23T20:48:50.975110] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T20:48:51.167830] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:48:51.199415] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-23T20:48:51.576145] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-23T20:48:51.821992] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T20:48:51.999453] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-23T20:48:52.799450] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-23T20:48:53.244531] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T20:48:53.599498] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-23T20:48:54.233410] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T20:48:54.399463] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-23T20:48:54.879563] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T20:48:55.199430] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-23T20:48:55.584552] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T20:48:55.672828] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T20:48:55.999447] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-23T20:48:56.799477] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-23T20:48:57.599446] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-23T20:48:58.074418] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-23T20:48:58.329331] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T20:48:58.399469] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-23T20:48:58.732832] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T20:48:59.199450] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-23T20:48:59.999434] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-23T20:49:00.070530] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T20:49:00.626674] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T20:49:00.799444] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-23T20:49:01.599417] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-23T20:49:02.119494] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-10-23T20:49:02.399440] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-23T20:49:02.506481] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T20:49:02.995300] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T20:49:03.199495] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-23T20:49:03.999443] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-23T20:49:04.324254] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T20:49:04.525701] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T20:49:04.799445] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-23T20:49:04.952740] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T20:49:05.599450] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-23T20:49:06.016243] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-23T20:49:06.399411] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-23T20:49:06.743900] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T20:49:06.891858] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T20:49:07.199457] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-23T20:49:07.730679] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-23T20:49:07.999437] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-23T20:49:08.799487] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-23T20:49:09.599412] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-23T20:49:10.036750] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-23T20:49:10.138062] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T20:49:10.158740] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T20:49:10.399428] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-23T20:49:11.199409] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-23T20:49:11.576087] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T20:49:11.999461] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-23T20:49:12.437840] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T20:49:12.438619] [INFO ] [REMOTE ] CUBB: Full fetch complete (953 records). [2025-10-23T20:49:12.438728] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-23T20:49:12.634683] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-23T20:49:12.634981] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:49:12.635055] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:49:12.635134] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-23T20:49:12.635236] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-23T20:49:12.635312] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-23T20:49:12.635396] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-23T20:49:12.635490] [INFO ] [MAIN ] Update Progress: 552/2367 symbols completed. CUBB took 22.1s. Estimated remaining: 3h 47m 20s. Rate: 8.0 symbols/min [2025-10-23T20:49:12.807266] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:49:12.802203] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-23T20:49:12.867227] [DEBUG] [LOCAL ] CUBE: Loaded 50871 existing records from primary storage. [2025-10-23T20:49:12.867925] [INFO ] [MAIN ] CUBE: Loaded 50871 existing records. [2025-10-23T20:49:13.071488] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:49:13.090372] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T20:49:13.090696] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-23T20:49:13.101188] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-23T20:49:13.102026] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-23T20:49:13.102475] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-23T20:49:13.459028] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:49:13.599559] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-23T20:49:13.684520] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T20:49:14.399484] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-23T20:49:15.199508] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-23T20:49:15.514252] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T20:49:15.934894] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T20:49:15.999471] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-23T20:49:16.444225] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T20:49:16.448740] [INFO ] [REMOTE ] CTS: Full fetch complete (27368 records). [2025-10-23T20:49:16.448873] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-23T20:49:16.810287] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-23T20:49:16.824622] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-23T20:49:16.824808] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-23T20:49:16.825862] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-23T20:49:16.826046] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-23T20:49:16.827214] [DEBUG] [LOCAL ] CTS: Trimmed 27368 records to 19655 (keeping 200 days of data) [2025-10-23T20:49:16.958313] [DEBUG] [LOCAL ] CTS: Primary data saved (19655 records). [2025-10-23T20:49:16.958615] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-23T20:49:16.958808] [INFO ] [MAIN ] Update Progress: 553/2367 symbols completed. CTS took 33.3s. Estimated remaining: 3h 47m 2s. Rate: 8.0 symbols/min [2025-10-23T20:49:17.137255] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:49:17.167177] [DEBUG] [LOCAL ] CUBI: Loaded 26998 existing records from primary storage. [2025-10-23T20:49:17.167564] [INFO ] [MAIN ] CUBI: Loaded 26998 existing records. [2025-10-23T20:49:17.401100] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:49:17.401401] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-23T20:49:17.401507] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-23T20:49:17.401792] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-23T20:49:17.401881] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-23T20:49:17.606298] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-23T20:49:17.753075] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:49:18.055110] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T20:49:18.399444] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-23T20:49:18.729824] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-23T20:49:18.738524] [INFO ] [REMOTE ] CTRI: Full fetch complete (54549 records). [2025-10-23T20:49:18.738752] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-23T20:49:19.138263] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-23T20:49:19.138489] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-23T20:49:19.139291] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-23T20:49:19.139382] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-23T20:49:19.164941] [DEBUG] [LOCAL ] CTRI: Trimmed 54549 records to 41115 (keeping 200 days of data) [2025-10-23T20:49:19.165953] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T20:49:19.222392] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-23T20:49:19.414847] [DEBUG] [LOCAL ] CTRI: Primary data saved (41115 records). [2025-10-23T20:49:19.414998] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-23T20:49:19.415101] [INFO ] [MAIN ] Update Progress: 554/2367 symbols completed. CTRI took 38.2s. Estimated remaining: 3h 46m 38s. Rate: 8.0 symbols/min [2025-10-23T20:49:19.586767] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:49:19.633798] [DEBUG] [LOCAL ] CUK: Loaded 51064 existing records from primary storage. [2025-10-23T20:49:19.634119] [INFO ] [MAIN ] CUK: Loaded 51064 existing records. [2025-10-23T20:49:19.812035] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:49:19.812327] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-23T20:49:19.812495] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-23T20:49:19.813622] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-23T20:49:19.813752] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-23T20:49:19.948372] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T20:49:20.003302] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-23T20:49:20.192965] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:49:20.799403] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-23T20:49:21.219113] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T20:49:21.244671] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T20:49:21.599459] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-23T20:49:22.399488] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-23T20:49:22.890680] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-23T20:49:22.900151] [INFO ] [REMOTE ] CTVA: Full fetch complete (77235 records). [2025-10-23T20:49:22.900337] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-23T20:49:23.217079] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-23T20:49:23.245510] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T20:49:23.350307] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-23T20:49:23.350439] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-23T20:49:23.351486] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-23T20:49:23.351570] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-23T20:49:23.353162] [DEBUG] [LOCAL ] CTVA: Trimmed 77235 records to 53693 (keeping 200 days of data) [2025-10-23T20:49:23.678253] [DEBUG] [LOCAL ] CTVA: Primary data saved (53693 records). [2025-10-23T20:49:23.678456] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-23T20:49:23.678594] [INFO ] [MAIN ] Update Progress: 555/2367 symbols completed. CTVA took 37.0s. Estimated remaining: 3h 46m 20s. Rate: 8.0 symbols/min [2025-10-23T20:49:23.862682] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:49:23.866940] [DEBUG] [LOCAL ] CULP: Loaded 2843 existing records from primary storage. [2025-10-23T20:49:23.867143] [INFO ] [MAIN ] CULP: Loaded 2843 existing records. [2025-10-23T20:49:24.004625] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-23T20:49:24.063959] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:49:24.064186] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-23T20:49:24.064264] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-23T20:49:24.064549] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-23T20:49:24.064626] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-23T20:49:24.455282] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:49:24.457857] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:49:24.799411] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-23T20:49:25.246434] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T20:49:25.530061] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T20:49:25.568505] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T20:49:25.599399] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-23T20:49:26.399435] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-23T20:49:26.858307] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T20:49:27.199445] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-23T20:49:27.999430] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-23T20:49:28.328935] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:49:28.762843] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T20:49:28.799402] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-23T20:49:29.228751] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T20:49:29.599435] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-23T20:49:30.399401] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-23T20:49:30.578695] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:49:31.141340] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T20:49:31.199404] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-23T20:49:31.829989] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-23T20:49:31.999422] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-23T20:49:32.518088] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-23T20:49:32.799470] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-23T20:49:33.297198] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T20:49:33.599433] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-23T20:49:34.399404] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-23T20:49:34.944599] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T20:49:34.971334] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-23T20:49:35.139991] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T20:49:35.199399] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-23T20:49:35.999497] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-23T20:49:36.494174] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T20:49:36.498806] [INFO ] [REMOTE ] CUBI: Full fetch complete (39129 records). [2025-10-23T20:49:36.498923] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-23T20:49:36.804636] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-23T20:49:36.881688] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-23T20:49:36.882806] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-23T20:49:36.882873] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-23T20:49:36.886077] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-23T20:49:36.886176] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-23T20:49:36.887045] [DEBUG] [LOCAL ] CUBI: Trimmed 39129 records to 27213 (keeping 200 days of data) [2025-10-23T20:49:37.038982] [DEBUG] [LOCAL ] CUBI: Primary data saved (27213 records). [2025-10-23T20:49:37.039149] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-23T20:49:37.039279] [INFO ] [MAIN ] Update Progress: 556/2367 symbols completed. CUBI took 20.1s. Estimated remaining: 3h 46m 32s. Rate: 8.0 symbols/min [2025-10-23T20:49:37.206636] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:49:37.235213] [DEBUG] [LOCAL ] CURB: Loaded 32786 existing records from primary storage. [2025-10-23T20:49:37.235574] [INFO ] [MAIN ] CURB: Loaded 32786 existing records. [2025-10-23T20:49:37.409592] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:49:37.409870] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-23T20:49:37.409984] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-23T20:49:37.410236] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-23T20:49:37.410326] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-23T20:49:37.606246] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-23T20:49:37.764032] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:49:38.238874] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T20:49:38.399407] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-23T20:49:38.925991] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-23T20:49:39.199447] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-23T20:49:39.824631] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-23T20:49:39.999409] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-23T20:49:40.334723] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-23T20:49:40.799421] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-23T20:49:40.806619] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T20:49:41.599469] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-23T20:49:42.399430] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-23T20:49:42.813856] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T20:49:43.012935] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T20:49:43.199438] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-23T20:49:43.487339] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T20:49:43.838890] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T20:49:43.999448] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-23T20:49:44.799477] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-23T20:49:45.398954] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T20:49:45.599475] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-23T20:49:46.399445] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-23T20:49:46.896314] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T20:49:47.148263] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T20:49:47.199402] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-23T20:49:47.971378] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T20:49:47.999412] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-23T20:49:48.429519] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T20:49:48.701365] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T20:49:48.702371] [INFO ] [REMOTE ] CULP: Full fetch complete (4478 records). [2025-10-23T20:49:48.702459] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-23T20:49:48.804590] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-23T20:49:49.064939] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-23T20:49:49.065053] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-23T20:49:49.065228] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-23T20:49:49.065305] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-23T20:49:49.065718] [DEBUG] [LOCAL ] CULP: Trimmed 4478 records to 2847 (keeping 200 days of data) [2025-10-23T20:49:49.081503] [DEBUG] [LOCAL ] CULP: Primary data saved (2847 records). [2025-10-23T20:49:49.081599] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-23T20:49:49.081728] [INFO ] [MAIN ] Update Progress: 557/2367 symbols completed. CULP took 25.4s. Estimated remaining: 3h 46m 39s. Rate: 8.0 symbols/min [2025-10-23T20:49:49.599448] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-23T20:49:50.399462] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-23T20:49:50.607185] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T20:49:50.616517] [INFO ] [REMOTE ] CUBE: Full fetch complete (73340 records). [2025-10-23T20:49:50.616717] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-23T20:49:51.005191] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-23T20:49:51.005336] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-23T20:49:51.006407] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-23T20:49:51.006509] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-23T20:49:51.008124] [DEBUG] [LOCAL ] CUBE: Trimmed 73340 records to 51249 (keeping 200 days of data) [2025-10-23T20:49:51.316315] [DEBUG] [LOCAL ] CUBE: Primary data saved (51249 records). [2025-10-23T20:49:51.316493] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-23T20:49:51.317430] [INFO ] [MAIN ] Update Progress: 558/2367 symbols completed. CUBE took 38.7s. Estimated remaining: 3h 46m 14s. Rate: 8.0 symbols/min [2025-10-23T20:49:51.674233] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-23T20:49:51.686199] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-23T20:49:52.062999] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T20:49:52.072111] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-23T20:49:53.398873] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T20:49:53.404945] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-23T20:49:53.634392] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:49:53.646073] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-23T20:49:54.814061] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T20:49:54.820826] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-23T20:49:55.724932] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-23T20:49:55.734171] [INFO ] [REMOTE ] CUK: Full fetch complete (74379 records). [2025-10-23T20:49:55.734338] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-23T20:49:56.138459] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-23T20:49:56.144856] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-23T20:49:56.157026] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-23T20:49:56.157247] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-23T20:49:56.159194] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T20:49:56.167061] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-23T20:49:56.167176] [DEBUG] [LOCAL ] CUK: Trimmed 74379 records to 51440 (keeping 200 days of data) [2025-10-23T20:49:56.461766] [DEBUG] [LOCAL ] CUK: Primary data saved (51440 records). [2025-10-23T20:49:56.461921] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-23T20:49:56.462941] [INFO ] [MAIN ] Update Progress: 559/2367 symbols completed. CUK took 37.0s. Estimated remaining: 3h 45m 59s. Rate: 8.0 symbols/min [2025-10-23T20:49:57.783576] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T20:49:57.791105] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-23T20:49:59.232800] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T20:49:59.239917] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-23T20:50:01.381197] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T20:50:01.388437] [INFO ] [REMOTE ] CURB: Full fetch complete (47576 records). [2025-10-23T20:50:01.388622] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-23T20:50:01.840496] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-23T20:50:01.840866] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-23T20:50:01.841963] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-23T20:50:01.842063] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-23T20:50:01.843596] [DEBUG] [LOCAL ] CURB: Trimmed 47576 records to 33062 (keeping 200 days of data) [2025-10-23T20:50:02.085715] [DEBUG] [LOCAL ] CURB: Primary data saved (33062 records). [2025-10-23T20:50:02.085902] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-23T20:50:02.086047] [INFO ] [MAIN ] Update Progress: 560/2367 symbols completed. CURB took 25.0s. Estimated remaining: 3h 45m 46s. Rate: 8.0 symbols/min [2025-10-23T20:50:02.752191] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:02.883727] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:02.904732] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:02.879061] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:02.905788] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-23T20:50:02.906189] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-23T20:50:02.906324] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-23T20:50:02.906376] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-23T20:50:02.906431] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-23T20:50:02.906472] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-23T20:50:03.107285] [DEBUG] [LOCAL ] CURV: Loaded 27192 existing records from primary storage. [2025-10-23T20:50:03.149815] [INFO ] [MAIN ] CURV: Loaded 27192 existing records. [2025-10-23T20:50:03.389742] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-23T20:50:03.434944] [DEBUG] [LOCAL ] CUZ: Loaded 49436 existing records from primary storage. [2025-10-23T20:50:03.435110] [INFO ] [MAIN ] CVE: Loaded 53567 existing records. [2025-10-23T20:50:03.520885] [INFO ] [MAIN ] CUZ: Loaded 49436 existing records. [2025-10-23T20:50:03.750797] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:03.803336] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:03.819400] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-23T20:50:03.803593] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-23T20:50:03.848598] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-23T20:50:03.928806] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-23T20:50:03.999190] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:03.999283] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-23T20:50:03.994289] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:04.010472] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-23T20:50:04.010741] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-23T20:50:04.010603] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-23T20:50:04.042479] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-23T20:50:04.055238] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-23T20:50:04.080946] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-23T20:50:04.064034] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-23T20:50:04.099366] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-23T20:50:04.982834] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:04.995131] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-23T20:50:05.127923] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:05.157491] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-23T20:50:05.157111] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:05.158989] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-23T20:50:05.166792] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T20:50:05.169106] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-23T20:50:06.246519] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T20:50:06.250355] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-23T20:50:06.406267] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T20:50:06.412167] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-23T20:50:06.670669] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T20:50:06.679986] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-23T20:50:06.866091] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T20:50:06.876424] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-23T20:50:07.513073] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T20:50:07.517258] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-23T20:50:07.662998] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T20:50:07.668549] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-23T20:50:08.160564] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T20:50:08.170170] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-23T20:50:08.386282] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T20:50:08.389894] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-23T20:50:08.662951] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T20:50:08.672194] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-23T20:50:08.878734] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-23T20:50:08.889076] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-23T20:50:09.278186] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T20:50:09.599439] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-23T20:50:09.948556] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T20:50:10.014705] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T20:50:10.399452] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-23T20:50:10.464422] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T20:50:10.705307] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T20:50:11.199444] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-23T20:50:11.999415] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-23T20:50:12.315379] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T20:50:12.353264] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T20:50:12.799457] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-23T20:50:13.306716] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T20:50:13.599432] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-23T20:50:13.835748] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T20:50:14.399473] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-23T20:50:14.918781] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T20:50:15.199512] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-23T20:50:15.999450] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-23T20:50:16.408321] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T20:50:16.799436] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-23T20:50:16.995159] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T20:50:17.108135] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T20:50:17.599502] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-23T20:50:18.399459] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-23T20:50:18.855738] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-23T20:50:19.199446] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-23T20:50:19.307126] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T20:50:19.999443] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-23T20:50:20.183315] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T20:50:20.799476] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-23T20:50:21.313062] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-23T20:50:21.339699] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T20:50:21.509763] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T20:50:21.513287] [INFO ] [REMOTE ] CVEO: Full fetch complete (20978 records). [2025-10-23T20:50:21.513422] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-23T20:50:21.604586] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-23T20:50:21.918355] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-23T20:50:21.918476] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-23T20:50:21.919088] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-23T20:50:21.919171] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-23T20:50:21.919822] [DEBUG] [LOCAL ] CVEO: Trimmed 20978 records to 15266 (keeping 200 days of data) [2025-10-23T20:50:22.008220] [DEBUG] [LOCAL ] CVEO: Primary data saved (15266 records). [2025-10-23T20:50:22.008429] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-23T20:50:22.008549] [INFO ] [MAIN ] Update Progress: 561/2367 symbols completed. CVEO took 19.9s. Estimated remaining: 3h 46m 18s. Rate: 8.0 symbols/min [2025-10-23T20:50:22.172970] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:22.173134] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-23T20:50:22.173207] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-23T20:50:22.173315] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-23T20:50:22.173387] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-23T20:50:22.173468] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-23T20:50:22.173537] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-23T20:50:22.404697] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-23T20:50:22.528451] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:23.199460] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-23T20:50:23.314848] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T20:50:23.999420] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-23T20:50:24.420553] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T20:50:24.799408] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-23T20:50:24.966603] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T20:50:25.599435] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-23T20:50:25.840986] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T20:50:26.126321] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T20:50:26.132456] [INFO ] [REMOTE ] CURV: Full fetch complete (38958 records). [2025-10-23T20:50:26.132598] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-23T20:50:26.409058] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-23T20:50:26.509489] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-23T20:50:26.509608] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-23T20:50:26.510266] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-23T20:50:26.510363] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-23T20:50:26.511263] [DEBUG] [LOCAL ] CURV: Trimmed 38958 records to 27396 (keeping 200 days of data) [2025-10-23T20:50:26.656775] [DEBUG] [LOCAL ] CURV: Primary data saved (27396 records). [2025-10-23T20:50:26.656958] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-23T20:50:26.657087] [INFO ] [MAIN ] Update Progress: 562/2367 symbols completed. CURV took 24.6s. Estimated remaining: 3h 46m 1s. Rate: 8.0 symbols/min [2025-10-23T20:50:26.824188] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:26.839101] [DEBUG] [LOCAL ] CVLG: Loaded 15231 existing records from primary storage. [2025-10-23T20:50:26.839390] [INFO ] [MAIN ] CVLG: Loaded 15231 existing records. [2025-10-23T20:50:27.019666] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:27.019884] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-23T20:50:27.019962] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-23T20:50:27.020390] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-23T20:50:27.020469] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-23T20:50:27.202719] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-23T20:50:27.416076] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:27.417804] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T20:50:27.999421] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-23T20:50:28.385017] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-23T20:50:28.799411] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-23T20:50:29.130456] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T20:50:29.440476] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T20:50:29.599481] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-23T20:50:30.399486] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-23T20:50:30.836520] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T20:50:31.199411] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-23T20:50:31.545446] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T20:50:31.597841] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T20:50:31.999454] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-23T20:50:32.799441] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-23T20:50:33.036740] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T20:50:33.111494] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T20:50:33.599484] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-23T20:50:34.377720] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T20:50:34.399393] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-23T20:50:34.631058] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T20:50:35.199484] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-23T20:50:35.425906] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T20:50:35.999442] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-23T20:50:36.799459] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-23T20:50:37.236958] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T20:50:37.247183] [INFO ] [REMOTE ] CVE: Full fetch complete (77718 records). [2025-10-23T20:50:37.247385] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-23T20:50:37.603006] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-23T20:50:37.647027] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-23T20:50:37.647154] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-23T20:50:37.648230] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-23T20:50:37.648314] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-23T20:50:37.649829] [DEBUG] [LOCAL ] CVE: Trimmed 77718 records to 53957 (keeping 200 days of data) [2025-10-23T20:50:37.898982] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T20:50:37.926832] [INFO ] [REMOTE ] CUZ: Full fetch complete (70764 records). [2025-10-23T20:50:37.929750] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-23T20:50:38.059254] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T20:50:38.348683] [DEBUG] [LOCAL ] CVE: Primary data saved (53957 records). [2025-10-23T20:50:38.359568] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-23T20:50:38.366473] [INFO ] [MAIN ] Update Progress: 563/2367 symbols completed. CVE took 36.3s. Estimated remaining: 3h 46m 7s. Rate: 8.0 symbols/min [2025-10-23T20:50:38.413393] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-23T20:50:38.557038] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-23T20:50:38.563728] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-23T20:50:38.577436] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-23T20:50:38.577546] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-23T20:50:38.635997] [DEBUG] [LOCAL ] CUZ: Trimmed 70764 records to 49765 (keeping 200 days of data) [2025-10-23T20:50:38.660073] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:38.987294] [DEBUG] [LOCAL ] CVNA: Loaded 52837 existing records from primary storage. [2025-10-23T20:50:38.989052] [INFO ] [MAIN ] CVNA: Loaded 52837 existing records. [2025-10-23T20:50:39.174529] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T20:50:39.198419] [DEBUG] [LOCAL ] CUZ: Primary data saved (49765 records). [2025-10-23T20:50:39.209448] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-23T20:50:39.249009] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:39.250027] [INFO ] [MAIN ] Update Progress: 564/2367 symbols completed. CUZ took 37.2s. Estimated remaining: 3h 45m 39s. Rate: 8.0 symbols/min [2025-10-23T20:50:39.270960] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-23T20:50:39.250413] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-23T20:50:39.313516] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-23T20:50:39.352248] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-23T20:50:39.354810] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-23T20:50:39.539829] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:39.702608] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T20:50:39.858835] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:39.860984] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-23T20:50:39.861276] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-23T20:50:40.007352] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-23T20:50:40.038054] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:40.038349] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-23T20:50:40.038468] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-23T20:50:40.038721] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-23T20:50:40.038795] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-23T20:50:40.407442] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:40.799396] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-23T20:50:41.180250] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T20:50:41.236196] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T20:50:41.599433] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-23T20:50:42.399496] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-23T20:50:43.199423] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-23T20:50:43.268382] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-23T20:50:43.434714] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:50:43.468674] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T20:50:43.999448] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-23T20:50:44.799448] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-23T20:50:45.326728] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-23T20:50:45.599411] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-23T20:50:45.691266] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T20:50:46.399461] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-23T20:50:47.096285] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-23T20:50:47.199442] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-23T20:50:47.720796] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-23T20:50:47.999416] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-23T20:50:48.171305] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T20:50:48.179941] [INFO ] [REMOTE ] CVI: Full fetch complete (67240 records). [2025-10-23T20:50:48.180150] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-23T20:50:48.573687] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-23T20:50:48.573807] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-23T20:50:48.574663] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-23T20:50:48.574744] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-23T20:50:48.576119] [DEBUG] [LOCAL ] CVI: Trimmed 67240 records to 47049 (keeping 200 days of data) [2025-10-23T20:50:48.759804] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T20:50:48.801631] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-23T20:50:48.870546] [DEBUG] [LOCAL ] CVI: Primary data saved (47049 records). [2025-10-23T20:50:48.870752] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-23T20:50:48.870875] [INFO ] [MAIN ] Update Progress: 565/2367 symbols completed. CVI took 26.9s. Estimated remaining: 3h 45m 38s. Rate: 8.0 symbols/min [2025-10-23T20:50:49.040779] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:49.097012] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-23T20:50:49.097347] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-23T20:50:49.276639] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:49.277034] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-23T20:50:49.277183] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-23T20:50:49.277433] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-23T20:50:49.277521] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-23T20:50:49.588927] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-23T20:50:49.621479] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-23T20:50:49.684578] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:49.900299] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T20:50:49.903193] [INFO ] [REMOTE ] CVLG: Full fetch complete (21345 records). [2025-10-23T20:50:49.903313] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-23T20:50:50.270485] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-23T20:50:50.270623] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-23T20:50:50.271216] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-23T20:50:50.271312] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-23T20:50:50.271990] [DEBUG] [LOCAL ] CVLG: Trimmed 21345 records to 15392 (keeping 200 days of data) [2025-10-23T20:50:50.361038] [DEBUG] [LOCAL ] CVLG: Primary data saved (15392 records). [2025-10-23T20:50:50.361206] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-23T20:50:50.361335] [INFO ] [MAIN ] Update Progress: 566/2367 symbols completed. CVLG took 23.7s. Estimated remaining: 3h 45m 11s. Rate: 8.0 symbols/min [2025-10-23T20:50:50.406477] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-23T20:50:50.535626] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:50:50.556976] [DEBUG] [LOCAL ] CW: Loaded 21935 existing records from primary storage. [2025-10-23T20:50:50.557302] [INFO ] [MAIN ] CW: Loaded 21935 existing records. [2025-10-23T20:50:50.734170] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:50:50.734396] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-23T20:50:50.734502] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-23T20:50:50.734806] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-23T20:50:50.734893] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-23T20:50:51.090381] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:50:51.199412] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-23T20:50:51.889135] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-23T20:50:51.999401] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-23T20:50:52.799428] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-23T20:50:52.957671] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T20:50:53.434970] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-10-23T20:50:53.599482] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-23T20:50:54.309804] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-23T20:50:54.399403] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-23T20:50:54.952525] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-23T20:50:55.199432] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-23T20:50:55.978048] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-23T20:50:55.999424] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-23T20:50:56.720326] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-23T20:50:56.799433] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-23T20:50:57.557313] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-23T20:50:57.599396] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-23T20:50:58.399427] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-23T20:50:58.568131] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-23T20:50:58.814774] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-23T20:50:59.199430] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-23T20:50:59.642622] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T20:51:00.002865] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-23T20:51:00.004680] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-23T20:51:00.799445] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-23T20:51:01.599480] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-23T20:51:02.295831] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-10-23T20:51:02.399406] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-23T20:51:02.535533] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-23T20:51:03.018429] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-23T20:51:03.199450] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-23T20:51:03.999418] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-23T20:51:04.325953] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-23T20:51:04.353133] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T20:51:04.799613] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-23T20:51:04.971066] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-23T20:51:05.599424] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-23T20:51:06.284996] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-23T20:51:06.286424] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T20:51:06.399398] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-23T20:51:07.199508] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-23T20:51:07.896521] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-23T20:51:07.999434] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-23T20:51:08.705567] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-23T20:51:08.799446] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-23T20:51:09.599468] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-23T20:51:09.730324] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-23T20:51:10.205608] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-23T20:51:10.399396] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-23T20:51:10.478452] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T20:51:10.487785] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-23T20:51:10.487931] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-23T20:51:10.807366] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T20:51:10.925962] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-23T20:51:10.926131] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-23T20:51:10.927638] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-23T20:51:10.927750] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-23T20:51:10.930240] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54084 (keeping 200 days of data) [2025-10-23T20:51:11.212769] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-23T20:51:11.288065] [DEBUG] [LOCAL ] CVS: Primary data saved (54084 records). [2025-10-23T20:51:11.289332] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T20:51:11.289464] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-23T20:51:11.289811] [INFO ] [MAIN ] Update Progress: 567/2367 symbols completed. CVS took 32.0s. Estimated remaining: 3h 45m 46s. Rate: 8.0 symbols/min [2025-10-23T20:51:11.361579] [INFO ] [REMOTE ] CVNA: Full fetch complete (76352 records). [2025-10-23T20:51:11.378128] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-23T20:51:11.399401] [FATAL] [VALIDATOR ] CVNA: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:51:11.399608] [FATAL] [MAIN ] CVNA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:51:11.399704] [WARN ] [MAIN ] CVNA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:51:11.399801] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-23T20:51:11.410725] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-23T20:51:11.410826] [INFO ] [LOCAL ] CVNA: Starting deletion of derivative data. [2025-10-23T20:51:11.438322] [DEBUG] [LOCAL ] CVNA: Deleted derivative data file. [2025-10-23T20:51:11.451892] [INFO ] [MAIN ] Update Progress: 568/2367 symbols completed. CVNA took 33.1s. Estimated remaining: 3h 45m 15s. Rate: 8.0 symbols/min [2025-10-23T20:51:11.469075] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:11.639139] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:11.677092] [DEBUG] [LOCAL ] CWAN: Loaded 52687 existing records from primary storage. [2025-10-23T20:51:11.677529] [INFO ] [MAIN ] CWAN: Loaded 52687 existing records. [2025-10-23T20:51:11.833112] [DEBUG] [LOCAL ] CWEN: Loaded 45287 existing records from primary storage. [2025-10-23T20:51:11.865398] [INFO ] [MAIN ] CWEN: Loaded 45287 existing records. [2025-10-23T20:51:11.885622] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:11.922698] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-23T20:51:11.961731] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-23T20:51:12.002459] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-23T20:51:12.006899] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-23T20:51:12.006762] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-23T20:51:12.215430] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:12.230026] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-23T20:51:12.230141] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-23T20:51:12.251375] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-23T20:51:12.287569] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-23T20:51:12.839998] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:12.860680] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-23T20:51:12.952949] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:13.308816] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T20:51:13.599438] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-23T20:51:13.892750] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-23T20:51:14.399420] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-23T20:51:14.848280] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-23T20:51:15.199433] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-23T20:51:15.356609] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T20:51:15.999435] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-23T20:51:16.480216] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T20:51:16.618689] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-23T20:51:16.799446] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-23T20:51:17.599416] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-23T20:51:17.653049] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T20:51:18.399457] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-23T20:51:18.829774] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T20:51:19.127140] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-23T20:51:19.199392] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-23T20:51:19.999428] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-23T20:51:20.165623] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T20:51:20.174395] [INFO ] [REMOTE ] CVX: Full fetch complete (77550 records). [2025-10-23T20:51:20.174571] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-23T20:51:20.175322] [FATAL] [VALIDATOR ] CVX: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:51:20.175421] [FATAL] [MAIN ] CVX: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:51:20.175512] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:51:20.175609] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-23T20:51:20.175740] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-23T20:51:20.175833] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-23T20:51:20.176364] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-23T20:51:20.177847] [INFO ] [MAIN ] Update Progress: 569/2367 symbols completed. CVX took 31.3s. Estimated remaining: 3h 45m 12s. Rate: 8.0 symbols/min [2025-10-23T20:51:20.377795] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:20.379760] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T20:51:20.438762] [DEBUG] [LOCAL ] CWH: Loaded 51271 existing records from primary storage. [2025-10-23T20:51:20.439091] [INFO ] [MAIN ] CWH: Loaded 51271 existing records. [2025-10-23T20:51:20.619049] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:20.619270] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-23T20:51:20.619349] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-23T20:51:20.620288] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-23T20:51:20.620364] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-23T20:51:20.804809] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-23T20:51:20.983251] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:21.445376] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T20:51:21.599482] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-23T20:51:22.316179] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T20:51:22.320168] [INFO ] [REMOTE ] CW: Full fetch complete (32902 records). [2025-10-23T20:51:22.320372] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-23T20:51:22.408970] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-23T20:51:22.713166] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-23T20:51:22.713326] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-23T20:51:22.713948] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-23T20:51:22.714025] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-23T20:51:22.714825] [DEBUG] [LOCAL ] CW: Trimmed 32902 records to 22064 (keeping 200 days of data) [2025-10-23T20:51:22.853332] [DEBUG] [LOCAL ] CW: Primary data saved (22064 records). [2025-10-23T20:51:22.853499] [INFO ] [MAIN ] CW: Full history saved. [2025-10-23T20:51:22.853610] [INFO ] [MAIN ] Update Progress: 570/2367 symbols completed. CW took 32.5s. Estimated remaining: 3h 44m 49s. Rate: 8.0 symbols/min [2025-10-23T20:51:23.039208] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:23.083444] [DEBUG] [LOCAL ] CWK: Loaded 49638 existing records from primary storage. [2025-10-23T20:51:23.083849] [INFO ] [MAIN ] CWK: Loaded 49638 existing records. [2025-10-23T20:51:23.203030] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-23T20:51:23.273166] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:23.273814] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-23T20:51:23.273909] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-23T20:51:23.274575] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-23T20:51:23.274700] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-23T20:51:23.663370] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T20:51:23.728247] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:23.999447] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-23T20:51:24.397227] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T20:51:24.796034] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T20:51:24.805319] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-23T20:51:25.509451] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T20:51:25.599424] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-23T20:51:26.399441] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-23T20:51:26.758021] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T20:51:27.199436] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-23T20:51:27.338600] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T20:51:27.858790] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T20:51:27.999405] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-23T20:51:28.799500] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-23T20:51:28.944301] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T20:51:29.599431] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-23T20:51:29.916777] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T20:51:30.399515] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-23T20:51:30.558399] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T20:51:31.199505] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-23T20:51:31.439343] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T20:51:31.796127] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T20:51:31.999445] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-23T20:51:32.799504] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-23T20:51:33.327219] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T20:51:33.599455] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-23T20:51:33.804507] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T20:51:34.399454] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-23T20:51:34.502368] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T20:51:35.199457] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-23T20:51:35.346908] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T20:51:35.999434] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-23T20:51:36.044893] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T20:51:36.799410] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-23T20:51:37.204420] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T20:51:37.599473] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-23T20:51:37.814874] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T20:51:38.399406] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-23T20:51:38.589745] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T20:51:39.199430] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-23T20:51:39.660721] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T20:51:39.999454] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-23T20:51:40.306716] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T20:51:40.730138] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T20:51:40.738726] [INFO ] [REMOTE ] CWEN: Full fetch complete (65695 records). [2025-10-23T20:51:40.738899] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-23T20:51:40.804695] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-23T20:51:41.131458] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-23T20:51:41.131571] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-23T20:51:41.132415] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-23T20:51:41.132495] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-23T20:51:41.133799] [DEBUG] [LOCAL ] CWEN: Trimmed 65695 records to 45626 (keeping 200 days of data) [2025-10-23T20:51:41.405046] [DEBUG] [LOCAL ] CWEN: Primary data saved (45626 records). [2025-10-23T20:51:41.405255] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-23T20:51:41.406250] [INFO ] [MAIN ] Update Progress: 571/2367 symbols completed. CWEN took 29.9s. Estimated remaining: 3h 45m 16s. Rate: 8.0 symbols/min [2025-10-23T20:51:41.573903] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:41.601758] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-23T20:51:41.602402] [DEBUG] [LOCAL ] CWT: Loaded 28062 existing records from primary storage. [2025-10-23T20:51:41.603621] [INFO ] [MAIN ] CWT: Loaded 28062 existing records. [2025-10-23T20:51:41.781226] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:41.781554] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-23T20:51:41.781723] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-23T20:51:41.781983] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-23T20:51:41.782105] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-23T20:51:42.117208] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-23T20:51:42.178919] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:42.399393] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-23T20:51:42.736603] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T20:51:43.180130] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:51:43.199406] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-23T20:51:43.917455] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T20:51:43.999417] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-23T20:51:44.799488] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-23T20:51:44.990891] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T20:51:45.599459] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-23T20:51:46.031093] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-23T20:51:46.040175] [INFO ] [REMOTE ] CWAN: Full fetch complete (75613 records). [2025-10-23T20:51:46.040336] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-23T20:51:46.402998] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-23T20:51:46.444504] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-23T20:51:46.444632] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-23T20:51:46.445719] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-23T20:51:46.445941] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-23T20:51:46.447466] [DEBUG] [LOCAL ] CWAN: Trimmed 75613 records to 53059 (keeping 200 days of data) [2025-10-23T20:51:46.690579] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T20:51:46.797115] [DEBUG] [LOCAL ] CWAN: Primary data saved (53059 records). [2025-10-23T20:51:46.797272] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-23T20:51:46.797387] [INFO ] [MAIN ] Update Progress: 572/2367 symbols completed. CWAN took 35.5s. Estimated remaining: 3h 45m 2s. Rate: 8.0 symbols/min [2025-10-23T20:51:46.978241] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:47.021269] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:51:47.044324] [DEBUG] [LOCAL ] CX: Loaded 52826 existing records from primary storage. [2025-10-23T20:51:47.044710] [INFO ] [MAIN ] CX: Loaded 52826 existing records. [2025-10-23T20:51:47.203460] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-23T20:51:47.233051] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:47.233247] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-23T20:51:47.233322] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-23T20:51:47.233547] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-23T20:51:47.233620] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-23T20:51:47.607312] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:47.999412] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-23T20:51:48.363634] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T20:51:48.799435] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-23T20:51:49.138560] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T20:51:49.199459] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T20:51:49.599443] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-23T20:51:50.399421] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-23T20:51:50.660727] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T20:51:51.206439] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-23T20:51:51.207710] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T20:51:51.999423] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-23T20:51:52.168797] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T20:51:52.177564] [INFO ] [REMOTE ] CWH: Full fetch complete (73222 records). [2025-10-23T20:51:52.177789] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-23T20:51:52.572463] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-23T20:51:52.572583] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-23T20:51:52.573490] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-23T20:51:52.573571] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-23T20:51:52.575035] [DEBUG] [LOCAL ] CWH: Trimmed 73222 records to 51624 (keeping 200 days of data) [2025-10-23T20:51:52.811347] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-23T20:51:52.892246] [DEBUG] [LOCAL ] CWH: Primary data saved (51624 records). [2025-10-23T20:51:52.892450] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-23T20:51:52.892573] [INFO ] [MAIN ] Update Progress: 573/2367 symbols completed. CWH took 32.7s. Estimated remaining: 3h 44m 50s. Rate: 8.0 symbols/min [2025-10-23T20:51:53.069430] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:51:53.104969] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-23T20:51:53.119217] [DEBUG] [LOCAL ] CXE: Loaded 6414 existing records from primary storage. [2025-10-23T20:51:53.120183] [INFO ] [MAIN ] CXE: Loaded 6414 existing records. [2025-10-23T20:51:53.304448] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:51:53.314188] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-23T20:51:53.329471] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-23T20:51:53.331212] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T20:51:53.331290] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-23T20:51:53.331666] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-23T20:51:53.604598] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-23T20:51:53.773463] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:51:54.399448] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-23T20:51:54.715692] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T20:51:54.970506] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-23T20:51:55.199399] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-23T20:51:55.532751] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T20:51:55.999459] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-23T20:51:56.799438] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-23T20:51:56.974923] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:51:57.599439] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-23T20:51:57.694052] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T20:51:57.984830] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T20:51:58.399435] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-23T20:51:59.199421] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-23T20:51:59.287412] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T20:51:59.296160] [INFO ] [REMOTE ] CWK: Full fetch complete (71402 records). [2025-10-23T20:51:59.296313] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-23T20:51:59.405502] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T20:51:59.688025] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-23T20:51:59.688156] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-23T20:51:59.689133] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-23T20:51:59.689251] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-23T20:51:59.690697] [DEBUG] [LOCAL ] CWK: Trimmed 71402 records to 50023 (keeping 200 days of data) [2025-10-23T20:51:59.971292] [DEBUG] [LOCAL ] CWK: Primary data saved (50023 records). [2025-10-23T20:51:59.971474] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-23T20:51:59.971607] [INFO ] [MAIN ] Update Progress: 574/2367 symbols completed. CWK took 37.1s. Estimated remaining: 3h 44m 41s. Rate: 8.0 symbols/min [2025-10-23T20:52:00.005573] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-23T20:52:00.153458] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:00.160012] [DEBUG] [LOCAL ] CXH: Loaded 4392 existing records from primary storage. [2025-10-23T20:52:00.160265] [INFO ] [MAIN ] CXH: Loaded 4392 existing records. [2025-10-23T20:52:00.331129] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:00.331326] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-23T20:52:00.331406] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-23T20:52:00.331583] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-23T20:52:00.331688] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-23T20:52:00.676901] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:00.799416] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-23T20:52:01.104969] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T20:52:01.543120] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-23T20:52:01.599447] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-23T20:52:02.174405] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T20:52:02.399445] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-23T20:52:02.497321] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T20:52:03.199418] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-23T20:52:03.888594] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T20:52:03.999444] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-23T20:52:04.799433] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-23T20:52:05.111823] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T20:52:05.602944] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-23T20:52:05.614681] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-23T20:52:06.227412] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T20:52:06.236409] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T20:52:06.399439] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-23T20:52:07.199487] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-23T20:52:07.216127] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T20:52:07.999467] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-23T20:52:08.594707] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T20:52:08.602038] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T20:52:08.799434] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-23T20:52:09.599484] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-23T20:52:10.198151] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T20:52:10.399469] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-23T20:52:11.199415] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-23T20:52:11.263275] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T20:52:11.700430] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T20:52:11.999436] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-23T20:52:12.645747] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T20:52:12.799459] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-23T20:52:12.885304] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T20:52:13.599499] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-23T20:52:14.252927] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T20:52:14.260844] [INFO ] [REMOTE ] CWT: Full fetch complete (41396 records). [2025-10-23T20:52:14.261012] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-23T20:52:14.399425] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-23T20:52:14.455396] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T20:52:14.527919] [INFO ] [REMOTE ] CXE: Full fetch complete (11285 records). [2025-10-23T20:52:14.567513] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-23T20:52:14.851249] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-23T20:52:14.880332] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-23T20:52:14.947380] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-23T20:52:15.003941] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-23T20:52:15.063005] [DEBUG] [LOCAL ] CWT: Trimmed 41396 records to 28287 (keeping 200 days of data) [2025-10-23T20:52:15.216219] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-23T20:52:15.309806] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T20:52:15.346819] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-23T20:52:15.366952] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-23T20:52:15.372308] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-23T20:52:15.380109] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-23T20:52:15.409514] [DEBUG] [LOCAL ] CXE: Trimmed 11285 records to 6427 (keeping 200 days of data) [2025-10-23T20:52:15.491185] [DEBUG] [LOCAL ] CWT: Primary data saved (28287 records). [2025-10-23T20:52:15.500139] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-23T20:52:15.505096] [DEBUG] [LOCAL ] CXE: Primary data saved (6427 records). [2025-10-23T20:52:15.505333] [INFO ] [MAIN ] Update Progress: 575/2367 symbols completed. CWT took 34.1s. Estimated remaining: 3h 44m 59s. Rate: 8.0 symbols/min [2025-10-23T20:52:15.511533] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-23T20:52:15.542991] [INFO ] [MAIN ] Update Progress: 576/2367 symbols completed. CXE took 22.7s. Estimated remaining: 3h 44m 28s. Rate: 8.0 symbols/min [2025-10-23T20:52:15.970955] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:15.974415] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:16.005772] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-23T20:52:16.020502] [DEBUG] [LOCAL ] CXT: Loaded 30698 existing records from primary storage. [2025-10-23T20:52:16.020841] [INFO ] [MAIN ] CXT: Loaded 30698 existing records. [2025-10-23T20:52:16.142513] [DEBUG] [LOCAL ] CXM: Loaded 47404 existing records from primary storage. [2025-10-23T20:52:16.164114] [INFO ] [MAIN ] CXM: Loaded 47404 existing records. [2025-10-23T20:52:16.318700] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:16.342129] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-23T20:52:16.342224] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-23T20:52:16.353503] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-23T20:52:16.353677] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-23T20:52:16.525116] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:16.550546] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-23T20:52:16.566975] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-23T20:52:16.571583] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-23T20:52:16.588110] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-23T20:52:16.893693] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T20:52:16.945099] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-23T20:52:17.123423] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:17.292296] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:17.325334] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-23T20:52:17.599429] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-23T20:52:17.707589] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T20:52:18.399440] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-23T20:52:19.132867] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T20:52:19.199417] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-23T20:52:19.999412] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-23T20:52:20.093606] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T20:52:20.711799] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T20:52:20.799403] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-23T20:52:21.522886] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T20:52:21.599398] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-23T20:52:22.399447] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-23T20:52:22.439292] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T20:52:22.448883] [INFO ] [REMOTE ] CX: Full fetch complete (76596 records). [2025-10-23T20:52:22.449099] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-23T20:52:22.844240] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-23T20:52:22.844370] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-23T20:52:22.845346] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-23T20:52:22.845428] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-23T20:52:22.846966] [DEBUG] [LOCAL ] CX: Trimmed 76596 records to 53209 (keeping 200 days of data) [2025-10-23T20:52:23.160495] [DEBUG] [LOCAL ] CX: Primary data saved (53209 records). [2025-10-23T20:52:23.160732] [INFO ] [MAIN ] CX: Full history saved. [2025-10-23T20:52:23.160956] [INFO ] [MAIN ] Update Progress: 577/2367 symbols completed. CX took 36.4s. Estimated remaining: 3h 44m 21s. Rate: 8.0 symbols/min [2025-10-23T20:52:23.215614] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-23T20:52:23.353614] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:23.355451] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T20:52:23.399969] [DEBUG] [LOCAL ] CXW: Loaded 43639 existing records from primary storage. [2025-10-23T20:52:23.400289] [INFO ] [MAIN ] CXW: Loaded 43639 existing records. [2025-10-23T20:52:23.576390] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:23.576679] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-23T20:52:23.576756] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-23T20:52:23.577052] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-23T20:52:23.577126] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-23T20:52:23.968385] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:23.973922] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T20:52:23.994881] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T20:52:24.001533] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-23T20:52:24.782879] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T20:52:24.799395] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-23T20:52:25.307245] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T20:52:25.308208] [INFO ] [REMOTE ] CXH: Full fetch complete (5304 records). [2025-10-23T20:52:25.308296] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-23T20:52:25.604619] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-23T20:52:25.672926] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-23T20:52:25.673042] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-23T20:52:25.673247] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-23T20:52:25.673321] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-23T20:52:25.673845] [DEBUG] [LOCAL ] CXH: Trimmed 5304 records to 4401 (keeping 200 days of data) [2025-10-23T20:52:25.700624] [DEBUG] [LOCAL ] CXH: Primary data saved (4401 records). [2025-10-23T20:52:25.700827] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-23T20:52:25.700947] [INFO ] [MAIN ] Update Progress: 578/2367 symbols completed. CXH took 25.7s. Estimated remaining: 3h 43m 58s. Rate: 8.0 symbols/min [2025-10-23T20:52:25.864566] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:25.894435] [DEBUG] [LOCAL ] CYD: Loaded 27277 existing records from primary storage. [2025-10-23T20:52:25.894769] [INFO ] [MAIN ] CYD: Loaded 27277 existing records. [2025-10-23T20:52:26.067380] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:26.067546] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-23T20:52:26.067618] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-23T20:52:26.067842] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-23T20:52:26.067913] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-23T20:52:26.407121] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-23T20:52:26.411809] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:27.199444] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-23T20:52:27.645842] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-23T20:52:27.920410] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T20:52:27.999433] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-23T20:52:28.548530] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T20:52:28.799459] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-23T20:52:29.437145] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T20:52:29.599455] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-23T20:52:30.399437] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-23T20:52:30.408881] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T20:52:30.557486] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T20:52:31.199439] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-23T20:52:31.781225] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:52:31.999445] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-23T20:52:32.799446] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-23T20:52:33.094805] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-23T20:52:33.599423] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-23T20:52:33.738447] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T20:52:33.876269] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T20:52:34.399436] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-23T20:52:34.816165] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T20:52:35.199450] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-23T20:52:35.999411] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-23T20:52:36.187621] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T20:52:36.752467] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T20:52:36.799402] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-23T20:52:37.599440] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-23T20:52:37.754591] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T20:52:38.221132] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T20:52:38.399446] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-23T20:52:39.188932] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T20:52:39.199401] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-23T20:52:39.999420] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-23T20:52:40.197333] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T20:52:40.627356] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T20:52:40.799454] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-23T20:52:41.599408] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-23T20:52:41.921222] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T20:52:42.020773] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T20:52:42.399441] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-23T20:52:43.101003] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T20:52:43.106632] [INFO ] [REMOTE ] CXT: Full fetch complete (45626 records). [2025-10-23T20:52:43.106812] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-23T20:52:43.204567] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-23T20:52:43.487822] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-23T20:52:43.487979] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-23T20:52:43.488711] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-23T20:52:43.488805] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-23T20:52:43.489971] [DEBUG] [LOCAL ] CXT: Trimmed 45626 records to 30880 (keeping 200 days of data) [2025-10-23T20:52:43.679864] [DEBUG] [LOCAL ] CXT: Primary data saved (30880 records). [2025-10-23T20:52:43.680031] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-23T20:52:43.680161] [INFO ] [MAIN ] Update Progress: 579/2367 symbols completed. CXT took 28.1s. Estimated remaining: 3h 44m 22s. Rate: 8.0 symbols/min [2025-10-23T20:52:43.856482] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:43.897497] [DEBUG] [LOCAL ] CYH: Loaded 47658 existing records from primary storage. [2025-10-23T20:52:43.897862] [INFO ] [MAIN ] CYH: Loaded 47658 existing records. [2025-10-23T20:52:44.004511] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-23T20:52:44.075392] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:44.076052] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-23T20:52:44.076140] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-23T20:52:44.076425] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-23T20:52:44.076511] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-23T20:52:44.348522] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T20:52:44.466574] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:44.663071] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T20:52:44.799440] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-23T20:52:45.599461] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-23T20:52:45.893052] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T20:52:46.049725] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T20:52:46.399455] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-23T20:52:47.199455] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-23T20:52:47.294809] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T20:52:47.999424] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-23T20:52:48.097316] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T20:52:48.808900] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-23T20:52:48.811512] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T20:52:49.406587] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T20:52:49.599442] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-23T20:52:50.155044] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T20:52:50.399453] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-23T20:52:51.097970] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T20:52:51.199420] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-23T20:52:51.921889] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T20:52:51.999421] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-23T20:52:52.799410] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-23T20:52:52.899319] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T20:52:53.047669] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T20:52:53.053424] [INFO ] [REMOTE ] CYD: Full fetch complete (36208 records). [2025-10-23T20:52:53.053534] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-23T20:52:53.430284] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-23T20:52:53.430410] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-23T20:52:53.431099] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-23T20:52:53.431181] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-23T20:52:53.432215] [DEBUG] [LOCAL ] CYD: Trimmed 36208 records to 27482 (keeping 200 days of data) [2025-10-23T20:52:53.604144] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-23T20:52:53.618506] [DEBUG] [LOCAL ] CYD: Primary data saved (27482 records). [2025-10-23T20:52:53.619828] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-23T20:52:53.619959] [INFO ] [MAIN ] Update Progress: 580/2367 symbols completed. CYD took 27.9s. Estimated remaining: 3h 44m 22s. Rate: 8.0 symbols/min [2025-10-23T20:52:53.790681] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:53.839481] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-23T20:52:53.839870] [INFO ] [MAIN ] D: Loaded 53649 existing records. [2025-10-23T20:52:54.034113] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:54.034359] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-23T20:52:54.034440] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-23T20:52:54.034781] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-23T20:52:54.034878] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-23T20:52:54.423344] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-23T20:52:54.429050] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:54.511221] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T20:52:54.519097] [INFO ] [REMOTE ] CXM: Full fetch complete (68535 records). [2025-10-23T20:52:54.519233] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-23T20:52:54.927046] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-23T20:52:54.927167] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-23T20:52:54.928249] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-23T20:52:54.928333] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-23T20:52:54.929758] [DEBUG] [LOCAL ] CXM: Trimmed 68535 records to 47703 (keeping 200 days of data) [2025-10-23T20:52:55.198665] [DEBUG] [LOCAL ] CXM: Primary data saved (47703 records). [2025-10-23T20:52:55.198876] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-23T20:52:55.199002] [INFO ] [MAIN ] Update Progress: 581/2367 symbols completed. CXM took 39.7s. Estimated remaining: 3h 43m 57s. Rate: 8.0 symbols/min [2025-10-23T20:52:55.204405] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-23T20:52:55.386714] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:52:55.416486] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T20:52:55.436294] [DEBUG] [LOCAL ] DAC: Loaded 12381 existing records from primary storage. [2025-10-23T20:52:55.436671] [INFO ] [MAIN ] DAC: Loaded 12381 existing records. [2025-10-23T20:52:55.623299] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:52:55.623541] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-23T20:52:55.623617] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-23T20:52:55.623840] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-23T20:52:55.623911] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-23T20:52:55.970209] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:52:55.999400] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-23T20:52:56.060422] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T20:52:56.799449] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-23T20:52:57.002144] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T20:52:57.187068] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T20:52:57.599445] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-23T20:52:58.399447] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-23T20:52:58.665319] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T20:52:59.199445] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-23T20:52:59.346449] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T20:52:59.354151] [INFO ] [REMOTE ] CXW: Full fetch complete (64778 records). [2025-10-23T20:52:59.354403] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-23T20:52:59.364460] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T20:52:59.744713] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-23T20:52:59.744837] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-23T20:52:59.745754] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-23T20:52:59.745834] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-23T20:52:59.747213] [DEBUG] [LOCAL ] CXW: Trimmed 64778 records to 43910 (keeping 200 days of data) [2025-10-23T20:52:59.988575] [DEBUG] [LOCAL ] CXW: Primary data saved (43910 records). [2025-10-23T20:52:59.988748] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-23T20:52:59.988861] [INFO ] [MAIN ] Update Progress: 582/2367 symbols completed. CXW took 36.8s. Estimated remaining: 3h 43m 41s. Rate: 8.0 symbols/min [2025-10-23T20:53:00.009260] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-23T20:53:00.164399] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:00.212326] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-23T20:53:00.212724] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-23T20:53:00.245624] [DEBUG] [REMOTE ] DAC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-23T20:53:00.291515] [WARN ] [REMOTE ] DAC: No data returned for month 2025-03 [2025-10-23T20:53:00.316419] [FATAL] [REMOTE ] DAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:53:00.318938] [FATAL] [MAIN ] DAC: Failed to fetch primary data. [2025-10-23T20:53:00.319051] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:53:00.319125] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-23T20:53:00.329955] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-23T20:53:00.358844] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-10-23T20:53:00.369604] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-10-23T20:53:00.377126] [INFO ] [MAIN ] Update Progress: 583/2367 symbols completed. DAC took 5.2s. Estimated remaining: 3h 43m 11s. Rate: 8.0 symbols/min [2025-10-23T20:53:00.429801] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:00.468796] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-23T20:53:00.490541] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-23T20:53:00.501973] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-23T20:53:00.502368] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-23T20:53:00.680239] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:00.803980] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-23T20:53:00.984533] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:00.998804] [DEBUG] [LOCAL ] DAN: Loaded 49384 existing records from primary storage. [2025-10-23T20:53:00.999077] [INFO ] [MAIN ] DAN: Loaded 49384 existing records. [2025-10-23T20:53:01.174686] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:01.174914] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-23T20:53:01.174989] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-23T20:53:01.175237] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-23T20:53:01.175311] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-23T20:53:01.533793] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:01.599436] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-23T20:53:01.783805] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-23T20:53:02.399470] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-23T20:53:03.199424] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-23T20:53:03.467047] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-23T20:53:03.999412] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-23T20:53:04.056031] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-23T20:53:04.135700] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T20:53:04.799450] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-23T20:53:05.057809] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T20:53:05.599425] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-23T20:53:05.948270] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T20:53:06.399453] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-23T20:53:06.935282] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-23T20:53:07.199477] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-23T20:53:07.658425] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T20:53:07.877279] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T20:53:07.999571] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-23T20:53:08.799537] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-23T20:53:09.599435] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-23T20:53:09.700269] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-23T20:53:09.913895] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T20:53:10.399499] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-23T20:53:10.897167] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T20:53:11.199496] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-23T20:53:11.439832] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:53:11.999483] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-23T20:53:12.806441] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-23T20:53:12.826565] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-23T20:53:13.132606] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T20:53:13.372570] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T20:53:13.599479] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-23T20:53:14.399437] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-23T20:53:14.985768] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-23T20:53:15.199435] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-23T20:53:15.999428] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-23T20:53:16.100361] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T20:53:16.108865] [INFO ] [REMOTE ] CYH: Full fetch complete (69768 records). [2025-10-23T20:53:16.125912] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-23T20:53:16.140851] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-23T20:53:16.534244] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-23T20:53:16.534361] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-23T20:53:16.535238] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-23T20:53:16.535317] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-23T20:53:16.536715] [DEBUG] [LOCAL ] CYH: Trimmed 69768 records to 47987 (keeping 200 days of data) [2025-10-23T20:53:16.805916] [DEBUG] [LOCAL ] CYH: Primary data saved (47987 records). [2025-10-23T20:53:16.803760] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-23T20:53:16.806279] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-23T20:53:16.806486] [INFO ] [MAIN ] Update Progress: 584/2367 symbols completed. CYH took 33.1s. Estimated remaining: 3h 43m 31s. Rate: 8.0 symbols/min [2025-10-23T20:53:17.015967] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:17.017376] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:53:17.047637] [DEBUG] [LOCAL ] DAO: Loaded 19714 existing records from primary storage. [2025-10-23T20:53:17.047958] [INFO ] [MAIN ] DAO: Loaded 19714 existing records. [2025-10-23T20:53:17.221479] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:17.221747] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-23T20:53:17.221822] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-23T20:53:17.222010] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-23T20:53:17.222082] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-23T20:53:17.565261] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:17.599394] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-23T20:53:17.932742] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T20:53:18.399412] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-23T20:53:18.748966] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T20:53:19.114740] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-23T20:53:19.199445] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-23T20:53:19.999409] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-23T20:53:20.167519] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T20:53:20.620748] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T20:53:20.799449] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-23T20:53:21.599437] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-23T20:53:22.137689] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-23T20:53:22.399470] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-23T20:53:23.199447] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-23T20:53:23.445683] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-23T20:53:23.548792] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T20:53:23.999464] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-23T20:53:24.084180] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T20:53:24.799451] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-23T20:53:25.411503] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-23T20:53:25.599424] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-23T20:53:25.838135] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:53:26.282107] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T20:53:26.399429] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-23T20:53:27.199440] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-23T20:53:27.611485] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T20:53:27.795278] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T20:53:27.999406] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-23T20:53:28.799504] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-23T20:53:29.297884] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-23T20:53:29.502522] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T20:53:29.599407] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-23T20:53:30.225409] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-23T20:53:30.399398] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-23T20:53:30.636212] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T20:53:31.199446] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-23T20:53:31.999444] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-23T20:53:32.507355] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-23T20:53:32.516906] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-23T20:53:32.517070] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-23T20:53:32.810890] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-23T20:53:32.940876] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-23T20:53:32.941253] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-23T20:53:32.942308] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-23T20:53:32.942442] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-23T20:53:32.944762] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 54039 (keeping 200 days of data) [2025-10-23T20:53:33.040257] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T20:53:33.085579] [INFO ] [REMOTE ] DAL: Full fetch complete (77541 records). [2025-10-23T20:53:33.094532] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-23T20:53:33.096405] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:53:33.100518] [FATAL] [MAIN ] DAL: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:53:33.114176] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:53:33.137011] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-23T20:53:33.142881] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-23T20:53:33.143049] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-10-23T20:53:33.145498] [DEBUG] [LOCAL ] DAL: Deleted derivative data file. [2025-10-23T20:53:33.145412] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:53:33.208543] [INFO ] [MAIN ] Update Progress: 585/2367 symbols completed. DAL took 33.2s. Estimated remaining: 3h 43m 51s. Rate: 8.0 symbols/min [2025-10-23T20:53:33.440737] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:33.560889] [DEBUG] [LOCAL ] D: Primary data saved (54039 records). [2025-10-23T20:53:33.561059] [INFO ] [MAIN ] D: Full history saved. [2025-10-23T20:53:33.561175] [INFO ] [MAIN ] Update Progress: 586/2367 symbols completed. D took 39.9s. Estimated remaining: 3h 43m 21s. Rate: 8.0 symbols/min [2025-10-23T20:53:33.604694] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-23T20:53:33.686395] [DEBUG] [LOCAL ] DAR: Loaded 51998 existing records from primary storage. [2025-10-23T20:53:33.712682] [INFO ] [MAIN ] DAR: Loaded 51998 existing records. [2025-10-23T20:53:33.807406] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:33.964699] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:33.965184] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-23T20:53:33.965328] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-23T20:53:33.966292] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-23T20:53:33.966385] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-23T20:53:34.083139] [DEBUG] [LOCAL ] DAVA: Loaded 41943 existing records from primary storage. [2025-10-23T20:53:34.109881] [INFO ] [MAIN ] DAVA: Loaded 41943 existing records. [2025-10-23T20:53:34.397890] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T20:53:34.456872] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-23T20:53:34.558152] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:34.562485] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:34.562930] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-23T20:53:34.563006] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-23T20:53:34.563270] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-23T20:53:34.563343] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-23T20:53:34.930493] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:35.199413] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-23T20:53:35.478694] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T20:53:35.487758] [INFO ] [REMOTE ] DAN: Full fetch complete (71361 records). [2025-10-23T20:53:35.487918] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-23T20:53:35.877313] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T20:53:35.905349] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-23T20:53:35.905678] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-23T20:53:35.906701] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-23T20:53:35.907184] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-23T20:53:35.909426] [DEBUG] [LOCAL ] DAN: Trimmed 71361 records to 49732 (keeping 200 days of data) [2025-10-23T20:53:36.001719] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-23T20:53:36.214202] [DEBUG] [LOCAL ] DAN: Primary data saved (49732 records). [2025-10-23T20:53:36.214391] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-23T20:53:36.214534] [INFO ] [MAIN ] Update Progress: 587/2367 symbols completed. DAN took 35.8s. Estimated remaining: 3h 42m 59s. Rate: 8.0 symbols/min [2025-10-23T20:53:36.384959] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:36.427675] [DEBUG] [LOCAL ] DAY: Loaded 49122 existing records from primary storage. [2025-10-23T20:53:36.428098] [INFO ] [MAIN ] DAY: Loaded 49122 existing records. [2025-10-23T20:53:36.622282] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:36.622748] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-23T20:53:36.622902] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-23T20:53:36.623202] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-23T20:53:36.623280] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-23T20:53:36.825079] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-23T20:53:36.998589] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T20:53:37.033346] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:37.213378] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T20:53:37.217390] [INFO ] [REMOTE ] DAO: Full fetch complete (32505 records). [2025-10-23T20:53:37.217494] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-23T20:53:37.582022] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-23T20:53:37.582137] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-23T20:53:37.582762] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-23T20:53:37.582842] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-23T20:53:37.583619] [DEBUG] [LOCAL ] DAO: Trimmed 32505 records to 19946 (keeping 200 days of data) [2025-10-23T20:53:37.627071] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-23T20:53:37.695246] [DEBUG] [LOCAL ] DAO: Primary data saved (19946 records). [2025-10-23T20:53:37.695444] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-23T20:53:37.695604] [INFO ] [MAIN ] Update Progress: 588/2367 symbols completed. DAO took 20.9s. Estimated remaining: 3h 42m 33s. Rate: 8.0 symbols/min [2025-10-23T20:53:37.862022] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:53:37.908430] [DEBUG] [LOCAL ] DB: Loaded 52466 existing records from primary storage. [2025-10-23T20:53:37.908828] [INFO ] [MAIN ] DB: Loaded 52466 existing records. [2025-10-23T20:53:38.086660] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:53:38.086910] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-23T20:53:38.086991] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-23T20:53:38.087381] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-23T20:53:38.087459] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-23T20:53:38.405355] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-23T20:53:38.457367] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T20:53:38.511602] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:53:39.199453] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-23T20:53:39.507638] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T20:53:39.999434] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-23T20:53:40.182711] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T20:53:40.799428] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-23T20:53:40.952944] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T20:53:41.167814] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T20:53:41.599447] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-23T20:53:42.399443] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-23T20:53:42.664307] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T20:53:43.199473] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-23T20:53:43.333987] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T20:53:43.999418] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-23T20:53:44.388206] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T20:53:44.750813] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T20:53:44.799402] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-23T20:53:45.599422] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-23T20:53:45.879680] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T20:53:46.377630] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T20:53:46.399398] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-23T20:53:47.199450] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-23T20:53:47.566103] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T20:53:47.999439] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-23T20:53:48.301793] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T20:53:48.799407] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-23T20:53:49.063554] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T20:53:49.606374] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-23T20:53:49.616395] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T20:53:50.399452] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-23T20:53:51.005237] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-23T20:53:51.199442] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-23T20:53:51.335504] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T20:53:52.000086] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-23T20:53:52.004176] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T20:53:52.799451] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-23T20:53:53.085502] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T20:53:53.591938] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T20:53:53.601115] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-23T20:53:54.399539] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-23T20:53:54.930568] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T20:53:55.116007] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T20:53:55.199485] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-23T20:53:55.844118] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T20:53:55.999408] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-23T20:53:56.799489] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-23T20:53:56.967148] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T20:53:57.599476] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-23T20:53:57.847878] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T20:53:58.399479] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-23T20:53:58.595691] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T20:53:59.199473] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-23T20:53:59.380297] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:53:59.999551] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-23T20:54:00.225492] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T20:54:00.799507] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-23T20:54:01.599452] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-23T20:54:01.733164] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-23T20:54:01.741359] [INFO ] [REMOTE ] DAVA: Full fetch complete (57300 records). [2025-10-23T20:54:01.741560] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-23T20:54:02.166138] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-23T20:54:02.166407] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-23T20:54:02.167383] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-23T20:54:02.167472] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-23T20:54:02.168984] [DEBUG] [LOCAL ] DAVA: Trimmed 57300 records to 42219 (keeping 200 days of data) [2025-10-23T20:54:02.413157] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-23T20:54:02.432394] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-23T20:54:02.468845] [DEBUG] [LOCAL ] DAVA: Primary data saved (42219 records). [2025-10-23T20:54:02.468982] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-23T20:54:02.469093] [INFO ] [MAIN ] Update Progress: 589/2367 symbols completed. DAVA took 28.9s. Estimated remaining: 3h 43m 18s. Rate: 8.0 symbols/min [2025-10-23T20:54:02.651051] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:02.651258] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-23T20:54:02.651327] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-23T20:54:02.651443] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-23T20:54:02.651520] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-23T20:54:02.651602] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-23T20:54:02.651693] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-23T20:54:03.058295] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:03.199417] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-23T20:54:03.347858] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-23T20:54:03.420158] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:54:03.924768] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T20:54:03.933839] [INFO ] [REMOTE ] DAR: Full fetch complete (75080 records). [2025-10-23T20:54:03.934012] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-23T20:54:04.004188] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-23T20:54:04.319353] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T20:54:04.345793] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-23T20:54:04.346468] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-23T20:54:04.347396] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-23T20:54:04.347476] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-23T20:54:04.348832] [DEBUG] [LOCAL ] DAR: Trimmed 75080 records to 52387 (keeping 200 days of data) [2025-10-23T20:54:04.644821] [DEBUG] [LOCAL ] DAR: Primary data saved (52387 records). [2025-10-23T20:54:04.644997] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-23T20:54:04.645111] [INFO ] [MAIN ] Update Progress: 590/2367 symbols completed. DAR took 31.4s. Estimated remaining: 3h 42m 54s. Rate: 8.0 symbols/min [2025-10-23T20:54:04.807681] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-23T20:54:04.810337] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:04.849186] [DEBUG] [LOCAL ] DBI: Loaded 43370 existing records from primary storage. [2025-10-23T20:54:04.849510] [INFO ] [MAIN ] DBI: Loaded 43370 existing records. [2025-10-23T20:54:05.023229] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:54:05.023498] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-23T20:54:05.023575] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-23T20:54:05.023824] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-23T20:54:05.023897] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-23T20:54:05.386286] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:05.599416] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-23T20:54:05.930569] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-23T20:54:06.151216] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-23T20:54:06.399524] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-23T20:54:07.199454] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-23T20:54:07.594271] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T20:54:07.999428] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-23T20:54:08.456305] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T20:54:08.465582] [INFO ] [REMOTE ] DB: Full fetch complete (75673 records). [2025-10-23T20:54:08.465800] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-23T20:54:08.807611] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-23T20:54:08.856326] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-23T20:54:08.857356] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-23T20:54:08.858458] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-23T20:54:08.858827] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-23T20:54:08.860502] [DEBUG] [LOCAL ] DB: Trimmed 75673 records to 52840 (keeping 200 days of data) [2025-10-23T20:54:09.005131] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T20:54:09.223966] [DEBUG] [LOCAL ] DB: Primary data saved (52840 records). [2025-10-23T20:54:09.233852] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-23T20:54:09.233237] [INFO ] [MAIN ] DB: Full history saved. [2025-10-23T20:54:09.239766] [INFO ] [MAIN ] Update Progress: 591/2367 symbols completed. DB took 31.5s. Estimated remaining: 3h 42m 38s. Rate: 8.0 symbols/min [2025-10-23T20:54:09.404338] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:09.413717] [DEBUG] [LOCAL ] DBL: Loaded 9247 existing records from primary storage. [2025-10-23T20:54:09.413924] [INFO ] [MAIN ] DBL: Loaded 9247 existing records. [2025-10-23T20:54:09.586262] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:54:09.586447] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-23T20:54:09.586524] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-23T20:54:09.586751] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-23T20:54:09.586825] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-23T20:54:09.606810] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-23T20:54:09.937203] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:10.399417] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-23T20:54:10.818167] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T20:54:11.199432] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-23T20:54:11.320670] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T20:54:11.658987] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-23T20:54:11.999445] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-23T20:54:12.799395] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-23T20:54:13.140288] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T20:54:13.599462] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-23T20:54:13.708968] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T20:54:13.819493] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T20:54:14.399438] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-23T20:54:15.088555] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T20:54:15.096688] [INFO ] [REMOTE ] DAY: Full fetch complete (71862 records). [2025-10-23T20:54:15.096863] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-23T20:54:15.204578] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-23T20:54:15.474040] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-23T20:54:15.474146] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-23T20:54:15.474985] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-23T20:54:15.475073] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-23T20:54:15.476385] [DEBUG] [LOCAL ] DAY: Trimmed 71862 records to 49492 (keeping 200 days of data) [2025-10-23T20:54:15.752419] [DEBUG] [LOCAL ] DAY: Primary data saved (49492 records). [2025-10-23T20:54:15.752565] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-23T20:54:15.753666] [INFO ] [MAIN ] Update Progress: 592/2367 symbols completed. DAY took 39.5s. Estimated remaining: 3h 42m 27s. Rate: 8.0 symbols/min [2025-10-23T20:54:15.923773] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:15.969167] [DEBUG] [LOCAL ] DBRG: Loaded 49979 existing records from primary storage. [2025-10-23T20:54:15.969484] [INFO ] [MAIN ] DBRG: Loaded 49979 existing records. [2025-10-23T20:54:16.000354] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-23T20:54:16.042879] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T20:54:16.160805] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:54:16.161102] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-23T20:54:16.161220] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-23T20:54:16.162323] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-23T20:54:16.162400] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-23T20:54:16.487097] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T20:54:16.547054] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:16.799414] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-23T20:54:17.348555] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T20:54:17.599417] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-23T20:54:18.399443] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-23T20:54:18.501801] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-23T20:54:18.529007] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T20:54:19.199431] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-23T20:54:19.999424] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-23T20:54:20.028870] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T20:54:20.252530] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T20:54:20.799441] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-23T20:54:21.001122] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T20:54:21.599434] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-23T20:54:21.696812] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T20:54:22.399460] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-23T20:54:23.199451] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-23T20:54:23.349202] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T20:54:23.481094] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T20:54:23.999442] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-23T20:54:24.154341] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T20:54:24.799437] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-23T20:54:25.599409] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-23T20:54:25.860312] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T20:54:26.180954] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T20:54:26.399453] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-23T20:54:27.199492] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-23T20:54:27.395292] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T20:54:27.435789] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T20:54:27.999443] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-23T20:54:28.457298] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T20:54:28.799426] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-23T20:54:28.927123] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T20:54:29.599456] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-23T20:54:30.399443] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-23T20:54:30.467708] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:54:31.199478] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-23T20:54:31.302928] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T20:54:31.305230] [INFO ] [REMOTE ] DBL: Full fetch complete (12843 records). [2025-10-23T20:54:31.305422] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-23T20:54:31.434443] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T20:54:31.723098] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-23T20:54:31.723254] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-23T20:54:31.723615] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-23T20:54:31.723738] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-23T20:54:31.724483] [DEBUG] [LOCAL ] DBL: Trimmed 12843 records to 9423 (keeping 200 days of data) [2025-10-23T20:54:31.784236] [DEBUG] [LOCAL ] DBL: Primary data saved (9423 records). [2025-10-23T20:54:31.784452] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-23T20:54:31.784587] [INFO ] [MAIN ] Update Progress: 593/2367 symbols completed. DBL took 22.5s. Estimated remaining: 3h 42m 45s. Rate: 8.0 symbols/min [2025-10-23T20:54:31.959093] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:31.991990] [DEBUG] [LOCAL ] DCI: Loaded 36843 existing records from primary storage. [2025-10-23T20:54:31.992364] [INFO ] [MAIN ] DCI: Loaded 36843 existing records. [2025-10-23T20:54:32.004590] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-23T20:54:32.177282] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:54:32.177526] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-23T20:54:32.177623] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-23T20:54:32.177923] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-23T20:54:32.178032] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-23T20:54:32.525220] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T20:54:32.551594] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:32.799398] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-23T20:54:33.599433] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-23T20:54:33.807799] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T20:54:34.399410] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-23T20:54:34.479522] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T20:54:34.779760] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T20:54:34.784268] [INFO ] [REMOTE ] DBD: Full fetch complete (32141 records). [2025-10-23T20:54:34.784366] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-23T20:54:35.147221] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-10-23T20:54:35.147331] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-10-23T20:54:35.148007] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-10-23T20:54:35.148085] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-10-23T20:54:35.148932] [DEBUG] [LOCAL ] DBD: Trimmed 32141 records to 24706 (keeping 200 days of data) [2025-10-23T20:54:35.203882] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-23T20:54:35.291109] [DEBUG] [LOCAL ] DBD: Primary data saved (24706 records). [2025-10-23T20:54:35.291271] [INFO ] [MAIN ] DBD: Full history saved. [2025-10-23T20:54:35.291375] [INFO ] [MAIN ] Update Progress: 594/2367 symbols completed. DBD took 32.8s. Estimated remaining: 3h 42m 26s. Rate: 8.0 symbols/min [2025-10-23T20:54:35.458372] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:35.472605] [DEBUG] [LOCAL ] DCO: Loaded 14967 existing records from primary storage. [2025-10-23T20:54:35.472894] [INFO ] [MAIN ] DCO: Loaded 14967 existing records. [2025-10-23T20:54:35.647026] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:54:35.647241] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-23T20:54:35.647324] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-23T20:54:35.647639] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-23T20:54:35.647758] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-23T20:54:35.994896] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:35.999393] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-23T20:54:36.386541] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T20:54:36.725069] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T20:54:36.799426] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-23T20:54:37.029472] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T20:54:37.599470] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-23T20:54:38.399498] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-23T20:54:38.618925] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:54:39.199472] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-23T20:54:39.348397] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T20:54:39.999428] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-23T20:54:40.165585] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T20:54:40.799462] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-23T20:54:41.205152] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T20:54:41.605316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-23T20:54:41.617222] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T20:54:41.627322] [INFO ] [REMOTE ] DBI: Full fetch complete (64729 records). [2025-10-23T20:54:41.627481] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-23T20:54:42.011140] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-23T20:54:42.011348] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-23T20:54:42.012421] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-23T20:54:42.012549] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-23T20:54:42.013994] [DEBUG] [LOCAL ] DBI: Trimmed 64729 records to 43620 (keeping 200 days of data) [2025-10-23T20:54:42.275312] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T20:54:42.296076] [DEBUG] [LOCAL ] DBI: Primary data saved (43620 records). [2025-10-23T20:54:42.296546] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-23T20:54:42.296699] [INFO ] [MAIN ] Update Progress: 595/2367 symbols completed. DBI took 37.7s. Estimated remaining: 3h 42m 16s. Rate: 8.0 symbols/min [2025-10-23T20:54:42.404559] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-23T20:54:42.471417] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:42.471751] [DEBUG] [LOCAL ] DD: No existing data file found in primary storage. [2025-10-23T20:54:42.471823] [WARN ] [MAIN ] DD: No existing data found, performing full refresh instead. [2025-10-23T20:54:42.471960] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-23T20:54:42.472046] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-23T20:54:42.472141] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-23T20:54:42.472252] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-23T20:54:42.821082] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:43.199438] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-23T20:54:43.485336] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T20:54:43.545279] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T20:54:43.999463] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-23T20:54:44.799488] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-23T20:54:44.819924] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T20:54:45.599443] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-23T20:54:45.907410] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T20:54:46.399413] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-23T20:54:46.716888] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T20:54:47.197768] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T20:54:47.209203] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-23T20:54:47.414394] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T20:54:47.999429] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-23T20:54:48.734297] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T20:54:48.765057] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T20:54:48.799395] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-23T20:54:49.409584] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T20:54:49.599414] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-23T20:54:50.399421] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-23T20:54:51.199422] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-23T20:54:51.586042] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T20:54:51.629968] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T20:54:51.999448] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-23T20:54:52.745091] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T20:54:52.799032] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T20:54:52.803055] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-23T20:54:53.599441] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-23T20:54:54.399437] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-23T20:54:54.474750] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T20:54:55.199436] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-23T20:54:55.552370] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T20:54:55.561399] [INFO ] [REMOTE ] DBRG: Full fetch complete (72589 records). [2025-10-23T20:54:55.561545] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-23T20:54:55.945862] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-23T20:54:55.945978] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-23T20:54:55.946886] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-23T20:54:55.946967] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-23T20:54:55.948435] [DEBUG] [LOCAL ] DBRG: Trimmed 72589 records to 50364 (keeping 200 days of data) [2025-10-23T20:54:55.999531] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-23T20:54:56.251155] [DEBUG] [LOCAL ] DBRG: Primary data saved (50364 records). [2025-10-23T20:54:56.251323] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-23T20:54:56.252411] [INFO ] [MAIN ] Update Progress: 596/2367 symbols completed. DBRG took 40.5s. Estimated remaining: 3h 42m 28s. Rate: 8.0 symbols/min [2025-10-23T20:54:56.430607] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:54:56.482252] [DEBUG] [LOCAL ] DDD: Loaded 50948 existing records from primary storage. [2025-10-23T20:54:56.482587] [INFO ] [MAIN ] DDD: Loaded 50948 existing records. [2025-10-23T20:54:56.641043] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T20:54:56.713229] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:54:56.713610] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-23T20:54:56.713771] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-23T20:54:56.714124] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-23T20:54:56.714204] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-23T20:54:56.804466] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-23T20:54:56.811880] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T20:54:57.137084] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:54:57.213038] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T20:54:57.599467] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-23T20:54:58.399423] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-23T20:54:58.609636] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T20:54:59.199434] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-23T20:54:59.487122] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T20:54:59.902911] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T20:54:59.910413] [INFO ] [REMOTE ] DCI: Full fetch complete (53698 records). [2025-10-23T20:54:59.910685] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-23T20:55:00.004891] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-23T20:55:00.316291] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-23T20:55:00.316406] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-23T20:55:00.317222] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-23T20:55:00.317301] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-23T20:55:00.318476] [DEBUG] [LOCAL ] DCI: Trimmed 53698 records to 37136 (keeping 200 days of data) [2025-10-23T20:55:00.537802] [DEBUG] [LOCAL ] DCI: Primary data saved (37136 records). [2025-10-23T20:55:00.538000] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-23T20:55:00.538113] [INFO ] [MAIN ] Update Progress: 597/2367 symbols completed. DCI took 28.8s. Estimated remaining: 3h 42m 11s. Rate: 8.0 symbols/min [2025-10-23T20:55:00.799423] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-23T20:55:00.971466] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T20:55:01.599498] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-23T20:55:01.966052] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T20:55:02.399499] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-23T20:55:02.587783] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-23T20:55:03.199437] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-23T20:55:03.694774] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T20:55:03.698284] [INFO ] [REMOTE ] DCO: Full fetch complete (19704 records). [2025-10-23T20:55:03.698379] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-23T20:55:04.065459] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-23T20:55:04.065569] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-23T20:55:04.066142] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-23T20:55:04.066221] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-23T20:55:04.066836] [DEBUG] [LOCAL ] DCO: Trimmed 19704 records to 15051 (keeping 200 days of data) [2025-10-23T20:55:04.151024] [DEBUG] [LOCAL ] DCO: Primary data saved (15051 records). [2025-10-23T20:55:04.151178] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-23T20:55:04.151291] [INFO ] [MAIN ] Update Progress: 598/2367 symbols completed. DCO took 28.9s. Estimated remaining: 3h 41m 52s. Rate: 8.0 symbols/min [2025-10-23T20:55:05.229145] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (3.63 seconds). [2025-10-23T20:55:05.241292] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-23T20:55:05.281794] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-23T20:55:05.292459] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-23T20:55:07.211540] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T20:55:07.222304] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-23T20:55:07.354910] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-23T20:55:07.366253] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-23T20:55:08.447341] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T20:55:08.458904] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-23T20:55:09.193977] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T20:55:09.204738] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-23T20:55:10.010909] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T20:55:10.020079] [INFO ] [REMOTE ] DD: Full fetch complete (76617 records). [2025-10-23T20:55:10.020199] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-23T20:55:10.400196] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-23T20:55:10.400300] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-23T20:55:10.401215] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-23T20:55:10.401293] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-23T20:55:10.402740] [DEBUG] [LOCAL ] DD: Trimmed 76617 records to 53305 (keeping 200 days of data) [2025-10-23T20:55:10.713034] [DEBUG] [LOCAL ] DD: Primary data saved (53305 records). [2025-10-23T20:55:10.713222] [INFO ] [MAIN ] DD: Full history saved. [2025-10-23T20:55:10.713328] [INFO ] [MAIN ] Update Progress: 599/2367 symbols completed. DD took 28.4s. Estimated remaining: 3h 41m 41s. Rate: 8.0 symbols/min [2025-10-23T20:55:11.233586] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-23T20:55:11.243927] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-23T20:55:13.277401] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T20:55:13.288569] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-23T20:55:15.367726] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-23T20:55:15.378523] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-23T20:55:17.364911] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T20:55:17.376774] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-23T20:55:19.467539] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-23T20:55:19.477614] [INFO ] [REMOTE ] DDD: Full fetch complete (73965 records). [2025-10-23T20:55:19.477799] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-23T20:55:19.908114] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-23T20:55:19.908235] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-23T20:55:19.909209] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-23T20:55:19.909297] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-23T20:55:19.910792] [DEBUG] [LOCAL ] DDD: Trimmed 73965 records to 51313 (keeping 200 days of data) [2025-10-23T20:55:20.234959] [DEBUG] [LOCAL ] DDD: Primary data saved (51313 records). [2025-10-23T20:55:20.235139] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-23T20:55:20.236114] [INFO ] [MAIN ] Update Progress: 600/2367 symbols completed. DDD took 24.0s. Estimated remaining: 3h 41m 40s. Rate: 8.0 symbols/min [2025-10-23T20:55:20.811753] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:20.996601] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:20.951780] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:21.012681] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:21.013700] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-23T20:55:21.014731] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-23T20:55:21.014869] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-23T20:55:21.014929] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-23T20:55:21.015687] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-23T20:55:21.015906] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-23T20:55:21.129143] [DEBUG] [LOCAL ] DDS: Loaded 12375 existing records from primary storage. [2025-10-23T20:55:21.140183] [INFO ] [MAIN ] DDS: Loaded 12375 existing records. [2025-10-23T20:55:21.368030] [DEBUG] [LOCAL ] DDL: Loaded 37179 existing records from primary storage. [2025-10-23T20:55:21.441460] [INFO ] [MAIN ] DDL: Loaded 37179 existing records. [2025-10-23T20:55:21.497452] [DEBUG] [LOCAL ] DE: Loaded 47533 existing records from primary storage. [2025-10-23T20:55:21.622290] [INFO ] [MAIN ] DE: Loaded 47533 existing records. [2025-10-23T20:55:21.631451] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:55:21.782539] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-23T20:55:21.797408] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-23T20:55:21.833493] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:21.833587] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-23T20:55:21.871988] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-23T20:55:21.882775] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-23T20:55:21.928104] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:55:21.951306] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-23T20:55:22.010198] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-23T20:55:22.017783] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-23T20:55:22.116991] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:55:22.072992] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-23T20:55:22.138693] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-23T20:55:22.168399] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-23T20:55:22.323462] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-23T20:55:22.383168] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-23T20:55:22.778332] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:22.801861] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-23T20:55:22.801998] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T20:55:22.870916] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-23T20:55:23.073564] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:23.073921] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-23T20:55:23.150125] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:23.150455] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-23T20:55:23.549737] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-23T20:55:23.550912] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-23T20:55:23.897777] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T20:55:23.900735] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-23T20:55:24.229767] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T20:55:24.231167] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-23T20:55:24.533328] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T20:55:24.540325] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-23T20:55:24.958968] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T20:55:24.969222] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-23T20:55:24.983756] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T20:55:24.986895] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-23T20:55:25.019704] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T20:55:25.021143] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-23T20:55:25.588980] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-23T20:55:25.590050] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-23T20:55:26.008361] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T20:55:26.011989] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-23T20:55:26.167373] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T20:55:26.166466] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-23T20:55:26.175306] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-23T20:55:26.176550] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-23T20:55:26.839987] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T20:55:26.853383] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-23T20:55:26.865204] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T20:55:26.866534] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-23T20:55:27.344201] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T20:55:27.348037] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-23T20:55:27.503808] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T20:55:27.505139] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-23T20:55:27.899524] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T20:55:27.999402] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-23T20:55:28.093297] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T20:55:28.559335] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T20:55:28.799431] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-23T20:55:28.944482] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T20:55:29.336174] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-23T20:55:29.337099] [INFO ] [REMOTE ] DDT: Full fetch complete (2820 records). [2025-10-23T20:55:29.337185] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-23T20:55:29.605864] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-23T20:55:29.720205] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-23T20:55:29.720591] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-23T20:55:29.720851] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-23T20:55:29.721027] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-23T20:55:29.721491] [DEBUG] [LOCAL ] DDT: Trimmed 2820 records to 1876 (keeping 200 days of data) [2025-10-23T20:55:29.733166] [DEBUG] [LOCAL ] DDT: Primary data saved (1876 records). [2025-10-23T20:55:29.733304] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-23T20:55:29.733409] [INFO ] [MAIN ] Update Progress: 601/2367 symbols completed. DDT took 9.5s. Estimated remaining: 3h 41m 38s. Rate: 8.0 symbols/min [2025-10-23T20:55:29.946794] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:29.949842] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-23T20:55:29.950522] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-23T20:55:29.951850] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T20:55:29.952085] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-23T20:55:29.962156] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-23T20:55:29.962780] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-23T20:55:29.963160] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-23T20:55:30.326631] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:30.399432] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-23T20:55:31.199424] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-23T20:55:31.408432] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T20:55:31.655231] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T20:55:31.999444] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-23T20:55:32.799404] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-23T20:55:32.901232] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T20:55:33.194958] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T20:55:33.599413] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-23T20:55:34.399403] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-23T20:55:34.654121] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T20:55:34.972383] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T20:55:35.199429] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-23T20:55:35.999435] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-23T20:55:36.023854] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T20:55:36.631209] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T20:55:36.799434] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-23T20:55:37.103083] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T20:55:37.599408] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-23T20:55:38.399423] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-23T20:55:38.612410] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T20:55:38.663596] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T20:55:39.199445] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-23T20:55:39.999454] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-23T20:55:40.193550] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T20:55:40.581817] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T20:55:40.799459] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-23T20:55:41.587457] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-23T20:55:41.599398] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-23T20:55:42.399409] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-23T20:55:42.863136] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T20:55:42.896796] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T20:55:43.199436] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-23T20:55:43.845005] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T20:55:43.856404] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T20:55:43.858367] [INFO ] [REMOTE ] DDS: Full fetch complete (18414 records). [2025-10-23T20:55:43.858473] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-23T20:55:44.005248] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-23T20:55:44.219227] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-23T20:55:44.219337] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-23T20:55:44.219815] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-23T20:55:44.219895] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-23T20:55:44.220502] [DEBUG] [LOCAL ] DDS: Trimmed 18414 records to 12405 (keeping 200 days of data) [2025-10-23T20:55:44.295606] [DEBUG] [LOCAL ] DDS: Primary data saved (12405 records). [2025-10-23T20:55:44.295782] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-23T20:55:44.295926] [INFO ] [MAIN ] Update Progress: 602/2367 symbols completed. DDS took 24.1s. Estimated remaining: 3h 41m 51s. Rate: 8.0 symbols/min [2025-10-23T20:55:44.460607] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:44.460814] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-23T20:55:44.460901] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-23T20:55:44.461048] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-23T20:55:44.461135] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-23T20:55:44.461246] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-23T20:55:44.461349] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-23T20:55:44.811032] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:44.805321] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-23T20:55:45.599443] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-23T20:55:45.843238] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:55:45.896888] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T20:55:46.399435] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-23T20:55:46.913217] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-23T20:55:47.199430] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-23T20:55:47.999424] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-23T20:55:48.175804] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T20:55:48.799441] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-23T20:55:48.851794] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T20:55:49.058333] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T20:55:49.599427] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-23T20:55:50.399443] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-23T20:55:50.453601] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T20:55:50.462215] [INFO ] [REMOTE ] DDL: Full fetch complete (53578 records). [2025-10-23T20:55:50.462408] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-23T20:55:50.850957] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-23T20:55:50.851063] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-23T20:55:50.851807] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-23T20:55:50.851885] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-23T20:55:50.852954] [DEBUG] [LOCAL ] DDL: Trimmed 53578 records to 37424 (keeping 200 days of data) [2025-10-23T20:55:51.054666] [DEBUG] [LOCAL ] DDL: Primary data saved (37424 records). [2025-10-23T20:55:51.054820] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-23T20:55:51.054927] [INFO ] [MAIN ] Update Progress: 603/2367 symbols completed. DDL took 30.8s. Estimated remaining: 3h 41m 41s. Rate: 8.0 symbols/min [2025-10-23T20:55:51.201205] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-23T20:55:51.224496] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:51.274401] [DEBUG] [LOCAL ] DECK: Loaded 53301 existing records from primary storage. [2025-10-23T20:55:51.274752] [INFO ] [MAIN ] DECK: Loaded 53301 existing records. [2025-10-23T20:55:51.473333] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:55:51.474865] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T20:55:51.483451] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-23T20:55:51.483996] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-23T20:55:51.484638] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-23T20:55:51.484737] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-23T20:55:51.838488] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:52.006238] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-23T20:55:52.025233] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T20:55:52.799410] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-23T20:55:53.151556] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T20:55:53.599463] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-23T20:55:53.678238] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T20:55:54.399469] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-23T20:55:54.431079] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T20:55:54.865603] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T20:55:55.199503] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-23T20:55:55.999473] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-23T20:55:56.055994] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T20:55:56.064454] [INFO ] [REMOTE ] DE: Full fetch complete (69930 records). [2025-10-23T20:55:56.064700] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-23T20:55:56.470357] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-23T20:55:56.470559] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-23T20:55:56.471466] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-23T20:55:56.477726] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-23T20:55:56.489615] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T20:55:56.497239] [DEBUG] [LOCAL ] DE: Trimmed 69930 records to 47878 (keeping 200 days of data) [2025-10-23T20:55:56.801471] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-23T20:55:56.835946] [DEBUG] [LOCAL ] DE: Primary data saved (47878 records). [2025-10-23T20:55:56.836121] [INFO ] [MAIN ] DE: Full history saved. [2025-10-23T20:55:56.836237] [INFO ] [MAIN ] Update Progress: 604/2367 symbols completed. DE took 36.6s. Estimated remaining: 3h 41m 29s. Rate: 8.0 symbols/min [2025-10-23T20:55:57.004742] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:57.048514] [DEBUG] [LOCAL ] DEI: Loaded 48295 existing records from primary storage. [2025-10-23T20:55:57.048927] [INFO ] [MAIN ] DEI: Loaded 48295 existing records. [2025-10-23T20:55:57.234660] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:55:57.234914] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-23T20:55:57.234993] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-23T20:55:57.235212] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-23T20:55:57.235289] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-23T20:55:57.602018] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-23T20:55:57.607520] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:57.670460] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T20:55:57.677908] [INFO ] [REMOTE ] DEA: Full fetch complete (61560 records). [2025-10-23T20:55:57.678114] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-23T20:55:58.054977] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-23T20:55:58.055095] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-23T20:55:58.055966] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-23T20:55:58.056058] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-23T20:55:58.057355] [DEBUG] [LOCAL ] DEA: Trimmed 61560 records to 40311 (keeping 200 days of data) [2025-10-23T20:55:58.299331] [DEBUG] [LOCAL ] DEA: Primary data saved (40311 records). [2025-10-23T20:55:58.299499] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-23T20:55:58.299629] [INFO ] [MAIN ] Update Progress: 605/2367 symbols completed. DEA took 28.6s. Estimated remaining: 3h 41m 3s. Rate: 8.0 symbols/min [2025-10-23T20:55:58.404516] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-23T20:55:58.436429] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T20:55:58.499577] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:55:58.551840] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-23T20:55:58.552224] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-23T20:55:58.732682] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:55:58.732924] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-23T20:55:58.733003] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-23T20:55:58.733263] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-23T20:55:58.733334] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-23T20:55:59.084236] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:55:59.199429] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-23T20:55:59.999420] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-23T20:56:00.166689] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-23T20:56:00.715618] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-23T20:56:00.799401] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-23T20:56:01.599421] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-23T20:56:01.886512] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T20:56:02.121604] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-10-23T20:56:02.399484] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-23T20:56:03.102962] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-23T20:56:03.199399] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-23T20:56:03.714943] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T20:56:03.892029] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-23T20:56:03.999481] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-23T20:56:04.799408] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-23T20:56:05.252301] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T20:56:05.407086] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T20:56:05.599428] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-23T20:56:06.399438] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-23T20:56:06.972101] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-23T20:56:07.199433] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-23T20:56:07.835352] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T20:56:07.841239] [INFO ] [REMOTE ] DEC: Full fetch complete (44576 records). [2025-10-23T20:56:07.841368] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-23T20:56:08.021288] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-23T20:56:08.237542] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-23T20:56:08.237750] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-23T20:56:08.238693] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-23T20:56:08.254151] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-23T20:56:08.265914] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-23T20:56:08.276572] [DEBUG] [LOCAL ] DEC: Trimmed 44576 records to 30427 (keeping 200 days of data) [2025-10-23T20:56:08.460291] [DEBUG] [LOCAL ] DEC: Primary data saved (30427 records). [2025-10-23T20:56:08.460476] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-23T20:56:08.460612] [INFO ] [MAIN ] Update Progress: 606/2367 symbols completed. DEC took 24.2s. Estimated remaining: 3h 41m 3s. Rate: 8.0 symbols/min [2025-10-23T20:56:08.630293] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:08.672869] [DEBUG] [LOCAL ] DEO: Loaded 49185 existing records from primary storage. [2025-10-23T20:56:08.673282] [INFO ] [MAIN ] DEO: Loaded 49185 existing records. [2025-10-23T20:56:08.804533] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-23T20:56:08.856980] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:56:08.857227] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-23T20:56:08.857316] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-23T20:56:08.857690] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-23T20:56:08.857779] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-23T20:56:09.223772] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:56:09.608963] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-23T20:56:09.629238] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-23T20:56:09.942674] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T20:56:10.399450] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-23T20:56:11.199502] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-23T20:56:11.554022] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-23T20:56:11.556025] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T20:56:11.999432] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-23T20:56:12.702018] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-23T20:56:12.784485] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T20:56:12.799394] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-23T20:56:13.599435] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-23T20:56:14.399432] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-23T20:56:14.610379] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-23T20:56:15.063832] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T20:56:15.199444] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-23T20:56:15.295513] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T20:56:15.999423] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-23T20:56:16.325404] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:56:16.799444] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-23T20:56:17.599417] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-23T20:56:17.774023] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-23T20:56:17.856763] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T20:56:18.399429] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-23T20:56:18.888974] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T20:56:19.141965] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T20:56:19.199474] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-23T20:56:19.999446] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-23T20:56:20.799466] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-23T20:56:20.885628] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-23T20:56:21.062736] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T20:56:21.404625] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T20:56:21.599417] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-23T20:56:21.952751] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T20:56:22.399444] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-23T20:56:23.199444] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-23T20:56:23.999415] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-23T20:56:24.127889] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-23T20:56:24.166255] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T20:56:24.799416] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-23T20:56:25.192037] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T20:56:25.599452] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-23T20:56:26.281435] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-23T20:56:26.291062] [INFO ] [REMOTE ] DECK: Full fetch complete (77177 records). [2025-10-23T20:56:26.291239] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-23T20:56:26.404575] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-23T20:56:26.713956] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-23T20:56:26.714100] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-23T20:56:26.715487] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-23T20:56:26.715586] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-23T20:56:26.717540] [DEBUG] [LOCAL ] DECK: Trimmed 77177 records to 53691 (keeping 200 days of data) [2025-10-23T20:56:27.054766] [DEBUG] [LOCAL ] DECK: Primary data saved (53691 records). [2025-10-23T20:56:27.069948] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-23T20:56:27.073316] [INFO ] [MAIN ] Update Progress: 607/2367 symbols completed. DECK took 36.0s. Estimated remaining: 3h 41m 28s. Rate: 7.9 symbols/min [2025-10-23T20:56:27.075562] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-23T20:56:27.199901] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-23T20:56:27.276156] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:27.276874] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-23T20:56:27.276948] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-23T20:56:27.277059] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-23T20:56:27.277130] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-23T20:56:27.277213] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-23T20:56:27.277283] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-23T20:56:27.667122] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:56:27.693266] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T20:56:27.999486] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-23T20:56:28.262009] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-23T20:56:28.270696] [INFO ] [REMOTE ] DEI: Full fetch complete (69960 records). [2025-10-23T20:56:28.270886] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-23T20:56:28.665552] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-23T20:56:28.665684] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-23T20:56:28.666545] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-23T20:56:28.666624] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-23T20:56:28.667984] [DEBUG] [LOCAL ] DEI: Trimmed 69960 records to 48643 (keeping 200 days of data) [2025-10-23T20:56:28.838229] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-23T20:56:28.958351] [DEBUG] [LOCAL ] DEI: Primary data saved (48643 records). [2025-10-23T20:56:28.958482] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-23T20:56:28.959260] [INFO ] [MAIN ] Update Progress: 608/2367 symbols completed. DEI took 32.1s. Estimated remaining: 3h 41m 4s. Rate: 8.0 symbols/min [2025-10-23T20:56:29.130812] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:29.130981] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-10-23T20:56:29.131049] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-10-23T20:56:29.131135] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-23T20:56:29.131202] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-23T20:56:29.131261] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-23T20:56:29.131323] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-23T20:56:29.500718] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:56:29.521005] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T20:56:29.599400] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-23T20:56:29.658089] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-23T20:56:30.399451] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-23T20:56:31.065926] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T20:56:31.173566] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T20:56:31.199403] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-23T20:56:31.226146] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T20:56:31.999414] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-23T20:56:32.800249] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-23T20:56:32.801856] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T20:56:33.270784] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T20:56:33.432272] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T20:56:33.441011] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-23T20:56:33.441156] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-23T20:56:33.442120] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T20:56:33.442205] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:56:33.442275] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:56:33.442350] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-23T20:56:33.442447] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-23T20:56:33.442521] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-23T20:56:33.442734] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-23T20:56:33.442845] [INFO ] [MAIN ] Update Progress: 609/2367 symbols completed. DELL took 35.1s. Estimated remaining: 3h 40m 48s. Rate: 8.0 symbols/min [2025-10-23T20:56:33.604855] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-23T20:56:33.632330] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:33.633589] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-10-23T20:56:33.633708] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-10-23T20:56:33.633823] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-23T20:56:33.633892] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-23T20:56:33.633974] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-23T20:56:33.634042] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-23T20:56:33.982246] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:56:34.399448] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-23T20:56:35.199421] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-23T20:56:35.342446] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T20:56:35.723054] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T20:56:35.999459] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-23T20:56:36.802908] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-23T20:56:36.807304] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T20:56:37.445903] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T20:56:37.599411] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-23T20:56:37.789014] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T20:56:38.399435] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-23T20:56:38.991833] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T20:56:39.199447] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-23T20:56:39.310831] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T20:56:39.999448] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-23T20:56:40.693369] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T20:56:40.799411] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-23T20:56:41.033831] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T20:56:41.599457] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-23T20:56:42.064259] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T20:56:42.399440] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-23T20:56:43.199410] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-23T20:56:43.755819] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-23T20:56:43.851495] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T20:56:43.999405] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-23T20:56:44.049565] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T20:56:44.799419] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-23T20:56:45.599444] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-23T20:56:45.633171] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T20:56:45.780357] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T20:56:46.399493] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-23T20:56:47.199421] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-23T20:56:47.472862] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T20:56:47.473822] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T20:56:47.486172] [INFO ] [REMOTE ] DEO: Full fetch complete (71713 records). [2025-10-23T20:56:47.486331] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-23T20:56:47.868665] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-23T20:56:47.868784] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-23T20:56:47.869691] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-23T20:56:47.869781] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-23T20:56:47.871149] [DEBUG] [LOCAL ] DEO: Trimmed 71713 records to 49560 (keeping 200 days of data) [2025-10-23T20:56:48.003807] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-23T20:56:48.117340] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T20:56:48.226791] [DEBUG] [LOCAL ] DEO: Primary data saved (49560 records). [2025-10-23T20:56:48.227004] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-23T20:56:48.227129] [INFO ] [MAIN ] Update Progress: 610/2367 symbols completed. DEO took 39.8s. Estimated remaining: 3h 41m 1s. Rate: 7.9 symbols/min [2025-10-23T20:56:48.397115] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:48.446160] [DEBUG] [LOCAL ] DG: Loaded 53259 existing records from primary storage. [2025-10-23T20:56:48.446565] [INFO ] [MAIN ] DG: Loaded 53259 existing records. [2025-10-23T20:56:48.618936] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:56:48.619150] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-23T20:56:48.619223] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-23T20:56:48.619469] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-23T20:56:48.619541] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-23T20:56:48.805262] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-23T20:56:48.971501] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:56:48.992396] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T20:56:49.599489] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-23T20:56:50.380291] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T20:56:50.399443] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-23T20:56:51.199422] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-23T20:56:51.421487] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T20:56:51.841274] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-23T20:56:51.999456] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-23T20:56:52.572574] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T20:56:52.799437] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-23T20:56:53.599443] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-23T20:56:54.045130] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-23T20:56:54.112907] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T20:56:54.119969] [INFO ] [REMOTE ] DFH: Full fetch complete (47355 records). [2025-10-23T20:56:54.120197] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-23T20:56:54.412380] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-23T20:56:54.670906] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-23T20:56:54.681055] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T20:56:54.680677] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-23T20:56:54.685507] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-23T20:56:54.685609] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-23T20:56:54.686693] [DEBUG] [LOCAL ] DFH: Trimmed 47355 records to 31800 (keeping 200 days of data) [2025-10-23T20:56:54.874284] [DEBUG] [LOCAL ] DFH: Primary data saved (31800 records). [2025-10-23T20:56:54.874465] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-23T20:56:54.874607] [INFO ] [MAIN ] Update Progress: 611/2367 symbols completed. DFH took 27.8s. Estimated remaining: 3h 40m 51s. Rate: 8.0 symbols/min [2025-10-23T20:56:55.084144] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:55.125264] [DEBUG] [LOCAL ] DGX: Loaded 44610 existing records from primary storage. [2025-10-23T20:56:55.125587] [INFO ] [MAIN ] DGX: Loaded 44610 existing records. [2025-10-23T20:56:55.204522] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-23T20:56:55.301594] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:56:55.301820] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-23T20:56:55.301895] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-23T20:56:55.302236] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-23T20:56:55.302308] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-23T20:56:55.653629] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:56:55.765284] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T20:56:55.999500] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-23T20:56:56.799465] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-23T20:56:56.996459] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T20:56:57.488604] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-23T20:56:57.599466] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-23T20:56:58.125388] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T20:56:58.129927] [INFO ] [REMOTE ] DFIN: Full fetch complete (33419 records). [2025-10-23T20:56:58.130040] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-23T20:56:58.404681] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-23T20:56:58.432545] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T20:56:58.476084] [INFO ] [REMOTE ] DFP: Full fetch complete (15800 records). [2025-10-23T20:56:58.515021] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-23T20:56:58.571154] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-23T20:56:58.603013] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-23T20:56:58.627834] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-23T20:56:58.630346] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-23T20:56:58.709250] [DEBUG] [LOCAL ] DFIN: Trimmed 33419 records to 22540 (keeping 200 days of data) [2025-10-23T20:56:59.015207] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-23T20:56:59.016303] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-23T20:56:59.017083] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-23T20:56:59.017557] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-23T20:56:59.044382] [DEBUG] [LOCAL ] DFP: Trimmed 15800 records to 11089 (keeping 200 days of data) [2025-10-23T20:56:59.048743] [DEBUG] [LOCAL ] DFIN: Primary data saved (22540 records). [2025-10-23T20:56:59.049478] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-23T20:56:59.049964] [INFO ] [MAIN ] Update Progress: 612/2367 symbols completed. DFIN took 30.1s. Estimated remaining: 3h 40m 34s. Rate: 8.0 symbols/min [2025-10-23T20:56:59.199916] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-23T20:56:59.231744] [DEBUG] [LOCAL ] DFP: Primary data saved (11089 records). [2025-10-23T20:56:59.237639] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-23T20:56:59.270972] [INFO ] [MAIN ] Update Progress: 613/2367 symbols completed. DFP took 25.8s. Estimated remaining: 3h 40m 5s. Rate: 8.0 symbols/min [2025-10-23T20:56:59.348246] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:59.488592] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:56:59.497820] [DEBUG] [LOCAL ] DHF: Loaded 20878 existing records from primary storage. [2025-10-23T20:56:59.498293] [INFO ] [MAIN ] DHF: Loaded 20878 existing records. [2025-10-23T20:56:59.687367] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:56:59.687742] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-23T20:56:59.687843] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-23T20:56:59.688177] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-23T20:56:59.688262] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-23T20:56:59.887982] [DEBUG] [LOCAL ] DHI: Loaded 53363 existing records from primary storage. [2025-10-23T20:56:59.940516] [INFO ] [MAIN ] DHI: Loaded 53363 existing records. [2025-10-23T20:57:00.279998] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:00.290865] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:57:00.291309] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-23T20:57:00.291799] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-23T20:57:00.292685] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-23T20:57:00.292971] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-23T20:57:00.293057] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-23T20:57:00.651504] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:00.807746] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-23T20:57:00.814308] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-23T20:57:01.599525] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-23T20:57:02.070033] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T20:57:02.399473] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-23T20:57:03.365485] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (4.17 seconds). [2025-10-23T20:57:03.374707] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-23T20:57:03.525290] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-23T20:57:03.865429] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-23T20:57:03.887213] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T20:57:03.999435] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-23T20:57:04.799448] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-23T20:57:05.308777] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T20:57:05.599509] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-23T20:57:06.178939] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-23T20:57:06.399471] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-23T20:57:06.546150] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T20:57:07.157112] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T20:57:07.199402] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-23T20:57:07.999415] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-23T20:57:08.407814] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-23T20:57:08.610143] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-23T20:57:08.799440] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-23T20:57:09.599433] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-23T20:57:10.058087] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T20:57:10.113994] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T20:57:10.399456] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-23T20:57:11.199470] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-23T20:57:11.999435] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-23T20:57:12.874223] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (3.27 seconds). [2025-10-23T20:57:12.885710] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-23T20:57:13.239203] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-23T20:57:13.458779] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-23T20:57:13.599402] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-23T20:57:13.918233] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T20:57:14.004856] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T20:57:14.399426] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-23T20:57:15.199421] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-23T20:57:15.683534] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-23T20:57:15.999412] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-23T20:57:16.383871] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T20:57:16.393368] [INFO ] [REMOTE ] DG: Full fetch complete (77317 records). [2025-10-23T20:57:16.393538] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-23T20:57:16.538027] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T20:57:16.804532] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-23T20:57:16.809953] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-23T20:57:16.810033] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-23T20:57:16.810998] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-23T20:57:16.811132] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-23T20:57:16.812842] [DEBUG] [LOCAL ] DG: Trimmed 77317 records to 53630 (keeping 200 days of data) [2025-10-23T20:57:17.148842] [DEBUG] [LOCAL ] DG: Primary data saved (53630 records). [2025-10-23T20:57:17.149018] [INFO ] [MAIN ] DG: Full history saved. [2025-10-23T20:57:17.149134] [INFO ] [MAIN ] Update Progress: 614/2367 symbols completed. DG took 28.9s. Estimated remaining: 3h 40m 27s. Rate: 8.0 symbols/min [2025-10-23T20:57:17.322938] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:57:17.323082] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-10-23T20:57:17.323169] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-10-23T20:57:17.323278] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-23T20:57:17.323348] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-23T20:57:17.323428] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-23T20:57:17.323497] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-23T20:57:17.600575] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-23T20:57:17.686742] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:17.800944] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T20:57:18.125598] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T20:57:18.399438] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-23T20:57:19.199416] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-23T20:57:19.630606] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T20:57:19.671719] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T20:57:19.999439] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-23T20:57:20.799444] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-23T20:57:21.529456] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-23T20:57:21.599405] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-23T20:57:21.947045] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T20:57:22.288660] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-23T20:57:22.399445] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-23T20:57:23.199413] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-23T20:57:23.297420] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T20:57:23.999412] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-23T20:57:24.464202] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T20:57:24.799424] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-23T20:57:25.041583] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T20:57:25.599392] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-23T20:57:25.820760] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T20:57:26.063383] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T20:57:26.066912] [INFO ] [REMOTE ] DHF: Full fetch complete (29985 records). [2025-10-23T20:57:26.067035] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-23T20:57:26.412277] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-23T20:57:26.462039] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-23T20:57:26.462143] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-23T20:57:26.462779] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-23T20:57:26.462859] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-23T20:57:26.463617] [DEBUG] [LOCAL ] DHF: Trimmed 29985 records to 20928 (keeping 200 days of data) [2025-10-23T20:57:26.583015] [DEBUG] [LOCAL ] DHF: Primary data saved (20928 records). [2025-10-23T20:57:26.583171] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-23T20:57:26.583284] [INFO ] [MAIN ] Update Progress: 615/2367 symbols completed. DHF took 27.5s. Estimated remaining: 3h 40m 25s. Rate: 7.9 symbols/min [2025-10-23T20:57:26.751084] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:57:26.751297] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-23T20:57:26.751367] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-23T20:57:26.751471] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-23T20:57:26.751540] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-23T20:57:26.751599] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-23T20:57:26.751636] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-23T20:57:27.099378] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:27.199392] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-23T20:57:27.948697] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-23T20:57:27.999404] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-23T20:57:28.197412] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T20:57:28.799421] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-23T20:57:29.043575] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T20:57:29.599454] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-23T20:57:30.147739] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T20:57:30.156787] [INFO ] [REMOTE ] DHI: Full fetch complete (77404 records). [2025-10-23T20:57:30.156936] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-23T20:57:30.403801] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-23T20:57:30.566128] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-23T20:57:30.566267] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-23T20:57:30.567350] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-23T20:57:30.567507] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-23T20:57:30.569269] [DEBUG] [LOCAL ] DHI: Trimmed 77404 records to 53747 (keeping 200 days of data) [2025-10-23T20:57:30.712201] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T20:57:30.729726] [INFO ] [REMOTE ] DGX: Full fetch complete (65697 records). [2025-10-23T20:57:30.736255] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-23T20:57:31.260970] [DEBUG] [LOCAL ] DHI: Primary data saved (53747 records). [2025-10-23T20:57:31.277220] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-23T20:57:31.282533] [INFO ] [MAIN ] Update Progress: 616/2367 symbols completed. DHI took 32.0s. Estimated remaining: 3h 40m 9s. Rate: 8.0 symbols/min [2025-10-23T20:57:31.401279] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-23T20:57:31.439334] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-23T20:57:31.440723] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-23T20:57:31.459298] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-23T20:57:31.559890] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:57:31.560883] [DEBUG] [LOCAL ] DGX: Trimmed 65697 records to 44964 (keeping 200 days of data) [2025-10-23T20:57:31.562662] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-23T20:57:31.571454] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-10-23T20:57:31.572583] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-10-23T20:57:31.573259] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-23T20:57:31.573339] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-23T20:57:31.573769] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-23T20:57:31.574697] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-23T20:57:31.574774] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-23T20:57:32.187831] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:32.190253] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-23T20:57:32.228800] [DEBUG] [LOCAL ] DGX: Primary data saved (44964 records). [2025-10-23T20:57:32.228967] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-23T20:57:32.230587] [INFO ] [MAIN ] Update Progress: 617/2367 symbols completed. DGX took 37.4s. Estimated remaining: 3h 39m 43s. Rate: 8.0 symbols/min [2025-10-23T20:57:32.415409] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:57:32.431206] [DEBUG] [LOCAL ] DIAX: Loaded 12723 existing records from primary storage. [2025-10-23T20:57:32.431468] [INFO ] [MAIN ] DIAX: Loaded 12723 existing records. [2025-10-23T20:57:32.618603] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:57:32.618966] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-23T20:57:32.619041] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-23T20:57:32.619303] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-23T20:57:32.619375] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-23T20:57:32.974926] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:32.975458] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-23T20:57:33.005156] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-23T20:57:33.514148] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T20:57:33.599400] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-23T20:57:33.895924] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T20:57:34.142140] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-23T20:57:34.399409] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-23T20:57:34.784549] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T20:57:35.199421] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-23T20:57:35.999404] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-23T20:57:36.313226] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T20:57:36.431029] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T20:57:36.799430] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-23T20:57:36.818353] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T20:57:37.599406] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-23T20:57:37.972070] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T20:57:38.399403] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-23T20:57:38.623836] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T20:57:39.199460] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-23T20:57:39.495965] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T20:57:39.999511] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-23T20:57:40.799462] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-23T20:57:40.977478] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:57:41.028460] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T20:57:41.599418] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-23T20:57:41.768059] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-23T20:57:42.399443] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-23T20:57:43.199425] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-23T20:57:43.466354] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T20:57:43.506445] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T20:57:43.999434] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-23T20:57:44.131866] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T20:57:44.715140] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-23T20:57:44.799486] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-23T20:57:45.599468] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-23T20:57:45.873212] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T20:57:46.399480] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-23T20:57:46.465871] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-23T20:57:47.199500] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-23T20:57:47.999416] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-23T20:57:48.304013] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T20:57:48.524282] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-23T20:57:48.799466] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-23T20:57:49.071847] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T20:57:49.599476] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-23T20:57:50.399413] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-23T20:57:50.948769] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-23T20:57:51.151399] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T20:57:51.199402] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-23T20:57:51.533165] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T20:57:51.536895] [INFO ] [REMOTE ] DHX: Full fetch complete (21637 records). [2025-10-23T20:57:51.536989] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-23T20:57:51.934864] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-23T20:57:51.934975] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-23T20:57:51.935478] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-23T20:57:51.935553] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-23T20:57:51.936208] [DEBUG] [LOCAL ] DHX: Trimmed 21637 records to 13333 (keeping 200 days of data) [2025-10-23T20:57:52.005193] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-23T20:57:52.010491] [DEBUG] [LOCAL ] DHX: Primary data saved (13333 records). [2025-10-23T20:57:52.011415] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-23T20:57:52.011523] [INFO ] [MAIN ] Update Progress: 618/2367 symbols completed. DHX took 20.7s. Estimated remaining: 3h 40m 10s. Rate: 7.9 symbols/min [2025-10-23T20:57:52.182423] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:57:52.216335] [DEBUG] [LOCAL ] DIN: Loaded 36752 existing records from primary storage. [2025-10-23T20:57:52.216635] [INFO ] [MAIN ] DIN: Loaded 36752 existing records. [2025-10-23T20:57:52.393493] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:57:52.393720] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-23T20:57:52.393804] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-23T20:57:52.394045] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-23T20:57:52.394120] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-23T20:57:52.756073] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:52.799403] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-23T20:57:52.975705] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T20:57:53.599427] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-23T20:57:54.182498] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-23T20:57:54.280215] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T20:57:54.399476] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-23T20:57:54.686338] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T20:57:55.199422] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-23T20:57:55.999436] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-23T20:57:56.799472] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-23T20:57:57.083035] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-23T20:57:57.599400] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-23T20:57:57.650705] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T20:57:57.832357] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T20:57:57.834983] [INFO ] [REMOTE ] DIAX: Full fetch complete (17645 records). [2025-10-23T20:57:57.835077] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-23T20:57:58.146461] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-23T20:57:58.242983] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-23T20:57:58.243101] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-23T20:57:58.243560] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-23T20:57:58.243636] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-23T20:57:58.244289] [DEBUG] [LOCAL ] DIAX: Trimmed 17645 records to 12784 (keeping 200 days of data) [2025-10-23T20:57:58.326500] [DEBUG] [LOCAL ] DIAX: Primary data saved (12784 records). [2025-10-23T20:57:58.326697] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-23T20:57:58.326811] [INFO ] [MAIN ] Update Progress: 619/2367 symbols completed. DIAX took 26.1s. Estimated remaining: 3h 39m 59s. Rate: 7.9 symbols/min [2025-10-23T20:57:58.404565] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-23T20:57:58.493533] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:57:58.543206] [DEBUG] [LOCAL ] DINO: Loaded 52825 existing records from primary storage. [2025-10-23T20:57:58.543561] [INFO ] [MAIN ] DINO: Loaded 52825 existing records. [2025-10-23T20:57:58.717313] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:57:58.717606] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-23T20:57:58.717705] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-23T20:57:58.718010] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-23T20:57:58.718117] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-23T20:57:59.058381] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:57:59.199434] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-23T20:57:59.805155] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-23T20:57:59.999525] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-23T20:58:00.225824] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T20:58:00.799433] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-23T20:58:01.599500] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-23T20:58:01.801793] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-23T20:58:01.916712] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T20:58:02.399444] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-23T20:58:02.772351] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T20:58:03.199444] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-23T20:58:03.813908] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-23T20:58:03.851371] [INFO ] [REMOTE ] DHT: Full fetch complete (70355 records). [2025-10-23T20:58:03.852447] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T20:58:03.852801] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-23T20:58:04.004716] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-23T20:58:04.255337] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-23T20:58:04.255455] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-23T20:58:04.256512] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-23T20:58:04.256598] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-23T20:58:04.258180] [DEBUG] [LOCAL ] DHT: Trimmed 70355 records to 48212 (keeping 200 days of data) [2025-10-23T20:58:04.545971] [DEBUG] [LOCAL ] DHT: Primary data saved (48212 records). [2025-10-23T20:58:04.546262] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-23T20:58:04.546426] [INFO ] [MAIN ] Update Progress: 620/2367 symbols completed. DHT took 38.0s. Estimated remaining: 3h 39m 48s. Rate: 7.9 symbols/min [2025-10-23T20:58:04.721155] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:04.721501] [DEBUG] [LOCAL ] DIS: No existing data file found in primary storage. [2025-10-23T20:58:04.721579] [WARN ] [MAIN ] DIS: No existing data found, performing full refresh instead. [2025-10-23T20:58:04.721743] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-23T20:58:04.721891] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-23T20:58:04.722105] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-23T20:58:04.722272] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-23T20:58:04.819135] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-23T20:58:04.932002] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T20:58:05.121608] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:05.599435] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-23T20:58:06.180273] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-23T20:58:06.195567] [INFO ] [REMOTE ] DHR: Full fetch complete (77439 records). [2025-10-23T20:58:06.195799] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-23T20:58:06.412405] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-23T20:58:06.603925] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T20:58:06.635303] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-23T20:58:06.635951] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-23T20:58:06.636999] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-23T20:58:06.637079] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-23T20:58:06.638611] [DEBUG] [LOCAL ] DHR: Trimmed 77439 records to 53765 (keeping 200 days of data) [2025-10-23T20:58:06.972324] [DEBUG] [LOCAL ] DHR: Primary data saved (53765 records). [2025-10-23T20:58:06.972506] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-23T20:58:06.972613] [INFO ] [MAIN ] Update Progress: 621/2367 symbols completed. DHR took 49.8s. Estimated remaining: 3h 39m 26s. Rate: 8.0 symbols/min [2025-10-23T20:58:07.141560] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:07.141784] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-23T20:58:07.141854] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-23T20:58:07.141960] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-23T20:58:07.142028] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-23T20:58:07.142136] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-23T20:58:07.142208] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-23T20:58:07.205543] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-23T20:58:07.500238] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:07.999430] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-23T20:58:08.216197] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-23T20:58:08.476635] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T20:58:08.486912] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-23T20:58:08.519298] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T20:58:08.799436] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-23T20:58:09.311727] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-23T20:58:09.599498] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-23T20:58:10.399449] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-23T20:58:11.199465] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-23T20:58:11.999477] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-23T20:58:12.163545] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-23T20:58:12.260632] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T20:58:12.761096] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T20:58:12.799026] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T20:58:12.806061] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-23T20:58:13.599456] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-23T20:58:14.399436] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-23T20:58:15.199417] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-23T20:58:15.595415] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-23T20:58:15.813309] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T20:58:15.815075] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-10-23T20:58:15.999448] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-23T20:58:16.301630] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T20:58:16.799445] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-23T20:58:17.599405] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-23T20:58:17.907188] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T20:58:18.065517] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T20:58:18.096411] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-23T20:58:18.399423] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-23T20:58:19.199455] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-23T20:58:19.999449] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-23T20:58:20.799428] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-23T20:58:21.291845] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T20:58:21.294968] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-10-23T20:58:21.321998] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-23T20:58:21.560907] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T20:58:21.570064] [INFO ] [REMOTE ] DIN: Full fetch complete (54745 records). [2025-10-23T20:58:21.570233] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-23T20:58:21.604501] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-23T20:58:21.954045] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-23T20:58:21.954168] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-23T20:58:21.955011] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-23T20:58:21.955092] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-23T20:58:21.956264] [DEBUG] [LOCAL ] DIN: Trimmed 54745 records to 36981 (keeping 200 days of data) [2025-10-23T20:58:22.174032] [DEBUG] [LOCAL ] DIN: Primary data saved (36981 records). [2025-10-23T20:58:22.174209] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-23T20:58:22.174323] [INFO ] [MAIN ] Update Progress: 622/2367 symbols completed. DIN took 30.2s. Estimated remaining: 3h 39m 40s. Rate: 7.9 symbols/min [2025-10-23T20:58:22.349402] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:22.396271] [DEBUG] [LOCAL ] DK: Loaded 49230 existing records from primary storage. [2025-10-23T20:58:22.396621] [INFO ] [MAIN ] DK: Loaded 49230 existing records. [2025-10-23T20:58:22.407760] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-23T20:58:22.573669] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:58:22.573880] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-23T20:58:22.573935] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-23T20:58:22.574237] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-23T20:58:22.574312] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-23T20:58:22.920877] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:23.199435] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-23T20:58:23.598355] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T20:58:23.999434] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-23T20:58:24.799414] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-23T20:58:24.981775] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T20:58:25.210015] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-23T20:58:25.238544] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T20:58:25.599412] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-23T20:58:25.848558] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T20:58:26.399443] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-23T20:58:27.199423] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-23T20:58:27.357740] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T20:58:27.999442] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-23T20:58:28.499759] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T20:58:28.811365] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-23T20:58:28.817207] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-23T20:58:28.909451] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T20:58:28.919833] [INFO ] [REMOTE ] DINO: Full fetch complete (76720 records). [2025-10-23T20:58:28.920048] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-23T20:58:29.326493] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-23T20:58:29.326684] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-23T20:58:29.328308] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-23T20:58:29.328414] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-23T20:58:29.330617] [DEBUG] [LOCAL ] DINO: Trimmed 76720 records to 53214 (keeping 200 days of data) [2025-10-23T20:58:29.623923] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-23T20:58:29.671143] [DEBUG] [LOCAL ] DINO: Primary data saved (53214 records). [2025-10-23T20:58:29.671298] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-23T20:58:29.672813] [INFO ] [MAIN ] Update Progress: 623/2367 symbols completed. DINO took 31.3s. Estimated remaining: 3h 39m 32s. Rate: 7.9 symbols/min [2025-10-23T20:58:29.843584] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:29.861414] [DEBUG] [LOCAL ] DKL: Loaded 16871 existing records from primary storage. [2025-10-23T20:58:29.861708] [INFO ] [MAIN ] DKL: Loaded 16871 existing records. [2025-10-23T20:58:30.040881] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:58:30.041122] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-23T20:58:30.041201] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-23T20:58:30.041410] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-23T20:58:30.041483] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-23T20:58:30.210885] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T20:58:30.434404] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-23T20:58:30.438564] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:30.787126] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T20:58:31.199425] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-23T20:58:31.999403] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-23T20:58:32.398688] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T20:58:32.469725] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T20:58:32.470498] [INFO ] [REMOTE ] DIVY: Full fetch complete (1674 records). [2025-10-23T20:58:32.470588] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-23T20:58:32.657266] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T20:58:32.657484] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T20:58:32.657680] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T20:58:32.657771] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-23T20:58:32.657887] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-23T20:58:32.658044] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-23T20:58:32.658131] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-23T20:58:32.658227] [INFO ] [MAIN ] Update Progress: 624/2367 symbols completed. DIVY took 25.7s. Estimated remaining: 3h 39m 12s. Rate: 8.0 symbols/min [2025-10-23T20:58:32.802479] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-23T20:58:32.837253] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:32.837913] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-10-23T20:58:32.838028] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-10-23T20:58:32.838269] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-23T20:58:32.838368] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-23T20:58:32.838528] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-10-23T20:58:32.838742] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-23T20:58:33.214054] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-23T20:58:33.264731] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:33.599470] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-23T20:58:34.399505] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-23T20:58:34.615414] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T20:58:35.199508] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-23T20:58:35.613346] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T20:58:35.999471] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-23T20:58:36.113564] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-23T20:58:36.799487] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-23T20:58:37.027972] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T20:58:37.383338] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T20:58:37.599457] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-23T20:58:38.399446] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-23T20:58:38.716679] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T20:58:39.199589] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-23T20:58:39.677541] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T20:58:39.999411] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-23T20:58:40.146747] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-23T20:58:40.799419] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-23T20:58:40.918813] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T20:58:40.943311] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T20:58:41.599459] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-23T20:58:42.399427] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-23T20:58:42.595575] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T20:58:43.117067] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T20:58:43.199432] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-23T20:58:43.999427] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-23T20:58:44.799443] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-23T20:58:45.147211] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-23T20:58:45.156565] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-23T20:58:45.156740] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-23T20:58:45.450714] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T20:58:45.579676] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-23T20:58:45.579870] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-23T20:58:45.580897] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-23T20:58:45.581043] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-23T20:58:45.582830] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54178 (keeping 200 days of data) [2025-10-23T20:58:45.639117] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-23T20:58:45.836101] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-23T20:58:45.958918] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-10-23T20:58:45.959074] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-23T20:58:45.959180] [INFO ] [MAIN ] Update Progress: 625/2367 symbols completed. DIS took 41.4s. Estimated remaining: 3h 39m 21s. Rate: 7.9 symbols/min [2025-10-23T20:58:46.122933] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:46.153535] [DEBUG] [LOCAL ] DLB: Loaded 32217 existing records from primary storage. [2025-10-23T20:58:46.153905] [INFO ] [MAIN ] DLB: Loaded 32217 existing records. [2025-10-23T20:58:46.330630] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:58:46.330897] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-23T20:58:46.331015] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-23T20:58:46.331310] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-23T20:58:46.331397] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-23T20:58:46.399374] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-23T20:58:46.708488] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:46.718369] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T20:58:46.751843] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T20:58:47.199451] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-23T20:58:47.999480] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-23T20:58:48.425250] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T20:58:48.447509] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T20:58:48.799462] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-23T20:58:49.599486] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-23T20:58:49.771751] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T20:58:50.399470] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-23T20:58:50.940795] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-23T20:58:51.199466] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-23T20:58:51.226000] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T20:58:51.999460] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-23T20:58:52.201130] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T20:58:52.211742] [INFO ] [REMOTE ] DK: Full fetch complete (70817 records). [2025-10-23T20:58:52.211923] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-23T20:58:52.594884] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-23T20:58:52.594994] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-23T20:58:52.595902] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-23T20:58:52.595998] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-23T20:58:52.597339] [DEBUG] [LOCAL ] DK: Trimmed 70817 records to 49598 (keeping 200 days of data) [2025-10-23T20:58:52.804170] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-23T20:58:52.897313] [DEBUG] [LOCAL ] DK: Primary data saved (49598 records). [2025-10-23T20:58:52.897589] [INFO ] [MAIN ] DK: Full history saved. [2025-10-23T20:58:52.897773] [INFO ] [MAIN ] Update Progress: 626/2367 symbols completed. DK took 30.7s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-10-23T20:58:53.074399] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:53.082705] [DEBUG] [LOCAL ] DLNG: Loaded 6048 existing records from primary storage. [2025-10-23T20:58:53.082989] [INFO ] [MAIN ] DLNG: Loaded 6048 existing records. [2025-10-23T20:58:53.266758] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:58:53.267091] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-23T20:58:53.267312] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-23T20:58:53.276400] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-23T20:58:53.293289] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-23T20:58:53.305925] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-23T20:58:53.602601] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-23T20:58:53.696606] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:53.697619] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T20:58:53.777918] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T20:58:54.399440] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-23T20:58:55.199405] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-23T20:58:55.280678] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T20:58:55.282993] [INFO ] [REMOTE ] DKL: Full fetch complete (27509 records). [2025-10-23T20:58:55.283096] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-23T20:58:55.653034] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-23T20:58:55.653246] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-23T20:58:55.653885] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-23T20:58:55.654054] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-23T20:58:55.654882] [DEBUG] [LOCAL ] DKL: Trimmed 27509 records to 16921 (keeping 200 days of data) [2025-10-23T20:58:55.756963] [DEBUG] [LOCAL ] DKL: Primary data saved (16921 records). [2025-10-23T20:58:55.757165] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-23T20:58:55.757413] [INFO ] [MAIN ] Update Progress: 627/2367 symbols completed. DKL took 26.1s. Estimated remaining: 3h 38m 51s. Rate: 8.0 symbols/min [2025-10-23T20:58:55.944120] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-23T20:58:55.962308] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:58:56.004128] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-23T20:58:56.027431] [DEBUG] [LOCAL ] DLR: Loaded 50597 existing records from primary storage. [2025-10-23T20:58:56.027854] [INFO ] [MAIN ] DLR: Loaded 50597 existing records. [2025-10-23T20:58:56.213096] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:58:56.214205] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-23T20:58:56.214334] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-23T20:58:56.218628] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-23T20:58:56.218876] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-23T20:58:56.218952] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-23T20:58:56.575735] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:58:56.799430] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-23T20:58:57.599416] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-23T20:58:57.681116] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-23T20:58:58.057804] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T20:58:58.399452] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-23T20:58:59.199425] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-23T20:58:59.344349] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T20:58:59.621149] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T20:58:59.999431] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-23T20:59:00.701423] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T20:59:00.799430] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-23T20:59:01.599437] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-23T20:59:02.181370] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-23T20:59:02.399486] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-23T20:59:02.510465] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-23T20:59:03.199434] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-23T20:59:03.448142] [DEBUG] [REMOTE ] DLNG: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-23T20:59:03.448733] [WARN ] [REMOTE ] DLNG: No data returned for month 2025-05 [2025-10-23T20:59:03.448832] [FATAL] [REMOTE ] DLNG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T20:59:03.448980] [FATAL] [MAIN ] DLNG: Failed to fetch primary data. [2025-10-23T20:59:03.449057] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T20:59:03.449161] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-23T20:59:03.449277] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-23T20:59:03.449392] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-10-23T20:59:03.449724] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-10-23T20:59:03.449906] [INFO ] [MAIN ] Update Progress: 628/2367 symbols completed. DLNG took 10.6s. Estimated remaining: 3h 38m 44s. Rate: 8.0 symbols/min [2025-10-23T20:59:03.627162] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:03.659451] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-23T20:59:03.692801] [DEBUG] [LOCAL ] DLX: Loaded 28049 existing records from primary storage. [2025-10-23T20:59:03.693094] [INFO ] [MAIN ] DLX: Loaded 28049 existing records. [2025-10-23T20:59:03.868767] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:59:03.868974] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-23T20:59:03.869052] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-23T20:59:03.869260] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-23T20:59:03.869332] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-23T20:59:04.006432] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-23T20:59:04.234102] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:04.584751] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-23T20:59:04.799446] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-23T20:59:05.599411] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-23T20:59:06.003036] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-23T20:59:06.011819] [INFO ] [REMOTE ] DKS: Full fetch complete (71502 records). [2025-10-23T20:59:06.011977] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-23T20:59:06.199114] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T20:59:06.411358] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-23T20:59:06.434305] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-23T20:59:06.435496] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-23T20:59:06.436418] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-23T20:59:06.436597] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-23T20:59:06.438057] [DEBUG] [LOCAL ] DKS: Trimmed 71502 records to 49595 (keeping 200 days of data) [2025-10-23T20:59:06.746246] [DEBUG] [LOCAL ] DKS: Primary data saved (49595 records). [2025-10-23T20:59:06.746407] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-23T20:59:06.746513] [INFO ] [MAIN ] Update Progress: 629/2367 symbols completed. DKS took 34.1s. Estimated remaining: 3h 38m 24s. Rate: 8.0 symbols/min [2025-10-23T20:59:06.920945] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:06.921406] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-10-23T20:59:06.921485] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-10-23T20:59:06.921599] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-23T20:59:06.921694] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-23T20:59:06.921779] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-23T20:59:06.921850] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-23T20:59:07.204737] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-23T20:59:07.278716] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:07.681303] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-23T20:59:07.716023] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T20:59:07.999455] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-23T20:59:08.705526] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T20:59:08.799444] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-23T20:59:09.599491] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-23T20:59:09.715613] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T20:59:09.965960] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T20:59:10.399460] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-23T20:59:10.871701] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T20:59:11.199447] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-23T20:59:11.903754] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T20:59:11.999437] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-23T20:59:12.459035] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T20:59:12.799436] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-23T20:59:13.051339] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T20:59:13.599454] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-23T20:59:14.399416] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-23T20:59:14.619863] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T20:59:14.664476] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T20:59:15.199485] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-23T20:59:15.936537] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T20:59:15.999418] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-23T20:59:16.487741] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T20:59:16.799508] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-23T20:59:17.474944] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T20:59:17.599435] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-23T20:59:18.399441] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-23T20:59:18.819094] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T20:59:19.040396] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T20:59:19.199421] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-23T20:59:19.232433] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T20:59:19.999420] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-23T20:59:20.797350] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T20:59:20.803440] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-23T20:59:21.599427] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-23T20:59:22.041601] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T20:59:22.357733] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T20:59:22.399404] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-23T20:59:23.199422] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-23T20:59:23.829056] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-23T20:59:23.999410] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-23T20:59:24.297672] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T20:59:24.799407] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-23T20:59:25.212849] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T20:59:25.255483] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T20:59:25.599424] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-23T20:59:26.086686] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T20:59:26.399441] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-23T20:59:27.012612] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T20:59:27.018546] [INFO ] [REMOTE ] DLB: Full fetch complete (47478 records). [2025-10-23T20:59:27.018688] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-23T20:59:27.208302] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-23T20:59:27.399791] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-23T20:59:27.399903] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-23T20:59:27.400605] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-23T20:59:27.400702] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-23T20:59:27.401701] [DEBUG] [LOCAL ] DLB: Trimmed 47478 records to 32462 (keeping 200 days of data) [2025-10-23T20:59:27.595810] [DEBUG] [LOCAL ] DLB: Primary data saved (32462 records). [2025-10-23T20:59:27.595981] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-23T20:59:27.597073] [INFO ] [MAIN ] Update Progress: 630/2367 symbols completed. DLB took 41.6s. Estimated remaining: 3h 38m 53s. Rate: 7.9 symbols/min [2025-10-23T20:59:27.765124] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:27.772976] [DEBUG] [LOCAL ] DMA: Loaded 4714 existing records from primary storage. [2025-10-23T20:59:27.773231] [INFO ] [MAIN ] DMA: Loaded 4714 existing records. [2025-10-23T20:59:27.950126] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:59:27.950322] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-23T20:59:27.950401] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-23T20:59:27.950625] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-23T20:59:27.950747] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-23T20:59:28.013685] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-23T20:59:28.308930] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:28.393491] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T20:59:28.402230] [INFO ] [REMOTE ] DLR: Full fetch complete (74186 records). [2025-10-23T20:59:28.402377] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-23T20:59:28.790333] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-23T20:59:28.790459] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-23T20:59:28.797184] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-23T20:59:28.807544] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-23T20:59:28.807637] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-23T20:59:28.810564] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T20:59:28.818162] [DEBUG] [LOCAL ] DLR: Trimmed 74186 records to 50985 (keeping 200 days of data) [2025-10-23T20:59:29.135113] [DEBUG] [LOCAL ] DLR: Primary data saved (50985 records). [2025-10-23T20:59:29.135285] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-23T20:59:29.136878] [INFO ] [MAIN ] Update Progress: 631/2367 symbols completed. DLR took 33.4s. Estimated remaining: 3h 38m 29s. Rate: 7.9 symbols/min [2025-10-23T20:59:29.308101] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:29.308365] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-23T20:59:29.308443] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-23T20:59:29.321026] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-23T20:59:29.321878] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-23T20:59:29.322405] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T20:59:29.322578] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-23T20:59:29.327020] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-23T20:59:29.609021] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-23T20:59:29.625092] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T20:59:29.708257] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:30.399447] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-23T20:59:30.914126] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T20:59:31.199424] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-23T20:59:31.291555] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T20:59:31.999446] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-23T20:59:32.502297] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T20:59:32.799473] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-23T20:59:32.828586] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T20:59:33.599400] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-23T20:59:33.978977] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T20:59:33.983350] [INFO ] [REMOTE ] DLX: Full fetch complete (41384 records). [2025-10-23T20:59:33.983468] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-23T20:59:34.350570] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T20:59:34.367353] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-23T20:59:34.367429] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-23T20:59:34.368113] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-23T20:59:34.368191] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-23T20:59:34.369116] [DEBUG] [LOCAL ] DLX: Trimmed 41384 records to 28240 (keeping 200 days of data) [2025-10-23T20:59:34.420694] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-23T20:59:34.537840] [DEBUG] [LOCAL ] DLX: Primary data saved (28240 records). [2025-10-23T20:59:34.541018] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-23T20:59:34.541149] [INFO ] [MAIN ] Update Progress: 632/2367 symbols completed. DLX took 31.1s. Estimated remaining: 3h 38m 16s. Rate: 7.9 symbols/min [2025-10-23T20:59:34.708791] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:34.720451] [DEBUG] [LOCAL ] DMO: Loaded 9788 existing records from primary storage. [2025-10-23T20:59:34.720716] [INFO ] [MAIN ] DMO: Loaded 9788 existing records. [2025-10-23T20:59:34.895052] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:59:34.895253] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-23T20:59:34.895326] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-23T20:59:34.895607] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-23T20:59:34.895711] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-23T20:59:35.208073] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-23T20:59:35.248874] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:35.371071] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T20:59:35.884372] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T20:59:35.999468] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-23T20:59:36.799432] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-23T20:59:37.224972] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T20:59:37.230268] [INFO ] [REMOTE ] DLY: Full fetch complete (28653 records). [2025-10-23T20:59:37.230401] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-23T20:59:37.598333] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-23T20:59:37.598440] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-23T20:59:37.598992] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-23T20:59:37.599069] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-23T20:59:37.599444] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-23T20:59:37.600744] [DEBUG] [LOCAL ] DLY: Trimmed 28653 records to 20880 (keeping 200 days of data) [2025-10-23T20:59:37.733814] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T20:59:37.735263] [DEBUG] [LOCAL ] DLY: Primary data saved (20880 records). [2025-10-23T20:59:37.738364] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-23T20:59:37.738749] [INFO ] [MAIN ] Update Progress: 633/2367 symbols completed. DLY took 31.0s. Estimated remaining: 3h 37m 56s. Rate: 8.0 symbols/min [2025-10-23T20:59:37.934036] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:37.934253] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-10-23T20:59:37.934325] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-10-23T20:59:37.934436] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-23T20:59:37.934504] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-23T20:59:37.934584] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-23T20:59:37.934676] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-23T20:59:38.317741] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:38.399428] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-23T20:59:38.566823] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T20:59:39.199484] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-23T20:59:39.999477] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-23T20:59:40.113872] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T20:59:40.271046] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T20:59:40.600149] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T20:59:40.799454] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-23T20:59:41.599447] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-23T20:59:42.399453] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-23T20:59:42.514449] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T20:59:42.993418] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-23T20:59:43.071666] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-23T20:59:43.199458] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-23T20:59:43.999432] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-23T20:59:44.117350] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T20:59:44.799425] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-23T20:59:44.971730] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-23T20:59:45.599430] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-23T20:59:45.775965] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-23T20:59:46.203872] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T20:59:46.399447] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-23T20:59:47.199454] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-23T20:59:47.265337] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T20:59:47.763945] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-23T20:59:47.999544] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-23T20:59:48.701794] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T20:59:48.799503] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-23T20:59:49.599432] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-23T20:59:49.743496] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-23T20:59:50.282599] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T20:59:50.399413] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-23T20:59:51.199431] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-23T20:59:51.299103] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T20:59:51.970858] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T20:59:51.999399] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-23T20:59:52.769137] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T20:59:52.799408] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-23T20:59:53.599440] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-23T20:59:54.399405] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-23T20:59:54.650312] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T20:59:54.821510] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T20:59:54.873054] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T20:59:54.874750] [INFO ] [REMOTE ] DMA: Full fetch complete (6562 records). [2025-10-23T20:59:54.874845] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-23T20:59:55.204552] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-23T20:59:55.266947] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-23T20:59:55.267067] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-23T20:59:55.267354] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-23T20:59:55.267435] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-23T20:59:55.268123] [DEBUG] [LOCAL ] DMA: Trimmed 6562 records to 4725 (keeping 200 days of data) [2025-10-23T20:59:55.299364] [DEBUG] [LOCAL ] DMA: Primary data saved (4725 records). [2025-10-23T20:59:55.299540] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-23T20:59:55.299679] [INFO ] [MAIN ] Update Progress: 634/2367 symbols completed. DMA took 27.7s. Estimated remaining: 3h 38m 16s. Rate: 7.9 symbols/min [2025-10-23T20:59:55.465632] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T20:59:55.508125] [DEBUG] [LOCAL ] DNOW: Loaded 43752 existing records from primary storage. [2025-10-23T20:59:55.508444] [INFO ] [MAIN ] DNOW: Loaded 43752 existing records. [2025-10-23T20:59:55.686142] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T20:59:55.686376] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-23T20:59:55.686453] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-23T20:59:55.686773] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-23T20:59:55.686852] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-23T20:59:56.009149] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-23T20:59:56.052076] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T20:59:56.265082] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T20:59:56.799493] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-23T20:59:57.599489] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-23T20:59:57.974789] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T20:59:58.399442] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-23T20:59:58.424361] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T20:59:58.619327] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T20:59:59.199455] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-23T20:59:59.999412] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-23T21:00:00.094885] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T21:00:00.097231] [INFO ] [REMOTE ] DMO: Full fetch complete (14390 records). [2025-10-23T21:00:00.097348] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-23T21:00:00.500349] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-23T21:00:00.521760] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-23T21:00:00.524837] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-23T21:00:00.525003] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-23T21:00:00.527063] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T21:00:00.527416] [DEBUG] [LOCAL ] DMO: Trimmed 14390 records to 9835 (keeping 200 days of data) [2025-10-23T21:00:00.598093] [DEBUG] [LOCAL ] DMO: Primary data saved (9835 records). [2025-10-23T21:00:00.598269] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-23T21:00:00.598389] [INFO ] [MAIN ] Update Progress: 635/2367 symbols completed. DMO took 26.1s. Estimated remaining: 3h 38m 2s. Rate: 7.9 symbols/min [2025-10-23T21:00:00.770486] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:00.801307] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-23T21:00:00.802745] [DEBUG] [LOCAL ] DNP: Loaded 32937 existing records from primary storage. [2025-10-23T21:00:00.803017] [INFO ] [MAIN ] DNP: Loaded 32937 existing records. [2025-10-23T21:00:00.985610] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:00.991280] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T21:00:00.991354] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-23T21:00:00.993578] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-23T21:00:00.993637] [INFO ] [REMOTE ] DMB: Full fetch complete (14678 records). [2025-10-23T21:00:00.993867] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-23T21:00:00.993986] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-23T21:00:01.062778] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-23T21:00:01.606462] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-23T21:00:01.728795] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-23T21:00:01.752865] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:01.753481] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-23T21:00:01.754360] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-23T21:00:01.754464] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-23T21:00:01.755346] [DEBUG] [LOCAL ] DMB: Trimmed 14678 records to 10554 (keeping 200 days of data) [2025-10-23T21:00:01.825891] [DEBUG] [LOCAL ] DMB: Primary data saved (10554 records). [2025-10-23T21:00:01.826079] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-23T21:00:01.826193] [INFO ] [MAIN ] Update Progress: 636/2367 symbols completed. DMB took 32.7s. Estimated remaining: 3h 37m 38s. Rate: 8.0 symbols/min [2025-10-23T21:00:02.028620] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:02.109116] [DEBUG] [LOCAL ] DOC: Loaded 53555 existing records from primary storage. [2025-10-23T21:00:02.109504] [INFO ] [MAIN ] DOC: Loaded 53555 existing records. [2025-10-23T21:00:02.307816] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:02.308094] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-23T21:00:02.308174] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-23T21:00:02.308801] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-23T21:00:02.308879] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-23T21:00:02.406926] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-23T21:00:02.710087] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:03.090836] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-23T21:00:03.199437] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-23T21:00:03.945693] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-23T21:00:03.999479] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-23T21:00:04.799560] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-23T21:00:04.835707] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-23T21:00:05.599433] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-23T21:00:05.671467] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-23T21:00:05.829164] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T21:00:06.399447] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-23T21:00:07.199424] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-23T21:00:07.281811] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:00:07.383081] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-23T21:00:07.999444] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-23T21:00:08.617061] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-23T21:00:08.799418] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-23T21:00:09.501392] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-23T21:00:09.599399] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-23T21:00:10.410266] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-23T21:00:10.412424] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-23T21:00:10.413819] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T21:00:11.199426] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-23T21:00:11.903633] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T21:00:11.999401] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-23T21:00:12.164671] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:00:12.567313] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T21:00:12.799446] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-23T21:00:13.599411] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-23T21:00:14.133724] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T21:00:14.399435] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-23T21:00:14.595061] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T21:00:15.199443] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-23T21:00:15.771129] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-23T21:00:15.999432] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-23T21:00:16.799471] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-23T21:00:16.833065] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T21:00:17.061274] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-23T21:00:17.599445] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-23T21:00:18.303638] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T21:00:18.379294] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-23T21:00:18.388298] [INFO ] [REMOTE ] DNA: Full fetch complete (71199 records). [2025-10-23T21:00:18.388464] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-23T21:00:18.409639] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-23T21:00:18.776667] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-23T21:00:18.776801] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-23T21:00:18.777919] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-23T21:00:18.778021] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-23T21:00:18.779492] [DEBUG] [LOCAL ] DNA: Trimmed 71199 records to 48871 (keeping 200 days of data) [2025-10-23T21:00:19.068983] [DEBUG] [LOCAL ] DNA: Primary data saved (48871 records). [2025-10-23T21:00:19.069145] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-23T21:00:19.069253] [INFO ] [MAIN ] Update Progress: 637/2367 symbols completed. DNA took 41.3s. Estimated remaining: 3h 37m 57s. Rate: 7.9 symbols/min [2025-10-23T21:00:19.199443] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-23T21:00:19.423928] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T21:00:19.999439] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-23T21:00:20.063345] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T21:00:20.799436] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-23T21:00:20.920954] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T21:00:21.599416] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-23T21:00:21.749893] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:00:21.959542] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T21:00:22.399451] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-23T21:00:23.199440] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-23T21:00:23.816034] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T21:00:23.999420] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-23T21:00:24.197835] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:00:24.671995] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:00:24.799472] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-23T21:00:25.599415] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-23T21:00:26.114838] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T21:00:26.354339] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T21:00:26.362343] [INFO ] [REMOTE ] DNOW: Full fetch complete (63662 records). [2025-10-23T21:00:26.362516] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-23T21:00:26.405792] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-23T21:00:26.750359] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-23T21:00:26.750473] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-23T21:00:26.751315] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-23T21:00:26.751394] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-23T21:00:26.752844] [DEBUG] [LOCAL ] DNOW: Trimmed 63662 records to 44058 (keeping 200 days of data) [2025-10-23T21:00:27] [DEBUG] [LOCAL ] DNOW: Primary data saved (44058 records). [2025-10-23T21:00:27.000148] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-23T21:00:27.001095] [INFO ] [MAIN ] Update Progress: 638/2367 symbols completed. DNOW took 31.7s. Estimated remaining: 3h 37m 50s. Rate: 7.9 symbols/min [2025-10-23T21:00:27.112365] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T21:00:27.118454] [INFO ] [REMOTE ] DNP: Full fetch complete (48407 records). [2025-10-23T21:00:27.118638] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-23T21:00:27.501688] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-23T21:00:27.501797] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-23T21:00:27.502485] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-23T21:00:27.502560] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-23T21:00:27.503550] [DEBUG] [LOCAL ] DNP: Trimmed 48407 records to 33207 (keeping 200 days of data) [2025-10-23T21:00:27.694514] [DEBUG] [LOCAL ] DNP: Primary data saved (33207 records). [2025-10-23T21:00:27.694697] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-23T21:00:27.694816] [INFO ] [MAIN ] Update Progress: 639/2367 symbols completed. DNP took 27.1s. Estimated remaining: 3h 37m 24s. Rate: 7.9 symbols/min [2025-10-23T21:00:28.629571] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-23T21:00:28.641055] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-23T21:00:30.714056] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T21:00:30.723561] [INFO ] [REMOTE ] DOC: Full fetch complete (77597 records). [2025-10-23T21:00:30.723787] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-23T21:00:31.115444] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-23T21:00:31.115577] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-23T21:00:31.116708] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-23T21:00:31.116792] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-23T21:00:31.118404] [DEBUG] [LOCAL ] DOC: Trimmed 77597 records to 53944 (keeping 200 days of data) [2025-10-23T21:00:31.450863] [DEBUG] [LOCAL ] DOC: Primary data saved (53944 records). [2025-10-23T21:00:31.451031] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-23T21:00:31.451144] [INFO ] [MAIN ] Update Progress: 640/2367 symbols completed. DOC took 29.6s. Estimated remaining: 3h 37m 6s. Rate: 8.0 symbols/min [2025-10-23T21:00:32.003349] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:32.089284] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-10-23T21:00:32.151068] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-10-23T21:00:32.199070] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-23T21:00:32.219324] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:32.226092] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:32.226580] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-23T21:00:32.225091] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:32.227376] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-23T21:00:32.227461] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-23T21:00:32.461816] [DEBUG] [LOCAL ] DOUG: Loaded 33811 existing records from primary storage. [2025-10-23T21:00:32.601530] [DEBUG] [LOCAL ] DOCN: Loaded 51129 existing records from primary storage. [2025-10-23T21:00:32.603473] [DEBUG] [LOCAL ] DOCS: Loaded 50353 existing records from primary storage. [2025-10-23T21:00:32.602087] [INFO ] [MAIN ] DOUG: Loaded 33811 existing records. [2025-10-23T21:00:32.608953] [INFO ] [MAIN ] DOCN: Loaded 51129 existing records. [2025-10-23T21:00:32.625205] [INFO ] [MAIN ] DOCS: Loaded 50353 existing records. [2025-10-23T21:00:33.089831] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:33.143350] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:33.148927] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-23T21:00:33.235990] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-23T21:00:33.227544] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:33.258469] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-23T21:00:33.263508] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-23T21:00:33.263159] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:33.263741] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-23T21:00:33.264081] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-23T21:00:33.264856] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-23T21:00:33.264896] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-23T21:00:33.265295] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-23T21:00:33.265370] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-23T21:00:33.301847] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-23T21:00:33.296538] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-23T21:00:33.375951] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-23T21:00:34.339823] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:34.391127] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-23T21:00:34.481872] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:34.458353] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:34.483821] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-23T21:00:34.483369] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-23T21:00:34.864126] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T21:00:34.872202] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-23T21:00:36.107738] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T21:00:36.117840] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-23T21:00:36.360574] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T21:00:36.369908] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-23T21:00:36.399141] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T21:00:36.406107] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-23T21:00:36.441207] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T21:00:36.452044] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-23T21:00:37.602805] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T21:00:37.610062] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-23T21:00:37.833566] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T21:00:37.843610] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-23T21:00:38.078076] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T21:00:38.085533] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-23T21:00:38.352616] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-23T21:00:38.362466] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-23T21:00:39.197176] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T21:00:39.205981] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-23T21:00:39.668802] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T21:00:39.680123] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-23T21:00:39.840243] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:00:39.999461] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-23T21:00:40.071610] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T21:00:40.740897] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T21:00:40.799521] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-23T21:00:41.416570] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T21:00:41.599498] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-23T21:00:41.719231] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T21:00:42.277400] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T21:00:42.399460] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-23T21:00:42.876702] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T21:00:43.199478] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-23T21:00:43.999413] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-23T21:00:44.546076] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-23T21:00:44.799437] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-23T21:00:45.204785] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-23T21:00:45.387302] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T21:00:45.599440] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-23T21:00:46.399500] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-23T21:00:46.945265] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-23T21:00:47.199416] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-23T21:00:47.297909] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T21:00:47.999435] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-23T21:00:48.445808] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-23T21:00:48.799416] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-23T21:00:49.207353] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T21:00:49.606501] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-23T21:00:49.616812] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T21:00:50.399509] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-23T21:00:50.886775] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-23T21:00:51.199406] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-23T21:00:51.709049] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T21:00:51.999474] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-23T21:00:52.207564] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T21:00:52.215134] [INFO ] [REMOTE ] DOLE: Full fetch complete (54707 records). [2025-10-23T21:00:52.215286] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-23T21:00:52.595039] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-23T21:00:52.595155] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-23T21:00:52.596048] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-23T21:00:52.596147] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-23T21:00:52.597345] [DEBUG] [LOCAL ] DOLE: Trimmed 54707 records to 39389 (keeping 200 days of data) [2025-10-23T21:00:52.737357] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T21:00:52.802264] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-23T21:00:52.861317] [DEBUG] [LOCAL ] DOLE: Primary data saved (39389 records). [2025-10-23T21:00:52.861462] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-23T21:00:52.861580] [INFO ] [MAIN ] Update Progress: 641/2367 symbols completed. DOLE took 21.4s. Estimated remaining: 3h 37m 36s. Rate: 7.9 symbols/min [2025-10-23T21:00:53.030069] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:53.072168] [DEBUG] [LOCAL ] DOV: Loaded 45584 existing records from primary storage. [2025-10-23T21:00:53.072508] [INFO ] [MAIN ] DOV: Loaded 45584 existing records. [2025-10-23T21:00:53.245743] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:53.245987] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-23T21:00:53.246083] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-23T21:00:53.246325] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-23T21:00:53.246416] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-23T21:00:53.610626] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:00:53.605970] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-23T21:00:54.064999] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-23T21:00:54.399453] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-23T21:00:55.016050] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-23T21:00:55.080489] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T21:00:55.199435] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-23T21:00:55.999456] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-23T21:00:56.318593] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T21:00:56.799529] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-23T21:00:56.956961] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T21:00:57.497113] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T21:00:57.599419] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-23T21:00:58.399450] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-23T21:00:58.686619] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T21:00:58.695249] [INFO ] [REMOTE ] DOCS: Full fetch complete (73727 records). [2025-10-23T21:00:58.695420] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-23T21:00:59.078988] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-23T21:00:59.079114] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-23T21:00:59.080065] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-23T21:00:59.080156] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-23T21:00:59.081603] [DEBUG] [LOCAL ] DOCS: Trimmed 73727 records to 50676 (keeping 200 days of data) [2025-10-23T21:00:59.244386] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-23T21:00:59.383830] [DEBUG] [LOCAL ] DOCS: Primary data saved (50676 records). [2025-10-23T21:00:59.384009] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-23T21:00:59.385765] [INFO ] [MAIN ] Update Progress: 642/2367 symbols completed. DOCS took 27.9s. Estimated remaining: 3h 37m 25s. Rate: 7.9 symbols/min [2025-10-23T21:00:59.623639] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:00:59.682465] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-23T21:00:59.682910] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-23T21:00:59.877445] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:00:59.877792] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-23T21:00:59.878038] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-23T21:00:59.878365] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-23T21:00:59.878437] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-23T21:01:00.039199] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-23T21:01:00.040486] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T21:01:00.129365] [INFO ] [REMOTE ] DOCN: Full fetch complete (73021 records). [2025-10-23T21:01:00.129619] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-23T21:01:00.181875] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-23T21:01:00.457265] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:00.684825] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-23T21:01:00.684934] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-23T21:01:00.685828] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-23T21:01:00.685910] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-23T21:01:00.687243] [DEBUG] [LOCAL ] DOCN: Trimmed 73021 records to 51493 (keeping 200 days of data) [2025-10-23T21:01:00.799499] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-23T21:01:00.979635] [DEBUG] [LOCAL ] DOCN: Primary data saved (51493 records). [2025-10-23T21:01:00.979846] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-23T21:01:00.979985] [INFO ] [MAIN ] Update Progress: 643/2367 symbols completed. DOCN took 29.5s. Estimated remaining: 3h 37m 2s. Rate: 7.9 symbols/min [2025-10-23T21:01:01.146462] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:01.170622] [DEBUG] [LOCAL ] DPG: Loaded 13345 existing records from primary storage. [2025-10-23T21:01:01.170924] [INFO ] [MAIN ] DPG: Loaded 13345 existing records. [2025-10-23T21:01:01.349499] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:01:01.349788] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-23T21:01:01.349864] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-23T21:01:01.350078] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-23T21:01:01.350151] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-23T21:01:01.714987] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:01.715352] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-23T21:01:02.040893] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-23T21:01:02.399538] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-23T21:01:02.937577] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-23T21:01:02.943035] [INFO ] [REMOTE ] DOUG: Full fetch complete (49865 records). [2025-10-23T21:01:02.943162] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-23T21:01:03.253745] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T21:01:03.285136] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-23T21:01:03.336141] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-23T21:01:03.336247] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-23T21:01:03.336976] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-23T21:01:03.337055] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-23T21:01:03.338153] [DEBUG] [LOCAL ] DOUG: Trimmed 49865 records to 33959 (keeping 200 days of data) [2025-10-23T21:01:03.521340] [DEBUG] [LOCAL ] DOUG: Primary data saved (33959 records). [2025-10-23T21:01:03.521501] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-23T21:01:03.521670] [INFO ] [MAIN ] Update Progress: 644/2367 symbols completed. DOUG took 32.0s. Estimated remaining: 3h 36m 41s. Rate: 8.0 symbols/min [2025-10-23T21:01:03.691746] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:03.691922] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-23T21:01:03.691995] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-23T21:01:03.692100] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-23T21:01:03.692166] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-23T21:01:03.692247] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-23T21:01:03.692312] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-23T21:01:04.050708] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:04.051129] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-23T21:01:04.147108] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (3.35 seconds). [2025-10-23T21:01:04.203502] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T21:01:04.204129] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T21:01:04.799432] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-23T21:01:05.599424] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-23T21:01:05.782846] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T21:01:06.399434] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-23T21:01:06.609838] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T21:01:06.715801] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T21:01:07.199433] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-23T21:01:07.999486] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-23T21:01:08.466009] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-23T21:01:08.726328] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T21:01:08.799445] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-23T21:01:09.292341] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T21:01:09.599423] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-23T21:01:10.399437] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-23T21:01:10.681516] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T21:01:10.892212] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T21:01:11.199461] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-23T21:01:11.884009] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T21:01:11.999397] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-23T21:01:12.799450] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-23T21:01:13.611402] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-23T21:01:13.617743] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-23T21:01:13.889674] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T21:01:14.399408] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-23T21:01:14.568706] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T21:01:14.655139] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T21:01:15.199453] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-23T21:01:15.999408] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-23T21:01:16.177902] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T21:01:16.799424] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-23T21:01:17.038712] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T21:01:17.506266] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-23T21:01:17.599448] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-23T21:01:18.399442] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-23T21:01:18.615387] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T21:01:18.759721] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T21:01:19.199441] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-23T21:01:19.999634] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-23T21:01:20.517302] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-23T21:01:20.600757] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T21:01:20.799419] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-23T21:01:21.472531] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:01:21.599426] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-23T21:01:22.272546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T21:01:22.399419] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-23T21:01:22.695806] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T21:01:23.199409] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-23T21:01:23.999411] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-23T21:01:24.025809] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:01:24.151341] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T21:01:24.154024] [INFO ] [REMOTE ] DPG: Full fetch complete (19001 records). [2025-10-23T21:01:24.154132] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-23T21:01:24.510687] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-23T21:01:24.510796] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-23T21:01:24.511244] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-23T21:01:24.511326] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-23T21:01:24.511960] [DEBUG] [LOCAL ] DPG: Trimmed 19001 records to 13421 (keeping 200 days of data) [2025-10-23T21:01:24.591557] [DEBUG] [LOCAL ] DPG: Primary data saved (13421 records). [2025-10-23T21:01:24.591766] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-23T21:01:24.591920] [INFO ] [MAIN ] Update Progress: 645/2367 symbols completed. DPG took 23.6s. Estimated remaining: 3h 37m 10s. Rate: 7.9 symbols/min [2025-10-23T21:01:24.763098] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:24.798640] [DEBUG] [LOCAL ] DRD: Loaded 37899 existing records from primary storage. [2025-10-23T21:01:24.798973] [INFO ] [MAIN ] DRD: Loaded 37899 existing records. [2025-10-23T21:01:24.810069] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-23T21:01:24.982087] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:01:24.982378] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-23T21:01:24.982460] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-23T21:01:24.983080] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-23T21:01:24.983156] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-23T21:01:25.338500] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:25.599413] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-23T21:01:25.858420] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-23T21:01:25.866692] [INFO ] [REMOTE ] DOV: Full fetch complete (66231 records). [2025-10-23T21:01:25.866853] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-23T21:01:26.252979] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-23T21:01:26.253165] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-23T21:01:26.254043] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-23T21:01:26.254177] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-23T21:01:26.255536] [DEBUG] [LOCAL ] DOV: Trimmed 66231 records to 45957 (keeping 200 days of data) [2025-10-23T21:01:26.370276] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T21:01:26.400119] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-23T21:01:26.569189] [DEBUG] [LOCAL ] DOV: Primary data saved (45957 records). [2025-10-23T21:01:26.569347] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-23T21:01:26.569437] [INFO ] [MAIN ] Update Progress: 646/2367 symbols completed. DOV took 33.7s. Estimated remaining: 3h 36m 47s. Rate: 7.9 symbols/min [2025-10-23T21:01:26.737042] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:26.737204] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-23T21:01:26.737274] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-23T21:01:26.737382] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-23T21:01:26.737452] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-23T21:01:26.737545] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-23T21:01:26.737610] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-23T21:01:27.103090] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:27.117935] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T21:01:27.199398] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-23T21:01:27.999569] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-23T21:01:28.551275] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-23T21:01:28.585240] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T21:01:28.799463] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-23T21:01:29.599452] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-23T21:01:30.286580] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-23T21:01:30.399409] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-23T21:01:30.422689] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T21:01:30.901021] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T21:01:31.199488] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-23T21:01:31.999452] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-23T21:01:32.799447] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-23T21:01:32.892442] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T21:01:32.953189] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-23T21:01:33.443313] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T21:01:33.599501] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-23T21:01:34.399461] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-23T21:01:34.523695] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:01:35.199424] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-23T21:01:35.532916] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T21:01:35.999440] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-23T21:01:36.604321] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T21:01:36.655854] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T21:01:36.799406] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-23T21:01:37.518842] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T21:01:37.599424] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-23T21:01:38.399445] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-23T21:01:38.865821] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T21:01:38.876784] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-23T21:01:38.876983] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-23T21:01:39.202629] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-23T21:01:39.361361] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-23T21:01:39.380762] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-23T21:01:39.382045] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-23T21:01:39.382723] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-23T21:01:39.383558] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T21:01:39.393166] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54123 (keeping 200 days of data) [2025-10-23T21:01:39.724275] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-23T21:01:39.724470] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-23T21:01:39.725702] [INFO ] [MAIN ] Update Progress: 647/2367 symbols completed. DOW took 40.3s. Estimated remaining: 3h 36m 54s. Rate: 7.9 symbols/min [2025-10-23T21:01:39.917137] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:39.964315] [DEBUG] [LOCAL ] DRI: Loaded 47513 existing records from primary storage. [2025-10-23T21:01:39.964674] [INFO ] [MAIN ] DRI: Loaded 47513 existing records. [2025-10-23T21:01:40.006760] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-23T21:01:40.197022] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:01:40.192988] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T21:01:40.207254] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-23T21:01:40.207390] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-23T21:01:40.207866] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-23T21:01:40.207968] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-23T21:01:40.589399] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:40.799439] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-23T21:01:41.360308] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-23T21:01:41.368755] [INFO ] [REMOTE ] DQ: Full fetch complete (63620 records). [2025-10-23T21:01:41.368944] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-23T21:01:41.608755] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-23T21:01:41.771989] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-23T21:01:41.772146] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-23T21:01:41.772996] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-23T21:01:41.773076] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-23T21:01:41.774370] [DEBUG] [LOCAL ] DQ: Trimmed 63620 records to 44070 (keeping 200 days of data) [2025-10-23T21:01:41.993456] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T21:01:42.055554] [DEBUG] [LOCAL ] DQ: Primary data saved (44070 records). [2025-10-23T21:01:42.055728] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-23T21:01:42.055833] [INFO ] [MAIN ] Update Progress: 648/2367 symbols completed. DQ took 38.5s. Estimated remaining: 3h 36m 33s. Rate: 7.9 symbols/min [2025-10-23T21:01:42.224155] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:42.224335] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-23T21:01:42.224405] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-23T21:01:42.224512] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-23T21:01:42.224583] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-23T21:01:42.224693] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-23T21:01:42.224762] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-23T21:01:42.423562] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-23T21:01:42.608118] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:42.832870] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T21:01:43.199428] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-23T21:01:43.570239] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T21:01:43.866997] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T21:01:43.999433] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-23T21:01:44.799416] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-23T21:01:45.034174] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T21:01:45.528987] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T21:01:45.599504] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-23T21:01:45.893760] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T21:01:46.399440] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-23T21:01:47.199416] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-23T21:01:47.320486] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:01:47.999416] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-23T21:01:48.044913] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T21:01:48.061108] [INFO ] [REMOTE ] DRD: Full fetch complete (52309 records). [2025-10-23T21:01:48.061454] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T21:01:48.061737] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-23T21:01:48.476524] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-23T21:01:48.476635] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-23T21:01:48.477412] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-23T21:01:48.477491] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-23T21:01:48.478597] [DEBUG] [LOCAL ] DRD: Trimmed 52309 records to 38203 (keeping 200 days of data) [2025-10-23T21:01:48.709317] [DEBUG] [LOCAL ] DRD: Primary data saved (38203 records). [2025-10-23T21:01:48.709551] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-23T21:01:48.709714] [INFO ] [MAIN ] Update Progress: 649/2367 symbols completed. DRD took 24.1s. Estimated remaining: 3h 36m 23s. Rate: 7.9 symbols/min [2025-10-23T21:01:48.808614] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-23T21:01:48.888790] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:01:48.918101] [DEBUG] [LOCAL ] DSL: Loaded 28887 existing records from primary storage. [2025-10-23T21:01:48.918440] [INFO ] [MAIN ] DSL: Loaded 28887 existing records. [2025-10-23T21:01:49.104067] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:01:49.104306] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-23T21:01:49.104383] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-23T21:01:49.104766] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-23T21:01:49.104845] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-23T21:01:49.478158] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:01:49.599416] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-23T21:01:49.933313] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T21:01:49.972718] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T21:01:50.399435] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-23T21:01:51.199431] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-23T21:01:51.336328] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T21:01:51.676450] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-23T21:01:51.999420] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-23T21:01:52.639504] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T21:01:52.799465] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-23T21:01:52.919242] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T21:01:53.599494] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-23T21:01:54.176873] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T21:01:54.399512] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-23T21:01:55.199444] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-23T21:01:55.572215] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T21:01:55.809251] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T21:01:55.999442] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-23T21:01:56.799418] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-23T21:01:56.906101] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T21:01:57.599454] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-23T21:01:58.069280] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-23T21:01:58.399473] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-23T21:01:58.426080] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T21:01:58.618879] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T21:01:59.199490] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-23T21:01:59.999470] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-23T21:02:00.184738] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T21:02:00.799472] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-23T21:02:01.304160] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T21:02:01.599542] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-23T21:02:02.310214] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-10-23T21:02:02.399464] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-23T21:02:02.899710] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-23T21:02:03.155515] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T21:02:03.199407] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-23T21:02:03.999436] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-23T21:02:04.100142] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T21:02:04.462054] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T21:02:04.470750] [INFO ] [REMOTE ] DRH: Full fetch complete (71973 records). [2025-10-23T21:02:04.470923] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-23T21:02:04.804570] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-23T21:02:04.889225] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-23T21:02:04.889378] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-23T21:02:04.890320] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-23T21:02:04.890405] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-23T21:02:04.892125] [DEBUG] [LOCAL ] DRH: Trimmed 71973 records to 50624 (keeping 200 days of data) [2025-10-23T21:02:05.185016] [DEBUG] [LOCAL ] DRH: Primary data saved (50624 records). [2025-10-23T21:02:05.185189] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-23T21:02:05.185300] [INFO ] [MAIN ] Update Progress: 650/2367 symbols completed. DRH took 38.6s. Estimated remaining: 3h 36m 39s. Rate: 7.9 symbols/min [2025-10-23T21:02:05.379044] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:05.394125] [DEBUG] [LOCAL ] DSM: Loaded 14178 existing records from primary storage. [2025-10-23T21:02:05.394411] [INFO ] [MAIN ] DSM: Loaded 14178 existing records. [2025-10-23T21:02:05.576988] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T21:02:05.612344] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:02:05.603775] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-23T21:02:05.619556] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-23T21:02:05.620305] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-23T21:02:05.621060] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-23T21:02:05.621161] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-23T21:02:06.000152] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:06.399491] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-23T21:02:06.574357] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T21:02:06.576197] [INFO ] [REMOTE ] DRLL: Full fetch complete (14481 records). [2025-10-23T21:02:06.576328] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-23T21:02:06.958186] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-23T21:02:06.958703] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-23T21:02:06.960321] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-23T21:02:06.960419] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-23T21:02:06.961672] [DEBUG] [LOCAL ] DRLL: Trimmed 14481 records to 8648 (keeping 200 days of data) [2025-10-23T21:02:07.022635] [DEBUG] [LOCAL ] DRLL: Primary data saved (8648 records). [2025-10-23T21:02:07.022904] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-23T21:02:07.023054] [INFO ] [MAIN ] Update Progress: 651/2367 symbols completed. DRLL took 25.0s. Estimated remaining: 3h 36m 16s. Rate: 7.9 symbols/min [2025-10-23T21:02:07.199818] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-23T21:02:07.202417] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:07.203945] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-23T21:02:07.232018] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-23T21:02:07.235834] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-23T21:02:07.235994] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-23T21:02:07.236180] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-23T21:02:07.236471] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-23T21:02:07.252932] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-23T21:02:07.369175] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T21:02:07.649907] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:07.999437] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-23T21:02:08.799428] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-23T21:02:08.844515] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T21:02:09.014723] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T21:02:09.599451] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-23T21:02:10.082908] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T21:02:10.399434] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-23T21:02:11.019599] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T21:02:11.069066] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T21:02:11.199418] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-23T21:02:11.834021] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T21:02:11.999446] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-23T21:02:12.799437] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-23T21:02:13.328822] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T21:02:13.462798] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-23T21:02:13.599474] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-23T21:02:14.399441] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-23T21:02:15.199477] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-23T21:02:15.426930] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T21:02:15.543066] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T21:02:15.999433] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-23T21:02:16.473808] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T21:02:16.799432] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-23T21:02:17.384799] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T21:02:17.599447] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-23T21:02:18.040324] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T21:02:18.062419] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T21:02:18.399447] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-23T21:02:18.960314] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-23T21:02:19.199432] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-23T21:02:19.999427] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-23T21:02:20.799445] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-23T21:02:20.905722] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T21:02:20.912422] [INFO ] [REMOTE ] DSL: Full fetch complete (41797 records). [2025-10-23T21:02:20.912631] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-23T21:02:21.344827] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-23T21:02:21.344973] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-23T21:02:21.345707] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-23T21:02:21.345790] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-23T21:02:21.347020] [DEBUG] [LOCAL ] DSL: Trimmed 41797 records to 29120 (keeping 200 days of data) [2025-10-23T21:02:21.457853] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-23T21:02:21.541309] [DEBUG] [LOCAL ] DSL: Primary data saved (29120 records). [2025-10-23T21:02:21.541487] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-23T21:02:21.541600] [INFO ] [MAIN ] Update Progress: 652/2367 symbols completed. DSL took 32.8s. Estimated remaining: 3h 36m 27s. Rate: 7.9 symbols/min [2025-10-23T21:02:21.601484] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-23T21:02:21.729228] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:21.751953] [DEBUG] [LOCAL ] DSU: Loaded 22871 existing records from primary storage. [2025-10-23T21:02:21.752236] [INFO ] [MAIN ] DSU: Loaded 22871 existing records. [2025-10-23T21:02:21.966349] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T21:02:21.971617] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:02:21.979955] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-23T21:02:21.980035] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-23T21:02:21.980220] [INFO ] [REMOTE ] DRI: Full fetch complete (69450 records). [2025-10-23T21:02:21.980282] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-23T21:02:21.980487] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-23T21:02:21.980546] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-23T21:02:22.418494] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-23T21:02:22.717615] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:22.772565] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-23T21:02:22.772843] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-23T21:02:22.773687] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T21:02:22.774838] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-23T21:02:22.775130] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-23T21:02:22.779866] [DEBUG] [LOCAL ] DRI: Trimmed 69450 records to 47825 (keeping 200 days of data) [2025-10-23T21:02:23.083678] [DEBUG] [LOCAL ] DRI: Primary data saved (47825 records). [2025-10-23T21:02:23.083857] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-23T21:02:23.084999] [INFO ] [MAIN ] Update Progress: 653/2367 symbols completed. DRI took 43.4s. Estimated remaining: 3h 36m 4s. Rate: 7.9 symbols/min [2025-10-23T21:02:23.193568] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T21:02:23.199406] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-23T21:02:23.269789] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:23.293730] [DEBUG] [LOCAL ] DSX: Loaded 23496 existing records from primary storage. [2025-10-23T21:02:23.294029] [INFO ] [MAIN ] DSX: Loaded 23496 existing records. [2025-10-23T21:02:23.473798] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:02:23.474076] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-23T21:02:23.474153] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-23T21:02:23.474382] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-23T21:02:23.474453] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-23T21:02:23.821897] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:23.999433] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-23T21:02:24.424010] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T21:02:24.799444] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-23T21:02:25.235919] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T21:02:25.599516] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-23T21:02:26.096454] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T21:02:26.399440] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-23T21:02:26.607097] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T21:02:27.199410] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-23T21:02:27.596066] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T21:02:27.999462] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-23T21:02:28.470909] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T21:02:28.799440] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-23T21:02:29.247126] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T21:02:29.599411] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-23T21:02:29.753818] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T21:02:30.399462] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-23T21:02:30.956087] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T21:02:31.199441] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-23T21:02:31.757183] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T21:02:31.758840] [INFO ] [REMOTE ] DSMC: Full fetch complete (2873 records). [2025-10-23T21:02:31.759116] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-23T21:02:31.904416] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T21:02:32.007518] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-23T21:02:32.162393] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-23T21:02:32.162510] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-23T21:02:32.162700] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-23T21:02:32.162782] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-23T21:02:32.163152] [DEBUG] [LOCAL ] DSMC: Trimmed 2873 records to 1780 (keeping 200 days of data) [2025-10-23T21:02:32.174283] [DEBUG] [LOCAL ] DSMC: Primary data saved (1780 records). [2025-10-23T21:02:32.174366] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-23T21:02:32.174462] [INFO ] [MAIN ] Update Progress: 654/2367 symbols completed. DSMC took 25.2s. Estimated remaining: 3h 36m 0s. Rate: 7.9 symbols/min [2025-10-23T21:02:32.340531] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:32.392400] [DEBUG] [LOCAL ] DT: Loaded 52954 existing records from primary storage. [2025-10-23T21:02:32.392788] [INFO ] [MAIN ] DT: Loaded 52954 existing records. [2025-10-23T21:02:32.572911] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:02:32.573115] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-23T21:02:32.573190] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-23T21:02:32.573409] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-23T21:02:32.573480] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-23T21:02:32.810775] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-23T21:02:32.930446] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:33.365921] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T21:02:33.599449] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-23T21:02:34.039674] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-23T21:02:34.399444] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-23T21:02:35.199425] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-23T21:02:35.548593] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T21:02:35.634399] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T21:02:35.999437] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-23T21:02:36.306888] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T21:02:36.799623] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-23T21:02:37.063402] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T21:02:37.599420] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-23T21:02:38.189895] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T21:02:38.399435] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-23T21:02:39.199491] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-23T21:02:39.514931] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-23T21:02:39.757081] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T21:02:39.823879] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T21:02:39.999431] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-23T21:02:40.799436] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-23T21:02:41.599458] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-23T21:02:41.840490] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T21:02:41.844037] [INFO ] [REMOTE ] DSM: Full fetch complete (23851 records). [2025-10-23T21:02:41.844165] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-23T21:02:42.218405] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-23T21:02:42.276933] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-23T21:02:42.277494] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-23T21:02:42.278407] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-23T21:02:42.278487] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-23T21:02:42.279428] [DEBUG] [LOCAL ] DSM: Trimmed 23851 records to 14223 (keeping 200 days of data) [2025-10-23T21:02:42.358923] [DEBUG] [LOCAL ] DSM: Primary data saved (14223 records). [2025-10-23T21:02:42.359075] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-23T21:02:42.359184] [INFO ] [MAIN ] Update Progress: 655/2367 symbols completed. DSM took 37.2s. Estimated remaining: 3h 35m 59s. Rate: 7.9 symbols/min [2025-10-23T21:02:42.404559] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-23T21:02:42.556258] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:42.557097] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-23T21:02:42.557168] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-23T21:02:42.557308] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-23T21:02:42.557382] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-23T21:02:42.557474] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-23T21:02:42.557544] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-23T21:02:42.911676] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:42.951049] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T21:02:43.199518] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-23T21:02:43.550016] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T21:02:43.999450] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-23T21:02:44.568319] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T21:02:44.799453] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-23T21:02:45.281498] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T21:02:45.286036] [INFO ] [REMOTE ] DSX: Full fetch complete (35399 records). [2025-10-23T21:02:45.286202] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-23T21:02:45.580714] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T21:02:45.599453] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-23T21:02:45.724508] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-23T21:02:45.724660] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-23T21:02:45.725326] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-23T21:02:45.725402] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-23T21:02:45.726672] [DEBUG] [LOCAL ] DSX: Trimmed 35399 records to 23599 (keeping 200 days of data) [2025-10-23T21:02:45.870277] [DEBUG] [LOCAL ] DSX: Primary data saved (23599 records). [2025-10-23T21:02:45.870464] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-23T21:02:45.870600] [INFO ] [MAIN ] Update Progress: 656/2367 symbols completed. DSX took 22.8s. Estimated remaining: 3h 35m 41s. Rate: 7.9 symbols/min [2025-10-23T21:02:46.062418] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:46.109249] [DEBUG] [LOCAL ] DTE: Loaded 47121 existing records from primary storage. [2025-10-23T21:02:46.109577] [INFO ] [MAIN ] DTE: Loaded 47121 existing records. [2025-10-23T21:02:46.288294] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:02:46.288475] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-23T21:02:46.288548] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-23T21:02:46.288822] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-23T21:02:46.288894] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-23T21:02:46.385161] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T21:02:46.404524] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-23T21:02:46.654083] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:47.199459] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-23T21:02:47.943258] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T21:02:47.999449] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-23T21:02:48.242110] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T21:02:48.738124] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T21:02:48.799403] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-23T21:02:49.599431] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-23T21:02:50.369179] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T21:02:50.399396] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-23T21:02:50.643371] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T21:02:51.199488] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-23T21:02:51.257123] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T21:02:51.999428] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-23T21:02:52.799453] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-23T21:02:52.957666] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T21:02:53.516007] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T21:02:53.571280] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T21:02:53.599474] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-23T21:02:54.399518] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-23T21:02:55.170319] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T21:02:55.199405] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-23T21:02:55.493388] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T21:02:55.999418] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-23T21:02:56.069224] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T21:02:56.799462] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-23T21:02:57.283709] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T21:02:57.291072] [INFO ] [REMOTE ] DSU: Full fetch complete (33057 records). [2025-10-23T21:02:57.291273] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-23T21:02:57.463941] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T21:02:57.493906] [INFO ] [REMOTE ] DTB: Full fetch complete (6514 records). [2025-10-23T21:02:57.552716] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-23T21:02:57.601791] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-23T21:02:57.872873] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-23T21:02:57.888554] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-23T21:02:57.922743] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-23T21:02:57.939327] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-23T21:02:58.039716] [DEBUG] [LOCAL ] DSU: Trimmed 33057 records to 22973 (keeping 200 days of data) [2025-10-23T21:02:58.253990] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-23T21:02:58.262784] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-23T21:02:58.269816] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-23T21:02:58.284260] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-23T21:02:58.288123] [DEBUG] [LOCAL ] DTB: Trimmed 6514 records to 4918 (keeping 200 days of data) [2025-10-23T21:02:58.334913] [DEBUG] [LOCAL ] DSU: Primary data saved (22973 records). [2025-10-23T21:02:58.339790] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-23T21:02:58.342544] [DEBUG] [LOCAL ] DTB: Primary data saved (4918 records). [2025-10-23T21:02:58.343117] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-23T21:02:58.342833] [INFO ] [MAIN ] Update Progress: 657/2367 symbols completed. DSU took 36.8s. Estimated remaining: 3h 35m 46s. Rate: 7.9 symbols/min [2025-10-23T21:02:58.351511] [INFO ] [MAIN ] Update Progress: 658/2367 symbols completed. DTB took 16.0s. Estimated remaining: 3h 35m 19s. Rate: 7.9 symbols/min [2025-10-23T21:02:58.429322] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-23T21:02:58.684474] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:58.749488] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:02:58.750097] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-23T21:02:58.750179] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-23T21:02:58.753557] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-23T21:02:58.753373] [DEBUG] [LOCAL ] DTG: Loaded 5687 existing records from primary storage. [2025-10-23T21:02:58.753709] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-23T21:02:58.753912] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-23T21:02:58.754005] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-23T21:02:58.754180] [INFO ] [MAIN ] DTG: Loaded 5687 existing records. [2025-10-23T21:02:59.161908] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:02:59.190778] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-23T21:02:59.230280] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-23T21:02:59.242117] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-23T21:02:59.253730] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-23T21:02:59.463063] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:59.509201] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-23T21:02:59.736031] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:02:59.764742] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-23T21:02:59.973085] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T21:02:59.999435] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-23T21:03:00.635757] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-23T21:03:00.799447] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-23T21:03:01.599434] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-23T21:03:02.065236] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T21:03:02.399488] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-23T21:03:02.866856] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T21:03:03.199441] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-23T21:03:03.488786] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-23T21:03:03.862435] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T21:03:03.999463] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-23T21:03:04.767277] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T21:03:04.801928] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-23T21:03:04.811439] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-23T21:03:05.599474] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-23T21:03:06.399513] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-23T21:03:06.629957] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:03:07.061335] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T21:03:07.199444] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-23T21:03:07.559521] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:03:07.800393] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T21:03:07.999466] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-23T21:03:08.650513] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T21:03:08.799485] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-23T21:03:09.343693] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T21:03:09.599468] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-23T21:03:10.399420] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-23T21:03:10.912707] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-23T21:03:11.199415] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-23T21:03:11.438136] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T21:03:11.835396] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T21:03:11.999458] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-23T21:03:12.799450] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-23T21:03:13.451092] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-23T21:03:13.599459] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-23T21:03:14.026849] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T21:03:14.399441] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-23T21:03:14.989474] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-23T21:03:14.990287] [INFO ] [REMOTE ] DTF: Full fetch complete (1734 records). [2025-10-23T21:03:14.990391] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-23T21:03:15.167618] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-23T21:03:15.167845] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:03:15.167916] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:03:15.168002] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-23T21:03:15.168071] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-23T21:03:15.168143] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-23T21:03:15.168225] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-23T21:03:15.168317] [INFO ] [MAIN ] Update Progress: 659/2367 symbols completed. DTF took 16.8s. Estimated remaining: 3h 35m 36s. Rate: 7.9 symbols/min [2025-10-23T21:03:15.204581] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-23T21:03:15.339927] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:15.340157] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-23T21:03:15.340229] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-23T21:03:15.340361] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-23T21:03:15.340432] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-23T21:03:15.340514] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-23T21:03:15.340582] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-23T21:03:15.731455] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:15.733910] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-23T21:03:15.743100] [INFO ] [REMOTE ] DT: Full fetch complete (76908 records). [2025-10-23T21:03:15.743299] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-23T21:03:16.004711] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-23T21:03:16.137368] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-23T21:03:16.137498] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-23T21:03:16.138560] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-23T21:03:16.138667] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-23T21:03:16.140160] [DEBUG] [LOCAL ] DT: Trimmed 76908 records to 53332 (keeping 200 days of data) [2025-10-23T21:03:16.357337] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T21:03:16.372923] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-23T21:03:16.373088] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:03:16.373184] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-23T21:03:16.373271] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:03:16.404832] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-23T21:03:16.411420] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-23T21:03:16.411594] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-23T21:03:16.439254] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-23T21:03:16.439599] [INFO ] [MAIN ] Update Progress: 660/2367 symbols completed. DTK took 1.3s. Estimated remaining: 3h 35m 12s. Rate: 7.9 symbols/min [2025-10-23T21:03:16.564565] [DEBUG] [LOCAL ] DT: Primary data saved (53332 records). [2025-10-23T21:03:16.580090] [INFO ] [MAIN ] DT: Full history saved. [2025-10-23T21:03:16.597443] [INFO ] [MAIN ] Update Progress: 661/2367 symbols completed. DT took 44.4s. Estimated remaining: 3h 34m 45s. Rate: 7.9 symbols/min [2025-10-23T21:03:16.629329] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:16.801179] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:16.801254] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-23T21:03:16.819541] [DEBUG] [LOCAL ] DTW: Loaded 4713 existing records from primary storage. [2025-10-23T21:03:16.819812] [INFO ] [MAIN ] DTW: Loaded 4713 existing records. [2025-10-23T21:03:16.950387] [DEBUG] [LOCAL ] DTM: Loaded 43686 existing records from primary storage. [2025-10-23T21:03:16.956498] [INFO ] [MAIN ] DTM: Loaded 43686 existing records. [2025-10-23T21:03:17.139103] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:03:17.218678] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:03:17.219029] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-23T21:03:17.219151] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-23T21:03:17.213842] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-23T21:03:17.219429] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-23T21:03:17.219789] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-23T21:03:17.219829] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-23T21:03:17.220049] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-23T21:03:17.220004] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-23T21:03:17.618475] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-23T21:03:17.834359] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-23T21:03:17.971947] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:18.008819] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-23T21:03:18.013966] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:18.399428] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-23T21:03:19.199467] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-23T21:03:19.212174] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T21:03:19.815879] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T21:03:19.999470] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-23T21:03:20.799574] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-23T21:03:21.102798] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-23T21:03:21.599413] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-23T21:03:21.645211] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T21:03:21.669289] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:03:21.677283] [INFO ] [REMOTE ] DTE: Full fetch complete (68845 records). [2025-10-23T21:03:21.677469] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-23T21:03:22.074101] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-23T21:03:22.074241] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-23T21:03:22.075123] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-23T21:03:22.075206] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-23T21:03:22.076559] [DEBUG] [LOCAL ] DTE: Trimmed 68845 records to 47417 (keeping 200 days of data) [2025-10-23T21:03:22.375486] [DEBUG] [LOCAL ] DTE: Primary data saved (47417 records). [2025-10-23T21:03:22.375670] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-23T21:03:22.376778] [INFO ] [MAIN ] Update Progress: 662/2367 symbols completed. DTE took 36.5s. Estimated remaining: 3h 34m 33s. Rate: 7.9 symbols/min [2025-10-23T21:03:22.408083] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-23T21:03:22.559937] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:22.560171] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-23T21:03:22.560268] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-23T21:03:22.560415] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-23T21:03:22.560515] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-23T21:03:22.560625] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-23T21:03:22.560821] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-23T21:03:22.922759] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:23.199412] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-23T21:03:23.339628] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T21:03:23.384924] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T21:03:23.999626] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-23T21:03:24.741302] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T21:03:24.799465] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-23T21:03:25.196952] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T21:03:25.580114] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T21:03:25.599441] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-23T21:03:26.325687] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T21:03:26.399425] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-23T21:03:27.199423] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-23T21:03:27.244032] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-23T21:03:27.999463] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-23T21:03:28.799431] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-23T21:03:28.891376] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T21:03:29.149797] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T21:03:29.599453] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-23T21:03:30.399435] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-23T21:03:30.431602] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T21:03:30.796628] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T21:03:31.199430] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-23T21:03:31.993179] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T21:03:31.999390] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-23T21:03:32.671296] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-23T21:03:32.726328] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T21:03:32.799446] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-23T21:03:33.532188] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T21:03:33.599517] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-23T21:03:34.399501] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-23T21:03:35.199407] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-23T21:03:35.248418] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T21:03:35.725688] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T21:03:35.999485] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-23T21:03:36.799484] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-23T21:03:36.834218] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T21:03:37.170479] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T21:03:37.599459] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-23T21:03:37.605339] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T21:03:37.606983] [INFO ] [REMOTE ] DTG: Full fetch complete (8544 records). [2025-10-23T21:03:37.607086] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-23T21:03:37.977594] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-23T21:03:37.977734] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-23T21:03:37.978108] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-23T21:03:37.978193] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-23T21:03:37.978690] [DEBUG] [LOCAL ] DTG: Trimmed 8544 records to 5709 (keeping 200 days of data) [2025-10-23T21:03:38.012704] [DEBUG] [LOCAL ] DTG: Primary data saved (5709 records). [2025-10-23T21:03:38.012865] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-23T21:03:38.012981] [INFO ] [MAIN ] Update Progress: 663/2367 symbols completed. DTG took 39.7s. Estimated remaining: 3h 34m 46s. Rate: 7.9 symbols/min [2025-10-23T21:03:38.182161] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:38.190544] [DEBUG] [LOCAL ] DUKB: Loaded 6134 existing records from primary storage. [2025-10-23T21:03:38.190804] [INFO ] [MAIN ] DUKB: Loaded 6134 existing records. [2025-10-23T21:03:38.373369] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:03:38.373566] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T21:03:38.375202] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-23T21:03:38.376051] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-23T21:03:38.376308] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-23T21:03:38.376382] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-23T21:03:38.404764] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-23T21:03:38.728914] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:39.199453] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-23T21:03:39.999428] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-23T21:03:40.570637] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-23T21:03:40.610587] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-23T21:03:40.799446] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-23T21:03:40.849003] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T21:03:41.524730] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T21:03:41.599467] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-23T21:03:42.399438] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-23T21:03:42.404347] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T21:03:42.405574] [INFO ] [REMOTE ] DTW: Full fetch complete (6952 records). [2025-10-23T21:03:42.405691] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-23T21:03:42.771110] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-23T21:03:42.771217] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-23T21:03:42.771452] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-23T21:03:42.771540] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-23T21:03:42.772030] [DEBUG] [LOCAL ] DTW: Trimmed 6952 records to 4737 (keeping 200 days of data) [2025-10-23T21:03:42.800127] [DEBUG] [LOCAL ] DTW: Primary data saved (4737 records). [2025-10-23T21:03:42.800268] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-23T21:03:42.800358] [INFO ] [MAIN ] Update Progress: 664/2367 symbols completed. DTW took 26.2s. Estimated remaining: 3h 34m 32s. Rate: 7.9 symbols/min [2025-10-23T21:03:42.971088] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:43.024205] [DEBUG] [LOCAL ] DV: Loaded 51241 existing records from primary storage. [2025-10-23T21:03:43.024591] [INFO ] [MAIN ] DV: Loaded 51241 existing records. [2025-10-23T21:03:43.204973] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-23T21:03:43.204908] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:03:43.206030] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-23T21:03:43.206107] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-23T21:03:43.206543] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-23T21:03:43.206617] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-23T21:03:43.586053] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:43.999415] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-23T21:03:44.485413] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T21:03:44.799421] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-23T21:03:44.970902] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T21:03:45.599439] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-23T21:03:45.727110] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T21:03:46.399420] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-23T21:03:46.441075] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T21:03:46.998496] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T21:03:47.199424] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-23T21:03:47.999423] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-23T21:03:48.228841] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:03:48.799426] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-23T21:03:49.243678] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T21:03:49.599425] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-23T21:03:49.847369] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T21:03:50.399449] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-23T21:03:50.409933] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T21:03:50.631129] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T21:03:51.199493] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-23T21:03:51.999467] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-23T21:03:52.488564] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-23T21:03:52.799440] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-23T21:03:52.997544] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T21:03:53.025284] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:03:53.599445] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-23T21:03:54.399428] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-23T21:03:54.431269] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T21:03:54.574914] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T21:03:54.584119] [INFO ] [REMOTE ] DUK: Full fetch complete (77563 records). [2025-10-23T21:03:54.584296] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-23T21:03:54.968689] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-23T21:03:54.968822] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-23T21:03:54.969809] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-23T21:03:54.969905] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-23T21:03:54.971410] [DEBUG] [LOCAL ] DUK: Trimmed 77563 records to 53818 (keeping 200 days of data) [2025-10-23T21:03:55.199590] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-23T21:03:55.303347] [DEBUG] [LOCAL ] DUK: Primary data saved (53818 records). [2025-10-23T21:03:55.303534] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-23T21:03:55.303670] [INFO ] [MAIN ] Update Progress: 665/2367 symbols completed. DUK took 32.9s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-23T21:03:55.475639] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:55.512539] [DEBUG] [LOCAL ] DVA: Loaded 40649 existing records from primary storage. [2025-10-23T21:03:55.512872] [INFO ] [MAIN ] DVA: Loaded 40649 existing records. [2025-10-23T21:03:55.689432] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:03:55.689680] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-23T21:03:55.689758] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-23T21:03:55.690037] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-23T21:03:55.690111] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-23T21:03:55.975054] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T21:03:56.004506] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-23T21:03:56.056388] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:56.230497] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T21:03:56.238593] [INFO ] [REMOTE ] DTM: Full fetch complete (65205 records). [2025-10-23T21:03:56.238814] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-23T21:03:56.630059] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-23T21:03:56.630191] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-23T21:03:56.631060] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-23T21:03:56.631151] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-23T21:03:56.632450] [DEBUG] [LOCAL ] DTM: Trimmed 65205 records to 44045 (keeping 200 days of data) [2025-10-23T21:03:56.744802] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T21:03:56.817710] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-23T21:03:56.912182] [DEBUG] [LOCAL ] DTM: Primary data saved (44045 records). [2025-10-23T21:03:56.912339] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-23T21:03:56.912449] [INFO ] [MAIN ] Update Progress: 666/2367 symbols completed. DTM took 40.5s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min [2025-10-23T21:03:57.079773] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:03:57.079956] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-23T21:03:57.080040] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-23T21:03:57.080158] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-23T21:03:57.080232] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-23T21:03:57.080294] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-23T21:03:57.080356] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-23T21:03:57.435381] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:03:57.563176] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T21:03:57.599396] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-23T21:03:58.399429] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-23T21:03:59.199455] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-23T21:03:59.886465] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-23T21:03:59.931748] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T21:03:59.933104] [INFO ] [REMOTE ] DUKB: Full fetch complete (8963 records). [2025-10-23T21:03:59.933192] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-23T21:04:00.006535] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-23T21:04:00.297193] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-23T21:04:00.297398] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-23T21:04:00.297769] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-23T21:04:00.297899] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-23T21:04:00.298580] [DEBUG] [LOCAL ] DUKB: Trimmed 8963 records to 6161 (keeping 200 days of data) [2025-10-23T21:04:00.357880] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T21:04:00.375555] [DEBUG] [LOCAL ] DUKB: Primary data saved (6161 records). [2025-10-23T21:04:00.375703] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-23T21:04:00.375813] [INFO ] [MAIN ] Update Progress: 667/2367 symbols completed. DUKB took 22.4s. Estimated remaining: 3h 33m 56s. Rate: 7.9 symbols/min [2025-10-23T21:04:00.541422] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:00.541620] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-23T21:04:00.541717] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-23T21:04:00.541845] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-23T21:04:00.541916] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-23T21:04:00.542002] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-23T21:04:00.542071] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-23T21:04:00.806164] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-23T21:04:00.895923] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:01.599455] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-23T21:04:02.399407] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-23T21:04:02.717883] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-23T21:04:03.199496] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-23T21:04:03.804034] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-23T21:04:03.952238] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (3.15 seconds). [2025-10-23T21:04:03.999405] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-23T21:04:04.193151] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T21:04:04.799416] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-23T21:04:05.502508] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-23T21:04:05.599411] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-23T21:04:05.905940] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T21:04:06.399448] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-23T21:04:06.707543] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T21:04:07.199543] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-23T21:04:08.000112] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-23T21:04:08.002869] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-23T21:04:08.222619] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T21:04:08.799405] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-23T21:04:09.296632] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-23T21:04:09.599528] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-23T21:04:09.905115] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T21:04:10.399459] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-23T21:04:11.139864] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-23T21:04:11.199406] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-23T21:04:11.412533] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T21:04:11.999414] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-23T21:04:12.147948] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:04:12.799450] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-23T21:04:13.014132] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T21:04:13.599428] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-23T21:04:13.885182] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T21:04:14.399424] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-23T21:04:15.013755] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-23T21:04:15.199440] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-23T21:04:15.804422] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T21:04:15.999447] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-23T21:04:16.132293] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T21:04:16.799401] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-23T21:04:17.225048] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T21:04:17.599437] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-23T21:04:17.785452] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T21:04:18.321953] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T21:04:18.399425] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-23T21:04:19.199425] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-23T21:04:19.805630] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-23T21:04:19.999430] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-23T21:04:20.123354] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T21:04:20.799440] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-23T21:04:20.978905] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:04:21.599485] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-23T21:04:21.900964] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T21:04:22.399836] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-23T21:04:22.977363] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T21:04:23.199427] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-23T21:04:23.528693] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T21:04:23.999430] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-23T21:04:24.802750] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-23T21:04:24.805537] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-23T21:04:24.816782] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-23T21:04:24.816958] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-23T21:04:25.240846] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T21:04:25.273226] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-23T21:04:25.273410] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-23T21:04:25.274789] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-23T21:04:25.274903] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-23T21:04:25.276590] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 54089 (keeping 200 days of data) [2025-10-23T21:04:25.600305] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-23T21:04:25.600015] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T21:04:25.618086] [INFO ] [REMOTE ] DV: Full fetch complete (73895 records). [2025-10-23T21:04:25.621373] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-23T21:04:25.633459] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-23T21:04:25.633556] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-23T21:04:25.633703] [INFO ] [MAIN ] Update Progress: 668/2367 symbols completed. DVN took 28.7s. Estimated remaining: 3h 34m 33s. Rate: 7.9 symbols/min [2025-10-23T21:04:26.082437] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:26.246467] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-23T21:04:26.246620] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-23T21:04:26.247869] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-23T21:04:26.248096] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-23T21:04:26.250469] [DEBUG] [LOCAL ] DV: Trimmed 73895 records to 51625 (keeping 200 days of data) [2025-10-23T21:04:26.571349] [DEBUG] [LOCAL ] DXC: Loaded 49919 existing records from primary storage. [2025-10-23T21:04:26.573056] [INFO ] [MAIN ] DXC: Loaded 49919 existing records. [2025-10-23T21:04:26.918565] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:04:26.922826] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-23T21:04:26.926004] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-23T21:04:26.941278] [DEBUG] [LOCAL ] DV: Primary data saved (51625 records). [2025-10-23T21:04:26.941747] [INFO ] [MAIN ] DV: Full history saved. [2025-10-23T21:04:26.943889] [INFO ] [MAIN ] Update Progress: 669/2367 symbols completed. DV took 44.1s. Estimated remaining: 3h 34m 10s. Rate: 7.9 symbols/min [2025-10-23T21:04:26.949547] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-23T21:04:26.994204] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-23T21:04:27.097701] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-23T21:04:27.238391] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-23T21:04:27.393168] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:27.604517] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:27.605038] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-23T21:04:27.622849] [DEBUG] [LOCAL ] DXYZ: Loaded 37126 existing records from primary storage. [2025-10-23T21:04:27.623215] [INFO ] [MAIN ] DXYZ: Loaded 37126 existing records. [2025-10-23T21:04:27.817563] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:04:27.817873] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-23T21:04:27.817989] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-23T21:04:27.818357] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-23T21:04:27.818473] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-23T21:04:27.970974] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-23T21:04:28.041110] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-23T21:04:28.240009] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:28.799445] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-23T21:04:28.890948] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T21:04:29.233557] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T21:04:29.599437] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-23T21:04:29.806860] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T21:04:29.816184] [INFO ] [REMOTE ] DX: Full fetch complete (75908 records). [2025-10-23T21:04:29.816330] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-23T21:04:30.202890] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-23T21:04:30.203015] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-23T21:04:30.203962] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-23T21:04:30.204040] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-23T21:04:30.205512] [DEBUG] [LOCAL ] DX: Trimmed 75908 records to 52920 (keeping 200 days of data) [2025-10-23T21:04:30.410505] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-23T21:04:30.523287] [DEBUG] [LOCAL ] DX: Primary data saved (52920 records). [2025-10-23T21:04:30.523438] [INFO ] [MAIN ] DX: Full history saved. [2025-10-23T21:04:30.523541] [INFO ] [MAIN ] Update Progress: 670/2367 symbols completed. DX took 30.1s. Estimated remaining: 3h 33m 52s. Rate: 7.9 symbols/min [2025-10-23T21:04:30.690918] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:30.717948] [DEBUG] [LOCAL ] DY: Loaded 28046 existing records from primary storage. [2025-10-23T21:04:30.722009] [INFO ] [MAIN ] DY: Loaded 28046 existing records. [2025-10-23T21:04:30.902123] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:04:30.902469] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-23T21:04:30.902555] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-23T21:04:30.902973] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-23T21:04:30.903077] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-23T21:04:31.235256] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-23T21:04:31.281232] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-23T21:04:31.313251] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:31.332268] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T21:04:31.339321] [INFO ] [REMOTE ] DVA: Full fetch complete (59638 records). [2025-10-23T21:04:31.339472] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-23T21:04:31.714326] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-23T21:04:31.714433] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-23T21:04:31.715446] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-23T21:04:31.715528] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-23T21:04:31.716729] [DEBUG] [LOCAL ] DVA: Trimmed 59638 records to 40950 (keeping 200 days of data) [2025-10-23T21:04:31.965778] [DEBUG] [LOCAL ] DVA: Primary data saved (40950 records). [2025-10-23T21:04:31.965918] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-23T21:04:31.967090] [INFO ] [MAIN ] Update Progress: 671/2367 symbols completed. DVA took 36.7s. Estimated remaining: 3h 33m 29s. Rate: 7.9 symbols/min [2025-10-23T21:04:32.011904] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-23T21:04:32.146195] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:32.146776] [DEBUG] [LOCAL ] E: No existing data file found in primary storage. [2025-10-23T21:04:32.146928] [WARN ] [MAIN ] E: No existing data found, performing full refresh instead. [2025-10-23T21:04:32.147163] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-23T21:04:32.147305] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-23T21:04:32.147565] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-23T21:04:32.155591] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-23T21:04:32.241930] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T21:04:32.536356] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:32.799464] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-23T21:04:33.557262] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-23T21:04:33.599400] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-23T21:04:33.650515] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T21:04:33.906935] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T21:04:34.399436] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-23T21:04:35.199452] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-23T21:04:35.724814] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T21:04:35.966915] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T21:04:35.999397] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-23T21:04:36.799417] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-23T21:04:36.941489] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T21:04:37.599487] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-23T21:04:37.718225] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T21:04:38.158390] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T21:04:38.399416] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-23T21:04:39.199422] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-23T21:04:39.374264] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T21:04:39.926004] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T21:04:39.999415] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-23T21:04:40.799414] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-23T21:04:41.289609] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T21:04:41.422424] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T21:04:41.599436] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-23T21:04:42.399434] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-23T21:04:42.708354] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T21:04:43.199448] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-23T21:04:43.516196] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T21:04:43.584628] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T21:04:43.999487] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-23T21:04:44.799502] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-23T21:04:44.836166] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T21:04:45.604585] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-23T21:04:45.614614] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T21:04:46.399425] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-23T21:04:46.654221] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T21:04:47.199502] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-23T21:04:47.325953] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T21:04:47.999417] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-23T21:04:48.085760] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:04:48.799434] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-23T21:04:49.126445] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T21:04:49.599451] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-23T21:04:49.731077] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T21:04:50.244906] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-23T21:04:50.399437] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-23T21:04:51.028745] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T21:04:51.199434] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-23T21:04:51.752442] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T21:04:51.999432] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-23T21:04:52.363037] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T21:04:52.799457] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-23T21:04:53.599434] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-23T21:04:53.831494] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:04:54.330178] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T21:04:54.399417] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-23T21:04:55.199412] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-23T21:04:55.645713] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T21:04:55.924318] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T21:04:55.999424] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-23T21:04:56.799421] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-23T21:04:57.059248] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-23T21:04:57.068036] [INFO ] [REMOTE ] DXC: Full fetch complete (70329 records). [2025-10-23T21:04:57.068194] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-23T21:04:57.198048] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T21:04:57.243706] [INFO ] [REMOTE ] DY: Full fetch complete (43190 records). [2025-10-23T21:04:57.262272] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-23T21:04:57.663599] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-23T21:04:57.745380] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-23T21:04:57.771833] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-23T21:04:57.772999] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-23T21:04:57.804574] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-23T21:04:57.898413] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-23T21:04:57.895865] [DEBUG] [LOCAL ] DXC: Trimmed 70329 records to 50264 (keeping 200 days of data) [2025-10-23T21:04:57.898574] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-23T21:04:57.899365] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-23T21:04:57.899681] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-23T21:04:57.947621] [DEBUG] [LOCAL ] DY: Trimmed 43190 records to 28151 (keeping 200 days of data) [2025-10-23T21:04:58.285326] [DEBUG] [LOCAL ] DY: Primary data saved (28151 records). [2025-10-23T21:04:58.290741] [INFO ] [MAIN ] DY: Full history saved. [2025-10-23T21:04:58.290886] [INFO ] [MAIN ] Update Progress: 672/2367 symbols completed. DY took 27.8s. Estimated remaining: 3h 34m 9s. Rate: 7.9 symbols/min [2025-10-23T21:04:58.323114] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T21:04:58.428980] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-23T21:04:58.577726] [DEBUG] [LOCAL ] DXC: Primary data saved (50264 records). [2025-10-23T21:04:58.571112] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:58.577863] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-23T21:04:58.578060] [INFO ] [MAIN ] Update Progress: 673/2367 symbols completed. DXC took 32.9s. Estimated remaining: 3h 33m 43s. Rate: 7.9 symbols/min [2025-10-23T21:04:58.578136] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-23T21:04:58.578389] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-23T21:04:58.610286] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-23T21:04:58.648907] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-23T21:04:58.654883] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-23T21:04:58.654968] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-23T21:04:58.885395] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:04:58.910393] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-23T21:04:58.916127] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-23T21:04:58.917254] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-23T21:04:58.918094] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-23T21:04:58.918949] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-23T21:04:58.919037] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-23T21:04:59.344783] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:59.386776] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-23T21:04:59.536094] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:04:59.648281] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T21:04:59.908758] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-23T21:04:59.999415] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-23T21:05:00.799477] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-23T21:05:01.400860] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-23T21:05:01.599514] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-23T21:05:02.399418] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-23T21:05:02.467068] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-23T21:05:02.474430] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56632 records). [2025-10-23T21:05:02.474585] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-23T21:05:02.671990] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T21:05:02.782749] [INFO ] [REMOTE ] E: Full fetch complete (47609 records). [2025-10-23T21:05:02.805249] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-23T21:05:03.060780] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-23T21:05:03.116669] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-23T21:05:03.182740] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-23T21:05:03.190132] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-23T21:05:03.269732] [DEBUG] [LOCAL ] DXYZ: Trimmed 56632 records to 37304 (keeping 200 days of data) [2025-10-23T21:05:03.314299] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-23T21:05:03.315049] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-23T21:05:03.316083] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-23T21:05:03.423826] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-23T21:05:03.431452] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T21:05:03.443866] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T21:05:03.446913] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-23T21:05:03.449923] [DEBUG] [LOCAL ] E: Trimmed 47609 records to 33399 (keeping 200 days of data) [2025-10-23T21:05:03.782949] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37304 records). [2025-10-23T21:05:03.789234] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-23T21:05:03.789117] [DEBUG] [LOCAL ] E: Primary data saved (33399 records). [2025-10-23T21:05:03.789586] [INFO ] [MAIN ] E: Full history saved. [2025-10-23T21:05:03.789480] [INFO ] [MAIN ] Update Progress: 674/2367 symbols completed. DXYZ took 36.8s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-10-23T21:05:03.790043] [INFO ] [MAIN ] Update Progress: 675/2367 symbols completed. E took 31.8s. Estimated remaining: 3h 33m 3s. Rate: 7.9 symbols/min [2025-10-23T21:05:04.004586] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-23T21:05:04.160610] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:04.164884] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-23T21:05:04.164555] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:04.165037] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-23T21:05:04.165596] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-23T21:05:04.165703] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-23T21:05:04.165787] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-23T21:05:04.165858] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-23T21:05:04.228888] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T21:05:04.548772] [DEBUG] [LOCAL ] EAT: Loaded 49719 existing records from primary storage. [2025-10-23T21:05:04.569247] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:04.569741] [INFO ] [MAIN ] EAT: Loaded 49719 existing records. [2025-10-23T21:05:04.748014] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:05:04.748256] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-23T21:05:04.748332] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-23T21:05:04.748715] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-23T21:05:04.748789] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-23T21:05:04.810897] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-23T21:05:05.104094] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:05.599416] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-23T21:05:05.951985] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T21:05:06.127427] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T21:05:06.388209] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T21:05:06.399388] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-23T21:05:07.199421] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-23T21:05:07.265465] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T21:05:07.999442] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-23T21:05:08.799424] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-23T21:05:08.854906] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:05:08.855512] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T21:05:09.599433] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-23T21:05:10.399423] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-23T21:05:10.861522] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T21:05:11.199412] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-23T21:05:11.346576] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:05:11.867446] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T21:05:11.936753] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T21:05:11.999401] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-23T21:05:12.753546] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T21:05:12.799406] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-23T21:05:13.599439] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-23T21:05:14.399409] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-23T21:05:14.788010] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T21:05:14.934140] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T21:05:15.066358] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T21:05:15.199430] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-23T21:05:15.999447] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-23T21:05:16.784929] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:05:16.799411] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-23T21:05:17.251897] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T21:05:17.599438] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-23T21:05:18.303867] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T21:05:18.305185] [INFO ] [REMOTE ] EAI: Full fetch complete (5836 records). [2025-10-23T21:05:18.305294] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-23T21:05:18.409896] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-23T21:05:18.581221] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T21:05:18.717953] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-23T21:05:18.718328] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-23T21:05:18.718615] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-23T21:05:18.718730] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-23T21:05:18.719320] [DEBUG] [LOCAL ] EAI: Trimmed 5836 records to 3938 (keeping 200 days of data) [2025-10-23T21:05:18.747866] [DEBUG] [LOCAL ] EAI: Primary data saved (3938 records). [2025-10-23T21:05:18.748064] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-23T21:05:18.748197] [INFO ] [MAIN ] Update Progress: 676/2367 symbols completed. EAI took 20.2s. Estimated remaining: 3h 33m 14s. Rate: 7.9 symbols/min [2025-10-23T21:05:19.033847] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:19.035096] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-23T21:05:19.035191] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-23T21:05:19.035376] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-23T21:05:19.035464] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-23T21:05:19.035575] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-23T21:05:19.035686] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-23T21:05:19.204743] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-23T21:05:19.596440] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:19.999451] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-23T21:05:20.315981] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T21:05:20.751800] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:05:20.799430] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-23T21:05:21.599462] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-23T21:05:21.808730] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T21:05:22.340532] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T21:05:22.399447] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-23T21:05:22.911246] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T21:05:23.199437] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-23T21:05:23.924174] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T21:05:23.999472] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-23T21:05:24.702248] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T21:05:24.799470] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-23T21:05:25.599432] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-23T21:05:25.671368] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T21:05:26.081261] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T21:05:26.399462] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-23T21:05:27.199423] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-23T21:05:27.377222] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:05:27.436739] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T21:05:27.999445] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-23T21:05:28.799439] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-23T21:05:29.332097] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T21:05:29.423715] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T21:05:29.428957] [INFO ] [REMOTE ] EARN: Full fetch complete (45181 records). [2025-10-23T21:05:29.429081] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-23T21:05:29.605205] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-23T21:05:29.806956] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-23T21:05:29.807068] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-23T21:05:29.807767] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-23T21:05:29.807846] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-23T21:05:29.808787] [DEBUG] [LOCAL ] EARN: Trimmed 45181 records to 27875 (keeping 200 days of data) [2025-10-23T21:05:29.975813] [DEBUG] [LOCAL ] EARN: Primary data saved (27875 records). [2025-10-23T21:05:29.976000] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-23T21:05:29.976109] [INFO ] [MAIN ] Update Progress: 677/2367 symbols completed. EARN took 26.2s. Estimated remaining: 3h 33m 16s. Rate: 7.9 symbols/min [2025-10-23T21:05:30.399556] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-23T21:05:30.457534] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T21:05:31.199424] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-23T21:05:31.586778] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T21:05:31.880221] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T21:05:31.999462] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-23T21:05:32.711060] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T21:05:32.799422] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-23T21:05:33.599419] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-23T21:05:34.094316] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-23T21:05:34.334392] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:05:34.399437] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-23T21:05:34.938121] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T21:05:34.943470] [INFO ] [REMOTE ] EAF: Full fetch complete (61869 records). [2025-10-23T21:05:34.943616] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-23T21:05:35.210988] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-23T21:05:35.371557] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-23T21:05:35.371693] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-23T21:05:35.372546] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-23T21:05:35.372624] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-23T21:05:35.373986] [DEBUG] [LOCAL ] EAF: Trimmed 61869 records to 41113 (keeping 200 days of data) [2025-10-23T21:05:35.601597] [DEBUG] [LOCAL ] EAF: Primary data saved (41113 records). [2025-10-23T21:05:35.601774] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-23T21:05:35.601877] [INFO ] [MAIN ] Update Progress: 678/2367 symbols completed. EAF took 37.3s. Estimated remaining: 3h 33m 3s. Rate: 7.9 symbols/min [2025-10-23T21:05:35.957146] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T21:05:35.999433] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-23T21:05:37.333224] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T21:05:37.343784] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-23T21:05:37.709443] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T21:05:37.717919] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-23T21:05:39.226709] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T21:05:39.237827] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-23T21:05:39.363812] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T21:05:39.371888] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-23T21:05:40.839782] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:05:40.846923] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-23T21:05:41.124090] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T21:05:41.132996] [INFO ] [REMOTE ] EAT: Full fetch complete (72428 records). [2025-10-23T21:05:41.133189] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-23T21:05:41.528372] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-23T21:05:41.528513] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-23T21:05:41.529453] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-23T21:05:41.529549] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-23T21:05:41.531020] [DEBUG] [LOCAL ] EAT: Trimmed 72428 records to 50090 (keeping 200 days of data) [2025-10-23T21:05:41.833858] [DEBUG] [LOCAL ] EAT: Primary data saved (50090 records). [2025-10-23T21:05:41.834021] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-23T21:05:41.835062] [INFO ] [MAIN ] Update Progress: 679/2367 symbols completed. EAT took 38.0s. Estimated remaining: 3h 32m 52s. Rate: 7.9 symbols/min [2025-10-23T21:05:41.864683] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T21:05:41.870887] [INFO ] [REMOTE ] EB: Full fetch complete (54919 records). [2025-10-23T21:05:41.871047] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-23T21:05:42.297935] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-23T21:05:42.298084] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-23T21:05:42.298995] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-23T21:05:42.299074] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-23T21:05:42.300422] [DEBUG] [LOCAL ] EB: Trimmed 54919 records to 36426 (keeping 200 days of data) [2025-10-23T21:05:42.520366] [DEBUG] [LOCAL ] EB: Primary data saved (36426 records). [2025-10-23T21:05:42.520553] [INFO ] [MAIN ] EB: Full history saved. [2025-10-23T21:05:42.520681] [INFO ] [MAIN ] Update Progress: 680/2367 symbols completed. EB took 23.8s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-10-23T21:05:43.177842] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:43.261301] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:43.225537] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:43.262489] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:05:43.265217] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-23T21:05:43.265797] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-23T21:05:43.266028] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-23T21:05:43.266101] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-23T21:05:43.266239] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-23T21:05:43.266373] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-23T21:05:43.466399] [DEBUG] [LOCAL ] EBF: Loaded 19250 existing records from primary storage. [2025-10-23T21:05:43.530108] [INFO ] [MAIN ] EBF: Loaded 19250 existing records. [2025-10-23T21:05:43.664037] [DEBUG] [LOCAL ] EBS: Loaded 46589 existing records from primary storage. [2025-10-23T21:05:43.691705] [DEBUG] [LOCAL ] EBR: Loaded 43347 existing records from primary storage. [2025-10-23T21:05:43.708006] [INFO ] [MAIN ] EBS: Loaded 46589 existing records. [2025-10-23T21:05:43.782149] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:43.788078] [INFO ] [MAIN ] EBR: Loaded 43347 existing records. [2025-10-23T21:05:43.804258] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-23T21:05:44.107105] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:05:44.118558] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-23T21:05:44.154677] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-23T21:05:44.229738] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-23T21:05:44.267533] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:05:44.238745] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:05:44.267947] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-23T21:05:44.268065] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-23T21:05:44.268111] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-23T21:05:44.268268] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-23T21:05:44.268368] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-23T21:05:44.311450] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-23T21:05:44.311708] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-23T21:05:44.377085] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-23T21:05:44.431193] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-23T21:05:45.330008] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:45.362994] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-23T21:05:45.339772] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:45.369984] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-23T21:05:45.443147] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:05:45.443459] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-23T21:05:45.901509] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T21:05:45.912014] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-23T21:05:46.547773] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T21:05:46.551410] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-23T21:05:47.232047] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T21:05:47.243701] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-23T21:05:47.246065] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T21:05:47.255301] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-23T21:05:47.348933] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-23T21:05:47.353523] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-23T21:05:47.799730] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T21:05:47.999431] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-23T21:05:48.410281] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T21:05:48.691603] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T21:05:48.801859] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-23T21:05:48.804043] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T21:05:49.599450] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-23T21:05:49.809944] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T21:05:50.030480] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T21:05:50.399442] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-23T21:05:51.199418] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-23T21:05:51.281720] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T21:05:51.999426] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-23T21:05:52.125935] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T21:05:52.374582] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T21:05:52.799418] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-23T21:05:53.599463] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-23T21:05:53.806840] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T21:05:54.399451] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-23T21:05:54.857386] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T21:05:54.911995] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-23T21:05:55.199438] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-23T21:05:55.999441] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-23T21:05:56.259215] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T21:05:56.799429] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-23T21:05:56.996159] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T21:05:57.599409] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-23T21:05:57.848563] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T21:05:58.399421] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-23T21:05:58.661685] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T21:05:58.760725] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T21:05:59.199431] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-23T21:05:59.999440] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-23T21:06:00.334595] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T21:06:00.799461] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-23T21:06:01.599419] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-23T21:06:01.917825] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-23T21:06:02.220988] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T21:06:02.399458] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-23T21:06:03.199423] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-23T21:06:03.213953] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T21:06:03.671949] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-23T21:06:03.999458] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-23T21:06:04.504197] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T21:06:04.799453] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-23T21:06:05.298013] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T21:06:05.599414] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-23T21:06:06.034853] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T21:06:06.399420] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-23T21:06:06.426602] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T21:06:07.199419] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-23T21:06:07.304160] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T21:06:07.537021] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T21:06:07.999437] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-23T21:06:08.799421] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-23T21:06:08.866455] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:06:08.874705] [INFO ] [REMOTE ] EBS: Full fetch complete (67356 records). [2025-10-23T21:06:08.874912] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-23T21:06:09.273199] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-23T21:06:09.273328] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-23T21:06:09.274376] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-23T21:06:09.274494] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-23T21:06:09.275951] [DEBUG] [LOCAL ] EBS: Trimmed 67356 records to 46902 (keeping 200 days of data) [2025-10-23T21:06:09.542201] [DEBUG] [LOCAL ] EBS: Primary data saved (46902 records). [2025-10-23T21:06:09.542373] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-23T21:06:09.542510] [INFO ] [MAIN ] Update Progress: 681/2367 symbols completed. EBS took 27.0s. Estimated remaining: 3h 33m 8s. Rate: 7.9 symbols/min [2025-10-23T21:06:09.604257] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-23T21:06:09.731360] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:09.761991] [DEBUG] [LOCAL ] ECAT: Loaded 29135 existing records from primary storage. [2025-10-23T21:06:09.762455] [INFO ] [MAIN ] ECAT: Loaded 29135 existing records. [2025-10-23T21:06:09.943007] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:06:09.943341] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-23T21:06:09.943580] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-23T21:06:09.943836] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-23T21:06:09.943914] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-23T21:06:10.109827] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-23T21:06:10.371276] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:10.399394] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-23T21:06:10.595793] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:06:10.827287] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T21:06:11.199466] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-23T21:06:11.526215] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T21:06:11.999486] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-23T21:06:12.634258] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T21:06:12.642805] [INFO ] [REMOTE ] EBR: Full fetch complete (62479 records). [2025-10-23T21:06:12.642962] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-23T21:06:12.804548] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-23T21:06:13.111158] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-23T21:06:13.111300] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-23T21:06:13.112564] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-23T21:06:13.112673] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-23T21:06:13.114090] [DEBUG] [LOCAL ] EBR: Trimmed 62479 records to 43686 (keeping 200 days of data) [2025-10-23T21:06:13.333979] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T21:06:13.341344] [INFO ] [REMOTE ] EBF: Full fetch complete (28362 records). [2025-10-23T21:06:13.342204] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-23T21:06:13.605036] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-23T21:06:13.691316] [DEBUG] [LOCAL ] EBR: Primary data saved (43686 records). [2025-10-23T21:06:13.702055] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-23T21:06:13.707894] [INFO ] [MAIN ] Update Progress: 682/2367 symbols completed. EBR took 31.2s. Estimated remaining: 3h 32m 52s. Rate: 7.9 symbols/min [2025-10-23T21:06:13.898487] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-23T21:06:13.908901] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-23T21:06:13.914816] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-23T21:06:13.928362] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-23T21:06:13.960148] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:13.960901] [DEBUG] [LOCAL ] EBF: Trimmed 28362 records to 19413 (keeping 200 days of data) [2025-10-23T21:06:14.094492] [DEBUG] [LOCAL ] EBF: Primary data saved (19413 records). [2025-10-23T21:06:14.106519] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-23T21:06:14.106767] [INFO ] [MAIN ] Update Progress: 683/2367 symbols completed. EBF took 31.6s. Estimated remaining: 3h 32m 27s. Rate: 7.9 symbols/min [2025-10-23T21:06:14.107318] [DEBUG] [LOCAL ] ECC: Loaded 43377 existing records from primary storage. [2025-10-23T21:06:14.144139] [INFO ] [MAIN ] ECC: Loaded 43377 existing records. [2025-10-23T21:06:14.488203] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:06:14.491289] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-23T21:06:14.500956] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-23T21:06:14.492540] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:14.513292] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-23T21:06:14.513387] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-23T21:06:14.514992] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-23T21:06:14.514601] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:06:14.514914] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-23T21:06:14.515437] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-23T21:06:14.543476] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-23T21:06:14.574085] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-23T21:06:14.605212] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-23T21:06:14.638634] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-23T21:06:15.246565] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:15.259765] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-23T21:06:15.351775] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:15.653419] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T21:06:15.661818] [INFO ] [REMOTE ] EC: Full fetch complete (71877 records). [2025-10-23T21:06:15.661972] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-23T21:06:16.004599] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-23T21:06:16.051429] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-23T21:06:16.051889] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-23T21:06:16.052965] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-23T21:06:16.053166] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-23T21:06:16.054593] [DEBUG] [LOCAL ] EC: Trimmed 71877 records to 49210 (keeping 200 days of data) [2025-10-23T21:06:16.281946] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T21:06:16.373562] [DEBUG] [LOCAL ] EC: Primary data saved (49210 records). [2025-10-23T21:06:16.373785] [INFO ] [MAIN ] EC: Full history saved. [2025-10-23T21:06:16.373900] [INFO ] [MAIN ] Update Progress: 684/2367 symbols completed. EC took 33.8s. Estimated remaining: 3h 32m 6s. Rate: 7.9 symbols/min [2025-10-23T21:06:16.544769] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:16.549602] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-23T21:06:16.555548] [DEBUG] [LOCAL ] ECCU: Loaded 2152 existing records from primary storage. [2025-10-23T21:06:16.555787] [INFO ] [MAIN ] ECCU: Loaded 2152 existing records. [2025-10-23T21:06:16.683059] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T21:06:16.768432] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:06:16.768629] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-23T21:06:16.768797] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-23T21:06:16.768967] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-23T21:06:16.769045] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-23T21:06:16.804615] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-23T21:06:17.131052] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:17.345081] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-23T21:06:17.599407] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-23T21:06:18.082364] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T21:06:18.399447] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-23T21:06:19.199454] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-23T21:06:19.668568] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-23T21:06:19.794223] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T21:06:19.999448] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-23T21:06:20.800812] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-23T21:06:20.805602] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T21:06:21.599463] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-23T21:06:22.138834] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T21:06:22.312603] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-23T21:06:22.399406] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-23T21:06:23.199418] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-23T21:06:23.293193] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T21:06:23.804512] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T21:06:23.999497] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-23T21:06:24.799444] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-23T21:06:25.505692] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T21:06:25.599391] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-23T21:06:25.690064] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T21:06:26.399437] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-23T21:06:26.823347] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T21:06:26.911411] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-23T21:06:27.199420] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-23T21:06:27.718335] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-23T21:06:27.999448] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-23T21:06:28.799454] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-23T21:06:29.437000] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T21:06:29.599492] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-23T21:06:30.052257] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-23T21:06:30.399432] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-23T21:06:30.619557] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T21:06:31.036431] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T21:06:31.199439] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-23T21:06:31.999459] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-23T21:06:32.799415] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-23T21:06:33.058344] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T21:06:33.338060] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T21:06:33.487452] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T21:06:33.599423] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-23T21:06:34.399435] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-23T21:06:35.008399] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T21:06:35.125579] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T21:06:35.199413] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-23T21:06:35.999461] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-23T21:06:36.427490] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-23T21:06:36.428368] [INFO ] [REMOTE ] ECCC: Full fetch complete (1304 records). [2025-10-23T21:06:36.428456] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-23T21:06:36.610267] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-23T21:06:36.610490] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:06:36.610560] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:06:36.610664] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-23T21:06:36.610772] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-23T21:06:36.610837] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-23T21:06:36.610918] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-23T21:06:36.611015] [INFO ] [MAIN ] Update Progress: 685/2367 symbols completed. ECCC took 22.5s. Estimated remaining: 3h 32m 30s. Rate: 7.9 symbols/min [2025-10-23T21:06:36.752693] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T21:06:36.799840] [INFO ] [REMOTE ] ECAT: Full fetch complete (42927 records). [2025-10-23T21:06:36.799745] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:36.799895] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-23T21:06:36.800208] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-23T21:06:36.800402] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-23T21:06:36.801341] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-23T21:06:36.801504] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-23T21:06:36.801562] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-23T21:06:36.832315] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-23T21:06:36.864850] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-23T21:06:37.528752] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-23T21:06:37.533674] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:37.533901] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-23T21:06:37.535061] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-23T21:06:37.535142] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-23T21:06:37.536380] [DEBUG] [LOCAL ] ECAT: Trimmed 42927 records to 29317 (keeping 200 days of data) [2025-10-23T21:06:37.623725] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-23T21:06:37.718502] [DEBUG] [LOCAL ] ECAT: Primary data saved (29317 records). [2025-10-23T21:06:37.718700] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-23T21:06:37.719980] [INFO ] [MAIN ] Update Progress: 686/2367 symbols completed. ECAT took 28.2s. Estimated remaining: 3h 32m 6s. Rate: 7.9 symbols/min [2025-10-23T21:06:37.896946] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:37.897186] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-23T21:06:37.897259] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-23T21:06:37.897369] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-23T21:06:37.897437] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-23T21:06:37.897522] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-23T21:06:37.897591] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-23T21:06:38.168149] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-23T21:06:38.280579] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:38.399425] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-23T21:06:38.548867] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:06:38.821058] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-23T21:06:39.199430] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-23T21:06:39.771363] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-23T21:06:39.999438] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-23T21:06:40.799464] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-23T21:06:41.230594] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T21:06:41.599540] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-23T21:06:41.822765] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T21:06:42.012932] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-23T21:06:42.399471] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-23T21:06:42.916553] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-23T21:06:43.199452] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-23T21:06:43.764710] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T21:06:43.999441] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-23T21:06:44.799431] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-23T21:06:45.311513] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-23T21:06:45.599440] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-23T21:06:46.016204] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T21:06:46.140689] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T21:06:46.399440] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-23T21:06:46.904547] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-23T21:06:47.199428] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-23T21:06:47.999475] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-23T21:06:48.628609] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T21:06:48.799405] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-23T21:06:48.966219] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:06:49.235031] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T21:06:49.599491] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-23T21:06:50.149230] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T21:06:50.399443] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-23T21:06:50.946324] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T21:06:51.199435] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-23T21:06:51.999437] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-23T21:06:52.509178] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T21:06:52.510099] [INFO ] [REMOTE ] ECCU: Full fetch complete (4141 records). [2025-10-23T21:06:52.510211] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-23T21:06:52.799538] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-23T21:06:52.919366] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-23T21:06:52.919501] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-23T21:06:52.919759] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-23T21:06:52.920007] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-23T21:06:52.920682] [DEBUG] [LOCAL ] ECCU: Trimmed 4141 records to 2156 (keeping 200 days of data) [2025-10-23T21:06:52.935276] [DEBUG] [LOCAL ] ECCU: Primary data saved (2156 records). [2025-10-23T21:06:52.935368] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-23T21:06:52.935475] [INFO ] [MAIN ] Update Progress: 687/2367 symbols completed. ECCU took 36.6s. Estimated remaining: 3h 32m 18s. Rate: 7.9 symbols/min [2025-10-23T21:06:53.149317] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:53.161047] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:06:53.200179] [DEBUG] [LOCAL ] ECG: Loaded 32780 existing records from primary storage. [2025-10-23T21:06:53.200472] [INFO ] [MAIN ] ECG: Loaded 32780 existing records. [2025-10-23T21:06:53.375990] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:06:53.376290] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-23T21:06:53.378695] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T21:06:53.378792] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-23T21:06:53.380110] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-23T21:06:53.380186] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-23T21:06:53.604711] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-23T21:06:53.728034] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:54.150390] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T21:06:54.399473] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-23T21:06:55.199468] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-23T21:06:55.686335] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-23T21:06:55.999441] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-23T21:06:56.038526] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T21:06:56.455840] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-23T21:06:56.456832] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-23T21:06:56.456925] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-23T21:06:56.648835] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-23T21:06:56.649130] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:06:56.649206] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:06:56.649285] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-23T21:06:56.649385] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-23T21:06:56.649460] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-23T21:06:56.649542] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-23T21:06:56.649683] [INFO ] [MAIN ] Update Progress: 688/2367 symbols completed. ECCW took 20.0s. Estimated remaining: 3h 32m 1s. Rate: 7.9 symbols/min [2025-10-23T21:06:56.800467] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-23T21:06:56.835475] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:06:56.888848] [DEBUG] [LOCAL ] ECL: Loaded 46689 existing records from primary storage. [2025-10-23T21:06:56.889362] [INFO ] [MAIN ] ECL: Loaded 46689 existing records. [2025-10-23T21:06:57.090135] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:06:57.090436] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-23T21:06:57.090518] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-23T21:06:57.090977] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-23T21:06:57.091058] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-23T21:06:57.386214] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T21:06:57.469616] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:06:57.599485] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-23T21:06:58.181693] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T21:06:58.399455] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-23T21:06:59.199427] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-23T21:06:59.999445] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-23T21:07:00.143543] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T21:07:00.586301] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T21:07:00.799449] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-23T21:07:01.577738] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-23T21:07:01.586029] [INFO ] [REMOTE ] ECC: Full fetch complete (61607 records). [2025-10-23T21:07:01.586270] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-23T21:07:01.609153] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-23T21:07:01.868169] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T21:07:02.001050] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-23T21:07:02.001192] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-23T21:07:02.002189] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-23T21:07:02.002295] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-23T21:07:02.003742] [DEBUG] [LOCAL ] ECC: Trimmed 61607 records to 43660 (keeping 200 days of data) [2025-10-23T21:07:02.259715] [DEBUG] [LOCAL ] ECC: Primary data saved (43660 records). [2025-10-23T21:07:02.259904] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-23T21:07:02.260035] [INFO ] [MAIN ] Update Progress: 689/2367 symbols completed. ECC took 48.5s. Estimated remaining: 3h 31m 48s. Rate: 7.9 symbols/min [2025-10-23T21:07:02.409143] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-23T21:07:02.442317] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:02.461555] [DEBUG] [LOCAL ] ECO: Loaded 18017 existing records from primary storage. [2025-10-23T21:07:02.461856] [INFO ] [MAIN ] ECO: Loaded 18017 existing records. [2025-10-23T21:07:02.648245] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:02.648484] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-23T21:07:02.648566] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-23T21:07:02.648803] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-23T21:07:02.648879] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-23T21:07:03.031023] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:03.199438] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-23T21:07:03.469207] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T21:07:03.753730] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-23T21:07:03.754594] [INFO ] [REMOTE ] ECCX: Full fetch complete (1461 records). [2025-10-23T21:07:03.754728] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-23T21:07:03.934470] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-23T21:07:03.934717] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:07:03.934807] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:07:03.934901] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-23T21:07:03.935014] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-23T21:07:03.935104] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-23T21:07:03.935214] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-23T21:07:03.935328] [INFO ] [MAIN ] Update Progress: 690/2367 symbols completed. ECCX took 26.2s. Estimated remaining: 3h 31m 26s. Rate: 7.9 symbols/min [2025-10-23T21:07:04.004588] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-23T21:07:04.111547] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:04.155442] [DEBUG] [LOCAL ] ECVT: Loaded 43112 existing records from primary storage. [2025-10-23T21:07:04.155829] [INFO ] [MAIN ] ECVT: Loaded 43112 existing records. [2025-10-23T21:07:04.340545] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:04.340957] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-23T21:07:04.341127] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-23T21:07:04.341413] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-23T21:07:04.341488] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-23T21:07:04.669462] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-23T21:07:04.760508] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:04.799437] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-23T21:07:05.599457] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-23T21:07:05.811699] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T21:07:06.324858] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T21:07:06.399406] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-23T21:07:06.813199] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:07:07.199466] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-23T21:07:07.920962] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T21:07:07.999406] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-23T21:07:08.690147] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T21:07:08.799419] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-23T21:07:09.599420] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-23T21:07:09.841807] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T21:07:10.399410] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-23T21:07:10.762593] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T21:07:10.947553] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T21:07:11.199434] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-23T21:07:11.999413] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-23T21:07:12.145154] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:07:12.453681] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T21:07:12.799448] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-23T21:07:13.599489] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-23T21:07:14.236619] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T21:07:14.306337] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T21:07:14.399467] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-23T21:07:15.199425] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-23T21:07:15.259794] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T21:07:15.999448] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-23T21:07:16.799446] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-23T21:07:16.823458] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T21:07:16.857946] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-23T21:07:17.599435] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-23T21:07:17.666968] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T21:07:18.154624] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T21:07:18.399503] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-23T21:07:19.044921] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T21:07:19.199486] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-23T21:07:19.585867] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T21:07:19.999546] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-23T21:07:20.799508] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-23T21:07:20.924248] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T21:07:21.599509] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-23T21:07:21.815415] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T21:07:22.341172] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T21:07:22.399432] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-23T21:07:22.913985] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T21:07:23.199535] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-23T21:07:23.999451] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-23T21:07:24.257783] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T21:07:24.715185] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T21:07:24.799463] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-23T21:07:24.909893] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T21:07:25.599499] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-23T21:07:26.211547] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T21:07:26.217868] [INFO ] [REMOTE ] ECG: Full fetch complete (50808 records). [2025-10-23T21:07:26.218156] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-23T21:07:26.405280] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-23T21:07:26.616742] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-23T21:07:26.616903] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-23T21:07:26.618340] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-23T21:07:26.618426] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-23T21:07:26.620099] [DEBUG] [LOCAL ] ECG: Trimmed 50808 records to 32971 (keeping 200 days of data) [2025-10-23T21:07:26.847591] [DEBUG] [LOCAL ] ECG: Primary data saved (32971 records). [2025-10-23T21:07:26.847838] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-23T21:07:26.848014] [INFO ] [MAIN ] Update Progress: 691/2367 symbols completed. ECG took 33.9s. Estimated remaining: 3h 31m 56s. Rate: 7.9 symbols/min [2025-10-23T21:07:27.028255] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:27.084947] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T21:07:27.107165] [DEBUG] [LOCAL ] ED: Loaded 52572 existing records from primary storage. [2025-10-23T21:07:27.107619] [INFO ] [MAIN ] ED: Loaded 52572 existing records. [2025-10-23T21:07:27.208943] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-23T21:07:27.360577] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:27.360948] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-23T21:07:27.361034] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-23T21:07:27.361638] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-23T21:07:27.361777] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-23T21:07:27.751814] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:27.999480] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-23T21:07:28.148412] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T21:07:28.799439] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-23T21:07:29.141681] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T21:07:29.599492] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-23T21:07:30.019291] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T21:07:30.116508] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T21:07:30.399489] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-23T21:07:31.199493] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-23T21:07:31.564447] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:07:31.787362] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T21:07:31.973890] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T21:07:31.999416] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-23T21:07:32.799422] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-23T21:07:33.168985] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T21:07:33.172901] [INFO ] [REMOTE ] ECO: Full fetch complete (28344 records). [2025-10-23T21:07:33.173009] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-23T21:07:33.560054] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-23T21:07:33.560236] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-23T21:07:33.561429] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-23T21:07:33.561517] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-23T21:07:33.563966] [DEBUG] [LOCAL ] ECO: Trimmed 28344 records to 18178 (keeping 200 days of data) [2025-10-23T21:07:33.612456] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-23T21:07:33.686719] [DEBUG] [LOCAL ] ECO: Primary data saved (18178 records). [2025-10-23T21:07:33.686979] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-23T21:07:33.687125] [INFO ] [MAIN ] Update Progress: 692/2367 symbols completed. ECO took 31.4s. Estimated remaining: 3h 31m 47s. Rate: 7.9 symbols/min [2025-10-23T21:07:33.871792] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:33.900350] [DEBUG] [LOCAL ] EDD: Loaded 27270 existing records from primary storage. [2025-10-23T21:07:33.900801] [INFO ] [MAIN ] EDD: Loaded 27270 existing records. [2025-10-23T21:07:34.096394] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:34.096721] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-23T21:07:34.096807] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-23T21:07:34.097140] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-23T21:07:34.097219] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-23T21:07:34.404706] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-23T21:07:34.471745] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:34.637084] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T21:07:34.646432] [INFO ] [REMOTE ] ECL: Full fetch complete (68402 records). [2025-10-23T21:07:34.646770] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-23T21:07:35.050181] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-23T21:07:35.050378] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-23T21:07:35.052101] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-23T21:07:35.052190] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-23T21:07:35.054185] [DEBUG] [LOCAL ] ECL: Trimmed 68402 records to 47048 (keeping 200 days of data) [2025-10-23T21:07:35.245954] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-23T21:07:35.368959] [DEBUG] [LOCAL ] ECL: Primary data saved (47048 records). [2025-10-23T21:07:35.369260] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-23T21:07:35.371066] [INFO ] [MAIN ] Update Progress: 693/2367 symbols completed. ECL took 38.7s. Estimated remaining: 3h 31m 25s. Rate: 7.9 symbols/min [2025-10-23T21:07:35.551821] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:35.570246] [DEBUG] [LOCAL ] EDF: Loaded 12838 existing records from primary storage. [2025-10-23T21:07:35.570601] [INFO ] [MAIN ] EDF: Loaded 12838 existing records. [2025-10-23T21:07:35.772721] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:35.773427] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-23T21:07:35.773736] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-23T21:07:35.774120] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-23T21:07:35.774469] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-23T21:07:35.951784] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T21:07:35.959938] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-23T21:07:36.040407] [INFO ] [REMOTE ] ECVT: Full fetch complete (60428 records). [2025-10-23T21:07:36.032277] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-23T21:07:36.046435] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-23T21:07:36.459045] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:36.635491] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T21:07:36.732439] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-23T21:07:36.732582] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-23T21:07:36.733711] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-23T21:07:36.733794] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-23T21:07:36.735551] [DEBUG] [LOCAL ] ECVT: Trimmed 60428 records to 43397 (keeping 200 days of data) [2025-10-23T21:07:36.819080] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-23T21:07:37.016245] [DEBUG] [LOCAL ] ECVT: Primary data saved (43397 records). [2025-10-23T21:07:37.016444] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-23T21:07:37.017581] [INFO ] [MAIN ] Update Progress: 694/2367 symbols completed. ECVT took 33.1s. Estimated remaining: 3h 31m 3s. Rate: 7.9 symbols/min [2025-10-23T21:07:37.210055] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:37.233581] [DEBUG] [LOCAL ] EDN: Loaded 19304 existing records from primary storage. [2025-10-23T21:07:37.233922] [INFO ] [MAIN ] EDN: Loaded 19304 existing records. [2025-10-23T21:07:37.450331] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:37.450567] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-23T21:07:37.450701] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-23T21:07:37.450904] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-23T21:07:37.450978] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-23T21:07:37.604689] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-23T21:07:37.861951] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:37.962208] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T21:07:38.184345] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-23T21:07:38.399481] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-23T21:07:38.965496] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T21:07:39.199409] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-23T21:07:39.475933] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T21:07:39.999466] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-23T21:07:40.502033] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-23T21:07:40.799473] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-23T21:07:41.599501] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-23T21:07:41.771829] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T21:07:42.368417] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T21:07:42.399443] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-23T21:07:42.679408] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T21:07:43.199441] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-23T21:07:43.647776] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:07:43.999453] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-23T21:07:44.467057] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T21:07:44.799452] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-23T21:07:45.599413] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-23T21:07:45.775348] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T21:07:46.049284] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:07:46.399427] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-23T21:07:46.430249] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T21:07:47.199456] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-23T21:07:47.999470] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-23T21:07:48.435384] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-23T21:07:48.461333] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T21:07:48.799410] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-23T21:07:49.093249] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T21:07:49.599436] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-23T21:07:50.399516] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-23T21:07:50.685236] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T21:07:50.735108] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T21:07:51.199469] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-23T21:07:51.707567] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T21:07:51.999440] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-23T21:07:52.331255] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T21:07:52.799426] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-23T21:07:53.003209] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T21:07:53.599421] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-23T21:07:53.984450] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T21:07:54.235958] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T21:07:54.244962] [INFO ] [REMOTE ] ED: Full fetch complete (75966 records). [2025-10-23T21:07:54.245169] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-23T21:07:54.246104] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T21:07:54.246203] [FATAL] [MAIN ] ED: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:07:54.246287] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:07:54.246374] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-23T21:07:54.246484] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-10-23T21:07:54.246572] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-10-23T21:07:54.247508] [DEBUG] [LOCAL ] ED: Deleted derivative data file. [2025-10-23T21:07:54.247679] [INFO ] [MAIN ] Update Progress: 695/2367 symbols completed. ED took 27.4s. Estimated remaining: 3h 31m 18s. Rate: 7.9 symbols/min [2025-10-23T21:07:54.406523] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-23T21:07:54.444003] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:07:54.483835] [DEBUG] [LOCAL ] EDU: Loaded 44813 existing records from primary storage. [2025-10-23T21:07:54.484168] [INFO ] [MAIN ] EDU: Loaded 44813 existing records. [2025-10-23T21:07:54.657157] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:07:54.657383] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-23T21:07:54.657457] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-23T21:07:54.657706] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-23T21:07:54.657768] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-23T21:07:55.006572] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:07:55.199430] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-23T21:07:55.999851] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-23T21:07:56.001951] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T21:07:56.799436] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-23T21:07:57.031445] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T21:07:57.052042] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T21:07:57.599465] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-23T21:07:58.066055] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T21:07:58.399407] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-23T21:07:58.748789] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:07:59.199436] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-23T21:07:59.865483] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:07:59.999400] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-23T21:08:00.799468] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-23T21:08:01.513030] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T21:08:01.518802] [INFO ] [REMOTE ] EDD: Full fetch complete (39167 records). [2025-10-23T21:08:01.518937] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-23T21:08:01.604574] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-23T21:08:01.806616] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-23T21:08:01.976244] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-23T21:08:01.976361] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-23T21:08:01.977194] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-23T21:08:01.977274] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-23T21:08:01.978345] [DEBUG] [LOCAL ] EDD: Trimmed 39167 records to 27448 (keeping 200 days of data) [2025-10-23T21:08:02.132693] [DEBUG] [LOCAL ] EDD: Primary data saved (27448 records). [2025-10-23T21:08:02.132858] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-23T21:08:02.132971] [INFO ] [MAIN ] Update Progress: 696/2367 symbols completed. EDD took 28.4s. Estimated remaining: 3h 31m 12s. Rate: 7.9 symbols/min [2025-10-23T21:08:02.305682] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:02.337150] [DEBUG] [LOCAL ] EE: Loaded 32539 existing records from primary storage. [2025-10-23T21:08:02.337482] [INFO ] [MAIN ] EE: Loaded 32539 existing records. [2025-10-23T21:08:02.400565] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-23T21:08:02.521323] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:08:02.521722] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-23T21:08:02.521905] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-23T21:08:02.522180] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-23T21:08:02.522256] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-23T21:08:02.632909] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:08:02.897545] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:03.198545] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T21:08:03.202508] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-23T21:08:03.999424] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-23T21:08:04.371299] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T21:08:04.424836] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T21:08:04.799441] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-23T21:08:05.303430] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T21:08:05.599423] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-23T21:08:05.769872] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T21:08:06.399418] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-23T21:08:07.199415] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-23T21:08:07.656197] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T21:08:07.761997] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T21:08:07.999447] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-23T21:08:08.420254] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T21:08:08.425010] [INFO ] [REMOTE ] EDN: Full fetch complete (29744 records). [2025-10-23T21:08:08.425124] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-23T21:08:08.801430] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-23T21:08:08.801679] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-23T21:08:08.801879] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-23T21:08:08.802553] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-23T21:08:08.802675] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-23T21:08:08.804198] [DEBUG] [LOCAL ] EDN: Trimmed 29744 records to 19477 (keeping 200 days of data) [2025-10-23T21:08:08.913108] [DEBUG] [LOCAL ] EDN: Primary data saved (19477 records). [2025-10-23T21:08:08.913273] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-23T21:08:08.913383] [INFO ] [MAIN ] Update Progress: 697/2367 symbols completed. EDN took 31.9s. Estimated remaining: 3h 31m 2s. Rate: 7.9 symbols/min [2025-10-23T21:08:09.079249] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:09.079426] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-23T21:08:09.079497] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-23T21:08:09.079600] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-23T21:08:09.079692] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-23T21:08:09.079772] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-23T21:08:09.079842] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-23T21:08:09.436680] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:09.523311] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T21:08:09.599396] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-23T21:08:09.874842] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T21:08:10.399436] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-23T21:08:11.204351] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-23T21:08:11.207090] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T21:08:11.313325] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T21:08:11.315659] [INFO ] [REMOTE ] EDF: Full fetch complete (20076 records). [2025-10-23T21:08:11.315765] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-23T21:08:11.675344] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-23T21:08:11.675463] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-23T21:08:11.675965] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-23T21:08:11.676044] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-23T21:08:11.676762] [DEBUG] [LOCAL ] EDF: Trimmed 20076 records to 12885 (keeping 200 days of data) [2025-10-23T21:08:11.754311] [DEBUG] [LOCAL ] EDF: Primary data saved (12885 records). [2025-10-23T21:08:11.754492] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-23T21:08:11.754609] [INFO ] [MAIN ] Update Progress: 698/2367 symbols completed. EDF took 36.4s. Estimated remaining: 3h 30m 43s. Rate: 7.9 symbols/min [2025-10-23T21:08:11.956804] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:11.968103] [DEBUG] [LOCAL ] EEX: Loaded 9811 existing records from primary storage. [2025-10-23T21:08:11.968431] [INFO ] [MAIN ] EEX: Loaded 9811 existing records. [2025-10-23T21:08:12.004539] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-23T21:08:12.170208] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:08:12.170492] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-23T21:08:12.170572] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-23T21:08:12.170817] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-23T21:08:12.170894] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-23T21:08:12.724954] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:12.804573] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-23T21:08:12.822119] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T21:08:13.551957] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T21:08:13.563082] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T21:08:13.599417] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-23T21:08:14.214927] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T21:08:14.399476] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-23T21:08:15.199453] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-23T21:08:15.850573] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T21:08:15.955458] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T21:08:15.999401] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-23T21:08:16.799429] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-23T21:08:17.093997] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T21:08:17.599449] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-23T21:08:18.399147] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T21:08:18.406880] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-23T21:08:18.746398] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T21:08:19.199466] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-23T21:08:19.908566] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T21:08:19.999428] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-23T21:08:20.094482] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:08:20.799501] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-23T21:08:21.551438] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T21:08:21.599477] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-23T21:08:21.929016] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T21:08:22.399480] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-23T21:08:23.199422] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-23T21:08:23.330405] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T21:08:23.510027] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T21:08:23.705753] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-23T21:08:23.999476] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-23T21:08:24.799434] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-23T21:08:25.599452] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-23T21:08:25.752002] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:08:26.080234] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-23T21:08:26.234258] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T21:08:26.399461] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-23T21:08:27.199452] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-23T21:08:27.999456] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-23T21:08:28.489819] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-23T21:08:28.665734] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T21:08:28.671986] [INFO ] [REMOTE ] EE: Full fetch complete (44595 records). [2025-10-23T21:08:28.672138] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-23T21:08:28.802540] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-23T21:08:28.815990] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T21:08:29.084360] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-23T21:08:29.084474] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-23T21:08:29.085178] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-23T21:08:29.085259] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-23T21:08:29.086337] [DEBUG] [LOCAL ] EE: Trimmed 44595 records to 32747 (keeping 200 days of data) [2025-10-23T21:08:29.280805] [DEBUG] [LOCAL ] EE: Primary data saved (32747 records). [2025-10-23T21:08:29.280970] [INFO ] [MAIN ] EE: Full history saved. [2025-10-23T21:08:29.281087] [INFO ] [MAIN ] Update Progress: 699/2367 symbols completed. EE took 27.1s. Estimated remaining: 3h 30m 59s. Rate: 7.9 symbols/min [2025-10-23T21:08:29.445445] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:29.485255] [DEBUG] [LOCAL ] EFC: Loaded 46280 existing records from primary storage. [2025-10-23T21:08:29.485581] [INFO ] [MAIN ] EFC: Loaded 46280 existing records. [2025-10-23T21:08:29.604699] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-23T21:08:29.663454] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:08:29.663811] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-23T21:08:29.663890] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-23T21:08:29.664229] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-23T21:08:29.664305] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-23T21:08:30.016940] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:30.399431] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-23T21:08:30.584204] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T21:08:30.750628] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T21:08:30.759856] [INFO ] [REMOTE ] EDU: Full fetch complete (67211 records). [2025-10-23T21:08:30.760099] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-23T21:08:31.179364] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-23T21:08:31.179519] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-23T21:08:31.180885] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-23T21:08:31.180981] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-23T21:08:31.182857] [DEBUG] [LOCAL ] EDU: Trimmed 67211 records to 45102 (keeping 200 days of data) [2025-10-23T21:08:31.244347] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-23T21:08:31.450256] [DEBUG] [LOCAL ] EDU: Primary data saved (45102 records). [2025-10-23T21:08:31.450418] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-23T21:08:31.450528] [INFO ] [MAIN ] Update Progress: 700/2367 symbols completed. EDU took 37.2s. Estimated remaining: 3h 30m 39s. Rate: 7.9 symbols/min [2025-10-23T21:08:31.618772] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:31.640108] [DEBUG] [LOCAL ] EFR: Loaded 15025 existing records from primary storage. [2025-10-23T21:08:31.640368] [INFO ] [MAIN ] EFR: Loaded 15025 existing records. [2025-10-23T21:08:31.815262] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:08:31.815447] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-23T21:08:31.815526] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-23T21:08:31.815739] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-23T21:08:31.815819] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-23T21:08:31.919041] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T21:08:32.007732] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-23T21:08:32.181029] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:32.258570] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T21:08:32.799492] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-23T21:08:32.900491] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-23T21:08:33.599433] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-23T21:08:33.684883] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T21:08:34.399571] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-23T21:08:35.199446] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-23T21:08:35.312877] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-23T21:08:35.362788] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T21:08:35.999430] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-23T21:08:36.136486] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T21:08:36.764247] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T21:08:36.766144] [INFO ] [REMOTE ] EEX: Full fetch complete (18268 records). [2025-10-23T21:08:36.766233] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-23T21:08:36.805061] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-23T21:08:37.154406] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-23T21:08:37.154516] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-23T21:08:37.155018] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-23T21:08:37.155100] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-23T21:08:37.155681] [DEBUG] [LOCAL ] EEX: Trimmed 18268 records to 9883 (keeping 200 days of data) [2025-10-23T21:08:37.209747] [DEBUG] [LOCAL ] EEX: Primary data saved (9883 records). [2025-10-23T21:08:37.209888] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-23T21:08:37.210001] [INFO ] [MAIN ] Update Progress: 701/2367 symbols completed. EEX took 25.5s. Estimated remaining: 3h 30m 27s. Rate: 7.9 symbols/min [2025-10-23T21:08:37.379318] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:37.379472] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-10-23T21:08:37.379540] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-10-23T21:08:37.379689] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-23T21:08:37.379748] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-23T21:08:37.379821] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-23T21:08:37.379893] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-23T21:08:37.607825] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-23T21:08:37.738029] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:37.770138] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T21:08:38.384308] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T21:08:38.399386] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-23T21:08:38.997775] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T21:08:39.199491] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-23T21:08:39.726163] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-23T21:08:39.727017] [INFO ] [REMOTE ] EEA: Full fetch complete (3692 records). [2025-10-23T21:08:39.727108] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-23T21:08:39.900452] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T21:08:39.900633] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:08:39.900731] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:08:39.900820] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-23T21:08:39.900927] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-23T21:08:39.901013] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-23T21:08:39.901113] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-23T21:08:39.901225] [INFO ] [MAIN ] Update Progress: 702/2367 symbols completed. EEA took 31.0s. Estimated remaining: 3h 30m 8s. Rate: 7.9 symbols/min [2025-10-23T21:08:39.999450] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-23T21:08:40.074561] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:08:40.074769] [DEBUG] [LOCAL ] EFX: No existing data file found in primary storage. [2025-10-23T21:08:40.074849] [WARN ] [MAIN ] EFX: No existing data found, performing full refresh instead. [2025-10-23T21:08:40.074932] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-23T21:08:40.074998] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-23T21:08:40.075077] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-23T21:08:40.075124] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-23T21:08:40.430710] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:08:40.799426] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-23T21:08:41.599406] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-23T21:08:42.065146] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-23T21:08:42.399467] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-23T21:08:42.511250] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T21:08:42.655009] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T21:08:43.199417] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-23T21:08:43.233695] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T21:08:43.999435] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-23T21:08:44.799409] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-23T21:08:44.867732] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T21:08:45.116769] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T21:08:45.599410] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-23T21:08:46.399410] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-23T21:08:46.558356] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T21:08:46.559721] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T21:08:47.041637] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T21:08:47.199449] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-23T21:08:47.999489] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-23T21:08:48.799411] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-23T21:08:48.862737] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T21:08:49.003167] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:08:49.599437] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-23T21:08:50.399412] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-23T21:08:50.625721] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:08:50.720092] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-23T21:08:51.160219] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T21:08:51.199458] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-23T21:08:51.999421] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-23T21:08:52.277435] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T21:08:52.799460] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-23T21:08:53.599403] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-23T21:08:53.834053] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T21:08:53.969111] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T21:08:54.399410] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-23T21:08:54.628201] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T21:08:55.199441] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-23T21:08:55.999417] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-23T21:08:56.234602] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T21:08:56.402257] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T21:08:56.799449] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-23T21:08:57.599415] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-23T21:08:58.073105] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T21:08:58.399420] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-23T21:08:58.558081] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T21:08:59.199477] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-23T21:08:59.541481] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-23T21:08:59.546706] [INFO ] [REMOTE ] EFR: Full fetch complete (19734 records). [2025-10-23T21:08:59.546911] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-23T21:08:59.915501] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-23T21:08:59.915619] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-23T21:08:59.916143] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-23T21:08:59.916218] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-23T21:08:59.917015] [DEBUG] [LOCAL ] EFR: Trimmed 19734 records to 15160 (keeping 200 days of data) [2025-10-23T21:09:00.001946] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-23T21:09:00.007185] [DEBUG] [LOCAL ] EFR: Primary data saved (15160 records). [2025-10-23T21:09:00.008200] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-23T21:09:00.008330] [INFO ] [MAIN ] Update Progress: 703/2367 symbols completed. EFR took 28.6s. Estimated remaining: 3h 30m 30s. Rate: 7.9 symbols/min [2025-10-23T21:09:00.178780] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:00.206779] [DEBUG] [LOCAL ] EFXT: Loaded 29466 existing records from primary storage. [2025-10-23T21:09:00.207086] [INFO ] [MAIN ] EFXT: Loaded 29466 existing records. [2025-10-23T21:09:00.386031] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:00.386239] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-23T21:09:00.386311] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-23T21:09:00.386528] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-23T21:09:00.386601] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-23T21:09:00.738220] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:00.799398] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-23T21:09:01.414527] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (5.42 seconds). [2025-10-23T21:09:01.599431] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-23T21:09:01.688265] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T21:09:02.224833] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-23T21:09:02.399462] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-23T21:09:02.508743] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T21:09:03.199469] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-23T21:09:03.933425] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-23T21:09:03.999413] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-23T21:09:04.194568] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T21:09:04.706991] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T21:09:04.799584] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-23T21:09:05.599463] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-23T21:09:05.935334] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T21:09:06.368240] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T21:09:06.399398] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-23T21:09:06.803442] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T21:09:07.199441] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-23T21:09:07.934701] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T21:09:07.999445] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-23T21:09:08.799440] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-23T21:09:09.178913] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T21:09:09.186951] [INFO ] [REMOTE ] EFC: Full fetch complete (66719 records). [2025-10-23T21:09:09.187119] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-23T21:09:09.565019] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-23T21:09:09.565151] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-23T21:09:09.566188] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-23T21:09:09.566301] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-23T21:09:09.567877] [DEBUG] [LOCAL ] EFC: Trimmed 66719 records to 46626 (keeping 200 days of data) [2025-10-23T21:09:09.624120] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-23T21:09:09.863455] [DEBUG] [LOCAL ] EFC: Primary data saved (46626 records). [2025-10-23T21:09:09.863668] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-23T21:09:09.863796] [INFO ] [MAIN ] Update Progress: 704/2367 symbols completed. EFC took 40.6s. Estimated remaining: 3h 30m 28s. Rate: 7.9 symbols/min [2025-10-23T21:09:10.034089] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:10.061879] [DEBUG] [LOCAL ] EG: Loaded 27544 existing records from primary storage. [2025-10-23T21:09:10.062175] [INFO ] [MAIN ] EG: Loaded 27544 existing records. [2025-10-23T21:09:10.260867] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:10.261301] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-23T21:09:10.261396] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-23T21:09:10.267290] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-23T21:09:10.276438] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-23T21:09:10.309226] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T21:09:10.404506] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-23T21:09:10.648186] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:10.675779] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T21:09:10.678499] [INFO ] [REMOTE ] EFT: Full fetch complete (17733 records). [2025-10-23T21:09:10.678608] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-23T21:09:11.041050] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-23T21:09:11.041166] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-23T21:09:11.041711] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-23T21:09:11.041808] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-23T21:09:11.042496] [DEBUG] [LOCAL ] EFT: Trimmed 17733 records to 12971 (keeping 200 days of data) [2025-10-23T21:09:11.118949] [DEBUG] [LOCAL ] EFT: Primary data saved (12971 records). [2025-10-23T21:09:11.119122] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-23T21:09:11.119251] [INFO ] [MAIN ] Update Progress: 705/2367 symbols completed. EFT took 33.9s. Estimated remaining: 3h 30m 5s. Rate: 7.9 symbols/min [2025-10-23T21:09:11.210526] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-23T21:09:11.293741] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:11.345188] [DEBUG] [LOCAL ] EGO: Loaded 51739 existing records from primary storage. [2025-10-23T21:09:11.345563] [INFO ] [MAIN ] EGO: Loaded 51739 existing records. [2025-10-23T21:09:11.515792] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (3.52 seconds). [2025-10-23T21:09:11.567727] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:11.567951] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-23T21:09:11.568103] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-23T21:09:11.568461] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-23T21:09:11.568538] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-23T21:09:11.928374] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:11.945384] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T21:09:11.999421] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-23T21:09:12.799464] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-23T21:09:13.018967] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T21:09:13.599531] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-23T21:09:13.758752] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T21:09:13.833300] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T21:09:14.399419] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-23T21:09:15.146351] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T21:09:15.199413] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-23T21:09:15.784109] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T21:09:15.999451] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-23T21:09:16.799407] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-23T21:09:17.487990] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-23T21:09:17.599411] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-23T21:09:17.981948] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T21:09:18.388714] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T21:09:18.399394] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-23T21:09:19.164473] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T21:09:19.199461] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-23T21:09:19.923516] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:09:19.929741] [INFO ] [REMOTE ] EFXT: Full fetch complete (44274 records). [2025-10-23T21:09:19.929856] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-23T21:09:20.004589] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-23T21:09:20.299612] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-23T21:09:20.299747] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-23T21:09:20.300446] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-23T21:09:20.300524] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-23T21:09:20.301504] [DEBUG] [LOCAL ] EFXT: Trimmed 44274 records to 29741 (keeping 200 days of data) [2025-10-23T21:09:20.467532] [DEBUG] [LOCAL ] EFXT: Primary data saved (29741 records). [2025-10-23T21:09:20.467709] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-23T21:09:20.467832] [INFO ] [MAIN ] Update Progress: 706/2367 symbols completed. EFXT took 20.5s. Estimated remaining: 3h 30m 2s. Rate: 7.9 symbols/min [2025-10-23T21:09:20.636100] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:20.669569] [DEBUG] [LOCAL ] EGP: Loaded 30227 existing records from primary storage. [2025-10-23T21:09:20.670715] [INFO ] [MAIN ] EGP: Loaded 30227 existing records. [2025-10-23T21:09:20.828054] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-23T21:09:20.851497] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:20.852907] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-23T21:09:20.852989] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-23T21:09:20.853804] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-23T21:09:20.853977] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-23T21:09:20.976430] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T21:09:21.241558] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:21.599416] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-23T21:09:21.740413] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T21:09:22.399422] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-23T21:09:22.730255] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T21:09:22.769342] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T21:09:23.199454] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-23T21:09:23.999539] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-23T21:09:24.602464] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-23T21:09:24.799426] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-23T21:09:24.878921] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T21:09:25.523827] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T21:09:25.599498] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-23T21:09:26.399507] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-23T21:09:26.789993] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T21:09:27.199495] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-23T21:09:27.227443] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T21:09:27.377071] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T21:09:27.999412] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-23T21:09:28.799419] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-23T21:09:28.987922] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T21:09:29.480096] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T21:09:29.599475] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-23T21:09:30.399452] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-23T21:09:30.700478] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T21:09:30.967510] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T21:09:30.976780] [INFO ] [REMOTE ] EFX: Full fetch complete (65132 records). [2025-10-23T21:09:30.976998] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-23T21:09:31.205090] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-23T21:09:31.388038] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-23T21:09:31.388145] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-23T21:09:31.389153] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-23T21:09:31.389235] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-23T21:09:31.390551] [DEBUG] [LOCAL ] EFX: Trimmed 65132 records to 45066 (keeping 200 days of data) [2025-10-23T21:09:31.672252] [DEBUG] [LOCAL ] EFX: Primary data saved (45066 records). [2025-10-23T21:09:31.672465] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-23T21:09:31.672603] [INFO ] [MAIN ] Update Progress: 707/2367 symbols completed. EFX took 51.8s. Estimated remaining: 3h 30m 3s. Rate: 7.9 symbols/min [2025-10-23T21:09:31.793767] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T21:09:31.871555] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:31.909014] [DEBUG] [LOCAL ] EGY: Loaded 41231 existing records from primary storage. [2025-10-23T21:09:31.909361] [INFO ] [MAIN ] EGY: Loaded 41231 existing records. [2025-10-23T21:09:32.005689] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-23T21:09:32.086177] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:32.086366] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-23T21:09:32.086446] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-23T21:09:32.086734] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-23T21:09:32.086801] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-23T21:09:32.439264] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:32.583526] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T21:09:32.587746] [INFO ] [REMOTE ] EG: Full fetch complete (42786 records). [2025-10-23T21:09:32.587869] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-23T21:09:32.804740] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-23T21:09:32.967585] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-23T21:09:32.967760] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-23T21:09:32.969323] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-23T21:09:32.969717] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-23T21:09:32.971343] [DEBUG] [LOCAL ] EG: Trimmed 42786 records to 27639 (keeping 200 days of data) [2025-10-23T21:09:33.157085] [DEBUG] [LOCAL ] EG: Primary data saved (27639 records). [2025-10-23T21:09:33.157368] [INFO ] [MAIN ] EG: Full history saved. [2025-10-23T21:09:33.157516] [INFO ] [MAIN ] Update Progress: 708/2367 symbols completed. EG took 23.3s. Estimated remaining: 3h 29m 41s. Rate: 7.9 symbols/min [2025-10-23T21:09:33.350698] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:33.380930] [DEBUG] [LOCAL ] EHAB: Loaded 29342 existing records from primary storage. [2025-10-23T21:09:33.381342] [INFO ] [MAIN ] EHAB: Loaded 29342 existing records. [2025-10-23T21:09:33.592480] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:33.592817] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-23T21:09:33.592907] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-23T21:09:33.593183] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-23T21:09:33.593263] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-23T21:09:33.628501] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-23T21:09:33.982842] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:34.082050] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T21:09:34.399419] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-23T21:09:34.719502] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T21:09:34.923046] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T21:09:35.199478] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-23T21:09:35.654951] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-23T21:09:35.999461] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-23T21:09:36.799468] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-23T21:09:37.035856] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T21:09:37.401061] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T21:09:37.599497] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-23T21:09:38.399474] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-23T21:09:38.845250] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T21:09:38.960834] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-23T21:09:39.199444] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-23T21:09:39.999424] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-23T21:09:40.154501] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T21:09:40.799423] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-23T21:09:41.049930] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T21:09:41.500536] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T21:09:41.599429] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-23T21:09:42.399400] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-23T21:09:42.903345] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-23T21:09:42.914292] [INFO ] [REMOTE ] EGO: Full fetch complete (74642 records). [2025-10-23T21:09:42.914484] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-23T21:09:43.205022] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-23T21:09:43.205689] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T21:09:43.329781] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-23T21:09:43.329905] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-23T21:09:43.330858] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-23T21:09:43.330955] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-23T21:09:43.332389] [DEBUG] [LOCAL ] EGO: Trimmed 74642 records to 52112 (keeping 200 days of data) [2025-10-23T21:09:43.640390] [DEBUG] [LOCAL ] EGO: Primary data saved (52112 records). [2025-10-23T21:09:43.640560] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-23T21:09:43.640720] [INFO ] [MAIN ] Update Progress: 709/2367 symbols completed. EGO took 32.5s. Estimated remaining: 3h 29m 40s. Rate: 7.9 symbols/min [2025-10-23T21:09:43.815438] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:43.825613] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T21:09:43.867621] [DEBUG] [LOCAL ] EHC: Loaded 40923 existing records from primary storage. [2025-10-23T21:09:43.868023] [INFO ] [MAIN ] EHC: Loaded 40923 existing records. [2025-10-23T21:09:44.004566] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-23T21:09:44.066932] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:44.067147] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-23T21:09:44.067241] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-23T21:09:44.067534] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-23T21:09:44.067609] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-23T21:09:44.429696] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:44.799441] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-23T21:09:45.071616] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T21:09:45.568004] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T21:09:45.599394] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-23T21:09:46.262712] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T21:09:46.399437] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-23T21:09:46.901893] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T21:09:47.199714] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-23T21:09:47.999424] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-23T21:09:48.025824] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:09:48.799437] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-23T21:09:48.856239] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T21:09:49.599444] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-23T21:09:49.887905] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T21:09:50.399471] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-23T21:09:50.424768] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T21:09:51.056837] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T21:09:51.199439] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-23T21:09:51.999421] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-23T21:09:52.034020] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T21:09:52.425398] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T21:09:52.799434] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-23T21:09:53.504266] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T21:09:53.599421] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-23T21:09:54.149193] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T21:09:54.153995] [INFO ] [REMOTE ] EHAB: Full fetch complete (41187 records). [2025-10-23T21:09:54.154115] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-23T21:09:54.404610] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-23T21:09:54.530603] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-23T21:09:54.530749] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-23T21:09:54.531509] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-23T21:09:54.531605] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-23T21:09:54.532856] [DEBUG] [LOCAL ] EHAB: Trimmed 41187 records to 29510 (keeping 200 days of data) [2025-10-23T21:09:54.693807] [DEBUG] [LOCAL ] EHAB: Primary data saved (29510 records). [2025-10-23T21:09:54.693978] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-23T21:09:54.694125] [INFO ] [MAIN ] Update Progress: 710/2367 symbols completed. EHAB took 21.5s. Estimated remaining: 3h 29m 40s. Rate: 7.9 symbols/min [2025-10-23T21:09:54.864322] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:54.876228] [DEBUG] [LOCAL ] EHI: Loaded 10532 existing records from primary storage. [2025-10-23T21:09:54.876499] [INFO ] [MAIN ] EHI: Loaded 10532 existing records. [2025-10-23T21:09:55.066808] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:55.067068] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-23T21:09:55.067163] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-23T21:09:55.067399] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-23T21:09:55.067490] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-23T21:09:55.209573] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-23T21:09:55.433906] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:55.456429] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T21:09:55.921489] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T21:09:55.999433] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-23T21:09:56.799465] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-23T21:09:57.034440] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T21:09:57.599508] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-23T21:09:57.974830] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T21:09:58.108384] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T21:09:58.114004] [INFO ] [REMOTE ] EGP: Full fetch complete (45538 records). [2025-10-23T21:09:58.114186] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-23T21:09:58.409183] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-23T21:09:58.534150] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-23T21:09:58.534318] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-23T21:09:58.535053] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-23T21:09:58.535134] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-23T21:09:58.536294] [DEBUG] [LOCAL ] EGP: Trimmed 45538 records to 30434 (keeping 200 days of data) [2025-10-23T21:09:58.731343] [DEBUG] [LOCAL ] EGP: Primary data saved (30434 records). [2025-10-23T21:09:58.731506] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-23T21:09:58.731616] [INFO ] [MAIN ] Update Progress: 711/2367 symbols completed. EGP took 38.3s. Estimated remaining: 3h 29m 24s. Rate: 7.9 symbols/min [2025-10-23T21:09:58.903025] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:09:58.924407] [DEBUG] [LOCAL ] EIC: Loaded 22441 existing records from primary storage. [2025-10-23T21:09:58.924723] [INFO ] [MAIN ] EIC: Loaded 22441 existing records. [2025-10-23T21:09:59.115156] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:09:59.115391] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-23T21:09:59.115466] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-23T21:09:59.115738] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-23T21:09:59.115825] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-23T21:09:59.221906] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-23T21:09:59.437824] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T21:09:59.510563] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:09:59.533503] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T21:09:59.999435] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-23T21:10:00.799450] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-23T21:10:01.151672] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T21:10:01.305794] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-23T21:10:01.599453] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-23T21:10:02.108980] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T21:10:02.399486] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-23T21:10:02.884387] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T21:10:03.199435] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-23T21:10:03.999453] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-23T21:10:04.799472] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-23T21:10:04.861988] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-23T21:10:05.112974] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T21:10:05.178327] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T21:10:05.599444] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-23T21:10:05.730732] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T21:10:06.399433] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-23T21:10:07.042788] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T21:10:07.049536] [INFO ] [REMOTE ] EGY: Full fetch complete (60678 records). [2025-10-23T21:10:07.049681] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-23T21:10:07.204534] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-23T21:10:07.444267] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-23T21:10:07.444382] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-23T21:10:07.445444] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-23T21:10:07.445575] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-23T21:10:07.447016] [DEBUG] [LOCAL ] EGY: Trimmed 60678 records to 41489 (keeping 200 days of data) [2025-10-23T21:10:07.686069] [DEBUG] [LOCAL ] EGY: Primary data saved (41489 records). [2025-10-23T21:10:07.686300] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-23T21:10:07.686521] [INFO ] [MAIN ] Update Progress: 712/2367 symbols completed. EGY took 36.0s. Estimated remaining: 3h 29m 20s. Rate: 7.9 symbols/min [2025-10-23T21:10:07.780987] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T21:10:07.879254] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:10:07.879449] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-23T21:10:07.879519] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-23T21:10:07.879627] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-23T21:10:07.879713] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-23T21:10:07.879771] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-23T21:10:07.879833] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-23T21:10:08.004518] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-23T21:10:08.258924] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:10:08.327942] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-23T21:10:08.799439] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-23T21:10:09.401521] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-23T21:10:09.599448] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-23T21:10:09.645821] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T21:10:10.107018] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-23T21:10:10.399427] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-23T21:10:11.199433] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-23T21:10:11.859952] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T21:10:11.999412] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-23T21:10:12.799411] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-23T21:10:13.177305] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T21:10:13.599407] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-23T21:10:13.628045] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T21:10:13.758037] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T21:10:14.399495] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-23T21:10:15.199427] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-23T21:10:15.447185] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T21:10:15.648789] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T21:10:15.995560] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T21:10:15.999887] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-23T21:10:16.799416] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-23T21:10:17.599439] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-23T21:10:17.673818] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T21:10:17.930890] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T21:10:18.047236] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T21:10:18.399450] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-23T21:10:18.873008] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-23T21:10:19.199533] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-23T21:10:19.999412] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-23T21:10:20.308029] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T21:10:20.311727] [INFO ] [REMOTE ] EIC: Full fetch complete (34050 records). [2025-10-23T21:10:20.311854] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-23T21:10:20.707487] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-23T21:10:20.707682] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-23T21:10:20.708714] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-23T21:10:20.708819] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-23T21:10:20.710132] [DEBUG] [LOCAL ] EIC: Trimmed 34050 records to 22532 (keeping 200 days of data) [2025-10-23T21:10:20.807256] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-23T21:10:20.868089] [DEBUG] [LOCAL ] EIC: Primary data saved (22532 records). [2025-10-23T21:10:20.868258] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-23T21:10:20.868382] [INFO ] [MAIN ] Update Progress: 713/2367 symbols completed. EIC took 22.1s. Estimated remaining: 3h 29m 25s. Rate: 7.9 symbols/min [2025-10-23T21:10:21.013155] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-23T21:10:21.076844] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:10:21.077047] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-23T21:10:21.077122] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-23T21:10:21.077242] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-23T21:10:21.077317] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-23T21:10:21.077401] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-23T21:10:21.077473] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-23T21:10:21.384395] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T21:10:21.473343] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:10:21.599467] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-23T21:10:22.126551] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T21:10:22.399438] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-23T21:10:22.979111] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T21:10:23.199467] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-23T21:10:23.718040] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-23T21:10:23.999448] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-23T21:10:24.799472] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-23T21:10:25.354041] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-23T21:10:25.576592] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T21:10:25.583306] [INFO ] [REMOTE ] EHC: Full fetch complete (58779 records). [2025-10-23T21:10:25.583435] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-23T21:10:25.604589] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-23T21:10:25.971470] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-23T21:10:25.971579] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-23T21:10:25.972413] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-23T21:10:25.972507] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-23T21:10:25.973740] [DEBUG] [LOCAL ] EHC: Trimmed 58779 records to 41202 (keeping 200 days of data) [2025-10-23T21:10:26.226819] [DEBUG] [LOCAL ] EHC: Primary data saved (41202 records). [2025-10-23T21:10:26.226979] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-23T21:10:26.227104] [INFO ] [MAIN ] Update Progress: 714/2367 symbols completed. EHC took 42.6s. Estimated remaining: 3h 29m 13s. Rate: 7.9 symbols/min [2025-10-23T21:10:26.332990] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T21:10:26.403449] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:10:26.403509] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-23T21:10:26.404636] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-23T21:10:26.404749] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-23T21:10:26.404889] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-23T21:10:26.404975] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-23T21:10:26.405077] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-23T21:10:26.405194] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-23T21:10:26.759279] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:10:27.199442] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-23T21:10:27.463305] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T21:10:27.993590] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T21:10:27.999386] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-23T21:10:28.686247] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T21:10:28.799441] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-23T21:10:29.599473] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-23T21:10:29.683455] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T21:10:30.093775] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T21:10:30.399481] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-23T21:10:31.041173] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T21:10:31.199462] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-23T21:10:31.660589] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T21:10:31.999441] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-23T21:10:32.542321] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T21:10:32.799471] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-23T21:10:33.270117] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T21:10:33.599454] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-23T21:10:34.197968] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T21:10:34.399429] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-23T21:10:35.199424] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-23T21:10:35.396431] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T21:10:35.865084] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T21:10:35.999470] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-23T21:10:36.447046] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T21:10:36.447857] [INFO ] [REMOTE ] EICA: Full fetch complete (1206 records). [2025-10-23T21:10:36.447960] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-23T21:10:36.625220] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-23T21:10:36.625417] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:10:36.625491] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:10:36.625568] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-23T21:10:36.625686] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-23T21:10:36.625761] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-23T21:10:36.625844] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-23T21:10:36.625939] [INFO ] [MAIN ] Update Progress: 715/2367 symbols completed. EICA took 28.9s. Estimated remaining: 3h 29m 12s. Rate: 7.9 symbols/min [2025-10-23T21:10:36.803433] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:10:36.803558] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-23T21:10:36.824589] [DEBUG] [LOCAL ] EIG: Loaded 20065 existing records from primary storage. [2025-10-23T21:10:36.824920] [INFO ] [MAIN ] EIG: Loaded 20065 existing records. [2025-10-23T21:10:37.000248] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:10:37.000477] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-23T21:10:37.000552] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-23T21:10:37.000776] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-23T21:10:37.000854] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-23T21:10:37.343563] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:10:37.599435] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-23T21:10:37.691060] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T21:10:38.399438] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-23T21:10:38.808181] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:10:39.182418] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T21:10:39.199407] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-23T21:10:39.999411] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-23T21:10:40.010107] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T21:10:40.799518] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-23T21:10:40.960424] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T21:10:40.962779] [INFO ] [REMOTE ] EHI: Full fetch complete (15755 records). [2025-10-23T21:10:40.962872] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-23T21:10:41.343054] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-23T21:10:41.343166] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-23T21:10:41.343588] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-23T21:10:41.343690] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-23T21:10:41.344239] [DEBUG] [LOCAL ] EHI: Trimmed 15755 records to 10593 (keeping 200 days of data) [2025-10-23T21:10:41.402859] [DEBUG] [LOCAL ] EHI: Primary data saved (10593 records). [2025-10-23T21:10:41.403011] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-23T21:10:41.403101] [INFO ] [MAIN ] Update Progress: 716/2367 symbols completed. EHI took 46.7s. Estimated remaining: 3h 28m 57s. Rate: 7.9 symbols/min [2025-10-23T21:10:41.582151] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:10:41.607373] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-23T21:10:41.637270] [DEBUG] [LOCAL ] EIX: Loaded 53348 existing records from primary storage. [2025-10-23T21:10:41.638518] [INFO ] [MAIN ] EIX: Loaded 53348 existing records. [2025-10-23T21:10:41.638368] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-23T21:10:41.835025] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:10:41.835263] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-23T21:10:41.835340] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-23T21:10:41.835728] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-23T21:10:41.835803] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-23T21:10:42.182750] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:10:42.399432] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-23T21:10:42.798012] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T21:10:43.199454] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-23T21:10:43.925923] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-23T21:10:43.999455] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-23T21:10:44.193747] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T21:10:44.445885] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T21:10:44.799452] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-23T21:10:45.599442] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-23T21:10:46.017260] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T21:10:46.031510] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-23T21:10:46.032386] [INFO ] [REMOTE ] EICB: Full fetch complete (2664 records). [2025-10-23T21:10:46.032475] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-23T21:10:46.208350] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-23T21:10:46.208606] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:10:46.208715] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:10:46.208768] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-23T21:10:46.208865] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-23T21:10:46.208938] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-23T21:10:46.209020] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-23T21:10:46.209116] [INFO ] [MAIN ] Update Progress: 717/2367 symbols completed. EICB took 25.3s. Estimated remaining: 3h 28m 43s. Rate: 7.9 symbols/min [2025-10-23T21:10:46.399416] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-23T21:10:47.199474] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-23T21:10:47.242318] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T21:10:47.999435] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-23T21:10:48.589707] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T21:10:48.799418] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-23T21:10:49.107250] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T21:10:49.599520] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-23T21:10:49.748439] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-23T21:10:50.399448] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-23T21:10:51.199423] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-23T21:10:51.598430] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T21:10:51.634064] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T21:10:51.917685] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T21:10:51.920215] [INFO ] [REMOTE ] EICC: Full fetch complete (8465 records). [2025-10-23T21:10:51.920360] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-23T21:10:52.004636] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-23T21:10:52.304423] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-10-23T21:10:52.304530] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-10-23T21:10:52.304787] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-10-23T21:10:52.304905] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-10-23T21:10:52.305349] [DEBUG] [LOCAL ] EICC: Trimmed 8465 records to 6220 (keeping 200 days of data) [2025-10-23T21:10:52.342116] [DEBUG] [LOCAL ] EICC: Primary data saved (6220 records). [2025-10-23T21:10:52.342272] [INFO ] [MAIN ] EICC: Full history saved. [2025-10-23T21:10:52.342374] [INFO ] [MAIN ] Update Progress: 718/2367 symbols completed. EICC took 26.1s. Estimated remaining: 3h 28m 33s. Rate: 7.9 symbols/min [2025-10-23T21:10:52.799501] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-23T21:10:53.478217] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T21:10:53.599498] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-23T21:10:54.835735] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T21:10:54.842127] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-23T21:10:54.959950] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-23T21:10:55.199453] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-23T21:10:56.010676] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T21:10:56.015509] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-23T21:10:57.047946] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T21:10:57.058957] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-23T21:10:57.178391] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T21:10:57.181776] [INFO ] [REMOTE ] EIG: Full fetch complete (27318 records). [2025-10-23T21:10:57.181892] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-23T21:10:57.551080] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-23T21:10:57.551202] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-23T21:10:57.551768] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-23T21:10:57.551848] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-23T21:10:57.552595] [DEBUG] [LOCAL ] EIG: Trimmed 27318 records to 20163 (keeping 200 days of data) [2025-10-23T21:10:57.671512] [DEBUG] [LOCAL ] EIG: Primary data saved (20163 records). [2025-10-23T21:10:57.671685] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-23T21:10:57.671796] [INFO ] [MAIN ] Update Progress: 719/2367 symbols completed. EIG took 21.0s. Estimated remaining: 3h 28m 20s. Rate: 7.9 symbols/min [2025-10-23T21:10:59.288874] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-23T21:10:59.300385] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-23T21:11:01.524808] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T21:11:01.536448] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-23T21:11:03.629328] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-23T21:11:03.640729] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-23T21:11:05.781958] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-23T21:11:05.793379] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-23T21:11:07.906151] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-23T21:11:07.920788] [INFO ] [REMOTE ] EIX: Full fetch complete (77451 records). [2025-10-23T21:11:07.921051] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-23T21:11:08.457211] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-23T21:11:08.457380] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-23T21:11:08.458607] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-23T21:11:08.458750] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-23T21:11:08.460399] [DEBUG] [LOCAL ] EIX: Trimmed 77451 records to 53737 (keeping 200 days of data) [2025-10-23T21:11:08.790360] [DEBUG] [LOCAL ] EIX: Primary data saved (53737 records). [2025-10-23T21:11:08.790527] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-23T21:11:08.790662] [INFO ] [MAIN ] Update Progress: 720/2367 symbols completed. EIX took 27.4s. Estimated remaining: 3h 28m 20s. Rate: 7.9 symbols/min [2025-10-23T21:11:09.430072] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:09.527279] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:09.544377] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:09.545095] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-10-23T21:11:09.545200] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-10-23T21:11:09.574639] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:09.577778] [DEBUG] [LOCAL ] ELC: Loaded 3431 existing records from primary storage. [2025-10-23T21:11:09.578215] [INFO ] [MAIN ] ELC: Loaded 3431 existing records. [2025-10-23T21:11:09.575096] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-23T21:11:09.583908] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-23T21:11:09.645085] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-23T21:11:09.674209] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-23T21:11:09.853945] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:11:09.898026] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-23T21:11:09.930442] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-23T21:11:09.965809] [DEBUG] [LOCAL ] EL: Loaded 53385 existing records from primary storage. [2025-10-23T21:11:09.966247] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-23T21:11:09.966345] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-23T21:11:09.966487] [INFO ] [MAIN ] EL: Loaded 53385 existing records. [2025-10-23T21:11:10.283540] [DEBUG] [LOCAL ] ELAN: Loaded 53314 existing records from primary storage. [2025-10-23T21:11:10.357272] [INFO ] [MAIN ] ELAN: Loaded 53314 existing records. [2025-10-23T21:11:10.644746] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:11:10.726294] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-23T21:11:10.762728] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-23T21:11:10.752338] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:10.814672] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-23T21:11:10.794328] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-23T21:11:10.903598] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-23T21:11:10.938220] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:11:10.956724] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:10.987471] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-23T21:11:11.015333] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-23T21:11:11.050940] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-23T21:11:11.065212] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-23T21:11:11.070478] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-23T21:11:11.675607] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:11.694188] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-23T21:11:11.731546] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:11.732029] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-23T21:11:11.839208] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T21:11:11.840720] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-23T21:11:12.802272] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T21:11:12.803587] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-23T21:11:13.092943] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-23T21:11:13.104095] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-23T21:11:13.222255] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T21:11:13.234904] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-23T21:11:13.477381] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T21:11:13.478914] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-23T21:11:14.081435] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T21:11:14.082994] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-23T21:11:14.718384] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T21:11:14.720497] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-23T21:11:14.756855] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-10-23T21:11:14.767435] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-23T21:11:14.941247] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:11:14.951120] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-23T21:11:15.525423] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T21:11:15.527040] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-23T21:11:15.538857] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-23T21:11:15.539820] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-23T21:11:16.262180] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T21:11:16.263865] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-23T21:11:16.836221] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T21:11:16.847136] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-23T21:11:16.856294] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T21:11:16.857755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-23T21:11:16.898678] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-23T21:11:16.909058] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-23T21:11:17.614598] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T21:11:17.616147] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-23T21:11:17.859034] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-23T21:11:17.871825] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-23T21:11:18.251124] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T21:11:18.252245] [INFO ] [REMOTE ] ELC: Full fetch complete (4927 records). [2025-10-23T21:11:18.252331] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-23T21:11:18.622371] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-23T21:11:18.622545] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-23T21:11:18.622761] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-23T21:11:18.622889] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-23T21:11:18.623345] [DEBUG] [LOCAL ] ELC: Trimmed 4927 records to 3459 (keeping 200 days of data) [2025-10-23T21:11:18.644221] [DEBUG] [LOCAL ] ELC: Primary data saved (3459 records). [2025-10-23T21:11:18.644327] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-23T21:11:18.644461] [INFO ] [MAIN ] Update Progress: 721/2367 symbols completed. ELC took 9.9s. Estimated remaining: 3h 28m 18s. Rate: 7.9 symbols/min [2025-10-23T21:11:18.822292] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:18.888253] [DEBUG] [LOCAL ] ELME: Loaded 39292 existing records from primary storage. [2025-10-23T21:11:18.889354] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T21:11:18.900621] [INFO ] [MAIN ] ELME: Loaded 39292 existing records. [2025-10-23T21:11:18.906884] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-23T21:11:19.090081] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:11:19.090439] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-23T21:11:19.090523] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-23T21:11:19.090995] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-23T21:11:19.091134] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-23T21:11:19.482422] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-23T21:11:19.503076] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:19.518873] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-23T21:11:19.520810] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-23T21:11:19.809507] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T21:11:19.999499] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-23T21:11:20.899020] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T21:11:20.910841] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-23T21:11:21.158309] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T21:11:21.599454] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-23T21:11:21.930562] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-23T21:11:22.399444] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-23T21:11:22.531393] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-23T21:11:22.808556] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T21:11:22.862361] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T21:11:23.199477] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-23T21:11:23.999462] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-23T21:11:24.749773] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-23T21:11:24.799434] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-23T21:11:25.150705] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T21:11:25.599495] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-23T21:11:25.714563] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T21:11:26.399436] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-23T21:11:26.921839] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-23T21:11:27.199449] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-23T21:11:27.598452] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-23T21:11:27.999430] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-23T21:11:28.204199] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T21:11:28.799449] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-23T21:11:29.294128] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T21:11:29.599527] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-23T21:11:29.948353] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T21:11:30.399453] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-23T21:11:31.063684] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T21:11:31.199496] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-23T21:11:31.999450] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-23T21:11:32.055637] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-23T21:11:32.348296] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T21:11:32.358196] [INFO ] [REMOTE ] ELAN: Full fetch complete (77093 records). [2025-10-23T21:11:32.358397] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-23T21:11:32.757472] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-23T21:11:32.757671] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-23T21:11:32.758687] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-23T21:11:32.758915] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-23T21:11:32.760458] [DEBUG] [LOCAL ] ELAN: Trimmed 77093 records to 53699 (keeping 200 days of data) [2025-10-23T21:11:32.808696] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-23T21:11:32.893928] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T21:11:33.106732] [DEBUG] [LOCAL ] ELAN: Primary data saved (53699 records). [2025-10-23T21:11:33.106919] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-23T21:11:33.107038] [INFO ] [MAIN ] Update Progress: 722/2367 symbols completed. ELAN took 24.3s. Estimated remaining: 3h 28m 26s. Rate: 7.9 symbols/min [2025-10-23T21:11:33.275914] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:33.276099] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-23T21:11:33.276171] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-23T21:11:33.276281] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-23T21:11:33.276348] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-23T21:11:33.276428] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-23T21:11:33.276495] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-23T21:11:33.610326] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-23T21:11:33.632068] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:34.367909] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-23T21:11:34.399478] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-23T21:11:35.024905] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-23T21:11:35.164964] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:11:35.199401] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-23T21:11:35.304884] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T21:11:35.999494] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-23T21:11:36.799480] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-23T21:11:36.923720] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T21:11:37.599432] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-23T21:11:38.363338] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-23T21:11:38.399399] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-23T21:11:38.580076] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T21:11:39.199443] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-23T21:11:39.356520] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T21:11:39.999463] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-23T21:11:40.440236] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T21:11:40.544267] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T21:11:40.553444] [INFO ] [REMOTE ] EL: Full fetch complete (77433 records). [2025-10-23T21:11:40.553588] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-23T21:11:40.805192] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-23T21:11:40.954667] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-23T21:11:40.954784] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-23T21:11:40.956090] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-23T21:11:40.956169] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-23T21:11:40.957839] [DEBUG] [LOCAL ] EL: Trimmed 77433 records to 53769 (keeping 200 days of data) [2025-10-23T21:11:41.281367] [DEBUG] [LOCAL ] EL: Primary data saved (53769 records). [2025-10-23T21:11:41.281541] [INFO ] [MAIN ] EL: Full history saved. [2025-10-23T21:11:41.281680] [INFO ] [MAIN ] Update Progress: 723/2367 symbols completed. EL took 32.5s. Estimated remaining: 3h 28m 20s. Rate: 7.9 symbols/min [2025-10-23T21:11:41.453282] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:41.453496] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-23T21:11:41.453568] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-23T21:11:41.453703] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-23T21:11:41.453774] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-23T21:11:41.453856] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-23T21:11:41.453925] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-23T21:11:41.607433] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-23T21:11:41.772703] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T21:11:41.856020] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:42.399471] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-23T21:11:42.983002] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T21:11:43.199424] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-23T21:11:43.241943] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-23T21:11:43.984996] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T21:11:43.993195] [INFO ] [REMOTE ] ELME: Full fetch complete (56116 records). [2025-10-23T21:11:43.993477] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-23T21:11:44.006484] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-23T21:11:44.379066] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-23T21:11:44.379192] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-23T21:11:44.380702] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-23T21:11:44.380788] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-23T21:11:44.382141] [DEBUG] [LOCAL ] ELME: Trimmed 56116 records to 39574 (keeping 200 days of data) [2025-10-23T21:11:44.633075] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T21:11:44.644676] [DEBUG] [LOCAL ] ELME: Primary data saved (39574 records). [2025-10-23T21:11:44.645141] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-23T21:11:44.645261] [INFO ] [MAIN ] Update Progress: 724/2367 symbols completed. ELME took 26.0s. Estimated remaining: 3h 28m 2s. Rate: 7.9 symbols/min [2025-10-23T21:11:44.748616] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T21:11:44.801792] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-23T21:11:44.821736] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:44.822094] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-23T21:11:44.822169] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-23T21:11:44.822314] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-23T21:11:44.822390] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-23T21:11:44.822487] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-23T21:11:44.822558] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-23T21:11:45.167521] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:45.341066] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-23T21:11:45.599452] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-23T21:11:46.399441] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-23T21:11:46.986946] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T21:11:47.199425] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-23T21:11:47.999448] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-23T21:11:48.446231] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T21:11:48.455951] [INFO ] [REMOTE ] ELF: Full fetch complete (75487 records). [2025-10-23T21:11:48.456098] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-23T21:11:48.620231] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T21:11:48.804686] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-23T21:11:48.932869] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-23T21:11:48.932988] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-23T21:11:48.934135] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-23T21:11:48.934221] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-23T21:11:48.936089] [DEBUG] [LOCAL ] ELF: Trimmed 75487 records to 52226 (keeping 200 days of data) [2025-10-23T21:11:49.236866] [DEBUG] [LOCAL ] ELF: Primary data saved (52226 records). [2025-10-23T21:11:49.237033] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-23T21:11:49.237141] [INFO ] [MAIN ] Update Progress: 725/2367 symbols completed. ELF took 40.4s. Estimated remaining: 3h 27m 48s. Rate: 7.9 symbols/min [2025-10-23T21:11:49.406695] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:49.407008] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-23T21:11:49.407089] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-23T21:11:49.407344] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-23T21:11:49.407480] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-23T21:11:49.407696] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-23T21:11:49.407839] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-23T21:11:49.607740] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-23T21:11:49.731272] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T21:11:49.802024] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:50.177634] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T21:11:50.325533] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T21:11:50.399405] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-23T21:11:51.199443] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-23T21:11:51.812698] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T21:11:51.999431] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-23T21:11:52.352925] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T21:11:52.799416] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-23T21:11:53.599466] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-23T21:11:53.905969] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T21:11:54.399484] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-23T21:11:54.583313] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T21:11:54.719124] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T21:11:55.199444] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-23T21:11:55.999421] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-23T21:11:56.097184] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T21:11:56.135474] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T21:11:56.140251] [INFO ] [REMOTE ] ELP: Full fetch complete (36800 records). [2025-10-23T21:11:56.140380] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-23T21:11:56.437143] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T21:11:56.562427] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-23T21:11:56.562540] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-23T21:11:56.563363] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-23T21:11:56.563451] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-23T21:11:56.564574] [DEBUG] [LOCAL ] ELP: Trimmed 36800 records to 25729 (keeping 200 days of data) [2025-10-23T21:11:56.714581] [DEBUG] [LOCAL ] ELP: Primary data saved (25729 records). [2025-10-23T21:11:56.714763] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-23T21:11:56.714878] [INFO ] [MAIN ] Update Progress: 726/2367 symbols completed. ELP took 23.6s. Estimated remaining: 3h 27m 40s. Rate: 7.9 symbols/min [2025-10-23T21:11:56.804628] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-23T21:11:56.907892] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:11:56.908121] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-23T21:11:56.908209] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-23T21:11:56.908327] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-23T21:11:56.908376] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-23T21:11:56.908424] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-23T21:11:56.908472] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-23T21:11:57.266809] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:11:57.599445] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-23T21:11:58.118832] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-23T21:11:58.399467] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-23T21:11:58.758153] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T21:11:59.199453] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-23T21:11:59.999451] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-23T21:12:00.311946] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T21:12:00.361537] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T21:12:00.362000] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-23T21:12:00.362132] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:12:00.362230] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-23T21:12:00.362320] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:12:00.362412] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-23T21:12:00.362536] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-23T21:12:00.362627] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-23T21:12:00.362758] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-23T21:12:00.362863] [INFO ] [MAIN ] Update Progress: 727/2367 symbols completed. EMA took 3.6s. Estimated remaining: 3h 27m 24s. Rate: 7.9 symbols/min [2025-10-23T21:12:00.641183] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:00.641430] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-23T21:12:00.641522] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-23T21:12:00.641696] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-23T21:12:00.641789] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-23T21:12:00.641891] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-23T21:12:00.641980] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-23T21:12:00.799511] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-23T21:12:01.128585] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:01.168859] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T21:12:01.599441] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-23T21:12:02.399435] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-23T21:12:03.040802] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T21:12:03.120904] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T21:12:03.199418] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-23T21:12:03.291813] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T21:12:03.999440] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-23T21:12:04.799485] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-23T21:12:05.089860] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T21:12:05.383151] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T21:12:05.599485] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-23T21:12:06.399423] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-23T21:12:06.760506] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T21:12:07.084884] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T21:12:07.199441] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-23T21:12:07.698166] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-23T21:12:07.999434] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-23T21:12:08.799428] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-23T21:12:08.987418] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T21:12:09.599459] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-23T21:12:10.060387] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T21:12:10.090884] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T21:12:10.388331] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-23T21:12:10.399411] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-23T21:12:11.199438] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-23T21:12:11.999458] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-23T21:12:12.318581] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T21:12:12.361547] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T21:12:12.425096] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-23T21:12:12.799515] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-23T21:12:13.196942] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-23T21:12:13.599461] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-23T21:12:14.070242] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T21:12:14.071036] [INFO ] [REMOTE ] ELPC: Full fetch complete (1337 records). [2025-10-23T21:12:14.071123] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-23T21:12:14.249797] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-23T21:12:14.250018] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:12:14.250090] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:12:14.250173] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-23T21:12:14.250274] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-23T21:12:14.250345] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-23T21:12:14.250471] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-23T21:12:14.250568] [INFO ] [MAIN ] Update Progress: 728/2367 symbols completed. ELPC took 33.0s. Estimated remaining: 3h 27m 30s. Rate: 7.9 symbols/min [2025-10-23T21:12:14.399875] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-23T21:12:14.420980] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:14.453342] [DEBUG] [LOCAL ] EME: Loaded 30650 existing records from primary storage. [2025-10-23T21:12:14.453677] [INFO ] [MAIN ] EME: Loaded 30650 existing records. [2025-10-23T21:12:14.626517] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:12:14.626730] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-23T21:12:14.626803] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-23T21:12:14.627065] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-23T21:12:14.627138] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-23T21:12:14.972185] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:15.199454] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-23T21:12:15.642214] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T21:12:15.999503] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-23T21:12:16.799476] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-23T21:12:16.994894] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T21:12:17.599456] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-23T21:12:17.783302] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T21:12:18.197115] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T21:12:18.399441] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-23T21:12:19.199426] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-23T21:12:19.274458] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:12:19.677413] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T21:12:19.999423] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-23T21:12:20.799485] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-23T21:12:20.933091] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T21:12:20.993781] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T21:12:21.002706] [INFO ] [REMOTE ] ELS: Full fetch complete (71332 records). [2025-10-23T21:12:21.002863] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-23T21:12:21.384532] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-23T21:12:21.384678] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-23T21:12:21.385593] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-23T21:12:21.385694] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-23T21:12:21.387299] [DEBUG] [LOCAL ] ELS: Trimmed 71332 records to 50237 (keeping 200 days of data) [2025-10-23T21:12:21.602908] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-23T21:12:21.686586] [DEBUG] [LOCAL ] ELS: Primary data saved (50237 records). [2025-10-23T21:12:21.686782] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-23T21:12:21.686896] [INFO ] [MAIN ] Update Progress: 729/2367 symbols completed. ELS took 37.0s. Estimated remaining: 3h 27m 22s. Rate: 7.9 symbols/min [2025-10-23T21:12:21.851616] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:21.857047] [DEBUG] [LOCAL ] EMF: Loaded 3081 existing records from primary storage. [2025-10-23T21:12:21.857241] [INFO ] [MAIN ] EMF: Loaded 3081 existing records. [2025-10-23T21:12:22.031021] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:12:22.031235] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-23T21:12:22.031308] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-23T21:12:22.031481] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-23T21:12:22.031554] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-23T21:12:22.385347] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:22.399397] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-23T21:12:22.545362] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:12:22.996279] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-23T21:12:23.199417] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-23T21:12:23.663947] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T21:12:23.676377] [INFO ] [REMOTE ] ELV: Full fetch complete (73339 records). [2025-10-23T21:12:23.676582] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-23T21:12:24.001047] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-23T21:12:24.012084] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T21:12:24.119859] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-23T21:12:24.119987] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-23T21:12:24.121023] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-23T21:12:24.121118] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-23T21:12:24.122686] [DEBUG] [LOCAL ] ELV: Trimmed 73339 records to 51124 (keeping 200 days of data) [2025-10-23T21:12:24.439705] [DEBUG] [LOCAL ] ELV: Primary data saved (51124 records). [2025-10-23T21:12:24.439877] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-23T21:12:24.439987] [INFO ] [MAIN ] Update Progress: 730/2367 symbols completed. ELV took 35.2s. Estimated remaining: 3h 27m 4s. Rate: 7.9 symbols/min [2025-10-23T21:12:24.610319] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:24.610534] [DEBUG] [LOCAL ] EMN: No existing data file found in primary storage. [2025-10-23T21:12:24.610606] [WARN ] [MAIN ] EMN: No existing data found, performing full refresh instead. [2025-10-23T21:12:24.610738] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-23T21:12:24.610808] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-23T21:12:24.610888] [DEBUG] [LOCAL ] EMN: No primary data file found to delete. [2025-10-23T21:12:24.610957] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-23T21:12:24.804619] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-23T21:12:24.959038] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:25.599413] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-23T21:12:25.713917] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T21:12:25.935465] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T21:12:26.399440] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-23T21:12:26.918610] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T21:12:27.199446] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-23T21:12:27.966230] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T21:12:27.999406] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-23T21:12:28.226672] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:12:28.643294] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T21:12:28.799473] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-23T21:12:29.510808] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-23T21:12:29.599574] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-23T21:12:30.399454] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-23T21:12:31.164089] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T21:12:31.199394] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-23T21:12:31.486047] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T21:12:31.882929] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-23T21:12:31.999417] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-23T21:12:32.601310] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T21:12:32.799431] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-23T21:12:33.599439] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-23T21:12:34.399416] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-23T21:12:34.618203] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T21:12:35.199475] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-23T21:12:35.250434] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T21:12:35.629127] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T21:12:35.632983] [INFO ] [REMOTE ] EMD: Full fetch complete (31904 records). [2025-10-23T21:12:35.633077] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-23T21:12:35.896628] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T21:12:35.919193] [INFO ] [REMOTE ] EMF: Full fetch complete (6094 records). [2025-10-23T21:12:35.919345] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-23T21:12:36.004610] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-23T21:12:36.111950] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-23T21:12:36.112157] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-23T21:12:36.123760] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-23T21:12:36.139279] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-23T21:12:36.173033] [DEBUG] [LOCAL ] EMD: Trimmed 31904 records to 20887 (keeping 200 days of data) [2025-10-23T21:12:36.487878] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-23T21:12:36.492453] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-23T21:12:36.497612] [DEBUG] [LOCAL ] EMD: Primary data saved (20887 records). [2025-10-23T21:12:36.497784] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-23T21:12:36.497912] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-23T21:12:36.498059] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-23T21:12:36.498158] [INFO ] [MAIN ] Update Progress: 731/2367 symbols completed. EMD took 36.1s. Estimated remaining: 3h 27m 6s. Rate: 7.9 symbols/min [2025-10-23T21:12:36.541344] [DEBUG] [LOCAL ] EMF: Trimmed 6094 records to 3111 (keeping 200 days of data) [2025-10-23T21:12:36.628010] [DEBUG] [LOCAL ] EMF: Primary data saved (3111 records). [2025-10-23T21:12:36.638339] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-23T21:12:36.638457] [INFO ] [MAIN ] Update Progress: 732/2367 symbols completed. EMF took 15.0s. Estimated remaining: 3h 26m 42s. Rate: 7.9 symbols/min [2025-10-23T21:12:36.785327] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:36.791075] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-10-23T21:12:36.791161] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-10-23T21:12:36.796426] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-23T21:12:36.812018] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-23T21:12:36.806775] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-23T21:12:36.824045] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-23T21:12:36.830218] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-23T21:12:36.862091] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:36.975501] [DEBUG] [LOCAL ] EMP: Loaded 2888 existing records from primary storage. [2025-10-23T21:12:36.997764] [INFO ] [MAIN ] EMP: Loaded 2888 existing records. [2025-10-23T21:12:37.337756] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:12:37.388434] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:37.388685] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-23T21:12:37.389046] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-23T21:12:37.389214] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-23T21:12:37.389289] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-23T21:12:37.609723] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-23T21:12:37.761017] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:37.778514] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T21:12:38.399422] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-23T21:12:38.626514] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T21:12:38.681567] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T21:12:39.116866] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-23T21:12:39.199453] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-23T21:12:39.999460] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-23T21:12:40.167399] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T21:12:40.619991] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T21:12:40.799443] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-23T21:12:41.510933] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T21:12:41.599478] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-23T21:12:42.399454] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-23T21:12:42.901181] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T21:12:43.199710] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-23T21:12:43.999409] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-23T21:12:44.330339] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T21:12:44.799450] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-23T21:12:44.838004] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T21:12:44.877885] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T21:12:45.599446] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-23T21:12:46.292291] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-23T21:12:46.399420] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-23T21:12:46.631512] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:12:46.880210] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-23T21:12:47.199438] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-23T21:12:47.839952] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-23T21:12:47.999428] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-23T21:12:48.799441] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-23T21:12:49.599409] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-23T21:12:49.783760] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T21:12:50.028500] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T21:12:50.034145] [INFO ] [REMOTE ] EME: Full fetch complete (47093 records). [2025-10-23T21:12:50.034294] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-23T21:12:50.308464] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T21:12:50.409928] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-23T21:12:50.428243] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-23T21:12:50.428358] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-23T21:12:50.429208] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-23T21:12:50.429288] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-23T21:12:50.430268] [DEBUG] [LOCAL ] EME: Trimmed 47093 records to 30969 (keeping 200 days of data) [2025-10-23T21:12:50.621267] [DEBUG] [LOCAL ] EME: Primary data saved (30969 records). [2025-10-23T21:12:50.621438] [INFO ] [MAIN ] EME: Full history saved. [2025-10-23T21:12:50.621554] [INFO ] [MAIN ] Update Progress: 733/2367 symbols completed. EME took 36.4s. Estimated remaining: 3h 26m 49s. Rate: 7.9 symbols/min [2025-10-23T21:12:50.787552] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:50.787765] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-10-23T21:12:50.787835] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-10-23T21:12:50.787946] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-23T21:12:50.788028] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-23T21:12:50.788091] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-23T21:12:50.788154] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-23T21:12:51.130639] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:51.199417] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-23T21:12:51.466302] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T21:12:51.999453] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-23T21:12:52.799495] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-23T21:12:53.187807] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-23T21:12:53.599477] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-23T21:12:53.701630] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T21:12:53.868997] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T21:12:54.399450] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-23T21:12:55.199427] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-23T21:12:55.331604] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T21:12:55.402086] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T21:12:55.665182] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-23T21:12:55.999437] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-23T21:12:56.799427] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-23T21:12:57.092835] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T21:12:57.599450] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-23T21:12:58.096881] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-23T21:12:58.399448] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-23T21:12:58.767633] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T21:12:58.822767] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-23T21:12:58.823811] [INFO ] [REMOTE ] EMP: Full fetch complete (4056 records). [2025-10-23T21:12:58.823902] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-23T21:12:59.184882] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-23T21:12:59.185003] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-23T21:12:59.185145] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-23T21:12:59.185213] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-23T21:12:59.185597] [DEBUG] [LOCAL ] EMP: Trimmed 4056 records to 2894 (keeping 200 days of data) [2025-10-23T21:12:59.201673] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-23T21:12:59.205183] [DEBUG] [LOCAL ] EMP: Primary data saved (2894 records). [2025-10-23T21:12:59.205271] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-23T21:12:59.205382] [INFO ] [MAIN ] Update Progress: 734/2367 symbols completed. EMP took 22.6s. Estimated remaining: 3h 26m 43s. Rate: 7.9 symbols/min [2025-10-23T21:12:59.382206] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:12:59.432043] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-23T21:12:59.432391] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-23T21:12:59.629135] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:12:59.629352] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-23T21:12:59.629434] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-23T21:12:59.629715] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-23T21:12:59.629789] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-23T21:12:59.988534] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:12:59.999396] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-23T21:13:00.258774] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T21:13:00.799432] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-23T21:13:01.599438] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-23T21:13:01.921253] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T21:13:02.411087] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-23T21:13:02.416331] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T21:13:03.199404] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-23T21:13:03.356340] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T21:13:03.999408] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-23T21:13:04.330688] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T21:13:04.799437] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-23T21:13:05.394489] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-23T21:13:05.599405] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-23T21:13:05.781619] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T21:13:06.399452] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-23T21:13:06.442366] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T21:13:06.789819] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T21:13:06.799018] [INFO ] [REMOTE ] EMN: Full fetch complete (72434 records). [2025-10-23T21:13:06.799188] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-23T21:13:07.192199] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-23T21:13:07.192327] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-23T21:13:07.193295] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-23T21:13:07.193376] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-23T21:13:07.194869] [DEBUG] [LOCAL ] EMN: Trimmed 72434 records to 51204 (keeping 200 days of data) [2025-10-23T21:13:07.248969] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-23T21:13:07.509380] [DEBUG] [LOCAL ] EMN: Primary data saved (51204 records). [2025-10-23T21:13:07.509545] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-23T21:13:07.509672] [INFO ] [MAIN ] Update Progress: 735/2367 symbols completed. EMN took 43.1s. Estimated remaining: 3h 26m 37s. Rate: 7.9 symbols/min [2025-10-23T21:13:07.698018] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:07.731527] [DEBUG] [LOCAL ] ENIC: Loaded 36415 existing records from primary storage. [2025-10-23T21:13:07.731856] [INFO ] [MAIN ] ENIC: Loaded 36415 existing records. [2025-10-23T21:13:07.905884] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:13:07.906081] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-23T21:13:07.906155] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-23T21:13:07.906394] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-23T21:13:07.906467] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-23T21:13:08.005434] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-23T21:13:08.270481] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:08.425458] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-23T21:13:08.447965] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T21:13:08.451729] [INFO ] [REMOTE ] EMO: Full fetch complete (17757 records). [2025-10-23T21:13:08.451857] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-23T21:13:08.804794] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-23T21:13:08.897823] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-23T21:13:08.898032] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-23T21:13:08.898767] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-23T21:13:08.898855] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-23T21:13:08.899691] [DEBUG] [LOCAL ] EMO: Trimmed 17757 records to 13427 (keeping 200 days of data) [2025-10-23T21:13:08.987928] [DEBUG] [LOCAL ] EMO: Primary data saved (13427 records). [2025-10-23T21:13:08.988219] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-23T21:13:08.988393] [INFO ] [MAIN ] Update Progress: 736/2367 symbols completed. EMO took 32.5s. Estimated remaining: 3h 26m 16s. Rate: 7.9 symbols/min [2025-10-23T21:13:09.163203] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:09.167371] [DEBUG] [LOCAL ] ENO: Loaded 1737 existing records from primary storage. [2025-10-23T21:13:09.167675] [INFO ] [MAIN ] ENO: Loaded 1737 existing records. [2025-10-23T21:13:09.352710] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:13:09.353085] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-23T21:13:09.353171] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-23T21:13:09.353384] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-23T21:13:09.353460] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-23T21:13:09.606935] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-23T21:13:09.745507] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:10.229825] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-23T21:13:10.399511] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-23T21:13:11.018593] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-23T21:13:11.055755] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-23T21:13:11.165909] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T21:13:11.199413] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-23T21:13:11.302903] [DEBUG] [REMOTE ] ENIC: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-23T21:13:11.303222] [WARN ] [REMOTE ] ENIC: No data returned for month 2025-02 [2025-10-23T21:13:11.303325] [FATAL] [REMOTE ] ENIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:13:11.303424] [FATAL] [MAIN ] ENIC: Failed to fetch primary data. [2025-10-23T21:13:11.303508] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:13:11.303599] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-23T21:13:11.303732] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-23T21:13:11.303846] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-23T21:13:11.304074] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-10-23T21:13:11.304177] [INFO ] [MAIN ] Update Progress: 737/2367 symbols completed. ENIC took 3.8s. Estimated remaining: 3h 25m 57s. Rate: 7.9 symbols/min [2025-10-23T21:13:11.469259] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:11.469458] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-23T21:13:11.469531] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-23T21:13:11.469665] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-23T21:13:11.469776] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-23T21:13:11.469877] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-23T21:13:11.469983] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-23T21:13:11.813353] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:11.999444] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-23T21:13:12.799439] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-23T21:13:13.589703] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T21:13:13.599406] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-23T21:13:14.399457] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-23T21:13:14.992854] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-23T21:13:15.199446] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-23T21:13:15.205727] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T21:13:15.237781] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T21:13:15.999463] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-23T21:13:16.799612] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-23T21:13:16.850696] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T21:13:17.584783] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-23T21:13:17.599406] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-23T21:13:18.399494] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-23T21:13:18.447884] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T21:13:19.174243] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T21:13:19.199459] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-23T21:13:19.500984] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T21:13:19.666001] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T21:13:19.999472] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-23T21:13:20.799472] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-23T21:13:21.599455] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-23T21:13:22.168093] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-23T21:13:22.236083] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-23T21:13:22.399429] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-23T21:13:22.651483] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T21:13:23.199456] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-23T21:13:23.745863] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-23T21:13:23.999433] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-23T21:13:24.081046] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T21:13:24.799451] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-23T21:13:25.208251] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T21:13:25.599449] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-23T21:13:26.399429] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-23T21:13:26.882062] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-23T21:13:26.929672] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-23T21:13:27.199438] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-23T21:13:27.385885] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T21:13:27.396181] [INFO ] [REMOTE ] EMR: Full fetch complete (77213 records). [2025-10-23T21:13:27.396452] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-23T21:13:27.810935] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-23T21:13:27.811089] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-23T21:13:27.812627] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-23T21:13:27.812736] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-23T21:13:27.815058] [DEBUG] [LOCAL ] EMR: Trimmed 77213 records to 53551 (keeping 200 days of data) [2025-10-23T21:13:28.009273] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-23T21:13:28.177330] [DEBUG] [LOCAL ] EMR: Primary data saved (53551 records). [2025-10-23T21:13:28.177560] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-23T21:13:28.177711] [INFO ] [MAIN ] Update Progress: 738/2367 symbols completed. EMR took 37.6s. Estimated remaining: 3h 26m 10s. Rate: 7.9 symbols/min [2025-10-23T21:13:28.356110] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:28.401573] [DEBUG] [LOCAL ] ENR: Loaded 43819 existing records from primary storage. [2025-10-23T21:13:28.402062] [INFO ] [MAIN ] ENR: Loaded 43819 existing records. [2025-10-23T21:13:28.594474] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:13:28.594886] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-23T21:13:28.594977] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-23T21:13:28.595311] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-23T21:13:28.595391] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-23T21:13:28.680347] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T21:13:28.801520] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-23T21:13:29.007591] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:29.079451] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T21:13:29.299026] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-23T21:13:29.299882] [INFO ] [REMOTE ] ENO: Full fetch complete (2991 records). [2025-10-23T21:13:29.299971] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-23T21:13:29.613882] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-23T21:13:29.660917] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-23T21:13:29.661050] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-23T21:13:29.661264] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-23T21:13:29.661353] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-23T21:13:29.661823] [DEBUG] [LOCAL ] ENO: Trimmed 2991 records to 1746 (keeping 200 days of data) [2025-10-23T21:13:29.673438] [DEBUG] [LOCAL ] ENO: Primary data saved (1746 records). [2025-10-23T21:13:29.673523] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-23T21:13:29.673675] [INFO ] [MAIN ] Update Progress: 739/2367 symbols completed. ENO took 20.7s. Estimated remaining: 3h 25m 49s. Rate: 7.9 symbols/min [2025-10-23T21:13:29.854904] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:29.855146] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-23T21:13:29.855221] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-23T21:13:29.855370] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-23T21:13:29.855474] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-23T21:13:29.855556] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-23T21:13:29.855627] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-23T21:13:30.235245] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:30.399485] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-23T21:13:31.199454] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-23T21:13:31.310586] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:13:31.383342] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T21:13:31.999439] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-23T21:13:32.799470] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-23T21:13:32.851884] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T21:13:33.599455] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-23T21:13:33.634203] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T21:13:34.399451] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-23T21:13:34.425524] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T21:13:35.199429] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-23T21:13:35.262950] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T21:13:35.999450] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-23T21:13:36.346816] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T21:13:36.414259] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-23T21:13:36.423814] [INFO ] [REMOTE ] ENB: Full fetch complete (77663 records). [2025-10-23T21:13:36.423999] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-23T21:13:36.820021] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-23T21:13:36.815978] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-23T21:13:36.820156] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-23T21:13:36.821322] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-23T21:13:36.822300] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-23T21:13:36.823937] [DEBUG] [LOCAL ] ENB: Trimmed 77663 records to 53901 (keeping 200 days of data) [2025-10-23T21:13:37.158986] [DEBUG] [LOCAL ] ENB: Primary data saved (53901 records). [2025-10-23T21:13:37.159174] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-23T21:13:37.159325] [INFO ] [MAIN ] Update Progress: 740/2367 symbols completed. ENB took 38.0s. Estimated remaining: 3h 25m 41s. Rate: 7.9 symbols/min [2025-10-23T21:13:37.331963] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:37.356548] [DEBUG] [LOCAL ] ENVA: Loaded 25234 existing records from primary storage. [2025-10-23T21:13:37.356861] [INFO ] [MAIN ] ENVA: Loaded 25234 existing records. [2025-10-23T21:13:37.536543] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:13:37.536790] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-23T21:13:37.536934] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-23T21:13:37.537174] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-23T21:13:37.537246] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-23T21:13:37.600846] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-23T21:13:37.902721] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:37.930607] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T21:13:38.399424] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-23T21:13:38.438372] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T21:13:39.204615] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-23T21:13:39.224144] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T21:13:39.999443] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-23T21:13:40.143907] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T21:13:40.684910] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T21:13:40.799483] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-23T21:13:41.217447] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T21:13:41.599455] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-23T21:13:42.283067] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T21:13:42.399414] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-23T21:13:43.079743] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T21:13:43.199452] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-23T21:13:43.999445] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-23T21:13:44.066489] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T21:13:44.593267] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T21:13:44.799440] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-23T21:13:45.599509] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-23T21:13:45.825319] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T21:13:45.857830] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T21:13:46.399505] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-23T21:13:47.027826] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T21:13:47.199435] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-23T21:13:47.738237] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T21:13:47.999451] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-23T21:13:48.473552] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T21:13:48.480551] [INFO ] [REMOTE ] ENOV: Full fetch complete (63336 records). [2025-10-23T21:13:48.480731] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-23T21:13:48.804543] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-23T21:13:48.876250] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-23T21:13:48.876433] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-23T21:13:48.877339] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-23T21:13:48.877421] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-23T21:13:48.878756] [DEBUG] [LOCAL ] ENOV: Trimmed 63336 records to 44895 (keeping 200 days of data) [2025-10-23T21:13:49.134602] [DEBUG] [LOCAL ] ENOV: Primary data saved (44895 records). [2025-10-23T21:13:49.134808] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-23T21:13:49.134938] [INFO ] [MAIN ] Update Progress: 741/2367 symbols completed. ENOV took 37.8s. Estimated remaining: 3h 25m 43s. Rate: 7.9 symbols/min [2025-10-23T21:13:49.304355] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:49.304581] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-23T21:13:49.304674] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-23T21:13:49.304784] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-23T21:13:49.304855] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-23T21:13:49.304935] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-23T21:13:49.305003] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-23T21:13:49.596343] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T21:13:49.606908] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-23T21:13:49.693606] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:50.399419] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-23T21:13:50.831263] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T21:13:50.889175] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T21:13:51.199449] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-23T21:13:52.005617] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-23T21:13:52.028619] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-23T21:13:52.036826] [INFO ] [REMOTE ] ENS: Full fetch complete (42837 records). [2025-10-23T21:13:52.036969] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-23T21:13:52.427177] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-23T21:13:52.427754] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-23T21:13:52.428531] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-23T21:13:52.428613] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-23T21:13:52.430009] [DEBUG] [LOCAL ] ENS: Trimmed 42837 records to 29875 (keeping 200 days of data) [2025-10-23T21:13:52.615815] [DEBUG] [LOCAL ] ENS: Primary data saved (29875 records). [2025-10-23T21:13:52.615985] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-23T21:13:52.616089] [INFO ] [MAIN ] Update Progress: 742/2367 symbols completed. ENS took 22.9s. Estimated remaining: 3h 25m 26s. Rate: 7.9 symbols/min [2025-10-23T21:13:52.788233] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:13:52.799454] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-23T21:13:52.843400] [DEBUG] [LOCAL ] EOG: Loaded 53390 existing records from primary storage. [2025-10-23T21:13:52.843822] [INFO ] [MAIN ] EOG: Loaded 53390 existing records. [2025-10-23T21:13:53.022205] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:13:53.022538] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-23T21:13:53.022682] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-23T21:13:53.032201] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-23T21:13:53.047328] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-23T21:13:53.093851] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T21:13:53.456226] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:13:53.599460] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-23T21:13:53.669241] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T21:13:53.880821] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T21:13:54.399449] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-23T21:13:55.199411] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-23T21:13:55.314585] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T21:13:55.603415] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T21:13:55.999440] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-23T21:13:56.799407] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-23T21:13:56.868070] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T21:13:57.599430] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-23T21:13:57.865775] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T21:13:58.307240] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-23T21:13:58.399409] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-23T21:13:58.670452] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T21:13:59.199444] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-23T21:13:59.999436] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-23T21:14:00.378689] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T21:14:00.530114] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T21:14:00.799446] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-23T21:14:01.599448] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-23T21:14:01.699507] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T21:14:01.707027] [INFO ] [REMOTE ] ENR: Full fetch complete (59741 records). [2025-10-23T21:14:01.707223] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-23T21:14:02.105464] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-23T21:14:02.105600] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-23T21:14:02.106552] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-23T21:14:02.106635] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-23T21:14:02.123443] [DEBUG] [LOCAL ] ENR: Trimmed 59741 records to 44097 (keeping 200 days of data) [2025-10-23T21:14:02.125095] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T21:14:02.245350] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-23T21:14:02.403390] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-23T21:14:02.418610] [DEBUG] [LOCAL ] ENR: Primary data saved (44097 records). [2025-10-23T21:14:02.418758] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-23T21:14:02.418867] [INFO ] [MAIN ] Update Progress: 743/2367 symbols completed. ENR took 34.2s. Estimated remaining: 3h 25m 24s. Rate: 7.9 symbols/min [2025-10-23T21:14:02.593251] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:02.605896] [DEBUG] [LOCAL ] EOI: Loaded 10436 existing records from primary storage. [2025-10-23T21:14:02.606232] [INFO ] [MAIN ] EOI: Loaded 10436 existing records. [2025-10-23T21:14:02.784015] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:14:02.784242] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-23T21:14:02.784320] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-23T21:14:02.784508] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-23T21:14:02.784578] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-23T21:14:03.145441] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:03.199404] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-23T21:14:03.352267] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-23T21:14:03.999437] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-23T21:14:04.095729] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-23T21:14:04.799449] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-23T21:14:05.599416] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-23T21:14:05.894119] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T21:14:06.184728] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-23T21:14:06.399436] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-23T21:14:06.563262] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T21:14:07.199482] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-23T21:14:07.705634] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T21:14:07.999454] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-23T21:14:08.187009] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T21:14:08.799467] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-23T21:14:09.085984] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T21:14:09.599496] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-23T21:14:09.687490] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T21:14:10.399483] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-23T21:14:10.998156] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T21:14:11.199465] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-23T21:14:11.430587] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T21:14:11.999445] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-23T21:14:12.054057] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T21:14:12.799447] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-23T21:14:13.599405] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-23T21:14:14.047724] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T21:14:14.052331] [INFO ] [REMOTE ] ENVA: Full fetch complete (36690 records). [2025-10-23T21:14:14.052467] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-23T21:14:14.094388] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T21:14:14.400414] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-23T21:14:14.489795] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-23T21:14:14.489916] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-23T21:14:14.490568] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-23T21:14:14.490764] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-23T21:14:14.491814] [DEBUG] [LOCAL ] ENVA: Trimmed 36690 records to 25451 (keeping 200 days of data) [2025-10-23T21:14:14.641073] [DEBUG] [LOCAL ] ENVA: Primary data saved (25451 records). [2025-10-23T21:14:14.641229] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-23T21:14:14.641343] [INFO ] [MAIN ] Update Progress: 744/2367 symbols completed. ENVA took 37.5s. Estimated remaining: 3h 25m 26s. Rate: 7.9 symbols/min [2025-10-23T21:14:14.768734] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T21:14:14.824217] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:14.840288] [DEBUG] [LOCAL ] EOS: Loaded 14668 existing records from primary storage. [2025-10-23T21:14:14.840555] [INFO ] [MAIN ] EOS: Loaded 14668 existing records. [2025-10-23T21:14:15.042515] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:14:15.042756] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-23T21:14:15.042831] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-23T21:14:15.043025] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-23T21:14:15.043097] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-23T21:14:15.210061] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-23T21:14:15.387706] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:15.999414] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-23T21:14:16.300676] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T21:14:16.414547] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T21:14:16.799419] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-23T21:14:17.076459] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T21:14:17.599433] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-23T21:14:17.840200] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T21:14:17.843518] [INFO ] [REMOTE ] EOD: Full fetch complete (20756 records). [2025-10-23T21:14:17.843617] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-23T21:14:18.211412] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-23T21:14:18.211525] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-23T21:14:18.212010] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-23T21:14:18.212088] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-23T21:14:18.212713] [DEBUG] [LOCAL ] EOD: Trimmed 20756 records to 14980 (keeping 200 days of data) [2025-10-23T21:14:18.297419] [DEBUG] [LOCAL ] EOD: Primary data saved (14980 records). [2025-10-23T21:14:18.297579] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-23T21:14:18.297708] [INFO ] [MAIN ] Update Progress: 745/2367 symbols completed. EOD took 29.2s. Estimated remaining: 3h 25m 10s. Rate: 7.9 symbols/min [2025-10-23T21:14:18.400286] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-23T21:14:18.474552] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:18.474807] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-23T21:14:18.474877] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-23T21:14:18.474985] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-23T21:14:18.475055] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-23T21:14:18.475136] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-23T21:14:18.475204] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-23T21:14:18.655563] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T21:14:18.852589] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:19.199484] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-23T21:14:19.560589] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T21:14:19.999454] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-23T21:14:20.514451] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T21:14:20.799438] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-23T21:14:21.599476] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-23T21:14:21.728048] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T21:14:22.128620] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-23T21:14:22.293596] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T21:14:22.399523] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-23T21:14:23.199458] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-23T21:14:23.649014] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:14:23.999443] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-23T21:14:24.182083] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T21:14:24.799501] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-23T21:14:25.599419] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-23T21:14:25.754704] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T21:14:25.757284] [INFO ] [REMOTE ] EOI: Full fetch complete (15997 records). [2025-10-23T21:14:25.757437] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-23T21:14:26.120915] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-23T21:14:26.121157] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-23T21:14:26.121606] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-23T21:14:26.121858] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-23T21:14:26.122762] [DEBUG] [LOCAL ] EOI: Trimmed 15997 records to 10479 (keeping 200 days of data) [2025-10-23T21:14:26.186883] [DEBUG] [LOCAL ] EOI: Primary data saved (10479 records). [2025-10-23T21:14:26.187175] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-23T21:14:26.187320] [INFO ] [MAIN ] Update Progress: 746/2367 symbols completed. EOI took 23.8s. Estimated remaining: 3h 25m 3s. Rate: 7.9 symbols/min [2025-10-23T21:14:26.321777] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-23T21:14:26.401215] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:26.400391] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-23T21:14:26.401909] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-10-23T21:14:26.402662] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-10-23T21:14:26.402774] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-23T21:14:26.402844] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-23T21:14:26.402933] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-23T21:14:26.403002] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-23T21:14:26.766256] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:26.767109] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T21:14:27.199453] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-23T21:14:27.538198] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T21:14:27.999404] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-23T21:14:28.366972] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T21:14:28.799498] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-23T21:14:29.405038] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T21:14:29.599412] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-23T21:14:29.699497] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-23T21:14:30.399433] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-23T21:14:30.697692] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T21:14:31.199426] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-23T21:14:31.318881] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T21:14:31.999438] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-23T21:14:32.799499] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-23T21:14:32.984462] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T21:14:33.234725] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T21:14:33.244461] [INFO ] [REMOTE ] EOG: Full fetch complete (77467 records). [2025-10-23T21:14:33.244700] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-23T21:14:33.584228] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T21:14:33.601391] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-23T21:14:33.672074] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-23T21:14:33.672172] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-23T21:14:33.673139] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-23T21:14:33.673219] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-23T21:14:33.674850] [DEBUG] [LOCAL ] EOG: Trimmed 77467 records to 53780 (keeping 200 days of data) [2025-10-23T21:14:34.009391] [DEBUG] [LOCAL ] EOG: Primary data saved (53780 records). [2025-10-23T21:14:34.009555] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-23T21:14:34.011198] [INFO ] [MAIN ] Update Progress: 747/2367 symbols completed. EOG took 41.4s. Estimated remaining: 3h 24m 56s. Rate: 7.9 symbols/min [2025-10-23T21:14:34.180631] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:34.220233] [DEBUG] [LOCAL ] EPAM: Loaded 39328 existing records from primary storage. [2025-10-23T21:14:34.220545] [INFO ] [MAIN ] EPAM: Loaded 39328 existing records. [2025-10-23T21:14:34.413733] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-23T21:14:34.419512] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:14:34.420019] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-23T21:14:34.420717] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-23T21:14:34.420978] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-23T21:14:34.421066] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-23T21:14:34.779523] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:34.805690] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T21:14:35.199448] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-23T21:14:35.915941] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T21:14:35.999478] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-23T21:14:36.733733] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T21:14:36.786750] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T21:14:36.799410] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-23T21:14:37.599442] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-23T21:14:37.627040] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T21:14:38.399511] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-23T21:14:39.000288] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T21:14:39.199403] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-23T21:14:39.999467] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-23T21:14:40.020719] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T21:14:40.448885] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T21:14:40.799479] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-23T21:14:41.004386] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T21:14:41.599470] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-23T21:14:42.399487] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-23T21:14:42.495683] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T21:14:42.678073] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T21:14:43.199474] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-23T21:14:43.585698] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T21:14:43.999463] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-23T21:14:44.799422] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-23T21:14:44.888129] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T21:14:45.140038] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T21:14:45.599470] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-23T21:14:45.672814] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T21:14:45.676373] [INFO ] [REMOTE ] EOS: Full fetch complete (22774 records). [2025-10-23T21:14:45.676507] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-23T21:14:46.064743] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-23T21:14:46.064913] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-23T21:14:46.065912] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-23T21:14:46.065998] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-23T21:14:46.066813] [DEBUG] [LOCAL ] EOS: Trimmed 22774 records to 14754 (keeping 200 days of data) [2025-10-23T21:14:46.161700] [DEBUG] [LOCAL ] EOS: Primary data saved (14754 records). [2025-10-23T21:14:46.161935] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-23T21:14:46.162080] [INFO ] [MAIN ] Update Progress: 748/2367 symbols completed. EOS took 31.5s. Estimated remaining: 3h 24m 58s. Rate: 7.9 symbols/min [2025-10-23T21:14:46.340944] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:46.383543] [DEBUG] [LOCAL ] EPC: Loaded 39741 existing records from primary storage. [2025-10-23T21:14:46.384074] [INFO ] [MAIN ] EPC: Loaded 39741 existing records. [2025-10-23T21:14:46.414520] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-23T21:14:46.591513] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-23T21:14:46.595218] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:14:46.597856] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-23T21:14:46.598317] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-23T21:14:46.598589] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-23T21:14:46.598698] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-23T21:14:46.982914] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:47.199483] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-23T21:14:47.999427] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-23T21:14:48.293331] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T21:14:48.674134] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T21:14:48.799486] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-23T21:14:49.599487] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-23T21:14:49.623899] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T21:14:50.399480] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-23T21:14:50.516556] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:14:50.799258] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T21:14:51.199449] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-23T21:14:51.864011] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T21:14:51.999470] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-23T21:14:52.799473] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-23T21:14:52.924356] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T21:14:52.926605] [INFO ] [REMOTE ] EOT: Full fetch complete (10698 records). [2025-10-23T21:14:52.926729] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-23T21:14:53.318529] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-23T21:14:53.318689] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-23T21:14:53.319115] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-23T21:14:53.319200] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-23T21:14:53.319929] [DEBUG] [LOCAL ] EOT: Trimmed 10698 records to 7087 (keeping 200 days of data) [2025-10-23T21:14:53.369014] [DEBUG] [LOCAL ] EOT: Primary data saved (7087 records). [2025-10-23T21:14:53.369204] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-23T21:14:53.369321] [INFO ] [MAIN ] Update Progress: 749/2367 symbols completed. EOT took 35.1s. Estimated remaining: 3h 24m 50s. Rate: 7.9 symbols/min [2025-10-23T21:14:53.543793] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-23T21:14:53.603911] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-23T21:14:53.649738] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:53.712613] [DEBUG] [LOCAL ] EPD: Loaded 53608 existing records from primary storage. [2025-10-23T21:14:53.713363] [INFO ] [MAIN ] EPD: Loaded 53608 existing records. [2025-10-23T21:14:54.025753] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:14:54.026060] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-23T21:14:54.026165] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-23T21:14:54.026625] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-23T21:14:54.026764] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-23T21:14:54.403215] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-23T21:14:54.580843] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T21:14:54.614568] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:55.045458] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T21:14:55.199476] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-23T21:14:55.999433] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-23T21:14:56.185475] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:14:56.799452] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-23T21:14:57.547976] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-23T21:14:57.599403] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-23T21:14:57.756229] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T21:14:57.761127] [INFO ] [REMOTE ] EPAC: Full fetch complete (38882 records). [2025-10-23T21:14:57.761253] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-23T21:14:58.157244] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-23T21:14:58.157412] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-23T21:14:58.158364] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-23T21:14:58.158683] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-23T21:14:58.159877] [DEBUG] [LOCAL ] EPAC: Trimmed 38882 records to 26571 (keeping 200 days of data) [2025-10-23T21:14:58.322786] [DEBUG] [LOCAL ] EPAC: Primary data saved (26571 records). [2025-10-23T21:14:58.323021] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-23T21:14:58.323138] [INFO ] [MAIN ] Update Progress: 750/2367 symbols completed. EPAC took 32.1s. Estimated remaining: 3h 24m 37s. Rate: 7.9 symbols/min [2025-10-23T21:14:58.408693] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-23T21:14:58.468382] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T21:14:58.545371] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:14:58.584203] [DEBUG] [LOCAL ] EPR: Loaded 43707 existing records from primary storage. [2025-10-23T21:14:58.584546] [INFO ] [MAIN ] EPR: Loaded 43707 existing records. [2025-10-23T21:14:58.759799] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:14:58.760006] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-23T21:14:58.760082] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-23T21:14:58.760325] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-23T21:14:58.760399] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-23T21:14:59.116492] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:14:59.199432] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-23T21:14:59.578261] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T21:14:59.999422] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-23T21:15:00.244417] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T21:15:00.799401] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-23T21:15:00.960356] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T21:15:01.599496] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-23T21:15:02.219579] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-23T21:15:02.258047] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T21:15:02.399461] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-23T21:15:03.199430] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-23T21:15:03.397756] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T21:15:03.404634] [INFO ] [REMOTE ] EPAM: Full fetch complete (56649 records). [2025-10-23T21:15:03.404865] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-23T21:15:03.785864] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-23T21:15:03.786009] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-23T21:15:03.786904] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-23T21:15:03.787007] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-23T21:15:03.788375] [DEBUG] [LOCAL ] EPAM: Trimmed 56649 records to 39611 (keeping 200 days of data) [2025-10-23T21:15:04.000325] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-23T21:15:04.037135] [DEBUG] [LOCAL ] EPAM: Primary data saved (39611 records). [2025-10-23T21:15:04.037808] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-23T21:15:04.037929] [INFO ] [MAIN ] Update Progress: 751/2367 symbols completed. EPAM took 30.0s. Estimated remaining: 3h 24m 25s. Rate: 7.9 symbols/min [2025-10-23T21:15:04.217165] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:15:04.261198] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-23T21:15:04.261526] [INFO ] [MAIN ] EPRT: Loaded 48479 existing records. [2025-10-23T21:15:04.463932] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-23T21:15:04.462208] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:15:04.471828] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-23T21:15:04.471919] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-23T21:15:04.472340] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-23T21:15:04.472542] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-23T21:15:04.817135] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:15:04.812491] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-23T21:15:04.909103] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T21:15:05.599443] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-23T21:15:06.155445] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-23T21:15:06.399434] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-23T21:15:06.694518] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T21:15:07.199435] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-23T21:15:07.395284] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T21:15:07.999406] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-23T21:15:08.282609] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T21:15:08.799467] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-23T21:15:09.228981] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T21:15:09.599468] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-23T21:15:09.878050] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-23T21:15:10.399455] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-23T21:15:10.570231] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T21:15:11.199500] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-23T21:15:11.482838] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T21:15:11.978768] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T21:15:11.999390] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-23T21:15:12.799445] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-23T21:15:12.904438] [DEBUG] [REMOTE ] EPR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-23T21:15:12.904857] [WARN ] [REMOTE ] EPR: No data returned for month 2025-06 [2025-10-23T21:15:12.904943] [FATAL] [REMOTE ] EPR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:15:12.905074] [FATAL] [MAIN ] EPR: Failed to fetch primary data. [2025-10-23T21:15:12.905146] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:15:12.905235] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-23T21:15:12.905331] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-23T21:15:12.905470] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-10-23T21:15:12.906348] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-10-23T21:15:12.906810] [INFO ] [MAIN ] Update Progress: 752/2367 symbols completed. EPR took 14.6s. Estimated remaining: 3h 24m 20s. Rate: 7.9 symbols/min [2025-10-23T21:15:13.076520] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:15:13.087340] [DEBUG] [LOCAL ] EQBK: Loaded 11303 existing records from primary storage. [2025-10-23T21:15:13.087595] [INFO ] [MAIN ] EQBK: Loaded 11303 existing records. [2025-10-23T21:15:13.268368] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:15:13.268813] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-23T21:15:13.268916] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-23T21:15:13.269215] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-23T21:15:13.269299] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-23T21:15:13.594740] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-23T21:15:13.605711] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-23T21:15:13.686520] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:15:13.964584] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T21:15:14.399428] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-23T21:15:15.199416] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-23T21:15:15.317313] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T21:15:15.434951] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T21:15:15.999425] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-23T21:15:16.799414] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-23T21:15:16.951694] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:15:17.599426] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-23T21:15:17.724052] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T21:15:18.399422] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-23T21:15:18.551903] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T21:15:18.904267] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T21:15:19.199448] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-23T21:15:19.999421] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-23T21:15:20.090041] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T21:15:20.099319] [INFO ] [REMOTE ] EPC: Full fetch complete (57393 records). [2025-10-23T21:15:20.099479] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-23T21:15:20.489345] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-23T21:15:20.489457] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-23T21:15:20.490249] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-23T21:15:20.490328] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-23T21:15:20.491547] [DEBUG] [LOCAL ] EPC: Trimmed 57393 records to 40003 (keeping 200 days of data) [2025-10-23T21:15:20.725953] [DEBUG] [LOCAL ] EPC: Primary data saved (40003 records). [2025-10-23T21:15:20.726127] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-23T21:15:20.726252] [INFO ] [MAIN ] Update Progress: 753/2367 symbols completed. EPC took 34.6s. Estimated remaining: 3h 24m 13s. Rate: 7.9 symbols/min [2025-10-23T21:15:20.804610] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-23T21:15:20.906545] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:15:20.954859] [DEBUG] [LOCAL ] EQH: Loaded 52699 existing records from primary storage. [2025-10-23T21:15:20.955206] [INFO ] [MAIN ] EQH: Loaded 52699 existing records. [2025-10-23T21:15:21.138627] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:15:21.138876] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-23T21:15:21.138956] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-23T21:15:21.139197] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-23T21:15:21.139268] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-23T21:15:21.542936] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:15:21.545358] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-23T21:15:21.599395] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-23T21:15:21.738547] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T21:15:21.774750] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T21:15:22.399447] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-23T21:15:23.199463] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-23T21:15:23.638373] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T21:15:23.927240] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T21:15:23.999481] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-23T21:15:24.799423] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-23T21:15:24.934373] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T21:15:25.274554] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-23T21:15:25.599438] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-23T21:15:26.399425] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-23T21:15:26.699243] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T21:15:27.199384] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-23T21:15:27.323543] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T21:15:27.475430] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-23T21:15:27.999415] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-23T21:15:28.799399] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-23T21:15:29.052836] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T21:15:29.599448] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-23T21:15:30.243342] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-23T21:15:30.252763] [INFO ] [REMOTE ] EPD: Full fetch complete (77777 records). [2025-10-23T21:15:30.252938] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-23T21:15:30.405078] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-23T21:15:30.661482] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-23T21:15:30.661704] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-23T21:15:30.662848] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-23T21:15:30.662941] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-23T21:15:30.664516] [DEBUG] [LOCAL ] EPD: Trimmed 77777 records to 53998 (keeping 200 days of data) [2025-10-23T21:15:30.929015] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T21:15:31.046985] [DEBUG] [LOCAL ] EPD: Primary data saved (53998 records). [2025-10-23T21:15:31.047155] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-23T21:15:31.047314] [INFO ] [MAIN ] Update Progress: 754/2367 symbols completed. EPD took 37.7s. Estimated remaining: 3h 24m 11s. Rate: 7.9 symbols/min [2025-10-23T21:15:31.217815] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:15:31.215213] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-23T21:15:31.266922] [DEBUG] [LOCAL ] EQNR: Loaded 53050 existing records from primary storage. [2025-10-23T21:15:31.267267] [INFO ] [MAIN ] EQNR: Loaded 53050 existing records. [2025-10-23T21:15:31.444889] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:15:31.445065] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-23T21:15:31.445139] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-23T21:15:31.445359] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-23T21:15:31.445437] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-23T21:15:31.812101] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-23T21:15:31.831589] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:15:31.851553] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T21:15:31.999455] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-23T21:15:32.799427] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-23T21:15:33.259396] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T21:15:33.599423] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-23T21:15:33.760311] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T21:15:33.769352] [INFO ] [REMOTE ] EPRT: Full fetch complete (69584 records). [2025-10-23T21:15:33.769524] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-23T21:15:34.153483] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-23T21:15:34.153592] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-23T21:15:34.154518] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-23T21:15:34.154613] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-23T21:15:34.155966] [DEBUG] [LOCAL ] EPRT: Trimmed 69584 records to 48861 (keeping 200 days of data) [2025-10-23T21:15:34.416399] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-23T21:15:34.450726] [DEBUG] [LOCAL ] EPRT: Primary data saved (48861 records). [2025-10-23T21:15:34.450841] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-23T21:15:34.450948] [INFO ] [MAIN ] Update Progress: 755/2367 symbols completed. EPRT took 30.4s. Estimated remaining: 3h 23m 55s. Rate: 7.9 symbols/min [2025-10-23T21:15:34.601900] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T21:15:34.632388] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:15:34.681582] [DEBUG] [LOCAL ] EQR: Loaded 51810 existing records from primary storage. [2025-10-23T21:15:34.681942] [INFO ] [MAIN ] EQR: Loaded 51810 existing records. [2025-10-23T21:15:34.857060] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:15:34.857327] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-23T21:15:34.857488] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-23T21:15:34.857772] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-23T21:15:34.857936] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-23T21:15:34.984457] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T21:15:35.206452] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-23T21:15:35.245390] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:15:35.999432] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-23T21:15:36.264065] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T21:15:36.350722] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T21:15:36.799456] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-23T21:15:37.599469] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-23T21:15:37.863113] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T21:15:37.972465] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T21:15:37.976622] [INFO ] [REMOTE ] EQBK: Full fetch complete (15653 records). [2025-10-23T21:15:37.976797] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-23T21:15:38.350388] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-23T21:15:38.350502] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-23T21:15:38.350911] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-23T21:15:38.350991] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-23T21:15:38.351569] [DEBUG] [LOCAL ] EQBK: Trimmed 15653 records to 11385 (keeping 200 days of data) [2025-10-23T21:15:38.400460] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-23T21:15:38.422617] [DEBUG] [LOCAL ] EQBK: Primary data saved (11385 records). [2025-10-23T21:15:38.422853] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-23T21:15:38.423069] [INFO ] [MAIN ] Update Progress: 756/2367 symbols completed. EQBK took 25.5s. Estimated remaining: 3h 23m 39s. Rate: 7.9 symbols/min [2025-10-23T21:15:38.592292] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:15:38.592532] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-23T21:15:38.592605] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-23T21:15:38.592742] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-23T21:15:38.592836] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-23T21:15:38.592920] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-23T21:15:38.592987] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-23T21:15:38.937053] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:15:39.199430] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-23T21:15:39.282001] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T21:15:39.734138] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T21:15:39.999422] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-23T21:15:40.486227] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-23T21:15:40.535999] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-23T21:15:40.799444] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-23T21:15:41.599431] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-23T21:15:42.399419] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-23T21:15:42.889746] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-23T21:15:43.199418] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-23T21:15:43.448744] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T21:15:43.999444] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-23T21:15:44.109923] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:15:44.642709] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T21:15:44.799437] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-23T21:15:45.599432] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-23T21:15:45.753060] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:15:46.399500] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-23T21:15:46.662380] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T21:15:47.199507] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-23T21:15:47.626932] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T21:15:47.881761] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T21:15:47.999446] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-23T21:15:48.799478] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-23T21:15:48.992994] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T21:15:49.002113] [INFO ] [REMOTE ] EQH: Full fetch complete (76621 records). [2025-10-23T21:15:49.002264] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-23T21:15:49.393585] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-23T21:15:49.393760] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-23T21:15:49.394689] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-23T21:15:49.394768] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-23T21:15:49.396154] [DEBUG] [LOCAL ] EQH: Trimmed 76621 records to 53065 (keeping 200 days of data) [2025-10-23T21:15:49.600842] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-23T21:15:49.712709] [DEBUG] [LOCAL ] EQH: Primary data saved (53065 records). [2025-10-23T21:15:49.712896] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-23T21:15:49.713093] [INFO ] [MAIN ] Update Progress: 757/2367 symbols completed. EQH took 29.0s. Estimated remaining: 3h 23m 40s. Rate: 7.9 symbols/min [2025-10-23T21:15:49.897930] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T21:15:50.054607] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T21:15:50.399456] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-23T21:15:51.199471] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-23T21:15:51.340728] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-23T21:15:51.631708] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-23T21:15:51.999410] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-23T21:15:52.245598] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T21:15:52.519126] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-23T21:15:52.799448] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-23T21:15:53.599484] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-23T21:15:54.399425] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-23T21:15:54.666388] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T21:15:54.942530] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T21:15:55.199461] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-23T21:15:55.439864] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T21:15:55.815019] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-23T21:15:55.999451] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-23T21:15:56.799450] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-23T21:15:57.492218] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T21:15:57.599470] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-23T21:15:57.965634] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-23T21:15:58.354916] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T21:15:58.399444] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-23T21:15:59.199457] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-23T21:15:59.784040] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T21:15:59.784981] [INFO ] [REMOTE ] EQS: Full fetch complete (2376 records). [2025-10-23T21:15:59.785081] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-23T21:15:59.962555] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-23T21:15:59.962741] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:15:59.962810] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:15:59.962895] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-23T21:15:59.962985] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-23T21:15:59.963059] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-23T21:15:59.963137] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-23T21:15:59.963229] [INFO ] [MAIN ] Update Progress: 758/2367 symbols completed. EQS took 21.5s. Estimated remaining: 3h 23m 38s. Rate: 7.9 symbols/min [2025-10-23T21:15:59.999423] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-23T21:16:00.392447] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-23T21:16:00.799434] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-23T21:16:01.914034] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T21:16:01.923228] [INFO ] [REMOTE ] EQR: Full fetch complete (74626 records). [2025-10-23T21:16:01.923368] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-23T21:16:02.314335] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-23T21:16:02.314817] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-23T21:16:02.315766] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-23T21:16:02.315847] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-23T21:16:02.317356] [DEBUG] [LOCAL ] EQR: Trimmed 74626 records to 52192 (keeping 200 days of data) [2025-10-23T21:16:02.583991] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T21:16:02.600106] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-23T21:16:02.699292] [DEBUG] [LOCAL ] EQR: Primary data saved (52192 records). [2025-10-23T21:16:02.699478] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-23T21:16:02.699594] [INFO ] [MAIN ] Update Progress: 759/2367 symbols completed. EQR took 28.2s. Estimated remaining: 3h 23m 20s. Rate: 7.9 symbols/min [2025-10-23T21:16:04.804138] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T21:16:04.816093] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-23T21:16:06.800041] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T21:16:06.811536] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-23T21:16:08.878535] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T21:16:08.889593] [INFO ] [REMOTE ] EQNR: Full fetch complete (77014 records). [2025-10-23T21:16:08.889858] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-23T21:16:09.270709] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-23T21:16:09.270820] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-23T21:16:09.271746] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-23T21:16:09.271825] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-23T21:16:09.273234] [DEBUG] [LOCAL ] EQNR: Trimmed 77014 records to 53437 (keeping 200 days of data) [2025-10-23T21:16:09.589233] [DEBUG] [LOCAL ] EQNR: Primary data saved (53437 records). [2025-10-23T21:16:09.589395] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-23T21:16:09.589498] [INFO ] [MAIN ] Update Progress: 760/2367 symbols completed. EQNR took 38.5s. Estimated remaining: 3h 23m 11s. Rate: 7.9 symbols/min [2025-10-23T21:16:10.218198] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:10.237835] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:10.263530] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:10.293444] [DEBUG] [LOCAL ] EQV: Loaded 2702 existing records from primary storage. [2025-10-23T21:16:10.312839] [INFO ] [MAIN ] EQV: Loaded 2702 existing records. [2025-10-23T21:16:10.350103] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:10.570282] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:10.565311] [DEBUG] [LOCAL ] ERO: Loaded 42159 existing records from primary storage. [2025-10-23T21:16:10.570925] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-23T21:16:10.571184] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-23T21:16:10.571048] [INFO ] [MAIN ] ERO: Loaded 42159 existing records. [2025-10-23T21:16:10.600839] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-23T21:16:10.634609] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-23T21:16:10.676506] [DEBUG] [LOCAL ] ERJ: Loaded 50289 existing records from primary storage. [2025-10-23T21:16:10.709101] [INFO ] [MAIN ] ERJ: Loaded 50289 existing records. [2025-10-23T21:16:11.004384] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-23T21:16:11.043109] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:11.039680] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-23T21:16:11.116540] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-23T21:16:11.198548] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-23T21:16:11.281133] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-23T21:16:11.290865] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-23T21:16:11.293961] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:11.387079] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-23T21:16:11.452045] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-23T21:16:11.508227] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-23T21:16:11.643772] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-23T21:16:11.732492] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:11.787771] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:11.819323] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-23T21:16:11.873874] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-23T21:16:11.901963] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-23T21:16:11.959040] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-23T21:16:11.969862] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-23T21:16:12.301523] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:12.339840] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-23T21:16:12.702944] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:12.721143] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-23T21:16:12.751923] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:12.752349] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-23T21:16:12.965468] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T21:16:12.967928] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-23T21:16:13.779128] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T21:16:13.781023] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-23T21:16:14.120622] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T21:16:14.129687] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-23T21:16:14.246887] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T21:16:14.248478] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-23T21:16:14.396336] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:16:14.406208] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-23T21:16:14.648014] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-23T21:16:14.658565] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-23T21:16:14.931167] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T21:16:14.932510] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-23T21:16:15.565030] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T21:16:15.566441] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-23T21:16:15.959532] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T21:16:15.967706] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-23T21:16:16.170680] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T21:16:16.172148] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-23T21:16:16.208774] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T21:16:16.219332] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-23T21:16:16.721725] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-23T21:16:16.732182] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-23T21:16:16.775488] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T21:16:16.799444] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-23T21:16:17.329115] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-23T21:16:17.331023] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T21:16:17.599524] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-23T21:16:17.902385] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T21:16:18.162318] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-23T21:16:18.399427] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-23T21:16:18.963090] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-23T21:16:19.199500] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-23T21:16:20.006711] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-23T21:16:20.025498] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T21:16:20.799478] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-23T21:16:20.923410] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T21:16:21.599550] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-23T21:16:22.043406] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T21:16:22.396519] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-23T21:16:22.407123] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-23T21:16:22.968082] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T21:16:22.969231] [INFO ] [REMOTE ] EQV: Full fetch complete (4836 records). [2025-10-23T21:16:22.969346] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-23T21:16:23.214193] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-23T21:16:23.350362] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-23T21:16:23.362823] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-23T21:16:23.363062] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-23T21:16:23.363260] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-23T21:16:23.365302] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T21:16:23.375852] [DEBUG] [LOCAL ] EQV: Trimmed 4836 records to 2771 (keeping 200 days of data) [2025-10-23T21:16:23.392819] [DEBUG] [LOCAL ] EQV: Primary data saved (2771 records). [2025-10-23T21:16:23.392914] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-23T21:16:23.393022] [INFO ] [MAIN ] Update Progress: 761/2367 symbols completed. EQV took 13.8s. Estimated remaining: 3h 23m 16s. Rate: 7.9 symbols/min [2025-10-23T21:16:23.564143] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:23.611962] [DEBUG] [LOCAL ] ES: Loaded 52699 existing records from primary storage. [2025-10-23T21:16:23.612355] [INFO ] [MAIN ] ES: Loaded 52699 existing records. [2025-10-23T21:16:23.788456] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:23.788704] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-23T21:16:23.788781] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-23T21:16:23.788999] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-23T21:16:23.789070] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-23T21:16:24.008418] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-23T21:16:24.147433] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:24.799420] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-23T21:16:24.822493] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T21:16:25.599419] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-23T21:16:25.741139] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T21:16:26.399426] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-23T21:16:27.006993] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-23T21:16:27.199417] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-23T21:16:27.424706] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:16:27.999404] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-23T21:16:28.530137] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-23T21:16:28.799440] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-23T21:16:29.399635] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-23T21:16:29.599423] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-23T21:16:29.942197] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T21:16:30.402556] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-23T21:16:30.408207] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T21:16:30.861415] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T21:16:31.199433] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-23T21:16:31.999523] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-23T21:16:32.758503] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-23T21:16:32.799501] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-23T21:16:33.096564] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-23T21:16:33.599420] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-23T21:16:33.790926] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T21:16:34.399410] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-23T21:16:34.533213] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T21:16:35.199411] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-23T21:16:35.565725] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T21:16:35.701797] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T21:16:35.999432] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-23T21:16:36.799461] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-23T21:16:37.386053] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-23T21:16:37.599460] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-23T21:16:37.978575] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T21:16:37.987219] [INFO ] [REMOTE ] ERJ: Full fetch complete (73083 records). [2025-10-23T21:16:37.987376] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-23T21:16:38.385062] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-23T21:16:38.385335] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-23T21:16:38.386637] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-23T21:16:38.386850] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-23T21:16:38.388935] [DEBUG] [LOCAL ] ERJ: Trimmed 73083 records to 50666 (keeping 200 days of data) [2025-10-23T21:16:38.441713] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-23T21:16:38.686258] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T21:16:38.816164] [DEBUG] [LOCAL ] ERJ: Primary data saved (50666 records). [2025-10-23T21:16:38.816404] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-23T21:16:38.816555] [INFO ] [MAIN ] Update Progress: 762/2367 symbols completed. ERJ took 29.2s. Estimated remaining: 3h 23m 25s. Rate: 7.9 symbols/min [2025-10-23T21:16:39.083012] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:39.119543] [DEBUG] [LOCAL ] ESAB: Loaded 25928 existing records from primary storage. [2025-10-23T21:16:39.119974] [INFO ] [MAIN ] ESAB: Loaded 25928 existing records. [2025-10-23T21:16:39.209701] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-23T21:16:39.417945] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:39.418498] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-23T21:16:39.418687] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-23T21:16:39.418946] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-23T21:16:39.419023] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-23T21:16:39.826117] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-23T21:16:39.860193] [INFO ] [REMOTE ] ERO: Full fetch complete (60654 records). [2025-10-23T21:16:39.880471] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-23T21:16:39.884506] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:40.004568] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-23T21:16:40.286699] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-23T21:16:40.286822] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-23T21:16:40.287626] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-23T21:16:40.287722] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-23T21:16:40.289009] [DEBUG] [LOCAL ] ERO: Trimmed 60654 records to 42461 (keeping 200 days of data) [2025-10-23T21:16:40.533333] [DEBUG] [LOCAL ] ERO: Primary data saved (42461 records). [2025-10-23T21:16:40.533491] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-23T21:16:40.533633] [INFO ] [MAIN ] Update Progress: 763/2367 symbols completed. ERO took 30.9s. Estimated remaining: 3h 23m 5s. Rate: 7.9 symbols/min [2025-10-23T21:16:40.705016] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:40.740095] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-23T21:16:40.755307] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-23T21:16:40.755698] [DEBUG] [LOCAL ] ESE: Loaded 16465 existing records from primary storage. [2025-10-23T21:16:40.755937] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-23T21:16:40.756188] [INFO ] [MAIN ] ESE: Loaded 16465 existing records. [2025-10-23T21:16:41.074158] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:41.166256] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-23T21:16:41.187243] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-23T21:16:41.210050] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-23T21:16:41.210302] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-23T21:16:41.524478] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-23T21:16:41.555989] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-23T21:16:41.575456] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-23T21:16:41.620598] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T21:16:41.635625] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-23T21:16:41.649511] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-23T21:16:41.718975] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54075 (keeping 200 days of data) [2025-10-23T21:16:41.818374] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-23T21:16:41.867128] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:41.905437] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-23T21:16:42.140189] [DEBUG] [LOCAL ] EQT: Primary data saved (54075 records). [2025-10-23T21:16:42.140353] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-23T21:16:42.141382] [INFO ] [MAIN ] Update Progress: 764/2367 symbols completed. EQT took 32.6s. Estimated remaining: 3h 22m 45s. Rate: 7.9 symbols/min [2025-10-23T21:16:42.307244] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:42.356505] [DEBUG] [LOCAL ] ESI: Loaded 50618 existing records from primary storage. [2025-10-23T21:16:42.356868] [INFO ] [MAIN ] ESI: Loaded 50618 existing records. [2025-10-23T21:16:42.419829] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-23T21:16:42.537766] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:42.538004] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-23T21:16:42.538086] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-23T21:16:42.538311] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-23T21:16:42.538384] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-23T21:16:42.897701] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:42.912264] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T21:16:42.972378] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T21:16:43.199440] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-23T21:16:43.999467] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-23T21:16:44.324703] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T21:16:44.378031] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T21:16:44.799465] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-23T21:16:45.553147] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T21:16:45.599448] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-23T21:16:46.399454] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-23T21:16:46.626948] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T21:16:47.199448] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-23T21:16:47.855486] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T21:16:47.973931] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T21:16:47.999425] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-23T21:16:48.412001] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-23T21:16:48.799444] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-23T21:16:49.259679] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T21:16:49.599449] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-23T21:16:50.093934] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T21:16:50.399408] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-23T21:16:50.773888] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:16:51.199447] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-23T21:16:51.999406] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-23T21:16:52.346837] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T21:16:52.375856] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T21:16:52.799430] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-23T21:16:53.216503] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T21:16:53.593118] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:16:53.603410] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-23T21:16:54.399445] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-23T21:16:55.199417] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-23T21:16:55.411005] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T21:16:55.419888] [INFO ] [REMOTE ] ES: Full fetch complete (76096 records). [2025-10-23T21:16:55.420084] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-23T21:16:55.420951] [FATAL] [VALIDATOR ] ES: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T21:16:55.421036] [FATAL] [MAIN ] ES: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:16:55.421117] [WARN ] [MAIN ] ES: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:16:55.421192] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-23T21:16:55.421296] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-23T21:16:55.421425] [INFO ] [LOCAL ] ES: Starting deletion of derivative data. [2025-10-23T21:16:55.421667] [DEBUG] [LOCAL ] ES: Deleted derivative data file. [2025-10-23T21:16:55.421779] [INFO ] [MAIN ] Update Progress: 765/2367 symbols completed. ES took 32.0s. Estimated remaining: 3h 22m 49s. Rate: 7.9 symbols/min [2025-10-23T21:16:55.596526] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:16:55.627427] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T21:16:55.668323] [DEBUG] [LOCAL ] ESNT: Loaded 37977 existing records from primary storage. [2025-10-23T21:16:55.668670] [INFO ] [MAIN ] ESNT: Loaded 37977 existing records. [2025-10-23T21:16:55.842279] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:16:55.842521] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-23T21:16:55.842620] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-23T21:16:55.842904] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-23T21:16:55.842981] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-23T21:16:56.002962] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-23T21:16:56.205300] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:16:56.216047] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T21:16:56.799425] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-23T21:16:57.599478] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-23T21:16:58.031460] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T21:16:58.314290] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T21:16:58.399446] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-23T21:16:59.199439] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-23T21:16:59.326066] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T21:16:59.995552] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T21:17:00.001872] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-23T21:17:00.038695] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T21:17:00.799446] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-23T21:17:01.599442] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-23T21:17:01.914765] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T21:17:02.399463] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-23T21:17:02.506500] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:17:02.741996] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T21:17:03.199527] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-23T21:17:03.405993] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T21:17:03.413142] [INFO ] [REMOTE ] ESAB: Full fetch complete (36432 records). [2025-10-23T21:17:03.413326] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-23T21:17:03.789831] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-23T21:17:03.789953] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-23T21:17:03.790604] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-23T21:17:03.790706] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-23T21:17:03.791596] [DEBUG] [LOCAL ] ESAB: Trimmed 36432 records to 26116 (keeping 200 days of data) [2025-10-23T21:17:03.948039] [DEBUG] [LOCAL ] ESAB: Primary data saved (26116 records). [2025-10-23T21:17:03.948189] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-23T21:17:03.948303] [INFO ] [MAIN ] Update Progress: 766/2367 symbols completed. ESAB took 25.1s. Estimated remaining: 3h 22m 44s. Rate: 7.9 symbols/min [2025-10-23T21:17:04.011699] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-23T21:17:04.122025] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:04.161891] [DEBUG] [LOCAL ] ESRT: Loaded 46546 existing records from primary storage. [2025-10-23T21:17:04.162212] [INFO ] [MAIN ] ESRT: Loaded 46546 existing records. [2025-10-23T21:17:04.341041] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:04.341247] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-23T21:17:04.341320] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-23T21:17:04.341545] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-23T21:17:04.341617] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-23T21:17:04.705890] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:04.713519] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T21:17:04.799398] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-23T21:17:05.599499] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-23T21:17:05.769637] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T21:17:06.085717] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T21:17:06.399428] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-23T21:17:07.003847] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T21:17:07.199409] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-23T21:17:07.484332] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T21:17:07.487478] [INFO ] [REMOTE ] ESE: Full fetch complete (22961 records). [2025-10-23T21:17:07.487627] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-23T21:17:07.864555] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-23T21:17:07.864692] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-23T21:17:07.865197] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-23T21:17:07.865271] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-23T21:17:07.865970] [DEBUG] [LOCAL ] ESE: Trimmed 22961 records to 16534 (keeping 200 days of data) [2025-10-23T21:17:07.966062] [DEBUG] [LOCAL ] ESE: Primary data saved (16534 records). [2025-10-23T21:17:07.966223] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-23T21:17:07.966334] [INFO ] [MAIN ] Update Progress: 767/2367 symbols completed. ESE took 27.4s. Estimated remaining: 3h 22m 29s. Rate: 7.9 symbols/min [2025-10-23T21:17:08.004588] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-23T21:17:08.137442] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:08.167415] [DEBUG] [LOCAL ] ESS: Loaded 30164 existing records from primary storage. [2025-10-23T21:17:08.167788] [INFO ] [MAIN ] ESS: Loaded 30164 existing records. [2025-10-23T21:17:08.342953] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:08.343182] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-23T21:17:08.343256] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-23T21:17:08.343594] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-23T21:17:08.343702] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-23T21:17:08.699510] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:08.799410] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-23T21:17:09.103538] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T21:17:09.599420] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-23T21:17:09.783576] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T21:17:09.909085] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T21:17:10.399430] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-23T21:17:11.199436] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-23T21:17:11.505505] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T21:17:11.925089] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T21:17:11.999443] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-23T21:17:12.669362] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T21:17:12.799412] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-23T21:17:13.599489] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-23T21:17:13.879079] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T21:17:14.399457] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-23T21:17:14.536253] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T21:17:15.199444] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-23T21:17:15.497265] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T21:17:15.818237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T21:17:15.999502] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-23T21:17:16.799422] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-23T21:17:16.987529] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T21:17:17.599443] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-23T21:17:17.879756] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T21:17:17.974804] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T21:17:18.399471] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-23T21:17:19.199449] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-23T21:17:19.353016] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T21:17:19.999412] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-23T21:17:20.459759] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T21:17:20.800568] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-23T21:17:20.803009] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T21:17:21.599397] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-23T21:17:21.772780] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T21:17:22.399400] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-23T21:17:22.428626] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:17:23.199411] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-23T21:17:23.450110] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T21:17:23.459246] [INFO ] [REMOTE ] ESI: Full fetch complete (73293 records). [2025-10-23T21:17:23.459404] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-23T21:17:23.839182] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-23T21:17:23.839308] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-23T21:17:23.840218] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-23T21:17:23.840296] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-23T21:17:23.841958] [DEBUG] [LOCAL ] ESI: Trimmed 73293 records to 51006 (keeping 200 days of data) [2025-10-23T21:17:24.013399] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-23T21:17:24.173627] [DEBUG] [LOCAL ] ESI: Primary data saved (51006 records). [2025-10-23T21:17:24.175290] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-23T21:17:24.175219] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:17:24.175466] [INFO ] [MAIN ] Update Progress: 768/2367 symbols completed. ESI took 42.0s. Estimated remaining: 3h 22m 39s. Rate: 7.9 symbols/min [2025-10-23T21:17:24.353604] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:24.394561] [DEBUG] [LOCAL ] ESTC: Loaded 50253 existing records from primary storage. [2025-10-23T21:17:24.394906] [INFO ] [MAIN ] ESTC: Loaded 50253 existing records. [2025-10-23T21:17:24.570164] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:24.570421] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-23T21:17:24.570494] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-23T21:17:24.570842] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-23T21:17:24.570915] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-23T21:17:24.811546] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-23T21:17:24.947782] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:24.949450] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T21:17:25.308167] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T21:17:25.599474] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-23T21:17:26.399412] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-23T21:17:26.652212] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T21:17:27.199408] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-23T21:17:27.381103] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T21:17:27.999425] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-23T21:17:28.324147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T21:17:28.776236] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T21:17:28.799400] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-23T21:17:29.599416] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-23T21:17:29.754458] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T21:17:29.762775] [INFO ] [REMOTE ] ESRT: Full fetch complete (66806 records). [2025-10-23T21:17:29.762973] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-23T21:17:30.156423] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-23T21:17:30.156529] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-23T21:17:30.157388] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-23T21:17:30.157467] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-23T21:17:30.158796] [DEBUG] [LOCAL ] ESRT: Trimmed 66806 records to 46911 (keeping 200 days of data) [2025-10-23T21:17:30.440541] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T21:17:30.409124] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-23T21:17:30.459028] [DEBUG] [LOCAL ] ESRT: Primary data saved (46911 records). [2025-10-23T21:17:30.459281] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-23T21:17:30.459399] [INFO ] [MAIN ] Update Progress: 769/2367 symbols completed. ESRT took 26.5s. Estimated remaining: 3h 22m 29s. Rate: 7.9 symbols/min [2025-10-23T21:17:30.627907] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:30.677825] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-23T21:17:30.678186] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-23T21:17:30.856906] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:30.857153] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-23T21:17:30.857231] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-23T21:17:30.857452] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-23T21:17:30.857524] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-23T21:17:31.204690] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-23T21:17:31.287769] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:31.433895] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T21:17:31.999488] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-23T21:17:32.324693] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T21:17:32.661776] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T21:17:32.667281] [INFO ] [REMOTE ] ESS: Full fetch complete (43914 records). [2025-10-23T21:17:32.667402] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-23T21:17:32.810579] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-23T21:17:33.044396] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-23T21:17:33.044509] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-23T21:17:33.045222] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-23T21:17:33.045300] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-23T21:17:33.046218] [DEBUG] [LOCAL ] ESS: Trimmed 43914 records to 30386 (keeping 200 days of data) [2025-10-23T21:17:33.229955] [DEBUG] [LOCAL ] ESS: Primary data saved (30386 records). [2025-10-23T21:17:33.230110] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-23T21:17:33.230201] [INFO ] [MAIN ] Update Progress: 770/2367 symbols completed. ESS took 25.3s. Estimated remaining: 3h 22m 11s. Rate: 7.9 symbols/min [2025-10-23T21:17:33.395081] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:33.408339] [DEBUG] [LOCAL ] ETB: Loaded 11764 existing records from primary storage. [2025-10-23T21:17:33.408597] [INFO ] [MAIN ] ETB: Loaded 11764 existing records. [2025-10-23T21:17:33.600176] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-23T21:17:33.604016] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:33.605275] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-23T21:17:33.605355] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-23T21:17:33.605697] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-23T21:17:33.605777] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-23T21:17:33.955106] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:34.404566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-23T21:17:34.422949] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-23T21:17:34.463820] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T21:17:35.199447] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-23T21:17:35.382625] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T21:17:35.963243] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-23T21:17:35.999406] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-23T21:17:36.799467] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-23T21:17:36.845935] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T21:17:36.852711] [INFO ] [REMOTE ] ESNT: Full fetch complete (57107 records). [2025-10-23T21:17:36.852880] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-23T21:17:37.239783] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-23T21:17:37.239959] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-23T21:17:37.240895] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-23T21:17:37.241003] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-23T21:17:37.242404] [DEBUG] [LOCAL ] ESNT: Trimmed 57107 records to 38188 (keeping 200 days of data) [2025-10-23T21:17:37.465906] [DEBUG] [LOCAL ] ESNT: Primary data saved (38188 records). [2025-10-23T21:17:37.466076] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-23T21:17:37.466206] [INFO ] [MAIN ] Update Progress: 771/2367 symbols completed. ESNT took 42.0s. Estimated remaining: 3h 21m 56s. Rate: 7.9 symbols/min [2025-10-23T21:17:37.610905] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-23T21:17:37.641997] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:37.668827] [DEBUG] [LOCAL ] ETD: Loaded 27141 existing records from primary storage. [2025-10-23T21:17:37.669109] [INFO ] [MAIN ] ETD: Loaded 27141 existing records. [2025-10-23T21:17:37.845445] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:37.845674] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-23T21:17:37.845741] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-23T21:17:37.845946] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-23T21:17:37.846019] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-23T21:17:37.965125] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T21:17:38.226630] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:38.254069] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-23T21:17:38.399467] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-23T21:17:39.199460] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-23T21:17:39.578434] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T21:17:39.767048] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T21:17:39.999415] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-23T21:17:40.282005] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T21:17:40.799446] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-23T21:17:41.599415] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-23T21:17:41.916531] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T21:17:42.023982] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T21:17:42.399471] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-23T21:17:42.723969] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-23T21:17:43.199503] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-23T21:17:43.999421] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-23T21:17:44.143113] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T21:17:44.807316] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-23T21:17:44.812991] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-23T21:17:45.298974] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-23T21:17:45.599449] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-23T21:17:46.399435] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-23T21:17:46.741049] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T21:17:47.199454] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-23T21:17:47.287028] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T21:17:47.999432] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-23T21:17:48.135682] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-23T21:17:48.799482] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-23T21:17:49.025770] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T21:17:49.092715] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T21:17:49.599450] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-23T21:17:50.399505] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-23T21:17:50.641915] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:17:51.199426] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-23T21:17:51.361397] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-23T21:17:51.999405] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-23T21:17:52.799425] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-23T21:17:53.086444] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-23T21:17:53.599410] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-23T21:17:53.726774] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-23T21:17:53.901010] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T21:17:54.225632] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-23T21:17:54.399429] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-23T21:17:55.199430] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-23T21:17:55.433411] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:17:55.999451] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-23T21:17:56.192317] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T21:17:56.195020] [INFO ] [REMOTE ] ETB: Full fetch complete (18472 records). [2025-10-23T21:17:56.195111] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-23T21:17:56.559209] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-23T21:17:56.559330] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-23T21:17:56.559871] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-23T21:17:56.559986] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-23T21:17:56.560536] [DEBUG] [LOCAL ] ETB: Trimmed 18472 records to 11826 (keeping 200 days of data) [2025-10-23T21:17:56.631590] [DEBUG] [LOCAL ] ETB: Primary data saved (11826 records). [2025-10-23T21:17:56.631778] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-23T21:17:56.631926] [INFO ] [MAIN ] Update Progress: 772/2367 symbols completed. ETB took 23.4s. Estimated remaining: 3h 22m 13s. Rate: 7.9 symbols/min [2025-10-23T21:17:56.800254] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:56.800433] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-23T21:17:56.800974] [DEBUG] [LOCAL ] ETG: No existing data file found in primary storage. [2025-10-23T21:17:56.802270] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-10-23T21:17:56.802483] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-23T21:17:56.802889] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-23T21:17:56.802997] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-23T21:17:56.803067] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-23T21:17:57.168232] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:17:57.214948] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-23T21:17:57.405256] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T21:17:57.599437] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-23T21:17:58.399426] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-23T21:17:58.832236] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-23T21:17:58.841005] [INFO ] [REMOTE ] ESTC: Full fetch complete (72456 records). [2025-10-23T21:17:58.841155] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-23T21:17:59.204838] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-23T21:17:59.227718] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-23T21:17:59.227825] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-23T21:17:59.228836] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-23T21:17:59.229002] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-23T21:17:59.230487] [DEBUG] [LOCAL ] ESTC: Trimmed 72456 records to 50579 (keeping 200 days of data) [2025-10-23T21:17:59.449070] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T21:17:59.557638] [DEBUG] [LOCAL ] ESTC: Primary data saved (50579 records). [2025-10-23T21:17:59.558008] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-23T21:17:59.558207] [INFO ] [MAIN ] Update Progress: 773/2367 symbols completed. ESTC took 35.4s. Estimated remaining: 3h 21m 56s. Rate: 7.9 symbols/min [2025-10-23T21:17:59.738853] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:17:59.773233] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T21:17:59.796261] [DEBUG] [LOCAL ] ETJ: Loaded 16449 existing records from primary storage. [2025-10-23T21:17:59.796563] [INFO ] [MAIN ] ETJ: Loaded 16449 existing records. [2025-10-23T21:17:59.971867] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:17:59.972098] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-23T21:17:59.972193] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-23T21:17:59.972404] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-23T21:17:59.972487] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-23T21:18:00.004615] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-23T21:18:00.348098] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:00.568874] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T21:18:00.799440] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-23T21:18:01.599441] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-23T21:18:02.131733] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T21:18:02.399430] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-23T21:18:02.516619] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-23T21:18:02.915209] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T21:18:03.199464] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-23T21:18:03.213266] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T21:18:03.999468] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-23T21:18:04.738541] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T21:18:04.799394] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-23T21:18:05.599453] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-23T21:18:06.158429] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T21:18:06.337609] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-23T21:18:06.347012] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-23T21:18:06.347185] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-23T21:18:06.411018] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-23T21:18:06.740745] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-23T21:18:06.740870] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-23T21:18:06.742043] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-23T21:18:06.742212] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-23T21:18:06.752794] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T21:18:06.757232] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54179 (keeping 200 days of data) [2025-10-23T21:18:07.076542] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-23T21:18:07.076712] [INFO ] [MAIN ] ET: Full history saved. [2025-10-23T21:18:07.076822] [INFO ] [MAIN ] Update Progress: 774/2367 symbols completed. ET took 36.6s. Estimated remaining: 3h 21m 48s. Rate: 7.9 symbols/min [2025-10-23T21:18:07.204510] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-23T21:18:07.247710] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:07.298320] [DEBUG] [LOCAL ] ETN: Loaded 52571 existing records from primary storage. [2025-10-23T21:18:07.298693] [INFO ] [MAIN ] ETN: Loaded 52571 existing records. [2025-10-23T21:18:07.477817] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:18:07.478031] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-23T21:18:07.478111] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-23T21:18:07.478442] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-23T21:18:07.478517] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-23T21:18:07.784444] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T21:18:07.847956] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:07.999466] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-23T21:18:08.540948] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T21:18:08.545423] [INFO ] [REMOTE ] ETD: Full fetch complete (38568 records). [2025-10-23T21:18:08.545527] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-23T21:18:08.804674] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-23T21:18:08.908047] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-23T21:18:08.908150] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-23T21:18:08.908818] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-23T21:18:08.908895] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-23T21:18:08.909726] [DEBUG] [LOCAL ] ETD: Trimmed 38568 records to 27262 (keeping 200 days of data) [2025-10-23T21:18:09.070891] [DEBUG] [LOCAL ] ETD: Primary data saved (27262 records). [2025-10-23T21:18:09.071398] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-23T21:18:09.071510] [INFO ] [MAIN ] Update Progress: 775/2367 symbols completed. ETD took 31.6s. Estimated remaining: 3h 21m 29s. Rate: 7.9 symbols/min [2025-10-23T21:18:09.235081] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:09.242893] [DEBUG] [LOCAL ] ETO: Loaded 6892 existing records from primary storage. [2025-10-23T21:18:09.243122] [INFO ] [MAIN ] ETO: Loaded 6892 existing records. [2025-10-23T21:18:09.415039] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:18:09.415229] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-23T21:18:09.415303] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-23T21:18:09.415924] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-23T21:18:09.415997] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-23T21:18:09.620091] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-23T21:18:09.771709] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:09.971803] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T21:18:10.144128] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-23T21:18:10.399438] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-23T21:18:11.103001] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T21:18:11.199407] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-23T21:18:11.326445] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T21:18:11.999460] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-23T21:18:12.124871] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T21:18:12.799454] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-23T21:18:13.022380] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T21:18:13.599459] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-23T21:18:13.820319] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T21:18:14.399482] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-23T21:18:14.802433] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T21:18:15.199480] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-23T21:18:15.544802] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:18:15.966457] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T21:18:15.999445] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-23T21:18:16.799433] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-23T21:18:17.134468] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T21:18:17.599459] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-23T21:18:17.679320] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T21:18:18.399482] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-23T21:18:18.860124] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T21:18:19.199455] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-23T21:18:19.999511] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-23T21:18:20.347781] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T21:18:20.799483] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-23T21:18:20.884759] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T21:18:21.038898] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-23T21:18:21.599414] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-23T21:18:21.958781] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T21:18:22.125421] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T21:18:22.399437] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-23T21:18:23.199413] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-23T21:18:23.999423] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-23T21:18:24.061617] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T21:18:24.672854] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-23T21:18:24.799420] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-23T21:18:25.012118] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T21:18:25.599443] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-23T21:18:25.972066] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T21:18:25.975236] [INFO ] [REMOTE ] ETJ: Full fetch complete (25436 records). [2025-10-23T21:18:25.975344] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-23T21:18:26.263737] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T21:18:26.345693] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-23T21:18:26.345802] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-23T21:18:26.346278] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-23T21:18:26.346355] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-23T21:18:26.347006] [DEBUG] [LOCAL ] ETJ: Trimmed 25436 records to 16510 (keeping 200 days of data) [2025-10-23T21:18:26.415208] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-23T21:18:26.449021] [DEBUG] [LOCAL ] ETJ: Primary data saved (16510 records). [2025-10-23T21:18:26.449203] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-23T21:18:26.449396] [INFO ] [MAIN ] Update Progress: 776/2367 symbols completed. ETJ took 26.9s. Estimated remaining: 3h 21m 41s. Rate: 7.9 symbols/min [2025-10-23T21:18:26.614290] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:26.614482] [DEBUG] [LOCAL ] ETR: No existing data file found in primary storage. [2025-10-23T21:18:26.614555] [WARN ] [MAIN ] ETR: No existing data found, performing full refresh instead. [2025-10-23T21:18:26.614771] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-23T21:18:26.614843] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-23T21:18:26.614923] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-10-23T21:18:26.614990] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-23T21:18:26.954324] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:27.199459] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-23T21:18:27.999420] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-23T21:18:28.331939] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T21:18:28.685982] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-23T21:18:28.724222] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T21:18:28.799413] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-23T21:18:29.599423] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-23T21:18:29.626776] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:18:30.399442] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-23T21:18:31.199462] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-23T21:18:31.522628] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T21:18:31.999465] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-23T21:18:32.311300] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T21:18:32.314682] [INFO ] [REMOTE ] ETG: Full fetch complete (24592 records). [2025-10-23T21:18:32.314820] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-23T21:18:32.719350] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-23T21:18:32.719514] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-23T21:18:32.720098] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-23T21:18:32.720296] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-23T21:18:32.721192] [DEBUG] [LOCAL ] ETG: Trimmed 24592 records to 16587 (keeping 200 days of data) [2025-10-23T21:18:32.802425] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-23T21:18:32.836033] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-23T21:18:32.864051] [DEBUG] [LOCAL ] ETG: Primary data saved (16587 records). [2025-10-23T21:18:32.865682] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-23T21:18:32.865832] [INFO ] [MAIN ] Update Progress: 777/2367 symbols completed. ETG took 36.2s. Estimated remaining: 3h 21m 31s. Rate: 7.9 symbols/min [2025-10-23T21:18:33.039895] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:33.091063] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-23T21:18:33.091425] [INFO ] [MAIN ] ETSY: Loaded 53569 existing records. [2025-10-23T21:18:33.268232] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:18:33.268438] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-23T21:18:33.268513] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-23T21:18:33.268763] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-23T21:18:33.268838] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-23T21:18:33.599852] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-23T21:18:33.631524] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:33.790392] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T21:18:33.792535] [INFO ] [REMOTE ] ETO: Full fetch complete (9679 records). [2025-10-23T21:18:33.792624] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-23T21:18:34.187443] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-23T21:18:34.187622] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-23T21:18:34.188217] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-23T21:18:34.190342] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-23T21:18:34.190223] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-23T21:18:34.202138] [DEBUG] [LOCAL ] ETO: Trimmed 9679 records to 6917 (keeping 200 days of data) [2025-10-23T21:18:34.247664] [DEBUG] [LOCAL ] ETO: Primary data saved (6917 records). [2025-10-23T21:18:34.247847] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-23T21:18:34.247971] [INFO ] [MAIN ] Update Progress: 778/2367 symbols completed. ETO took 25.2s. Estimated remaining: 3h 21m 11s. Rate: 7.9 symbols/min [2025-10-23T21:18:34.399622] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-23T21:18:34.429185] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:34.454057] [DEBUG] [LOCAL ] ETV: Loaded 21830 existing records from primary storage. [2025-10-23T21:18:34.454407] [INFO ] [MAIN ] ETV: Loaded 21830 existing records. [2025-10-23T21:18:34.634074] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:18:34.634344] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-23T21:18:34.634424] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-23T21:18:34.634850] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-23T21:18:34.634926] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-23T21:18:34.986884] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:35.199412] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-23T21:18:35.293077] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:18:35.999438] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-23T21:18:36.466748] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T21:18:36.799408] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-23T21:18:37.290324] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T21:18:37.599495] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-23T21:18:38.400286] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-23T21:18:38.400350] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-23T21:18:38.815029] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-23T21:18:39.199420] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-23T21:18:39.600281] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T21:18:39.869782] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T21:18:39.999433] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-23T21:18:40.799510] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-23T21:18:41.278066] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T21:18:41.564260] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-23T21:18:41.599481] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-23T21:18:42.399424] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-23T21:18:42.765376] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T21:18:42.885427] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T21:18:43.199449] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-23T21:18:43.480489] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T21:18:43.999449] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-23T21:18:44.799435] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-23T21:18:45.088130] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T21:18:45.140240] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T21:18:45.599455] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-23T21:18:46.399417] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-23T21:18:47.199409] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-23T21:18:47.497789] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-23T21:18:47.537625] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T21:18:47.646903] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T21:18:47.999487] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-23T21:18:48.799463] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-23T21:18:49.168083] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:18:49.372848] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-23T21:18:49.381905] [INFO ] [REMOTE ] ETN: Full fetch complete (76639 records). [2025-10-23T21:18:49.382056] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-23T21:18:49.608344] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-23T21:18:49.777472] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-23T21:18:49.777596] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-23T21:18:49.778616] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-23T21:18:49.778736] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-23T21:18:49.780353] [DEBUG] [LOCAL ] ETN: Trimmed 76639 records to 52954 (keeping 200 days of data) [2025-10-23T21:18:50.102039] [DEBUG] [LOCAL ] ETN: Primary data saved (52954 records). [2025-10-23T21:18:50.102193] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-23T21:18:50.103732] [INFO ] [MAIN ] Update Progress: 779/2367 symbols completed. ETN took 43.0s. Estimated remaining: 3h 21m 20s. Rate: 7.9 symbols/min [2025-10-23T21:18:50.272917] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:50.296768] [DEBUG] [LOCAL ] ETW: Loaded 25106 existing records from primary storage. [2025-10-23T21:18:50.297044] [INFO ] [MAIN ] ETW: Loaded 25106 existing records. [2025-10-23T21:18:50.399619] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-23T21:18:50.481983] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:18:50.482197] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-23T21:18:50.482271] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-23T21:18:50.482488] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-23T21:18:50.482562] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-23T21:18:50.837254] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:50.895908] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T21:18:51.016100] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T21:18:51.199402] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-23T21:18:51.999420] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-23T21:18:52.799422] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-23T21:18:53.240830] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T21:18:53.266095] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T21:18:53.599401] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-23T21:18:53.613168] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T21:18:54.399427] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-23T21:18:54.801620] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T21:18:55.199451] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-23T21:18:55.741429] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-23T21:18:55.999412] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-23T21:18:56.249748] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T21:18:56.523606] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (6.12 seconds). [2025-10-23T21:18:56.799435] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-23T21:18:57.323617] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T21:18:57.328313] [INFO ] [REMOTE ] ETV: Full fetch complete (32184 records). [2025-10-23T21:18:57.328418] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-23T21:18:57.607439] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-23T21:18:57.694681] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-23T21:18:57.694790] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-23T21:18:57.695448] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-23T21:18:57.695530] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-23T21:18:57.696326] [DEBUG] [LOCAL ] ETV: Trimmed 32184 records to 21947 (keeping 200 days of data) [2025-10-23T21:18:57.825227] [DEBUG] [LOCAL ] ETV: Primary data saved (21947 records). [2025-10-23T21:18:57.825360] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-23T21:18:57.825466] [INFO ] [MAIN ] Update Progress: 780/2367 symbols completed. ETV took 23.6s. Estimated remaining: 3h 21m 13s. Rate: 7.9 symbols/min [2025-10-23T21:18:57.994589] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:18:58.002325] [DEBUG] [LOCAL ] ETX: Loaded 5336 existing records from primary storage. [2025-10-23T21:18:58.002558] [INFO ] [MAIN ] ETX: Loaded 5336 existing records. [2025-10-23T21:18:58.181135] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:18:58.181356] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-23T21:18:58.181432] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-23T21:18:58.181620] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-23T21:18:58.181726] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-23T21:18:58.419135] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-23T21:18:58.539157] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:18:58.841575] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T21:18:58.882080] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-23T21:18:59.199428] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-23T21:18:59.999414] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-23T21:19:00.117854] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:19:00.491908] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-23T21:19:00.799417] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-23T21:19:01.252124] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T21:19:01.263173] [INFO ] [REMOTE ] ETR: Full fetch complete (77268 records). [2025-10-23T21:19:01.263441] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-23T21:19:01.609452] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-23T21:19:01.689991] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-23T21:19:01.690138] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-23T21:19:01.691310] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-23T21:19:01.691411] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-23T21:19:01.693451] [DEBUG] [LOCAL ] ETR: Trimmed 77268 records to 53572 (keeping 200 days of data) [2025-10-23T21:19:02.029083] [DEBUG] [LOCAL ] ETR: Primary data saved (53572 records). [2025-10-23T21:19:02.029284] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-23T21:19:02.029397] [INFO ] [MAIN ] Update Progress: 781/2367 symbols completed. ETR took 35.6s. Estimated remaining: 3h 20m 58s. Rate: 7.9 symbols/min [2025-10-23T21:19:02.200429] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:02.200691] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-10-23T21:19:02.200765] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-10-23T21:19:02.200879] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-23T21:19:02.200950] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-23T21:19:02.201032] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-23T21:19:02.201101] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-23T21:19:02.409522] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-23T21:19:02.465425] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T21:19:02.586018] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:02.799514] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T21:19:03.199431] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-23T21:19:03.795438] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T21:19:03.899026] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-23T21:19:03.999398] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-23T21:19:04.653422] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-23T21:19:04.799462] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-23T21:19:05.599423] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-23T21:19:05.721089] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T21:19:06.399434] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-23T21:19:06.840843] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T21:19:07.199449] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-23T21:19:07.999433] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-23T21:19:08.440136] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T21:19:08.514766] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T21:19:08.799425] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-23T21:19:08.886215] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T21:19:09.599503] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-23T21:19:09.963192] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T21:19:10.399469] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-23T21:19:11.100070] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-23T21:19:11.199422] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-23T21:19:11.672356] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T21:19:11.838845] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T21:19:11.999465] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-23T21:19:12.799440] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-23T21:19:13.338231] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T21:19:13.599455] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-23T21:19:13.630605] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:19:14.399458] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-23T21:19:15.199425] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-23T21:19:15.535388] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T21:19:15.544841] [INFO ] [REMOTE ] ETSY: Full fetch complete (77658 records). [2025-10-23T21:19:15.544992] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-23T21:19:15.935804] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T21:19:15.963988] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-23T21:19:15.964419] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-23T21:19:15.965454] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-23T21:19:15.965540] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-23T21:19:15.967030] [DEBUG] [LOCAL ] ETSY: Trimmed 77658 records to 53952 (keeping 200 days of data) [2025-10-23T21:19:16.015487] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-23T21:19:16.280492] [DEBUG] [LOCAL ] ETSY: Primary data saved (53952 records). [2025-10-23T21:19:16.280693] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-23T21:19:16.280807] [INFO ] [MAIN ] Update Progress: 782/2367 symbols completed. ETSY took 43.4s. Estimated remaining: 3h 21m 4s. Rate: 7.9 symbols/min [2025-10-23T21:19:16.452270] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:16.470549] [DEBUG] [LOCAL ] EVC: Loaded 17862 existing records from primary storage. [2025-10-23T21:19:16.470827] [INFO ] [MAIN ] EVC: Loaded 17862 existing records. [2025-10-23T21:19:16.649678] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:16.649881] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-23T21:19:16.649954] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-23T21:19:16.650141] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-23T21:19:16.650215] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-23T21:19:16.809385] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-23T21:19:16.848719] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T21:19:17.047068] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:17.340538] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T21:19:17.599408] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-23T21:19:17.649542] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T21:19:17.651000] [INFO ] [REMOTE ] ETX: Full fetch complete (6795 records). [2025-10-23T21:19:17.651087] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-23T21:19:18.025364] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-23T21:19:18.025487] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-23T21:19:18.025812] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-23T21:19:18.025909] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-23T21:19:18.026398] [DEBUG] [LOCAL ] ETX: Trimmed 6795 records to 5361 (keeping 200 days of data) [2025-10-23T21:19:18.061864] [DEBUG] [LOCAL ] ETX: Primary data saved (5361 records). [2025-10-23T21:19:18.062051] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-23T21:19:18.062191] [INFO ] [MAIN ] Update Progress: 783/2367 symbols completed. ETX took 20.2s. Estimated remaining: 3h 20m 45s. Rate: 7.9 symbols/min [2025-10-23T21:19:18.230244] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:18.261226] [DEBUG] [LOCAL ] EVEX: Loaded 33091 existing records from primary storage. [2025-10-23T21:19:18.261525] [INFO ] [MAIN ] EVEX: Loaded 33091 existing records. [2025-10-23T21:19:18.404702] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-23T21:19:18.445852] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:18.446220] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-23T21:19:18.446315] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-23T21:19:18.446548] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-23T21:19:18.446633] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-23T21:19:18.800025] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:19.199418] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-23T21:19:19.912936] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T21:19:19.966740] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-23T21:19:19.999397] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-23T21:19:20.584940] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T21:19:20.799438] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-23T21:19:21.045881] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T21:19:21.599464] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-23T21:19:22.043617] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T21:19:22.399419] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-23T21:19:23.199419] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-23T21:19:23.571292] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T21:19:23.593506] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T21:19:23.999447] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-23T21:19:24.601505] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T21:19:24.799507] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-23T21:19:25.289931] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T21:19:25.599433] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-23T21:19:26.093447] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T21:19:26.399408] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-23T21:19:26.546135] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T21:19:27.199481] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-23T21:19:27.744016] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T21:19:27.999428] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-23T21:19:28.583967] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T21:19:28.799444] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-23T21:19:29.257005] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T21:19:29.599457] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-23T21:19:30.091730] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T21:19:30.096503] [INFO ] [REMOTE ] ETW: Full fetch complete (36425 records). [2025-10-23T21:19:30.096635] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-23T21:19:30.403053] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-23T21:19:30.510212] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-23T21:19:30.510328] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-23T21:19:30.511048] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-23T21:19:30.511129] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-23T21:19:30.512057] [DEBUG] [LOCAL ] ETW: Trimmed 36425 records to 25243 (keeping 200 days of data) [2025-10-23T21:19:30.677020] [DEBUG] [LOCAL ] ETW: Primary data saved (25243 records). [2025-10-23T21:19:30.677242] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-23T21:19:30.677368] [INFO ] [MAIN ] Update Progress: 784/2367 symbols completed. ETW took 40.6s. Estimated remaining: 3h 20m 47s. Rate: 7.9 symbols/min [2025-10-23T21:19:30.887309] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T21:19:30.891713] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:30.908607] [DEBUG] [LOCAL ] EVF: Loaded 9694 existing records from primary storage. [2025-10-23T21:19:30.908923] [INFO ] [MAIN ] EVF: Loaded 9694 existing records. [2025-10-23T21:19:31.112014] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:31.112305] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-23T21:19:31.112387] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-23T21:19:31.112613] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-23T21:19:31.112745] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-23T21:19:31.204755] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-23T21:19:31.479295] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:31.655165] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:19:31.999447] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-23T21:19:32.642425] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T21:19:32.799423] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-23T21:19:33.302397] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T21:19:33.309996] [INFO ] [REMOTE ] ETY: Full fetch complete (33882 records). [2025-10-23T21:19:33.310223] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-23T21:19:33.604723] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-23T21:19:33.790462] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-23T21:19:33.790683] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-23T21:19:33.791635] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-23T21:19:33.791757] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-23T21:19:33.792872] [DEBUG] [LOCAL ] ETY: Trimmed 33882 records to 22481 (keeping 200 days of data) [2025-10-23T21:19:33.933207] [DEBUG] [LOCAL ] ETY: Primary data saved (22481 records). [2025-10-23T21:19:33.933480] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-23T21:19:33.967331] [INFO ] [MAIN ] Update Progress: 785/2367 symbols completed. ETY took 31.9s. Estimated remaining: 3h 20m 31s. Rate: 7.9 symbols/min [2025-10-23T21:19:33.980111] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T21:19:34.146597] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:34.154851] [DEBUG] [LOCAL ] EVG: Loaded 5750 existing records from primary storage. [2025-10-23T21:19:34.155079] [INFO ] [MAIN ] EVG: Loaded 5750 existing records. [2025-10-23T21:19:34.343565] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:34.343843] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-23T21:19:34.343928] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-23T21:19:34.344147] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-23T21:19:34.344230] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-23T21:19:34.411550] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-23T21:19:34.711210] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:34.869496] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T21:19:35.199499] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-23T21:19:35.255233] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T21:19:35.945539] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T21:19:35.999468] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-23T21:19:36.717690] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T21:19:36.799462] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-23T21:19:37.570335] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T21:19:37.599434] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-23T21:19:38.399443] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-23T21:19:38.499128] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-23T21:19:39.199466] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-23T21:19:39.593878] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T21:19:39.999469] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-23T21:19:40.040607] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T21:19:40.799421] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-23T21:19:41.537005] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T21:19:41.599456] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-23T21:19:41.755985] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T21:19:42.399491] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-23T21:19:42.574387] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T21:19:42.577857] [INFO ] [REMOTE ] EVC: Full fetch complete (28731 records). [2025-10-23T21:19:42.577971] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-23T21:19:42.961887] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-23T21:19:42.962050] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-23T21:19:42.963582] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-23T21:19:42.963694] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-23T21:19:42.964778] [DEBUG] [LOCAL ] EVC: Trimmed 28731 records to 17929 (keeping 200 days of data) [2025-10-23T21:19:43.077198] [DEBUG] [LOCAL ] EVC: Primary data saved (17929 records). [2025-10-23T21:19:43.077431] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-23T21:19:43.077572] [INFO ] [MAIN ] Update Progress: 786/2367 symbols completed. EVC took 26.8s. Estimated remaining: 3h 20m 26s. Rate: 7.9 symbols/min [2025-10-23T21:19:43.204623] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-23T21:19:43.257545] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:43.263077] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T21:19:43.316916] [DEBUG] [LOCAL ] EVH: Loaded 49602 existing records from primary storage. [2025-10-23T21:19:43.317454] [INFO ] [MAIN ] EVH: Loaded 49602 existing records. [2025-10-23T21:19:43.538279] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:43.538582] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-23T21:19:43.538712] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-23T21:19:43.539087] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-23T21:19:43.539165] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-23T21:19:43.925590] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:43.999496] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-23T21:19:44.799439] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-23T21:19:45.002877] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T21:19:45.599428] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-23T21:19:45.744399] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T21:19:45.811698] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T21:19:46.199737] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-23T21:19:46.399498] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-23T21:19:47.199494] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-23T21:19:47.486808] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T21:19:47.999420] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-23T21:19:48.042385] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T21:19:48.799469] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-23T21:19:48.937834] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-23T21:19:49.599461] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-23T21:19:50.399413] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-23T21:19:50.590178] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T21:19:51.199427] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-23T21:19:51.270247] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-23T21:19:51.443299] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T21:19:51.999443] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-23T21:19:52.801394] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-23T21:19:52.802397] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T21:19:53.033230] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T21:19:53.599440] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-23T21:19:54.399434] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-23T21:19:54.987264] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-23T21:19:54.995709] [INFO ] [REMOTE ] EVEX: Full fetch complete (44189 records). [2025-10-23T21:19:54.995834] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-23T21:19:55.222111] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-23T21:19:55.323163] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T21:19:55.407758] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-23T21:19:55.407885] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-23T21:19:55.408835] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-23T21:19:55.408928] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-23T21:19:55.410101] [DEBUG] [LOCAL ] EVEX: Trimmed 44189 records to 33354 (keeping 200 days of data) [2025-10-23T21:19:55.605699] [DEBUG] [LOCAL ] EVEX: Primary data saved (33354 records). [2025-10-23T21:19:55.624870] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-23T21:19:55.625059] [INFO ] [MAIN ] Update Progress: 787/2367 symbols completed. EVEX took 37.6s. Estimated remaining: 3h 20m 29s. Rate: 7.9 symbols/min [2025-10-23T21:19:55.660852] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T21:19:55.822075] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:55.834718] [DEBUG] [LOCAL ] EVN: Loaded 10780 existing records from primary storage. [2025-10-23T21:19:55.834986] [INFO ] [MAIN ] EVN: Loaded 10780 existing records. [2025-10-23T21:19:56.007212] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-23T21:19:56.013595] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:56.015524] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-23T21:19:56.015606] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-23T21:19:56.015834] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-23T21:19:56.015908] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-23T21:19:56.102774] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T21:19:56.380458] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:56.799462] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-23T21:19:57.128348] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T21:19:57.131416] [INFO ] [REMOTE ] EVF: Full fetch complete (12875 records). [2025-10-23T21:19:57.131562] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-23T21:19:57.519106] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-23T21:19:57.519252] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-23T21:19:57.519798] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-23T21:19:57.519880] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-23T21:19:57.520452] [DEBUG] [LOCAL ] EVF: Trimmed 12875 records to 9771 (keeping 200 days of data) [2025-10-23T21:19:57.580542] [DEBUG] [LOCAL ] EVF: Primary data saved (9771 records). [2025-10-23T21:19:57.580801] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-23T21:19:57.580971] [INFO ] [MAIN ] Update Progress: 788/2367 symbols completed. EVF took 26.9s. Estimated remaining: 3h 20m 10s. Rate: 7.9 symbols/min [2025-10-23T21:19:57.604789] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-23T21:19:57.760341] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:19:57.797637] [DEBUG] [LOCAL ] EVR: Loaded 33601 existing records from primary storage. [2025-10-23T21:19:57.798138] [INFO ] [MAIN ] EVR: Loaded 33601 existing records. [2025-10-23T21:19:58.004586] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:19:58.005240] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-23T21:19:58.005346] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-23T21:19:58.005819] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-23T21:19:58.005900] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-23T21:19:58.134029] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T21:19:58.404982] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-23T21:19:58.431827] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:19:58.566623] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T21:19:59.199453] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-23T21:19:59.999448] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-23T21:20:00.379230] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T21:20:00.449253] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T21:20:00.586352] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T21:20:00.799458] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-23T21:20:01.599536] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-23T21:20:01.694419] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T21:20:01.696447] [INFO ] [REMOTE ] EVG: Full fetch complete (8073 records). [2025-10-23T21:20:01.696552] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-23T21:20:02.119278] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-23T21:20:02.119423] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-23T21:20:02.119846] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-23T21:20:02.119931] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-23T21:20:02.120419] [DEBUG] [LOCAL ] EVG: Trimmed 8073 records to 5779 (keeping 200 days of data) [2025-10-23T21:20:02.157558] [DEBUG] [LOCAL ] EVG: Primary data saved (5779 records). [2025-10-23T21:20:02.157807] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-23T21:20:02.157950] [INFO ] [MAIN ] Update Progress: 789/2367 symbols completed. EVG took 28.2s. Estimated remaining: 3h 19m 56s. Rate: 7.9 symbols/min [2025-10-23T21:20:02.341399] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:02.360891] [DEBUG] [LOCAL ] EVT: Loaded 16515 existing records from primary storage. [2025-10-23T21:20:02.361250] [INFO ] [MAIN ] EVT: Loaded 16515 existing records. [2025-10-23T21:20:02.404766] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-23T21:20:02.569812] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:02.570192] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-23T21:20:02.570288] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-23T21:20:02.570679] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-23T21:20:02.570767] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-23T21:20:02.984616] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:03.199422] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-23T21:20:03.470603] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T21:20:03.503862] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T21:20:03.999496] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-23T21:20:04.799498] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-23T21:20:05.092847] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T21:20:05.599495] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-23T21:20:05.802771] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:20:05.863627] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T21:20:06.399459] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-23T21:20:06.602866] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T21:20:07.188257] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T21:20:07.199397] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-23T21:20:07.999413] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-23T21:20:08.141618] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T21:20:08.799448] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-23T21:20:09.196312] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T21:20:09.599449] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-23T21:20:09.732907] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T21:20:10.399426] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-23T21:20:10.894631] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-23T21:20:11.199482] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-23T21:20:11.999406] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-23T21:20:12.260121] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T21:20:12.337298] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T21:20:12.799415] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-23T21:20:13.158389] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T21:20:13.599472] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-23T21:20:14.399493] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-23T21:20:14.616305] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T21:20:15.199419] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-23T21:20:15.308545] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T21:20:15.442013] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:20:15.999484] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-23T21:20:16.786205] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T21:20:16.799401] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-23T21:20:17.056888] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T21:20:17.599435] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-23T21:20:18.399464] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-23T21:20:18.707875] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T21:20:19.199415] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-23T21:20:19.231122] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T21:20:19.593527] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T21:20:19.999455] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-23T21:20:20.799456] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-23T21:20:20.996298] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T21:20:21.005267] [INFO ] [REMOTE ] EVH: Full fetch complete (71903 records). [2025-10-23T21:20:21.005461] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-23T21:20:21.404471] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-23T21:20:21.404609] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-23T21:20:21.405533] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-23T21:20:21.405611] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-23T21:20:21.407058] [DEBUG] [LOCAL ] EVH: Trimmed 71903 records to 49979 (keeping 200 days of data) [2025-10-23T21:20:21.614472] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-23T21:20:21.693980] [DEBUG] [LOCAL ] EVH: Primary data saved (49979 records). [2025-10-23T21:20:21.694142] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-23T21:20:21.694254] [INFO ] [MAIN ] Update Progress: 790/2367 symbols completed. EVH took 38.6s. Estimated remaining: 3h 20m 12s. Rate: 7.9 symbols/min [2025-10-23T21:20:21.852983] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T21:20:21.877798] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:21.881267] [INFO ] [REMOTE ] EVN: Full fetch complete (17140 records). [2025-10-23T21:20:21.905052] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-23T21:20:21.912739] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T21:20:22.160947] [DEBUG] [LOCAL ] EVTC: Loaded 26785 existing records from primary storage. [2025-10-23T21:20:22.209777] [INFO ] [MAIN ] EVTC: Loaded 26785 existing records. [2025-10-23T21:20:22.405900] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-23T21:20:22.489330] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-23T21:20:22.523765] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:22.524234] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-23T21:20:22.525125] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-23T21:20:22.525194] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-23T21:20:22.525307] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-23T21:20:22.525441] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-23T21:20:22.525840] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-23T21:20:22.525932] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-23T21:20:22.603599] [DEBUG] [LOCAL ] EVN: Trimmed 17140 records to 10894 (keeping 200 days of data) [2025-10-23T21:20:22.791613] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T21:20:22.878521] [DEBUG] [LOCAL ] EVN: Primary data saved (10894 records). [2025-10-23T21:20:22.907590] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-23T21:20:22.918247] [INFO ] [MAIN ] Update Progress: 791/2367 symbols completed. EVN took 27.3s. Estimated remaining: 3h 19m 52s. Rate: 7.9 symbols/min [2025-10-23T21:20:23.134872] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:23.198743] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:23.199485] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-23T21:20:23.244316] [DEBUG] [LOCAL ] EVTL: Loaded 41363 existing records from primary storage. [2025-10-23T21:20:23.244876] [INFO ] [MAIN ] EVTL: Loaded 41363 existing records. [2025-10-23T21:20:23.438132] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:23.438569] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-23T21:20:23.438681] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-23T21:20:23.439301] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-23T21:20:23.439382] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-23T21:20:23.822558] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:23.930549] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T21:20:23.999421] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-23T21:20:24.350006] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:20:24.799450] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-23T21:20:25.591417] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T21:20:25.601048] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-23T21:20:26.093520] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T21:20:26.399459] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-23T21:20:27.119471] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T21:20:27.199404] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-23T21:20:27.575284] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T21:20:27.999433] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-23T21:20:28.441968] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T21:20:28.447128] [INFO ] [REMOTE ] EVR: Full fetch complete (50609 records). [2025-10-23T21:20:28.447268] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-23T21:20:28.799476] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-23T21:20:28.833472] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-23T21:20:28.833694] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-23T21:20:28.834458] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-23T21:20:28.834639] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-23T21:20:28.835784] [DEBUG] [LOCAL ] EVR: Trimmed 50609 records to 33793 (keeping 200 days of data) [2025-10-23T21:20:29.051262] [DEBUG] [LOCAL ] EVR: Primary data saved (33793 records). [2025-10-23T21:20:29.051432] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-23T21:20:29.051544] [INFO ] [MAIN ] Update Progress: 792/2367 symbols completed. EVR took 31.5s. Estimated remaining: 3h 19m 41s. Rate: 7.9 symbols/min [2025-10-23T21:20:29.167631] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T21:20:29.252027] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:29.281342] [DEBUG] [LOCAL ] EVTR: Loaded 25397 existing records from primary storage. [2025-10-23T21:20:29.281671] [INFO ] [MAIN ] EVTR: Loaded 25397 existing records. [2025-10-23T21:20:29.488873] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:29.489163] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-23T21:20:29.489267] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-23T21:20:29.489583] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-23T21:20:29.489707] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-23T21:20:29.604591] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-23T21:20:29.874313] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:30.399441] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-23T21:20:30.494436] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T21:20:30.731067] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T21:20:30.734015] [INFO ] [REMOTE ] EVT: Full fetch complete (24999 records). [2025-10-23T21:20:30.734115] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-23T21:20:31.147171] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-23T21:20:31.147289] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-23T21:20:31.147880] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-23T21:20:31.147960] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-23T21:20:31.148662] [DEBUG] [LOCAL ] EVT: Trimmed 24999 records to 16606 (keeping 200 days of data) [2025-10-23T21:20:31.222718] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-23T21:20:31.254508] [DEBUG] [LOCAL ] EVT: Primary data saved (16606 records). [2025-10-23T21:20:31.254679] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-23T21:20:31.254782] [INFO ] [MAIN ] Update Progress: 793/2367 symbols completed. EVT took 29.1s. Estimated remaining: 3h 19m 23s. Rate: 7.9 symbols/min [2025-10-23T21:20:31.390139] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T21:20:31.443070] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:31.494877] [DEBUG] [LOCAL ] EW: Loaded 53399 existing records from primary storage. [2025-10-23T21:20:31.495270] [INFO ] [MAIN ] EW: Loaded 53399 existing records. [2025-10-23T21:20:31.675142] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:31.675380] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-23T21:20:31.675457] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-23T21:20:31.675730] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-23T21:20:31.675813] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-23T21:20:32.007390] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-23T21:20:32.036582] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:32.680239] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T21:20:32.799407] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-23T21:20:32.930280] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T21:20:33.599457] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-23T21:20:34.399414] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-23T21:20:34.781852] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-23T21:20:34.806818] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T21:20:35.199452] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-23T21:20:35.673236] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T21:20:35.999465] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-23T21:20:36.724307] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T21:20:36.799439] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-23T21:20:37.574313] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T21:20:37.599422] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-23T21:20:38.399416] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-23T21:20:38.591086] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T21:20:39.199396] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-23T21:20:39.554177] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T21:20:39.593119] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T21:20:39.999447] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-23T21:20:40.799486] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-23T21:20:41.259402] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-23T21:20:41.544175] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T21:20:41.599410] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-23T21:20:42.399434] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-23T21:20:42.903822] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T21:20:42.999544] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T21:20:43.199441] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-23T21:20:43.493687] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T21:20:43.999411] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-23T21:20:44.371378] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:20:44.799406] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-23T21:20:45.106804] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T21:20:45.599449] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-23T21:20:46.168234] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T21:20:46.399430] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-23T21:20:47.199681] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-23T21:20:47.210718] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T21:20:47.477162] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T21:20:47.999443] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-23T21:20:48.799420] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-23T21:20:48.964768] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:20:49.147945] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T21:20:49.599434] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-23T21:20:49.707053] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-23T21:20:50.399437] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-23T21:20:51.199417] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-23T21:20:51.360764] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T21:20:51.999440] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-23T21:20:52.172132] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T21:20:52.478880] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T21:20:52.484605] [INFO ] [REMOTE ] EVTC: Full fetch complete (38523 records). [2025-10-23T21:20:52.484830] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-23T21:20:52.804574] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-23T21:20:52.868925] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-23T21:20:52.869054] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-23T21:20:52.869803] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-23T21:20:52.869890] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-23T21:20:52.870891] [DEBUG] [LOCAL ] EVTC: Trimmed 38523 records to 26985 (keeping 200 days of data) [2025-10-23T21:20:53.024134] [DEBUG] [LOCAL ] EVTC: Primary data saved (26985 records). [2025-10-23T21:20:53.024294] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-23T21:20:53.024437] [INFO ] [MAIN ] Update Progress: 794/2367 symbols completed. EVTC took 31.3s. Estimated remaining: 3h 19m 43s. Rate: 7.9 symbols/min [2025-10-23T21:20:53.196336] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:53.229605] [DEBUG] [LOCAL ] EXG: Loaded 33614 existing records from primary storage. [2025-10-23T21:20:53.229966] [INFO ] [MAIN ] EXG: Loaded 33614 existing records. [2025-10-23T21:20:53.421816] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:53.422061] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-23T21:20:53.422156] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-23T21:20:53.422369] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-23T21:20:53.422440] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-23T21:20:53.607852] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-23T21:20:53.837884] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:53.884538] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T21:20:53.972792] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T21:20:53.981782] [INFO ] [REMOTE ] EVTL: Full fetch complete (54987 records). [2025-10-23T21:20:53.981904] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-23T21:20:54.358189] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-23T21:20:54.358307] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-23T21:20:54.359099] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-23T21:20:54.359176] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-23T21:20:54.360308] [DEBUG] [LOCAL ] EVTL: Trimmed 54987 records to 41735 (keeping 200 days of data) [2025-10-23T21:20:54.403096] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-23T21:20:54.586238] [DEBUG] [LOCAL ] EVTL: Primary data saved (41735 records). [2025-10-23T21:20:54.586419] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-23T21:20:54.586544] [INFO ] [MAIN ] Update Progress: 795/2367 symbols completed. EVTL took 31.7s. Estimated remaining: 3h 19m 24s. Rate: 7.9 symbols/min [2025-10-23T21:20:54.751920] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:20:54.799449] [DEBUG] [LOCAL ] EXK: Loaded 53187 existing records from primary storage. [2025-10-23T21:20:54.799809] [INFO ] [MAIN ] EXK: Loaded 53187 existing records. [2025-10-23T21:20:54.978144] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:20:54.978341] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-23T21:20:54.978430] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-23T21:20:54.978709] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-23T21:20:54.978821] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-23T21:20:55.204275] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-23T21:20:55.347366] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:20:55.376952] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T21:20:55.791458] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T21:20:55.999437] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-23T21:20:56.167496] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T21:20:56.799431] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-23T21:20:57.599420] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-23T21:20:57.735606] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T21:20:58.194985] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T21:20:58.399427] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-23T21:20:59.199417] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-23T21:20:59.520148] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T21:20:59.869236] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T21:20:59.999436] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-23T21:21:00.798116] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T21:21:00.807620] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-23T21:21:01.411826] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T21:21:01.599444] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-23T21:21:02.399464] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-23T21:21:03.058803] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T21:21:03.199445] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-23T21:21:03.993170] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T21:21:04.003577] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-23T21:21:04.635065] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T21:21:04.642198] [INFO ] [REMOTE ] EVTR: Full fetch complete (34108 records). [2025-10-23T21:21:04.642331] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-23T21:21:04.812899] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-23T21:21:05.007756] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-23T21:21:05.007866] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-23T21:21:05.008529] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-23T21:21:05.008607] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-23T21:21:05.009441] [DEBUG] [LOCAL ] EVTR: Trimmed 34108 records to 25689 (keeping 200 days of data) [2025-10-23T21:21:05.161468] [DEBUG] [LOCAL ] EVTR: Primary data saved (25689 records). [2025-10-23T21:21:05.161628] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-23T21:21:05.161756] [INFO ] [MAIN ] Update Progress: 796/2367 symbols completed. EVTR took 36.1s. Estimated remaining: 3h 19m 22s. Rate: 7.9 symbols/min [2025-10-23T21:21:05.332056] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:05.363192] [DEBUG] [LOCAL ] EXP: Loaded 29175 existing records from primary storage. [2025-10-23T21:21:05.363482] [INFO ] [MAIN ] EXP: Loaded 29175 existing records. [2025-10-23T21:21:05.546700] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:05.547057] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-23T21:21:05.547154] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-23T21:21:05.547567] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-23T21:21:05.547750] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-23T21:21:05.665141] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (4.86 seconds). [2025-10-23T21:21:05.697963] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-23T21:21:05.972570] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:06.005396] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T21:21:06.391432] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T21:21:06.400383] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-23T21:21:06.401917] [INFO ] [REMOTE ] EW: Full fetch complete (77506 records). [2025-10-23T21:21:06.402059] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-23T21:21:06.794148] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-23T21:21:06.794419] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-23T21:21:06.795522] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-23T21:21:06.795831] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-23T21:21:06.815236] [DEBUG] [LOCAL ] EW: Trimmed 77506 records to 53780 (keeping 200 days of data) [2025-10-23T21:21:06.816312] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T21:21:07.134583] [DEBUG] [LOCAL ] EW: Primary data saved (53780 records). [2025-10-23T21:21:07.134787] [INFO ] [MAIN ] EW: Full history saved. [2025-10-23T21:21:07.134937] [INFO ] [MAIN ] Update Progress: 797/2367 symbols completed. EW took 35.9s. Estimated remaining: 3h 19m 3s. Rate: 7.9 symbols/min [2025-10-23T21:21:07.199532] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-23T21:21:07.333402] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T21:21:07.999475] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-23T21:21:08.689057] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T21:21:08.799408] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-23T21:21:09.599427] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-23T21:21:09.639520] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T21:21:10.303372] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T21:21:10.399471] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-23T21:21:11.072752] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T21:21:11.199443] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-23T21:21:11.999446] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-23T21:21:12.234128] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:21:12.450126] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T21:21:12.799479] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-23T21:21:13.078552] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T21:21:13.599474] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-23T21:21:14.399529] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-23T21:21:14.779564] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T21:21:15.033550] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T21:21:15.199480] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-23T21:21:15.761546] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T21:21:15.999439] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-23T21:21:16.501627] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T21:21:16.799466] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-23T21:21:17.599432] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-23T21:21:17.964158] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T21:21:18.051851] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T21:21:18.057452] [INFO ] [REMOTE ] EXG: Full fetch complete (49505 records). [2025-10-23T21:21:18.057578] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-23T21:21:18.405631] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-23T21:21:18.513607] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-23T21:21:18.513783] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-23T21:21:18.514876] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-23T21:21:18.514968] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-23T21:21:18.516354] [DEBUG] [LOCAL ] EXG: Trimmed 49505 records to 33832 (keeping 200 days of data) [2025-10-23T21:21:18.794701] [DEBUG] [LOCAL ] EXG: Primary data saved (33832 records). [2025-10-23T21:21:18.794963] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-23T21:21:18.795114] [INFO ] [MAIN ] Update Progress: 798/2367 symbols completed. EXG took 25.8s. Estimated remaining: 3h 19m 4s. Rate: 7.9 symbols/min [2025-10-23T21:21:18.981424] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T21:21:19.199512] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-23T21:21:20.292625] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T21:21:20.308585] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-23T21:21:20.599330] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T21:21:20.799497] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-23T21:21:22.242563] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T21:21:22.251796] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-23T21:21:22.372444] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T21:21:22.399435] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-23T21:21:23.522579] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T21:21:23.528918] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-23T21:21:24.520668] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-23T21:21:24.530704] [INFO ] [REMOTE ] EXK: Full fetch complete (76867 records). [2025-10-23T21:21:24.530837] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-23T21:21:24.889814] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-23T21:21:24.942895] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-23T21:21:24.943031] [INFO ] [REMOTE ] EXP: Full fetch complete (42895 records). [2025-10-23T21:21:24.943213] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-23T21:21:24.944255] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-23T21:21:24.944183] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-23T21:21:24.944528] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-23T21:21:25.058431] [DEBUG] [LOCAL ] EXK: Trimmed 76867 records to 53575 (keeping 200 days of data) [2025-10-23T21:21:25.512547] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-23T21:21:25.543416] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-23T21:21:25.552941] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-23T21:21:25.568097] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-23T21:21:25.635828] [DEBUG] [LOCAL ] EXP: Trimmed 42895 records to 29302 (keeping 200 days of data) [2025-10-23T21:21:25.749294] [DEBUG] [LOCAL ] EXK: Primary data saved (53575 records). [2025-10-23T21:21:25.757081] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-23T21:21:25.761741] [INFO ] [MAIN ] Update Progress: 799/2367 symbols completed. EXK took 31.2s. Estimated remaining: 3h 18m 55s. Rate: 7.9 symbols/min [2025-10-23T21:21:25.840016] [DEBUG] [LOCAL ] EXP: Primary data saved (29302 records). [2025-10-23T21:21:25.840200] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-23T21:21:25.840317] [INFO ] [MAIN ] Update Progress: 800/2367 symbols completed. EXP took 20.7s. Estimated remaining: 3h 18m 32s. Rate: 7.9 symbols/min [2025-10-23T21:21:26.544378] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:26.507028] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:26.561913] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:26.604096] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:26.699897] [DEBUG] [LOCAL ] FAF: Loaded 41432 existing records from primary storage. [2025-10-23T21:21:26.702746] [INFO ] [MAIN ] FAF: Loaded 41432 existing records. [2025-10-23T21:21:26.716192] [DEBUG] [LOCAL ] EXR: Loaded 45503 existing records from primary storage. [2025-10-23T21:21:26.730329] [INFO ] [MAIN ] EXR: Loaded 45503 existing records. [2025-10-23T21:21:26.779334] [DEBUG] [LOCAL ] EXPD: Loaded 47729 existing records from primary storage. [2025-10-23T21:21:26.835510] [INFO ] [MAIN ] EXPD: Loaded 47729 existing records. [2025-10-23T21:21:26.896943] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-23T21:21:27.030245] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-23T21:21:27.306756] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:27.389969] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:27.422356] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-23T21:21:27.446589] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-23T21:21:27.452721] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:27.458482] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-23T21:21:27.449246] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-23T21:21:27.449341] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-23T21:21:27.474104] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-23T21:21:27.474360] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-23T21:21:27.474512] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-23T21:21:27.474454] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-23T21:21:27.541670] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:27.474565] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-23T21:21:27.492861] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-23T21:21:27.594533] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-23T21:21:27.572497] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-23T21:21:27.621547] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-23T21:21:27.803148] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-23T21:21:27.852287] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-23T21:21:28.743727] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:28.834544] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-23T21:21:28.987780] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:29.067112] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-23T21:21:29.037661] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:29.093095] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-23T21:21:29.098358] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:29.099435] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-23T21:21:30.489618] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T21:21:30.496871] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-23T21:21:30.749885] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:21:30.759203] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-23T21:21:31.455876] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T21:21:31.462838] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-23T21:21:31.593417] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-23T21:21:31.605113] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-23T21:21:31.855174] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-10-23T21:21:31.865126] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-23T21:21:32.958223] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T21:21:32.967171] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-23T21:21:33.552322] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-10-23T21:21:33.561719] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-23T21:21:33.594605] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T21:21:33.604992] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-23T21:21:33.995462] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-23T21:21:34.005893] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-23T21:21:34.644012] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T21:21:34.653346] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-23T21:21:35.265966] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T21:21:35.275942] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-23T21:21:35.418397] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T21:21:35.999469] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-23T21:21:36.279189] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:21:36.552948] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-23T21:21:36.799419] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-23T21:21:37.031900] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T21:21:37.485959] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T21:21:37.599480] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-23T21:21:38.403094] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-23T21:21:38.407889] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T21:21:39.199460] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-23T21:21:39.999490] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-23T21:21:40.155289] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:21:40.232387] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-23T21:21:40.653830] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T21:21:40.799430] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-23T21:21:41.599462] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-23T21:21:41.670231] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T21:21:41.950802] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T21:21:42.399428] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-23T21:21:43.199463] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-23T21:21:43.933798] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T21:21:44.000259] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-23T21:21:44.006456] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-23T21:21:44.442340] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T21:21:44.799452] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-23T21:21:45.549113] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T21:21:45.599414] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-23T21:21:46.086175] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T21:21:46.399441] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-23T21:21:47.205197] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-23T21:21:47.228509] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T21:21:47.822942] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T21:21:47.999447] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-23T21:21:48.799431] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-23T21:21:48.961489] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T21:21:49.416322] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T21:21:49.423333] [INFO ] [REMOTE ] FAF: Full fetch complete (58396 records). [2025-10-23T21:21:49.423512] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-23T21:21:49.612595] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-23T21:21:49.855455] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-23T21:21:49.855584] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-23T21:21:49.856416] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-23T21:21:49.856512] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-23T21:21:49.857742] [DEBUG] [LOCAL ] FAF: Trimmed 58396 records to 41784 (keeping 200 days of data) [2025-10-23T21:21:50.119182] [DEBUG] [LOCAL ] FAF: Primary data saved (41784 records). [2025-10-23T21:21:50.119355] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-23T21:21:50.119442] [INFO ] [MAIN ] Update Progress: 801/2367 symbols completed. FAF took 24.3s. Estimated remaining: 3h 18m 57s. Rate: 7.9 symbols/min [2025-10-23T21:21:50.289916] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:50.290133] [DEBUG] [LOCAL ] FBIN: No existing data file found in primary storage. [2025-10-23T21:21:50.290205] [WARN ] [MAIN ] FBIN: No existing data found, performing full refresh instead. [2025-10-23T21:21:50.290316] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-23T21:21:50.290390] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-23T21:21:50.290472] [DEBUG] [LOCAL ] FBIN: No primary data file found to delete. [2025-10-23T21:21:50.290542] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-23T21:21:50.404573] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-23T21:21:50.661807] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:51.199447] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-23T21:21:51.234754] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-23T21:21:51.377623] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T21:21:51.656976] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T21:21:51.999442] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-23T21:21:52.799409] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-23T21:21:52.882397] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:21:53.531428] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T21:21:53.539687] [INFO ] [REMOTE ] EXR: Full fetch complete (66174 records). [2025-10-23T21:21:53.539892] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-23T21:21:53.610092] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-23T21:21:53.941148] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-23T21:21:53.941276] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-23T21:21:53.942250] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-23T21:21:53.942332] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-23T21:21:53.943743] [DEBUG] [LOCAL ] EXR: Trimmed 66174 records to 45770 (keeping 200 days of data) [2025-10-23T21:21:54.248637] [DEBUG] [LOCAL ] EXR: Primary data saved (45770 records). [2025-10-23T21:21:54.248814] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-23T21:21:54.248931] [INFO ] [MAIN ] Update Progress: 802/2367 symbols completed. EXR took 28.4s. Estimated remaining: 3h 18m 43s. Rate: 7.9 symbols/min [2025-10-23T21:21:54.404938] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-23T21:21:54.432416] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:54.454615] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T21:21:54.463372] [INFO ] [REMOTE ] EXPD: Full fetch complete (69413 records). [2025-10-23T21:21:54.463530] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-23T21:21:54.649820] [DEBUG] [LOCAL ] FBK: Loaded 27466 existing records from primary storage. [2025-10-23T21:21:54.668537] [INFO ] [MAIN ] FBK: Loaded 27466 existing records. [2025-10-23T21:21:55.042698] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:55.059162] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-23T21:21:55.075954] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-23T21:21:55.079426] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-23T21:21:55.079459] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-23T21:21:55.079699] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-23T21:21:55.079763] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-23T21:21:55.080858] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-23T21:21:55.113315] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-23T21:21:55.184332] [DEBUG] [LOCAL ] EXPD: Trimmed 69413 records to 48043 (keeping 200 days of data) [2025-10-23T21:21:55.628305] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:55.654549] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-23T21:21:55.741681] [DEBUG] [LOCAL ] EXPD: Primary data saved (48043 records). [2025-10-23T21:21:55.741887] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-23T21:21:55.742073] [INFO ] [MAIN ] Update Progress: 803/2367 symbols completed. EXPD took 29.9s. Estimated remaining: 3h 18m 23s. Rate: 7.9 symbols/min [2025-10-23T21:21:55.916597] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:21:55.955631] [DEBUG] [LOCAL ] FBP: Loaded 45588 existing records from primary storage. [2025-10-23T21:21:55.955985] [INFO ] [MAIN ] FBP: Loaded 45588 existing records. [2025-10-23T21:21:56.140751] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:21:56.141543] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-23T21:21:56.142120] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-23T21:21:56.142958] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-23T21:21:56.143043] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-23T21:21:56.443918] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-23T21:21:56.513154] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-23T21:21:56.633724] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:21:56.642015] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-23T21:21:56.668355] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-23T21:21:56.799443] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-23T21:21:57.599407] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-23T21:21:57.792266] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T21:21:58.295214] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T21:21:58.399417] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-23T21:21:59.199448] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-23T21:21:59.865624] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-23T21:21:59.942258] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T21:21:59.999448] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-23T21:22:00.799431] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-23T21:22:00.891815] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T21:22:01.599439] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-23T21:22:01.988456] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T21:22:02.399519] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-23T21:22:02.439759] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-23T21:22:03.159841] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T21:22:03.199407] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-23T21:22:03.999407] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-23T21:22:04.159587] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T21:22:04.799547] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-23T21:22:04.963263] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T21:22:05.599452] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-23T21:22:05.771509] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-23T21:22:05.781309] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-23T21:22:05.781505] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-23T21:22:06.182739] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-23T21:22:06.182859] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-23T21:22:06.183861] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-23T21:22:06.183946] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-23T21:22:06.185516] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-23T21:22:06.403829] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-23T21:22:06.540462] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-23T21:22:06.540637] [INFO ] [MAIN ] F: Full history saved. [2025-10-23T21:22:06.540869] [INFO ] [MAIN ] Update Progress: 804/2367 symbols completed. F took 40.7s. Estimated remaining: 3h 18m 22s. Rate: 7.9 symbols/min [2025-10-23T21:22:06.673441] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T21:22:06.770074] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:22:06.808095] [DEBUG] [LOCAL ] FBRT: Loaded 35216 existing records from primary storage. [2025-10-23T21:22:06.808401] [INFO ] [MAIN ] FBRT: Loaded 35216 existing records. [2025-10-23T21:22:07.008353] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:22:07.008880] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-23T21:22:07.009107] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-23T21:22:07.009539] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-23T21:22:07.009612] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-23T21:22:07.199857] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-23T21:22:07.383210] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:22:07.416248] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T21:22:07.488056] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T21:22:07.999453] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-23T21:22:08.799481] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-23T21:22:09.097477] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T21:22:09.599448] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-23T21:22:09.788632] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T21:22:10.090555] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T21:22:10.399437] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-23T21:22:11.199423] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-23T21:22:11.313081] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T21:22:11.439044] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T21:22:11.999448] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-23T21:22:12.554048] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T21:22:12.799496] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-23T21:22:13.129930] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T21:22:13.599466] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-23T21:22:14.399453] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-23T21:22:14.453560] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T21:22:14.970535] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T21:22:15.199581] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-23T21:22:15.459362] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T21:22:15.999508] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-23T21:22:16.721481] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:22:16.730868] [INFO ] [REMOTE ] FBIN: Full fetch complete (73002 records). [2025-10-23T21:22:16.731074] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-23T21:22:16.804535] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-23T21:22:17.180259] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-23T21:22:17.181188] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-23T21:22:17.180786] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-23T21:22:17.182279] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-23T21:22:17.187804] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-23T21:22:17.189262] [DEBUG] [LOCAL ] FBIN: Trimmed 73002 records to 50736 (keeping 200 days of data) [2025-10-23T21:22:17.500263] [DEBUG] [LOCAL ] FBIN: Primary data saved (50736 records). [2025-10-23T21:22:17.500463] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-23T21:22:17.500601] [INFO ] [MAIN ] Update Progress: 805/2367 symbols completed. FBIN took 27.4s. Estimated remaining: 3h 18m 21s. Rate: 7.9 symbols/min [2025-10-23T21:22:17.604694] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-23T21:22:17.683585] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:22:17.683817] [DEBUG] [LOCAL ] FC: No existing data file found in primary storage. [2025-10-23T21:22:17.683887] [WARN ] [MAIN ] FC: No existing data found, performing full refresh instead. [2025-10-23T21:22:17.683995] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-23T21:22:17.684072] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-23T21:22:17.684151] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-10-23T21:22:17.684220] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-23T21:22:18.043683] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:22:18.344318] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T21:22:18.399482] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-23T21:22:19.023859] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T21:22:19.199499] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-23T21:22:19.705221] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T21:22:19.711239] [INFO ] [REMOTE ] FBK: Full fetch complete (35589 records). [2025-10-23T21:22:19.711366] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-23T21:22:20.003778] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-23T21:22:20.094984] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-23T21:22:20.095136] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-23T21:22:20.095947] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-23T21:22:20.096047] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-23T21:22:20.097179] [DEBUG] [LOCAL ] FBK: Trimmed 35589 records to 27617 (keeping 200 days of data) [2025-10-23T21:22:20.266100] [DEBUG] [LOCAL ] FBK: Primary data saved (27617 records). [2025-10-23T21:22:20.266276] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-23T21:22:20.266400] [INFO ] [MAIN ] Update Progress: 806/2367 symbols completed. FBK took 26.0s. Estimated remaining: 3h 18m 4s. Rate: 7.9 symbols/min [2025-10-23T21:22:20.448513] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:22:20.448890] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-23T21:22:20.448967] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-23T21:22:20.449076] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-23T21:22:20.449143] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-23T21:22:20.449224] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-23T21:22:20.449293] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-23T21:22:20.810896] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-23T21:22:20.835875] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T21:22:20.833796] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:22:20.960341] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T21:22:21.599420] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-23T21:22:22.299755] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T21:22:22.399429] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-23T21:22:23.056471] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T21:22:23.199490] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-23T21:22:23.307182] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-23T21:22:23.999506] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-23T21:22:24.506458] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-23T21:22:24.810690] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-23T21:22:24.816538] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T21:22:25.599473] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-23T21:22:25.806444] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T21:22:26.399489] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-23T21:22:27.204707] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-23T21:22:27.229067] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T21:22:27.269672] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-23T21:22:27.999463] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-23T21:22:28.725890] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T21:22:28.799452] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-23T21:22:29.204085] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T21:22:29.599448] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-23T21:22:30.334493] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T21:22:30.392611] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T21:22:30.399403] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-23T21:22:31.199448] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-23T21:22:31.222974] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T21:22:31.999441] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-23T21:22:32.655468] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T21:22:32.799523] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-23T21:22:33.553919] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T21:22:33.599496] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-23T21:22:33.829896] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T21:22:34.399461] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-23T21:22:35.055349] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T21:22:35.064477] [INFO ] [REMOTE ] FBP: Full fetch complete (66806 records). [2025-10-23T21:22:35.064691] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-23T21:22:35.204580] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-23T21:22:35.497726] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-23T21:22:35.497851] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-23T21:22:35.498816] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-23T21:22:35.498899] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-23T21:22:35.500307] [DEBUG] [LOCAL ] FBP: Trimmed 66806 records to 45946 (keeping 200 days of data) [2025-10-23T21:22:35.763719] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T21:22:35.839939] [DEBUG] [LOCAL ] FBP: Primary data saved (45946 records). [2025-10-23T21:22:35.840142] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-23T21:22:35.840284] [INFO ] [MAIN ] Update Progress: 807/2367 symbols completed. FBP took 40.1s. Estimated remaining: 3h 18m 12s. Rate: 7.9 symbols/min [2025-10-23T21:22:36.006494] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-23T21:22:36.026212] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:22:36.054793] [DEBUG] [LOCAL ] FCN: Loaded 25886 existing records from primary storage. [2025-10-23T21:22:36.055064] [INFO ] [MAIN ] FCN: Loaded 25886 existing records. [2025-10-23T21:22:36.236500] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:22:36.244636] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-23T21:22:36.245387] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:22:36.245446] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-23T21:22:36.249138] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-23T21:22:36.249219] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-23T21:22:36.600625] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:22:36.799425] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-23T21:22:37.476874] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T21:22:37.489338] [INFO ] [REMOTE ] FBRT: Full fetch complete (49560 records). [2025-10-23T21:22:37.489552] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-23T21:22:37.601061] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-23T21:22:37.926228] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-23T21:22:37.927312] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T21:22:37.927375] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-23T21:22:37.932342] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-23T21:22:37.932459] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-23T21:22:37.933634] [DEBUG] [LOCAL ] FBRT: Trimmed 49560 records to 35460 (keeping 200 days of data) [2025-10-23T21:22:38.147793] [DEBUG] [LOCAL ] FBRT: Primary data saved (35460 records). [2025-10-23T21:22:38.147993] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-23T21:22:38.148155] [INFO ] [MAIN ] Update Progress: 808/2367 symbols completed. FBRT took 31.6s. Estimated remaining: 3h 17m 54s. Rate: 7.9 symbols/min [2025-10-23T21:22:38.321812] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:22:38.355313] [DEBUG] [LOCAL ] FCPT: Loaded 36980 existing records from primary storage. [2025-10-23T21:22:38.355705] [INFO ] [MAIN ] FCPT: Loaded 36980 existing records. [2025-10-23T21:22:38.404551] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-23T21:22:38.548994] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:22:38.549287] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-23T21:22:38.549367] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-23T21:22:38.549674] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-23T21:22:38.549738] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-23T21:22:38.952816] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:22:39.199478] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-23T21:22:39.243144] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T21:22:39.371501] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T21:22:39.999500] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-23T21:22:40.041857] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T21:22:40.799481] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-23T21:22:41.415460] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T21:22:41.599488] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-23T21:22:42.206478] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T21:22:42.399541] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-23T21:22:43.032215] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T21:22:43.199462] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-23T21:22:43.799933] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T21:22:43.999412] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-23T21:22:44.017347] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T21:22:44.799492] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-23T21:22:45.010437] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T21:22:45.013625] [INFO ] [REMOTE ] FC: Full fetch complete (21876 records). [2025-10-23T21:22:45.013796] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-23T21:22:45.392451] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-23T21:22:45.392613] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-23T21:22:45.393560] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-23T21:22:45.393691] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-23T21:22:45.395245] [DEBUG] [LOCAL ] FC: Trimmed 21876 records to 14390 (keeping 200 days of data) [2025-10-23T21:22:45.493950] [DEBUG] [LOCAL ] FC: Primary data saved (14390 records). [2025-10-23T21:22:45.494133] [INFO ] [MAIN ] FC: Full history saved. [2025-10-23T21:22:45.494219] [INFO ] [MAIN ] Update Progress: 809/2367 symbols completed. FC took 28.0s. Estimated remaining: 3h 17m 46s. Rate: 7.9 symbols/min [2025-10-23T21:22:45.604638] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-23T21:22:45.694084] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:22:45.694284] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-23T21:22:45.694364] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-23T21:22:45.694485] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-23T21:22:45.694558] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-23T21:22:45.694841] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-23T21:22:45.694923] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-23T21:22:46.071859] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:22:46.090840] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T21:22:46.399433] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-23T21:22:46.819558] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-23T21:22:46.951879] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T21:22:47.199436] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-23T21:22:47.611706] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-23T21:22:47.999446] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-23T21:22:48.799428] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-23T21:22:49.488891] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T21:22:49.599401] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-23T21:22:50.020069] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T21:22:50.399427] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-23T21:22:50.726937] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T21:22:51.199437] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-23T21:22:51.801149] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T21:22:51.999442] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-23T21:22:52.442993] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T21:22:52.799438] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-23T21:22:53.413897] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T21:22:53.599437] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-23T21:22:53.735434] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T21:22:54.399443] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-23T21:22:54.950003] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-23T21:22:54.973358] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T21:22:55.199418] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-23T21:22:55.641468] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-23T21:22:55.999454] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-23T21:22:56.325667] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-23T21:22:56.799455] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-23T21:22:57.290166] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T21:22:57.599456] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-23T21:22:57.925572] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-23T21:22:58.399446] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-23T21:22:59.199435] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-23T21:22:59.999449] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-23T21:23:00.799426] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-23T21:23:04.744904] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (6.35 seconds). [2025-10-23T21:23:04.749985] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-23T21:23:04.755243] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (3.96 seconds). [2025-10-23T21:23:04.756785] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-23T21:23:05.507203] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (6.31 seconds). [2025-10-23T21:23:05.515275] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-23T21:23:05.534345] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (5.53 seconds). [2025-10-23T21:23:05.541815] [INFO ] [REMOTE ] FCF: Full fetch complete (58134 records). [2025-10-23T21:23:05.541951] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-23T21:23:05.740343] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T21:23:05.807703] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-23T21:23:05.932617] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-23T21:23:05.932759] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-23T21:23:05.933611] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-23T21:23:05.933709] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-23T21:23:05.934906] [DEBUG] [LOCAL ] FCF: Trimmed 58134 records to 39380 (keeping 200 days of data) [2025-10-23T21:23:06.141315] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-23T21:23:06.148034] [INFO ] [REMOTE ] FCRX: Full fetch complete (1640 records). [2025-10-23T21:23:06.149541] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-23T21:23:06.325356] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T21:23:06.350142] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-23T21:23:06.380940] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-23T21:23:06.353015] [DEBUG] [LOCAL ] FCF: Primary data saved (39380 records). [2025-10-23T21:23:06.382870] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:23:06.381470] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-23T21:23:06.383128] [INFO ] [MAIN ] Update Progress: 810/2367 symbols completed. FCF took 46.1s. Estimated remaining: 3h 18m 4s. Rate: 7.9 symbols/min [2025-10-23T21:23:06.383043] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:23:06.418954] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-23T21:23:06.465513] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-23T21:23:06.470730] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-23T21:23:06.491849] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-23T21:23:06.492019] [INFO ] [MAIN ] Update Progress: 811/2367 symbols completed. FCRX took 21.0s. Estimated remaining: 3h 17m 41s. Rate: 7.9 symbols/min [2025-10-23T21:23:06.666250] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:06.746841] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:06.755219] [DEBUG] [LOCAL ] FCT: Loaded 14722 existing records from primary storage. [2025-10-23T21:23:06.755749] [INFO ] [MAIN ] FCT: Loaded 14722 existing records. [2025-10-23T21:23:06.975539] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:06.976101] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-23T21:23:06.976280] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-23T21:23:06.976615] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-23T21:23:06.976934] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-23T21:23:07.101109] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-23T21:23:07.117064] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-23T21:23:07.222406] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T21:23:07.349550] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-23T21:23:07.606685] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:07.613611] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-23T21:23:07.638480] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-23T21:23:07.638305] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:07.639088] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-23T21:23:07.640288] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-23T21:23:07.640402] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-23T21:23:07.657132] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T21:23:07.755483] [INFO ] [REMOTE ] FCN: Full fetch complete (36521 records). [2025-10-23T21:23:07.788422] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-23T21:23:08.411460] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:08.416460] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-23T21:23:08.511308] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-23T21:23:08.511631] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-23T21:23:08.512865] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-23T21:23:08.512952] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-23T21:23:08.514574] [DEBUG] [LOCAL ] FCN: Trimmed 36521 records to 26198 (keeping 200 days of data) [2025-10-23T21:23:08.659520] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T21:23:08.668832] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-23T21:23:08.721885] [DEBUG] [LOCAL ] FCN: Primary data saved (26198 records). [2025-10-23T21:23:08.722176] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-23T21:23:08.722353] [INFO ] [MAIN ] Update Progress: 812/2367 symbols completed. FCN took 32.9s. Estimated remaining: 3h 17m 24s. Rate: 7.9 symbols/min [2025-10-23T21:23:08.856857] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T21:23:08.888386] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-23T21:23:08.942960] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:08.978536] [DEBUG] [LOCAL ] FDP: Loaded 29707 existing records from primary storage. [2025-10-23T21:23:08.978978] [INFO ] [MAIN ] FDP: Loaded 29707 existing records. [2025-10-23T21:23:09.163970] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:09.164290] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-23T21:23:09.164376] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-23T21:23:09.164738] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-23T21:23:09.164820] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-23T21:23:09.544936] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:09.599506] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-23T21:23:09.731380] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T21:23:09.973225] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T21:23:10.399490] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-23T21:23:10.514269] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T21:23:10.821856] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T21:23:11.199472] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-23T21:23:11.303232] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-23T21:23:11.999456] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-23T21:23:12.799395] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-23T21:23:12.980194] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-23T21:23:13.304102] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-23T21:23:13.599486] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-23T21:23:14.091583] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T21:23:14.399432] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-23T21:23:15.032253] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T21:23:15.039089] [INFO ] [REMOTE ] FCPT: Full fetch complete (53845 records). [2025-10-23T21:23:15.039201] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-23T21:23:15.227080] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-23T21:23:15.352445] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-23T21:23:15.437229] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-23T21:23:15.437333] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-23T21:23:15.438146] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-23T21:23:15.438225] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-23T21:23:15.439318] [DEBUG] [LOCAL ] FCPT: Trimmed 53845 records to 37208 (keeping 200 days of data) [2025-10-23T21:23:15.663253] [DEBUG] [LOCAL ] FCPT: Primary data saved (37208 records). [2025-10-23T21:23:15.663420] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-23T21:23:15.663534] [INFO ] [MAIN ] Update Progress: 813/2367 symbols completed. FCPT took 37.5s. Estimated remaining: 3h 17m 15s. Rate: 7.9 symbols/min [2025-10-23T21:23:15.831050] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:15.856069] [DEBUG] [LOCAL ] FDS: Loaded 28003 existing records from primary storage. [2025-10-23T21:23:15.856395] [INFO ] [MAIN ] FDS: Loaded 28003 existing records. [2025-10-23T21:23:16.004577] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-23T21:23:16.031630] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:16.032804] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-23T21:23:16.032886] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-23T21:23:16.033123] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-23T21:23:16.033195] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-23T21:23:16.388566] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:16.666752] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T21:23:16.799476] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-23T21:23:17.599489] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-23T21:23:18.114773] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T21:23:18.234281] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-23T21:23:18.399490] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-23T21:23:18.598903] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T21:23:19.199491] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-23T21:23:19.489060] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T21:23:19.999499] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-23T21:23:20.711360] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T21:23:20.799498] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-23T21:23:21.599472] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-23T21:23:22.270130] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-23T21:23:22.328960] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:23:22.399428] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-23T21:23:22.570913] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T21:23:23.199464] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-23T21:23:23.999431] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-23T21:23:24.190096] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T21:23:24.468263] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-23T21:23:24.799488] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-23T21:23:25.237942] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T21:23:25.599462] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-23T21:23:26.232114] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-23T21:23:26.399455] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-23T21:23:26.883034] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T21:23:27.199445] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-23T21:23:27.735464] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T21:23:27.999411] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-23T21:23:28.380954] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T21:23:28.799408] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-23T21:23:29.268491] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T21:23:29.599432] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-23T21:23:30.112544] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T21:23:30.399445] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-23T21:23:30.705586] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T21:23:30.710815] [INFO ] [REMOTE ] FDP: Full fetch complete (42908 records). [2025-10-23T21:23:30.710946] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-23T21:23:31.098444] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-23T21:23:31.098632] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-23T21:23:31.099354] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-23T21:23:31.099430] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-23T21:23:31.100477] [DEBUG] [LOCAL ] FDP: Trimmed 42908 records to 29865 (keeping 200 days of data) [2025-10-23T21:23:31.199441] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-23T21:23:31.283017] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-23T21:23:31.299795] [DEBUG] [LOCAL ] FDP: Primary data saved (29865 records). [2025-10-23T21:23:31.299986] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-23T21:23:31.300140] [INFO ] [MAIN ] Update Progress: 814/2367 symbols completed. FDP took 22.6s. Estimated remaining: 3h 17m 22s. Rate: 7.9 symbols/min [2025-10-23T21:23:31.470393] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:31.519129] [DEBUG] [LOCAL ] FDX: Loaded 51182 existing records from primary storage. [2025-10-23T21:23:31.519508] [INFO ] [MAIN ] FDX: Loaded 51182 existing records. [2025-10-23T21:23:31.698659] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:31.698915] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-23T21:23:31.699011] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-23T21:23:31.699312] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-23T21:23:31.699398] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-23T21:23:32.004618] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-23T21:23:32.077854] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:32.799494] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-23T21:23:32.966083] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T21:23:33.348545] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-23T21:23:33.599437] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-23T21:23:34.399418] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-23T21:23:34.710375] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T21:23:35.199425] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-23T21:23:35.304299] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T21:23:35.308073] [INFO ] [REMOTE ] FCT: Full fetch complete (21443 records). [2025-10-23T21:23:35.308174] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-23T21:23:35.690305] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-23T21:23:35.690482] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-23T21:23:35.691038] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-23T21:23:35.691130] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-23T21:23:35.692213] [DEBUG] [LOCAL ] FCT: Trimmed 21443 records to 14945 (keeping 200 days of data) [2025-10-23T21:23:35.794076] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T21:23:35.826470] [DEBUG] [LOCAL ] FCT: Primary data saved (14945 records). [2025-10-23T21:23:35.826702] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-23T21:23:35.826823] [INFO ] [MAIN ] Update Progress: 815/2367 symbols completed. FCT took 29.4s. Estimated remaining: 3h 17m 9s. Rate: 7.9 symbols/min [2025-10-23T21:23:36.003118] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:36.003284] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-23T21:23:36.053055] [DEBUG] [LOCAL ] FE: Loaded 53433 existing records from primary storage. [2025-10-23T21:23:36.053459] [INFO ] [MAIN ] FE: Loaded 53433 existing records. [2025-10-23T21:23:36.227047] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:36.227264] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-23T21:23:36.227341] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-23T21:23:36.227583] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-23T21:23:36.227691] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-23T21:23:36.576419] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:36.799459] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-23T21:23:36.932525] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T21:23:37.099285] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T21:23:37.599448] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-23T21:23:38.399439] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-23T21:23:38.565998] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T21:23:38.976220] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T21:23:39.199445] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-23T21:23:39.999459] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-23T21:23:40.394053] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T21:23:40.693615] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T21:23:40.799508] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-23T21:23:41.599428] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-23T21:23:41.720212] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:23:42.399445] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-23T21:23:42.463532] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T21:23:43.199413] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-23T21:23:43.288158] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T21:23:43.295236] [INFO ] [REMOTE ] FDS: Full fetch complete (39527 records). [2025-10-23T21:23:43.295353] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-23T21:23:43.659809] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-23T21:23:43.659926] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-23T21:23:43.660694] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-23T21:23:43.660782] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-23T21:23:43.661687] [DEBUG] [LOCAL ] FDS: Trimmed 39527 records to 28305 (keeping 200 days of data) [2025-10-23T21:23:43.832464] [DEBUG] [LOCAL ] FDS: Primary data saved (28305 records). [2025-10-23T21:23:43.832623] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-23T21:23:43.832751] [INFO ] [MAIN ] Update Progress: 816/2367 symbols completed. FDS took 28.2s. Estimated remaining: 3h 17m 2s. Rate: 7.9 symbols/min [2025-10-23T21:23:44.006208] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-23T21:23:44.026348] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:44.026548] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-23T21:23:44.026631] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-23T21:23:44.026773] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-23T21:23:44.026844] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-23T21:23:44.026924] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-23T21:23:44.026993] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-23T21:23:44.400693] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:44.799426] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-23T21:23:44.908881] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-23T21:23:45.450053] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-23T21:23:45.528873] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-23T21:23:45.599419] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-23T21:23:46.189810] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-23T21:23:46.399440] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-23T21:23:46.829986] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T21:23:47.199460] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-23T21:23:47.646857] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T21:23:47.896792] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-23T21:23:47.999416] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-23T21:23:48.496812] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T21:23:48.799448] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-23T21:23:49.249882] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T21:23:49.599424] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-23T21:23:50.399428] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-23T21:23:51.199456] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-23T21:23:51.999423] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-23T21:23:52.045142] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-23T21:23:52.055584] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-23T21:23:52.055880] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-23T21:23:52.378797] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-23T21:23:52.493600] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-23T21:23:52.496927] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-23T21:23:52.500950] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T21:23:52.498763] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-23T21:23:52.501212] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-23T21:23:52.513914] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54091 (keeping 200 days of data) [2025-10-23T21:23:52.804710] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-23T21:23:52.848830] [DEBUG] [LOCAL ] FCX: Primary data saved (54091 records). [2025-10-23T21:23:52.849297] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-23T21:23:52.851458] [INFO ] [MAIN ] Update Progress: 817/2367 symbols completed. FCX took 46.4s. Estimated remaining: 3h 16m 57s. Rate: 7.9 symbols/min [2025-10-23T21:23:53.021487] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:53.071387] [DEBUG] [LOCAL ] FERG: Loaded 48718 existing records from primary storage. [2025-10-23T21:23:53.071833] [INFO ] [MAIN ] FERG: Loaded 48718 existing records. [2025-10-23T21:23:53.176189] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-23T21:23:53.262319] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:53.262676] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-23T21:23:53.262872] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-23T21:23:53.278253] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-23T21:23:53.278375] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-23T21:23:53.382043] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-23T21:23:53.615021] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-23T21:23:53.655266] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:54.399433] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-23T21:23:54.753195] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-23T21:23:55.199490] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-23T21:23:55.676446] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T21:23:55.735383] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T21:23:55.999450] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-23T21:23:56.390517] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-23T21:23:56.391909] [INFO ] [REMOTE ] FENG: Full fetch complete (2273 records). [2025-10-23T21:23:56.392027] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-23T21:23:56.580392] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T21:23:56.580696] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:23:56.580777] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:23:56.580914] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-23T21:23:56.581143] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-23T21:23:56.581231] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-23T21:23:56.581388] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-23T21:23:56.581505] [INFO ] [MAIN ] Update Progress: 818/2367 symbols completed. FENG took 12.7s. Estimated remaining: 3h 16m 42s. Rate: 7.9 symbols/min [2025-10-23T21:23:56.765877] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:23:56.782982] [DEBUG] [LOCAL ] FET: Loaded 12875 existing records from primary storage. [2025-10-23T21:23:56.783382] [INFO ] [MAIN ] FET: Loaded 12875 existing records. [2025-10-23T21:23:56.804665] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-23T21:23:56.978178] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:23:56.978563] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-23T21:23:56.978706] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-23T21:23:56.978983] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-23T21:23:56.979065] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-23T21:23:57.359207] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:23:57.599558] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-23T21:23:58.397800] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T21:23:58.400812] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-23T21:23:58.767344] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T21:23:59.199446] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-23T21:23:59.999448] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-23T21:24:00.284597] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T21:24:00.799470] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-23T21:24:00.915004] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T21:24:00.992085] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T21:24:01.599579] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-23T21:24:02.399438] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-23T21:24:02.857420] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T21:24:03.199413] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-23T21:24:03.311853] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:24:03.922560] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T21:24:03.999404] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-23T21:24:04.093586] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:24:04.799449] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-23T21:24:04.951687] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T21:24:05.599449] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-23T21:24:06.399443] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-23T21:24:06.455857] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T21:24:06.551521] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T21:24:06.559963] [INFO ] [REMOTE ] FDX: Full fetch complete (74190 records). [2025-10-23T21:24:06.560109] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-23T21:24:06.935984] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-23T21:24:06.936094] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-23T21:24:06.937031] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-23T21:24:06.937112] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-23T21:24:06.938565] [DEBUG] [LOCAL ] FDX: Trimmed 74190 records to 51522 (keeping 200 days of data) [2025-10-23T21:24:07.216488] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-23T21:24:07.262063] [DEBUG] [LOCAL ] FDX: Primary data saved (51522 records). [2025-10-23T21:24:07.262248] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-23T21:24:07.262371] [INFO ] [MAIN ] Update Progress: 819/2367 symbols completed. FDX took 36.0s. Estimated remaining: 3h 16m 40s. Rate: 7.9 symbols/min [2025-10-23T21:24:07.432555] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:07.453297] [DEBUG] [LOCAL ] FF: Loaded 23707 existing records from primary storage. [2025-10-23T21:24:07.453621] [INFO ] [MAIN ] FF: Loaded 23707 existing records. [2025-10-23T21:24:07.630470] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:24:07.630724] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-23T21:24:07.630801] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-23T21:24:07.631022] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-23T21:24:07.631093] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-23T21:24:08.001217] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:08.001368] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-23T21:24:08.194558] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T21:24:08.526025] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-23T21:24:08.799408] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-23T21:24:09.137555] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T21:24:09.599472] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-23T21:24:09.999439] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T21:24:10.399433] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-23T21:24:11.199415] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-23T21:24:11.503123] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T21:24:11.887957] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T21:24:11.999485] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-23T21:24:12.121310] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T21:24:12.785956] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:24:12.799559] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-23T21:24:13.599463] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-23T21:24:14.399439] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-23T21:24:14.545279] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:24:15.199421] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-23T21:24:15.407609] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T21:24:15.416779] [INFO ] [REMOTE ] FE: Full fetch complete (77482 records). [2025-10-23T21:24:15.416919] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-23T21:24:15.802995] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-23T21:24:15.803117] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-23T21:24:15.804131] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-23T21:24:15.804219] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-23T21:24:15.805750] [DEBUG] [LOCAL ] FE: Trimmed 77482 records to 53821 (keeping 200 days of data) [2025-10-23T21:24:16.025003] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-23T21:24:16.039873] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T21:24:16.163415] [DEBUG] [LOCAL ] FE: Primary data saved (53821 records). [2025-10-23T21:24:16.163605] [INFO ] [MAIN ] FE: Full history saved. [2025-10-23T21:24:16.163774] [INFO ] [MAIN ] Update Progress: 820/2367 symbols completed. FE took 40.3s. Estimated remaining: 3h 16m 35s. Rate: 7.9 symbols/min [2025-10-23T21:24:16.332193] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:16.339215] [DEBUG] [LOCAL ] FFA: Loaded 5586 existing records from primary storage. [2025-10-23T21:24:16.339456] [INFO ] [MAIN ] FFA: Loaded 5586 existing records. [2025-10-23T21:24:16.514288] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:24:16.514552] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-23T21:24:16.514796] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-23T21:24:16.515009] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-23T21:24:16.515080] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-23T21:24:16.800273] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-23T21:24:16.882794] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:16.910230] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T21:24:17.066898] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:24:17.599455] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-23T21:24:17.705290] [DEBUG] [REMOTE ] FET: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-23T21:24:17.705677] [WARN ] [REMOTE ] FET: No data returned for month 2025-09 [2025-10-23T21:24:17.705762] [FATAL] [REMOTE ] FET: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:24:17.705901] [FATAL] [MAIN ] FET: Failed to fetch primary data. [2025-10-23T21:24:17.705995] [WARN ] [MAIN ] FET: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:24:17.706093] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-23T21:24:17.706214] [DEBUG] [LOCAL ] FET: No primary data file found to delete. [2025-10-23T21:24:17.706323] [INFO ] [LOCAL ] FET: Starting deletion of derivative data. [2025-10-23T21:24:17.707027] [DEBUG] [LOCAL ] FET: Deleted derivative data file. [2025-10-23T21:24:17.707138] [INFO ] [MAIN ] Update Progress: 821/2367 symbols completed. FET took 21.1s. Estimated remaining: 3h 16m 16s. Rate: 7.9 symbols/min [2025-10-23T21:24:17.879025] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:17.897703] [DEBUG] [LOCAL ] FFC: Loaded 16583 existing records from primary storage. [2025-10-23T21:24:17.898035] [INFO ] [MAIN ] FFC: Loaded 16583 existing records. [2025-10-23T21:24:18.083786] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:24:18.084188] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-23T21:24:18.084265] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-23T21:24:18.084563] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-23T21:24:18.084685] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-23T21:24:18.225496] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T21:24:18.404518] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-23T21:24:18.464612] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:19.199434] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-23T21:24:19.999413] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-23T21:24:20.324042] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T21:24:20.634363] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T21:24:20.799452] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-23T21:24:21.017599] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T21:24:21.599410] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-23T21:24:21.984579] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T21:24:22.399414] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-23T21:24:22.570744] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T21:24:23.199444] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-23T21:24:23.954165] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T21:24:23.999414] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-23T21:24:24.091137] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T21:24:24.581382] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T21:24:24.799446] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-23T21:24:25.599409] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-23T21:24:25.971446] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:24:26.399459] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-23T21:24:27.028557] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T21:24:27.199419] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-23T21:24:27.515831] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T21:24:27.956227] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-23T21:24:27.999445] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-23T21:24:28.617231] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T21:24:28.799409] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-23T21:24:29.599438] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-23T21:24:30.399409] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-23T21:24:30.484686] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T21:24:30.493246] [INFO ] [REMOTE ] FERG: Full fetch complete (71257 records). [2025-10-23T21:24:30.493400] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-23T21:24:30.830066] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T21:24:30.919502] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-23T21:24:30.919634] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-23T21:24:30.920696] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-23T21:24:30.920797] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-23T21:24:30.922178] [DEBUG] [LOCAL ] FERG: Trimmed 71257 records to 49080 (keeping 200 days of data) [2025-10-23T21:24:31.199750] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-23T21:24:31.236040] [DEBUG] [LOCAL ] FERG: Primary data saved (49080 records). [2025-10-23T21:24:31.236166] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-23T21:24:31.237878] [INFO ] [MAIN ] Update Progress: 822/2367 symbols completed. FERG took 38.4s. Estimated remaining: 3h 16m 19s. Rate: 7.9 symbols/min [2025-10-23T21:24:31.413738] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:31.444438] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T21:24:31.460262] [DEBUG] [LOCAL ] FFWM: Loaded 35671 existing records from primary storage. [2025-10-23T21:24:31.460636] [INFO ] [MAIN ] FFWM: Loaded 35671 existing records. [2025-10-23T21:24:31.640319] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:24:31.640576] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-23T21:24:31.640717] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-23T21:24:31.640992] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-23T21:24:31.641074] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-23T21:24:32.006143] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-23T21:24:32.012150] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:32.407599] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T21:24:32.799421] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-23T21:24:33.023524] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T21:24:33.398810] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T21:24:33.599447] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-23T21:24:34.399440] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-23T21:24:34.574577] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-23T21:24:35.087959] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T21:24:35.199439] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-23T21:24:35.999439] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-23T21:24:36.244865] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T21:24:36.650795] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T21:24:36.799474] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-23T21:24:37.511855] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T21:24:37.599414] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-23T21:24:38.399440] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-23T21:24:38.928779] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T21:24:39.199417] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-23T21:24:39.544071] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T21:24:39.834814] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T21:24:39.999431] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-23T21:24:40.799453] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-23T21:24:41.456780] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T21:24:41.468485] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T21:24:41.470275] [INFO ] [REMOTE ] FFA: Full fetch complete (8642 records). [2025-10-23T21:24:41.470366] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-23T21:24:41.610902] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-23T21:24:41.839665] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-23T21:24:41.839804] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-23T21:24:41.840111] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-23T21:24:41.840194] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-23T21:24:41.840905] [DEBUG] [LOCAL ] FFA: Trimmed 8642 records to 5602 (keeping 200 days of data) [2025-10-23T21:24:41.875600] [DEBUG] [LOCAL ] FFA: Primary data saved (5602 records). [2025-10-23T21:24:41.875786] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-23T21:24:41.875920] [INFO ] [MAIN ] Update Progress: 823/2367 symbols completed. FFA took 25.7s. Estimated remaining: 3h 16m 17s. Rate: 7.9 symbols/min [2025-10-23T21:24:42.047866] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:42.067500] [DEBUG] [LOCAL ] FG: Loaded 21366 existing records from primary storage. [2025-10-23T21:24:42.067819] [INFO ] [MAIN ] FG: Loaded 21366 existing records. [2025-10-23T21:24:42.244592] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:24:42.244823] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-23T21:24:42.244900] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-23T21:24:42.245295] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-23T21:24:42.245371] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-23T21:24:42.401801] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-23T21:24:42.612267] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:43.195897] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T21:24:43.203363] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-23T21:24:43.457198] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T21:24:44.003622] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-23T21:24:44.006239] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T21:24:44.799434] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-23T21:24:45.526137] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T21:24:45.599439] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-23T21:24:45.821791] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T21:24:45.825935] [INFO ] [REMOTE ] FF: Full fetch complete (36323 records). [2025-10-23T21:24:45.826091] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-23T21:24:46.207957] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-23T21:24:46.208097] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-23T21:24:46.208981] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-23T21:24:46.209084] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-23T21:24:46.210054] [DEBUG] [LOCAL ] FF: Trimmed 36323 records to 23773 (keeping 200 days of data) [2025-10-23T21:24:46.354417] [DEBUG] [LOCAL ] FF: Primary data saved (23773 records). [2025-10-23T21:24:46.355069] [INFO ] [MAIN ] FF: Full history saved. [2025-10-23T21:24:46.355188] [INFO ] [MAIN ] Update Progress: 824/2367 symbols completed. FF took 39.1s. Estimated remaining: 3h 16m 4s. Rate: 7.9 symbols/min [2025-10-23T21:24:46.404904] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-23T21:24:46.533826] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:46.540099] [DEBUG] [LOCAL ] FGN: Loaded 3560 existing records from primary storage. [2025-10-23T21:24:46.540331] [INFO ] [MAIN ] FGN: Loaded 3560 existing records. [2025-10-23T21:24:46.722623] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:24:46.722955] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-23T21:24:46.723029] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-23T21:24:46.723524] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-23T21:24:46.723598] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-23T21:24:47.035232] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T21:24:47.120614] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:47.199441] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-23T21:24:47.343449] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T21:24:47.859091] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T21:24:47.999438] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-23T21:24:48.633939] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-23T21:24:48.799403] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-23T21:24:49.599423] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-23T21:24:49.986587] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T21:24:50.399420] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-23T21:24:50.854276] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T21:24:51.199462] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-23T21:24:51.806175] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T21:24:51.830221] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-23T21:24:51.999436] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-23T21:24:52.630858] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T21:24:52.799436] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-23T21:24:53.399951] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T21:24:53.599440] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-23T21:24:54.399475] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-23T21:24:54.982079] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T21:24:55.199454] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-23T21:24:55.257524] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T21:24:55.509497] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-23T21:24:55.999411] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-23T21:24:56.587897] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T21:24:56.799477] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-23T21:24:57.599461] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-23T21:24:58.158488] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T21:24:58.399419] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-23T21:24:58.569564] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T21:24:58.572854] [INFO ] [REMOTE ] FFC: Full fetch complete (24566 records). [2025-10-23T21:24:58.572946] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-23T21:24:58.934697] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-23T21:24:58.934805] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-23T21:24:58.935324] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-23T21:24:58.935392] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-23T21:24:58.936049] [DEBUG] [LOCAL ] FFC: Trimmed 24566 records to 16737 (keeping 200 days of data) [2025-10-23T21:24:59.009916] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T21:24:59.040057] [DEBUG] [LOCAL ] FFC: Primary data saved (16737 records). [2025-10-23T21:24:59.040201] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-23T21:24:59.040312] [INFO ] [MAIN ] Update Progress: 825/2367 symbols completed. FFC took 41.3s. Estimated remaining: 3h 16m 6s. Rate: 7.9 symbols/min [2025-10-23T21:24:59.205749] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-23T21:24:59.208192] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:24:59.209155] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-23T21:24:59.209225] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-23T21:24:59.209333] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-23T21:24:59.209401] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-23T21:24:59.209478] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-23T21:24:59.209546] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-23T21:24:59.561930] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:24:59.846480] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T21:24:59.999466] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-23T21:25:00.779148] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T21:25:00.799403] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-23T21:25:01.430333] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-23T21:25:01.599459] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-23T21:25:02.249078] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T21:25:02.399413] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-23T21:25:03.199426] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-23T21:25:03.199367] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T21:25:03.858718] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T21:25:03.999405] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-23T21:25:04.558500] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T21:25:04.799504] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-23T21:25:05.503856] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T21:25:05.599464] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-23T21:25:06.214459] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T21:25:06.399446] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-23T21:25:06.879193] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T21:25:06.880224] [INFO ] [REMOTE ] FGN: Full fetch complete (5479 records). [2025-10-23T21:25:06.880316] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-23T21:25:07.207624] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-23T21:25:07.248589] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-23T21:25:07.248779] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-23T21:25:07.248983] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-23T21:25:07.249058] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-23T21:25:07.249447] [DEBUG] [LOCAL ] FGN: Trimmed 5479 records to 3575 (keeping 200 days of data) [2025-10-23T21:25:07.271187] [DEBUG] [LOCAL ] FGN: Primary data saved (3575 records). [2025-10-23T21:25:07.271283] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-23T21:25:07.271388] [INFO ] [MAIN ] Update Progress: 826/2367 symbols completed. FGN took 20.9s. Estimated remaining: 3h 15m 59s. Rate: 7.9 symbols/min [2025-10-23T21:25:07.466915] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:07.502204] [DEBUG] [LOCAL ] FHI: Loaded 39410 existing records from primary storage. [2025-10-23T21:25:07.502508] [INFO ] [MAIN ] FHI: Loaded 39410 existing records. [2025-10-23T21:25:07.675720] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:07.675945] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-23T21:25:07.676019] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-23T21:25:07.676246] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-23T21:25:07.676320] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-23T21:25:08.012895] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-23T21:25:08.056115] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:08.291813] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T21:25:08.649124] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T21:25:08.799420] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-23T21:25:09.599451] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-23T21:25:10.193019] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T21:25:10.399426] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-23T21:25:10.552786] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T21:25:10.889600] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T21:25:10.890813] [INFO ] [REMOTE ] FGSN: Full fetch complete (8102 records). [2025-10-23T21:25:10.890936] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-23T21:25:11.069072] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-23T21:25:11.069307] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:25:11.069398] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:25:11.069495] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-23T21:25:11.069612] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-23T21:25:11.069719] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-23T21:25:11.069822] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-23T21:25:11.069938] [INFO ] [MAIN ] Update Progress: 827/2367 symbols completed. FGSN took 12.0s. Estimated remaining: 3h 15m 44s. Rate: 7.9 symbols/min [2025-10-23T21:25:11.209484] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-23T21:25:11.240857] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:11.290212] [DEBUG] [LOCAL ] FHN: Loaded 53399 existing records from primary storage. [2025-10-23T21:25:11.290558] [INFO ] [MAIN ] FHN: Loaded 53399 existing records. [2025-10-23T21:25:11.465059] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:11.465290] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-23T21:25:11.465380] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-23T21:25:11.465625] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-23T21:25:11.465742] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-23T21:25:11.813266] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:11.999476] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-23T21:25:12.631910] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T21:25:12.664165] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T21:25:12.799440] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-23T21:25:13.599432] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-23T21:25:14.158297] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T21:25:14.399409] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-23T21:25:15.199433] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-23T21:25:15.403874] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T21:25:15.677113] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T21:25:15.683852] [INFO ] [REMOTE ] FFWM: Full fetch complete (51920 records). [2025-10-23T21:25:15.684043] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-23T21:25:16.002372] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-23T21:25:16.078196] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-23T21:25:16.078358] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-23T21:25:16.079132] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-23T21:25:16.079210] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-23T21:25:16.080357] [DEBUG] [LOCAL ] FFWM: Trimmed 51920 records to 35895 (keeping 200 days of data) [2025-10-23T21:25:16.281462] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T21:25:16.293963] [DEBUG] [LOCAL ] FFWM: Primary data saved (35895 records). [2025-10-23T21:25:16.294093] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-23T21:25:16.294200] [INFO ] [MAIN ] Update Progress: 828/2367 symbols completed. FFWM took 45.1s. Estimated remaining: 3h 15m 32s. Rate: 7.9 symbols/min [2025-10-23T21:25:16.461059] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:16.511079] [DEBUG] [LOCAL ] FI: Loaded 53586 existing records from primary storage. [2025-10-23T21:25:16.511413] [INFO ] [MAIN ] FI: Loaded 53586 existing records. [2025-10-23T21:25:16.695624] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:16.695878] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-23T21:25:16.695958] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-23T21:25:16.696208] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-23T21:25:16.696291] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-23T21:25:16.803418] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-23T21:25:17.065734] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:17.599440] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-23T21:25:17.748109] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:25:18.399402] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-23T21:25:18.500193] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T21:25:18.705945] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T21:25:19.199439] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-23T21:25:19.999426] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-23T21:25:20.163011] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T21:25:20.799412] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-23T21:25:21.055049] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T21:25:21.542603] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T21:25:21.546488] [INFO ] [REMOTE ] FG: Full fetch complete (28967 records). [2025-10-23T21:25:21.546587] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-23T21:25:21.609413] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-23T21:25:21.867757] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T21:25:21.966167] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-23T21:25:21.966290] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-23T21:25:21.966951] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-23T21:25:21.967030] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-23T21:25:21.967847] [DEBUG] [LOCAL ] FG: Trimmed 28967 records to 21445 (keeping 200 days of data) [2025-10-23T21:25:22.093329] [DEBUG] [LOCAL ] FG: Primary data saved (21445 records). [2025-10-23T21:25:22.093468] [INFO ] [MAIN ] FG: Full history saved. [2025-10-23T21:25:22.093577] [INFO ] [MAIN ] Update Progress: 829/2367 symbols completed. FG took 40.2s. Estimated remaining: 3h 15m 21s. Rate: 7.9 symbols/min [2025-10-23T21:25:22.258993] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:22.280569] [DEBUG] [LOCAL ] FICO: Loaded 21963 existing records from primary storage. [2025-10-23T21:25:22.280871] [INFO ] [MAIN ] FICO: Loaded 21963 existing records. [2025-10-23T21:25:22.404577] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-23T21:25:22.455565] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:22.455967] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-23T21:25:22.456042] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-23T21:25:22.456360] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-23T21:25:22.456434] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-23T21:25:22.803005] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:23.199420] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-23T21:25:23.419467] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T21:25:23.999441] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-23T21:25:24.036452] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:25:24.799499] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-23T21:25:25.020567] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T21:25:25.599442] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-23T21:25:25.812732] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T21:25:26.121303] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T21:25:26.399419] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-23T21:25:27.199444] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-23T21:25:27.501315] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T21:25:27.847387] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T21:25:27.999427] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-23T21:25:28.360453] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T21:25:28.799452] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-23T21:25:29.599415] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-23T21:25:29.913320] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T21:25:29.960889] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T21:25:30.399427] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-23T21:25:31.144664] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:25:31.199456] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-23T21:25:31.928725] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T21:25:31.999405] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-23T21:25:32.799470] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-23T21:25:33.230533] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T21:25:33.509451] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T21:25:33.599443] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-23T21:25:34.399440] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-23T21:25:34.766731] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T21:25:35.209489] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-23T21:25:35.230575] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T21:25:35.907925] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T21:25:35.999415] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-23T21:25:36.799483] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-23T21:25:37.169325] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T21:25:37.545320] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-23T21:25:37.599396] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-23T21:25:37.894751] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T21:25:38.399407] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-23T21:25:38.791399] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T21:25:39.199423] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-23T21:25:39.999462] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-23T21:25:40.042005] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T21:25:40.053991] [INFO ] [REMOTE ] FHN: Full fetch complete (77478 records). [2025-10-23T21:25:40.054200] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-23T21:25:40.449271] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-23T21:25:40.449394] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-23T21:25:40.450492] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-23T21:25:40.450614] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-23T21:25:40.466570] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T21:25:40.471543] [DEBUG] [LOCAL ] FHN: Trimmed 77478 records to 53789 (keeping 200 days of data) [2025-10-23T21:25:40.791502] [DEBUG] [LOCAL ] FHN: Primary data saved (53789 records). [2025-10-23T21:25:40.791694] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-23T21:25:40.791807] [INFO ] [MAIN ] Update Progress: 830/2367 symbols completed. FHN took 29.7s. Estimated remaining: 3h 15m 34s. Rate: 7.9 symbols/min [2025-10-23T21:25:40.804872] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-23T21:25:40.964058] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:40.964238] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-23T21:25:40.964320] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-23T21:25:40.964478] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-23T21:25:40.964549] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-23T21:25:40.964629] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-23T21:25:40.964720] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-23T21:25:41.332752] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:41.348511] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T21:25:41.354477] [INFO ] [REMOTE ] FHI: Full fetch complete (57372 records). [2025-10-23T21:25:41.354605] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-23T21:25:41.604635] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-23T21:25:41.730623] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-23T21:25:41.730741] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-23T21:25:41.731528] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-23T21:25:41.731604] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-23T21:25:41.732838] [DEBUG] [LOCAL ] FHI: Trimmed 57372 records to 39641 (keeping 200 days of data) [2025-10-23T21:25:41.909186] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-23T21:25:41.965849] [DEBUG] [LOCAL ] FHI: Primary data saved (39641 records). [2025-10-23T21:25:41.966014] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-23T21:25:41.966135] [INFO ] [MAIN ] Update Progress: 831/2367 symbols completed. FHI took 34.7s. Estimated remaining: 3h 15m 15s. Rate: 7.9 symbols/min [2025-10-23T21:25:42.133775] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:42.175400] [DEBUG] [LOCAL ] FIGS: Loaded 48545 existing records from primary storage. [2025-10-23T21:25:42.175763] [INFO ] [MAIN ] FIGS: Loaded 48545 existing records. [2025-10-23T21:25:42.357232] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:42.357462] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-23T21:25:42.357538] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-23T21:25:42.357787] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-23T21:25:42.357861] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-23T21:25:42.411837] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-23T21:25:42.718994] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:42.776170] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-23T21:25:43.062156] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T21:25:43.199431] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-23T21:25:43.999423] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-23T21:25:44.799449] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-23T21:25:45.260017] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T21:25:45.438596] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T21:25:45.599450] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-23T21:25:46.399422] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-23T21:25:46.487148] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T21:25:46.728908] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-23T21:25:46.979732] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T21:25:47.199429] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-23T21:25:47.999444] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-23T21:25:48.799474] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-23T21:25:49.287116] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-23T21:25:49.380987] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T21:25:49.599407] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-23T21:25:49.909503] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T21:25:50.399445] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-23T21:25:51.199417] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-23T21:25:51.531000] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T21:25:51.755601] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-23T21:25:51.765791] [INFO ] [REMOTE ] FI: Full fetch complete (77494 records). [2025-10-23T21:25:51.765975] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-23T21:25:52.000108] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-23T21:25:52.201171] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-23T21:25:52.201327] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-23T21:25:52.202518] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-23T21:25:52.219414] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-23T21:25:52.238064] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T21:25:52.251062] [DEBUG] [LOCAL ] FI: Trimmed 77494 records to 53968 (keeping 200 days of data) [2025-10-23T21:25:52.459420] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T21:25:52.576345] [DEBUG] [LOCAL ] FI: Primary data saved (53968 records). [2025-10-23T21:25:52.576502] [INFO ] [MAIN ] FI: Full history saved. [2025-10-23T21:25:52.576608] [INFO ] [MAIN ] Update Progress: 832/2367 symbols completed. FI took 36.3s. Estimated remaining: 3h 15m 12s. Rate: 7.9 symbols/min [2025-10-23T21:25:52.746733] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:52.784122] [DEBUG] [LOCAL ] FIHL: Loaded 39044 existing records from primary storage. [2025-10-23T21:25:52.784449] [INFO ] [MAIN ] FIHL: Loaded 39044 existing records. [2025-10-23T21:25:52.804933] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-23T21:25:52.963089] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:52.963288] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-23T21:25:52.963364] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-23T21:25:52.963583] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-23T21:25:52.963689] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-23T21:25:53.106313] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T21:25:53.142285] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-23T21:25:53.210486] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:25:53.226945] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-23T21:25:53.249430] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:25:53.249568] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-23T21:25:53.255379] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-23T21:25:53.260605] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-23T21:25:53.276060] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-23T21:25:53.298591] [INFO ] [MAIN ] Update Progress: 833/2367 symbols completed. FIG took 12.5s. Estimated remaining: 3h 14m 52s. Rate: 7.9 symbols/min [2025-10-23T21:25:53.327826] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:53.497160] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:53.507409] [DEBUG] [LOCAL ] FINS: Loaded 8261 existing records from primary storage. [2025-10-23T21:25:53.507715] [INFO ] [MAIN ] FINS: Loaded 8261 existing records. [2025-10-23T21:25:53.606351] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-23T21:25:53.690727] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:53.690977] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-23T21:25:53.691057] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-23T21:25:53.691260] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-23T21:25:53.691333] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-23T21:25:54.041696] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:54.399499] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-23T21:25:54.909295] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T21:25:54.914281] [INFO ] [REMOTE ] FICO: Full fetch complete (30138 records). [2025-10-23T21:25:54.914377] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-23T21:25:55.204547] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-23T21:25:55.281297] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-23T21:25:55.281399] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-23T21:25:55.282017] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-23T21:25:55.282095] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-23T21:25:55.282844] [DEBUG] [LOCAL ] FICO: Trimmed 30138 records to 22189 (keeping 200 days of data) [2025-10-23T21:25:55.421488] [DEBUG] [LOCAL ] FICO: Primary data saved (22189 records). [2025-10-23T21:25:55.421672] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-23T21:25:55.421790] [INFO ] [MAIN ] Update Progress: 834/2367 symbols completed. FICO took 33.3s. Estimated remaining: 3h 14m 34s. Rate: 7.9 symbols/min [2025-10-23T21:25:55.590622] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:25:55.630994] [DEBUG] [LOCAL ] FINV: Loaded 45222 existing records from primary storage. [2025-10-23T21:25:55.631326] [INFO ] [MAIN ] FINV: Loaded 45222 existing records. [2025-10-23T21:25:55.810564] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:25:55.810827] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-23T21:25:55.810968] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-23T21:25:55.811214] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-23T21:25:55.811290] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-23T21:25:56.000292] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-23T21:25:56.191768] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:25:56.249205] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T21:25:56.401125] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T21:25:56.770638] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T21:25:56.799407] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-23T21:25:57.505089] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-23T21:25:57.599402] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-23T21:25:58.208984] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T21:25:58.399433] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-23T21:25:59.199453] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-23T21:25:59.804139] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T21:25:59.817365] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-23T21:25:59.999490] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-23T21:26:00.799457] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-23T21:26:01.143382] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-23T21:26:01.599473] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-23T21:26:02.324946] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T21:26:02.399406] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-23T21:26:03.199401] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-23T21:26:03.311857] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T21:26:03.999439] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-23T21:26:04.061092] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T21:26:04.305252] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T21:26:04.461905] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T21:26:04.799441] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-23T21:26:05.599435] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-23T21:26:06.399455] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-23T21:26:06.435759] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T21:26:07.161901] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T21:26:07.199398] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-23T21:26:07.285816] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:26:07.887778] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T21:26:07.999446] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-23T21:26:08.713828] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T21:26:08.799436] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-23T21:26:09.599469] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-23T21:26:10.353240] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T21:26:10.399425] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-23T21:26:11.189354] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T21:26:11.199393] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-23T21:26:11.999463] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-23T21:26:12.232519] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:26:12.799433] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-23T21:26:12.915287] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T21:26:13.468519] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T21:26:13.599487] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-23T21:26:14.302380] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T21:26:14.304062] [INFO ] [REMOTE ] FINS: Full fetch complete (11600 records). [2025-10-23T21:26:14.304171] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-23T21:26:14.406453] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-23T21:26:14.715404] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-23T21:26:14.717274] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T21:26:14.717523] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-23T21:26:14.728016] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-23T21:26:14.728266] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-23T21:26:14.729201] [DEBUG] [LOCAL ] FINS: Trimmed 11600 records to 8300 (keeping 200 days of data) [2025-10-23T21:26:14.781057] [DEBUG] [LOCAL ] FINS: Primary data saved (8300 records). [2025-10-23T21:26:14.781236] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-23T21:26:14.781365] [INFO ] [MAIN ] Update Progress: 835/2367 symbols completed. FINS took 21.5s. Estimated remaining: 3h 14m 48s. Rate: 7.9 symbols/min [2025-10-23T21:26:14.951369] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:14.997865] [DEBUG] [LOCAL ] FIS: Loaded 53325 existing records from primary storage. [2025-10-23T21:26:14.998256] [INFO ] [MAIN ] FIS: Loaded 53325 existing records. [2025-10-23T21:26:15.177698] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:26:15.177932] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-23T21:26:15.178053] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-23T21:26:15.178578] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-23T21:26:15.178698] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-23T21:26:15.209497] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-23T21:26:15.551255] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:15.980404] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T21:26:15.999403] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-23T21:26:16.709926] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T21:26:16.799397] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-23T21:26:17.256786] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T21:26:17.599491] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-23T21:26:18.399461] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-23T21:26:18.446827] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T21:26:19.199436] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-23T21:26:19.244309] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T21:26:19.858855] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T21:26:19.999470] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-23T21:26:20.734189] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T21:26:20.799402] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-23T21:26:21.599469] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-23T21:26:21.671515] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:26:21.679802] [INFO ] [REMOTE ] FIGS: Full fetch complete (70789 records). [2025-10-23T21:26:21.679964] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-23T21:26:22.067605] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-23T21:26:22.067898] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-23T21:26:22.068862] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-23T21:26:22.068953] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-23T21:26:22.070306] [DEBUG] [LOCAL ] FIGS: Trimmed 70789 records to 48846 (keeping 200 days of data) [2025-10-23T21:26:22.279153] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T21:26:22.293388] [INFO ] [REMOTE ] FIHL: Full fetch complete (56410 records). [2025-10-23T21:26:22.305595] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-23T21:26:22.436218] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-23T21:26:22.632920] [DEBUG] [LOCAL ] FIGS: Primary data saved (48846 records). [2025-10-23T21:26:22.653773] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-23T21:26:22.670132] [INFO ] [MAIN ] Update Progress: 836/2367 symbols completed. FIGS took 40.7s. Estimated remaining: 3h 14m 41s. Rate: 7.9 symbols/min [2025-10-23T21:26:22.947172] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:22.903301] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-23T21:26:22.947407] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-23T21:26:22.948459] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-23T21:26:22.948927] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-23T21:26:22.951127] [DEBUG] [LOCAL ] FIHL: Trimmed 56410 records to 39341 (keeping 200 days of data) [2025-10-23T21:26:23.081415] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T21:26:23.107148] [DEBUG] [LOCAL ] FIX: Loaded 28424 existing records from primary storage. [2025-10-23T21:26:23.113701] [INFO ] [MAIN ] FIX: Loaded 28424 existing records. [2025-10-23T21:26:23.213900] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-23T21:26:23.396024] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:26:23.401340] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-23T21:26:23.404104] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-23T21:26:23.404740] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-23T21:26:23.405614] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-23T21:26:23.608785] [DEBUG] [LOCAL ] FIHL: Primary data saved (39341 records). [2025-10-23T21:26:23.644909] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-23T21:26:23.683283] [INFO ] [MAIN ] Update Progress: 837/2367 symbols completed. FIHL took 31.1s. Estimated remaining: 3h 14m 21s. Rate: 7.9 symbols/min [2025-10-23T21:26:23.790735] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:23.999428] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-23T21:26:24.310871] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T21:26:24.799449] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-23T21:26:24.912457] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T21:26:25.531100] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T21:26:25.599409] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-23T21:26:26.327499] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T21:26:26.399412] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-23T21:26:27.203116] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-23T21:26:27.205561] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T21:26:27.999412] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-23T21:26:28.357525] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T21:26:28.799423] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-23T21:26:28.873600] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:26:28.881896] [INFO ] [REMOTE ] FINV: Full fetch complete (65006 records). [2025-10-23T21:26:28.882084] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-23T21:26:29.303704] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-23T21:26:29.303837] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-23T21:26:29.304738] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-23T21:26:29.304830] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-23T21:26:29.306287] [DEBUG] [LOCAL ] FINV: Trimmed 65006 records to 45555 (keeping 200 days of data) [2025-10-23T21:26:29.573817] [DEBUG] [LOCAL ] FINV: Primary data saved (45555 records). [2025-10-23T21:26:29.573996] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-23T21:26:29.574137] [INFO ] [MAIN ] Update Progress: 838/2367 symbols completed. FINV took 34.2s. Estimated remaining: 3h 14m 11s. Rate: 7.9 symbols/min [2025-10-23T21:26:29.698402] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T21:26:29.707108] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-23T21:26:30.708298] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T21:26:30.719616] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-23T21:26:31.368169] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T21:26:31.376040] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-23T21:26:32.218376] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T21:26:32.229594] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-23T21:26:32.449981] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T21:26:32.799508] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-23T21:26:33.904463] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T21:26:33.915521] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-23T21:26:33.970519] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:26:34.399467] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-23T21:26:35.764494] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T21:26:35.777136] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-23T21:26:35.852377] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T21:26:35.999467] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-23T21:26:37.245799] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T21:26:37.252261] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-23T21:26:37.503185] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T21:26:37.599463] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-23T21:26:38.534939] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T21:26:38.541100] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-23T21:26:39.440047] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T21:26:39.451552] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-23T21:26:39.769598] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T21:26:39.774455] [INFO ] [REMOTE ] FIX: Full fetch complete (45640 records). [2025-10-23T21:26:39.774563] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-23T21:26:40.146780] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-23T21:26:40.146890] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-23T21:26:40.147562] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-23T21:26:40.147658] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-23T21:26:40.148606] [DEBUG] [LOCAL ] FIX: Trimmed 45640 records to 28670 (keeping 200 days of data) [2025-10-23T21:26:40.347629] [DEBUG] [LOCAL ] FIX: Primary data saved (28670 records). [2025-10-23T21:26:40.347835] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-23T21:26:40.347964] [INFO ] [MAIN ] Update Progress: 839/2367 symbols completed. FIX took 17.7s. Estimated remaining: 3h 14m 9s. Rate: 7.9 symbols/min [2025-10-23T21:26:41.120564] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:26:41.129879] [INFO ] [REMOTE ] FIS: Full fetch complete (77394 records). [2025-10-23T21:26:41.130055] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-23T21:26:41.526222] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-23T21:26:41.526361] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-23T21:26:41.527354] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-23T21:26:41.527452] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-23T21:26:41.529002] [DEBUG] [LOCAL ] FIS: Trimmed 77394 records to 53715 (keeping 200 days of data) [2025-10-23T21:26:41.852601] [DEBUG] [LOCAL ] FIS: Primary data saved (53715 records). [2025-10-23T21:26:41.852815] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-23T21:26:41.852951] [INFO ] [MAIN ] Update Progress: 840/2367 symbols completed. FIS took 27.1s. Estimated remaining: 3h 13m 50s. Rate: 7.9 symbols/min [2025-10-23T21:26:42.499584] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:42.501478] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:42.545188] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-23T21:26:42.510981] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:42.566451] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-23T21:26:42.573726] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-23T21:26:42.571526] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:42.574173] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-23T21:26:42.574555] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-23T21:26:42.574632] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-23T21:26:42.626052] [DEBUG] [LOCAL ] FLC: Loaded 5396 existing records from primary storage. [2025-10-23T21:26:42.649369] [INFO ] [MAIN ] FLC: Loaded 5396 existing records. [2025-10-23T21:26:42.944752] [DEBUG] [LOCAL ] FLNG: Loaded 33319 existing records from primary storage. [2025-10-23T21:26:42.994522] [INFO ] [MAIN ] FLNG: Loaded 33319 existing records. [2025-10-23T21:26:43.198463] [DEBUG] [LOCAL ] FLG: Loaded 53319 existing records from primary storage. [2025-10-23T21:26:43.298721] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:26:43.328097] [INFO ] [MAIN ] FLG: Loaded 53319 existing records. [2025-10-23T21:26:43.331378] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:43.376454] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-23T21:26:43.362533] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-23T21:26:43.389504] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-23T21:26:43.455544] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:26:43.418609] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-23T21:26:43.481968] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-23T21:26:43.526163] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-23T21:26:43.542993] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-23T21:26:43.596932] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-23T21:26:43.607473] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-23T21:26:43.673960] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T21:26:43.753606] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-23T21:26:43.809471] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:26:43.823393] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-23T21:26:43.823518] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:26:43.841667] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:26:43.862581] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-23T21:26:43.862766] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-23T21:26:43.868426] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-23T21:26:43.914872] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-23T21:26:43.918477] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-23T21:26:43.915038] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-23T21:26:43.961115] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-23T21:26:43.980578] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-23T21:26:43.980745] [INFO ] [MAIN ] Update Progress: 841/2367 symbols completed. FIXT took 2.1s. Estimated remaining: 3h 13m 32s. Rate: 7.9 symbols/min [2025-10-23T21:26:44.679500] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:44.766756] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-23T21:26:44.748929] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:44.801128] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:26:44.801669] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-23T21:26:44.940904] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:44.941357] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-23T21:26:44.979942] [DEBUG] [LOCAL ] FLO: Loaded 52073 existing records from primary storage. [2025-10-23T21:26:44.980323] [INFO ] [MAIN ] FLO: Loaded 52073 existing records. [2025-10-23T21:26:45.154928] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:26:45.155151] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-23T21:26:45.155229] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-23T21:26:45.155466] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-23T21:26:45.155540] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-23T21:26:45.516189] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:26:45.516695] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T21:26:45.517164] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-23T21:26:45.519299] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-23T21:26:45.940616] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-23T21:26:45.942436] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-23T21:26:46.130323] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T21:26:46.137926] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-23T21:26:46.239048] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T21:26:46.399399] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-23T21:26:46.405296] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T21:26:47.211841] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-23T21:26:47.214361] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:26:47.605862] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T21:26:47.953142] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T21:26:47.999415] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-23T21:26:48.135466] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T21:26:48.799451] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-23T21:26:49.599425] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-23T21:26:49.641834] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T21:26:50.114254] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T21:26:50.399442] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-23T21:26:50.998203] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T21:26:51.199419] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-23T21:26:51.405050] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T21:26:51.999447] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-23T21:26:52.588843] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T21:26:52.799442] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-23T21:26:53.489638] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T21:26:53.599394] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-23T21:26:54.152982] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T21:26:54.399462] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-23T21:26:55.199409] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-23T21:26:55.286486] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-23T21:26:55.893110] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T21:26:55.999406] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-23T21:26:56.327619] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T21:26:56.799518] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-23T21:26:57.377396] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T21:26:57.599433] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-23T21:26:58.399449] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-23T21:26:58.650780] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T21:26:59.116989] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T21:26:59.199400] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-23T21:26:59.913778] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T21:26:59.999413] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-23T21:27:00.703363] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T21:27:00.799404] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-23T21:27:01.599452] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-23T21:27:01.927802] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T21:27:02.315207] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T21:27:02.399414] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-23T21:27:02.520281] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T21:27:03.164335] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T21:27:03.199437] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-23T21:27:03.863820] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T21:27:03.999415] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-23T21:27:04.799439] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-23T21:27:05.462861] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T21:27:05.465104] [INFO ] [REMOTE ] FLC: Full fetch complete (7812 records). [2025-10-23T21:27:05.465243] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-23T21:27:05.607621] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-23T21:27:06.014440] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-23T21:27:06.014580] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-23T21:27:06.014955] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-23T21:27:06.015032] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-23T21:27:06.015525] [DEBUG] [LOCAL ] FLC: Trimmed 7812 records to 5444 (keeping 200 days of data) [2025-10-23T21:27:06.052479] [DEBUG] [LOCAL ] FLC: Primary data saved (5444 records). [2025-10-23T21:27:06.052867] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-23T21:27:06.053068] [INFO ] [MAIN ] Update Progress: 842/2367 symbols completed. FLC took 24.2s. Estimated remaining: 3h 13m 51s. Rate: 7.9 symbols/min [2025-10-23T21:27:06.220052] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T21:27:06.298224] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:06.298415] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-23T21:27:06.298492] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-23T21:27:06.298604] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-23T21:27:06.298697] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-23T21:27:06.298782] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-23T21:27:06.298852] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-23T21:27:06.402029] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-23T21:27:06.657068] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:07.201972] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-23T21:27:07.205155] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T21:27:07.963696] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T21:27:07.999419] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-23T21:27:08.739167] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T21:27:08.799413] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-23T21:27:09.067017] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T21:27:09.599441] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-23T21:27:10.399430] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-23T21:27:10.758431] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:27:11.199422] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-23T21:27:11.218766] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T21:27:11.415667] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T21:27:11.999448] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-23T21:27:12.678755] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T21:27:12.688311] [INFO ] [REMOTE ] FLG: Full fetch complete (77425 records). [2025-10-23T21:27:12.688506] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-23T21:27:12.804725] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-23T21:27:13.118680] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-23T21:27:13.118818] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-23T21:27:13.120106] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-23T21:27:13.120195] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-23T21:27:13.121860] [DEBUG] [LOCAL ] FLG: Trimmed 77425 records to 53708 (keeping 200 days of data) [2025-10-23T21:27:13.459042] [DEBUG] [LOCAL ] FLG: Primary data saved (53708 records). [2025-10-23T21:27:13.459208] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-23T21:27:13.459325] [INFO ] [MAIN ] Update Progress: 843/2367 symbols completed. FLG took 31.6s. Estimated remaining: 3h 13m 43s. Rate: 7.9 symbols/min [2025-10-23T21:27:13.601871] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-23T21:27:13.634064] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:13.682531] [DEBUG] [LOCAL ] FLR: Loaded 53263 existing records from primary storage. [2025-10-23T21:27:13.682892] [INFO ] [MAIN ] FLR: Loaded 53263 existing records. [2025-10-23T21:27:13.867668] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:13.868121] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-23T21:27:13.868240] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-23T21:27:13.868584] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-23T21:27:13.868723] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-23T21:27:14.168682] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-23T21:27:14.262624] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T21:27:14.290227] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:14.291052] [INFO ] [REMOTE ] FLNG: Full fetch complete (49810 records). [2025-10-23T21:27:14.291183] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-23T21:27:14.404504] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-23T21:27:14.673432] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-23T21:27:14.673579] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-23T21:27:14.674416] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-23T21:27:14.674496] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-23T21:27:14.675710] [DEBUG] [LOCAL ] FLNG: Trimmed 49810 records to 33502 (keeping 200 days of data) [2025-10-23T21:27:14.875764] [DEBUG] [LOCAL ] FLNG: Primary data saved (33502 records). [2025-10-23T21:27:14.876049] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-23T21:27:14.876164] [INFO ] [MAIN ] Update Progress: 844/2367 symbols completed. FLNG took 33.0s. Estimated remaining: 3h 13m 24s. Rate: 7.9 symbols/min [2025-10-23T21:27:15.051839] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:15.071934] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T21:27:15.118748] [DEBUG] [LOCAL ] FLS: Loaded 50409 existing records from primary storage. [2025-10-23T21:27:15.119097] [INFO ] [MAIN ] FLS: Loaded 50409 existing records. [2025-10-23T21:27:15.204726] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-23T21:27:15.303798] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:15.304018] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-23T21:27:15.304093] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-23T21:27:15.304308] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-23T21:27:15.304379] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-23T21:27:15.652037] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:15.999449] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-23T21:27:16.359203] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T21:27:16.371338] [INFO ] [REMOTE ] FLO: Full fetch complete (75395 records). [2025-10-23T21:27:16.371533] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-23T21:27:16.761874] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-23T21:27:16.761994] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-23T21:27:16.762995] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-23T21:27:16.763081] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-23T21:27:16.764520] [DEBUG] [LOCAL ] FLO: Trimmed 75395 records to 52445 (keeping 200 days of data) [2025-10-23T21:27:16.818882] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-23T21:27:17.090983] [DEBUG] [LOCAL ] FLO: Primary data saved (52445 records). [2025-10-23T21:27:17.091456] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-23T21:27:17.091701] [INFO ] [MAIN ] Update Progress: 845/2367 symbols completed. FLO took 33.0s. Estimated remaining: 3h 13m 7s. Rate: 7.9 symbols/min [2025-10-23T21:27:17.224623] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T21:27:17.308739] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:17.326251] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T21:27:17.378431] [DEBUG] [LOCAL ] FLUT: Loaded 50672 existing records from primary storage. [2025-10-23T21:27:17.378804] [INFO ] [MAIN ] FLUT: Loaded 50672 existing records. [2025-10-23T21:27:17.555248] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:17.555465] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-23T21:27:17.555537] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-23T21:27:17.555776] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-23T21:27:17.555847] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-23T21:27:17.610609] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-23T21:27:17.913368] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:18.399468] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-23T21:27:18.566740] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T21:27:18.917618] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T21:27:19.199453] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-23T21:27:19.999440] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-23T21:27:20.177172] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T21:27:20.799414] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-23T21:27:21.090539] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T21:27:21.515094] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T21:27:21.599456] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-23T21:27:21.825880] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T21:27:22.399498] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-23T21:27:23.199418] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-23T21:27:23.403623] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:27:23.555299] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T21:27:23.999452] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-23T21:27:24.799413] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-23T21:27:24.904425] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:27:25.599416] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-23T21:27:25.797388] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T21:27:26.399438] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-23T21:27:26.498855] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:27:26.834975] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T21:27:27.199471] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-23T21:27:27.999437] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-23T21:27:28.269472] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T21:27:28.799425] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-23T21:27:28.976336] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T21:27:29.599444] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-23T21:27:29.831036] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:27:30.399404] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-23T21:27:30.679553] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T21:27:30.966558] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T21:27:31.199414] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-23T21:27:31.999443] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-23T21:27:32.231446] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T21:27:32.287533] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T21:27:32.799488] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-23T21:27:33.599501] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-23T21:27:33.705570] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T21:27:34.399436] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-23T21:27:34.478430] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T21:27:35.134761] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T21:27:35.199438] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-23T21:27:35.999455] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-23T21:27:36.347473] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T21:27:36.784812] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T21:27:36.789870] [INFO ] [REMOTE ] FLOC: Full fetch complete (41049 records). [2025-10-23T21:27:36.790020] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-23T21:27:36.804674] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-23T21:27:36.987666] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-23T21:27:36.988345] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:27:36.988583] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:27:36.988747] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-23T21:27:36.988959] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-23T21:27:36.989116] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-23T21:27:36.989324] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-23T21:27:36.989516] [INFO ] [MAIN ] Update Progress: 846/2367 symbols completed. FLOC took 30.9s. Estimated remaining: 3h 13m 21s. Rate: 7.9 symbols/min [2025-10-23T21:27:37.177751] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T21:27:37.216514] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:37.238467] [DEBUG] [LOCAL ] FLXR: Loaded 21360 existing records from primary storage. [2025-10-23T21:27:37.238832] [INFO ] [MAIN ] FLXR: Loaded 21360 existing records. [2025-10-23T21:27:37.424851] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:37.425104] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-23T21:27:37.425183] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-23T21:27:37.425555] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-23T21:27:37.425632] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-23T21:27:37.609218] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-23T21:27:37.777428] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:38.399422] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-23T21:27:38.793280] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T21:27:39.199419] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-23T21:27:39.377309] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:27:39.987114] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T21:27:39.999397] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-23T21:27:40.445689] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T21:27:40.777420] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T21:27:40.799412] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-23T21:27:41.599452] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-23T21:27:42.399445] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-23T21:27:42.576503] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:27:43.034984] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T21:27:43.199398] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-23T21:27:43.397067] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:27:43.999442] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-23T21:27:44.799445] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-23T21:27:45.136506] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T21:27:45.176173] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-23T21:27:45.599441] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-23T21:27:46.399449] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-23T21:27:46.684445] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T21:27:46.728511] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T21:27:47.199437] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-23T21:27:47.999420] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-23T21:27:48.252199] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T21:27:48.262259] [INFO ] [REMOTE ] FLR: Full fetch complete (76898 records). [2025-10-23T21:27:48.262464] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-23T21:27:48.517099] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T21:27:48.675340] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-23T21:27:48.675479] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-23T21:27:48.676468] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-23T21:27:48.676570] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-23T21:27:48.678150] [DEBUG] [LOCAL ] FLR: Trimmed 76898 records to 53643 (keeping 200 days of data) [2025-10-23T21:27:48.838314] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-23T21:27:48.991877] [DEBUG] [LOCAL ] FLR: Primary data saved (53643 records). [2025-10-23T21:27:48.992049] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-23T21:27:48.992163] [INFO ] [MAIN ] Update Progress: 847/2367 symbols completed. FLR took 35.5s. Estimated remaining: 3h 13m 22s. Rate: 7.9 symbols/min [2025-10-23T21:27:49.168478] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:49.214198] [DEBUG] [LOCAL ] FMC: Loaded 51883 existing records from primary storage. [2025-10-23T21:27:49.214533] [INFO ] [MAIN ] FMC: Loaded 51883 existing records. [2025-10-23T21:27:49.396367] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:49.396606] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-23T21:27:49.396703] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-23T21:27:49.397337] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-23T21:27:49.397411] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-23T21:27:49.601256] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-23T21:27:49.766176] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:49.911015] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T21:27:49.938923] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T21:27:49.947973] [INFO ] [REMOTE ] FLUT: Full fetch complete (73364 records). [2025-10-23T21:27:49.948160] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-23T21:27:50.328333] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-23T21:27:50.328458] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-23T21:27:50.329416] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-23T21:27:50.329514] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-23T21:27:50.330911] [DEBUG] [LOCAL ] FLUT: Trimmed 73364 records to 51016 (keeping 200 days of data) [2025-10-23T21:27:50.415397] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-23T21:27:50.634487] [DEBUG] [LOCAL ] FLUT: Primary data saved (51016 records). [2025-10-23T21:27:50.634671] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-23T21:27:50.634795] [INFO ] [MAIN ] Update Progress: 848/2367 symbols completed. FLUT took 33.5s. Estimated remaining: 3h 13m 3s. Rate: 7.9 symbols/min [2025-10-23T21:27:50.807092] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:50.814679] [DEBUG] [LOCAL ] FMN: Loaded 5477 existing records from primary storage. [2025-10-23T21:27:50.814942] [INFO ] [MAIN ] FMN: Loaded 5477 existing records. [2025-10-23T21:27:50.990983] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:50.991193] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-23T21:27:50.991268] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-23T21:27:50.991464] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-23T21:27:50.991542] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-23T21:27:51.201369] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-23T21:27:51.355221] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:51.591528] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T21:27:51.600519] [INFO ] [REMOTE ] FLS: Full fetch complete (72545 records). [2025-10-23T21:27:51.600687] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-23T21:27:51.992834] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-23T21:27:51.992993] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-23T21:27:51.994092] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-23T21:27:51.994184] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-23T21:27:51.995859] [DEBUG] [LOCAL ] FLS: Trimmed 72545 records to 50773 (keeping 200 days of data) [2025-10-23T21:27:52.061288] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-23T21:27:52.116736] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:27:52.349265] [DEBUG] [LOCAL ] FLS: Primary data saved (50773 records). [2025-10-23T21:27:52.349427] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-23T21:27:52.349548] [INFO ] [MAIN ] Update Progress: 849/2367 symbols completed. FLS took 37.5s. Estimated remaining: 3h 12m 45s. Rate: 7.9 symbols/min [2025-10-23T21:27:52.541771] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:52.544806] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T21:27:52.559336] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-23T21:27:52.585961] [DEBUG] [LOCAL ] FMS: Loaded 30344 existing records from primary storage. [2025-10-23T21:27:52.586279] [INFO ] [MAIN ] FMS: Loaded 30344 existing records. [2025-10-23T21:27:52.769574] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:52.769842] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-23T21:27:52.769959] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-23T21:27:52.770201] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-23T21:27:52.770277] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-23T21:27:52.804608] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-23T21:27:53.145747] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:27:53.599509] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-23T21:27:54.098538] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T21:27:54.394043] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T21:27:54.399382] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-23T21:27:55.199504] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-23T21:27:55.256491] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T21:27:55.999481] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-23T21:27:56.265982] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T21:27:56.716241] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T21:27:56.799432] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-23T21:27:57.599576] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-23T21:27:58.399489] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-23T21:27:58.581830] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T21:27:58.802196] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T21:27:58.808311] [INFO ] [REMOTE ] FLXR: Full fetch complete (27743 records). [2025-10-23T21:27:58.808587] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-23T21:27:59.007411] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T21:27:59.205075] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-23T21:27:59.301929] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-23T21:27:59.302042] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-23T21:27:59.302624] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-23T21:27:59.302728] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-23T21:27:59.303484] [DEBUG] [LOCAL ] FLXR: Trimmed 27743 records to 21596 (keeping 200 days of data) [2025-10-23T21:27:59.430577] [DEBUG] [LOCAL ] FLXR: Primary data saved (21596 records). [2025-10-23T21:27:59.430745] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-23T21:27:59.430855] [INFO ] [MAIN ] Update Progress: 850/2367 symbols completed. FLXR took 22.4s. Estimated remaining: 3h 12m 36s. Rate: 7.9 symbols/min [2025-10-23T21:27:59.598309] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:27:59.639814] [DEBUG] [LOCAL ] FMX: Loaded 40436 existing records from primary storage. [2025-10-23T21:27:59.640171] [INFO ] [MAIN ] FMX: Loaded 40436 existing records. [2025-10-23T21:27:59.817247] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:27:59.821734] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-23T21:27:59.822329] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-23T21:27:59.822514] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T21:27:59.823405] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-23T21:27:59.824965] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-23T21:27:59.999497] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-23T21:28:00.183410] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:00.799483] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-23T21:28:01.599429] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-23T21:28:01.987801] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T21:28:02.303256] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T21:28:02.319693] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T21:28:02.399469] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-23T21:28:02.994854] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T21:28:03.199466] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-23T21:28:03.999454] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-23T21:28:04.799422] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-23T21:28:04.924823] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T21:28:05.402024] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T21:28:05.547711] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T21:28:05.599414] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-23T21:28:06.399441] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-23T21:28:07.152226] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T21:28:07.199411] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-23T21:28:07.794597] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T21:28:07.849579] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T21:28:07.851477] [INFO ] [REMOTE ] FMN: Full fetch complete (9871 records). [2025-10-23T21:28:07.851566] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-23T21:28:08.004565] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-23T21:28:08.216314] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-23T21:28:08.216415] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-23T21:28:08.216750] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-23T21:28:08.216829] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-23T21:28:08.217351] [DEBUG] [LOCAL ] FMN: Trimmed 9871 records to 5496 (keeping 200 days of data) [2025-10-23T21:28:08.249937] [DEBUG] [LOCAL ] FMN: Primary data saved (5496 records). [2025-10-23T21:28:08.250065] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-23T21:28:08.250169] [INFO ] [MAIN ] Update Progress: 851/2367 symbols completed. FMN took 17.6s. Estimated remaining: 3h 12m 31s. Rate: 7.9 symbols/min [2025-10-23T21:28:08.423595] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:28:08.427403] [DEBUG] [LOCAL ] FMY: Loaded 1360 existing records from primary storage. [2025-10-23T21:28:08.427573] [INFO ] [MAIN ] FMY: Loaded 1360 existing records. [2025-10-23T21:28:08.603183] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:28:08.603379] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-23T21:28:08.603457] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-23T21:28:08.603680] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-23T21:28:08.603771] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-23T21:28:08.811371] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-23T21:28:08.977638] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:09.490968] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T21:28:09.599430] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-23T21:28:09.960970] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-23T21:28:10.399431] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-23T21:28:10.540944] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T21:28:11.199447] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-23T21:28:11.999407] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-23T21:28:12.039178] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T21:28:12.447666] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T21:28:12.585173] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T21:28:12.799472] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-23T21:28:13.599445] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-23T21:28:13.983210] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-23T21:28:14.228568] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T21:28:14.399430] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-23T21:28:15.199499] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-23T21:28:15.645302] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-23T21:28:15.729863] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T21:28:15.999464] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-23T21:28:16.799491] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-23T21:28:17.599420] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-23T21:28:17.741137] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T21:28:18.053766] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T21:28:18.399406] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-23T21:28:18.988039] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T21:28:19.199475] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-23T21:28:19.584444] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-23T21:28:19.752933] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T21:28:19.999469] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-23T21:28:20.799454] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-23T21:28:21.399478] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T21:28:21.599478] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-23T21:28:22.399493] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-23T21:28:22.625725] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:28:23.199465] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-23T21:28:23.231142] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T21:28:23.789477] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T21:28:23.999435] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-23T21:28:24.799429] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-23T21:28:25.009809] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T21:28:25.261470] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T21:28:25.267768] [INFO ] [REMOTE ] FMS: Full fetch complete (43144 records). [2025-10-23T21:28:25.267878] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-23T21:28:25.609692] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-23T21:28:25.659548] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-23T21:28:25.659669] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-23T21:28:25.660395] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-23T21:28:25.660470] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-23T21:28:25.661497] [DEBUG] [LOCAL ] FMS: Trimmed 43144 records to 30525 (keeping 200 days of data) [2025-10-23T21:28:25.834146] [DEBUG] [LOCAL ] FMS: Primary data saved (30525 records). [2025-10-23T21:28:25.834306] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-23T21:28:25.834417] [INFO ] [MAIN ] Update Progress: 852/2367 symbols completed. FMS took 33.5s. Estimated remaining: 3h 12m 41s. Rate: 7.9 symbols/min [2025-10-23T21:28:26.000180] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:28:26.035077] [DEBUG] [LOCAL ] FN: Loaded 37392 existing records from primary storage. [2025-10-23T21:28:26.035390] [INFO ] [MAIN ] FN: Loaded 37392 existing records. [2025-10-23T21:28:26.211741] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:28:26.212151] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-23T21:28:26.212300] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-23T21:28:26.212523] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-23T21:28:26.212596] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-23T21:28:26.341283] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T21:28:26.405352] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-23T21:28:26.555386] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T21:28:26.623593] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:27.199460] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-23T21:28:27.705060] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-23T21:28:27.999424] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-23T21:28:28.398351] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T21:28:28.436454] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T21:28:28.799468] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-23T21:28:29.599447] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-23T21:28:30.269689] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T21:28:30.399450] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-23T21:28:31.199469] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-23T21:28:31.672804] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T21:28:31.682086] [INFO ] [REMOTE ] FMC: Full fetch complete (75433 records). [2025-10-23T21:28:31.682235] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-23T21:28:31.999638] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-23T21:28:32.080331] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-23T21:28:32.080470] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-23T21:28:32.081635] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-23T21:28:32.081746] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-23T21:28:32.083294] [DEBUG] [LOCAL ] FMC: Trimmed 75433 records to 52264 (keeping 200 days of data) [2025-10-23T21:28:32.208474] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T21:28:32.425039] [DEBUG] [LOCAL ] FMC: Primary data saved (52264 records). [2025-10-23T21:28:32.425184] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-23T21:28:32.425290] [INFO ] [MAIN ] Update Progress: 853/2367 symbols completed. FMC took 43.4s. Estimated remaining: 3h 12m 32s. Rate: 7.9 symbols/min [2025-10-23T21:28:32.597355] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:28:32.600229] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T21:28:32.653993] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-23T21:28:32.654451] [INFO ] [MAIN ] FNB: Loaded 52602 existing records. [2025-10-23T21:28:32.811192] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-23T21:28:32.853338] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:28:32.853747] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-23T21:28:32.853835] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-23T21:28:32.854196] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-23T21:28:32.854405] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-23T21:28:33.157260] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:28:33.244415] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:33.599441] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-23T21:28:33.977126] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-23T21:28:33.978231] [INFO ] [REMOTE ] FMY: Full fetch complete (1941 records). [2025-10-23T21:28:33.978334] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-23T21:28:34.349126] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-23T21:28:34.349243] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-23T21:28:34.349376] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-23T21:28:34.349447] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-23T21:28:34.349868] [DEBUG] [LOCAL ] FMY: Trimmed 1941 records to 1365 (keeping 200 days of data) [2025-10-23T21:28:34.358833] [DEBUG] [LOCAL ] FMY: Primary data saved (1365 records). [2025-10-23T21:28:34.359008] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-23T21:28:34.359179] [INFO ] [MAIN ] Update Progress: 854/2367 symbols completed. FMY took 26.1s. Estimated remaining: 3h 12m 14s. Rate: 7.9 symbols/min [2025-10-23T21:28:34.404618] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-23T21:28:34.534986] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:28:34.580226] [DEBUG] [LOCAL ] FND: Loaded 52075 existing records from primary storage. [2025-10-23T21:28:34.580583] [INFO ] [MAIN ] FND: Loaded 52075 existing records. [2025-10-23T21:28:34.766385] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:28:34.780721] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-23T21:28:34.780841] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-23T21:28:34.782190] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T21:28:34.782232] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-23T21:28:34.791032] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-23T21:28:35.136193] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:35.199394] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-23T21:28:35.999431] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-23T21:28:36.799423] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-23T21:28:36.898014] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:28:37.368892] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T21:28:37.375305] [INFO ] [REMOTE ] FMX: Full fetch complete (57896 records). [2025-10-23T21:28:37.375433] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-23T21:28:37.545097] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (3.14 seconds). [2025-10-23T21:28:37.606237] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-23T21:28:37.801287] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-23T21:28:37.801395] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-23T21:28:37.802198] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-23T21:28:37.802277] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-23T21:28:37.803401] [DEBUG] [LOCAL ] FMX: Trimmed 57896 records to 40643 (keeping 200 days of data) [2025-10-23T21:28:38.047865] [DEBUG] [LOCAL ] FMX: Primary data saved (40643 records). [2025-10-23T21:28:38.048054] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-23T21:28:38.048168] [INFO ] [MAIN ] Update Progress: 855/2367 symbols completed. FMX took 38.6s. Estimated remaining: 3h 11m 59s. Rate: 7.9 symbols/min [2025-10-23T21:28:38.217346] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:28:38.259773] [DEBUG] [LOCAL ] FNF: Loaded 48737 existing records from primary storage. [2025-10-23T21:28:38.260139] [INFO ] [MAIN ] FNF: Loaded 48737 existing records. [2025-10-23T21:28:38.399971] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-23T21:28:38.444258] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:28:38.444598] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-23T21:28:38.444792] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-23T21:28:38.445164] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-23T21:28:38.445258] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-23T21:28:38.759381] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T21:28:38.889999] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:39.199449] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-23T21:28:39.375923] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T21:28:39.893124] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T21:28:39.999409] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-23T21:28:40.752463] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T21:28:40.799399] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-23T21:28:41.599419] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-23T21:28:41.718851] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T21:28:42.012091] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T21:28:42.399432] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-23T21:28:43.090451] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T21:28:43.199444] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-23T21:28:43.999428] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-23T21:28:44.214137] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T21:28:44.764844] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T21:28:44.799431] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-23T21:28:45.480701] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T21:28:45.599416] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-23T21:28:46.399417] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-23T21:28:46.798799] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T21:28:47.199409] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-23T21:28:47.387953] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T21:28:47.796879] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T21:28:47.999460] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-23T21:28:48.799434] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-23T21:28:48.908771] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T21:28:49.599424] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-23T21:28:49.645236] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T21:28:50.219003] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T21:28:50.399408] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-23T21:28:51.035310] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T21:28:51.199476] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-23T21:28:51.692034] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T21:28:51.999449] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-23T21:28:52.799413] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-23T21:28:52.987487] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T21:28:53.070007] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T21:28:53.599454] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-23T21:28:54.399483] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-23T21:28:54.643810] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T21:28:55.020386] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T21:28:55.026161] [INFO ] [REMOTE ] FN: Full fetch complete (56416 records). [2025-10-23T21:28:55.026285] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-23T21:28:55.202924] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-23T21:28:55.425818] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-23T21:28:55.425962] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-23T21:28:55.427282] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-23T21:28:55.427368] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-23T21:28:55.428918] [DEBUG] [LOCAL ] FN: Trimmed 56416 records to 37580 (keeping 200 days of data) [2025-10-23T21:28:55.666502] [DEBUG] [LOCAL ] FN: Primary data saved (37580 records). [2025-10-23T21:28:55.666968] [INFO ] [MAIN ] FN: Full history saved. [2025-10-23T21:28:55.667128] [INFO ] [MAIN ] Update Progress: 856/2367 symbols completed. FN took 29.8s. Estimated remaining: 3h 12m 9s. Rate: 7.9 symbols/min [2025-10-23T21:28:55.848756] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:28:55.879573] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T21:28:55.928245] [DEBUG] [LOCAL ] FNV: Loaded 46129 existing records from primary storage. [2025-10-23T21:28:55.928565] [INFO ] [MAIN ] FNV: Loaded 46129 existing records. [2025-10-23T21:28:56.004543] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-23T21:28:56.106015] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:28:56.106262] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-23T21:28:56.106343] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-23T21:28:56.106604] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-23T21:28:56.106728] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-23T21:28:56.452403] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:28:56.799431] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-23T21:28:57.019825] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T21:28:57.599469] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-23T21:28:57.733187] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T21:28:57.922407] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T21:28:58.399461] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-23T21:28:59.199457] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-23T21:28:59.492744] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T21:28:59.956774] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T21:28:59.999411] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-23T21:29:00.799420] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-23T21:29:00.954293] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:29:01.520549] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T21:29:01.599476] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-23T21:29:02.399452] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-23T21:29:02.606408] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T21:29:03.073567] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:29:03.199452] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-23T21:29:03.999437] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-23T21:29:04.216558] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T21:29:04.799437] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-23T21:29:05.008936] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T21:29:05.599416] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-23T21:29:05.783737] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T21:29:05.792739] [INFO ] [REMOTE ] FND: Full fetch complete (75084 records). [2025-10-23T21:29:05.792908] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-23T21:29:06.209924] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-23T21:29:06.210064] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-23T21:29:06.211052] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-23T21:29:06.211131] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-23T21:29:06.212592] [DEBUG] [LOCAL ] FND: Trimmed 75084 records to 52447 (keeping 200 days of data) [2025-10-23T21:29:06.417534] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-23T21:29:06.527422] [DEBUG] [LOCAL ] FND: Primary data saved (52447 records). [2025-10-23T21:29:06.527587] [INFO ] [MAIN ] FND: Full history saved. [2025-10-23T21:29:06.527762] [INFO ] [MAIN ] Update Progress: 857/2367 symbols completed. FND took 32.2s. Estimated remaining: 3h 12m 7s. Rate: 7.9 symbols/min [2025-10-23T21:29:06.712805] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:06.730780] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T21:29:06.751417] [DEBUG] [LOCAL ] FOA: Loaded 13013 existing records from primary storage. [2025-10-23T21:29:06.751764] [INFO ] [MAIN ] FOA: Loaded 13013 existing records. [2025-10-23T21:29:06.931820] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:06.932026] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-23T21:29:06.932100] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-23T21:29:06.932369] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-23T21:29:06.932444] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-23T21:29:07.207799] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-23T21:29:07.306680] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:07.334093] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T21:29:07.999479] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-23T21:29:08.239393] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T21:29:08.799522] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-23T21:29:08.949504] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T21:29:09.009233] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-23T21:29:09.599438] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-23T21:29:10.258260] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T21:29:10.267288] [INFO ] [REMOTE ] FNF: Full fetch complete (69991 records). [2025-10-23T21:29:10.267539] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-23T21:29:10.413599] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-23T21:29:10.686184] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-23T21:29:10.686354] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-23T21:29:10.688216] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-23T21:29:10.688313] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-23T21:29:10.690368] [DEBUG] [LOCAL ] FNF: Trimmed 69991 records to 49061 (keeping 200 days of data) [2025-10-23T21:29:11.017166] [DEBUG] [LOCAL ] FNF: Primary data saved (49061 records). [2025-10-23T21:29:11.017525] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-23T21:29:11.017712] [INFO ] [MAIN ] Update Progress: 858/2367 symbols completed. FNF took 33.0s. Estimated remaining: 3h 11m 54s. Rate: 7.9 symbols/min [2025-10-23T21:29:11.203139] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:11.203281] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-23T21:29:11.217286] [DEBUG] [LOCAL ] FOF: Loaded 8391 existing records from primary storage. [2025-10-23T21:29:11.217672] [INFO ] [MAIN ] FOF: Loaded 8391 existing records. [2025-10-23T21:29:11.430326] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:11.452245] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-23T21:29:11.453287] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-23T21:29:11.456230] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T21:29:11.465833] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-23T21:29:11.466415] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-23T21:29:11.794529] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T21:29:11.882961] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:11.999474] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-23T21:29:12.799427] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-23T21:29:12.816334] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T21:29:12.986388] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T21:29:12.995757] [INFO ] [REMOTE ] FNB: Full fetch complete (76232 records). [2025-10-23T21:29:12.995912] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-23T21:29:13.392884] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-23T21:29:13.393019] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-23T21:29:13.394075] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-23T21:29:13.394156] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-23T21:29:13.395688] [DEBUG] [LOCAL ] FNB: Trimmed 76232 records to 52992 (keeping 200 days of data) [2025-10-23T21:29:13.603589] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-23T21:29:13.720943] [DEBUG] [LOCAL ] FNB: Primary data saved (52992 records). [2025-10-23T21:29:13.730567] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-23T21:29:13.730752] [INFO ] [MAIN ] Update Progress: 859/2367 symbols completed. FNB took 41.3s. Estimated remaining: 3h 11m 38s. Rate: 7.9 symbols/min [2025-10-23T21:29:13.731271] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T21:29:13.903941] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:13.922991] [DEBUG] [LOCAL ] FOR: Loaded 19506 existing records from primary storage. [2025-10-23T21:29:13.923324] [INFO ] [MAIN ] FOR: Loaded 19506 existing records. [2025-10-23T21:29:14.104714] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:14.104966] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-23T21:29:14.105069] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-23T21:29:14.105399] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-23T21:29:14.105483] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-23T21:29:14.404519] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-23T21:29:14.459077] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:15.103328] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T21:29:15.199441] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-23T21:29:15.271291] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T21:29:15.999471] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-23T21:29:16.599954] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T21:29:16.799497] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-23T21:29:17.229739] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T21:29:17.564947] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T21:29:17.599435] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-23T21:29:18.399410] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-23T21:29:18.641854] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T21:29:19.199452] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-23T21:29:19.231902] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T21:29:19.922624] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T21:29:19.999452] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-23T21:29:20.707113] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-23T21:29:20.799429] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-23T21:29:21.564918] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T21:29:21.599418] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-23T21:29:22.399433] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-23T21:29:22.635039] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T21:29:23.168878] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T21:29:23.199429] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-23T21:29:23.999416] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-23T21:29:24.133139] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-23T21:29:24.799439] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-23T21:29:25.599423] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-23T21:29:25.700911] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T21:29:26.138789] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T21:29:26.399447] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-23T21:29:26.575620] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T21:29:26.856508] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T21:29:27.199509] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-23T21:29:27.999434] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-23T21:29:28.046416] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T21:29:28.799450] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-23T21:29:29.562879] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T21:29:29.571294] [INFO ] [REMOTE ] FNV: Full fetch complete (67021 records). [2025-10-23T21:29:29.571460] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-23T21:29:29.604523] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-23T21:29:29.684687] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T21:29:29.971599] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-23T21:29:29.971750] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-23T21:29:29.972683] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-23T21:29:29.972821] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-23T21:29:29.974269] [DEBUG] [LOCAL ] FNV: Trimmed 67021 records to 46446 (keeping 200 days of data) [2025-10-23T21:29:30.257173] [DEBUG] [LOCAL ] FNV: Primary data saved (46446 records). [2025-10-23T21:29:30.257335] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-23T21:29:30.257452] [INFO ] [MAIN ] Update Progress: 860/2367 symbols completed. FNV took 34.6s. Estimated remaining: 3h 11m 46s. Rate: 7.9 symbols/min [2025-10-23T21:29:30.403979] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-23T21:29:30.434935] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:30.477104] [DEBUG] [LOCAL ] FOUR: Loaded 49712 existing records from primary storage. [2025-10-23T21:29:30.477458] [INFO ] [MAIN ] FOUR: Loaded 49712 existing records. [2025-10-23T21:29:30.654055] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:30.661113] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-23T21:29:30.661719] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-23T21:29:30.661973] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-23T21:29:30.664966] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-23T21:29:30.665154] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-23T21:29:30.665228] [INFO ] [REMOTE ] FOA: Full fetch complete (20964 records). [2025-10-23T21:29:30.696677] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-23T21:29:31.213124] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-23T21:29:31.270881] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T21:29:31.363363] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:31.428578] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-23T21:29:31.428703] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-23T21:29:31.429203] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-23T21:29:31.429277] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-23T21:29:31.429913] [DEBUG] [LOCAL ] FOA: Trimmed 20964 records to 13094 (keeping 200 days of data) [2025-10-23T21:29:31.502883] [DEBUG] [LOCAL ] FOA: Primary data saved (13094 records). [2025-10-23T21:29:31.503034] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-23T21:29:31.503144] [INFO ] [MAIN ] Update Progress: 861/2367 symbols completed. FOA took 25.0s. Estimated remaining: 3h 11m 27s. Rate: 7.9 symbols/min [2025-10-23T21:29:31.677797] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:31.696916] [DEBUG] [LOCAL ] FPF: Loaded 18735 existing records from primary storage. [2025-10-23T21:29:31.697205] [INFO ] [MAIN ] FPF: Loaded 18735 existing records. [2025-10-23T21:29:31.875483] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:31.875756] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-23T21:29:31.875850] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-23T21:29:31.876108] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-23T21:29:31.876185] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-23T21:29:32.004623] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-23T21:29:32.234892] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:32.330170] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T21:29:32.799472] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-23T21:29:33.599449] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-23T21:29:33.787612] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T21:29:33.913160] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T21:29:34.322773] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T21:29:34.324848] [INFO ] [REMOTE ] FOF: Full fetch complete (11929 records). [2025-10-23T21:29:34.325018] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-23T21:29:34.404637] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-23T21:29:34.680335] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-23T21:29:34.680445] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-23T21:29:34.680784] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-23T21:29:34.680861] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-23T21:29:34.681427] [DEBUG] [LOCAL ] FOF: Trimmed 11929 records to 8451 (keeping 200 days of data) [2025-10-23T21:29:34.731611] [DEBUG] [LOCAL ] FOF: Primary data saved (8451 records). [2025-10-23T21:29:34.731771] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-23T21:29:34.731881] [INFO ] [MAIN ] Update Progress: 862/2367 symbols completed. FOF took 23.7s. Estimated remaining: 3h 11m 12s. Rate: 7.9 symbols/min [2025-10-23T21:29:34.902966] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:34.920213] [DEBUG] [LOCAL ] FPH: Loaded 19183 existing records from primary storage. [2025-10-23T21:29:34.920465] [INFO ] [MAIN ] FPH: Loaded 19183 existing records. [2025-10-23T21:29:35.099007] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:35.099210] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-23T21:29:35.099287] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-23T21:29:35.099590] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-23T21:29:35.099697] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-23T21:29:35.201708] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-23T21:29:35.463676] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:35.475482] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T21:29:35.999457] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-23T21:29:36.283002] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T21:29:36.799435] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-23T21:29:37.227535] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T21:29:37.599472] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-23T21:29:37.765272] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T21:29:38.399480] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-23T21:29:38.816367] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T21:29:39.199447] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-23T21:29:39.254767] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T21:29:39.999472] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-23T21:29:40.179662] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T21:29:40.799437] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-23T21:29:41.062754] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T21:29:41.599426] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-23T21:29:41.934251] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T21:29:42.399416] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-23T21:29:42.697377] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T21:29:43.199461] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-23T21:29:43.388474] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-23T21:29:43.999478] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-23T21:29:44.799412] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-23T21:29:45.042282] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T21:29:45.085742] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T21:29:45.599422] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-23T21:29:45.843554] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-23T21:29:46.399433] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-23T21:29:46.513531] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-23T21:29:47.199439] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-23T21:29:47.306606] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T21:29:47.309836] [INFO ] [REMOTE ] FOR: Full fetch complete (29585 records). [2025-10-23T21:29:47.309942] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-23T21:29:47.681417] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-23T21:29:47.681532] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-23T21:29:47.682152] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-23T21:29:47.682231] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-23T21:29:47.682968] [DEBUG] [LOCAL ] FOR: Trimmed 29585 records to 19591 (keeping 200 days of data) [2025-10-23T21:29:47.793727] [DEBUG] [LOCAL ] FOR: Primary data saved (19591 records). [2025-10-23T21:29:47.793902] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-23T21:29:47.794018] [INFO ] [MAIN ] Update Progress: 863/2367 symbols completed. FOR took 34.1s. Estimated remaining: 3h 11m 14s. Rate: 7.9 symbols/min [2025-10-23T21:29:47.962058] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:29:47.992738] [DEBUG] [LOCAL ] FPI: Loaded 31375 existing records from primary storage. [2025-10-23T21:29:47.993040] [INFO ] [MAIN ] FPI: Loaded 31375 existing records. [2025-10-23T21:29:48.004576] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-23T21:29:48.178282] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:29:48.178556] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-23T21:29:48.178674] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-23T21:29:48.178972] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-23T21:29:48.179070] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-23T21:29:48.557553] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:29:48.799411] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-23T21:29:49.113230] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T21:29:49.173847] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T21:29:49.599442] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-23T21:29:49.823339] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T21:29:50.399451] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-23T21:29:51.167855] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T21:29:51.199402] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-23T21:29:51.499107] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T21:29:51.999465] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-23T21:29:52.799422] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-23T21:29:52.983731] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T21:29:53.006038] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T21:29:53.579300] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T21:29:53.599424] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-23T21:29:54.273292] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T21:29:54.399443] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-23T21:29:55.199430] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-23T21:29:55.584618] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T21:29:55.999420] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-23T21:29:56.774584] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T21:29:56.799425] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-23T21:29:56.827787] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T21:29:57.599415] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-23T21:29:57.833832] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T21:29:58.399484] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-23T21:29:58.920350] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T21:29:59.199433] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-23T21:29:59.521359] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T21:29:59.527470] [INFO ] [REMOTE ] FPF: Full fetch complete (26664 records). [2025-10-23T21:29:59.527689] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-23T21:30:00.004672] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-23T21:30:00.090211] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-23T21:30:00.090344] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-23T21:30:00.091075] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-23T21:30:00.091159] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-23T21:30:00.092138] [DEBUG] [LOCAL ] FPF: Trimmed 26664 records to 18898 (keeping 200 days of data) [2025-10-23T21:30:00.220370] [DEBUG] [LOCAL ] FPF: Primary data saved (18898 records). [2025-10-23T21:30:00.220552] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-23T21:30:00.220713] [INFO ] [MAIN ] Update Progress: 864/2367 symbols completed. FPF took 28.7s. Estimated remaining: 3h 11m 14s. Rate: 7.9 symbols/min [2025-10-23T21:30:00.333391] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T21:30:00.358598] [INFO ] [REMOTE ] FPH: Full fetch complete (30845 records). [2025-10-23T21:30:00.386600] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-23T21:30:00.488860] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:00.808810] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-23T21:30:00.844082] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-23T21:30:00.844181] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-23T21:30:00.845768] [DEBUG] [LOCAL ] FR: Loaded 46648 existing records from primary storage. [2025-10-23T21:30:00.846477] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-23T21:30:00.846702] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-23T21:30:00.847101] [INFO ] [MAIN ] FR: Loaded 46648 existing records. [2025-10-23T21:30:00.929916] [DEBUG] [LOCAL ] FPH: Trimmed 30845 records to 19347 (keeping 200 days of data) [2025-10-23T21:30:01.111839] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:01.120431] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-23T21:30:01.126510] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-23T21:30:01.143775] [DEBUG] [LOCAL ] FPH: Primary data saved (19347 records). [2025-10-23T21:30:01.144164] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-23T21:30:01.144298] [INFO ] [MAIN ] Update Progress: 865/2367 symbols completed. FPH took 26.4s. Estimated remaining: 3h 10m 55s. Rate: 7.9 symbols/min [2025-10-23T21:30:01.144494] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-23T21:30:01.165021] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-23T21:30:01.558438] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:01.715966] [DEBUG] [LOCAL ] FRA: Loaded 14058 existing records from primary storage. [2025-10-23T21:30:01.743956] [INFO ] [MAIN ] FRA: Loaded 14058 existing records. [2025-10-23T21:30:01.801112] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:01.823842] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-23T21:30:02.027361] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:02.030565] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-23T21:30:02.031376] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-23T21:30:02.032675] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T21:30:02.042870] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-23T21:30:02.043490] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-23T21:30:02.401684] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-23T21:30:02.415186] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:02.439500] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T21:30:03.199471] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-23T21:30:03.805040] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-23T21:30:03.999415] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-23T21:30:04.245130] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T21:30:04.579076] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T21:30:04.799444] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-23T21:30:05.599435] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-23T21:30:05.725630] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T21:30:06.399459] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-23T21:30:06.754998] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:30:07.009361] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T21:30:07.199453] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-23T21:30:07.999414] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-23T21:30:08.132369] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T21:30:08.237227] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T21:30:08.799450] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-23T21:30:09.416588] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T21:30:09.599423] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-23T21:30:09.808691] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T21:30:10.399456] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-23T21:30:11.083094] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T21:30:11.199463] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-23T21:30:11.587202] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T21:30:11.999513] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-23T21:30:12.799437] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-23T21:30:13.348510] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T21:30:13.358096] [INFO ] [REMOTE ] FOUR: Full fetch complete (72227 records). [2025-10-23T21:30:13.358274] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-23T21:30:13.617221] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-23T21:30:13.735713] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T21:30:13.812015] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-23T21:30:13.813232] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-23T21:30:13.814371] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-23T21:30:13.814538] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-23T21:30:13.843122] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T21:30:13.843313] [DEBUG] [LOCAL ] FOUR: Trimmed 72227 records to 50041 (keeping 200 days of data) [2025-10-23T21:30:14.146858] [DEBUG] [LOCAL ] FOUR: Primary data saved (50041 records). [2025-10-23T21:30:14.147023] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-23T21:30:14.147141] [INFO ] [MAIN ] Update Progress: 866/2367 symbols completed. FOUR took 43.9s. Estimated remaining: 3h 10m 57s. Rate: 7.9 symbols/min [2025-10-23T21:30:14.315442] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:14.330963] [DEBUG] [LOCAL ] FRGE: Loaded 15540 existing records from primary storage. [2025-10-23T21:30:14.331230] [INFO ] [MAIN ] FRGE: Loaded 15540 existing records. [2025-10-23T21:30:14.404619] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-23T21:30:14.512141] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:14.512346] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-23T21:30:14.512422] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-23T21:30:14.512637] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-23T21:30:14.512741] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-23T21:30:14.865177] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:14.961887] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T21:30:15.199441] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-23T21:30:15.234541] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T21:30:15.999462] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-23T21:30:16.357373] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T21:30:16.799499] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-23T21:30:17.536752] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T21:30:17.599418] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-23T21:30:18.089180] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T21:30:18.095382] [INFO ] [REMOTE ] FPI: Full fetch complete (43831 records). [2025-10-23T21:30:18.095569] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-23T21:30:18.405801] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-23T21:30:18.542383] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-23T21:30:18.542727] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-23T21:30:18.544043] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-23T21:30:18.544151] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-23T21:30:18.545839] [DEBUG] [LOCAL ] FPI: Trimmed 43831 records to 31560 (keeping 200 days of data) [2025-10-23T21:30:18.677066] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T21:30:18.799299] [DEBUG] [LOCAL ] FPI: Primary data saved (31560 records). [2025-10-23T21:30:18.799558] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-23T21:30:18.799841] [INFO ] [MAIN ] Update Progress: 867/2367 symbols completed. FPI took 31.0s. Estimated remaining: 3h 10m 44s. Rate: 7.9 symbols/min [2025-10-23T21:30:18.980284] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:19.036329] [DEBUG] [LOCAL ] FRO: Loaded 51679 existing records from primary storage. [2025-10-23T21:30:19.036859] [INFO ] [MAIN ] FRO: Loaded 51679 existing records. [2025-10-23T21:30:19.204856] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-23T21:30:19.234131] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:19.234494] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-23T21:30:19.234584] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-23T21:30:19.234914] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-23T21:30:19.234996] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-23T21:30:19.551481] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:30:19.628620] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:19.999478] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-23T21:30:20.799458] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-23T21:30:20.997453] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T21:30:21.599414] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-23T21:30:22.018551] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T21:30:22.163590] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T21:30:22.399421] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-23T21:30:22.444632] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-23T21:30:23.199416] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-23T21:30:23.726730] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T21:30:23.999469] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-23T21:30:24.111267] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-23T21:30:24.799469] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-23T21:30:25.599472] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-23T21:30:25.760699] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T21:30:26.399410] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-23T21:30:26.491303] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:30:26.522354] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T21:30:26.525184] [INFO ] [REMOTE ] FRA: Full fetch complete (23229 records). [2025-10-23T21:30:26.525283] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-23T21:30:26.883468] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-23T21:30:26.883573] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-23T21:30:26.884121] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-23T21:30:26.884201] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-23T21:30:26.884938] [DEBUG] [LOCAL ] FRA: Trimmed 23229 records to 14116 (keeping 200 days of data) [2025-10-23T21:30:26.971498] [DEBUG] [LOCAL ] FRA: Primary data saved (14116 records). [2025-10-23T21:30:26.971693] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-23T21:30:26.971868] [INFO ] [MAIN ] Update Progress: 868/2367 symbols completed. FRA took 25.8s. Estimated remaining: 3h 10m 37s. Rate: 7.9 symbols/min [2025-10-23T21:30:27.158085] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:27.195879] [DEBUG] [LOCAL ] FRT: Loaded 41468 existing records from primary storage. [2025-10-23T21:30:27.196239] [INFO ] [MAIN ] FRT: Loaded 41468 existing records. [2025-10-23T21:30:27.207926] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-23T21:30:27.381178] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:27.381437] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-23T21:30:27.381541] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-23T21:30:27.381814] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-23T21:30:27.381890] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-23T21:30:27.746319] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:27.999405] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-23T21:30:28.305870] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T21:30:28.633838] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-23T21:30:28.799509] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-23T21:30:29.512796] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T21:30:29.599446] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-23T21:30:30.399451] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-23T21:30:30.793713] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-23T21:30:31.046944] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T21:30:31.199430] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-23T21:30:31.387161] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T21:30:31.999483] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-23T21:30:32.799490] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-23T21:30:33.013787] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T21:30:33.599413] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-23T21:30:33.639177] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T21:30:33.774200] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T21:30:34.399443] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-23T21:30:35.199413] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-23T21:30:35.355370] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T21:30:35.356783] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T21:30:35.999440] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-23T21:30:36.799427] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-23T21:30:36.959895] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T21:30:37.597959] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T21:30:37.655964] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-23T21:30:37.808909] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T21:30:38.399488] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-23T21:30:39.183605] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:30:39.199398] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-23T21:30:39.999441] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-23T21:30:40.277247] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T21:30:40.664476] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T21:30:40.799462] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-23T21:30:40.840333] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T21:30:41.599444] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-23T21:30:42.401950] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-23T21:30:42.406253] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T21:30:43.199414] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-23T21:30:43.264295] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T21:30:43.999458] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-23T21:30:44.393138] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T21:30:44.799469] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-23T21:30:44.843982] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T21:30:44.846423] [INFO ] [REMOTE ] FRGE: Full fetch complete (29980 records). [2025-10-23T21:30:44.846516] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-23T21:30:45.228728] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-23T21:30:45.228956] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-23T21:30:45.229725] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-23T21:30:45.229875] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-23T21:30:45.259588] [DEBUG] [LOCAL ] FRGE: Trimmed 29980 records to 15605 (keeping 200 days of data) [2025-10-23T21:30:45.265472] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-23T21:30:45.370169] [DEBUG] [LOCAL ] FRGE: Primary data saved (15605 records). [2025-10-23T21:30:45.370356] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-23T21:30:45.370481] [INFO ] [MAIN ] Update Progress: 869/2367 symbols completed. FRGE took 31.2s. Estimated remaining: 3h 10m 48s. Rate: 7.9 symbols/min [2025-10-23T21:30:45.540261] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:45.574693] [DEBUG] [LOCAL ] FSCO: Loaded 38527 existing records from primary storage. [2025-10-23T21:30:45.574985] [INFO ] [MAIN ] FSCO: Loaded 38527 existing records. [2025-10-23T21:30:45.605586] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-23T21:30:45.756683] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:45.756909] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-23T21:30:45.756986] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-23T21:30:45.757221] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-23T21:30:45.757296] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-23T21:30:46.113018] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:46.398557] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T21:30:46.406601] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-23T21:30:46.408302] [INFO ] [REMOTE ] FR: Full fetch complete (67285 records). [2025-10-23T21:30:46.408537] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-23T21:30:46.546420] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T21:30:46.848623] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-23T21:30:46.848776] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-23T21:30:46.849699] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-23T21:30:46.849779] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-23T21:30:46.851182] [DEBUG] [LOCAL ] FR: Trimmed 67285 records to 46973 (keeping 200 days of data) [2025-10-23T21:30:47.149113] [DEBUG] [LOCAL ] FR: Primary data saved (46973 records). [2025-10-23T21:30:47.149282] [INFO ] [MAIN ] FR: Full history saved. [2025-10-23T21:30:47.149403] [INFO ] [MAIN ] Update Progress: 870/2367 symbols completed. FR took 46.9s. Estimated remaining: 3h 10m 30s. Rate: 7.9 symbols/min [2025-10-23T21:30:47.212217] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-23T21:30:47.319577] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:47.361973] [DEBUG] [LOCAL ] FSK: Loaded 49476 existing records from primary storage. [2025-10-23T21:30:47.362314] [INFO ] [MAIN ] FSK: Loaded 49476 existing records. [2025-10-23T21:30:47.539100] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:47.539384] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-23T21:30:47.539465] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-23T21:30:47.539902] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-23T21:30:47.539979] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-23T21:30:47.901570] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:47.973779] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T21:30:47.999403] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-23T21:30:48.799429] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-23T21:30:48.879292] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:30:48.886098] [INFO ] [REMOTE ] FRT: Full fetch complete (60484 records). [2025-10-23T21:30:48.886244] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-23T21:30:49.282082] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-23T21:30:49.282369] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-23T21:30:49.283311] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-23T21:30:49.283458] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-23T21:30:49.284688] [DEBUG] [LOCAL ] FRT: Trimmed 60484 records to 41727 (keeping 200 days of data) [2025-10-23T21:30:49.406863] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T21:30:49.560832] [DEBUG] [LOCAL ] FRT: Primary data saved (41727 records). [2025-10-23T21:30:49.560983] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-23T21:30:49.561091] [INFO ] [MAIN ] Update Progress: 871/2367 symbols completed. FRT took 22.6s. Estimated remaining: 3h 10m 14s. Rate: 7.9 symbols/min [2025-10-23T21:30:49.604545] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-23T21:30:49.729001] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:49.774606] [DEBUG] [LOCAL ] FSLY: Loaded 51303 existing records from primary storage. [2025-10-23T21:30:49.774990] [INFO ] [MAIN ] FSLY: Loaded 51303 existing records. [2025-10-23T21:30:49.946589] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:30:49.946809] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-23T21:30:49.946884] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-23T21:30:49.947219] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-23T21:30:49.947290] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-23T21:30:50.293612] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:50.399413] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-23T21:30:50.560991] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T21:30:51.115903] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T21:30:51.199469] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-23T21:30:51.999419] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-23T21:30:52.732324] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-23T21:30:52.810233] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-23T21:30:52.818396] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T21:30:53.227866] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T21:30:53.599731] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-23T21:30:54.404549] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-23T21:30:54.416732] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T21:30:54.426184] [INFO ] [REMOTE ] FRO: Full fetch complete (75394 records). [2025-10-23T21:30:54.426357] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-23T21:30:54.821338] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-23T21:30:54.821467] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-23T21:30:54.822558] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-23T21:30:54.822700] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-23T21:30:54.824210] [DEBUG] [LOCAL ] FRO: Trimmed 75394 records to 52061 (keeping 200 days of data) [2025-10-23T21:30:55.103124] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T21:30:55.183756] [DEBUG] [LOCAL ] FRO: Primary data saved (52061 records). [2025-10-23T21:30:55.183929] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-23T21:30:55.184059] [INFO ] [MAIN ] Update Progress: 872/2367 symbols completed. FRO took 36.4s. Estimated remaining: 3h 10m 3s. Rate: 7.9 symbols/min [2025-10-23T21:30:55.205753] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-23T21:30:55.363756] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:30:55.363977] [DEBUG] [LOCAL ] FSM: No existing data file found in primary storage. [2025-10-23T21:30:55.364049] [WARN ] [MAIN ] FSM: No existing data found, performing full refresh instead. [2025-10-23T21:30:55.364160] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-23T21:30:55.364231] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-23T21:30:55.364311] [DEBUG] [LOCAL ] FSM: No primary data file found to delete. [2025-10-23T21:30:55.364378] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-23T21:30:55.711783] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:30:55.999413] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-23T21:30:56.799482] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-23T21:30:57.656824] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T21:30:57.667172] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-23T21:30:58.228809] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T21:30:58.399413] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-23T21:30:59.230155] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T21:30:59.240351] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-23T21:30:59.861312] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T21:30:59.999418] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-23T21:31:00.131945] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (5.73 seconds). [2025-10-23T21:31:00.799495] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-23T21:31:01.174633] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T21:31:01.569077] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T21:31:01.599412] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-23T21:31:02.399430] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-23T21:31:02.494050] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T21:31:02.533972] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (7.33 seconds). [2025-10-23T21:31:03.154617] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T21:31:03.199420] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-23T21:31:03.999416] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-23T21:31:04.403076] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T21:31:04.789569] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T21:31:04.797442] [INFO ] [REMOTE ] FSCO: Full fetch complete (55337 records). [2025-10-23T21:31:04.797570] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-23T21:31:04.809453] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-23T21:31:05.172744] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-23T21:31:05.172856] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-23T21:31:05.173689] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-23T21:31:05.173767] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-23T21:31:05.174868] [DEBUG] [LOCAL ] FSCO: Trimmed 55337 records to 38800 (keeping 200 days of data) [2025-10-23T21:31:05.392146] [DEBUG] [LOCAL ] FSCO: Primary data saved (38800 records). [2025-10-23T21:31:05.392298] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-23T21:31:05.392427] [INFO ] [MAIN ] Update Progress: 873/2367 symbols completed. FSCO took 20.0s. Estimated remaining: 3h 9m 60s. Rate: 7.9 symbols/min [2025-10-23T21:31:05.564348] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:31:05.607292] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-23T21:31:05.622849] [DEBUG] [LOCAL ] FSS: Loaded 33138 existing records from primary storage. [2025-10-23T21:31:05.623215] [INFO ] [MAIN ] FSS: Loaded 33138 existing records. [2025-10-23T21:31:05.801701] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:31:05.801925] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-23T21:31:05.802091] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-23T21:31:05.802384] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-23T21:31:05.802509] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-23T21:31:05.949594] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T21:31:06.221781] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:31:06.399429] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-23T21:31:06.847116] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T21:31:07.199442] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-23T21:31:07.463109] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T21:31:07.708196] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-23T21:31:07.999442] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-23T21:31:08.736442] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T21:31:08.799405] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-23T21:31:09.426297] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T21:31:09.599421] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-23T21:31:10.399451] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-23T21:31:10.714516] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T21:31:11.199472] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-23T21:31:11.999449] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-23T21:31:12.635041] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T21:31:12.799423] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-23T21:31:13.015411] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (3.42 seconds). [2025-10-23T21:31:13.599427] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-23T21:31:13.822496] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T21:31:14.399422] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-23T21:31:14.500469] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:31:14.554144] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (4.15 seconds). [2025-10-23T21:31:15.199515] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-23T21:31:15.396835] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T21:31:15.999420] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-23T21:31:16.367069] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-23T21:31:16.799409] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-23T21:31:16.892942] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:31:17.599430] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-23T21:31:17.861272] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T21:31:18.399429] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-23T21:31:18.573786] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T21:31:18.757410] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T21:31:18.766705] [INFO ] [REMOTE ] FSM: Full fetch complete (77156 records). [2025-10-23T21:31:18.766894] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-23T21:31:19.155083] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-23T21:31:19.155213] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-23T21:31:19.156439] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-23T21:31:19.156548] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-23T21:31:19.158287] [DEBUG] [LOCAL ] FSM: Trimmed 77156 records to 53690 (keeping 200 days of data) [2025-10-23T21:31:19.203141] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-23T21:31:19.464856] [DEBUG] [LOCAL ] FSM: Primary data saved (53690 records). [2025-10-23T21:31:19.465021] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-23T21:31:19.465159] [INFO ] [MAIN ] Update Progress: 874/2367 symbols completed. FSM took 24.3s. Estimated remaining: 3h 10m 3s. Rate: 7.9 symbols/min [2025-10-23T21:31:19.633853] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:31:19.642874] [DEBUG] [LOCAL ] FT: Loaded 6800 existing records from primary storage. [2025-10-23T21:31:19.643087] [INFO ] [MAIN ] FT: Loaded 6800 existing records. [2025-10-23T21:31:19.819631] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:31:19.820027] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-23T21:31:19.820106] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-23T21:31:19.820290] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-23T21:31:19.820363] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-23T21:31:20.003927] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-23T21:31:20.228299] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:31:20.248877] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:31:20.799415] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-23T21:31:21.046875] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T21:31:21.419963] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T21:31:21.599500] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-23T21:31:22.399423] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-23T21:31:22.659950] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T21:31:23.125440] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T21:31:23.199487] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-23T21:31:23.459795] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T21:31:23.999523] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-23T21:31:24.605130] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T21:31:24.799480] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-23T21:31:25.075601] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T21:31:25.599444] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-23T21:31:26.399482] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-23T21:31:26.712378] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T21:31:27.199479] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-23T21:31:27.317815] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T21:31:27.326627] [INFO ] [REMOTE ] FSLY: Full fetch complete (74883 records). [2025-10-23T21:31:27.326801] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-23T21:31:27.709470] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-23T21:31:27.709680] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-23T21:31:27.710639] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-23T21:31:27.710744] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-23T21:31:27.712165] [DEBUG] [LOCAL ] FSLY: Trimmed 74883 records to 51652 (keeping 200 days of data) [2025-10-23T21:31:27.987547] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T21:31:28.016134] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-23T21:31:28.035459] [DEBUG] [LOCAL ] FSLY: Primary data saved (51652 records). [2025-10-23T21:31:28.037027] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-23T21:31:28.037143] [INFO ] [MAIN ] Update Progress: 875/2367 symbols completed. FSLY took 38.5s. Estimated remaining: 3h 9m 57s. Rate: 7.9 symbols/min [2025-10-23T21:31:28.204202] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:31:28.216414] [DEBUG] [LOCAL ] FTHY: Loaded 12294 existing records from primary storage. [2025-10-23T21:31:28.216746] [INFO ] [MAIN ] FTHY: Loaded 12294 existing records. [2025-10-23T21:31:28.389135] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:31:28.389341] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-23T21:31:28.389414] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-23T21:31:28.389732] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-23T21:31:28.389804] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-23T21:31:28.740475] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:31:28.774937] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T21:31:28.799396] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-23T21:31:28.860083] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T21:31:28.869394] [INFO ] [REMOTE ] FSK: Full fetch complete (72114 records). [2025-10-23T21:31:28.869558] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-23T21:31:29.246790] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-23T21:31:29.246915] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-23T21:31:29.247846] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-23T21:31:29.247925] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-23T21:31:29.249294] [DEBUG] [LOCAL ] FSK: Trimmed 72114 records to 49831 (keeping 200 days of data) [2025-10-23T21:31:29.544713] [DEBUG] [LOCAL ] FSK: Primary data saved (49831 records). [2025-10-23T21:31:29.544868] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-23T21:31:29.545001] [INFO ] [MAIN ] Update Progress: 876/2367 symbols completed. FSK took 42.4s. Estimated remaining: 3h 9m 39s. Rate: 7.9 symbols/min [2025-10-23T21:31:29.607044] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-23T21:31:29.712686] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:31:29.760247] [DEBUG] [LOCAL ] FTI: Loaded 53293 existing records from primary storage. [2025-10-23T21:31:29.760578] [INFO ] [MAIN ] FTI: Loaded 53293 existing records. [2025-10-23T21:31:29.933862] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:31:29.934054] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-23T21:31:29.934128] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-23T21:31:29.934447] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-23T21:31:29.934521] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-23T21:31:30.246088] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T21:31:30.315173] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:31:30.399397] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-23T21:31:30.641620] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T21:31:31.199490] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-23T21:31:31.969525] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T21:31:31.975300] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T21:31:31.999456] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-23T21:31:32.799446] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-23T21:31:33.600340] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-23T21:31:33.602450] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T21:31:33.662898] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:31:34.341554] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T21:31:34.399413] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-23T21:31:35.199447] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-23T21:31:35.633265] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T21:31:35.999410] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-23T21:31:36.098827] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T21:31:36.440507] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T21:31:36.799436] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-23T21:31:37.599465] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-23T21:31:38.399434] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-23T21:31:38.614619] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T21:31:38.866010] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T21:31:38.872168] [INFO ] [REMOTE ] FSS: Full fetch complete (48448 records). [2025-10-23T21:31:38.872340] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-23T21:31:39.047938] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T21:31:39.204555] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-23T21:31:39.278385] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-23T21:31:39.278504] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-23T21:31:39.279356] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-23T21:31:39.279439] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-23T21:31:39.280616] [DEBUG] [LOCAL ] FSS: Trimmed 48448 records to 33299 (keeping 200 days of data) [2025-10-23T21:31:39.491227] [DEBUG] [LOCAL ] FSS: Primary data saved (33299 records). [2025-10-23T21:31:39.491411] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-23T21:31:39.491534] [INFO ] [MAIN ] Update Progress: 877/2367 symbols completed. FSS took 34.1s. Estimated remaining: 3h 9m 35s. Rate: 7.9 symbols/min [2025-10-23T21:31:39.909659] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-23T21:31:39.999401] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-23T21:31:40.799310] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T21:31:40.801219] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-23T21:31:41.581848] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T21:31:41.599393] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-23T21:31:42.372113] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T21:31:42.399435] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-23T21:31:43.199454] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-23T21:31:43.948746] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T21:31:43.999431] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-23T21:31:44.794865] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T21:31:44.799385] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-23T21:31:45.327150] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-23T21:31:45.599496] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-23T21:31:45.626313] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T21:31:45.629145] [INFO ] [REMOTE ] FT: Full fetch complete (9357 records). [2025-10-23T21:31:45.629314] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-23T21:31:46.150403] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-23T21:31:46.150521] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-23T21:31:46.150792] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-23T21:31:46.150894] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-23T21:31:46.151365] [DEBUG] [LOCAL ] FT: Trimmed 9357 records to 6885 (keeping 200 days of data) [2025-10-23T21:31:46.191235] [DEBUG] [LOCAL ] FT: Primary data saved (6885 records). [2025-10-23T21:31:46.191390] [INFO ] [MAIN ] FT: Full history saved. [2025-10-23T21:31:46.191505] [INFO ] [MAIN ] Update Progress: 878/2367 symbols completed. FT took 26.7s. Estimated remaining: 3h 9m 26s. Rate: 7.9 symbols/min [2025-10-23T21:31:46.404134] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-23T21:31:46.405845] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T21:31:47.199452] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-23T21:31:48.035929] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T21:31:48.039205] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-23T21:31:48.270081] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T21:31:48.799442] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-23T21:31:48.818844] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T21:31:48.822331] [INFO ] [REMOTE ] FTHY: Full fetch complete (17324 records). [2025-10-23T21:31:48.822543] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-23T21:31:49.231504] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-23T21:31:49.231956] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-23T21:31:49.232402] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-23T21:31:49.232481] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-23T21:31:49.233151] [DEBUG] [LOCAL ] FTHY: Trimmed 17324 records to 12371 (keeping 200 days of data) [2025-10-23T21:31:49.306513] [DEBUG] [LOCAL ] FTHY: Primary data saved (12371 records). [2025-10-23T21:31:49.306696] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-23T21:31:49.306804] [INFO ] [MAIN ] Update Progress: 879/2367 symbols completed. FTHY took 21.3s. Estimated remaining: 3h 9m 11s. Rate: 7.9 symbols/min [2025-10-23T21:31:50.558336] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T21:31:50.569064] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-23T21:31:52.387725] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T21:31:52.399133] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-23T21:31:54.956587] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-23T21:31:54.968059] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-23T21:31:56.768326] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:31:56.779847] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-23T21:31:58.975543] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-23T21:31:58.984975] [INFO ] [REMOTE ] FTI: Full fetch complete (77334 records). [2025-10-23T21:31:58.985166] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-23T21:31:59.371363] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-23T21:31:59.371477] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-23T21:31:59.372481] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-23T21:31:59.372562] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-23T21:31:59.374114] [DEBUG] [LOCAL ] FTI: Trimmed 77334 records to 53683 (keeping 200 days of data) [2025-10-23T21:31:59.695045] [DEBUG] [LOCAL ] FTI: Primary data saved (53683 records). [2025-10-23T21:31:59.695277] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-23T21:31:59.696837] [INFO ] [MAIN ] Update Progress: 880/2367 symbols completed. FTI took 30.2s. Estimated remaining: 3h 9m 8s. Rate: 7.9 symbols/min [2025-10-23T21:32:00.308989] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:00.444225] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:00.462018] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:00.432906] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:00.466265] [DEBUG] [LOCAL ] FTWO: Loaded 1949 existing records from primary storage. [2025-10-23T21:32:00.466993] [INFO ] [MAIN ] FTWO: Loaded 1949 existing records. [2025-10-23T21:32:00.689587] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:00.690855] [DEBUG] [LOCAL ] FTK: Loaded 32937 existing records from primary storage. [2025-10-23T21:32:00.704154] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-23T21:32:00.704562] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-23T21:32:00.704762] [INFO ] [MAIN ] FTK: Loaded 32937 existing records. [2025-10-23T21:32:00.715714] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-23T21:32:00.785848] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-23T21:32:00.818215] [DEBUG] [LOCAL ] FTS: Loaded 42482 existing records from primary storage. [2025-10-23T21:32:00.898111] [DEBUG] [LOCAL ] FTV: Loaded 53022 existing records from primary storage. [2025-10-23T21:32:00.913682] [INFO ] [MAIN ] FTS: Loaded 42482 existing records. [2025-10-23T21:32:00.975067] [INFO ] [MAIN ] FTV: Loaded 53022 existing records. [2025-10-23T21:32:01.023350] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:01.041732] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-23T21:32:01.076944] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-23T21:32:01.257123] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-23T21:32:01.264832] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-23T21:32:01.595777] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:01.684363] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-23T21:32:01.703971] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-23T21:32:01.760344] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:01.800117] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-23T21:32:01.817219] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-23T21:32:01.800037] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-23T21:32:01.868636] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-23T21:32:01.985399] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-23T21:32:02.010915] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:02.048202] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-23T21:32:02.053534] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-23T21:32:02.353928] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:02.388709] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-23T21:32:02.727022] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:02.757059] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-23T21:32:02.844265] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:02.846297] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-23T21:32:02.849484] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T21:32:02.851148] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-23T21:32:03.307741] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-23T21:32:03.309101] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-23T21:32:03.636836] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T21:32:03.642232] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-23T21:32:03.749425] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-23T21:32:03.750572] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-23T21:32:04.245685] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T21:32:04.246806] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-23T21:32:04.399406] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T21:32:04.408112] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-23T21:32:04.593043] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T21:32:04.603211] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-23T21:32:04.611575] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-23T21:32:04.612996] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-23T21:32:04.713107] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T21:32:04.717627] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-23T21:32:05.070920] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T21:32:05.072129] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-23T21:32:05.536266] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T21:32:05.537469] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-23T21:32:05.621252] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T21:32:05.629238] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-23T21:32:05.837609] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T21:32:05.843843] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-23T21:32:06.042121] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T21:32:06.166254] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T21:32:06.399461] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-23T21:32:06.837824] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-23T21:32:07.089678] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:32:07.196780] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T21:32:07.205821] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-23T21:32:07.999442] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-23T21:32:08.486160] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T21:32:08.487267] [INFO ] [REMOTE ] FTWO: Full fetch complete (3331 records). [2025-10-23T21:32:08.487375] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-23T21:32:08.803713] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-23T21:32:08.877965] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-23T21:32:08.878843] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T21:32:08.879043] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-23T21:32:08.886461] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-23T21:32:08.887028] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-23T21:32:08.887798] [DEBUG] [LOCAL ] FTWO: Trimmed 3331 records to 1966 (keeping 200 days of data) [2025-10-23T21:32:08.899731] [DEBUG] [LOCAL ] FTWO: Primary data saved (1966 records). [2025-10-23T21:32:08.899828] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-23T21:32:08.899956] [INFO ] [MAIN ] Update Progress: 881/2367 symbols completed. FTWO took 9.2s. Estimated remaining: 3h 9m 3s. Rate: 7.9 symbols/min [2025-10-23T21:32:09.065823] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:09.114136] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-23T21:32:09.114494] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-23T21:32:09.288019] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:09.288254] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-23T21:32:09.288348] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-23T21:32:09.288742] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-23T21:32:09.288837] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-23T21:32:09.604559] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-23T21:32:09.641727] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:10.399421] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-23T21:32:10.447382] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T21:32:11.199413] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-23T21:32:11.422276] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T21:32:11.999454] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-23T21:32:12.541276] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T21:32:12.799404] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-23T21:32:12.936876] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-23T21:32:13.599427] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-23T21:32:14.009678] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T21:32:14.173001] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-23T21:32:14.399435] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-23T21:32:15.199450] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-23T21:32:15.601493] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T21:32:15.833705] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-23T21:32:15.999480] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-23T21:32:16.799474] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-23T21:32:16.875126] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T21:32:17.599483] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-23T21:32:18.211977] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-23T21:32:18.253480] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T21:32:18.399478] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-23T21:32:19.199521] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-23T21:32:19.258511] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T21:32:19.999502] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-23T21:32:20.510981] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T21:32:20.517191] [INFO ] [REMOTE ] FTK: Full fetch complete (44101 records). [2025-10-23T21:32:20.517326] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-23T21:32:20.833921] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-23T21:32:20.880037] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-23T21:32:20.939672] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-23T21:32:20.939778] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-23T21:32:20.940492] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-23T21:32:20.940566] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-23T21:32:20.941522] [DEBUG] [LOCAL ] FTK: Trimmed 44101 records to 33227 (keeping 200 days of data) [2025-10-23T21:32:21.135356] [DEBUG] [LOCAL ] FTK: Primary data saved (33227 records). [2025-10-23T21:32:21.135667] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-23T21:32:21.156521] [INFO ] [MAIN ] Update Progress: 882/2367 symbols completed. FTK took 21.5s. Estimated remaining: 3h 9m 3s. Rate: 7.9 symbols/min [2025-10-23T21:32:21.158019] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T21:32:21.341583] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:21.371971] [DEBUG] [LOCAL ] FUL: Loaded 31986 existing records from primary storage. [2025-10-23T21:32:21.372265] [INFO ] [MAIN ] FUL: Loaded 31986 existing records. [2025-10-23T21:32:21.546621] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:21.546854] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-23T21:32:21.546927] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-23T21:32:21.547169] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-23T21:32:21.547241] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-23T21:32:21.609377] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-23T21:32:21.899407] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:22.399477] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-23T21:32:22.528707] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:32:22.838405] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T21:32:23.199441] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-23T21:32:23.999484] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-23T21:32:24.579429] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T21:32:24.696407] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-23T21:32:24.799432] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-23T21:32:25.150337] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T21:32:25.599443] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-23T21:32:26.119103] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T21:32:26.399444] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-23T21:32:27.195929] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T21:32:27.204670] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-23T21:32:27.999405] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-23T21:32:28.293191] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T21:32:28.590140] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T21:32:28.799464] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-23T21:32:29.599442] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-23T21:32:30.089614] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T21:32:30.303298] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T21:32:30.311189] [INFO ] [REMOTE ] FTS: Full fetch complete (60866 records). [2025-10-23T21:32:30.311364] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-23T21:32:30.404685] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-23T21:32:30.718567] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-23T21:32:30.718706] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-23T21:32:30.719620] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-23T21:32:30.719715] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-23T21:32:30.721091] [DEBUG] [LOCAL ] FTS: Trimmed 60866 records to 42787 (keeping 200 days of data) [2025-10-23T21:32:30.969131] [DEBUG] [LOCAL ] FTS: Primary data saved (42787 records). [2025-10-23T21:32:30.969288] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-23T21:32:30.969402] [INFO ] [MAIN ] Update Progress: 883/2367 symbols completed. FTS took 31.3s. Estimated remaining: 3h 8m 59s. Rate: 7.9 symbols/min [2025-10-23T21:32:31.144564] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:31.190258] [DEBUG] [LOCAL ] FUN: Loaded 52023 existing records from primary storage. [2025-10-23T21:32:31.190621] [INFO ] [MAIN ] FUN: Loaded 52023 existing records. [2025-10-23T21:32:31.224305] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-23T21:32:31.387431] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:31.387944] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-23T21:32:31.388091] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-23T21:32:31.388782] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-23T21:32:31.388866] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-23T21:32:31.606820] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T21:32:31.802169] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:31.964708] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T21:32:31.999392] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-23T21:32:32.799411] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-23T21:32:33.271392] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T21:32:33.561092] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-23T21:32:33.606791] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-23T21:32:33.628193] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:32:34.399459] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-23T21:32:35.194939] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T21:32:35.203542] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-23T21:32:35.764296] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T21:32:35.999447] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-23T21:32:36.799465] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-23T21:32:37.299365] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T21:32:37.488640] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-23T21:32:37.599408] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-23T21:32:38.400908] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T21:32:38.401061] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-23T21:32:38.877742] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T21:32:39.199460] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-23T21:32:39.999422] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-23T21:32:40.221757] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T21:32:40.231566] [INFO ] [REMOTE ] FTV: Full fetch complete (76613 records). [2025-10-23T21:32:40.231768] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-23T21:32:40.691041] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-23T21:32:40.691327] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-23T21:32:40.692534] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-23T21:32:40.692741] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-23T21:32:40.695055] [DEBUG] [LOCAL ] FTV: Trimmed 76613 records to 53399 (keeping 200 days of data) [2025-10-23T21:32:40.815749] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T21:32:40.812084] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-23T21:32:41.051935] [DEBUG] [LOCAL ] FTV: Primary data saved (53399 records). [2025-10-23T21:32:41.052095] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-23T21:32:41.052201] [INFO ] [MAIN ] Update Progress: 884/2367 symbols completed. FTV took 41.3s. Estimated remaining: 3h 8m 55s. Rate: 7.8 symbols/min [2025-10-23T21:32:41.218498] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:41.237475] [DEBUG] [LOCAL ] FVR: Loaded 20820 existing records from primary storage. [2025-10-23T21:32:41.237788] [INFO ] [MAIN ] FVR: Loaded 20820 existing records. [2025-10-23T21:32:41.412101] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:41.412303] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-23T21:32:41.412379] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-23T21:32:41.412600] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-23T21:32:41.412702] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-23T21:32:41.619321] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-23T21:32:41.766194] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:42.223365] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T21:32:42.377860] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-23T21:32:42.399406] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-23T21:32:43.199443] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-23T21:32:43.365023] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:32:43.642698] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T21:32:43.648066] [INFO ] [REMOTE ] FUL: Full fetch complete (47799 records). [2025-10-23T21:32:43.648172] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-23T21:32:44.008211] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-23T21:32:44.025626] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-23T21:32:44.025754] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-23T21:32:44.026546] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-23T21:32:44.026714] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-23T21:32:44.027813] [DEBUG] [LOCAL ] FUL: Trimmed 47799 records to 32220 (keeping 200 days of data) [2025-10-23T21:32:44.219134] [DEBUG] [LOCAL ] FUL: Primary data saved (32220 records). [2025-10-23T21:32:44.219263] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-23T21:32:44.219375] [INFO ] [MAIN ] Update Progress: 885/2367 symbols completed. FUL took 23.1s. Estimated remaining: 3h 8m 40s. Rate: 7.9 symbols/min [2025-10-23T21:32:44.368466] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T21:32:44.402138] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:44.436284] [DEBUG] [LOCAL ] FVRR: Loaded 40496 existing records from primary storage. [2025-10-23T21:32:44.436629] [INFO ] [MAIN ] FVRR: Loaded 40496 existing records. [2025-10-23T21:32:44.612854] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:44.613056] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-23T21:32:44.613149] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-23T21:32:44.613425] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-23T21:32:44.613501] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-23T21:32:44.804771] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-23T21:32:44.960027] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:45.599453] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-23T21:32:45.819821] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T21:32:46.223423] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T21:32:46.399447] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-23T21:32:47.148849] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-23T21:32:47.158109] [INFO ] [REMOTE ] FUBO: Full fetch complete (77868 records). [2025-10-23T21:32:47.158254] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-23T21:32:47.204553] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-23T21:32:47.554185] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-23T21:32:47.554452] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-23T21:32:47.555431] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-23T21:32:47.555509] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-23T21:32:47.557020] [DEBUG] [LOCAL ] FUBO: Trimmed 77868 records to 54106 (keeping 200 days of data) [2025-10-23T21:32:47.666580] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T21:32:47.880220] [DEBUG] [LOCAL ] FUBO: Primary data saved (54106 records). [2025-10-23T21:32:47.880387] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-23T21:32:47.880497] [INFO ] [MAIN ] Update Progress: 886/2367 symbols completed. FUBO took 39.0s. Estimated remaining: 3h 8m 26s. Rate: 7.9 symbols/min [2025-10-23T21:32:48.004687] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-23T21:32:48.049334] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:32:48.053010] [DEBUG] [LOCAL ] FXED: Loaded 1227 existing records from primary storage. [2025-10-23T21:32:48.053174] [INFO ] [MAIN ] FXED: Loaded 1227 existing records. [2025-10-23T21:32:48.231534] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:32:48.231766] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-23T21:32:48.231862] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-23T21:32:48.232049] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-23T21:32:48.232123] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-23T21:32:48.576751] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:32:48.695462] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T21:32:48.799406] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-23T21:32:49.221711] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-23T21:32:49.599488] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-23T21:32:49.756285] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T21:32:50.399455] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-23T21:32:50.748639] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-23T21:32:51.199500] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-23T21:32:51.426161] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:32:51.999453] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-23T21:32:52.384161] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-23T21:32:52.799404] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-23T21:32:52.837229] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T21:32:53.599420] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-23T21:32:53.854623] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T21:32:54.399473] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-23T21:32:54.819690] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-23T21:32:54.969229] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T21:32:55.199496] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-23T21:32:55.999426] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-23T21:32:56.269961] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T21:32:56.799433] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-23T21:32:57.137675] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-23T21:32:57.449393] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T21:32:57.599433] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-23T21:32:58.399400] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-23T21:32:58.762015] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-23T21:32:58.794903] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T21:32:59.199442] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-23T21:32:59.999425] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-23T21:33:00.297281] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T21:33:00.457442] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T21:33:00.799442] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-23T21:33:01.599436] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-23T21:33:02.399402] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-23T21:33:02.446710] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T21:33:02.692396] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T21:33:03.199435] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-23T21:33:03.999420] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-23T21:33:04.082330] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T21:33:04.191286] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T21:33:04.352928] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-23T21:33:04.799435] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-23T21:33:05.599437] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-23T21:33:05.796134] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T21:33:06.399437] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-23T21:33:06.785913] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-23T21:33:07.199410] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-23T21:33:07.316969] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T21:33:07.549105] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T21:33:07.550000] [INFO ] [REMOTE ] FXED: Full fetch complete (1791 records). [2025-10-23T21:33:07.550091] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-23T21:33:07.918530] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-23T21:33:07.918638] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-23T21:33:07.918779] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-23T21:33:07.918850] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-23T21:33:07.919199] [DEBUG] [LOCAL ] FXED: Trimmed 1791 records to 1237 (keeping 200 days of data) [2025-10-23T21:33:07.926938] [DEBUG] [LOCAL ] FXED: Primary data saved (1237 records). [2025-10-23T21:33:07.927017] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-23T21:33:07.927115] [INFO ] [MAIN ] Update Progress: 887/2367 symbols completed. FXED took 20.0s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-10-23T21:33:08.004556] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-23T21:33:08.099172] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:08.141612] [DEBUG] [LOCAL ] G: Loaded 50090 existing records from primary storage. [2025-10-23T21:33:08.141979] [INFO ] [MAIN ] G: Loaded 50090 existing records. [2025-10-23T21:33:08.316331] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:08.316558] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-23T21:33:08.316671] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-23T21:33:08.316927] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-23T21:33:08.317023] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-23T21:33:08.666236] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:08.799399] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-23T21:33:09.599500] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-23T21:33:09.651196] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T21:33:10.397565] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T21:33:10.406340] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-23T21:33:10.561881] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T21:33:10.565136] [INFO ] [REMOTE ] FVR: Full fetch complete (29252 records). [2025-10-23T21:33:10.565236] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-23T21:33:10.942373] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-23T21:33:10.942488] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-23T21:33:10.943116] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-23T21:33:10.943194] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-23T21:33:10.943963] [DEBUG] [LOCAL ] FVR: Trimmed 29252 records to 20893 (keeping 200 days of data) [2025-10-23T21:33:11.068563] [DEBUG] [LOCAL ] FVR: Primary data saved (20893 records). [2025-10-23T21:33:11.068745] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-23T21:33:11.068862] [INFO ] [MAIN ] Update Progress: 888/2367 symbols completed. FVR took 30.0s. Estimated remaining: 3h 8m 24s. Rate: 7.9 symbols/min [2025-10-23T21:33:11.206108] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-23T21:33:11.240048] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:11.267125] [DEBUG] [LOCAL ] GAB: Loaded 27447 existing records from primary storage. [2025-10-23T21:33:11.267474] [INFO ] [MAIN ] GAB: Loaded 27447 existing records. [2025-10-23T21:33:11.439134] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:11.439330] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-23T21:33:11.439404] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-23T21:33:11.439615] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-23T21:33:11.439715] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-23T21:33:11.785569] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:11.999403] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-23T21:33:12.172333] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:33:12.799512] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-23T21:33:12.888298] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:33:13.171355] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T21:33:13.599452] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-23T21:33:14.399470] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-23T21:33:14.603365] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T21:33:14.612542] [INFO ] [REMOTE ] FUN: Full fetch complete (73539 records). [2025-10-23T21:33:14.612713] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-23T21:33:14.748216] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T21:33:15.015159] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-23T21:33:15.015286] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-23T21:33:15.016261] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-23T21:33:15.016358] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-23T21:33:15.017783] [DEBUG] [LOCAL ] FUN: Trimmed 73539 records to 52412 (keeping 200 days of data) [2025-10-23T21:33:15.210865] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-23T21:33:15.316492] [DEBUG] [LOCAL ] FUN: Primary data saved (52412 records). [2025-10-23T21:33:15.316684] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-23T21:33:15.316798] [INFO ] [MAIN ] Update Progress: 889/2367 symbols completed. FUN took 44.3s. Estimated remaining: 3h 8m 11s. Rate: 7.9 symbols/min [2025-10-23T21:33:15.504750] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:15.510407] [DEBUG] [LOCAL ] GAM: Loaded 3825 existing records from primary storage. [2025-10-23T21:33:15.510582] [INFO ] [MAIN ] GAM: Loaded 3825 existing records. [2025-10-23T21:33:15.690236] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:15.690441] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-23T21:33:15.690515] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-23T21:33:15.690719] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-23T21:33:15.690792] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-23T21:33:16.024589] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-23T21:33:16.053442] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:16.076406] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T21:33:16.493545] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T21:33:16.799470] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-23T21:33:17.599481] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-23T21:33:17.782719] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T21:33:18.399252] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T21:33:18.399543] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-23T21:33:18.399416] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T21:33:18.410971] [INFO ] [REMOTE ] FVRR: Full fetch complete (59131 records). [2025-10-23T21:33:18.411118] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-23T21:33:18.809479] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-23T21:33:18.809593] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-23T21:33:18.810451] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-23T21:33:18.810529] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-23T21:33:18.811720] [DEBUG] [LOCAL ] FVRR: Trimmed 59131 records to 40750 (keeping 200 days of data) [2025-10-23T21:33:19.041032] [DEBUG] [LOCAL ] FVRR: Primary data saved (40750 records). [2025-10-23T21:33:19.041183] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-23T21:33:19.041291] [INFO ] [MAIN ] Update Progress: 890/2367 symbols completed. FVRR took 34.8s. Estimated remaining: 3h 7m 56s. Rate: 7.9 symbols/min [2025-10-23T21:33:19.204442] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-23T21:33:19.205954] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:19.253140] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-23T21:33:19.253479] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-23T21:33:19.426134] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:19.426340] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-23T21:33:19.426416] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-23T21:33:19.426761] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-23T21:33:19.426835] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-23T21:33:19.787329] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:19.999442] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-23T21:33:20.229280] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T21:33:20.546156] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T21:33:20.799443] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-23T21:33:21.599435] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-23T21:33:21.800787] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T21:33:21.991441] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T21:33:22.399445] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-23T21:33:23.205756] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T21:33:23.201521] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-23T21:33:23.717945] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T21:33:23.904729] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T21:33:23.999455] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-23T21:33:24.799439] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-23T21:33:25.604585] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-23T21:33:25.629430] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T21:33:26.399411] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-23T21:33:26.479970] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:33:26.946332] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T21:33:27.141499] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T21:33:27.199407] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-23T21:33:27.999450] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-23T21:33:28.799551] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-23T21:33:29.191222] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T21:33:29.424766] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T21:33:29.599439] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-23T21:33:29.698075] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T21:33:30.226612] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T21:33:30.399414] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-23T21:33:30.970354] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-23T21:33:31.199450] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-23T21:33:31.789077] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T21:33:31.999444] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-23T21:33:32.638074] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T21:33:32.799441] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-23T21:33:33.306419] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T21:33:33.599491] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-23T21:33:34.399507] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-23T21:33:35.012139] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T21:33:35.013453] [INFO ] [REMOTE ] GAM: Full fetch complete (6434 records). [2025-10-23T21:33:35.013548] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-23T21:33:35.207279] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-23T21:33:35.394171] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-23T21:33:35.394463] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-23T21:33:35.394863] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-23T21:33:35.395108] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-23T21:33:35.395876] [DEBUG] [LOCAL ] GAM: Trimmed 6434 records to 3836 (keeping 200 days of data) [2025-10-23T21:33:35.420325] [DEBUG] [LOCAL ] GAM: Primary data saved (3836 records). [2025-10-23T21:33:35.420683] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-23T21:33:35.420868] [INFO ] [MAIN ] Update Progress: 891/2367 symbols completed. GAM took 20.1s. Estimated remaining: 3h 8m 3s. Rate: 7.8 symbols/min [2025-10-23T21:33:35.557045] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T21:33:35.656078] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:35.677013] [DEBUG] [LOCAL ] GATX: Loaded 18061 existing records from primary storage. [2025-10-23T21:33:35.677416] [INFO ] [MAIN ] GATX: Loaded 18061 existing records. [2025-10-23T21:33:35.862509] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:35.862828] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-23T21:33:35.862909] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-23T21:33:35.863249] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-23T21:33:35.863327] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-23T21:33:36.004720] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-23T21:33:36.230909] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:36.523420] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T21:33:36.799435] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-23T21:33:37.599406] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-23T21:33:37.977431] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T21:33:38.080845] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-23T21:33:38.399449] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-23T21:33:39.199416] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-23T21:33:39.430181] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:33:39.999423] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-23T21:33:40.495748] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-23T21:33:40.591870] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T21:33:40.799449] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-23T21:33:41.599430] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-23T21:33:41.753750] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T21:33:41.762584] [INFO ] [REMOTE ] G: Full fetch complete (72320 records). [2025-10-23T21:33:41.762764] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-23T21:33:41.898731] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T21:33:42.163473] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-23T21:33:42.163582] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-23T21:33:42.164515] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-23T21:33:42.164593] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-23T21:33:42.165953] [DEBUG] [LOCAL ] G: Trimmed 72320 records to 50463 (keeping 200 days of data) [2025-10-23T21:33:42.405159] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-23T21:33:42.470295] [DEBUG] [LOCAL ] G: Primary data saved (50463 records). [2025-10-23T21:33:42.470508] [INFO ] [MAIN ] G: Full history saved. [2025-10-23T21:33:42.470636] [INFO ] [MAIN ] Update Progress: 892/2367 symbols completed. G took 34.5s. Estimated remaining: 3h 7m 55s. Rate: 7.8 symbols/min [2025-10-23T21:33:42.639105] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:42.652058] [DEBUG] [LOCAL ] GBAB: Loaded 12735 existing records from primary storage. [2025-10-23T21:33:42.652286] [INFO ] [MAIN ] GBAB: Loaded 12735 existing records. [2025-10-23T21:33:42.832145] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:42.845306] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-23T21:33:42.845776] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T21:33:42.845999] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-23T21:33:42.851212] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-23T21:33:42.851414] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-23T21:33:42.882304] [INFO ] [REMOTE ] GAB: Full fetch complete (39425 records). [2025-10-23T21:33:42.925472] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-23T21:33:43.204597] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-23T21:33:43.592564] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:43.607091] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-23T21:33:43.607200] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-23T21:33:43.607921] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-23T21:33:43.608020] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-23T21:33:43.608949] [DEBUG] [LOCAL ] GAB: Trimmed 39425 records to 27609 (keeping 200 days of data) [2025-10-23T21:33:43.761855] [DEBUG] [LOCAL ] GAB: Primary data saved (27609 records). [2025-10-23T21:33:43.762025] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-23T21:33:43.762121] [INFO ] [MAIN ] Update Progress: 893/2367 symbols completed. GAB took 32.7s. Estimated remaining: 3h 7m 36s. Rate: 7.9 symbols/min [2025-10-23T21:33:43.930699] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:43.966894] [DEBUG] [LOCAL ] GBCI: Loaded 41187 existing records from primary storage. [2025-10-23T21:33:43.967205] [INFO ] [MAIN ] GBCI: Loaded 41187 existing records. [2025-10-23T21:33:44.009867] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-23T21:33:44.148991] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:33:44.149303] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-23T21:33:44.149431] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-23T21:33:44.149679] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-23T21:33:44.157162] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-23T21:33:44.170819] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T21:33:44.526287] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:44.564301] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-23T21:33:44.799477] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-23T21:33:45.027408] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T21:33:45.599425] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-23T21:33:45.844932] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T21:33:46.399482] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-23T21:33:47.199421] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-23T21:33:47.311009] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T21:33:47.629770] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T21:33:47.999446] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-23T21:33:48.406493] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:33:48.799467] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-23T21:33:48.915825] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T21:33:49.599457] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-23T21:33:50.399418] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-23T21:33:50.555162] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T21:33:50.801126] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T21:33:51.199433] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-23T21:33:51.370144] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T21:33:51.999426] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-23T21:33:52.055041] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T21:33:52.799429] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-23T21:33:53.441983] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T21:33:53.599442] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-23T21:33:53.723912] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T21:33:54.399453] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-23T21:33:54.457472] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T21:33:55.199495] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-23T21:33:55.793684] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T21:33:55.999442] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-23T21:33:56.207954] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T21:33:56.799439] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-23T21:33:57.599422] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-23T21:33:57.699598] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T21:33:57.708926] [INFO ] [REMOTE ] GAP: Full fetch complete (77813 records). [2025-10-23T21:33:57.709084] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-23T21:33:57.847556] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T21:33:58.112160] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-23T21:33:58.112276] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-23T21:33:58.113303] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-23T21:33:58.113384] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-23T21:33:58.114893] [DEBUG] [LOCAL ] GAP: Trimmed 77813 records to 54043 (keeping 200 days of data) [2025-10-23T21:33:58.401620] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-23T21:33:58.447332] [DEBUG] [LOCAL ] GAP: Primary data saved (54043 records). [2025-10-23T21:33:58.447507] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-23T21:33:58.447677] [INFO ] [MAIN ] Update Progress: 894/2367 symbols completed. GAP took 39.4s. Estimated remaining: 3h 7m 40s. Rate: 7.8 symbols/min [2025-10-23T21:33:58.614735] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T21:33:58.636227] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:33:58.640163] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-23T21:33:58.640600] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-23T21:33:58.640743] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-23T21:33:58.640814] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-23T21:33:58.640898] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-23T21:33:58.640968] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-23T21:33:58.998217] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:33:59.199420] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-23T21:33:59.590045] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T21:33:59.999453] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-23T21:34:00.686581] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-23T21:34:00.719453] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T21:34:00.799422] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-23T21:34:01.165862] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-23T21:34:01.599485] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-23T21:34:02.399420] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-23T21:34:03.206172] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-23T21:34:03.210919] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T21:34:03.563587] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T21:34:03.575520] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-23T21:34:03.999452] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-23T21:34:04.799443] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-23T21:34:04.833812] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T21:34:05.599436] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-23T21:34:05.829801] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T21:34:05.833201] [INFO ] [REMOTE ] GATX: Full fetch complete (25115 records). [2025-10-23T21:34:05.833297] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-23T21:34:05.933243] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T21:34:06.223309] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-23T21:34:06.223429] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-23T21:34:06.224014] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-23T21:34:06.224093] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-23T21:34:06.224811] [DEBUG] [LOCAL ] GATX: Trimmed 25115 records to 18194 (keeping 200 days of data) [2025-10-23T21:34:06.334793] [DEBUG] [LOCAL ] GATX: Primary data saved (18194 records). [2025-10-23T21:34:06.334952] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-23T21:34:06.335102] [INFO ] [MAIN ] Update Progress: 895/2367 symbols completed. GATX took 30.9s. Estimated remaining: 3h 7m 33s. Rate: 7.8 symbols/min [2025-10-23T21:34:06.404580] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-23T21:34:06.505624] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:06.540761] [DEBUG] [LOCAL ] GBTG: Loaded 40227 existing records from primary storage. [2025-10-23T21:34:06.541124] [INFO ] [MAIN ] GBTG: Loaded 40227 existing records. [2025-10-23T21:34:06.714286] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:34:06.714539] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-23T21:34:06.714632] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-23T21:34:06.714941] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-23T21:34:06.715031] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-23T21:34:07.078244] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:34:07.199414] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-23T21:34:07.248598] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T21:34:07.999453] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-23T21:34:08.441599] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T21:34:08.505662] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T21:34:08.507910] [INFO ] [REMOTE ] GBAB: Full fetch complete (18722 records). [2025-10-23T21:34:08.508047] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-23T21:34:08.804498] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-23T21:34:08.874678] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-23T21:34:08.874785] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-23T21:34:08.875261] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-23T21:34:08.875338] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-23T21:34:08.876030] [DEBUG] [LOCAL ] GBAB: Trimmed 18722 records to 12790 (keeping 200 days of data) [2025-10-23T21:34:08.952121] [DEBUG] [LOCAL ] GBAB: Primary data saved (12790 records). [2025-10-23T21:34:08.952278] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-23T21:34:08.952393] [INFO ] [MAIN ] Update Progress: 896/2367 symbols completed. GBAB took 26.5s. Estimated remaining: 3h 7m 17s. Rate: 7.9 symbols/min [2025-10-23T21:34:09.122087] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:09.149610] [DEBUG] [LOCAL ] GBX: Loaded 28211 existing records from primary storage. [2025-10-23T21:34:09.149920] [INFO ] [MAIN ] GBX: Loaded 28211 existing records. [2025-10-23T21:34:09.325526] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:34:09.325792] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-23T21:34:09.325874] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-23T21:34:09.326269] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-23T21:34:09.326349] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-23T21:34:09.604575] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-23T21:34:09.695661] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:34:10.006750] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-23T21:34:10.285974] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T21:34:10.399419] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-23T21:34:11.199435] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-23T21:34:11.452961] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-23T21:34:11.999432] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-23T21:34:12.042732] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T21:34:12.799439] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-23T21:34:13.333500] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T21:34:13.599453] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-23T21:34:14.097441] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T21:34:14.399435] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-23T21:34:14.534411] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T21:34:15.199456] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-23T21:34:15.462358] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-23T21:34:15.700119] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T21:34:15.999465] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-23T21:34:16.799460] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-23T21:34:17.252624] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-23T21:34:17.532570] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T21:34:17.599455] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-23T21:34:17.957551] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-23T21:34:18.399463] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-23T21:34:19.199522] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-23T21:34:19.931483] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T21:34:19.999449] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-23T21:34:20.692569] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T21:34:20.799503] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-23T21:34:20.941835] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T21:34:21.147766] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T21:34:21.148734] [INFO ] [REMOTE ] GBLI: Full fetch complete (1284 records). [2025-10-23T21:34:21.148831] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-23T21:34:21.339178] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-23T21:34:21.339434] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:34:21.339510] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:34:21.339590] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-23T21:34:21.339725] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-23T21:34:21.339803] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-23T21:34:21.339890] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-23T21:34:21.339996] [INFO ] [MAIN ] Update Progress: 897/2367 symbols completed. GBLI took 22.9s. Estimated remaining: 3h 7m 17s. Rate: 7.8 symbols/min [2025-10-23T21:34:21.519685] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:21.563787] [DEBUG] [LOCAL ] GCI: Loaded 43579 existing records from primary storage. [2025-10-23T21:34:21.564287] [INFO ] [MAIN ] GCI: Loaded 43579 existing records. [2025-10-23T21:34:21.604834] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-23T21:34:21.748223] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:34:21.748439] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-23T21:34:21.748526] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-23T21:34:21.748829] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-23T21:34:21.748906] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-23T21:34:22.095494] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:34:22.399501] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-23T21:34:23.171043] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T21:34:23.199426] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-23T21:34:23.915288] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T21:34:23.999424] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-23T21:34:24.601720] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T21:34:24.799451] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-23T21:34:25.273277] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T21:34:25.599462] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-23T21:34:25.859811] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T21:34:26.399434] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-23T21:34:27.150309] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T21:34:27.199398] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-23T21:34:27.530262] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T21:34:27.999445] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-23T21:34:28.799440] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-23T21:34:28.841175] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T21:34:29.301628] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T21:34:29.311069] [INFO ] [REMOTE ] GBCI: Full fetch complete (59567 records). [2025-10-23T21:34:29.311344] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-23T21:34:29.604705] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-23T21:34:29.759857] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-23T21:34:29.760008] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-23T21:34:29.761364] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-23T21:34:29.761452] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-23T21:34:29.763118] [DEBUG] [LOCAL ] GBCI: Trimmed 59567 records to 41514 (keeping 200 days of data) [2025-10-23T21:34:29.970211] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:34:30.050821] [DEBUG] [LOCAL ] GBCI: Primary data saved (41514 records). [2025-10-23T21:34:30.051050] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-23T21:34:30.051189] [INFO ] [MAIN ] Update Progress: 898/2367 symbols completed. GBCI took 46.3s. Estimated remaining: 3h 7m 12s. Rate: 7.8 symbols/min [2025-10-23T21:34:30.237014] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:30.261678] [DEBUG] [LOCAL ] GCO: Loaded 22815 existing records from primary storage. [2025-10-23T21:34:30.262100] [INFO ] [MAIN ] GCO: Loaded 22815 existing records. [2025-10-23T21:34:30.404607] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-23T21:34:30.448104] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:34:30.448399] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-23T21:34:30.448485] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-23T21:34:30.448789] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-23T21:34:30.448867] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-23T21:34:30.821520] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:34:31.081102] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T21:34:31.199405] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-23T21:34:31.935387] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T21:34:31.999425] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-23T21:34:32.693007] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T21:34:32.799433] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-23T21:34:33.124580] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T21:34:33.599458] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-23T21:34:34.399467] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-23T21:34:35.005605] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T21:34:35.199466] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-23T21:34:35.613755] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:34:35.999472] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-23T21:34:36.136303] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-10-23T21:34:36.447674] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T21:34:36.799486] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-23T21:34:37.066902] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T21:34:37.599479] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-23T21:34:38.399521] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-23T21:34:39.038685] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T21:34:39.199507] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-23T21:34:39.586753] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T21:34:39.999469] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-23T21:34:40.705778] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T21:34:40.799438] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-23T21:34:41.112261] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T21:34:41.117406] [INFO ] [REMOTE ] GBX: Full fetch complete (42730 records). [2025-10-23T21:34:41.117628] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-23T21:34:41.556998] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-23T21:34:41.557163] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-23T21:34:41.558328] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-23T21:34:41.558418] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-23T21:34:41.559948] [DEBUG] [LOCAL ] GBX: Trimmed 42730 records to 28356 (keeping 200 days of data) [2025-10-23T21:34:41.612419] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-23T21:34:41.732451] [DEBUG] [LOCAL ] GBX: Primary data saved (28356 records). [2025-10-23T21:34:41.732671] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-23T21:34:41.732789] [INFO ] [MAIN ] Update Progress: 899/2367 symbols completed. GBX took 32.8s. Estimated remaining: 3h 7m 11s. Rate: 7.8 symbols/min [2025-10-23T21:34:41.899696] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:41.919982] [DEBUG] [LOCAL ] GCTS: Loaded 20286 existing records from primary storage. [2025-10-23T21:34:41.920272] [INFO ] [MAIN ] GCTS: Loaded 20286 existing records. [2025-10-23T21:34:42.119804] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:34:42.121427] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-23T21:34:42.127209] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-23T21:34:42.127576] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-23T21:34:42.127833] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-23T21:34:42.127909] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-23T21:34:42.404563] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-23T21:34:42.480099] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:34:43.088250] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T21:34:43.095963] [INFO ] [REMOTE ] GBTG: Full fetch complete (56957 records). [2025-10-23T21:34:43.096178] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-23T21:34:43.204062] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-23T21:34:43.507214] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-23T21:34:43.507377] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-23T21:34:43.508871] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-23T21:34:43.508959] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-23T21:34:43.510699] [DEBUG] [LOCAL ] GBTG: Trimmed 56957 records to 40489 (keeping 200 days of data) [2025-10-23T21:34:43.744909] [DEBUG] [LOCAL ] GBTG: Primary data saved (40489 records). [2025-10-23T21:34:43.745106] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-23T21:34:43.745242] [INFO ] [MAIN ] Update Progress: 900/2367 symbols completed. GBTG took 37.4s. Estimated remaining: 3h 6m 54s. Rate: 7.8 symbols/min [2025-10-23T21:34:43.917166] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:43.927057] [DEBUG] [LOCAL ] GCV: Loaded 7752 existing records from primary storage. [2025-10-23T21:34:43.927354] [INFO ] [MAIN ] GCV: Loaded 7752 existing records. [2025-10-23T21:34:44.112619] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:34:44.112909] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-23T21:34:44.112995] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-23T21:34:44.113201] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-23T21:34:44.113286] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-23T21:34:44.414036] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:34:44.428787] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-23T21:34:44.503507] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:34:44.799455] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-23T21:34:45.382459] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T21:34:45.453998] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-23T21:34:45.599473] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-23T21:34:46.188574] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T21:34:46.399533] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-23T21:34:47.073454] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T21:34:47.199518] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-23T21:34:47.999464] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-23T21:34:48.021303] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T21:34:48.799412] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-23T21:34:48.888096] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T21:34:49.501076] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-23T21:34:49.599434] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-23T21:34:50.399423] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-23T21:34:50.823278] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T21:34:51.199455] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-23T21:34:52.468431] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T21:34:52.473403] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-23T21:34:53.829849] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (17.03 seconds). [2025-10-23T21:34:53.839390] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-23T21:34:54.577905] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (12.17 seconds). [2025-10-23T21:34:54.583964] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-23T21:34:54.718786] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (4.32 seconds). [2025-10-23T21:34:54.720737] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-23T21:34:55.262400] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-23T21:34:55.269164] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-23T21:34:55.408953] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T21:34:55.489745] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T21:34:55.557411] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T21:34:55.999444] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-23T21:34:56.415136] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:34:56.799417] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-23T21:34:57.581138] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T21:34:57.599399] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-23T21:34:57.811496] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T21:34:58.399448] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-23T21:34:59.061972] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T21:34:59.069420] [INFO ] [REMOTE ] GCI: Full fetch complete (63279 records). [2025-10-23T21:34:59.069571] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-23T21:34:59.200259] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-23T21:34:59.354285] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T21:34:59.505840] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-23T21:34:59.505966] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-23T21:34:59.506861] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-23T21:34:59.506940] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-23T21:34:59.508292] [DEBUG] [LOCAL ] GCI: Trimmed 63279 records to 43883 (keeping 200 days of data) [2025-10-23T21:34:59.747868] [DEBUG] [LOCAL ] GCI: Primary data saved (43883 records). [2025-10-23T21:34:59.748056] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-23T21:34:59.748179] [INFO ] [MAIN ] Update Progress: 901/2367 symbols completed. GCI took 38.4s. Estimated remaining: 3h 6m 60s. Rate: 7.8 symbols/min [2025-10-23T21:34:59.922838] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:34:59.963315] [DEBUG] [LOCAL ] GD: Loaded 46474 existing records from primary storage. [2025-10-23T21:34:59.963693] [INFO ] [MAIN ] GD: Loaded 46474 existing records. [2025-10-23T21:35:00.004837] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-23T21:35:00.071553] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-23T21:35:00.156244] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:35:00.156465] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-23T21:35:00.156516] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-23T21:35:00.156830] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-23T21:35:00.156907] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-23T21:35:00.510032] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:35:00.799441] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-23T21:35:01.265284] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T21:35:01.599501] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-23T21:35:02.399440] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-23T21:35:02.797265] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T21:35:03.199431] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-23T21:35:03.695124] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T21:35:03.999458] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-23T21:35:04.799419] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-23T21:35:05.011899] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (3.41 seconds). [2025-10-23T21:35:05.015272] [INFO ] [REMOTE ] GCO: Full fetch complete (34632 records). [2025-10-23T21:35:05.015384] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-23T21:35:05.134835] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-23T21:35:05.227559] [INFO ] [REMOTE ] GCTS: Full fetch complete (26674 records). [2025-10-23T21:35:05.260719] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-23T21:35:05.598315] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-23T21:35:05.629921] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-23T21:35:05.713058] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-23T21:35:05.728860] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T21:35:05.714075] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-23T21:35:05.771909] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-23T21:35:05.771564] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-23T21:35:05.794211] [DEBUG] [LOCAL ] GCO: Trimmed 34632 records to 22941 (keeping 200 days of data) [2025-10-23T21:35:05.976882] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-23T21:35:05.990665] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-23T21:35:05.992314] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-23T21:35:05.997782] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-23T21:35:06.014575] [DEBUG] [LOCAL ] GCO: Primary data saved (22941 records). [2025-10-23T21:35:06.014948] [DEBUG] [LOCAL ] GCTS: Trimmed 26674 records to 20365 (keeping 200 days of data) [2025-10-23T21:35:06.014844] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-23T21:35:06.015422] [INFO ] [MAIN ] Update Progress: 902/2367 symbols completed. GCO took 36.0s. Estimated remaining: 3h 6m 50s. Rate: 7.8 symbols/min [2025-10-23T21:35:06.289926] [DEBUG] [LOCAL ] GCTS: Primary data saved (20365 records). [2025-10-23T21:35:06.306847] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-23T21:35:06.310794] [INFO ] [MAIN ] Update Progress: 903/2367 symbols completed. GCTS took 24.6s. Estimated remaining: 3h 6m 30s. Rate: 7.8 symbols/min [2025-10-23T21:35:06.310600] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:35:06.402678] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-23T21:35:06.483285] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:35:06.500437] [DEBUG] [LOCAL ] GDIV: Loaded 3507 existing records from primary storage. [2025-10-23T21:35:06.500755] [INFO ] [MAIN ] GDIV: Loaded 3507 existing records. [2025-10-23T21:35:06.617562] [DEBUG] [LOCAL ] GDDY: Loaded 49624 existing records from primary storage. [2025-10-23T21:35:06.638979] [INFO ] [MAIN ] GDDY: Loaded 49624 existing records. [2025-10-23T21:35:06.770631] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:35:06.799919] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-23T21:35:06.802314] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-23T21:35:06.823545] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-23T21:35:06.845986] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-23T21:35:06.926478] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:35:06.964466] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-23T21:35:06.986219] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-23T21:35:07.011605] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-23T21:35:07.049796] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-23T21:35:07.286225] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T21:35:07.344627] [INFO ] [REMOTE ] GCV: Full fetch complete (9922 records). [2025-10-23T21:35:07.381339] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-23T21:35:07.619256] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:35:07.708696] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-23T21:35:07.987972] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:35:08.010352] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-23T21:35:08.205231] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-23T21:35:08.205509] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-23T21:35:08.216421] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-23T21:35:08.217161] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-23T21:35:08.217625] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-23T21:35:08.218303] [DEBUG] [LOCAL ] GCV: Trimmed 9922 records to 7854 (keeping 200 days of data) [2025-10-23T21:35:08.265815] [DEBUG] [LOCAL ] GCV: Primary data saved (7854 records). [2025-10-23T21:35:08.265986] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-23T21:35:08.266105] [INFO ] [MAIN ] Update Progress: 904/2367 symbols completed. GCV took 24.5s. Estimated remaining: 3h 6m 13s. Rate: 7.9 symbols/min [2025-10-23T21:35:08.457068] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:35:08.463276] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T21:35:08.468847] [DEBUG] [LOCAL ] GDL: Loaded 2510 existing records from primary storage. [2025-10-23T21:35:08.469103] [INFO ] [MAIN ] GDL: Loaded 2510 existing records. [2025-10-23T21:35:08.648024] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:35:08.648242] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-23T21:35:08.648322] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-23T21:35:08.648489] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-23T21:35:08.648562] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-23T21:35:08.804667] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-23T21:35:09.009259] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:35:09.599424] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-23T21:35:09.652825] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T21:35:10.082120] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-23T21:35:10.399411] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-23T21:35:10.852872] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T21:35:10.854588] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T21:35:11.199453] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-23T21:35:11.999447] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-23T21:35:12.571118] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T21:35:12.799417] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-23T21:35:13.046167] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T21:35:13.299839] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-23T21:35:13.599468] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-23T21:35:14.190324] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T21:35:14.399412] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-23T21:35:15.199437] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-23T21:35:15.692009] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-23T21:35:15.999440] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-23T21:35:16.799426] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-23T21:35:17.599432] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-23T21:35:18.036144] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T21:35:18.389562] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T21:35:18.399637] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-23T21:35:19.199463] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-23T21:35:19.653388] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T21:35:19.893571] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (3.89 seconds). [2025-10-23T21:35:19.999440] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-23T21:35:20.703015] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (6.30 seconds). [2025-10-23T21:35:20.799466] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-23T21:35:21.281207] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T21:35:21.599461] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-23T21:35:21.863492] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T21:35:22.150572] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T21:35:22.399445] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-23T21:35:22.978987] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T21:35:23.199434] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-23T21:35:23.776408] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T21:35:23.999503] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-23T21:35:24.799440] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-23T21:35:24.906269] [DEBUG] [REMOTE ] GDL: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-23T21:35:24.906578] [WARN ] [REMOTE ] GDL: No data returned for month 2025-10 [2025-10-23T21:35:24.906707] [FATAL] [REMOTE ] GDL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:35:24.906808] [FATAL] [MAIN ] GDL: Failed to fetch primary data. [2025-10-23T21:35:24.906880] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:35:24.906955] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-23T21:35:24.907044] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-10-23T21:35:24.907113] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-10-23T21:35:24.907308] [DEBUG] [LOCAL ] GDL: Deleted derivative data file. [2025-10-23T21:35:24.907410] [INFO ] [MAIN ] Update Progress: 905/2367 symbols completed. GDL took 16.6s. Estimated remaining: 3h 6m 20s. Rate: 7.8 symbols/min [2025-10-23T21:35:25.094997] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:35:25.102504] [DEBUG] [LOCAL ] GDO: Loaded 5852 existing records from primary storage. [2025-10-23T21:35:25.102766] [INFO ] [MAIN ] GDO: Loaded 5852 existing records. [2025-10-23T21:35:25.303523] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:35:25.303789] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-23T21:35:25.304693] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-23T21:35:25.304888] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-23T21:35:25.304961] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-23T21:35:25.604543] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-23T21:35:25.678454] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:35:25.708373] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T21:35:26.399505] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-23T21:35:27.199442] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-23T21:36:02.863586] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (44.46 seconds). [2025-10-23T21:36:02.875928] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-23T21:36:03.063939] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (37.46 seconds). [2025-10-23T21:36:03.065387] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-23T21:36:03.367879] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (36.97 seconds). [2025-10-23T21:36:03.369986] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-23T21:36:03.631134] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-23T21:36:03.632502] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-23T21:36:03.986660] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T21:36:03.988783] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-23T21:36:04.463936] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T21:36:04.474348] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-23T21:36:05.026203] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (37.83 seconds). [2025-10-23T21:36:05.037160] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-23T21:36:05.041474] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T21:36:05.042834] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-23T21:36:05.116997] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T21:36:05.118991] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-23T21:36:05.499089] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-23T21:36:05.500434] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-23T21:36:05.802970] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T21:36:05.805010] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-23T21:36:06.001308] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-23T21:36:06.002395] [INFO ] [REMOTE ] GDIV: Full fetch complete (5423 records). [2025-10-23T21:36:06.002483] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-23T21:36:06.371306] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-23T21:36:06.371632] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-23T21:36:06.371874] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-23T21:36:06.392207] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-23T21:36:06.396627] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T21:36:06.405882] [DEBUG] [LOCAL ] GDIV: Trimmed 5423 records to 3522 (keeping 200 days of data) [2025-10-23T21:36:06.407249] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-23T21:36:06.429774] [DEBUG] [LOCAL ] GDIV: Primary data saved (3522 records). [2025-10-23T21:36:06.429884] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-23T21:36:06.430006] [INFO ] [MAIN ] Update Progress: 906/2367 symbols completed. GDIV took 1m 0s. Estimated remaining: 3h 7m 7s. Rate: 7.8 symbols/min [2025-10-23T21:36:06.539161] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T21:36:06.586365] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-23T21:36:06.616730] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:06.651213] [DEBUG] [LOCAL ] GDOT: Loaded 37641 existing records from primary storage. [2025-10-23T21:36:06.651542] [INFO ] [MAIN ] GDOT: Loaded 37641 existing records. [2025-10-23T21:36:06.858988] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:06.853871] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T21:36:06.868023] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-23T21:36:06.868141] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-23T21:36:06.868533] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-23T21:36:06.868740] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-23T21:36:06.900469] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-23T21:36:07.166200] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-23T21:36:07.188839] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-23T21:36:07.244434] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:07.244824] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-23T21:36:07.897153] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T21:36:07.899294] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-23T21:36:08.294074] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T21:36:08.302241] [INFO ] [REMOTE ] GD: Full fetch complete (69620 records). [2025-10-23T21:36:08.302413] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-23T21:36:08.466401] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T21:36:08.493438] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-23T21:36:08.646973] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T21:36:08.676613] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-23T21:36:08.751883] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-23T21:36:08.752144] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-23T21:36:08.753172] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-23T21:36:08.753347] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-23T21:36:08.755020] [DEBUG] [LOCAL ] GD: Trimmed 69620 records to 46837 (keeping 200 days of data) [2025-10-23T21:36:08.916692] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T21:36:08.941129] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-23T21:36:09.136069] [DEBUG] [LOCAL ] GD: Primary data saved (46837 records). [2025-10-23T21:36:09.136281] [INFO ] [MAIN ] GD: Full history saved. [2025-10-23T21:36:09.136418] [INFO ] [MAIN ] Update Progress: 907/2367 symbols completed. GD took 1m 9s. Estimated remaining: 3h 6m 51s. Rate: 7.8 symbols/min [2025-10-23T21:36:09.303696] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:09.323380] [DEBUG] [LOCAL ] GDV: Loaded 19143 existing records from primary storage. [2025-10-23T21:36:09.323713] [INFO ] [MAIN ] GDV: Loaded 19143 existing records. [2025-10-23T21:36:09.496602] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:09.496834] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-23T21:36:09.496908] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-23T21:36:09.497133] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-23T21:36:09.497205] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-23T21:36:09.794499] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T21:36:09.843417] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-23T21:36:09.864729] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:09.865762] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-23T21:36:09.881761] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T21:36:09.887924] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-23T21:36:10.484512] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T21:36:10.485970] [INFO ] [REMOTE ] GDO: Full fetch complete (8478 records). [2025-10-23T21:36:10.486059] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-23T21:36:10.855413] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-23T21:36:10.855719] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-23T21:36:10.856070] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-23T21:36:10.856248] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-23T21:36:10.857018] [DEBUG] [LOCAL ] GDO: Trimmed 8478 records to 5905 (keeping 200 days of data) [2025-10-23T21:36:10.917853] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-23T21:36:10.935197] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-23T21:36:10.942693] [DEBUG] [LOCAL ] GDO: Primary data saved (5905 records). [2025-10-23T21:36:10.943025] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-23T21:36:10.943197] [INFO ] [MAIN ] Update Progress: 908/2367 symbols completed. GDO took 46.0s. Estimated remaining: 3h 6m 34s. Rate: 7.8 symbols/min [2025-10-23T21:36:11.074481] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:36:11.115484] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-23T21:36:11.140770] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:11.169465] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T21:36:11.179127] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-23T21:36:11.224859] [DEBUG] [LOCAL ] GE: Loaded 53697 existing records from primary storage. [2025-10-23T21:36:11.225233] [INFO ] [MAIN ] GE: Loaded 53697 existing records. [2025-10-23T21:36:11.401335] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:11.401580] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-23T21:36:11.401681] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-23T21:36:11.401918] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-23T21:36:11.401989] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-23T21:36:11.755572] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:11.755912] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-23T21:36:12.168805] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T21:36:12.173103] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-23T21:36:12.723134] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T21:36:12.731497] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-23T21:36:12.844730] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T21:36:12.858082] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-23T21:36:13.220784] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T21:36:13.227924] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-23T21:36:14.070131] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-23T21:36:14.080550] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-23T21:36:14.175952] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T21:36:14.184287] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-23T21:36:14.271780] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T21:36:14.280460] [INFO ] [REMOTE ] GDDY: Full fetch complete (72107 records). [2025-10-23T21:36:14.280608] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-23T21:36:14.603969] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T21:36:14.650608] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-23T21:36:14.708171] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-23T21:36:14.708289] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-23T21:36:14.709412] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-23T21:36:14.709492] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-23T21:36:14.710988] [DEBUG] [LOCAL ] GDDY: Trimmed 72107 records to 49956 (keeping 200 days of data) [2025-10-23T21:36:15.004404] [DEBUG] [LOCAL ] GDDY: Primary data saved (49956 records). [2025-10-23T21:36:15.004568] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-23T21:36:15.004704] [INFO ] [MAIN ] Update Progress: 909/2367 symbols completed. GDDY took 1m 9s. Estimated remaining: 3h 6m 21s. Rate: 7.8 symbols/min [2025-10-23T21:36:15.182540] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:15.201275] [DEBUG] [LOCAL ] GEF: Loaded 20692 existing records from primary storage. [2025-10-23T21:36:15.201555] [INFO ] [MAIN ] GEF: Loaded 20692 existing records. [2025-10-23T21:36:15.385504] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:15.385719] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-23T21:36:15.385793] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-23T21:36:15.385998] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-23T21:36:15.386068] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-23T21:36:15.762852] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:15.764287] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-23T21:36:15.786889] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T21:36:15.795078] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-23T21:36:15.828561] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T21:36:15.834813] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-23T21:36:15.993853] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T21:36:16.004025] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-23T21:36:16.861903] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T21:36:16.866343] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-23T21:36:16.910522] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T21:36:16.914984] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-23T21:36:17.284831] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T21:36:17.293634] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-23T21:36:17.780915] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T21:36:17.786306] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-23T21:36:17.927457] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T21:36:17.931373] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-23T21:36:18.129478] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T21:36:18.140544] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-23T21:36:18.513954] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T21:36:18.518060] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-23T21:36:18.603734] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T21:36:18.611726] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-23T21:36:19.071886] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T21:36:19.076405] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-23T21:36:19.480724] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T21:36:19.484596] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-23T21:36:20.069622] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T21:36:20.074561] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-23T21:36:20.151690] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T21:36:20.163005] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-23T21:36:20.287267] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T21:36:20.297159] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-23T21:36:20.446902] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T21:36:20.450256] [INFO ] [REMOTE ] GDV: Full fetch complete (28268 records). [2025-10-23T21:36:20.450349] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-23T21:36:20.852840] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-23T21:36:20.852484] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T21:36:20.852995] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-23T21:36:20.857461] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-23T21:36:20.858063] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-23T21:36:20.858557] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-23T21:36:20.860142] [DEBUG] [LOCAL ] GDV: Trimmed 28268 records to 19241 (keeping 200 days of data) [2025-10-23T21:36:20.982087] [DEBUG] [LOCAL ] GDV: Primary data saved (19241 records). [2025-10-23T21:36:20.982247] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-23T21:36:20.982337] [INFO ] [MAIN ] Update Progress: 910/2367 symbols completed. GDV took 11.8s. Estimated remaining: 3h 6m 11s. Rate: 7.8 symbols/min [2025-10-23T21:36:21.152639] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:21.182483] [DEBUG] [LOCAL ] GEL: Loaded 31221 existing records from primary storage. [2025-10-23T21:36:21.182850] [INFO ] [MAIN ] GEL: Loaded 31221 existing records. [2025-10-23T21:36:21.362889] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:21.363423] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-23T21:36:21.363536] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-23T21:36:21.364174] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-23T21:36:21.364256] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-23T21:36:21.549464] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T21:36:21.653562] [INFO ] [REMOTE ] GDOT: Full fetch complete (53729 records). [2025-10-23T21:36:21.677824] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-23T21:36:21.881916] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:21.882963] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-23T21:36:22.202450] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-23T21:36:22.203927] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T21:36:22.204268] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-23T21:36:22.213337] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-23T21:36:22.212589] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-23T21:36:22.215062] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-23T21:36:22.217167] [DEBUG] [LOCAL ] GDOT: Trimmed 53729 records to 37911 (keeping 200 days of data) [2025-10-23T21:36:22.334605] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-23T21:36:22.382577] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-23T21:36:22.494906] [DEBUG] [LOCAL ] GDOT: Primary data saved (37911 records). [2025-10-23T21:36:22.495205] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-23T21:36:22.495356] [INFO ] [MAIN ] Update Progress: 911/2367 symbols completed. GDOT took 16.1s. Estimated remaining: 3h 5m 53s. Rate: 7.8 symbols/min [2025-10-23T21:36:22.671420] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:22.727062] [DEBUG] [LOCAL ] GENI: Loaded 52937 existing records from primary storage. [2025-10-23T21:36:22.727536] [INFO ] [MAIN ] GENI: Loaded 52937 existing records. [2025-10-23T21:36:22.932751] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:22.933187] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-23T21:36:22.933274] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-23T21:36:22.933602] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-23T21:36:22.933734] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-23T21:36:23.201290] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T21:36:23.239898] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-23T21:36:23.563882] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T21:36:23.582388] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:23.584020] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-23T21:36:23.584541] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-23T21:36:24.758102] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-23T21:36:24.773670] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T21:36:24.784093] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-23T21:36:24.783519] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-23T21:36:24.802180] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T21:36:24.807866] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-23T21:36:24.908955] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T21:36:24.919514] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-23T21:36:25.668050] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T21:36:25.673280] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-23T21:36:26.077680] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T21:36:26.087078] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-23T21:36:26.590756] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T21:36:26.601432] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-23T21:36:26.620367] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T21:36:26.625194] [INFO ] [REMOTE ] GEF: Full fetch complete (29355 records). [2025-10-23T21:36:26.625396] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-23T21:36:27.023824] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-23T21:36:27.024050] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-23T21:36:27.025274] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-23T21:36:27.025364] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-23T21:36:27.026456] [DEBUG] [LOCAL ] GEF: Trimmed 29355 records to 20824 (keeping 200 days of data) [2025-10-23T21:36:27.175540] [DEBUG] [LOCAL ] GEF: Primary data saved (20824 records). [2025-10-23T21:36:27.191960] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-23T21:36:27.195540] [INFO ] [MAIN ] Update Progress: 912/2367 symbols completed. GEF took 12.2s. Estimated remaining: 3h 5m 41s. Rate: 7.8 symbols/min [2025-10-23T21:36:27.244694] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-23T21:36:27.325895] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-23T21:36:27.399018] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:27.423605] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T21:36:27.431632] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-23T21:36:27.480691] [DEBUG] [LOCAL ] GEO: Loaded 51707 existing records from primary storage. [2025-10-23T21:36:27.481135] [INFO ] [MAIN ] GEO: Loaded 51707 existing records. [2025-10-23T21:36:27.665670] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:27.665993] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-23T21:36:27.666076] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-23T21:36:27.666422] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-23T21:36:27.666500] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-23T21:36:28.064163] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:28.064845] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-23T21:36:28.349724] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:36:28.362121] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-23T21:36:28.822494] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T21:36:28.830788] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-23T21:36:29.358484] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T21:36:29.371024] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-23T21:36:29.899337] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T21:36:29.908045] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-23T21:36:30.132806] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T21:36:30.143895] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-23T21:36:30.234533] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T21:36:30.246355] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-23T21:36:31.358890] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T21:36:31.367208] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-23T21:36:31.700914] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-23T21:36:31.713895] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-23T21:36:31.953997] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T21:36:31.965082] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-23T21:36:32.042997] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T21:36:32.055894] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-23T21:36:32.090276] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-23T21:36:32.099813] [INFO ] [REMOTE ] GE: Full fetch complete (77860 records). [2025-10-23T21:36:32.100010] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-23T21:36:32.496957] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-23T21:36:32.497415] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-23T21:36:32.498496] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-23T21:36:32.498583] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-23T21:36:32.500172] [DEBUG] [LOCAL ] GE: Trimmed 77860 records to 54083 (keeping 200 days of data) [2025-10-23T21:36:32.846687] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T21:36:32.880032] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-23T21:36:32.879513] [DEBUG] [LOCAL ] GE: Primary data saved (54083 records). [2025-10-23T21:36:32.880264] [INFO ] [MAIN ] GE: Full history saved. [2025-10-23T21:36:32.881755] [INFO ] [MAIN ] Update Progress: 913/2367 symbols completed. GE took 21.9s. Estimated remaining: 3h 5m 30s. Rate: 7.8 symbols/min [2025-10-23T21:36:33.054892] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:33.091252] [DEBUG] [LOCAL ] GES: Loaded 37820 existing records from primary storage. [2025-10-23T21:36:33.091602] [INFO ] [MAIN ] GES: Loaded 37820 existing records. [2025-10-23T21:36:33.274345] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:33.274674] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-23T21:36:33.275111] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-23T21:36:33.276002] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-23T21:36:33.276088] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-23T21:36:33.634817] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T21:36:33.698138] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-23T21:36:33.703338] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:33.705337] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-23T21:36:34.174854] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T21:36:34.214437] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-23T21:36:34.212231] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-23T21:36:34.226616] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-23T21:36:35.225071] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T21:36:35.234691] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-23T21:36:35.273993] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-23T21:36:35.278348] [INFO ] [REMOTE ] GEL: Full fetch complete (47938 records). [2025-10-23T21:36:35.278503] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-23T21:36:35.626205] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T21:36:35.673586] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-23T21:36:35.706948] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-23T21:36:35.707050] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-23T21:36:35.707879] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-23T21:36:35.707956] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-23T21:36:35.709267] [DEBUG] [LOCAL ] GEL: Trimmed 47938 records to 31358 (keeping 200 days of data) [2025-10-23T21:36:35.892462] [DEBUG] [LOCAL ] GEL: Primary data saved (31358 records). [2025-10-23T21:36:35.892727] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-23T21:36:35.892848] [INFO ] [MAIN ] Update Progress: 914/2367 symbols completed. GEL took 14.9s. Estimated remaining: 3h 5m 15s. Rate: 7.8 symbols/min [2025-10-23T21:36:36.062157] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:36.109263] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T21:36:36.120840] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-23T21:36:36.136461] [DEBUG] [LOCAL ] GETY: Loaded 35237 existing records from primary storage. [2025-10-23T21:36:36.136786] [INFO ] [MAIN ] GETY: Loaded 35237 existing records. [2025-10-23T21:36:36.315473] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:36.315690] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-23T21:36:36.315766] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-23T21:36:36.316000] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-23T21:36:36.316075] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-23T21:36:36.670977] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:36.799394] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-23T21:36:36.835931] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T21:36:37.432481] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T21:36:37.599404] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-23T21:36:38.017881] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T21:36:38.399457] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-23T21:36:38.787195] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-23T21:36:39.071624] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T21:36:39.199418] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-23T21:36:39.999417] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-23T21:36:40.302336] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T21:36:40.799441] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-23T21:36:40.914781] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T21:36:41.600190] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-23T21:36:41.603332] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T21:36:42.399429] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-23T21:36:42.552280] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:36:43.199421] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-23T21:36:43.467900] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T21:36:43.594274] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T21:36:43.999453] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-23T21:36:44.799420] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-23T21:36:45.060004] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-23T21:36:45.069328] [INFO ] [REMOTE ] GENI: Full fetch complete (76087 records). [2025-10-23T21:36:45.069489] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-23T21:36:45.486626] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-23T21:36:45.486762] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-23T21:36:45.487837] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-23T21:36:45.487915] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-23T21:36:45.489394] [DEBUG] [LOCAL ] GENI: Trimmed 76087 records to 53310 (keeping 200 days of data) [2025-10-23T21:36:45.599414] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-23T21:36:45.799700] [DEBUG] [LOCAL ] GENI: Primary data saved (53310 records). [2025-10-23T21:36:45.799861] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-23T21:36:45.799974] [INFO ] [MAIN ] Update Progress: 915/2367 symbols completed. GENI took 23.3s. Estimated remaining: 3h 5m 11s. Rate: 7.8 symbols/min [2025-10-23T21:36:45.986158] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:46.006977] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T21:36:46.065105] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-23T21:36:46.065471] [INFO ] [MAIN ] GEV: Loaded 52992 existing records. [2025-10-23T21:36:46.246479] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:46.246968] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-23T21:36:46.247065] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-23T21:36:46.247352] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-23T21:36:46.247544] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-23T21:36:46.363028] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T21:36:46.404433] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-23T21:36:46.638660] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:47.199419] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-23T21:36:47.296719] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:36:47.999428] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-23T21:36:48.270624] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T21:36:48.724735] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T21:36:48.799434] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-23T21:36:49.415366] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T21:36:49.599434] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-23T21:36:50.399424] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-23T21:36:51.198393] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-23T21:36:51.205848] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-23T21:36:51.999431] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-23T21:36:52.106420] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T21:36:52.147262] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-23T21:36:52.145898] [INFO ] [REMOTE ] GEO: Full fetch complete (75472 records). [2025-10-23T21:36:52.157725] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-23T21:36:52.555829] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-23T21:36:52.555951] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-23T21:36:52.556935] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-23T21:36:52.557016] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-23T21:36:52.558560] [DEBUG] [LOCAL ] GEO: Trimmed 75472 records to 52037 (keeping 200 days of data) [2025-10-23T21:36:52.786521] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T21:36:52.800679] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-23T21:36:52.892964] [DEBUG] [LOCAL ] GEO: Primary data saved (52037 records). [2025-10-23T21:36:52.893143] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-23T21:36:52.893273] [INFO ] [MAIN ] Update Progress: 916/2367 symbols completed. GEO took 25.7s. Estimated remaining: 3h 5m 2s. Rate: 7.8 symbols/min [2025-10-23T21:36:53.062064] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:36:53.069556] [DEBUG] [LOCAL ] GF: Loaded 2623 existing records from primary storage. [2025-10-23T21:36:53.069800] [INFO ] [MAIN ] GF: Loaded 2623 existing records. [2025-10-23T21:36:53.253824] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:36:53.254107] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-23T21:36:53.254184] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-23T21:36:53.254374] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-23T21:36:53.254447] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-23T21:36:53.604878] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-23T21:36:53.626013] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:36:53.642602] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T21:36:54.316007] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T21:36:54.399439] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-23T21:36:55.199440] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-23T21:36:55.828297] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T21:36:55.862993] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-23T21:36:55.999439] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-23T21:36:56.604608] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T21:36:56.799495] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-23T21:36:57.217215] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-23T21:36:57.599449] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-23T21:36:58.178309] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T21:36:58.352234] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-23T21:36:58.399487] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-23T21:36:59.199496] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-23T21:36:59.999491] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-23T21:37:00.810873] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-23T21:37:00.816907] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-23T21:37:01.295388] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-23T21:37:01.429952] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T21:37:01.437078] [INFO ] [REMOTE ] GES: Full fetch complete (58326 records). [2025-10-23T21:37:01.437251] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-23T21:37:01.587706] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T21:37:01.603345] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-23T21:37:01.860029] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-23T21:37:01.860148] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-23T21:37:01.861007] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-23T21:37:01.861086] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-23T21:37:01.862314] [DEBUG] [LOCAL ] GES: Trimmed 58326 records to 38089 (keeping 200 days of data) [2025-10-23T21:37:02.096013] [DEBUG] [LOCAL ] GES: Primary data saved (38089 records). [2025-10-23T21:37:02.096203] [INFO ] [MAIN ] GES: Full history saved. [2025-10-23T21:37:02.096321] [INFO ] [MAIN ] Update Progress: 917/2367 symbols completed. GES took 29.2s. Estimated remaining: 3h 4m 57s. Rate: 7.8 symbols/min [2025-10-23T21:37:02.399447] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-23T21:37:03.181413] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T21:37:03.188271] [INFO ] [REMOTE ] GETY: Full fetch complete (55586 records). [2025-10-23T21:37:03.188429] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-23T21:37:03.220619] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-23T21:37:03.564676] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-23T21:37:03.564783] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-23T21:37:03.565569] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-23T21:37:03.565639] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-23T21:37:03.566744] [DEBUG] [LOCAL ] GETY: Trimmed 55586 records to 35534 (keeping 200 days of data) [2025-10-23T21:37:03.759530] [DEBUG] [LOCAL ] GETY: Primary data saved (35534 records). [2025-10-23T21:37:03.759706] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-23T21:37:03.759818] [INFO ] [MAIN ] Update Progress: 918/2367 symbols completed. GETY took 27.9s. Estimated remaining: 3h 4m 40s. Rate: 7.8 symbols/min [2025-10-23T21:37:03.864622] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T21:37:03.999419] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-23T21:37:04.623488] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T21:37:04.804531] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-23T21:37:04.821969] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-23T21:37:05.405491] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T21:37:05.599438] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-23T21:37:06.108399] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-23T21:37:06.399469] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-23T21:37:07.199458] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-23T21:37:07.776484] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T21:37:07.999436] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-23T21:37:08.462795] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-23T21:37:08.764218] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-23T21:37:08.799440] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-23T21:37:09.599533] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-23T21:37:10.010997] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-23T21:37:10.011919] [INFO ] [REMOTE ] GF: Full fetch complete (4799 records). [2025-10-23T21:37:10.012006] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-23T21:37:10.361316] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-23T21:37:10.361427] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-23T21:37:10.361596] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-23T21:37:10.361707] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-23T21:37:10.362124] [DEBUG] [LOCAL ] GF: Trimmed 4799 records to 2643 (keeping 200 days of data) [2025-10-23T21:37:10.377360] [DEBUG] [LOCAL ] GF: Primary data saved (2643 records). [2025-10-23T21:37:10.377440] [INFO ] [MAIN ] GF: Full history saved. [2025-10-23T21:37:10.377542] [INFO ] [MAIN ] Update Progress: 919/2367 symbols completed. GF took 17.5s. Estimated remaining: 3h 4m 31s. Rate: 7.8 symbols/min [2025-10-23T21:37:11.365166] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-23T21:37:11.377701] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-23T21:37:13.885433] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-23T21:37:13.896406] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-23T21:37:16.451749] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-23T21:37:16.463109] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-23T21:37:17.199708] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T21:37:17.208768] [INFO ] [REMOTE ] GEV: Full fetch complete (77047 records). [2025-10-23T21:37:17.208929] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-23T21:37:17.590541] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-23T21:37:17.590672] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-23T21:37:17.591626] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-23T21:37:17.591728] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-23T21:37:17.593054] [DEBUG] [LOCAL ] GEV: Trimmed 77047 records to 53379 (keeping 200 days of data) [2025-10-23T21:37:17.924849] [DEBUG] [LOCAL ] GEV: Primary data saved (53379 records). [2025-10-23T21:37:17.925003] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-23T21:37:17.926636] [INFO ] [MAIN ] Update Progress: 920/2367 symbols completed. GEV took 32.1s. Estimated remaining: 3h 4m 23s. Rate: 7.8 symbols/min [2025-10-23T21:37:18.492955] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:18.572498] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:18.615105] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:18.618596] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:18.631499] [DEBUG] [LOCAL ] GFR: Loaded 7332 existing records from primary storage. [2025-10-23T21:37:18.632067] [INFO ] [MAIN ] GFR: Loaded 7332 existing records. [2025-10-23T21:37:18.832283] [DEBUG] [LOCAL ] GFF: Loaded 29398 existing records from primary storage. [2025-10-23T21:37:18.883716] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:18.883940] [INFO ] [MAIN ] GFF: Loaded 29398 existing records. [2025-10-23T21:37:18.890622] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-23T21:37:18.926881] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-23T21:37:18.890964] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-23T21:37:18.994785] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-23T21:37:19.049930] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-23T21:37:19.065732] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-23T21:37:19.055265] [DEBUG] [LOCAL ] GFL: Loaded 47496 existing records from primary storage. [2025-10-23T21:37:19.126586] [INFO ] [MAIN ] GFL: Loaded 47496 existing records. [2025-10-23T21:37:19.358467] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:19.393762] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-23T21:37:19.466231] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-23T21:37:19.469233] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:19.469527] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-23T21:37:19.469882] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-23T21:37:19.480823] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-23T21:37:19.535553] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-23T21:37:19.547290] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-23T21:37:19.579676] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-23T21:37:19.606672] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:19.827624] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-23T21:37:19.903163] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-23T21:37:19.966002] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-23T21:37:19.982043] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-23T21:37:20.416742] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:20.514495] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-23T21:37:20.847563] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:20.916589] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-23T21:37:20.952282] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:20.959119] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-23T21:37:21.044395] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:21.044783] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-23T21:37:21.345779] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T21:37:21.348588] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-23T21:37:22.070486] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T21:37:22.073047] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-23T21:37:22.116445] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T21:37:22.122860] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-23T21:37:22.587373] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T21:37:22.596696] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-23T21:37:22.750369] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T21:37:22.760795] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-23T21:37:22.869078] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T21:37:22.872371] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-23T21:37:23.461105] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T21:37:23.465699] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-23T21:37:23.511186] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T21:37:23.517440] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-23T21:37:23.909769] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T21:37:23.918902] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-23T21:37:24.276355] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T21:37:24.279427] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-23T21:37:24.721203] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T21:37:24.729241] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-23T21:37:24.763035] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-23T21:37:24.799405] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-23T21:37:24.893782] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T21:37:25.599511] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-23T21:37:25.647154] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T21:37:26.162406] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T21:37:26.363100] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T21:37:26.399482] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-23T21:37:27.036049] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-23T21:37:27.199426] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-23T21:37:27.795905] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T21:37:27.999438] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-23T21:37:28.799457] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-23T21:37:29.395941] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T21:37:29.404483] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-23T21:37:29.558382] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T21:37:29.599446] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-23T21:37:30.399462] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-23T21:37:31.042754] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T21:37:31.204534] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-23T21:37:31.218386] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T21:37:31.999444] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-23T21:37:32.474834] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T21:37:32.799503] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-23T21:37:33.422754] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T21:37:33.425441] [INFO ] [REMOTE ] GFR: Full fetch complete (11958 records). [2025-10-23T21:37:33.425589] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-23T21:37:33.602507] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-23T21:37:33.934475] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T21:37:34.028716] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-23T21:37:34.028832] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-23T21:37:34.029154] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-23T21:37:34.029227] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-23T21:37:34.029788] [DEBUG] [LOCAL ] GFR: Trimmed 11958 records to 7396 (keeping 200 days of data) [2025-10-23T21:37:34.073556] [DEBUG] [LOCAL ] GFR: Primary data saved (7396 records). [2025-10-23T21:37:34.073744] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-23T21:37:34.073860] [INFO ] [MAIN ] Update Progress: 921/2367 symbols completed. GFR took 16.1s. Estimated remaining: 3h 4m 29s. Rate: 7.8 symbols/min [2025-10-23T21:37:34.243688] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:34.243885] [DEBUG] [LOCAL ] GGB: No existing data file found in primary storage. [2025-10-23T21:37:34.243957] [WARN ] [MAIN ] GGB: No existing data found, performing full refresh instead. [2025-10-23T21:37:34.244066] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-23T21:37:34.244137] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-23T21:37:34.244219] [DEBUG] [LOCAL ] GGB: No primary data file found to delete. [2025-10-23T21:37:34.244289] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-23T21:37:34.402176] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-23T21:37:34.604693] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:35.199404] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-23T21:37:35.658297] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-23T21:37:35.999445] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-23T21:37:36.092335] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T21:37:36.799464] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-23T21:37:36.891476] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T21:37:37.321448] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T21:37:37.599467] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-23T21:37:38.399426] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-23T21:37:38.425313] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T21:37:39.116249] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T21:37:39.199391] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-23T21:37:39.999435] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-23T21:37:40.263379] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T21:37:40.419553] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T21:37:40.799438] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-23T21:37:41.599416] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-23T21:37:41.777605] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T21:37:42.399458] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-23T21:37:42.930803] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-23T21:37:43.199417] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-23T21:37:43.329108] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T21:37:43.741906] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T21:37:43.999443] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-23T21:37:44.799414] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-23T21:37:45.599458] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-23T21:37:45.755342] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T21:37:45.813444] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T21:37:45.818247] [INFO ] [REMOTE ] GFF: Full fetch complete (43650 records). [2025-10-23T21:37:45.818366] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-23T21:37:46.212360] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-23T21:37:46.212482] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-23T21:37:46.213249] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-23T21:37:46.213334] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-23T21:37:46.214239] [DEBUG] [LOCAL ] GFF: Trimmed 43650 records to 29553 (keeping 200 days of data) [2025-10-23T21:37:46.413374] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-23T21:37:46.421955] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-10-23T21:37:46.426501] [DEBUG] [LOCAL ] GFF: Primary data saved (29553 records). [2025-10-23T21:37:46.442538] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-23T21:37:46.443223] [INFO ] [MAIN ] Update Progress: 922/2367 symbols completed. GFF took 28.5s. Estimated remaining: 3h 4m 28s. Rate: 7.8 symbols/min [2025-10-23T21:37:46.612069] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:46.648997] [DEBUG] [LOCAL ] GGG: Loaded 40560 existing records from primary storage. [2025-10-23T21:37:46.649315] [INFO ] [MAIN ] GGG: Loaded 40560 existing records. [2025-10-23T21:37:46.821304] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:46.822116] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-23T21:37:46.822193] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-23T21:37:46.822421] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-23T21:37:46.822494] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-23T21:37:47.175619] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:47.199410] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-23T21:37:47.596579] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-23T21:37:47.605426] [INFO ] [REMOTE ] GFL: Full fetch complete (69727 records). [2025-10-23T21:37:47.605631] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-23T21:37:47.992791] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-23T21:37:47.992964] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-23T21:37:47.994029] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-23T21:37:47.994127] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-23T21:37:47.995593] [DEBUG] [LOCAL ] GFL: Trimmed 69727 records to 47819 (keeping 200 days of data) [2025-10-23T21:37:47.999437] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-23T21:37:48.301826] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T21:37:48.343206] [DEBUG] [LOCAL ] GFL: Primary data saved (47819 records). [2025-10-23T21:37:48.343748] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-23T21:37:48.343885] [INFO ] [MAIN ] Update Progress: 923/2367 symbols completed. GFL took 30.4s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-23T21:37:48.507924] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:48.523090] [DEBUG] [LOCAL ] GGT: Loaded 14455 existing records from primary storage. [2025-10-23T21:37:48.523386] [INFO ] [MAIN ] GGT: Loaded 14455 existing records. [2025-10-23T21:37:48.696605] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:48.696867] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-23T21:37:48.696959] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-23T21:37:48.697184] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-23T21:37:48.697277] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-23T21:37:48.804767] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-23T21:37:49.054420] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:49.402146] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T21:37:49.438874] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T21:37:49.599431] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-23T21:37:50.399479] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-23T21:37:50.615510] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T21:37:51.112779] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T21:37:51.199445] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-23T21:37:51.701516] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-23T21:37:51.729152] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-23T21:37:51.738718] [INFO ] [REMOTE ] GFI: Full fetch complete (76990 records). [2025-10-23T21:37:51.738870] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-23T21:37:52.004738] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-23T21:37:52.140202] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-23T21:37:52.140307] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-23T21:37:52.141344] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-23T21:37:52.141423] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-23T21:37:52.142886] [DEBUG] [LOCAL ] GFI: Trimmed 76990 records to 53505 (keeping 200 days of data) [2025-10-23T21:37:52.466919] [DEBUG] [LOCAL ] GFI: Primary data saved (53505 records). [2025-10-23T21:37:52.467076] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-23T21:37:52.467193] [INFO ] [MAIN ] Update Progress: 924/2367 symbols completed. GFI took 34.5s. Estimated remaining: 3h 3m 58s. Rate: 7.8 symbols/min [2025-10-23T21:37:52.636010] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:37:52.640716] [DEBUG] [LOCAL ] GGZ: Loaded 2348 existing records from primary storage. [2025-10-23T21:37:52.640922] [INFO ] [MAIN ] GGZ: Loaded 2348 existing records. [2025-10-23T21:37:52.816060] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:37:52.811572] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-23T21:37:52.816285] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-23T21:37:52.817067] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-23T21:37:52.817226] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-23T21:37:52.817296] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-23T21:37:53.174573] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:37:53.511833] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T21:37:53.599400] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-23T21:37:54.172018] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-23T21:37:54.399413] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-23T21:37:54.796310] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T21:37:55.199447] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-23T21:37:55.884632] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T21:37:55.999424] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-23T21:37:56.799415] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-23T21:37:57.068871] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T21:37:57.111862] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-23T21:37:57.599416] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-23T21:37:57.702855] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:37:58.399423] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-23T21:37:59.139837] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T21:37:59.199427] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-23T21:37:59.259201] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T21:37:59.999434] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-23T21:38:00.478577] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T21:38:00.799457] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-23T21:38:00.971842] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T21:38:00.981179] [INFO ] [REMOTE ] GGB: Full fetch complete (74385 records). [2025-10-23T21:38:00.981323] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-23T21:38:01.375791] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-23T21:38:01.375896] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-23T21:38:01.376913] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-23T21:38:01.376998] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-23T21:38:01.378402] [DEBUG] [LOCAL ] GGB: Trimmed 74385 records to 51938 (keeping 200 days of data) [2025-10-23T21:38:01.599438] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-23T21:38:01.672039] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T21:38:01.691328] [DEBUG] [LOCAL ] GGB: Primary data saved (51938 records). [2025-10-23T21:38:01.691553] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-23T21:38:01.691769] [INFO ] [MAIN ] Update Progress: 925/2367 symbols completed. GGB took 27.6s. Estimated remaining: 3h 3m 53s. Rate: 7.8 symbols/min [2025-10-23T21:38:01.883333] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:01.889368] [DEBUG] [LOCAL ] GHC: Loaded 2954 existing records from primary storage. [2025-10-23T21:38:01.889619] [INFO ] [MAIN ] GHC: Loaded 2954 existing records. [2025-10-23T21:38:02.077273] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:02.077513] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-23T21:38:02.077589] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-23T21:38:02.077806] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-23T21:38:02.077885] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-23T21:38:02.404580] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-23T21:38:02.470826] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:03.007888] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T21:38:03.199439] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-23T21:38:03.589175] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T21:38:03.760995] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-23T21:38:03.999434] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-23T21:38:04.404850] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-23T21:38:04.799467] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-23T21:38:05.187856] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-23T21:38:05.599458] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-23T21:38:06.399441] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-23T21:38:06.840255] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T21:38:07.098327] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T21:38:07.199428] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-23T21:38:07.726600] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-23T21:38:07.999438] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-23T21:38:08.470573] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T21:38:08.799481] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-23T21:38:09.599437] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-23T21:38:10.124523] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T21:38:10.221123] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T21:38:10.399450] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-23T21:38:11.199456] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-23T21:38:11.501767] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T21:38:11.727754] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T21:38:11.999440] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-23T21:38:12.523254] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-23T21:38:12.799449] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-23T21:38:13.599472] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-23T21:38:13.749556] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T21:38:14.001016] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-23T21:38:14.399482] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-23T21:38:15.199450] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-23T21:38:15.648495] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T21:38:15.649544] [INFO ] [REMOTE ] GGZ: Full fetch complete (3807 records). [2025-10-23T21:38:15.649632] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-23T21:38:16.002454] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-23T21:38:16.044188] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-23T21:38:16.044879] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-23T21:38:16.046541] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T21:38:16.046972] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-23T21:38:16.055495] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-23T21:38:16.056395] [DEBUG] [LOCAL ] GGZ: Trimmed 3807 records to 2357 (keeping 200 days of data) [2025-10-23T21:38:16.071064] [DEBUG] [LOCAL ] GGZ: Primary data saved (2357 records). [2025-10-23T21:38:16.071149] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-23T21:38:16.071273] [INFO ] [MAIN ] Update Progress: 926/2367 symbols completed. GGZ took 23.6s. Estimated remaining: 3h 3m 56s. Rate: 7.8 symbols/min [2025-10-23T21:38:16.234096] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:16.240014] [DEBUG] [LOCAL ] GHG: Loaded 3269 existing records from primary storage. [2025-10-23T21:38:16.240240] [INFO ] [MAIN ] GHG: Loaded 3269 existing records. [2025-10-23T21:38:16.413950] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:16.414196] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-23T21:38:16.414272] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-23T21:38:16.414511] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-23T21:38:16.414585] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-23T21:38:16.676978] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T21:38:16.791085] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:16.799399] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-23T21:38:17.599489] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-23T21:38:18.287999] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T21:38:18.399412] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-23T21:38:18.412104] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T21:38:19.002117] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T21:38:19.199430] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-23T21:38:19.999465] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-23T21:38:20.664125] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T21:38:20.671809] [INFO ] [REMOTE ] GGG: Full fetch complete (59581 records). [2025-10-23T21:38:20.671947] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-23T21:38:20.812565] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-23T21:38:21.057269] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-23T21:38:21.066312] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-23T21:38:21.066602] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T21:38:21.067723] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-23T21:38:21.071328] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-23T21:38:21.072816] [DEBUG] [LOCAL ] GGG: Trimmed 59581 records to 40930 (keeping 200 days of data) [2025-10-23T21:38:21.282584] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-23T21:38:21.322130] [DEBUG] [LOCAL ] GGG: Primary data saved (40930 records). [2025-10-23T21:38:21.322297] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-23T21:38:21.322427] [INFO ] [MAIN ] Update Progress: 927/2367 symbols completed. GGG took 34.9s. Estimated remaining: 3h 3m 45s. Rate: 7.8 symbols/min [2025-10-23T21:38:21.491706] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:21.501910] [DEBUG] [LOCAL ] GHI: Loaded 7763 existing records from primary storage. [2025-10-23T21:38:21.502181] [INFO ] [MAIN ] GHI: Loaded 7763 existing records. [2025-10-23T21:38:21.600912] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-23T21:38:21.677051] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:21.677233] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-23T21:38:21.677310] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-23T21:38:21.677521] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-23T21:38:21.677604] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-23T21:38:22.027593] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:22.076212] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T21:38:22.399445] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-23T21:38:22.897977] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T21:38:23.199504] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-23T21:38:23.756069] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-23T21:38:23.999414] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-23T21:38:24.688972] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T21:38:24.690964] [INFO ] [REMOTE ] GHC: Full fetch complete (3702 records). [2025-10-23T21:38:24.691068] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-23T21:38:24.804544] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-23T21:38:25.082913] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-23T21:38:25.083344] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-23T21:38:25.083508] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-23T21:38:25.083580] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-23T21:38:25.083973] [DEBUG] [LOCAL ] GHC: Trimmed 3702 records to 2978 (keeping 200 days of data) [2025-10-23T21:38:25.105465] [DEBUG] [LOCAL ] GHC: Primary data saved (2978 records). [2025-10-23T21:38:25.105612] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-23T21:38:25.105749] [INFO ] [MAIN ] Update Progress: 928/2367 symbols completed. GHC took 23.4s. Estimated remaining: 3h 3m 31s. Rate: 7.8 symbols/min [2025-10-23T21:38:25.283678] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:25.291147] [DEBUG] [LOCAL ] GHLD: Loaded 4327 existing records from primary storage. [2025-10-23T21:38:25.291406] [INFO ] [MAIN ] GHLD: Loaded 4327 existing records. [2025-10-23T21:38:25.531693] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:25.532195] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-23T21:38:25.532379] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-23T21:38:25.532904] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-23T21:38:25.533002] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-23T21:38:25.604885] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-23T21:38:25.768474] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T21:38:26.019799] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:26.256506] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T21:38:26.259867] [INFO ] [REMOTE ] GGT: Full fetch complete (19072 records). [2025-10-23T21:38:26.259967] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-23T21:38:26.404621] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-23T21:38:26.640028] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-23T21:38:26.640154] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-23T21:38:26.640639] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-23T21:38:26.640741] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-23T21:38:26.641424] [DEBUG] [LOCAL ] GGT: Trimmed 19072 records to 14575 (keeping 200 days of data) [2025-10-23T21:38:26.728166] [DEBUG] [LOCAL ] GGT: Primary data saved (14575 records). [2025-10-23T21:38:26.728336] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-23T21:38:26.728451] [INFO ] [MAIN ] Update Progress: 929/2367 symbols completed. GGT took 38.4s. Estimated remaining: 3h 3m 14s. Rate: 7.8 symbols/min [2025-10-23T21:38:26.907016] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:26.923131] [DEBUG] [LOCAL ] GHM: Loaded 14307 existing records from primary storage. [2025-10-23T21:38:26.923410] [INFO ] [MAIN ] GHM: Loaded 14307 existing records. [2025-10-23T21:38:27.031347] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-23T21:38:27.111787] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:27.112059] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-23T21:38:27.112139] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-23T21:38:27.112366] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-23T21:38:27.112440] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-23T21:38:27.204551] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-23T21:38:27.465118] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:27.761249] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-23T21:38:27.999444] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-23T21:38:28.643680] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T21:38:28.799421] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-23T21:38:29.130429] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-23T21:38:29.599433] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-23T21:38:30.204844] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T21:38:30.399428] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-23T21:38:30.881154] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T21:38:31.199434] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-23T21:38:31.999432] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-23T21:38:32.018474] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T21:38:32.721623] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T21:38:32.799400] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-23T21:38:33.599454] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-23T21:38:33.696035] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-23T21:38:34.156160] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-23T21:38:34.399443] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-23T21:38:34.859185] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T21:38:35.199445] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-23T21:38:35.627974] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-23T21:38:35.999439] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-23T21:38:36.588338] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T21:38:36.799421] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-23T21:38:37.599414] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-23T21:38:37.737281] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T21:38:38.180436] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T21:38:38.399447] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-23T21:38:38.878287] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-23T21:38:39.199427] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-23T21:38:39.631933] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-23T21:38:39.999464] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-23T21:38:40.759603] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T21:38:40.799433] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-23T21:38:41.599414] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-23T21:38:41.615176] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-23T21:38:42.133383] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-23T21:38:42.399438] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-23T21:38:43.199413] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-23T21:38:43.315072] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T21:38:43.944370] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T21:38:43.999401] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-23T21:38:44.799427] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-23T21:38:44.867100] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T21:38:44.871102] [INFO ] [REMOTE ] GHI: Full fetch complete (11336 records). [2025-10-23T21:38:44.871246] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-23T21:38:45.254524] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-23T21:38:45.254687] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-23T21:38:45.255051] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-23T21:38:45.255146] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-23T21:38:45.255754] [DEBUG] [LOCAL ] GHI: Trimmed 11336 records to 7953 (keeping 200 days of data) [2025-10-23T21:38:45.306665] [DEBUG] [LOCAL ] GHI: Primary data saved (7953 records). [2025-10-23T21:38:45.306834] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-23T21:38:45.306948] [INFO ] [MAIN ] Update Progress: 930/2367 symbols completed. GHI took 24.0s. Estimated remaining: 3h 3m 23s. Rate: 7.8 symbols/min [2025-10-23T21:38:45.424114] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T21:38:45.484188] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:45.505822] [DEBUG] [LOCAL ] GHY: Loaded 20840 existing records from primary storage. [2025-10-23T21:38:45.506113] [INFO ] [MAIN ] GHY: Loaded 20840 existing records. [2025-10-23T21:38:45.604730] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-23T21:38:45.687391] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:45.687590] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-23T21:38:45.687688] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-23T21:38:45.687976] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-23T21:38:45.688068] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-23T21:38:46.053397] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:46.106441] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T21:38:46.399441] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-23T21:38:47.199436] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-23T21:38:47.208949] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T21:38:47.999449] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-23T21:38:48.547866] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T21:38:48.599967] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T21:38:48.799439] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-23T21:38:49.389219] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-23T21:38:49.390669] [INFO ] [REMOTE ] GHG: Full fetch complete (4212 records). [2025-10-23T21:38:49.390771] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-23T21:38:49.605227] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-23T21:38:49.759779] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-23T21:38:49.759892] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-23T21:38:49.760122] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-23T21:38:49.760196] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-23T21:38:49.760580] [DEBUG] [LOCAL ] GHG: Trimmed 4212 records to 3296 (keeping 200 days of data) [2025-10-23T21:38:49.781179] [DEBUG] [LOCAL ] GHG: Primary data saved (3296 records). [2025-10-23T21:38:49.781309] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-23T21:38:49.781417] [INFO ] [MAIN ] Update Progress: 931/2367 symbols completed. GHG took 33.7s. Estimated remaining: 3h 3m 11s. Rate: 7.8 symbols/min [2025-10-23T21:38:49.944198] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:38:49.974130] [DEBUG] [LOCAL ] GIB: Loaded 31346 existing records from primary storage. [2025-10-23T21:38:49.974440] [INFO ] [MAIN ] GIB: Loaded 31346 existing records. [2025-10-23T21:38:50.147278] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:38:50.147505] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-23T21:38:50.147581] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-23T21:38:50.147883] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-23T21:38:50.147958] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-23T21:38:50.407585] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-23T21:38:50.493830] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:38:50.658514] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T21:38:51.199409] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-23T21:38:51.355595] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-23T21:38:51.885275] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T21:38:51.999472] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-23T21:38:52.799413] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-23T21:38:53.276864] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T21:38:53.435071] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T21:38:53.599429] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-23T21:38:54.399413] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-23T21:38:54.635247] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-23T21:38:55.199451] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-23T21:38:55.406856] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T21:38:55.963004] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T21:38:55.999404] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-23T21:38:56.600534] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T21:38:56.799464] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-23T21:38:57.599437] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-23T21:38:57.802802] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-23T21:38:58.359296] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-23T21:38:58.399424] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-23T21:38:59.199418] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-23T21:38:59.348919] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T21:38:59.999415] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-23T21:39:00.243805] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:39:00.799424] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-23T21:39:01.297319] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T21:39:01.599445] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-23T21:39:02.145802] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T21:39:02.180026] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T21:39:02.181521] [INFO ] [REMOTE ] GHLD: Full fetch complete (5136 records). [2025-10-23T21:39:02.181637] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-23T21:39:02.404551] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-23T21:39:02.551932] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-23T21:39:02.552047] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-23T21:39:02.552249] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-23T21:39:02.552324] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-23T21:39:02.552788] [DEBUG] [LOCAL ] GHLD: Trimmed 5136 records to 4346 (keeping 200 days of data) [2025-10-23T21:39:02.578024] [DEBUG] [LOCAL ] GHLD: Primary data saved (4346 records). [2025-10-23T21:39:02.578147] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-23T21:39:02.578257] [INFO ] [MAIN ] Update Progress: 932/2367 symbols completed. GHLD took 37.5s. Estimated remaining: 3h 3m 11s. Rate: 7.8 symbols/min [2025-10-23T21:39:02.755539] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:02.770032] [DEBUG] [LOCAL ] GIC: Loaded 13184 existing records from primary storage. [2025-10-23T21:39:02.770306] [INFO ] [MAIN ] GIC: Loaded 13184 existing records. [2025-10-23T21:39:02.949509] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:02.949754] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-23T21:39:02.949832] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-23T21:39:02.950020] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-23T21:39:02.950093] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-23T21:39:03.208897] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-23T21:39:03.314119] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:03.558468] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T21:39:03.999437] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-23T21:39:04.308052] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T21:39:04.799447] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-23T21:39:05.318717] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T21:39:05.599418] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-23T21:39:05.782509] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T21:39:05.785881] [INFO ] [REMOTE ] GHM: Full fetch complete (21905 records). [2025-10-23T21:39:05.785989] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-23T21:39:06.151039] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-23T21:39:06.151151] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-23T21:39:06.151633] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-23T21:39:06.151728] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-23T21:39:06.152395] [DEBUG] [LOCAL ] GHM: Trimmed 21905 records to 14417 (keeping 200 days of data) [2025-10-23T21:39:06.236081] [DEBUG] [LOCAL ] GHM: Primary data saved (14417 records). [2025-10-23T21:39:06.236276] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-23T21:39:06.236402] [INFO ] [MAIN ] Update Progress: 933/2367 symbols completed. GHM took 39.5s. Estimated remaining: 3h 2m 57s. Rate: 7.8 symbols/min [2025-10-23T21:39:06.405620] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-23T21:39:06.408280] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:06.449442] [DEBUG] [LOCAL ] GIL: Loaded 43951 existing records from primary storage. [2025-10-23T21:39:06.449807] [INFO ] [MAIN ] GIL: Loaded 43951 existing records. [2025-10-23T21:39:06.643936] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:06.640231] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T21:39:06.647947] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-23T21:39:06.648048] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-23T21:39:06.648631] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-23T21:39:06.648724] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-23T21:39:07.012957] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:07.199432] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-23T21:39:07.942441] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T21:39:07.999464] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-23T21:39:08.639035] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T21:39:08.799506] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-23T21:39:08.898337] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T21:39:09.599438] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-23T21:39:09.734469] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T21:39:10.399479] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-23T21:39:10.669921] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T21:39:11.199442] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-23T21:39:12.004586] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-23T21:39:12.014936] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T21:39:12.258612] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T21:39:12.799414] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-23T21:39:13.270923] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T21:39:13.599430] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-23T21:39:14.021523] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T21:39:14.229710] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T21:39:14.399423] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-23T21:39:15.199446] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-23T21:39:15.999453] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-23T21:39:16.128354] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T21:39:16.607431] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-23T21:39:16.799440] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-23T21:39:17.157558] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T21:39:17.162065] [INFO ] [REMOTE ] GHY: Full fetch complete (32315 records). [2025-10-23T21:39:17.162165] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-23T21:39:17.570083] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-23T21:39:17.570249] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-23T21:39:17.571171] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-23T21:39:17.571274] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-23T21:39:17.572322] [DEBUG] [LOCAL ] GHY: Trimmed 32315 records to 21009 (keeping 200 days of data) [2025-10-23T21:39:17.642770] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-23T21:39:17.756875] [DEBUG] [LOCAL ] GHY: Primary data saved (21009 records). [2025-10-23T21:39:17.757078] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-23T21:39:17.757205] [INFO ] [MAIN ] Update Progress: 934/2367 symbols completed. GHY took 32.5s. Estimated remaining: 3h 2m 55s. Rate: 7.8 symbols/min [2025-10-23T21:39:18.020840] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:18.071039] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T21:39:18.152419] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-23T21:39:18.153009] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-23T21:39:18.401078] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-23T21:39:18.431837] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:18.432960] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-23T21:39:18.433060] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-23T21:39:18.433296] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-23T21:39:18.433368] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-23T21:39:18.829357] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:19.199420] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-23T21:39:19.364550] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T21:39:19.383352] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-23T21:39:19.999427] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-23T21:39:20.799432] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-23T21:39:20.822284] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T21:39:21.079132] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T21:39:21.599452] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-23T21:39:21.911291] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T21:39:22.399443] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-23T21:39:23.199435] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-23T21:39:23.380614] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T21:39:23.871152] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T21:39:23.891784] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T21:39:23.999435] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-23T21:39:24.799442] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-23T21:39:25.599428] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-23T21:39:25.648343] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T21:39:26.399448] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-23T21:39:26.618001] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T21:39:26.723307] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T21:39:27.199447] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-23T21:39:27.999466] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-23T21:39:28.187275] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T21:39:28.213177] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T21:39:28.218734] [INFO ] [REMOTE ] GIB: Full fetch complete (46507 records). [2025-10-23T21:39:28.218852] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-23T21:39:28.588208] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-23T21:39:28.588330] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-23T21:39:28.589109] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-23T21:39:28.589219] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-23T21:39:28.590217] [DEBUG] [LOCAL ] GIB: Trimmed 46507 records to 31579 (keeping 200 days of data) [2025-10-23T21:39:28.778532] [DEBUG] [LOCAL ] GIB: Primary data saved (31579 records). [2025-10-23T21:39:28.778725] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-23T21:39:28.778838] [INFO ] [MAIN ] Update Progress: 935/2367 symbols completed. GIB took 39.0s. Estimated remaining: 3h 2m 53s. Rate: 7.8 symbols/min [2025-10-23T21:39:28.807796] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-23T21:39:28.949442] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:28.987328] [DEBUG] [LOCAL ] GKOS: Loaded 42465 existing records from primary storage. [2025-10-23T21:39:28.987668] [INFO ] [MAIN ] GKOS: Loaded 42465 existing records. [2025-10-23T21:39:29.162985] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:29.163243] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-23T21:39:29.163335] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-23T21:39:29.163583] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-23T21:39:29.163693] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-23T21:39:29.529354] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:29.599418] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-23T21:39:29.773986] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T21:39:30.399475] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-23T21:39:30.530436] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T21:39:30.552588] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T21:39:31.199450] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-23T21:39:31.880522] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T21:39:31.999402] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-23T21:39:32.799431] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-23T21:39:32.850037] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T21:39:32.858225] [INFO ] [REMOTE ] GIL: Full fetch complete (62664 records). [2025-10-23T21:39:32.858365] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-23T21:39:33.240484] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-23T21:39:33.240600] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-23T21:39:33.241514] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-23T21:39:33.241593] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-23T21:39:33.242869] [DEBUG] [LOCAL ] GIL: Trimmed 62664 records to 44321 (keeping 200 days of data) [2025-10-23T21:39:33.511957] [DEBUG] [LOCAL ] GIL: Primary data saved (44321 records). [2025-10-23T21:39:33.512470] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-23T21:39:33.534881] [INFO ] [MAIN ] Update Progress: 936/2367 symbols completed. GIL took 27.3s. Estimated remaining: 3h 2m 41s. Rate: 7.8 symbols/min [2025-10-23T21:39:33.535791] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T21:39:33.605006] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-23T21:39:33.664900] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T21:39:33.689302] [INFO ] [REMOTE ] GIC: Full fetch complete (19766 records). [2025-10-23T21:39:33.718352] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-23T21:39:33.757187] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:34.097142] [DEBUG] [LOCAL ] GL: Loaded 37380 existing records from primary storage. [2025-10-23T21:39:34.127217] [INFO ] [MAIN ] GL: Loaded 37380 existing records. [2025-10-23T21:39:34.282992] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-23T21:39:34.283179] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-23T21:39:34.284185] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-23T21:39:34.290085] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-23T21:39:34.336186] [DEBUG] [LOCAL ] GIC: Trimmed 19766 records to 13240 (keeping 200 days of data) [2025-10-23T21:39:34.367084] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:34.367787] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-23T21:39:34.367871] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-23T21:39:34.368133] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-23T21:39:34.368213] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-23T21:39:34.399702] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-23T21:39:34.607103] [DEBUG] [LOCAL ] GIC: Primary data saved (13240 records). [2025-10-23T21:39:34.613008] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-23T21:39:34.622108] [INFO ] [MAIN ] Update Progress: 937/2367 symbols completed. GIC took 32.0s. Estimated remaining: 3h 2m 23s. Rate: 7.8 symbols/min [2025-10-23T21:39:35.001007] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:35.026941] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:35.078059] [DEBUG] [LOCAL ] GLOB: Loaded 48049 existing records from primary storage. [2025-10-23T21:39:35.078509] [INFO ] [MAIN ] GLOB: Loaded 48049 existing records. [2025-10-23T21:39:35.204545] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-23T21:39:35.270749] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:35.271004] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-23T21:39:35.271101] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-23T21:39:35.271334] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-23T21:39:35.271410] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-23T21:39:35.636518] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:35.713961] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-23T21:39:35.999495] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-23T21:39:36.293537] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T21:39:36.346574] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T21:39:36.799448] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-23T21:39:37.599474] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-23T21:39:37.926867] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T21:39:38.333938] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T21:39:38.399425] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-23T21:39:39.029620] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T21:39:39.199437] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-23T21:39:39.952444] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T21:39:39.999404] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-23T21:39:40.244818] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T21:39:40.799431] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-23T21:39:41.609217] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-23T21:39:41.614077] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T21:39:42.399453] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-23T21:39:42.827009] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T21:39:43.190604] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T21:39:43.199443] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-23T21:39:43.922144] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T21:39:43.999404] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-23T21:39:44.799439] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-23T21:39:44.916973] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T21:39:44.982050] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T21:39:45.599470] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-23T21:39:46.263495] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T21:39:46.399443] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-23T21:39:47.170222] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T21:39:47.199408] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-23T21:39:47.933241] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:39:47.999408] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-23T21:39:48.553055] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T21:39:48.799446] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-23T21:39:49.414689] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T21:39:49.599440] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-23T21:39:50.399416] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-23T21:39:50.958707] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-23T21:39:51.199455] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-23T21:39:51.355534] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T21:39:51.544384] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T21:39:51.999432] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-23T21:39:52.799413] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-23T21:39:52.923240] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T21:39:52.932618] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-23T21:39:52.932785] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-23T21:39:53.328807] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-23T21:39:53.329022] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-23T21:39:53.330084] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-23T21:39:53.330287] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-23T21:39:53.350420] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 54065 (keeping 200 days of data) [2025-10-23T21:39:53.351266] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T21:39:53.609462] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-23T21:39:53.716004] [DEBUG] [LOCAL ] GIS: Primary data saved (54065 records). [2025-10-23T21:39:53.716241] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-23T21:39:53.716357] [INFO ] [MAIN ] Update Progress: 938/2367 symbols completed. GIS took 36.0s. Estimated remaining: 3h 2m 33s. Rate: 7.8 symbols/min [2025-10-23T21:39:53.894088] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T21:39:53.920908] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:39:53.932279] [DEBUG] [LOCAL ] GLP: Loaded 9234 existing records from primary storage. [2025-10-23T21:39:53.932525] [INFO ] [MAIN ] GLP: Loaded 9234 existing records. [2025-10-23T21:39:54.106298] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:39:54.106501] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-23T21:39:54.106573] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-23T21:39:54.106780] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-23T21:39:54.106853] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-23T21:39:54.404535] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-23T21:39:54.454579] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:39:55.211958] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-23T21:39:55.214703] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T21:39:55.999469] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-23T21:39:56.152560] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:39:56.192380] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T21:39:56.799460] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-23T21:39:57.298124] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T21:39:57.604194] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-23T21:39:57.605122] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T21:39:58.399444] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-23T21:39:59.193669] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T21:39:59.199384] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-23T21:39:59.520063] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T21:39:59.914440] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T21:39:59.999430] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-23T21:40:00.799472] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-23T21:40:00.831357] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T21:40:01.599480] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-23T21:40:02.399462] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-23T21:40:02.658328] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T21:40:03.118747] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:40:03.125473] [INFO ] [REMOTE ] GL: Full fetch complete (54930 records). [2025-10-23T21:40:03.125611] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-23T21:40:03.199945] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-23T21:40:03.235584] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T21:40:03.514608] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-23T21:40:03.514738] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-23T21:40:03.515597] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-23T21:40:03.515690] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-23T21:40:03.516775] [DEBUG] [LOCAL ] GL: Trimmed 54930 records to 37689 (keeping 200 days of data) [2025-10-23T21:40:03.753839] [DEBUG] [LOCAL ] GL: Primary data saved (37689 records). [2025-10-23T21:40:03.754006] [INFO ] [MAIN ] GL: Full history saved. [2025-10-23T21:40:03.754118] [INFO ] [MAIN ] Update Progress: 939/2367 symbols completed. GL took 30.2s. Estimated remaining: 3h 2m 29s. Rate: 7.8 symbols/min [2025-10-23T21:40:03.919792] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:03.966900] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-23T21:40:03.967260] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-23T21:40:04.009216] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-23T21:40:04.144087] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:04.144296] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-23T21:40:04.144372] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-23T21:40:04.144624] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-23T21:40:04.144751] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-23T21:40:04.499626] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:04.798233] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T21:40:04.806567] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-23T21:40:04.836484] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T21:40:05.599458] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-23T21:40:06.399471] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-23T21:40:06.584517] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T21:40:06.593443] [INFO ] [REMOTE ] GLOB: Full fetch complete (66363 records). [2025-10-23T21:40:06.593626] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-23T21:40:06.997956] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-23T21:40:07.001030] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-23T21:40:07.002128] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-23T21:40:07.002214] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-23T21:40:07.010517] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T21:40:07.010639] [DEBUG] [LOCAL ] GLOB: Trimmed 66363 records to 48426 (keeping 200 days of data) [2025-10-23T21:40:07.213558] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-23T21:40:07.298909] [DEBUG] [LOCAL ] GLOB: Primary data saved (48426 records). [2025-10-23T21:40:07.299067] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-23T21:40:07.299190] [INFO ] [MAIN ] Update Progress: 940/2367 symbols completed. GLOB took 32.7s. Estimated remaining: 3h 2m 15s. Rate: 7.8 symbols/min [2025-10-23T21:40:07.470422] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:07.517405] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-23T21:40:07.517866] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-23T21:40:07.690869] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-23T21:40:07.736681] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:07.736859] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-23T21:40:07.736934] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-23T21:40:07.737312] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-23T21:40:07.737389] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-23T21:40:07.921281] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T21:40:08.004530] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-23T21:40:08.124983] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:08.799455] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-23T21:40:09.599410] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-23T21:40:09.658336] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T21:40:09.660327] [INFO ] [REMOTE ] GLP: Full fetch complete (14250 records). [2025-10-23T21:40:09.660418] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-23T21:40:10.029199] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-23T21:40:10.029449] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-23T21:40:10.029997] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-23T21:40:10.030097] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-23T21:40:10.030809] [DEBUG] [LOCAL ] GLP: Trimmed 14250 records to 9259 (keeping 200 days of data) [2025-10-23T21:40:10.111337] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-23T21:40:10.134590] [DEBUG] [LOCAL ] GLP: Primary data saved (9259 records). [2025-10-23T21:40:10.134775] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-23T21:40:10.134892] [INFO ] [MAIN ] Update Progress: 941/2367 symbols completed. GLP took 16.4s. Estimated remaining: 3h 1m 60s. Rate: 7.8 symbols/min [2025-10-23T21:40:10.377503] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:10.415120] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-23T21:40:10.448070] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-23T21:40:10.448506] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-23T21:40:10.711662] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:10.712043] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-23T21:40:10.712159] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-23T21:40:10.713015] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-23T21:40:10.713118] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-23T21:40:11.197960] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:11.199438] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-23T21:40:11.727390] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-23T21:40:11.999439] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-23T21:40:12.021895] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T21:40:12.029874] [INFO ] [REMOTE ] GKOS: Full fetch complete (60675 records). [2025-10-23T21:40:12.030024] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-23T21:40:12.413627] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-23T21:40:12.413765] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-23T21:40:12.414713] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-23T21:40:12.414790] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-23T21:40:12.416046] [DEBUG] [LOCAL ] GKOS: Trimmed 60675 records to 42738 (keeping 200 days of data) [2025-10-23T21:40:12.661882] [DEBUG] [LOCAL ] GKOS: Primary data saved (42738 records). [2025-10-23T21:40:12.662041] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-23T21:40:12.662163] [INFO ] [MAIN ] Update Progress: 942/2367 symbols completed. GKOS took 43.9s. Estimated remaining: 3h 1m 45s. Rate: 7.8 symbols/min [2025-10-23T21:40:12.805975] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-23T21:40:12.830762] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:12.873386] [DEBUG] [LOCAL ] GMED: Loaded 48094 existing records from primary storage. [2025-10-23T21:40:12.873737] [INFO ] [MAIN ] GMED: Loaded 48094 existing records. [2025-10-23T21:40:13.060627] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:13.060971] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-23T21:40:13.061062] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-23T21:40:13.061378] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-23T21:40:13.061506] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-23T21:40:13.452278] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-23T21:40:13.456690] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:13.599418] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-23T21:40:14.399429] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-23T21:40:14.664090] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-23T21:40:14.741491] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T21:40:15.199427] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-23T21:40:15.609894] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T21:40:15.770076] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T21:40:15.999441] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-23T21:40:16.799485] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-23T21:40:17.552100] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-23T21:40:17.599412] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-23T21:40:17.645329] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T21:40:18.399455] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-23T21:40:18.765751] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T21:40:19.199442] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-23T21:40:19.855874] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-23T21:40:19.999447] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-23T21:40:20.598172] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-23T21:40:20.769746] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T21:40:20.799400] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-23T21:40:21.599449] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-23T21:40:22.399429] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-23T21:40:22.642513] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-23T21:40:22.872206] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T21:40:23.199444] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-23T21:40:23.337036] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T21:40:23.999413] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-23T21:40:24.130482] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T21:40:24.799442] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-23T21:40:25.501758] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-23T21:40:25.599398] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-23T21:40:25.726495] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T21:40:26.399417] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-23T21:40:26.871344] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-23T21:40:27.199438] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-23T21:40:27.862699] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-23T21:40:27.999400] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-23T21:40:28.604792] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-23T21:40:28.799461] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-23T21:40:29.092629] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T21:40:29.599430] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-23T21:40:30.399457] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-23T21:40:30.626237] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-23T21:40:31.184821] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-23T21:40:31.199396] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-23T21:40:31.273002] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T21:40:31.999440] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-23T21:40:32.550201] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T21:40:32.559578] [INFO ] [REMOTE ] GLW: Full fetch complete (77798 records). [2025-10-23T21:40:32.559775] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-23T21:40:32.811800] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-23T21:40:32.994982] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-23T21:40:32.995286] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-23T21:40:32.996732] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-23T21:40:32.996867] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-23T21:40:32.998502] [DEBUG] [LOCAL ] GLW: Trimmed 77798 records to 54025 (keeping 200 days of data) [2025-10-23T21:40:33.256126] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T21:40:33.367458] [DEBUG] [LOCAL ] GLW: Primary data saved (54025 records). [2025-10-23T21:40:33.367616] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-23T21:40:33.367814] [INFO ] [MAIN ] Update Progress: 943/2367 symbols completed. GLW took 29.6s. Estimated remaining: 3h 1m 57s. Rate: 7.8 symbols/min [2025-10-23T21:40:33.533956] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:33.565487] [DEBUG] [LOCAL ] GMRE: Loaded 36438 existing records from primary storage. [2025-10-23T21:40:33.565847] [INFO ] [MAIN ] GMRE: Loaded 36438 existing records. [2025-10-23T21:40:33.607830] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-23T21:40:33.743284] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:33.743505] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-23T21:40:33.743580] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-23T21:40:33.743924] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-23T21:40:33.743999] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-23T21:40:34.091180] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:34.399459] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-23T21:40:34.473727] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-23T21:40:34.809149] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-23T21:40:35.199421] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-23T21:40:35.674939] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T21:40:35.837167] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T21:40:35.999398] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-23T21:40:36.799435] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-23T21:40:37.282886] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T21:40:37.400674] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T21:40:37.599422] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-23T21:40:38.399427] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-23T21:40:38.523666] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T21:40:39.199438] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-23T21:40:39.956346] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-23T21:40:39.965664] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-23T21:40:39.965818] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-23T21:40:40.010429] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-23T21:40:40.362951] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-23T21:40:40.363152] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-23T21:40:40.364301] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-23T21:40:40.364520] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-23T21:40:40.366056] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 54171 (keeping 200 days of data) [2025-10-23T21:40:40.628392] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-23T21:40:40.707168] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-23T21:40:40.712340] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-23T21:40:40.760756] [DEBUG] [LOCAL ] GME: Primary data saved (54171 records). [2025-10-23T21:40:40.810061] [INFO ] [MAIN ] GME: Full history saved. [2025-10-23T21:40:40.831894] [INFO ] [MAIN ] Update Progress: 944/2367 symbols completed. GME took 30.7s. Estimated remaining: 3h 1m 49s. Rate: 7.8 symbols/min [2025-10-23T21:40:41.301925] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:41.338479] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-23T21:40:41.339276] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-23T21:40:41.340751] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-23T21:40:41.341181] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-23T21:40:41.372340] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-23T21:40:41.376683] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54119 (keeping 200 days of data) [2025-10-23T21:40:41.388821] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-23T21:40:41.461009] [DEBUG] [LOCAL ] GNE: Loaded 18074 existing records from primary storage. [2025-10-23T21:40:41.493126] [INFO ] [MAIN ] GNE: Loaded 18074 existing records. [2025-10-23T21:40:41.643756] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T21:40:41.750672] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:41.750932] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-23T21:40:41.753167] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-23T21:40:41.760020] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-23T21:40:41.769431] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-23T21:40:41.769535] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-23T21:40:42.336094] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:42.352359] [DEBUG] [LOCAL ] GM: Primary data saved (54119 records). [2025-10-23T21:40:42.352538] [INFO ] [MAIN ] GM: Full history saved. [2025-10-23T21:40:42.354562] [INFO ] [MAIN ] Update Progress: 945/2367 symbols completed. GM took 35.1s. Estimated remaining: 3h 1m 32s. Rate: 7.8 symbols/min [2025-10-23T21:40:42.417731] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-23T21:40:42.525524] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:42.568574] [DEBUG] [LOCAL ] GNK: Loaded 39524 existing records from primary storage. [2025-10-23T21:40:42.568911] [INFO ] [MAIN ] GNK: Loaded 39524 existing records. [2025-10-23T21:40:42.746494] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:42.746772] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-23T21:40:42.746846] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-23T21:40:42.747094] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-23T21:40:42.747184] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-23T21:40:43.112780] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:43.189952] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T21:40:43.199504] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-23T21:40:43.300196] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T21:40:43.329296] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T21:40:43.999443] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-23T21:40:44.581540] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T21:40:44.595938] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T21:40:44.799484] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-23T21:40:45.599490] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-23T21:40:46.399445] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-23T21:40:46.722870] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T21:40:46.773263] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T21:40:47.199440] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-23T21:40:47.871626] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T21:40:47.999450] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-23T21:40:48.806275] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-23T21:40:48.834279] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T21:40:49.461460] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T21:40:49.599436] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-23T21:40:49.730138] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T21:40:50.399436] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-23T21:40:51.170852] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T21:40:51.199411] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-23T21:40:51.999437] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-23T21:40:52.073611] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:40:52.082811] [INFO ] [REMOTE ] GMED: Full fetch complete (70146 records). [2025-10-23T21:40:52.083168] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-23T21:40:52.477814] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-23T21:40:52.477943] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-23T21:40:52.479070] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-23T21:40:52.479153] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-23T21:40:52.480571] [DEBUG] [LOCAL ] GMED: Trimmed 70146 records to 48462 (keeping 200 days of data) [2025-10-23T21:40:52.761385] [DEBUG] [LOCAL ] GMED: Primary data saved (48462 records). [2025-10-23T21:40:52.761566] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-23T21:40:52.761702] [INFO ] [MAIN ] Update Progress: 946/2367 symbols completed. GMED took 40.1s. Estimated remaining: 3h 1m 28s. Rate: 7.8 symbols/min [2025-10-23T21:40:52.804598] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-23T21:40:52.955126] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T21:40:52.988743] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:40:53.009239] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-23T21:40:53.052443] [DEBUG] [LOCAL ] GNL: Loaded 46512 existing records from primary storage. [2025-10-23T21:40:53.052839] [INFO ] [MAIN ] GNL: Loaded 46512 existing records. [2025-10-23T21:40:53.231778] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:40:53.231981] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-23T21:40:53.232062] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-23T21:40:53.232279] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-23T21:40:53.232351] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-23T21:40:53.587561] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:40:53.599406] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-23T21:40:54.374438] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T21:40:54.399446] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-23T21:40:55.199411] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-23T21:40:55.283517] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:40:55.589264] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T21:40:55.999450] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-23T21:40:56.799467] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-23T21:40:56.826270] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T21:40:57.532604] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T21:40:57.599418] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-23T21:40:58.245781] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T21:40:58.399446] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-23T21:40:59.199444] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-23T21:40:59.343371] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T21:40:59.629935] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T21:40:59.999436] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-23T21:41:00.462811] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T21:41:00.799436] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-23T21:41:01.130821] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T21:41:01.599434] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-23T21:41:02.399414] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-23T21:41:02.570801] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T21:41:02.646804] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T21:41:03.199442] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-23T21:41:03.666519] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T21:41:03.999415] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-23T21:41:04.238211] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T21:41:04.242979] [INFO ] [REMOTE ] GMRE: Full fetch complete (51822 records). [2025-10-23T21:41:04.243097] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-23T21:41:04.624954] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-23T21:41:04.625067] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-23T21:41:04.625898] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-23T21:41:04.625976] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-23T21:41:04.627056] [DEBUG] [LOCAL ] GMRE: Trimmed 51822 records to 36569 (keeping 200 days of data) [2025-10-23T21:41:04.815074] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-23T21:41:04.847761] [DEBUG] [LOCAL ] GMRE: Primary data saved (36569 records). [2025-10-23T21:41:04.847946] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-23T21:41:04.848095] [INFO ] [MAIN ] Update Progress: 947/2367 symbols completed. GMRE took 31.5s. Estimated remaining: 3h 1m 27s. Rate: 7.8 symbols/min [2025-10-23T21:41:04.963853] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T21:41:04.982498] [INFO ] [REMOTE ] GNE: Full fetch complete (22617 records). [2025-10-23T21:41:05.006637] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-23T21:41:05.083417] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:05.443084] [DEBUG] [LOCAL ] GNRC: Loaded 45359 existing records from primary storage. [2025-10-23T21:41:05.443268] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-23T21:41:05.443484] [INFO ] [MAIN ] GNRC: Loaded 45359 existing records. [2025-10-23T21:41:05.443543] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-23T21:41:05.487126] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-23T21:41:05.513519] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-23T21:41:05.546118] [DEBUG] [LOCAL ] GNE: Trimmed 22617 records to 18205 (keeping 200 days of data) [2025-10-23T21:41:05.650355] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-23T21:41:05.679000] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:05.702825] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-23T21:41:05.703993] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-23T21:41:05.704756] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-23T21:41:05.705088] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-23T21:41:06.023543] [DEBUG] [LOCAL ] GNE: Primary data saved (18205 records). [2025-10-23T21:41:06.023772] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-23T21:41:06.029715] [INFO ] [MAIN ] Update Progress: 948/2367 symbols completed. GNE took 25.2s. Estimated remaining: 3h 1m 10s. Rate: 7.8 symbols/min [2025-10-23T21:41:06.202007] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:06.281405] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:06.295117] [DEBUG] [LOCAL ] GNT: Loaded 8632 existing records from primary storage. [2025-10-23T21:41:06.295369] [INFO ] [MAIN ] GNT: Loaded 8632 existing records. [2025-10-23T21:41:06.403211] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-23T21:41:06.495620] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:06.505869] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-23T21:41:06.506127] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-23T21:41:06.506555] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-23T21:41:06.507433] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T21:41:06.507581] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-23T21:41:06.864927] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:07.199430] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-23T21:41:07.257577] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T21:41:07.732254] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T21:41:07.999417] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-23T21:41:08.087396] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:41:08.619102] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T21:41:08.799441] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-23T21:41:09.387511] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T21:41:09.599414] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-23T21:41:10.399433] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-23T21:41:11.059351] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T21:41:11.199449] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-23T21:41:11.999425] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-23T21:41:12.081782] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:41:12.472877] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-23T21:41:12.649391] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T21:41:12.799444] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-23T21:41:13.521582] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T21:41:13.599428] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-23T21:41:14.397677] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T21:41:14.400179] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-23T21:41:15.199432] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-23T21:41:15.969600] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T21:41:15.999429] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-23T21:41:16.799438] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-23T21:41:16.897366] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T21:41:16.925423] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T21:41:17.599466] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-23T21:41:18.399421] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-23T21:41:18.479220] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T21:41:18.947557] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T21:41:19.118248] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:41:19.128327] [INFO ] [REMOTE ] GNK: Full fetch complete (57213 records). [2025-10-23T21:41:19.128583] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-23T21:41:19.204761] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-23T21:41:19.721459] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-23T21:41:19.721623] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-23T21:41:19.723246] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-23T21:41:19.723362] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-23T21:41:19.725092] [DEBUG] [LOCAL ] GNK: Trimmed 57213 records to 39706 (keeping 200 days of data) [2025-10-23T21:41:20.010693] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-23T21:41:20.033433] [DEBUG] [LOCAL ] GNK: Primary data saved (39706 records). [2025-10-23T21:41:20.034235] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-23T21:41:20.034354] [INFO ] [MAIN ] Update Progress: 949/2367 symbols completed. GNK took 37.7s. Estimated remaining: 3h 1m 12s. Rate: 7.8 symbols/min [2025-10-23T21:41:20.206844] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:20.256311] [DEBUG] [LOCAL ] GNW: Loaded 51369 existing records from primary storage. [2025-10-23T21:41:20.256711] [INFO ] [MAIN ] GNW: Loaded 51369 existing records. [2025-10-23T21:41:20.437524] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:20.437737] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-23T21:41:20.437813] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-23T21:41:20.438058] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-23T21:41:20.438134] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-23T21:41:20.802103] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-23T21:41:20.829707] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:20.973285] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:41:21.018994] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T21:41:21.599478] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-23T21:41:22.397266] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T21:41:22.399803] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-23T21:41:22.400004] [INFO ] [REMOTE ] GNT: Full fetch complete (11455 records). [2025-10-23T21:41:22.400115] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-23T21:41:22.776208] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-23T21:41:22.776339] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-23T21:41:22.776703] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-23T21:41:22.776906] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-23T21:41:22.786533] [DEBUG] [LOCAL ] GNT: Trimmed 11455 records to 8683 (keeping 200 days of data) [2025-10-23T21:41:22.824389] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T21:41:22.865077] [DEBUG] [LOCAL ] GNT: Primary data saved (8683 records). [2025-10-23T21:41:22.865235] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-23T21:41:22.865347] [INFO ] [MAIN ] Update Progress: 950/2367 symbols completed. GNT took 16.8s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-10-23T21:41:23.042095] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:23.080477] [DEBUG] [LOCAL ] GOF: Loaded 42713 existing records from primary storage. [2025-10-23T21:41:23.080812] [INFO ] [MAIN ] GOF: Loaded 42713 existing records. [2025-10-23T21:41:23.204561] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-23T21:41:23.264017] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:23.264194] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-23T21:41:23.264268] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-23T21:41:23.264692] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-23T21:41:23.264768] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-23T21:41:23.625109] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:23.999411] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-23T21:41:24.073616] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T21:41:24.799428] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-23T21:41:24.868266] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T21:41:25.599419] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-23T21:41:25.711768] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T21:41:26.329567] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:41:26.399438] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-23T21:41:27.186133] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T21:41:27.194280] [INFO ] [REMOTE ] GNL: Full fetch complete (68074 records). [2025-10-23T21:41:27.194428] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-23T21:41:27.206498] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-23T21:41:27.588154] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-23T21:41:27.588333] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-23T21:41:27.589369] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-23T21:41:27.589469] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-23T21:41:27.590896] [DEBUG] [LOCAL ] GNL: Trimmed 68074 records to 46808 (keeping 200 days of data) [2025-10-23T21:41:27.830068] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T21:41:27.908127] [DEBUG] [LOCAL ] GNL: Primary data saved (46808 records). [2025-10-23T21:41:27.908289] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-23T21:41:27.908400] [INFO ] [MAIN ] Update Progress: 951/2367 symbols completed. GNL took 35.1s. Estimated remaining: 3h 0m 45s. Rate: 7.8 symbols/min [2025-10-23T21:41:28.004874] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-23T21:41:28.075613] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:28.104228] [DEBUG] [LOCAL ] GOLF: Loaded 30311 existing records from primary storage. [2025-10-23T21:41:28.104526] [INFO ] [MAIN ] GOLF: Loaded 30311 existing records. [2025-10-23T21:41:28.279978] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:28.280173] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-23T21:41:28.280245] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-23T21:41:28.280452] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-23T21:41:28.280522] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-23T21:41:28.636604] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:28.663375] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T21:41:28.799399] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-23T21:41:29.594708] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T21:41:29.603071] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-23T21:41:30.102719] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T21:41:30.399490] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-23T21:41:31.199452] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-23T21:41:31.355336] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:41:31.999439] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-23T21:41:32.113941] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T21:41:32.799403] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-23T21:41:32.884883] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T21:41:33.599419] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-23T21:41:33.738995] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T21:41:34.258469] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T21:41:34.399432] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-23T21:41:35.031787] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T21:41:35.167106] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T21:41:35.199399] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-23T21:41:35.999456] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-23T21:41:36.799450] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-23T21:41:36.920173] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T21:41:36.928902] [INFO ] [REMOTE ] GNRC: Full fetch complete (65707 records). [2025-10-23T21:41:36.929090] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-23T21:41:37.312099] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-23T21:41:37.312267] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-23T21:41:37.313226] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-23T21:41:37.313308] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-23T21:41:37.314724] [DEBUG] [LOCAL ] GNRC: Trimmed 65707 records to 45673 (keeping 200 days of data) [2025-10-23T21:41:37.546311] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T21:41:37.605176] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-23T21:41:37.622942] [DEBUG] [LOCAL ] GNRC: Primary data saved (45673 records). [2025-10-23T21:41:37.623040] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-23T21:41:37.623145] [INFO ] [MAIN ] Update Progress: 952/2367 symbols completed. GNRC took 32.8s. Estimated remaining: 3h 0m 41s. Rate: 7.8 symbols/min [2025-10-23T21:41:37.787608] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:37.830036] [DEBUG] [LOCAL ] GOOS: Loaded 44038 existing records from primary storage. [2025-10-23T21:41:37.830371] [INFO ] [MAIN ] GOOS: Loaded 44038 existing records. [2025-10-23T21:41:38.018182] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:38.018395] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-23T21:41:38.018469] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-23T21:41:38.018773] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-23T21:41:38.018847] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-23T21:41:38.383528] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:38.399398] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-23T21:41:38.636206] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T21:41:39.159894] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T21:41:39.199390] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-23T21:41:39.939585] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T21:41:39.999392] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-23T21:41:40.567950] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T21:41:40.799445] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-23T21:41:41.599429] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-23T21:41:41.736975] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T21:41:42.214850] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T21:41:42.399428] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-23T21:41:42.854864] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T21:41:43.199437] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-23T21:41:43.999423] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-23T21:41:44.077182] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T21:41:44.495902] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T21:41:44.799436] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-23T21:41:45.599417] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-23T21:41:45.822268] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T21:41:46.366935] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T21:41:46.399404] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-23T21:41:47.199416] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-23T21:41:47.300844] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T21:41:47.957689] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T21:41:47.999409] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-23T21:41:48.361322] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T21:41:48.799457] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-23T21:41:49.319476] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T21:41:49.599446] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-23T21:41:50.362926] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T21:41:50.399420] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-23T21:41:50.957282] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T21:41:51.199446] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-23T21:41:51.999417] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-23T21:41:52.189879] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T21:41:52.747124] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:41:52.799407] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-23T21:41:53.599426] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-23T21:41:53.714089] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T21:41:54.399420] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-23T21:41:54.593439] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T21:41:54.839049] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T21:41:55.199473] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-23T21:41:55.850711] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T21:41:55.999443] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-23T21:41:56.799511] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-23T21:41:56.951962] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:41:57.599457] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-23T21:41:57.722438] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T21:41:58.399418] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-23T21:41:58.462674] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T21:41:58.471679] [INFO ] [REMOTE ] GNW: Full fetch complete (73913 records). [2025-10-23T21:41:58.471823] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-23T21:41:58.857604] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-23T21:41:58.857741] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-23T21:41:58.858976] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-23T21:41:58.859057] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-23T21:41:58.860550] [DEBUG] [LOCAL ] GNW: Trimmed 73913 records to 51738 (keeping 200 days of data) [2025-10-23T21:41:58.988337] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T21:41:59.186220] [DEBUG] [LOCAL ] GNW: Primary data saved (51738 records). [2025-10-23T21:41:59.186387] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-23T21:41:59.187834] [INFO ] [MAIN ] Update Progress: 953/2367 symbols completed. GNW took 39.2s. Estimated remaining: 3h 0m 54s. Rate: 7.8 symbols/min [2025-10-23T21:41:59.209033] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-23T21:41:59.371695] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:41:59.407301] [DEBUG] [LOCAL ] GOTU: Loaded 36876 existing records from primary storage. [2025-10-23T21:41:59.407692] [INFO ] [MAIN ] GOTU: Loaded 36876 existing records. [2025-10-23T21:41:59.580198] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:41:59.580410] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-23T21:41:59.580483] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-23T21:41:59.580733] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-23T21:41:59.580806] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-23T21:41:59.933686] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:41:59.957193] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T21:41:59.965356] [INFO ] [REMOTE ] GOF: Full fetch complete (62706 records). [2025-10-23T21:41:59.965499] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-23T21:42:00.007947] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-23T21:42:00.360080] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-23T21:42:00.360204] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-23T21:42:00.361214] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-23T21:42:00.361313] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-23T21:42:00.362621] [DEBUG] [LOCAL ] GOF: Trimmed 62706 records to 43072 (keeping 200 days of data) [2025-10-23T21:42:00.629612] [DEBUG] [LOCAL ] GOF: Primary data saved (43072 records). [2025-10-23T21:42:00.629782] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-23T21:42:00.629913] [INFO ] [MAIN ] Update Progress: 954/2367 symbols completed. GOF took 37.8s. Estimated remaining: 3h 0m 37s. Rate: 7.8 symbols/min [2025-10-23T21:42:00.748405] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T21:42:00.763277] [INFO ] [REMOTE ] GOOS: Full fetch complete (64639 records). [2025-10-23T21:42:00.773744] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-23T21:42:00.842635] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-23T21:42:00.921696] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:01.258256] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-23T21:42:01.271945] [DEBUG] [LOCAL ] GPC: Loaded 45916 existing records from primary storage. [2025-10-23T21:42:01.271236] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-23T21:42:01.273334] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-23T21:42:01.273488] [INFO ] [MAIN ] GPC: Loaded 45916 existing records. [2025-10-23T21:42:01.273724] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-23T21:42:01.367473] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-23T21:42:01.409783] [INFO ] [REMOTE ] GOLF: Full fetch complete (45273 records). [2025-10-23T21:42:01.394109] [DEBUG] [LOCAL ] GOOS: Trimmed 64639 records to 44323 (keeping 200 days of data) [2025-10-23T21:42:01.415148] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-23T21:42:01.519905] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:01.587902] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-23T21:42:01.616554] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-23T21:42:01.643830] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-23T21:42:01.665782] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-23T21:42:02.520349] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-23T21:42:02.531098] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-23T21:42:02.530584] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:02.535143] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-23T21:42:02.538417] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-23T21:42:02.541301] [DEBUG] [LOCAL ] GOOS: Primary data saved (44323 records). [2025-10-23T21:42:02.541710] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-23T21:42:02.541508] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-23T21:42:02.542838] [INFO ] [MAIN ] Update Progress: 955/2367 symbols completed. GOOS took 24.9s. Estimated remaining: 3h 0m 20s. Rate: 7.8 symbols/min [2025-10-23T21:42:02.613468] [DEBUG] [LOCAL ] GOLF: Trimmed 45273 records to 30411 (keeping 200 days of data) [2025-10-23T21:42:02.825687] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:02.872461] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T21:42:02.891738] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-23T21:42:02.906130] [DEBUG] [LOCAL ] GPI: Loaded 14678 existing records from primary storage. [2025-10-23T21:42:02.916825] [INFO ] [MAIN ] GPI: Loaded 14678 existing records. [2025-10-23T21:42:03.139223] [DEBUG] [LOCAL ] GOLF: Primary data saved (30411 records). [2025-10-23T21:42:03.144670] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-23T21:42:03.154806] [INFO ] [MAIN ] Update Progress: 956/2367 symbols completed. GOLF took 35.2s. Estimated remaining: 3h 0m 2s. Rate: 7.8 symbols/min [2025-10-23T21:42:03.192627] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:03.252870] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-23T21:42:03.269323] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-23T21:42:03.290559] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-23T21:42:03.311522] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-23T21:42:03.457707] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:03.519637] [DEBUG] [LOCAL ] GPJA: Loaded 4108 existing records from primary storage. [2025-10-23T21:42:03.569566] [INFO ] [MAIN ] GPJA: Loaded 4108 existing records. [2025-10-23T21:42:03.903709] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:03.925771] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:03.926128] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-23T21:42:03.926335] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-23T21:42:03.927472] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-23T21:42:03.927737] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-23T21:42:03.927834] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-23T21:42:04.291073] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:04.291452] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-23T21:42:04.483925] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T21:42:04.613502] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:42:04.769075] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T21:42:04.799423] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-23T21:42:04.835998] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-23T21:42:05.599465] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-23T21:42:06.100929] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-23T21:42:06.399447] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-23T21:42:06.457928] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:42:06.868547] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T21:42:07.199444] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-23T21:42:07.999447] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-23T21:42:08.799418] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-23T21:42:08.939289] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T21:42:08.998139] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:42:09.599455] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-23T21:42:10.399463] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-23T21:42:10.638879] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T21:42:10.981892] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T21:42:11.129309] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T21:42:11.199435] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-23T21:42:11.999500] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-23T21:42:12.351468] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T21:42:12.799471] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-23T21:42:13.599418] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-23T21:42:13.651010] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T21:42:14.282211] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T21:42:14.399413] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-23T21:42:14.708178] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T21:42:14.910404] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-23T21:42:15.199418] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-23T21:42:15.999493] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-23T21:42:16.638238] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T21:42:16.702327] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T21:42:16.799433] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-23T21:42:17.599427] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-23T21:42:17.670461] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-23T21:42:18.399435] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-23T21:42:19.069838] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T21:42:19.089555] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T21:42:19.199444] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-23T21:42:19.999441] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-23T21:42:20.286214] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T21:42:20.799474] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-23T21:42:21.234603] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T21:42:21.401437] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T21:42:21.599423] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-23T21:42:22.399432] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-23T21:42:23.199460] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-23T21:42:23.371392] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T21:42:23.778219] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T21:42:23.887386] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T21:42:23.999414] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-23T21:42:24.799436] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-23T21:42:25.353276] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T21:42:25.359278] [INFO ] [REMOTE ] GOTU: Full fetch complete (58120 records). [2025-10-23T21:42:25.359422] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-23T21:42:25.469466] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T21:42:25.604632] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-23T21:42:25.756319] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-23T21:42:25.756429] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-23T21:42:25.757331] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-23T21:42:25.757410] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-23T21:42:25.758612] [DEBUG] [LOCAL ] GOTU: Trimmed 58120 records to 37025 (keeping 200 days of data) [2025-10-23T21:42:25.958121] [DEBUG] [LOCAL ] GOTU: Primary data saved (37025 records). [2025-10-23T21:42:25.958275] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-23T21:42:25.958382] [INFO ] [MAIN ] Update Progress: 957/2367 symbols completed. GOTU took 26.8s. Estimated remaining: 3h 0m 17s. Rate: 7.8 symbols/min [2025-10-23T21:42:26.399473] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-23T21:42:26.958367] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T21:42:26.959618] [INFO ] [REMOTE ] GPJA: Full fetch complete (6817 records). [2025-10-23T21:42:26.959740] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-23T21:42:27.208636] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-23T21:42:27.329196] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-23T21:42:27.329368] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-23T21:42:27.329689] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-23T21:42:27.329769] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-23T21:42:27.330273] [DEBUG] [LOCAL ] GPJA: Trimmed 6817 records to 4128 (keeping 200 days of data) [2025-10-23T21:42:27.377885] [DEBUG] [LOCAL ] GPJA: Primary data saved (4128 records). [2025-10-23T21:42:27.378068] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-23T21:42:27.378278] [INFO ] [MAIN ] Update Progress: 958/2367 symbols completed. GPJA took 24.2s. Estimated remaining: 3h 0m 0s. Rate: 7.8 symbols/min [2025-10-23T21:42:27.380123] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T21:42:27.999418] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-23T21:42:28.193196] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T21:42:28.799575] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-23T21:42:29.553691] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T21:42:29.594183] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:42:29.599396] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-23T21:42:30.399417] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-23T21:42:30.691423] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T21:42:30.695077] [INFO ] [REMOTE ] GPI: Full fetch complete (21926 records). [2025-10-23T21:42:30.695186] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-23T21:42:31.081237] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-23T21:42:31.081354] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-23T21:42:31.081859] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-23T21:42:31.081937] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-23T21:42:31.082549] [DEBUG] [LOCAL ] GPI: Trimmed 21926 records to 14863 (keeping 200 days of data) [2025-10-23T21:42:31.172384] [DEBUG] [LOCAL ] GPI: Primary data saved (14863 records). [2025-10-23T21:42:31.172542] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-23T21:42:31.172689] [INFO ] [MAIN ] Update Progress: 959/2367 symbols completed. GPI took 28.6s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-10-23T21:42:31.960137] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T21:42:31.969518] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-23T21:42:33.561407] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T21:42:33.571074] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-23T21:42:35.089390] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:42:35.098110] [INFO ] [REMOTE ] GPC: Full fetch complete (68666 records). [2025-10-23T21:42:35.098338] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-23T21:42:35.504793] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-23T21:42:35.505030] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-23T21:42:35.506762] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-23T21:42:35.506853] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-23T21:42:35.508829] [DEBUG] [LOCAL ] GPC: Trimmed 68666 records to 46263 (keeping 200 days of data) [2025-10-23T21:42:35.821566] [DEBUG] [LOCAL ] GPC: Primary data saved (46263 records). [2025-10-23T21:42:35.821818] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-23T21:42:35.821960] [INFO ] [MAIN ] Update Progress: 960/2367 symbols completed. GPC took 35.2s. Estimated remaining: 2h 59m 35s. Rate: 7.8 symbols/min [2025-10-23T21:42:36.480341] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:36.602188] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:36.644251] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:36.650133] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:36.689638] [DEBUG] [LOCAL ] GPOR: Loaded 23317 existing records from primary storage. [2025-10-23T21:42:36.728723] [INFO ] [MAIN ] GPOR: Loaded 23317 existing records. [2025-10-23T21:42:36.761107] [DEBUG] [LOCAL ] GPMT: Loaded 25950 existing records from primary storage. [2025-10-23T21:42:36.839902] [INFO ] [MAIN ] GPMT: Loaded 25950 existing records. [2025-10-23T21:42:36.897127] [DEBUG] [LOCAL ] GPK: Loaded 52780 existing records from primary storage. [2025-10-23T21:42:36.872460] [DEBUG] [LOCAL ] GPN: Loaded 51867 existing records from primary storage. [2025-10-23T21:42:36.969807] [INFO ] [MAIN ] GPK: Loaded 52780 existing records. [2025-10-23T21:42:36.980998] [INFO ] [MAIN ] GPN: Loaded 51867 existing records. [2025-10-23T21:42:37.329635] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:37.391415] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-23T21:42:37.420934] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-23T21:42:37.409245] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:37.489301] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-23T21:42:37.469207] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-23T21:42:37.531730] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-23T21:42:37.522589] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-23T21:42:37.620259] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:37.592119] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:37.644315] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-23T21:42:37.649975] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-23T21:42:37.663819] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-23T21:42:37.663970] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-23T21:42:37.664234] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-23T21:42:37.705900] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-23T21:42:37.717028] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-23T21:42:37.722344] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-23T21:42:37.818244] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-23T21:42:37.845351] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-23T21:42:38.977638] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:39.015047] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-23T21:42:39.111979] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:39.212879] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:39.213414] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-23T21:42:39.236403] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:39.238177] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-23T21:42:39.238711] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-23T21:42:40.369942] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T21:42:40.377898] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-23T21:42:40.515957] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T21:42:40.522495] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-23T21:42:40.919114] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:42:40.930011] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-23T21:42:40.996585] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T21:42:41.006716] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-23T21:42:41.068997] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T21:42:41.076904] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-23T21:42:41.675795] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T21:42:41.681148] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-23T21:42:42.144211] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T21:42:42.150204] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-23T21:42:42.320170] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T21:42:42.329883] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-23T21:42:42.730577] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:42:42.742015] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-23T21:42:42.834030] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T21:42:43.199420] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-23T21:42:43.535756] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T21:42:43.889107] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T21:42:43.999403] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-23T21:42:44.315926] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-23T21:42:44.539120] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:42:44.799404] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-23T21:42:44.890212] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T21:42:45.599442] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-23T21:42:45.818808] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T21:42:46.399444] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-23T21:42:47.105554] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T21:42:47.199418] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-23T21:42:47.524363] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T21:42:47.999416] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-23T21:42:48.280516] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T21:42:48.799407] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-23T21:42:49.147185] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:42:49.599498] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-23T21:42:50.078202] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T21:42:50.399440] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-23T21:42:50.775912] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T21:42:51.199435] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-23T21:42:51.367339] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T21:42:51.999444] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-23T21:42:52.451253] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T21:42:52.799488] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-23T21:42:53.599420] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-23T21:42:53.861463] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T21:42:54.004176] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T21:42:54.008947] [INFO ] [REMOTE ] GPOR: Full fetch complete (34921 records). [2025-10-23T21:42:54.009042] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-23T21:42:54.370983] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-23T21:42:54.371089] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-23T21:42:54.371787] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-23T21:42:54.371864] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-23T21:42:54.372749] [DEBUG] [LOCAL ] GPOR: Trimmed 34921 records to 23577 (keeping 200 days of data) [2025-10-23T21:42:54.421469] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-23T21:42:54.512767] [DEBUG] [LOCAL ] GPOR: Primary data saved (23577 records). [2025-10-23T21:42:54.512929] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-23T21:42:54.513043] [INFO ] [MAIN ] Update Progress: 961/2367 symbols completed. GPOR took 18.7s. Estimated remaining: 2h 59m 43s. Rate: 7.8 symbols/min [2025-10-23T21:42:54.680843] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:54.716244] [DEBUG] [LOCAL ] GPRK: Loaded 39851 existing records from primary storage. [2025-10-23T21:42:54.716624] [INFO ] [MAIN ] GPRK: Loaded 39851 existing records. [2025-10-23T21:42:54.890058] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:54.890269] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-23T21:42:54.890342] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-23T21:42:54.890689] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-23T21:42:54.890763] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-23T21:42:55.203952] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-23T21:42:55.245151] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:55.417913] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T21:42:55.511720] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T21:42:55.515470] [INFO ] [REMOTE ] GPMT: Full fetch complete (36288 records). [2025-10-23T21:42:55.515577] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-23T21:42:55.888882] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-23T21:42:55.888997] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-23T21:42:55.889706] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-23T21:42:55.889782] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-23T21:42:55.890587] [DEBUG] [LOCAL ] GPMT: Trimmed 36288 records to 26058 (keeping 200 days of data) [2025-10-23T21:42:56.000326] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-23T21:42:56.040114] [DEBUG] [LOCAL ] GPMT: Primary data saved (26058 records). [2025-10-23T21:42:56.040299] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-23T21:42:56.040416] [INFO ] [MAIN ] Update Progress: 962/2367 symbols completed. GPMT took 20.1s. Estimated remaining: 2h 59m 27s. Rate: 7.8 symbols/min [2025-10-23T21:42:56.208526] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:42:56.233615] [DEBUG] [LOCAL ] GRBK: Loaded 26691 existing records from primary storage. [2025-10-23T21:42:56.233910] [INFO ] [MAIN ] GRBK: Loaded 26691 existing records. [2025-10-23T21:42:56.409935] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:42:56.410152] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-23T21:42:56.410228] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-23T21:42:56.410434] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-23T21:42:56.410507] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-23T21:42:56.766805] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:42:56.799417] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-23T21:42:57.147466] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T21:42:57.537927] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T21:42:57.599443] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-23T21:42:58.399423] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-23T21:42:58.616945] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T21:42:58.971953] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T21:42:59.199451] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-23T21:42:59.709006] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-23T21:42:59.999434] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-23T21:43:00.799428] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-23T21:43:00.907515] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T21:43:01.370556] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T21:43:01.599461] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-23T21:43:02.399416] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-23T21:43:02.624902] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T21:43:02.786129] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T21:43:03.199450] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-23T21:43:03.908665] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T21:43:03.999452] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-23T21:43:04.800920] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T21:43:04.801007] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-23T21:43:05.599423] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-23T21:43:05.943446] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-23T21:43:06.073508] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T21:43:06.399496] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-23T21:43:06.839213] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T21:43:07.199445] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-23T21:43:07.999501] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-23T21:43:08.044959] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T21:43:08.799456] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-23T21:43:09.033891] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T21:43:09.116146] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T21:43:09.599439] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-23T21:43:10.334664] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T21:43:10.399402] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-23T21:43:10.594816] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:43:11.199495] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-23T21:43:11.999435] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-23T21:43:12.148473] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T21:43:12.157383] [INFO ] [REMOTE ] GPN: Full fetch complete (75023 records). [2025-10-23T21:43:12.157542] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-23T21:43:12.560493] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-23T21:43:12.560755] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-23T21:43:12.562423] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-23T21:43:12.562669] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-23T21:43:12.564391] [DEBUG] [LOCAL ] GPN: Trimmed 75023 records to 52198 (keeping 200 days of data) [2025-10-23T21:43:12.682143] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T21:43:12.806208] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-23T21:43:12.917324] [DEBUG] [LOCAL ] GPN: Primary data saved (52198 records). [2025-10-23T21:43:12.917524] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-23T21:43:12.917687] [INFO ] [MAIN ] Update Progress: 963/2367 symbols completed. GPN took 37.1s. Estimated remaining: 2h 59m 32s. Rate: 7.8 symbols/min [2025-10-23T21:43:13.090210] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:13.101549] [DEBUG] [LOCAL ] GRC: Loaded 9268 existing records from primary storage. [2025-10-23T21:43:13.101841] [INFO ] [MAIN ] GRC: Loaded 9268 existing records. [2025-10-23T21:43:13.285813] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:13.286100] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-23T21:43:13.286292] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-23T21:43:13.286497] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-23T21:43:13.286672] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-23T21:43:13.389495] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T21:43:13.604585] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-23T21:43:13.671903] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:14.254360] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T21:43:14.263736] [INFO ] [REMOTE ] GPK: Full fetch complete (76091 records). [2025-10-23T21:43:14.263968] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-23T21:43:14.408248] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-23T21:43:14.675737] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-23T21:43:14.675897] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-23T21:43:14.676934] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-23T21:43:14.677014] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-23T21:43:14.678463] [DEBUG] [LOCAL ] GPK: Trimmed 76091 records to 53166 (keeping 200 days of data) [2025-10-23T21:43:14.936445] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T21:43:15.026418] [DEBUG] [LOCAL ] GPK: Primary data saved (53166 records). [2025-10-23T21:43:15.026624] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-23T21:43:15.028530] [INFO ] [MAIN ] Update Progress: 964/2367 symbols completed. GPK took 39.2s. Estimated remaining: 2h 59m 17s. Rate: 7.8 symbols/min [2025-10-23T21:43:15.177437] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T21:43:15.206075] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-23T21:43:15.213777] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:15.238264] [DEBUG] [LOCAL ] GRDN: Loaded 21258 existing records from primary storage. [2025-10-23T21:43:15.238588] [INFO ] [MAIN ] GRDN: Loaded 21258 existing records. [2025-10-23T21:43:15.420331] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:15.420601] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-23T21:43:15.420706] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-23T21:43:15.420935] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-23T21:43:15.421010] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-23T21:43:15.766701] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:15.999462] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-23T21:43:16.800023] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-23T21:43:16.803541] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T21:43:17.120313] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T21:43:17.599432] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-23T21:43:17.649841] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T21:43:18.399403] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-23T21:43:18.871880] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T21:43:19.199423] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-23T21:43:19.242004] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T21:43:19.999430] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-23T21:43:20.008870] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T21:43:20.799438] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-23T21:43:21.514480] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T21:43:21.599440] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-23T21:43:21.628262] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T21:43:22.399430] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-23T21:43:22.454470] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-23T21:43:23.199443] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-23T21:43:23.634444] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T21:43:23.692101] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-23T21:43:23.999474] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-23T21:43:24.639803] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-23T21:43:24.799480] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-23T21:43:25.585407] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T21:43:25.599386] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-23T21:43:26.399462] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-23T21:43:26.453276] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-23T21:43:27.199487] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-23T21:43:27.453066] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T21:43:27.999433] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-23T21:43:28.103705] [DEBUG] [REMOTE ] GRDN: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-23T21:43:28.104030] [WARN ] [REMOTE ] GRDN: No data returned for month 2025-03 [2025-10-23T21:43:28.104126] [FATAL] [REMOTE ] GRDN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:43:28.104261] [FATAL] [MAIN ] GRDN: Failed to fetch primary data. [2025-10-23T21:43:28.104353] [WARN ] [MAIN ] GRDN: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:43:28.104449] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-23T21:43:28.104566] [DEBUG] [LOCAL ] GRDN: No primary data file found to delete. [2025-10-23T21:43:28.104691] [INFO ] [LOCAL ] GRDN: Starting deletion of derivative data. [2025-10-23T21:43:28.104921] [DEBUG] [LOCAL ] GRDN: Deleted derivative data file. [2025-10-23T21:43:28.105044] [INFO ] [MAIN ] Update Progress: 965/2367 symbols completed. GRDN took 13.1s. Estimated remaining: 2h 59m 17s. Rate: 7.8 symbols/min [2025-10-23T21:43:28.273078] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:28.312086] [DEBUG] [LOCAL ] GRMN: Loaded 39812 existing records from primary storage. [2025-10-23T21:43:28.312393] [INFO ] [MAIN ] GRMN: Loaded 39812 existing records. [2025-10-23T21:43:28.487474] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:28.487691] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-23T21:43:28.487766] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-23T21:43:28.488045] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-23T21:43:28.488118] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-23T21:43:28.810276] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-23T21:43:28.856315] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:28.876370] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T21:43:28.884673] [INFO ] [REMOTE ] GPRK: Full fetch complete (58486 records). [2025-10-23T21:43:28.884835] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-23T21:43:29.287812] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-23T21:43:29.287986] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-23T21:43:29.288866] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-23T21:43:29.289135] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-23T21:43:29.290356] [DEBUG] [LOCAL ] GPRK: Trimmed 58486 records to 40214 (keeping 200 days of data) [2025-10-23T21:43:29.504239] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T21:43:29.538880] [DEBUG] [LOCAL ] GPRK: Primary data saved (40214 records). [2025-10-23T21:43:29.539024] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-23T21:43:29.539130] [INFO ] [MAIN ] Update Progress: 966/2367 symbols completed. GPRK took 35.0s. Estimated remaining: 2h 59m 0s. Rate: 7.8 symbols/min [2025-10-23T21:43:29.608590] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-23T21:43:29.734085] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:29.778211] [DEBUG] [LOCAL ] GRND: Loaded 50191 existing records from primary storage. [2025-10-23T21:43:29.778580] [INFO ] [MAIN ] GRND: Loaded 50191 existing records. [2025-10-23T21:43:29.958177] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:29.958407] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-23T21:43:29.958482] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-23T21:43:29.958741] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-23T21:43:29.958814] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-23T21:43:30.311091] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:30.399443] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-23T21:43:31.202085] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-23T21:43:31.203440] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T21:43:31.208252] [INFO ] [REMOTE ] GRC: Full fetch complete (13479 records). [2025-10-23T21:43:31.208463] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-23T21:43:31.435500] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T21:43:31.629896] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-23T21:43:31.630013] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-23T21:43:31.630410] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-23T21:43:31.630486] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-23T21:43:31.631029] [DEBUG] [LOCAL ] GRC: Trimmed 13479 records to 9356 (keeping 200 days of data) [2025-10-23T21:43:31.685162] [DEBUG] [LOCAL ] GRC: Primary data saved (9356 records). [2025-10-23T21:43:31.685310] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-23T21:43:31.685429] [INFO ] [MAIN ] Update Progress: 967/2367 symbols completed. GRC took 18.8s. Estimated remaining: 2h 58m 44s. Rate: 7.8 symbols/min [2025-10-23T21:43:31.862685] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:31.893988] [DEBUG] [LOCAL ] GRNT: Loaded 33953 existing records from primary storage. [2025-10-23T21:43:31.894286] [INFO ] [MAIN ] GRNT: Loaded 33953 existing records. [2025-10-23T21:43:32.004697] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-23T21:43:32.077225] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:32.077458] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-23T21:43:32.077666] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-23T21:43:32.077936] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-23T21:43:32.078062] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-23T21:43:32.249011] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T21:43:32.290253] [INFO ] [REMOTE ] GRBK: Full fetch complete (39896 records). [2025-10-23T21:43:32.351447] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-23T21:43:32.626355] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:32.804757] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-23T21:43:32.865003] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-23T21:43:32.865156] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-23T21:43:32.866571] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-23T21:43:32.866690] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-23T21:43:32.868162] [DEBUG] [LOCAL ] GRBK: Trimmed 39896 records to 26788 (keeping 200 days of data) [2025-10-23T21:43:33.027289] [DEBUG] [LOCAL ] GRBK: Primary data saved (26788 records). [2025-10-23T21:43:33.027483] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-23T21:43:33.027626] [INFO ] [MAIN ] Update Progress: 968/2367 symbols completed. GRBK took 37.0s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-10-23T21:43:33.202324] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:33.211773] [DEBUG] [LOCAL ] GROV: Loaded 8616 existing records from primary storage. [2025-10-23T21:43:33.212058] [INFO ] [MAIN ] GROV: Loaded 8616 existing records. [2025-10-23T21:43:33.395999] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:33.396258] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-23T21:43:33.396347] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-23T21:43:33.396598] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-23T21:43:33.396719] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-23T21:43:33.605140] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-23T21:43:33.758478] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:33.783128] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T21:43:33.808204] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T21:43:34.399443] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-23T21:43:35.199416] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-23T21:43:35.307042] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:43:35.999417] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-23T21:43:36.085312] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T21:43:36.133730] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T21:43:36.799429] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-23T21:43:37.189537] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T21:43:37.599440] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-23T21:43:38.366706] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T21:43:38.399385] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-23T21:43:38.590877] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T21:43:39.199433] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-23T21:43:39.935005] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T21:43:39.999401] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-23T21:43:40.630150] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T21:43:40.802228] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-23T21:43:40.803398] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T21:43:41.599426] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-23T21:43:42.255202] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-23T21:43:42.295844] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T21:43:42.399412] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-23T21:43:43.199430] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-23T21:43:43.999425] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-23T21:43:44.232084] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T21:43:44.448876] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T21:43:44.513045] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-23T21:43:44.799447] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-23T21:43:45.534805] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T21:43:45.599405] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-23T21:43:46.399453] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-23T21:43:46.503596] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T21:43:47.199488] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-23T21:43:47.999572] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-23T21:43:47.999496] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T21:43:48.563198] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T21:43:48.799457] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-23T21:43:49.367501] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T21:43:49.599440] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-23T21:43:49.753516] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:43:50.050792] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T21:43:50.399463] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-23T21:43:51.199455] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-23T21:43:51.625510] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T21:43:51.847431] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T21:43:51.849423] [INFO ] [REMOTE ] GROV: Full fetch complete (13599 records). [2025-10-23T21:43:51.849528] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-23T21:43:52.001842] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-23T21:43:52.212595] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-23T21:43:52.212716] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-23T21:43:52.213050] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-23T21:43:52.213123] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-23T21:43:52.213620] [DEBUG] [LOCAL ] GROV: Trimmed 13599 records to 8639 (keeping 200 days of data) [2025-10-23T21:43:52.259527] [DEBUG] [LOCAL ] GROV: Primary data saved (8639 records). [2025-10-23T21:43:52.259681] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-23T21:43:52.259793] [INFO ] [MAIN ] Update Progress: 969/2367 symbols completed. GROV took 19.2s. Estimated remaining: 2h 58m 37s. Rate: 7.8 symbols/min [2025-10-23T21:43:52.428920] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:43:52.434924] [DEBUG] [LOCAL ] GRX: Loaded 4839 existing records from primary storage. [2025-10-23T21:43:52.435142] [INFO ] [MAIN ] GRX: Loaded 4839 existing records. [2025-10-23T21:43:52.608065] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:43:52.608320] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-23T21:43:52.608394] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-23T21:43:52.608569] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-23T21:43:52.608682] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-23T21:43:52.810989] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-23T21:43:52.957892] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:43:53.596916] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T21:43:53.604765] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-23T21:43:54.195291] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T21:43:54.399414] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-23T21:43:54.736421] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T21:43:54.841353] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T21:43:55.199460] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-23T21:43:55.999443] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-23T21:43:56.799459] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-23T21:43:56.844063] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T21:43:57.356833] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-23T21:43:57.411152] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T21:43:57.599447] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-23T21:43:58.399446] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-23T21:43:58.978894] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T21:43:59.199422] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-23T21:43:59.999426] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-23T21:44:00.138084] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T21:44:00.799444] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-23T21:44:00.939847] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T21:44:01.175911] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-23T21:44:01.413104] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T21:44:01.419938] [INFO ] [REMOTE ] GRNT: Full fetch complete (48383 records). [2025-10-23T21:44:01.420075] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-23T21:44:01.624759] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-23T21:44:01.845780] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-23T21:44:01.845909] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-23T21:44:01.846846] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-23T21:44:01.846929] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-23T21:44:01.848239] [DEBUG] [LOCAL ] GRNT: Trimmed 48383 records to 34218 (keeping 200 days of data) [2025-10-23T21:44:02.060158] [DEBUG] [LOCAL ] GRNT: Primary data saved (34218 records). [2025-10-23T21:44:02.060424] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-23T21:44:02.060612] [INFO ] [MAIN ] Update Progress: 970/2367 symbols completed. GRNT took 30.4s. Estimated remaining: 2h 58m 32s. Rate: 7.8 symbols/min [2025-10-23T21:44:02.256157] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:02.307298] [DEBUG] [LOCAL ] GS: Loaded 51777 existing records from primary storage. [2025-10-23T21:44:02.307639] [INFO ] [MAIN ] GS: Loaded 51777 existing records. [2025-10-23T21:44:02.404695] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-23T21:44:02.507890] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:02.508149] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-23T21:44:02.508281] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-23T21:44:02.508679] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-23T21:44:02.508754] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-23T21:44:02.871968] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:03.199416] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-23T21:44:03.534547] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T21:44:03.999427] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-23T21:44:04.124169] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T21:44:04.583313] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T21:44:04.799509] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-23T21:44:05.387917] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T21:44:05.599422] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-23T21:44:06.320349] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:44:06.326858] [INFO ] [REMOTE ] GRMN: Full fetch complete (59436 records). [2025-10-23T21:44:06.327008] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-23T21:44:06.404561] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-23T21:44:06.716204] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-23T21:44:06.716315] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-23T21:44:06.717199] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-23T21:44:06.717276] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-23T21:44:06.718517] [DEBUG] [LOCAL ] GRMN: Trimmed 59436 records to 40017 (keeping 200 days of data) [2025-10-23T21:44:06.966499] [DEBUG] [LOCAL ] GRMN: Primary data saved (40017 records). [2025-10-23T21:44:06.966612] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-23T21:44:06.968382] [INFO ] [MAIN ] Update Progress: 971/2367 symbols completed. GRMN took 38.9s. Estimated remaining: 2h 58m 20s. Rate: 7.8 symbols/min [2025-10-23T21:44:07.052354] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T21:44:07.146602] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:07.186190] [DEBUG] [LOCAL ] GSBD: Loaded 39527 existing records from primary storage. [2025-10-23T21:44:07.186500] [INFO ] [MAIN ] GSBD: Loaded 39527 existing records. [2025-10-23T21:44:07.206964] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-23T21:44:07.368985] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:07.369287] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-23T21:44:07.369417] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-23T21:44:07.369698] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-23T21:44:07.369773] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-23T21:44:07.739863] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:07.768882] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-23T21:44:07.999430] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-23T21:44:08.799418] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-23T21:44:09.050339] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T21:44:09.387436] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T21:44:09.599410] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-23T21:44:09.680895] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:44:10.399444] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-23T21:44:11.199482] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-23T21:44:11.854349] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T21:44:11.901790] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-23T21:44:11.932898] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-23T21:44:11.999402] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-23T21:44:12.799435] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-23T21:44:13.599446] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-23T21:44:14.352923] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T21:44:14.404511] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-23T21:44:14.426010] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-23T21:44:15.199446] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-23T21:44:15.350508] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T21:44:15.999411] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-23T21:44:16.047400] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T21:44:16.084037] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T21:44:16.799444] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-23T21:44:17.599424] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-23T21:44:17.804767] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T21:44:17.813838] [INFO ] [REMOTE ] GRND: Full fetch complete (71853 records). [2025-10-23T21:44:17.813975] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-23T21:44:18.195495] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-23T21:44:18.195625] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-23T21:44:18.196587] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-23T21:44:18.196693] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-23T21:44:18.198108] [DEBUG] [LOCAL ] GRND: Trimmed 71853 records to 50545 (keeping 200 days of data) [2025-10-23T21:44:18.419240] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-23T21:44:18.427011] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:44:18.514056] [DEBUG] [LOCAL ] GRND: Primary data saved (50545 records). [2025-10-23T21:44:18.514223] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-23T21:44:18.514347] [INFO ] [MAIN ] Update Progress: 972/2367 symbols completed. GRND took 49.0s. Estimated remaining: 2h 58m 18s. Rate: 7.8 symbols/min [2025-10-23T21:44:18.680166] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:18.728038] [DEBUG] [LOCAL ] GSK: Loaded 53511 existing records from primary storage. [2025-10-23T21:44:18.728396] [INFO ] [MAIN ] GSK: Loaded 53511 existing records. [2025-10-23T21:44:18.902845] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:18.903041] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-23T21:44:18.903122] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-23T21:44:18.903312] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-23T21:44:18.903379] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-23T21:44:19.186582] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T21:44:19.208939] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-23T21:44:19.209058] [INFO ] [REMOTE ] GRX: Full fetch complete (6540 records). [2025-10-23T21:44:19.215788] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-23T21:44:19.267776] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:19.676401] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-23T21:44:19.676636] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-23T21:44:19.676903] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-23T21:44:19.677072] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-23T21:44:19.677759] [DEBUG] [LOCAL ] GRX: Trimmed 6540 records to 4873 (keeping 200 days of data) [2025-10-23T21:44:19.709882] [DEBUG] [LOCAL ] GRX: Primary data saved (4873 records). [2025-10-23T21:44:19.710249] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-23T21:44:19.710374] [INFO ] [MAIN ] Update Progress: 973/2367 symbols completed. GRX took 27.5s. Estimated remaining: 2h 58m 1s. Rate: 7.8 symbols/min [2025-10-23T21:44:19.870286] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-23T21:44:19.938510] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:19.974096] [DEBUG] [LOCAL ] GSL: Loaded 32919 existing records from primary storage. [2025-10-23T21:44:19.974476] [INFO ] [MAIN ] GSL: Loaded 32919 existing records. [2025-10-23T21:44:20.006495] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-23T21:44:20.161326] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:20.161536] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-23T21:44:20.161611] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-23T21:44:20.161848] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-23T21:44:20.161920] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-23T21:44:20.509439] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:20.771607] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T21:44:20.799393] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-23T21:44:21.599442] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-23T21:44:22.081308] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T21:44:22.334151] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T21:44:22.399441] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-23T21:44:22.644400] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T21:44:23.199449] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-23T21:44:23.999443] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-23T21:44:24.135985] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T21:44:24.799418] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-23T21:44:25.238081] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-23T21:44:25.482019] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T21:44:25.599406] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-23T21:44:26.120281] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T21:44:26.399443] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-23T21:44:27.065232] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:44:27.199450] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-23T21:44:27.883876] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T21:44:27.999412] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-23T21:44:28.799427] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-23T21:44:29.202326] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T21:44:29.431950] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T21:44:29.599422] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-23T21:44:30.369364] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T21:44:30.377469] [INFO ] [REMOTE ] GSBD: Full fetch complete (58495 records). [2025-10-23T21:44:30.377597] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-23T21:44:30.409698] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-23T21:44:30.772538] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-23T21:44:30.772663] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-23T21:44:30.773515] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-23T21:44:30.773589] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-23T21:44:30.774797] [DEBUG] [LOCAL ] GSBD: Trimmed 58495 records to 39823 (keeping 200 days of data) [2025-10-23T21:44:31.018387] [DEBUG] [LOCAL ] GSBD: Primary data saved (39823 records). [2025-10-23T21:44:31.018558] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-23T21:44:31.018702] [INFO ] [MAIN ] Update Progress: 974/2367 symbols completed. GSBD took 24.1s. Estimated remaining: 2h 57m 59s. Rate: 7.8 symbols/min [2025-10-23T21:44:31.179117] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T21:44:31.210747] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:31.207509] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-23T21:44:31.262831] [DEBUG] [LOCAL ] GTES: Loaded 50288 existing records from primary storage. [2025-10-23T21:44:31.263162] [INFO ] [MAIN ] GTES: Loaded 50288 existing records. [2025-10-23T21:44:31.436211] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:31.436400] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-23T21:44:31.436474] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-23T21:44:31.436731] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-23T21:44:31.436805] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-23T21:44:31.788274] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:31.999439] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-23T21:44:32.606508] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-23T21:44:32.799448] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-23T21:44:33.071026] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T21:44:33.508024] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T21:44:33.599408] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-23T21:44:34.399400] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-23T21:44:34.685344] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T21:44:35.060405] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T21:44:35.199433] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-23T21:44:35.870133] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T21:44:35.999441] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-23T21:44:36.799397] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-23T21:44:36.859469] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T21:44:37.599458] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-23T21:44:37.957629] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T21:44:38.020233] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T21:44:38.399433] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-23T21:44:39.110876] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T21:44:39.120160] [INFO ] [REMOTE ] GS: Full fetch complete (75836 records). [2025-10-23T21:44:39.120340] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-23T21:44:39.201900] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-23T21:44:39.526818] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T21:44:39.565007] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-23T21:44:39.565555] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-23T21:44:39.566679] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-23T21:44:39.566771] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-23T21:44:39.568521] [DEBUG] [LOCAL ] GS: Trimmed 75836 records to 52152 (keeping 200 days of data) [2025-10-23T21:44:39.887919] [DEBUG] [LOCAL ] GS: Primary data saved (52152 records). [2025-10-23T21:44:39.888098] [INFO ] [MAIN ] GS: Full history saved. [2025-10-23T21:44:39.888229] [INFO ] [MAIN ] Update Progress: 975/2367 symbols completed. GS took 37.8s. Estimated remaining: 2h 57m 53s. Rate: 7.8 symbols/min [2025-10-23T21:44:40.004534] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-23T21:44:40.058690] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:40.097038] [DEBUG] [LOCAL ] GTLS: Loaded 43141 existing records from primary storage. [2025-10-23T21:44:40.097355] [INFO ] [MAIN ] GTLS: Loaded 43141 existing records. [2025-10-23T21:44:40.272368] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:40.272574] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-23T21:44:40.272674] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-23T21:44:40.272931] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-23T21:44:40.273002] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-23T21:44:40.639171] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:40.673119] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T21:44:40.799435] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-23T21:44:41.599411] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-23T21:44:42.037559] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T21:44:42.399408] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-23T21:44:42.496963] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:44:42.580813] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T21:44:43.199407] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-23T21:44:43.944380] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T21:44:43.999421] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-23T21:44:44.504479] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T21:44:44.510483] [INFO ] [REMOTE ] GSL: Full fetch complete (48199 records). [2025-10-23T21:44:44.510661] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-23T21:44:44.804394] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-23T21:44:44.899896] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-23T21:44:44.900006] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-23T21:44:44.900867] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-23T21:44:44.900947] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-23T21:44:44.901969] [DEBUG] [LOCAL ] GSL: Trimmed 48199 records to 33099 (keeping 200 days of data) [2025-10-23T21:44:45.094433] [DEBUG] [LOCAL ] GSL: Primary data saved (33099 records). [2025-10-23T21:44:45.094593] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-23T21:44:45.094738] [INFO ] [MAIN ] Update Progress: 976/2367 symbols completed. GSL took 25.4s. Estimated remaining: 2h 57m 42s. Rate: 7.8 symbols/min [2025-10-23T21:44:45.261523] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:45.299562] [DEBUG] [LOCAL ] GTN: Loaded 44840 existing records from primary storage. [2025-10-23T21:44:45.299928] [INFO ] [MAIN ] GTN: Loaded 44840 existing records. [2025-10-23T21:44:45.473784] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:45.474023] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-23T21:44:45.474097] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-23T21:44:45.474310] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-23T21:44:45.474381] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-23T21:44:45.613473] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-23T21:44:45.838634] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:45.989462] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T21:44:46.399407] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-23T21:44:46.520841] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T21:44:47.204542] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-23T21:44:47.216942] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T21:44:47.999421] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-23T21:44:48.339505] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T21:44:48.752518] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:44:48.799401] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-23T21:44:49.599476] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-23T21:44:49.664808] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T21:44:50.399429] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-23T21:44:50.463849] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T21:44:51.199457] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-23T21:44:51.536296] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T21:44:51.975816] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T21:44:51.999419] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-23T21:44:52.623188] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T21:44:52.799499] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-23T21:44:53.599532] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-23T21:44:53.674052] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T21:44:54.399414] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-23T21:44:54.588298] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T21:44:55.199435] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-23T21:44:55.551875] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T21:44:55.561302] [INFO ] [REMOTE ] GSK: Full fetch complete (77635 records). [2025-10-23T21:44:55.561467] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-23T21:44:55.969368] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-23T21:44:55.969496] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-23T21:44:55.970539] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-23T21:44:55.970769] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-23T21:44:55.972309] [DEBUG] [LOCAL ] GSK: Trimmed 77635 records to 53900 (keeping 200 days of data) [2025-10-23T21:44:56.025299] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-23T21:44:56.109294] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T21:44:56.342482] [DEBUG] [LOCAL ] GSK: Primary data saved (53900 records). [2025-10-23T21:44:56.342676] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-23T21:44:56.342795] [INFO ] [MAIN ] Update Progress: 977/2367 symbols completed. GSK took 37.8s. Estimated remaining: 2h 57m 39s. Rate: 7.8 symbols/min [2025-10-23T21:44:56.524744] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:44:56.553735] [DEBUG] [LOCAL ] GTY: Loaded 30006 existing records from primary storage. [2025-10-23T21:44:56.554035] [INFO ] [MAIN ] GTY: Loaded 30006 existing records. [2025-10-23T21:44:56.730238] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:44:56.774744] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:44:56.775470] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-23T21:44:56.775551] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-23T21:44:56.775855] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-23T21:44:56.775930] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-23T21:44:56.808824] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-23T21:44:57.164836] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:44:57.599437] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-23T21:44:57.778856] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T21:44:58.399463] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-23T21:44:58.546923] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T21:44:58.935213] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T21:44:59.199438] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-23T21:44:59.999490] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-23T21:45:00.063807] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T21:45:00.799419] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-23T21:45:00.844630] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T21:45:01.599409] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-23T21:45:01.665220] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:45:01.674095] [INFO ] [REMOTE ] GTES: Full fetch complete (73866 records). [2025-10-23T21:45:01.674257] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-23T21:45:02.071333] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-23T21:45:02.071467] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-23T21:45:02.072765] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-23T21:45:02.072867] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-23T21:45:02.074444] [DEBUG] [LOCAL ] GTES: Trimmed 73866 records to 50654 (keeping 200 days of data) [2025-10-23T21:45:02.373371] [DEBUG] [LOCAL ] GTES: Primary data saved (50654 records). [2025-10-23T21:45:02.373692] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-23T21:45:02.375123] [INFO ] [MAIN ] Update Progress: 978/2367 symbols completed. GTES took 31.4s. Estimated remaining: 2h 57m 29s. Rate: 7.8 symbols/min [2025-10-23T21:45:02.401475] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-23T21:45:02.565026] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:02.594303] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T21:45:02.611537] [DEBUG] [LOCAL ] GUG: Loaded 12168 existing records from primary storage. [2025-10-23T21:45:02.611818] [INFO ] [MAIN ] GUG: Loaded 12168 existing records. [2025-10-23T21:45:02.784485] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:02.784805] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-23T21:45:02.784879] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-23T21:45:02.785252] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-23T21:45:02.785336] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-23T21:45:03.138921] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:03.199401] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-23T21:45:03.292785] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T21:45:03.716422] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T21:45:03.999425] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-23T21:45:04.257842] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T21:45:04.799505] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-23T21:45:05.599541] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-23T21:45:05.675237] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T21:45:06.203694] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T21:45:06.399417] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-23T21:45:06.470881] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T21:45:07.199462] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-23T21:45:07.914733] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T21:45:07.999489] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-23T21:45:08.799467] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-23T21:45:08.895449] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-23T21:45:08.940264] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T21:45:09.599436] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-23T21:45:10.399425] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-23T21:45:10.584414] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:45:10.799146] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T21:45:10.960466] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-23T21:45:11.199450] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-23T21:45:11.999462] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-23T21:45:12.236832] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-23T21:45:12.799456] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-23T21:45:13.332098] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T21:45:13.599455] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-23T21:45:14.082418] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T21:45:14.399449] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-23T21:45:15.085126] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T21:45:15.133239] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T21:45:15.140723] [INFO ] [REMOTE ] GTLS: Full fetch complete (61506 records). [2025-10-23T21:45:15.140858] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-23T21:45:15.204592] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-23T21:45:15.534014] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-23T21:45:15.534142] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-23T21:45:15.535044] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-23T21:45:15.535121] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-23T21:45:15.536368] [DEBUG] [LOCAL ] GTLS: Trimmed 61506 records to 43429 (keeping 200 days of data) [2025-10-23T21:45:15.788279] [DEBUG] [LOCAL ] GTLS: Primary data saved (43429 records). [2025-10-23T21:45:15.788432] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-23T21:45:15.788540] [INFO ] [MAIN ] Update Progress: 979/2367 symbols completed. GTLS took 35.9s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min [2025-10-23T21:45:15.958054] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:15.966753] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T21:45:15.984086] [DEBUG] [LOCAL ] GUT: Loaded 15487 existing records from primary storage. [2025-10-23T21:45:15.984336] [INFO ] [MAIN ] GUT: Loaded 15487 existing records. [2025-10-23T21:45:16.004557] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-23T21:45:16.164961] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:16.165189] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-23T21:45:16.165266] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-23T21:45:16.165480] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-23T21:45:16.165554] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-23T21:45:16.540739] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:16.799452] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-23T21:45:17.599463] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-23T21:45:17.788486] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T21:45:17.796099] [INFO ] [REMOTE ] GTN: Full fetch complete (65732 records). [2025-10-23T21:45:17.796241] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-23T21:45:18.182578] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-23T21:45:18.182912] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-23T21:45:18.183943] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-23T21:45:18.184178] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-23T21:45:18.203749] [DEBUG] [LOCAL ] GTN: Trimmed 65732 records to 45076 (keeping 200 days of data) [2025-10-23T21:45:18.204432] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T21:45:18.421818] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-23T21:45:18.495134] [DEBUG] [LOCAL ] GTN: Primary data saved (45076 records). [2025-10-23T21:45:18.495329] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-23T21:45:18.495460] [INFO ] [MAIN ] Update Progress: 980/2367 symbols completed. GTN took 33.4s. Estimated remaining: 2h 57m 15s. Rate: 7.8 symbols/min [2025-10-23T21:45:18.596146] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-23T21:45:18.704672] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:18.739143] [DEBUG] [LOCAL ] GVA: Loaded 32580 existing records from primary storage. [2025-10-23T21:45:18.739461] [INFO ] [MAIN ] GVA: Loaded 32580 existing records. [2025-10-23T21:45:18.942819] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:18.943103] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-23T21:45:18.943197] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-23T21:45:18.943434] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-23T21:45:18.943509] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-23T21:45:19.204623] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-23T21:45:19.336965] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:19.414768] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T21:45:19.999463] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-23T21:45:20.602529] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T21:45:20.621866] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T21:45:20.799437] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-23T21:45:21.599423] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-23T21:45:21.822390] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T21:45:22.399425] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-23T21:45:22.461015] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T21:45:23.199441] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-23T21:45:23.769132] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T21:45:23.999414] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-23T21:45:24.034635] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T21:45:24.797587] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T21:45:24.800441] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-23T21:45:25.599477] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-23T21:45:25.770855] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T21:45:26.385163] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T21:45:26.387539] [INFO ] [REMOTE ] GUG: Full fetch complete (18798 records). [2025-10-23T21:45:26.387669] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-23T21:45:26.409159] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-23T21:45:26.755037] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-23T21:45:26.755154] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-23T21:45:26.755588] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-23T21:45:26.755685] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-23T21:45:26.756255] [DEBUG] [LOCAL ] GUG: Trimmed 18798 records to 12223 (keeping 200 days of data) [2025-10-23T21:45:26.827582] [DEBUG] [LOCAL ] GUG: Primary data saved (12223 records). [2025-10-23T21:45:26.827751] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-23T21:45:26.827859] [INFO ] [MAIN ] Update Progress: 981/2367 symbols completed. GUG took 24.5s. Estimated remaining: 2h 57m 8s. Rate: 7.8 symbols/min [2025-10-23T21:45:26.992976] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:27.012539] [DEBUG] [LOCAL ] GWH: Loaded 20115 existing records from primary storage. [2025-10-23T21:45:27.012814] [INFO ] [MAIN ] GWH: Loaded 20115 existing records. [2025-10-23T21:45:27.187017] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:27.187202] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-23T21:45:27.187274] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-23T21:45:27.187490] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-23T21:45:27.187570] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-23T21:45:27.208111] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-23T21:45:27.549595] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:27.855714] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T21:45:27.945809] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T21:45:27.999440] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-23T21:45:28.794963] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T21:45:28.799397] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-23T21:45:29.599475] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-23T21:45:29.649296] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T21:45:30.399446] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-23T21:45:30.926984] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T21:45:30.932939] [INFO ] [REMOTE ] GTY: Full fetch complete (43893 records). [2025-10-23T21:45:30.933047] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-23T21:45:31.043610] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T21:45:31.204553] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-23T21:45:31.327953] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-23T21:45:31.328090] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-23T21:45:31.328953] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-23T21:45:31.329055] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-23T21:45:31.330041] [DEBUG] [LOCAL ] GTY: Trimmed 43893 records to 30273 (keeping 200 days of data) [2025-10-23T21:45:31.513081] [DEBUG] [LOCAL ] GTY: Primary data saved (30273 records). [2025-10-23T21:45:31.513209] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-23T21:45:31.513321] [INFO ] [MAIN ] Update Progress: 982/2367 symbols completed. GTY took 35.2s. Estimated remaining: 2h 56m 56s. Rate: 7.8 symbols/min [2025-10-23T21:45:31.682627] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:31.719268] [DEBUG] [LOCAL ] GWRE: Loaded 39608 existing records from primary storage. [2025-10-23T21:45:31.719575] [INFO ] [MAIN ] GWRE: Loaded 39608 existing records. [2025-10-23T21:45:31.899576] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:31.899796] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-23T21:45:31.899871] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-23T21:45:31.900082] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-23T21:45:31.900154] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-23T21:45:32.001591] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-23T21:45:32.258999] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:32.773267] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T21:45:32.799397] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-23T21:45:32.827824] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T21:45:33.599435] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-23T21:45:34.327151] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T21:45:34.399419] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-23T21:45:34.694917] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T21:45:35.199446] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-23T21:45:35.999409] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-23T21:45:36.152044] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T21:45:36.619509] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T21:45:36.772333] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T21:45:36.799399] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-23T21:45:37.599424] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-23T21:45:37.952599] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:45:38.399488] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-23T21:45:38.940410] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T21:45:39.199435] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-23T21:45:39.409343] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T21:45:39.999435] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-23T21:45:40.574829] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T21:45:40.799409] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-23T21:45:41.005453] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T21:45:41.599441] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-23T21:45:41.836342] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T21:45:42.399450] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-23T21:45:43.074343] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T21:45:43.199459] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-23T21:45:43.535034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T21:45:43.999450] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-23T21:45:44.799457] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-23T21:45:45.030060] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T21:45:45.041535] [INFO ] [REMOTE ] GWH: Full fetch complete (24835 records). [2025-10-23T21:45:45.041760] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-23T21:45:45.435310] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-23T21:45:45.445525] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-23T21:45:45.446133] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T21:45:45.452452] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-23T21:45:45.452901] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-23T21:45:45.453987] [DEBUG] [LOCAL ] GWH: Trimmed 24835 records to 20423 (keeping 200 days of data) [2025-10-23T21:45:45.564610] [DEBUG] [LOCAL ] GWH: Primary data saved (20423 records). [2025-10-23T21:45:45.564773] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-23T21:45:45.564882] [INFO ] [MAIN ] Update Progress: 983/2367 symbols completed. GWH took 18.7s. Estimated remaining: 2h 56m 58s. Rate: 7.8 symbols/min [2025-10-23T21:45:45.607374] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-23T21:45:45.734979] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:45.754272] [DEBUG] [LOCAL ] GWW: Loaded 19181 existing records from primary storage. [2025-10-23T21:45:45.754544] [INFO ] [MAIN ] GWW: Loaded 19181 existing records. [2025-10-23T21:45:45.927054] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:45.927293] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-23T21:45:45.927370] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-23T21:45:45.927587] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-23T21:45:45.927701] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-23T21:45:46.280879] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:46.341781] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T21:45:46.399398] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-23T21:45:46.686026] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T21:45:47.199455] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-23T21:45:47.907353] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T21:45:47.999417] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-23T21:45:48.566487] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T21:45:48.572415] [INFO ] [REMOTE ] GVA: Full fetch complete (48544 records). [2025-10-23T21:45:48.572575] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-23T21:45:48.799563] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-23T21:45:48.993396] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-23T21:45:49.002053] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-23T21:45:49.003152] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T21:45:49.004260] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-23T21:45:49.004440] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-23T21:45:49.009347] [DEBUG] [LOCAL ] GVA: Trimmed 48544 records to 32845 (keeping 200 days of data) [2025-10-23T21:45:49.207250] [DEBUG] [LOCAL ] GVA: Primary data saved (32845 records). [2025-10-23T21:45:49.207420] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-23T21:45:49.207530] [INFO ] [MAIN ] Update Progress: 984/2367 symbols completed. GVA took 30.7s. Estimated remaining: 2h 56m 44s. Rate: 7.8 symbols/min [2025-10-23T21:45:49.381363] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:49.422306] [DEBUG] [LOCAL ] GXO: Loaded 46455 existing records from primary storage. [2025-10-23T21:45:49.422673] [INFO ] [MAIN ] GXO: Loaded 46455 existing records. [2025-10-23T21:45:49.595703] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:49.595920] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-23T21:45:49.595993] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-23T21:45:49.596211] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-23T21:45:49.596301] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-23T21:45:49.607742] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-23T21:45:49.987071] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:50.399493] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-23T21:45:50.540741] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T21:45:50.544139] [INFO ] [REMOTE ] GUT: Full fetch complete (22417 records). [2025-10-23T21:45:50.544234] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-23T21:45:50.844371] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T21:45:50.945242] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-23T21:45:50.945365] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-23T21:45:50.945930] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-23T21:45:50.946009] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-23T21:45:50.946784] [DEBUG] [LOCAL ] GUT: Trimmed 22417 records to 15608 (keeping 200 days of data) [2025-10-23T21:45:51.033775] [DEBUG] [LOCAL ] GUT: Primary data saved (15608 records). [2025-10-23T21:45:51.033929] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-23T21:45:51.034039] [INFO ] [MAIN ] Update Progress: 985/2367 symbols completed. GUT took 35.2s. Estimated remaining: 2h 56m 29s. Rate: 7.8 symbols/min [2025-10-23T21:45:51.199210] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:45:51.199731] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-23T21:45:51.203280] [DEBUG] [LOCAL ] GYLD: Loaded 1532 existing records from primary storage. [2025-10-23T21:45:51.203462] [INFO ] [MAIN ] GYLD: Loaded 1532 existing records. [2025-10-23T21:45:51.384351] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:45:51.384595] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-23T21:45:51.384696] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-23T21:45:51.384890] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-23T21:45:51.384978] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-23T21:45:51.740915] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:45:51.794546] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T21:45:51.999473] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-23T21:45:52.799425] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-23T21:45:52.832251] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T21:45:53.599425] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-23T21:45:53.734099] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T21:45:53.949563] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T21:45:54.399428] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-23T21:45:54.959772] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T21:45:55.199420] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-23T21:45:55.488734] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T21:45:55.999462] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-23T21:45:56.359408] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-23T21:45:56.782807] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T21:45:56.799407] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-23T21:45:57.133390] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-23T21:45:57.599525] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-23T21:45:58.052452] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T21:45:58.399451] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-23T21:45:58.790838] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-23T21:45:59.199470] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-23T21:45:59.633510] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-23T21:45:59.999465] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-23T21:46:00.444100] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-23T21:46:00.799460] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-23T21:46:01.599446] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-23T21:46:02.064553] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T21:46:02.358666] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T21:46:02.399478] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-23T21:46:02.868395] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-23T21:46:03.199467] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-23T21:46:03.999483] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-23T21:46:04.699742] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T21:46:04.799466] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-23T21:46:05.599454] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-23T21:46:05.830471] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:46:06.399453] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-23T21:46:06.490188] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T21:46:06.851418] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:46:06.974730] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T21:46:07.199443] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-23T21:46:07.631181] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-23T21:46:07.632150] [INFO ] [REMOTE ] GYLD: Full fetch complete (2092 records). [2025-10-23T21:46:07.632239] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-23T21:46:07.986079] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-23T21:46:07.986188] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-23T21:46:07.986297] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-23T21:46:07.986371] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-23T21:46:07.986871] [DEBUG] [LOCAL ] GYLD: Trimmed 2092 records to 1537 (keeping 200 days of data) [2025-10-23T21:46:07.996387] [DEBUG] [LOCAL ] GYLD: Primary data saved (1537 records). [2025-10-23T21:46:07.996470] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-23T21:46:07.996604] [INFO ] [MAIN ] Update Progress: 986/2367 symbols completed. GYLD took 17.0s. Estimated remaining: 2h 56m 34s. Rate: 7.8 symbols/min [2025-10-23T21:46:08.006897] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-23T21:46:08.167377] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:08.212922] [DEBUG] [LOCAL ] H: Loaded 44372 existing records from primary storage. [2025-10-23T21:46:08.213273] [INFO ] [MAIN ] H: Loaded 44372 existing records. [2025-10-23T21:46:08.386118] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:08.386342] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-23T21:46:08.386418] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-23T21:46:08.386725] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-23T21:46:08.386803] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-23T21:46:08.761080] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:08.799500] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-23T21:46:09.529984] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:46:09.536402] [INFO ] [REMOTE ] GWRE: Full fetch complete (59983 records). [2025-10-23T21:46:09.536600] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-23T21:46:09.609240] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-23T21:46:09.951471] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-23T21:46:09.951765] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-23T21:46:09.952688] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-23T21:46:09.952835] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-23T21:46:09.963600] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T21:46:09.968079] [DEBUG] [LOCAL ] GWRE: Trimmed 59983 records to 39790 (keeping 200 days of data) [2025-10-23T21:46:10.200631] [DEBUG] [LOCAL ] GWRE: Primary data saved (39790 records). [2025-10-23T21:46:10.200814] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-23T21:46:10.200921] [INFO ] [MAIN ] Update Progress: 987/2367 symbols completed. GWRE took 38.7s. Estimated remaining: 2h 56m 19s. Rate: 7.8 symbols/min [2025-10-23T21:46:10.384164] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:10.403878] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-23T21:46:10.420789] [DEBUG] [LOCAL ] HAE: Loaded 39324 existing records from primary storage. [2025-10-23T21:46:10.421091] [INFO ] [MAIN ] HAE: Loaded 39324 existing records. [2025-10-23T21:46:10.611705] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:10.611927] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-23T21:46:10.612001] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-23T21:46:10.612241] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-23T21:46:10.612315] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-23T21:46:10.995008] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:11.136484] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T21:46:11.199395] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-23T21:46:11.447267] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T21:46:11.999438] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-23T21:46:12.806404] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-23T21:46:12.809392] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T21:46:13.599411] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-23T21:46:13.696442] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:46:13.982493] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T21:46:14.399446] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-23T21:46:14.559110] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T21:46:15.199489] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-23T21:46:15.744815] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T21:46:15.999484] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-23T21:46:16.799419] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-23T21:46:16.880437] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:46:17.599414] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-23T21:46:17.766438] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T21:46:17.931996] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T21:46:18.399451] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-23T21:46:19.176195] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T21:46:19.197334] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T21:46:19.201510] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-23T21:46:19.999434] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-23T21:46:20.430239] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T21:46:20.799461] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-23T21:46:20.989354] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-10-23T21:46:20.992937] [INFO ] [REMOTE ] GWW: Full fetch complete (29039 records). [2025-10-23T21:46:20.993046] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-23T21:46:21.384442] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-23T21:46:21.384551] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-23T21:46:21.385196] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-23T21:46:21.385275] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-23T21:46:21.386020] [DEBUG] [LOCAL ] GWW: Trimmed 29039 records to 19343 (keeping 200 days of data) [2025-10-23T21:46:21.505723] [DEBUG] [LOCAL ] GWW: Primary data saved (19343 records). [2025-10-23T21:46:21.505873] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-23T21:46:21.506017] [INFO ] [MAIN ] Update Progress: 988/2367 symbols completed. GWW took 35.9s. Estimated remaining: 2h 56m 16s. Rate: 7.8 symbols/min [2025-10-23T21:46:21.610104] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-23T21:46:21.681519] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:21.711491] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T21:46:21.749772] [DEBUG] [LOCAL ] HAFN: Loaded 42607 existing records from primary storage. [2025-10-23T21:46:21.750089] [INFO ] [MAIN ] HAFN: Loaded 42607 existing records. [2025-10-23T21:46:21.946950] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:21.947165] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-23T21:46:21.947239] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-23T21:46:21.947461] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-23T21:46:21.947537] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-23T21:46:22.316580] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:22.399404] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-23T21:46:22.992985] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T21:46:23.199398] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-23T21:46:23.999416] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-23T21:46:24.335879] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T21:46:24.706732] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T21:46:24.799407] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-23T21:46:25.537053] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T21:46:25.599401] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-23T21:46:26.399414] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-23T21:46:26.436674] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T21:46:27.141852] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T21:46:27.199406] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-23T21:46:27.999433] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-23T21:46:28.159866] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T21:46:28.799472] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-23T21:46:28.856998] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T21:46:29.607342] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-23T21:46:29.612591] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T21:46:30.399462] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-23T21:46:30.556683] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T21:46:31.162101] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-23T21:46:31.199402] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-23T21:46:31.768968] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T21:46:31.999418] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-23T21:46:32.801101] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-23T21:46:32.803937] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T21:46:32.812567] [INFO ] [REMOTE ] GXO: Full fetch complete (69304 records). [2025-10-23T21:46:32.812787] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-23T21:46:33.199971] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-23T21:46:33.200092] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-23T21:46:33.201037] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-23T21:46:33.201115] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-23T21:46:33.202393] [DEBUG] [LOCAL ] GXO: Trimmed 69304 records to 46753 (keeping 200 days of data) [2025-10-23T21:46:33.462602] [DEBUG] [LOCAL ] GXO: Primary data saved (46753 records). [2025-10-23T21:46:33.462780] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-23T21:46:33.462894] [INFO ] [MAIN ] Update Progress: 989/2367 symbols completed. GXO took 44.3s. Estimated remaining: 2h 56m 14s. Rate: 7.8 symbols/min [2025-10-23T21:46:33.608145] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-23T21:46:33.633421] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:33.686371] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-23T21:46:33.686763] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-23T21:46:33.906995] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:33.908089] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-23T21:46:33.911195] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T21:46:33.911374] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-23T21:46:33.916702] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-23T21:46:33.923800] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-23T21:46:34.283139] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:34.399418] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-23T21:46:34.505403] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T21:46:34.815370] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T21:46:35.199443] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-23T21:46:36.003115] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-23T21:46:36.008303] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T21:46:36.420763] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T21:46:36.799449] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-23T21:46:37.599411] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-23T21:46:38.055776] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-23T21:46:38.399446] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-23T21:46:38.457722] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T21:46:39.175696] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T21:46:39.199399] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-23T21:46:39.999442] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-23T21:46:40.254092] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T21:46:40.799436] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-23T21:46:40.885725] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T21:46:41.599438] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-23T21:46:41.766162] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T21:46:42.399427] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-23T21:46:42.543969] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T21:46:42.551594] [INFO ] [REMOTE ] H: Full fetch complete (63478 records). [2025-10-23T21:46:42.551789] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-23T21:46:42.932264] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-23T21:46:42.932394] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-23T21:46:42.933331] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-23T21:46:42.933426] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-23T21:46:42.934776] [DEBUG] [LOCAL ] H: Trimmed 63478 records to 44693 (keeping 200 days of data) [2025-10-23T21:46:43.204723] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-23T21:46:43.212729] [DEBUG] [LOCAL ] H: Primary data saved (44693 records). [2025-10-23T21:46:43.212882] [INFO ] [MAIN ] H: Full history saved. [2025-10-23T21:46:43.213868] [INFO ] [MAIN ] Update Progress: 990/2367 symbols completed. H took 35.2s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-10-23T21:46:43.383868] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:43.426103] [DEBUG] [LOCAL ] HASI: Loaded 47728 existing records from primary storage. [2025-10-23T21:46:43.426471] [INFO ] [MAIN ] HASI: Loaded 47728 existing records. [2025-10-23T21:46:43.620911] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:43.621206] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-23T21:46:43.621375] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-23T21:46:43.621685] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-23T21:46:43.621885] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-23T21:46:43.956128] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-23T21:46:44.051939] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:44.053003] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-23T21:46:44.073560] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:46:44.081229] [INFO ] [REMOTE ] HAE: Full fetch complete (59323 records). [2025-10-23T21:46:44.081365] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-23T21:46:44.465005] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-23T21:46:44.465222] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-23T21:46:44.466325] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-23T21:46:44.466423] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-23T21:46:44.467948] [DEBUG] [LOCAL ] HAE: Trimmed 59323 records to 39587 (keeping 200 days of data) [2025-10-23T21:46:44.574543] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T21:46:44.724090] [DEBUG] [LOCAL ] HAE: Primary data saved (39587 records). [2025-10-23T21:46:44.724248] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-23T21:46:44.724359] [INFO ] [MAIN ] Update Progress: 991/2367 symbols completed. HAE took 34.5s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min [2025-10-23T21:46:44.804814] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-23T21:46:44.894587] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:44.938712] [DEBUG] [LOCAL ] HAYW: Loaded 48803 existing records from primary storage. [2025-10-23T21:46:44.939065] [INFO ] [MAIN ] HAYW: Loaded 48803 existing records. [2025-10-23T21:46:45.119095] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:45.119363] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-23T21:46:45.119477] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-23T21:46:45.119778] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-23T21:46:45.119852] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-23T21:46:45.468871] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:45.599420] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-23T21:46:46.202900] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-23T21:46:46.399426] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-23T21:46:46.460470] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T21:46:47.199535] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-23T21:46:47.271754] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T21:46:47.999437] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-23T21:46:48.549466] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-23T21:46:48.792561] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T21:46:48.801157] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-23T21:46:49.582013] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T21:46:49.599399] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-23T21:46:50.399547] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-23T21:46:50.810715] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T21:46:51.195855] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T21:46:51.204916] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-23T21:46:51.999432] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-23T21:46:52.046493] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T21:46:52.799436] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-23T21:46:53.325040] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-23T21:46:53.604584] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-23T21:46:53.620350] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T21:46:54.053814] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T21:46:54.399461] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-23T21:46:55.199432] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-23T21:46:55.224123] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T21:46:55.999460] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-23T21:46:56.351560] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T21:46:56.793035] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-23T21:46:56.802831] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-23T21:46:57.179675] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T21:46:57.186814] [INFO ] [REMOTE ] HAFN: Full fetch complete (64644 records). [2025-10-23T21:46:57.186954] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-23T21:46:57.566444] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-23T21:46:57.566549] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-23T21:46:57.567457] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-23T21:46:57.567536] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-23T21:46:57.568781] [DEBUG] [LOCAL ] HAFN: Trimmed 64644 records to 42951 (keeping 200 days of data) [2025-10-23T21:46:57.615905] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-23T21:46:57.812278] [DEBUG] [LOCAL ] HAFN: Primary data saved (42951 records). [2025-10-23T21:46:57.812460] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-23T21:46:57.813799] [INFO ] [MAIN ] Update Progress: 992/2367 symbols completed. HAFN took 36.3s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min [2025-10-23T21:46:57.989683] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:46:57.998280] [DEBUG] [LOCAL ] HBB: Loaded 6298 existing records from primary storage. [2025-10-23T21:46:57.998543] [INFO ] [MAIN ] HBB: Loaded 6298 existing records. [2025-10-23T21:46:58.172947] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:46:58.173160] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-23T21:46:58.173232] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-23T21:46:58.173467] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-23T21:46:58.173540] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-23T21:46:58.416319] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-23T21:46:58.530230] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:46:58.561591] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T21:46:59.199467] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-23T21:46:59.310434] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T21:46:59.999419] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-23T21:47:00.116902] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T21:47:00.799433] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-23T21:47:01.240035] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T21:47:01.249294] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-23T21:47:01.249443] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-23T21:47:01.624040] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-23T21:47:01.668846] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T21:47:01.689295] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-23T21:47:01.698956] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-23T21:47:01.700309] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-23T21:47:01.700940] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-23T21:47:01.702422] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54108 (keeping 200 days of data) [2025-10-23T21:47:02.036262] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-10-23T21:47:02.036832] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-23T21:47:02.036945] [INFO ] [MAIN ] Update Progress: 993/2367 symbols completed. HAL took 28.6s. Estimated remaining: 2h 55m 41s. Rate: 7.8 symbols/min [2025-10-23T21:47:02.215542] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:02.262805] [DEBUG] [LOCAL ] HBI: Loaded 52906 existing records from primary storage. [2025-10-23T21:47:02.263185] [INFO ] [MAIN ] HBI: Loaded 52906 existing records. [2025-10-23T21:47:02.407540] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-23T21:47:02.476740] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:02.480905] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T21:47:02.481666] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T21:47:02.481903] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-23T21:47:02.494205] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-23T21:47:02.494896] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-23T21:47:02.494975] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-23T21:47:02.846157] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:03.199437] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-23T21:47:03.999406] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-23T21:47:04.178085] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T21:47:04.799432] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-23T21:47:04.947250] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:47:05.562540] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T21:47:05.599405] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-23T21:47:05.682504] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T21:47:06.340528] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T21:47:06.399459] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-23T21:47:07.199415] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-23T21:47:07.263799] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-23T21:47:07.999439] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-23T21:47:08.799425] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-23T21:47:08.855791] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T21:47:09.468229] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T21:47:09.599421] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-23T21:47:10.209159] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T21:47:10.399469] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-23T21:47:11.199403] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-23T21:47:11.999438] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-23T21:47:12.075509] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T21:47:12.547561] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T21:47:12.706345] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T21:47:12.799388] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-23T21:47:13.512818] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T21:47:13.599406] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-23T21:47:14.235022] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (5.44 seconds). [2025-10-23T21:47:14.399412] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-23T21:47:15.199405] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-23T21:47:15.265712] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:47:15.277783] [INFO ] [REMOTE ] HASI: Full fetch complete (68338 records). [2025-10-23T21:47:15.278031] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-23T21:47:15.660465] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-23T21:47:15.660581] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-23T21:47:15.661533] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-23T21:47:15.661611] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-23T21:47:15.662894] [DEBUG] [LOCAL ] HASI: Trimmed 68338 records to 48038 (keeping 200 days of data) [2025-10-23T21:47:15.944538] [DEBUG] [LOCAL ] HASI: Primary data saved (48038 records). [2025-10-23T21:47:15.944753] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-23T21:47:15.945002] [INFO ] [MAIN ] Update Progress: 994/2367 symbols completed. HASI took 32.7s. Estimated remaining: 2h 55m 42s. Rate: 7.8 symbols/min [2025-10-23T21:47:16.011014] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-23T21:47:16.128210] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:16.143015] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T21:47:16.152277] [INFO ] [REMOTE ] HAYW: Full fetch complete (70917 records). [2025-10-23T21:47:16.152518] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-23T21:47:16.487884] [DEBUG] [LOCAL ] HBM: Loaded 52980 existing records from primary storage. [2025-10-23T21:47:16.521512] [INFO ] [MAIN ] HBM: Loaded 52980 existing records. [2025-10-23T21:47:16.658787] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-23T21:47:16.723340] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-23T21:47:16.723890] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-23T21:47:16.740523] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-23T21:47:16.764455] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-23T21:47:16.800852] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-23T21:47:16.807561] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:16.808610] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-23T21:47:16.808859] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-23T21:47:16.809108] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-23T21:47:16.809306] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-23T21:47:16.866040] [DEBUG] [LOCAL ] HAYW: Trimmed 70917 records to 49174 (keeping 200 days of data) [2025-10-23T21:47:17.235292] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T21:47:17.487357] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:17.505927] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T21:47:17.509762] [INFO ] [REMOTE ] HBB: Full fetch complete (9197 records). [2025-10-23T21:47:17.509876] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-23T21:47:17.587380] [DEBUG] [LOCAL ] HAYW: Primary data saved (49174 records). [2025-10-23T21:47:17.603812] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-23T21:47:17.626126] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-23T21:47:17.627079] [INFO ] [MAIN ] Update Progress: 995/2367 symbols completed. HAYW took 32.9s. Estimated remaining: 2h 55m 26s. Rate: 7.8 symbols/min [2025-10-23T21:47:18.027325] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:18.071285] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-23T21:47:18.071392] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-23T21:47:18.071634] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-23T21:47:18.071732] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-23T21:47:18.072173] [DEBUG] [LOCAL ] HBB: Trimmed 9197 records to 6322 (keeping 200 days of data) [2025-10-23T21:47:18.123167] [DEBUG] [LOCAL ] HBB: Primary data saved (6322 records). [2025-10-23T21:47:18.123334] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-23T21:47:18.123502] [INFO ] [MAIN ] Update Progress: 996/2367 symbols completed. HBB took 20.3s. Estimated remaining: 2h 55m 8s. Rate: 7.8 symbols/min [2025-10-23T21:47:18.247064] [DEBUG] [LOCAL ] HCA: Loaded 46893 existing records from primary storage. [2025-10-23T21:47:18.267834] [INFO ] [MAIN ] HCA: Loaded 46893 existing records. [2025-10-23T21:47:18.406527] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:18.409719] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-23T21:47:18.491964] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:18.492199] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-23T21:47:18.492368] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-23T21:47:18.492688] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-23T21:47:18.492751] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-23T21:47:18.792292] [DEBUG] [LOCAL ] HCC: Loaded 44974 existing records from primary storage. [2025-10-23T21:47:18.803306] [INFO ] [MAIN ] HCC: Loaded 44974 existing records. [2025-10-23T21:47:18.976236] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:19.052181] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:19.052377] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-23T21:47:19.052457] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-23T21:47:19.052822] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-23T21:47:19.052919] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-23T21:47:19.201738] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-23T21:47:19.420766] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:19.447791] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T21:47:19.999534] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-23T21:47:20.222323] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T21:47:20.766249] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T21:47:20.799394] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-23T21:47:21.584192] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T21:47:21.599391] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-23T21:47:22.399402] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-23T21:47:22.595240] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T21:47:23.204040] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-23T21:47:23.205565] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T21:47:23.999404] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-23T21:47:24.107890] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T21:47:24.799434] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-23T21:47:25.087745] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T21:47:25.599417] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-23T21:47:25.798030] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:47:26.399419] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-23T21:47:26.576489] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T21:47:27.199429] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-23T21:47:27.242699] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T21:47:27.999426] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-23T21:47:28.206924] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T21:47:28.799465] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-23T21:47:29.115379] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T21:47:29.599411] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-23T21:47:29.777445] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T21:47:30.290226] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T21:47:30.399446] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-23T21:47:31.199431] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-23T21:47:31.463297] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T21:47:31.999434] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-23T21:47:32.249759] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T21:47:32.799428] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-23T21:47:33.043625] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T21:47:33.355526] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T21:47:33.599425] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-23T21:47:34.399431] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-23T21:47:34.482924] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T21:47:34.852207] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T21:47:35.199443] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-23T21:47:35.717544] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T21:47:35.999474] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-23T21:47:36.799442] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-23T21:47:36.949191] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:47:37.525264] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T21:47:37.534362] [INFO ] [REMOTE ] HBI: Full fetch complete (76971 records). [2025-10-23T21:47:37.534506] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-23T21:47:37.604631] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-23T21:47:37.924898] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-23T21:47:37.924999] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-23T21:47:37.926028] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-23T21:47:37.926109] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-23T21:47:37.927589] [DEBUG] [LOCAL ] HBI: Trimmed 76971 records to 53296 (keeping 200 days of data) [2025-10-23T21:47:38.226865] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T21:47:38.256628] [DEBUG] [LOCAL ] HBI: Primary data saved (53296 records). [2025-10-23T21:47:38.256797] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-23T21:47:38.256905] [INFO ] [MAIN ] Update Progress: 997/2367 symbols completed. HBI took 36.2s. Estimated remaining: 2h 55m 18s. Rate: 7.8 symbols/min [2025-10-23T21:47:38.399433] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-23T21:47:38.850045] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T21:47:39.199440] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-23T21:47:39.802683] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T21:47:39.999450] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-23T21:47:40.743325] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T21:47:40.799397] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-23T21:47:41.599375] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-23T21:47:42.319438] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T21:47:42.332050] [INFO ] [REMOTE ] HCC: Full fetch complete (64832 records). [2025-10-23T21:47:42.332387] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-23T21:47:42.902369] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-23T21:47:42.902512] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-23T21:47:42.903524] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-23T21:47:42.903616] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-23T21:47:42.905155] [DEBUG] [LOCAL ] HCC: Trimmed 64832 records to 45253 (keeping 200 days of data) [2025-10-23T21:47:43.203136] [DEBUG] [LOCAL ] HCC: Primary data saved (45253 records). [2025-10-23T21:47:43.203295] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-23T21:47:43.203407] [INFO ] [MAIN ] Update Progress: 998/2367 symbols completed. HCC took 25.1s. Estimated remaining: 2h 55m 6s. Rate: 7.8 symbols/min [2025-10-23T21:47:44.450490] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (4.45 seconds). [2025-10-23T21:47:44.461294] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-23T21:47:46.245549] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T21:47:46.255493] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-23T21:47:46.519871] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (4.92 seconds). [2025-10-23T21:47:46.534572] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-23T21:47:48.057344] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:47:48.067897] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-23T21:47:48.153952] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T21:47:48.166446] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-23T21:47:48.787342] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T21:47:48.796594] [INFO ] [REMOTE ] HCA: Full fetch complete (68942 records). [2025-10-23T21:47:48.796844] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-23T21:47:49.213757] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-23T21:47:49.213922] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-23T21:47:49.215980] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-23T21:47:49.216073] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-23T21:47:49.218136] [DEBUG] [LOCAL ] HCA: Trimmed 68942 records to 47254 (keeping 200 days of data) [2025-10-23T21:47:49.545185] [DEBUG] [LOCAL ] HCA: Primary data saved (47254 records). [2025-10-23T21:47:49.545420] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-23T21:47:49.545561] [INFO ] [MAIN ] Update Progress: 999/2367 symbols completed. HCA took 31.9s. Estimated remaining: 2h 54m 57s. Rate: 7.8 symbols/min [2025-10-23T21:47:49.982482] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T21:47:49.994278] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-23T21:47:52.037543] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T21:47:52.046824] [INFO ] [REMOTE ] HBM: Full fetch complete (76744 records). [2025-10-23T21:47:52.047007] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-23T21:47:52.428021] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-23T21:47:52.428146] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-23T21:47:52.429215] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-23T21:47:52.429298] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-23T21:47:52.430799] [DEBUG] [LOCAL ] HBM: Trimmed 76744 records to 53369 (keeping 200 days of data) [2025-10-23T21:47:52.762557] [DEBUG] [LOCAL ] HBM: Primary data saved (53369 records). [2025-10-23T21:47:52.762777] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-23T21:47:52.762910] [INFO ] [MAIN ] Update Progress: 1000/2367 symbols completed. HBM took 36.8s. Estimated remaining: 2h 54m 43s. Rate: 7.8 symbols/min [2025-10-23T21:47:53.367161] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:53.420751] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:53.435808] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:53.480884] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:47:53.481529] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-23T21:47:53.481582] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-23T21:47:53.481696] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-23T21:47:53.481763] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-23T21:47:53.481815] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-23T21:47:53.481857] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-23T21:47:53.489511] [DEBUG] [LOCAL ] HCI: Loaded 14079 existing records from primary storage. [2025-10-23T21:47:53.521757] [INFO ] [MAIN ] HCI: Loaded 14079 existing records. [2025-10-23T21:47:53.867485] [DEBUG] [LOCAL ] HD: Loaded 53467 existing records from primary storage. [2025-10-23T21:47:53.947703] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:53.963310] [INFO ] [MAIN ] HD: Loaded 53467 existing records. [2025-10-23T21:47:53.967792] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-23T21:47:53.998238] [DEBUG] [LOCAL ] HDB: Loaded 51909 existing records from primary storage. [2025-10-23T21:47:54.038712] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-23T21:47:54.152612] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-23T21:47:54.103682] [INFO ] [MAIN ] HDB: Loaded 51909 existing records. [2025-10-23T21:47:54.179730] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-23T21:47:54.499372] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:54.532692] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-23T21:47:54.521746] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:54.550043] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-23T21:47:54.550377] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-23T21:47:54.598940] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-23T21:47:54.641125] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-23T21:47:54.685335] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:47:54.740689] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-23T21:47:54.740834] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-23T21:47:54.806909] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-23T21:47:54.873341] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-23T21:47:55.041719] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-23T21:47:55.191605] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:55.186594] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-23T21:47:55.212816] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-23T21:47:55.618015] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:55.646384] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-23T21:47:55.653373] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-23T21:47:55.653064] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:47:55.654677] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-23T21:47:55.655225] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-23T21:47:55.991674] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-23T21:47:55.992624] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-23T21:47:56.236872] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-23T21:47:56.237726] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-23T21:47:56.326555] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T21:47:56.329716] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-23T21:47:56.486263] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-23T21:47:56.487201] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-23T21:47:56.741483] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-23T21:47:56.742346] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-23T21:47:57.054947] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-23T21:47:57.055819] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-23T21:47:57.175959] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T21:47:57.179256] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-23T21:47:57.445586] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-23T21:47:57.485562] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T21:47:57.599417] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-23T21:47:57.752517] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T21:47:57.918602] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-23T21:47:58.145714] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T21:47:58.399442] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-23T21:47:59.199410] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-23T21:47:59.999543] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-23T21:48:00.139497] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T21:48:00.193341] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T21:48:00.252029] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-23T21:48:00.252928] [INFO ] [REMOTE ] HCXY: Full fetch complete (510 records). [2025-10-23T21:48:00.253020] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-23T21:48:00.438589] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-23T21:48:00.438819] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:48:00.438907] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:48:00.438995] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-23T21:48:00.439181] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-23T21:48:00.439256] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-23T21:48:00.439339] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-23T21:48:00.439433] [INFO ] [MAIN ] Update Progress: 1001/2367 symbols completed. HCXY took 7.7s. Estimated remaining: 2h 54m 35s. Rate: 7.8 symbols/min [2025-10-23T21:48:00.636433] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:00.698508] [DEBUG] [LOCAL ] HE: Loaded 48806 existing records from primary storage. [2025-10-23T21:48:00.698934] [INFO ] [MAIN ] HE: Loaded 48806 existing records. [2025-10-23T21:48:00.802504] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-23T21:48:00.883544] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:48:00.883812] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-23T21:48:00.883907] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-23T21:48:00.884165] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-23T21:48:00.884239] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-23T21:48:01.232352] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:01.599487] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-23T21:48:02.399446] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-23T21:48:02.662628] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T21:48:03.199448] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-23T21:48:03.726430] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-23T21:48:03.999463] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-23T21:48:04.050789] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T21:48:04.074064] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-23T21:48:04.799428] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-23T21:48:05.599424] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-23T21:48:06.197264] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-23T21:48:06.399411] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-23T21:48:07.199410] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-23T21:48:07.461757] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T21:48:07.948353] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (3.15 seconds). [2025-10-23T21:48:07.999409] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-23T21:48:08.088990] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T21:48:08.674853] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T21:48:08.799483] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-23T21:48:09.599509] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-23T21:48:09.911848] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T21:48:10.399457] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-23T21:48:10.697739] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T21:48:11.199544] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-23T21:48:11.762014] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-23T21:48:11.844020] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T21:48:11.999406] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-23T21:48:12.641741] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T21:48:12.799492] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-23T21:48:13.579370] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T21:48:13.599407] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-23T21:48:13.705955] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T21:48:14.285765] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T21:48:14.399444] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-23T21:48:15.199449] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-23T21:48:15.359977] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T21:48:15.363041] [INFO ] [REMOTE ] HCI: Full fetch complete (19558 records). [2025-10-23T21:48:15.363152] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-23T21:48:15.729363] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-23T21:48:15.729513] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-23T21:48:15.729992] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-23T21:48:15.730088] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-23T21:48:15.730748] [DEBUG] [LOCAL ] HCI: Trimmed 19558 records to 14149 (keeping 200 days of data) [2025-10-23T21:48:15.816419] [DEBUG] [LOCAL ] HCI: Primary data saved (14149 records). [2025-10-23T21:48:15.816579] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-23T21:48:15.816731] [INFO ] [MAIN ] Update Progress: 1002/2367 symbols completed. HCI took 23.1s. Estimated remaining: 2h 54m 38s. Rate: 7.8 symbols/min [2025-10-23T21:48:15.984794] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:16.001999] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-23T21:48:16.017776] [DEBUG] [LOCAL ] HEI: Loaded 30521 existing records from primary storage. [2025-10-23T21:48:16.018338] [INFO ] [MAIN ] HEI: Loaded 30521 existing records. [2025-10-23T21:48:16.193380] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:48:16.193702] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-23T21:48:16.193815] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-23T21:48:16.194084] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-23T21:48:16.194169] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-23T21:48:16.541324] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:16.799416] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-23T21:48:17.266151] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T21:48:17.599444] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-23T21:48:17.689674] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T21:48:18.384113] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T21:48:18.399395] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-23T21:48:19.199453] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-23T21:48:19.716723] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T21:48:19.828665] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T21:48:19.999438] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-23T21:48:20.799469] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-23T21:48:20.950078] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T21:48:21.519616] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T21:48:21.599403] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-23T21:48:22.399438] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-23T21:48:23.012405] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T21:48:23.199405] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-23T21:48:23.999416] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-23T21:48:24.145963] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:48:24.573773] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (3.77 seconds). [2025-10-23T21:48:24.799402] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-23T21:48:25.599407] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-23T21:48:25.923681] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-23T21:48:25.958160] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T21:48:26.399414] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-23T21:48:26.913246] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-23T21:48:27.199440] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-23T21:48:27.367228] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:48:27.406114] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T21:48:27.999453] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-23T21:48:28.735916] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T21:48:28.799466] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-23T21:48:29.599412] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-23T21:48:29.792784] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T21:48:30.399426] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-23T21:48:30.562193] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T21:48:30.909129] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T21:48:31.199453] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-23T21:48:31.999419] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-23T21:48:32.172715] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T21:48:32.181977] [INFO ] [REMOTE ] HDB: Full fetch complete (75658 records). [2025-10-23T21:48:32.182136] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-23T21:48:32.598135] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-23T21:48:32.604683] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-23T21:48:32.618043] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T21:48:32.617172] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-23T21:48:32.624465] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-23T21:48:32.627227] [DEBUG] [LOCAL ] HDB: Trimmed 75658 records to 52296 (keeping 200 days of data) [2025-10-23T21:48:32.765669] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T21:48:32.842298] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-23T21:48:32.854240] [INFO ] [REMOTE ] HD: Full fetch complete (77547 records). [2025-10-23T21:48:32.883260] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-23T21:48:33.178386] [DEBUG] [LOCAL ] HDB: Primary data saved (52296 records). [2025-10-23T21:48:33.229696] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-23T21:48:33.262206] [INFO ] [MAIN ] Update Progress: 1003/2367 symbols completed. HDB took 40.5s. Estimated remaining: 2h 54m 44s. Rate: 7.8 symbols/min [2025-10-23T21:48:33.559441] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-23T21:48:33.581917] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-23T21:48:33.581812] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:33.583260] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-23T21:48:33.583426] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-23T21:48:33.585537] [DEBUG] [LOCAL ] HD: Trimmed 77547 records to 53854 (keeping 200 days of data) [2025-10-23T21:48:33.641483] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-23T21:48:33.678968] [DEBUG] [LOCAL ] HEQ: Loaded 6756 existing records from primary storage. [2025-10-23T21:48:33.683984] [INFO ] [MAIN ] HEQ: Loaded 6756 existing records. [2025-10-23T21:48:34.003095] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:48:34.027045] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-23T21:48:34.027189] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-23T21:48:34.027436] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-23T21:48:34.027527] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-23T21:48:34.329236] [DEBUG] [LOCAL ] HD: Primary data saved (53854 records). [2025-10-23T21:48:34.385875] [INFO ] [MAIN ] HD: Full history saved. [2025-10-23T21:48:34.402951] [INFO ] [MAIN ] Update Progress: 1004/2367 symbols completed. HD took 41.6s. Estimated remaining: 2h 54m 27s. Rate: 7.8 symbols/min [2025-10-23T21:48:34.560047] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:34.576454] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-23T21:48:34.666831] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:34.694098] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T21:48:34.702792] [INFO ] [REMOTE ] HE: Full fetch complete (72030 records). [2025-10-23T21:48:34.703013] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-23T21:48:35.004639] [DEBUG] [LOCAL ] HESM: Loaded 48607 existing records from primary storage. [2025-10-23T21:48:35.040749] [INFO ] [MAIN ] HESM: Loaded 48607 existing records. [2025-10-23T21:48:35.226018] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T21:48:35.243079] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-23T21:48:35.260048] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-23T21:48:35.272174] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-23T21:48:35.273362] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-23T21:48:35.316311] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T21:48:35.315451] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-23T21:48:35.365285] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:48:35.365909] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-23T21:48:35.366094] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-23T21:48:35.366487] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-23T21:48:35.366562] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-23T21:48:35.366733] [DEBUG] [LOCAL ] HE: Trimmed 72030 records to 49115 (keeping 200 days of data) [2025-10-23T21:48:35.937918] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:36.008702] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-23T21:48:36.025205] [DEBUG] [LOCAL ] HE: Primary data saved (49115 records). [2025-10-23T21:48:36.025362] [INFO ] [MAIN ] HE: Full history saved. [2025-10-23T21:48:36.026684] [INFO ] [MAIN ] Update Progress: 1005/2367 symbols completed. HE took 35.6s. Estimated remaining: 2h 54m 11s. Rate: 7.8 symbols/min [2025-10-23T21:48:36.194773] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:36.194975] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-23T21:48:36.195046] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-23T21:48:36.195184] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-23T21:48:36.195271] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-23T21:48:36.195355] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-23T21:48:36.195486] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-23T21:48:36.548201] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:36.559001] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T21:48:36.563281] [INFO ] [REMOTE ] HEI: Full fetch complete (47192 records). [2025-10-23T21:48:36.563453] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-23T21:48:36.811415] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-23T21:48:36.941917] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-23T21:48:36.942033] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-23T21:48:36.942845] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-23T21:48:36.942923] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-23T21:48:36.943969] [DEBUG] [LOCAL ] HEI: Trimmed 47192 records to 30697 (keeping 200 days of data) [2025-10-23T21:48:37.131032] [DEBUG] [LOCAL ] HEI: Primary data saved (30697 records). [2025-10-23T21:48:37.131206] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-23T21:48:37.131339] [INFO ] [MAIN ] Update Progress: 1006/2367 symbols completed. HEI took 21.3s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-10-23T21:48:37.304405] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:37.304597] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-23T21:48:37.304694] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-23T21:48:37.304782] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-23T21:48:37.304891] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-23T21:48:37.304983] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-23T21:48:37.305040] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-23T21:48:37.627176] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-23T21:48:37.663871] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:37.669250] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T21:48:37.773408] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T21:48:37.934808] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-23T21:48:38.399435] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-23T21:48:38.914275] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-23T21:48:39.199433] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-23T21:48:39.999427] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-23T21:48:40.346636] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-23T21:48:40.772203] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T21:48:40.799409] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-23T21:48:41.599478] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-23T21:48:41.853794] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-23T21:48:42.399499] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-23T21:48:42.515438] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T21:48:42.823245] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-23T21:48:43.199447] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-23T21:48:43.450892] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-23T21:48:43.999445] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-23T21:48:44.755973] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-23T21:48:44.799410] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-23T21:48:45.599451] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-23T21:48:46.279548] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-23T21:48:46.399410] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-23T21:48:46.581568] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T21:48:46.733242] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T21:48:47.199432] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-23T21:48:47.999441] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-23T21:48:48.256394] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-23T21:48:48.756558] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T21:48:48.799395] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-23T21:48:49.599444] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-23T21:48:50.088854] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-23T21:48:50.399540] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-23T21:48:50.473195] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T21:48:50.646395] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-23T21:48:51.199524] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-23T21:48:51.453071] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-23T21:48:51.999441] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-23T21:48:52.585479] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T21:48:52.799430] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-23T21:48:53.581624] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T21:48:53.599423] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-23T21:48:54.399538] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-23T21:48:54.647069] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-23T21:48:55.199408] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-23T21:48:55.303159] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T21:48:55.862006] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-23T21:48:55.999460] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-23T21:48:56.799439] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-23T21:48:56.824588] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:48:57.040199] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-23T21:48:57.599449] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-23T21:48:57.963197] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-23T21:48:58.399453] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-23T21:48:58.653001] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-23T21:48:58.653785] [INFO ] [REMOTE ] HF: Full fetch complete (420 records). [2025-10-23T21:48:58.653889] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-23T21:48:58.845525] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-23T21:48:58.845732] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:48:58.845817] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:48:58.845918] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-23T21:48:58.846051] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-23T21:48:58.846164] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-23T21:48:58.846269] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-23T21:48:58.846406] [INFO ] [MAIN ] Update Progress: 1007/2367 symbols completed. HF took 22.8s. Estimated remaining: 2h 54m 6s. Rate: 7.8 symbols/min [2025-10-23T21:48:59.023583] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:48:59.041752] [DEBUG] [LOCAL ] HFRO: Loaded 16376 existing records from primary storage. [2025-10-23T21:48:59.042035] [INFO ] [MAIN ] HFRO: Loaded 16376 existing records. [2025-10-23T21:48:59.217981] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:48:59.218311] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-23T21:48:59.218409] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-23T21:48:59.212705] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-23T21:48:59.219502] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-23T21:48:59.219591] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-23T21:48:59.582301] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:48:59.999412] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-23T21:49:00.799455] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-23T21:49:00.932363] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T21:49:01.191166] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-23T21:49:01.268461] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T21:49:01.599464] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-23T21:49:01.935741] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-23T21:49:02.399505] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-23T21:49:02.828638] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-23T21:49:03.199439] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-23T21:49:03.641085] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T21:49:03.999449] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-23T21:49:04.750762] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T21:49:04.752954] [INFO ] [REMOTE ] HEQ: Full fetch complete (9568 records). [2025-10-23T21:49:04.753047] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-23T21:49:04.805567] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-23T21:49:05.182828] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-23T21:49:05.182948] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-23T21:49:05.183232] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-23T21:49:05.183309] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-23T21:49:05.183854] [DEBUG] [LOCAL ] HEQ: Trimmed 9568 records to 6802 (keeping 200 days of data) [2025-10-23T21:49:05.227738] [DEBUG] [LOCAL ] HEQ: Primary data saved (6802 records). [2025-10-23T21:49:05.227890] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-23T21:49:05.228065] [INFO ] [MAIN ] Update Progress: 1008/2367 symbols completed. HEQ took 32.0s. Estimated remaining: 2h 53m 57s. Rate: 7.8 symbols/min [2025-10-23T21:49:05.325228] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-23T21:49:05.414661] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:05.431103] [DEBUG] [LOCAL ] HGER: Loaded 15543 existing records from primary storage. [2025-10-23T21:49:05.431406] [INFO ] [MAIN ] HGER: Loaded 15543 existing records. [2025-10-23T21:49:05.604539] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-23T21:49:05.608480] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:05.609669] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-23T21:49:05.609753] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-23T21:49:05.609958] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-23T21:49:05.610033] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-23T21:49:05.971099] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:06.137516] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-23T21:49:06.138503] [INFO ] [REMOTE ] HFND: Full fetch complete (1763 records). [2025-10-23T21:49:06.138595] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-23T21:49:06.317865] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-23T21:49:06.318103] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:49:06.318178] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:49:06.318337] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-23T21:49:06.318436] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-23T21:49:06.318510] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-23T21:49:06.318611] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-23T21:49:06.318747] [INFO ] [MAIN ] Update Progress: 1009/2367 symbols completed. HFND took 29.2s. Estimated remaining: 2h 53m 40s. Rate: 7.8 symbols/min [2025-10-23T21:49:06.404689] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-23T21:49:06.488574] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:06.500064] [DEBUG] [LOCAL ] HGLB: Loaded 9621 existing records from primary storage. [2025-10-23T21:49:06.500324] [INFO ] [MAIN ] HGLB: Loaded 9621 existing records. [2025-10-23T21:49:06.677092] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:06.677325] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-23T21:49:06.677407] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-23T21:49:06.677635] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-23T21:49:06.677747] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-23T21:49:07.026902] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:07.199407] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-23T21:49:07.591437] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T21:49:07.999472] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-23T21:49:08.017709] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T21:49:08.799428] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-23T21:49:09.118913] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T21:49:09.599463] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-23T21:49:10.206589] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T21:49:10.399428] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-23T21:49:10.435339] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T21:49:11.199437] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-23T21:49:11.999417] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-23T21:49:12.198933] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T21:49:12.207693] [INFO ] [REMOTE ] HESM: Full fetch complete (69939 records). [2025-10-23T21:49:12.207865] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-23T21:49:12.333286] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T21:49:12.620789] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-23T21:49:12.620900] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-23T21:49:12.621867] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-23T21:49:12.621947] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-23T21:49:12.623360] [DEBUG] [LOCAL ] HESM: Trimmed 69939 records to 48963 (keeping 200 days of data) [2025-10-23T21:49:12.736811] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T21:49:12.801000] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-23T21:49:12.925088] [DEBUG] [LOCAL ] HESM: Primary data saved (48963 records). [2025-10-23T21:49:12.925275] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-23T21:49:12.925386] [INFO ] [MAIN ] Update Progress: 1010/2367 symbols completed. HESM took 38.5s. Estimated remaining: 2h 53m 31s. Rate: 7.8 symbols/min [2025-10-23T21:49:13.090729] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:13.105268] [DEBUG] [LOCAL ] HGTY: Loaded 13361 existing records from primary storage. [2025-10-23T21:49:13.105527] [INFO ] [MAIN ] HGTY: Loaded 13361 existing records. [2025-10-23T21:49:13.284903] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:13.285106] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-23T21:49:13.285180] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-23T21:49:13.285412] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-23T21:49:13.285486] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-23T21:49:13.604626] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-23T21:49:13.661951] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:13.731434] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T21:49:14.256768] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T21:49:14.399457] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-23T21:49:15.199442] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-23T21:49:15.282189] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-23T21:49:15.959242] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T21:49:15.999464] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-23T21:49:16.755488] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T21:49:16.799441] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-23T21:49:17.599444] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-23T21:49:17.755615] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T21:49:18.399415] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-23T21:49:18.506635] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-23T21:49:19.199432] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-23T21:49:19.452449] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T21:49:19.992447] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T21:49:19.999385] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-23T21:49:20.786289] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T21:49:20.799437] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-23T21:49:21.586961] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T21:49:21.599392] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-23T21:49:22.111127] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-23T21:49:22.399448] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-23T21:49:23.199432] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-23T21:49:23.404117] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-23T21:49:23.999455] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-23T21:49:24.764489] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T21:49:24.799497] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-23T21:49:25.599444] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-23T21:49:25.766698] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-23T21:49:26.370352] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T21:49:26.399411] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-23T21:49:26.441513] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T21:49:27.194470] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T21:49:27.199383] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-23T21:49:27.999418] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-23T21:49:28.055251] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-23T21:49:28.647299] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-23T21:49:28.799454] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-23T21:49:29.599426] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-23T21:49:29.892822] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T21:49:30.081571] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-23T21:49:30.399445] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-23T21:49:31.159830] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T21:49:31.199424] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-23T21:49:31.909459] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T21:49:31.999433] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-23T21:49:32.779875] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T21:49:32.799396] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-23T21:49:33.599425] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-23T21:49:33.813512] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T21:49:34.399421] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-23T21:49:34.634849] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T21:49:35.199437] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-23T21:49:35.458146] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T21:49:35.999445] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-23T21:49:36.048416] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T21:49:36.050946] [INFO ] [REMOTE ] HGLB: Full fetch complete (14377 records). [2025-10-23T21:49:36.051038] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-23T21:49:36.410671] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-23T21:49:36.410783] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-23T21:49:36.411218] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-23T21:49:36.411295] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-23T21:49:36.411841] [DEBUG] [LOCAL ] HGLB: Trimmed 14377 records to 9671 (keeping 200 days of data) [2025-10-23T21:49:36.468196] [DEBUG] [LOCAL ] HGLB: Primary data saved (9671 records). [2025-10-23T21:49:36.468356] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-23T21:49:36.468478] [INFO ] [MAIN ] Update Progress: 1011/2367 symbols completed. HGLB took 30.1s. Estimated remaining: 2h 53m 45s. Rate: 7.8 symbols/min [2025-10-23T21:49:36.643329] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:36.683893] [DEBUG] [LOCAL ] HGV: Loaded 46058 existing records from primary storage. [2025-10-23T21:49:36.684265] [INFO ] [MAIN ] HGV: Loaded 46058 existing records. [2025-10-23T21:49:36.804585] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-23T21:49:36.869699] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:36.870082] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-23T21:49:36.870247] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-23T21:49:36.870552] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-23T21:49:36.870628] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-23T21:49:37.140138] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-23T21:49:37.183115] [INFO ] [REMOTE ] HGER: Full fetch complete (19172 records). [2025-10-23T21:49:37.199116] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-23T21:49:37.361808] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:37.613195] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-23T21:49:37.622999] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-23T21:49:37.623828] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-23T21:49:37.624329] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-23T21:49:37.624405] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-23T21:49:37.625074] [DEBUG] [LOCAL ] HGER: Trimmed 19172 records to 15736 (keeping 200 days of data) [2025-10-23T21:49:37.719328] [DEBUG] [LOCAL ] HGER: Primary data saved (15736 records). [2025-10-23T21:49:37.719494] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-23T21:49:37.719615] [INFO ] [MAIN ] Update Progress: 1012/2367 symbols completed. HGER took 32.5s. Estimated remaining: 2h 53m 28s. Rate: 7.8 symbols/min [2025-10-23T21:49:37.895809] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:37.928849] [DEBUG] [LOCAL ] HHH: Loaded 33047 existing records from primary storage. [2025-10-23T21:49:37.929136] [INFO ] [MAIN ] HHH: Loaded 33047 existing records. [2025-10-23T21:49:38.074349] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T21:49:38.135077] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:38.135322] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-23T21:49:38.135413] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-23T21:49:38.135694] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-23T21:49:38.135782] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-23T21:49:38.399594] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-23T21:49:38.519492] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:38.624140] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T21:49:38.627074] [INFO ] [REMOTE ] HFRO: Full fetch complete (26724 records). [2025-10-23T21:49:38.627190] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-23T21:49:39.004546] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-23T21:49:39.004684] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-23T21:49:39.005281] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-23T21:49:39.005355] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-23T21:49:39.006106] [DEBUG] [LOCAL ] HFRO: Trimmed 26724 records to 16411 (keeping 200 days of data) [2025-10-23T21:49:39.101183] [DEBUG] [LOCAL ] HFRO: Primary data saved (16411 records). [2025-10-23T21:49:39.101360] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-23T21:49:39.101470] [INFO ] [MAIN ] Update Progress: 1013/2367 symbols completed. HFRO took 40.3s. Estimated remaining: 2h 53m 12s. Rate: 7.8 symbols/min [2025-10-23T21:49:39.200856] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-23T21:49:39.270515] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:39.308085] [DEBUG] [LOCAL ] HI: Loaded 36110 existing records from primary storage. [2025-10-23T21:49:39.308399] [INFO ] [MAIN ] HI: Loaded 36110 existing records. [2025-10-23T21:49:39.484837] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:39.485062] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-23T21:49:39.485159] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-23T21:49:39.485404] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-23T21:49:39.485493] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-23T21:49:39.844435] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:39.934664] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T21:49:39.952027] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T21:49:39.952713] [INFO ] [REMOTE ] HGTY: Full fetch complete (17593 records). [2025-10-23T21:49:39.960583] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-23T21:49:40.004678] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-23T21:49:40.322748] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-23T21:49:40.322871] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-23T21:49:40.323293] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-23T21:49:40.323386] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-23T21:49:40.323984] [DEBUG] [LOCAL ] HGTY: Trimmed 17593 records to 13442 (keeping 200 days of data) [2025-10-23T21:49:40.398223] [DEBUG] [LOCAL ] HGTY: Primary data saved (13442 records). [2025-10-23T21:49:40.398392] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-23T21:49:40.398522] [INFO ] [MAIN ] Update Progress: 1014/2367 symbols completed. HGTY took 27.5s. Estimated remaining: 2h 52m 56s. Rate: 7.8 symbols/min [2025-10-23T21:49:40.566153] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:49:40.614778] [DEBUG] [LOCAL ] HIG: Loaded 51135 existing records from primary storage. [2025-10-23T21:49:40.615106] [INFO ] [MAIN ] HIG: Loaded 51135 existing records. [2025-10-23T21:49:40.789293] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:49:40.789487] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-23T21:49:40.789559] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-23T21:49:40.789824] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-23T21:49:40.789904] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-23T21:49:40.810102] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-23T21:49:41.151310] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:49:41.599420] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-23T21:49:42.000432] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T21:49:42.410813] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-23T21:49:42.445121] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T21:49:42.958845] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T21:49:43.199495] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-23T21:49:43.812455] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T21:49:43.999538] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-23T21:49:44.672123] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T21:49:44.799439] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-23T21:49:44.943088] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T21:49:45.599475] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-23T21:49:46.217747] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T21:49:46.399522] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-23T21:49:47.199512] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-23T21:49:47.234322] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T21:49:47.999479] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-23T21:49:48.074675] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T21:49:48.720628] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T21:49:48.799476] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-23T21:49:49.590847] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T21:49:49.600540] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-23T21:49:50.002593] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T21:49:50.399481] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-23T21:49:50.865260] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T21:49:51.199458] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-23T21:49:51.999410] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-23T21:49:52.188536] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T21:49:52.545257] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T21:49:52.799428] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-23T21:49:53.345361] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T21:49:53.599442] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-23T21:49:54.195702] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T21:49:54.399441] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-23T21:49:54.945797] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T21:49:55.199453] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-23T21:49:55.905850] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T21:49:55.999425] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-23T21:49:56.320956] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T21:49:56.799476] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-23T21:49:57.563604] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T21:49:57.599407] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-23T21:49:57.734839] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T21:49:58.399447] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-23T21:49:59.154221] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:49:59.199446] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-23T21:49:59.818831] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T21:49:59.999426] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-23T21:50:00.717076] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T21:50:00.799447] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-23T21:50:01.457831] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T21:50:01.599472] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-23T21:50:02.241954] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T21:50:02.249534] [INFO ] [REMOTE ] HI: Full fetch complete (51381 records). [2025-10-23T21:50:02.249762] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-23T21:50:02.404529] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-23T21:50:02.651840] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-23T21:50:02.651957] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-23T21:50:02.652872] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-23T21:50:02.652952] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-23T21:50:02.654398] [DEBUG] [LOCAL ] HI: Trimmed 51381 records to 36466 (keeping 200 days of data) [2025-10-23T21:50:02.874855] [DEBUG] [LOCAL ] HI: Primary data saved (36466 records). [2025-10-23T21:50:02.875050] [INFO ] [MAIN ] HI: Full history saved. [2025-10-23T21:50:02.875173] [INFO ] [MAIN ] Update Progress: 1015/2367 symbols completed. HI took 23.8s. Estimated remaining: 2h 53m 8s. Rate: 7.8 symbols/min [2025-10-23T21:50:03.045970] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:03.079770] [DEBUG] [LOCAL ] HII: Loaded 33319 existing records from primary storage. [2025-10-23T21:50:03.080070] [INFO ] [MAIN ] HII: Loaded 33319 existing records. [2025-10-23T21:50:03.203596] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-23T21:50:03.263026] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:03.263439] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-23T21:50:03.263530] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-23T21:50:03.263860] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-23T21:50:03.263950] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-23T21:50:03.629094] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:03.696252] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T21:50:03.999412] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-23T21:50:04.245084] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T21:50:04.313183] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T21:50:04.799484] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-23T21:50:05.601683] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-23T21:50:05.605998] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T21:50:06.181275] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T21:50:06.186620] [INFO ] [REMOTE ] HHH: Full fetch complete (46231 records). [2025-10-23T21:50:06.186767] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-23T21:50:06.404598] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-23T21:50:06.575610] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-23T21:50:06.575760] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-23T21:50:06.576861] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-23T21:50:06.576939] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-23T21:50:06.578043] [DEBUG] [LOCAL ] HHH: Trimmed 46231 records to 33222 (keeping 200 days of data) [2025-10-23T21:50:06.772401] [DEBUG] [LOCAL ] HHH: Primary data saved (33222 records). [2025-10-23T21:50:06.772568] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-23T21:50:06.772680] [INFO ] [MAIN ] Update Progress: 1016/2367 symbols completed. HHH took 29.1s. Estimated remaining: 2h 52m 55s. Rate: 7.8 symbols/min [2025-10-23T21:50:06.942916] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:06.991718] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-23T21:50:06.992069] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-23T21:50:07.175956] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:07.176321] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-23T21:50:07.176535] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-23T21:50:07.177165] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-23T21:50:07.177243] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-23T21:50:07.213595] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-23T21:50:07.384338] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T21:50:07.576219] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:07.999407] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-23T21:50:08.121227] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T21:50:08.799422] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-23T21:50:09.253377] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T21:50:09.565469] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T21:50:09.572887] [INFO ] [REMOTE ] HGV: Full fetch complete (65869 records). [2025-10-23T21:50:09.573039] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-23T21:50:09.604710] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-23T21:50:09.957848] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-23T21:50:09.958008] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-23T21:50:09.958968] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-23T21:50:09.959049] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-23T21:50:09.960445] [DEBUG] [LOCAL ] HGV: Trimmed 65869 records to 46371 (keeping 200 days of data) [2025-10-23T21:50:10.216590] [DEBUG] [LOCAL ] HGV: Primary data saved (46371 records). [2025-10-23T21:50:10.216920] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-23T21:50:10.217039] [INFO ] [MAIN ] Update Progress: 1017/2367 symbols completed. HGV took 33.7s. Estimated remaining: 2h 52m 42s. Rate: 7.8 symbols/min [2025-10-23T21:50:10.384290] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:10.399421] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-23T21:50:10.408122] [DEBUG] [LOCAL ] HIO: Loaded 23941 existing records from primary storage. [2025-10-23T21:50:10.408382] [INFO ] [MAIN ] HIO: Loaded 23941 existing records. [2025-10-23T21:50:10.590114] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:10.590504] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-23T21:50:10.590587] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-23T21:50:10.590965] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-23T21:50:10.591042] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-23T21:50:10.791959] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T21:50:11.000868] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:11.204563] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-23T21:50:11.218534] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T21:50:11.999485] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-23T21:50:12.503109] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T21:50:12.799445] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-23T21:50:12.904847] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-23T21:50:13.512522] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T21:50:13.599403] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-23T21:50:13.974129] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T21:50:14.399470] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-23T21:50:15.199443] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-23T21:50:15.999422] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-23T21:50:16.436598] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-23T21:50:16.513509] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T21:50:16.799465] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-23T21:50:16.976940] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-23T21:50:17.443486] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T21:50:17.599483] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-23T21:50:18.399421] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-23T21:50:18.561524] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T21:50:18.754922] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T21:50:19.199442] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-23T21:50:19.896214] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T21:50:19.904905] [INFO ] [REMOTE ] HIG: Full fetch complete (73683 records). [2025-10-23T21:50:19.905053] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-23T21:50:20.004565] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-23T21:50:20.295833] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-23T21:50:20.295949] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-23T21:50:20.296954] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-23T21:50:20.297033] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-23T21:50:20.298509] [DEBUG] [LOCAL ] HIG: Trimmed 73683 records to 51458 (keeping 200 days of data) [2025-10-23T21:50:20.606872] [DEBUG] [LOCAL ] HIG: Primary data saved (51458 records). [2025-10-23T21:50:20.607029] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-23T21:50:20.607142] [INFO ] [MAIN ] Update Progress: 1018/2367 symbols completed. HIG took 40.2s. Estimated remaining: 2h 52m 38s. Rate: 7.8 symbols/min [2025-10-23T21:50:20.776864] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:20.796977] [DEBUG] [LOCAL ] HIPO: Loaded 21379 existing records from primary storage. [2025-10-23T21:50:20.797287] [INFO ] [MAIN ] HIPO: Loaded 21379 existing records. [2025-10-23T21:50:20.829126] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-23T21:50:20.984042] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:20.984432] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-23T21:50:20.984670] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-23T21:50:20.984955] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-23T21:50:20.985040] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-23T21:50:21.135579] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T21:50:21.384770] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:21.414570] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (3.02 seconds). [2025-10-23T21:50:21.599423] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-23T21:50:22.135729] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T21:50:22.250854] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T21:50:22.399435] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-23T21:50:23.199456] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-23T21:50:23.999428] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-23T21:50:24.264960] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T21:50:24.799406] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-23T21:50:25.124493] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T21:50:25.507826] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-23T21:50:25.599408] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-23T21:50:26.399408] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-23T21:50:26.728599] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T21:50:27.199425] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-23T21:50:27.364889] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (4.97 seconds). [2025-10-23T21:50:27.646121] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T21:50:27.999426] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-23T21:50:28.732555] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T21:50:28.799408] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-23T21:50:29.268853] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T21:50:29.599449] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-23T21:50:30.399435] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-23T21:50:30.999070] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T21:50:31.199410] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-23T21:50:31.513913] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-23T21:50:31.600465] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T21:50:31.999436] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-23T21:50:32.663563] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T21:50:32.799424] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-23T21:50:33.378009] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T21:50:33.384127] [INFO ] [REMOTE ] HIO: Full fetch complete (38168 records). [2025-10-23T21:50:33.384286] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-23T21:50:33.604998] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-23T21:50:33.782338] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-23T21:50:33.782455] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-23T21:50:33.783276] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-23T21:50:33.783367] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-23T21:50:33.784264] [DEBUG] [LOCAL ] HIO: Trimmed 38168 records to 24111 (keeping 200 days of data) [2025-10-23T21:50:33.917031] [DEBUG] [LOCAL ] HIO: Primary data saved (24111 records). [2025-10-23T21:50:33.917182] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-23T21:50:33.917287] [INFO ] [MAIN ] Update Progress: 1019/2367 symbols completed. HIO took 23.7s. Estimated remaining: 2h 52m 38s. Rate: 7.8 symbols/min [2025-10-23T21:50:34.087615] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:34.104550] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T21:50:34.144179] [DEBUG] [LOCAL ] HIW: Loaded 44400 existing records from primary storage. [2025-10-23T21:50:34.144503] [INFO ] [MAIN ] HIW: Loaded 44400 existing records. [2025-10-23T21:50:34.321578] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:34.321860] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-23T21:50:34.321933] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-23T21:50:34.322206] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-23T21:50:34.322279] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-23T21:50:34.404760] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-23T21:50:34.692328] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:35.208121] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-23T21:50:35.230853] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T21:50:35.999417] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-23T21:50:36.365052] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T21:50:36.799463] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-23T21:50:37.091678] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-23T21:50:37.488338] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T21:50:37.599422] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-23T21:50:37.840993] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:50:38.399427] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-23T21:50:39.056309] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T21:50:39.175562] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T21:50:39.199392] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-23T21:50:39.999418] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-23T21:50:40.084053] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T21:50:40.087237] [INFO ] [REMOTE ] HIPO: Full fetch complete (30987 records). [2025-10-23T21:50:40.087350] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-23T21:50:40.452820] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-23T21:50:40.452926] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-23T21:50:40.453545] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-23T21:50:40.453635] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-23T21:50:40.454403] [DEBUG] [LOCAL ] HIPO: Trimmed 30987 records to 21492 (keeping 200 days of data) [2025-10-23T21:50:40.573357] [DEBUG] [LOCAL ] HIPO: Primary data saved (21492 records). [2025-10-23T21:50:40.573509] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-23T21:50:40.573618] [INFO ] [MAIN ] Update Progress: 1020/2367 symbols completed. HIPO took 20.0s. Estimated remaining: 2h 52m 29s. Rate: 7.8 symbols/min [2025-10-23T21:50:40.739383] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:40.758578] [DEBUG] [LOCAL ] HIX: Loaded 20442 existing records from primary storage. [2025-10-23T21:50:40.758858] [INFO ] [MAIN ] HIX: Loaded 20442 existing records. [2025-10-23T21:50:40.804624] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-23T21:50:40.936788] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:40.937051] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-23T21:50:40.937125] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-23T21:50:40.937326] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-23T21:50:40.937397] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-23T21:50:41.284176] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:41.599460] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-23T21:50:42.399401] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-23T21:50:42.515070] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T21:50:42.644369] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T21:50:42.743801] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-23T21:50:43.199435] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-23T21:50:43.650506] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T21:50:43.999439] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-23T21:50:44.799418] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-23T21:50:45.067978] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T21:50:45.599443] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-23T21:50:45.912781] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-23T21:50:46.230059] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T21:50:46.235521] [INFO ] [REMOTE ] HII: Full fetch complete (52283 records). [2025-10-23T21:50:46.235636] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-23T21:50:46.405122] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-23T21:50:46.618743] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-23T21:50:46.618872] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-23T21:50:46.619887] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-23T21:50:46.619983] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-23T21:50:46.621102] [DEBUG] [LOCAL ] HII: Trimmed 52283 records to 33565 (keeping 200 days of data) [2025-10-23T21:50:46.826131] [DEBUG] [LOCAL ] HII: Primary data saved (33565 records). [2025-10-23T21:50:46.826281] [INFO ] [MAIN ] HII: Full history saved. [2025-10-23T21:50:46.826389] [INFO ] [MAIN ] Update Progress: 1021/2367 symbols completed. HII took 44.0s. Estimated remaining: 2h 52m 19s. Rate: 7.8 symbols/min [2025-10-23T21:50:46.998686] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:47.015965] [DEBUG] [LOCAL ] HKD: Loaded 18679 existing records from primary storage. [2025-10-23T21:50:47.016219] [INFO ] [MAIN ] HKD: Loaded 18679 existing records. [2025-10-23T21:50:47.201239] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:47.201440] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-23T21:50:47.201638] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-23T21:50:47.201934] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-23T21:50:47.202884] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-23T21:50:47.202970] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-23T21:50:47.367235] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T21:50:47.587801] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:47.999434] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-23T21:50:48.281544] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T21:50:48.799398] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-23T21:50:49.070024] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T21:50:49.264750] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-23T21:50:49.599437] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-23T21:50:49.906437] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T21:50:50.399465] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-23T21:50:50.873872] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T21:50:51.199450] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-23T21:50:51.999456] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-23T21:50:52.339096] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T21:50:52.799468] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-23T21:50:53.067069] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.67 seconds). [2025-10-23T21:50:53.077670] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-23T21:50:53.077989] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-23T21:50:53.490072] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-23T21:50:53.490418] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-23T21:50:53.491816] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-23T21:50:53.492163] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-23T21:50:53.538778] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54207 (keeping 200 days of data) [2025-10-23T21:50:53.541285] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T21:50:53.546864] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T21:50:53.607970] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-23T21:50:53.911254] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-10-23T21:50:53.911425] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-23T21:50:53.911535] [INFO ] [MAIN ] Update Progress: 1022/2367 symbols completed. HIMS took 47.1s. Estimated remaining: 2h 52m 11s. Rate: 7.8 symbols/min [2025-10-23T21:50:54.080461] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:50:54.129185] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-23T21:50:54.129562] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-23T21:50:54.305923] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:50:54.306287] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-23T21:50:54.306560] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-23T21:50:54.312519] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-23T21:50:54.316566] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-23T21:50:54.349892] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T21:50:54.400102] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-23T21:50:54.690180] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:50:55.199408] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-23T21:50:55.433170] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T21:50:55.972639] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T21:50:55.999399] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-23T21:50:56.799466] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-23T21:50:57.276319] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T21:50:57.599430] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-23T21:50:58.330447] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T21:50:58.399399] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-23T21:50:59.199402] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-23T21:50:59.560010] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T21:51:00.007022] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-23T21:51:00.008821] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T21:51:00.344362] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T21:51:00.799429] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-23T21:51:01.599442] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-23T21:51:01.784546] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-23T21:51:02.399407] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-23T21:51:02.802379] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-23T21:51:03.201349] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-23T21:51:03.206562] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T21:51:03.360495] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T21:51:03.999449] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-23T21:51:04.799422] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-23T21:51:05.164993] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T21:51:05.202422] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T21:51:05.599445] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-23T21:51:06.338190] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T21:51:06.399408] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-23T21:51:06.736919] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T21:51:07.199465] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-23T21:51:07.901376] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T21:51:07.909623] [INFO ] [REMOTE ] HIW: Full fetch complete (64941 records). [2025-10-23T21:51:07.909849] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-23T21:51:08.004626] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-23T21:51:08.346395] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-23T21:51:08.346513] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-23T21:51:08.347529] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-23T21:51:08.347610] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-23T21:51:08.349032] [DEBUG] [LOCAL ] HIW: Trimmed 64941 records to 44737 (keeping 200 days of data) [2025-10-23T21:51:08.616957] [DEBUG] [LOCAL ] HIW: Primary data saved (44737 records). [2025-10-23T21:51:08.617234] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-23T21:51:08.617349] [INFO ] [MAIN ] Update Progress: 1023/2367 symbols completed. HIW took 34.7s. Estimated remaining: 2h 52m 12s. Rate: 7.8 symbols/min [2025-10-23T21:51:08.783299] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:08.806077] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-23T21:51:08.826137] [DEBUG] [LOCAL ] HLF: Loaded 48453 existing records from primary storage. [2025-10-23T21:51:08.826476] [INFO ] [MAIN ] HLF: Loaded 48453 existing records. [2025-10-23T21:51:09.003080] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:09.003386] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-23T21:51:09.003473] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-23T21:51:09.003837] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-23T21:51:09.003926] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-23T21:51:09.269243] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T21:51:09.386827] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:09.418607] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-23T21:51:09.599415] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-23T21:51:10.009487] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T21:51:10.013504] [INFO ] [REMOTE ] HKD: Full fetch complete (27785 records). [2025-10-23T21:51:10.013615] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-23T21:51:10.397817] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-23T21:51:10.397932] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-23T21:51:10.398740] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-23T21:51:10.398824] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-23T21:51:10.399408] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-23T21:51:10.400558] [DEBUG] [LOCAL ] HKD: Trimmed 27785 records to 18788 (keeping 200 days of data) [2025-10-23T21:51:10.509238] [DEBUG] [LOCAL ] HKD: Primary data saved (18788 records). [2025-10-23T21:51:10.509439] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-23T21:51:10.509572] [INFO ] [MAIN ] Update Progress: 1024/2367 symbols completed. HKD took 23.7s. Estimated remaining: 2h 51m 57s. Rate: 7.8 symbols/min [2025-10-23T21:51:10.679227] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:10.712579] [DEBUG] [LOCAL ] HLI: Loaded 30581 existing records from primary storage. [2025-10-23T21:51:10.712925] [INFO ] [MAIN ] HLI: Loaded 30581 existing records. [2025-10-23T21:51:10.889617] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:10.889900] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-23T21:51:10.889981] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-23T21:51:10.890225] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-23T21:51:10.890300] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-23T21:51:11.204574] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-23T21:51:11.241875] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:11.999417] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-23T21:51:12.094685] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T21:51:12.300429] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T21:51:12.304305] [INFO ] [REMOTE ] HIX: Full fetch complete (30062 records). [2025-10-23T21:51:12.304404] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-23T21:51:12.476541] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-23T21:51:12.718904] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-23T21:51:12.719015] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-23T21:51:12.719676] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-23T21:51:12.719753] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-23T21:51:12.720446] [DEBUG] [LOCAL ] HIX: Trimmed 30062 records to 20615 (keeping 200 days of data) [2025-10-23T21:51:12.800712] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-23T21:51:12.838708] [DEBUG] [LOCAL ] HIX: Primary data saved (20615 records). [2025-10-23T21:51:12.838850] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-23T21:51:12.838959] [INFO ] [MAIN ] Update Progress: 1025/2367 symbols completed. HIX took 32.3s. Estimated remaining: 2h 51m 42s. Rate: 7.8 symbols/min [2025-10-23T21:51:13.011572] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:13.039116] [DEBUG] [LOCAL ] HLIO: Loaded 28093 existing records from primary storage. [2025-10-23T21:51:13.039430] [INFO ] [MAIN ] HLIO: Loaded 28093 existing records. [2025-10-23T21:51:13.219095] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:13.219318] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-23T21:51:13.219420] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-23T21:51:13.219739] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-23T21:51:13.219828] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-23T21:51:13.578000] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:13.596321] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T21:51:13.602958] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-23T21:51:14.131772] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T21:51:14.399433] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-23T21:51:14.642978] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T21:51:15.199460] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-23T21:51:15.999421] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-23T21:51:16.211382] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T21:51:16.799425] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-23T21:51:16.909708] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-23T21:51:17.269809] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T21:51:17.599486] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-23T21:51:17.903077] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-23T21:51:18.399481] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-23T21:51:19.199408] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-23T21:51:19.320962] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T21:51:19.632342] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T21:51:19.999436] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-23T21:51:20.378490] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T21:51:20.799410] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-23T21:51:21.599409] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-23T21:51:21.682467] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T21:51:22.399437] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-23T21:51:22.709509] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T21:51:23.122090] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T21:51:23.199410] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-23T21:51:23.999408] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-23T21:51:24.052682] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T21:51:24.655233] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T21:51:24.799452] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-23T21:51:25.454063] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T21:51:25.599418] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-23T21:51:26.354434] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T21:51:26.399401] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-23T21:51:27.199461] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-23T21:51:27.772438] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T21:51:27.999492] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-23T21:51:28.200103] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T21:51:28.232033] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T21:51:28.799423] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-23T21:51:29.599432] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-23T21:51:29.734203] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T21:51:30.115322] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-23T21:51:30.399422] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-23T21:51:30.967672] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T21:51:31.199449] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-23T21:51:31.781335] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T21:51:31.999447] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-23T21:51:32.101948] [DEBUG] [REMOTE ] HLI: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-23T21:51:32.102274] [WARN ] [REMOTE ] HLI: No data returned for month 2025-07 [2025-10-23T21:51:32.102358] [FATAL] [REMOTE ] HLI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:51:32.102477] [FATAL] [MAIN ] HLI: Failed to fetch primary data. [2025-10-23T21:51:32.102557] [WARN ] [MAIN ] HLI: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:51:32.102631] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-23T21:51:32.102739] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-23T21:51:32.102843] [INFO ] [LOCAL ] HLI: Starting deletion of derivative data. [2025-10-23T21:51:32.103192] [DEBUG] [LOCAL ] HLI: Deleted derivative data file. [2025-10-23T21:51:32.103298] [INFO ] [MAIN ] Update Progress: 1026/2367 symbols completed. HLI took 21.6s. Estimated remaining: 2h 51m 50s. Rate: 7.8 symbols/min [2025-10-23T21:51:32.272173] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:32.305084] [DEBUG] [LOCAL ] HLLY: Loaded 33310 existing records from primary storage. [2025-10-23T21:51:32.305390] [INFO ] [MAIN ] HLLY: Loaded 33310 existing records. [2025-10-23T21:51:32.483984] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:32.484279] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-23T21:51:32.484375] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-23T21:51:32.484685] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-23T21:51:32.484772] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-23T21:51:32.804529] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-23T21:51:32.876838] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:33.232209] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-23T21:51:33.241553] [INFO ] [REMOTE ] HL: Full fetch complete (77827 records). [2025-10-23T21:51:33.241735] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-23T21:51:33.610627] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-23T21:51:33.638426] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-23T21:51:33.638554] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-23T21:51:33.639709] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-23T21:51:33.639806] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-23T21:51:33.641574] [DEBUG] [LOCAL ] HL: Trimmed 77827 records to 54066 (keeping 200 days of data) [2025-10-23T21:51:33.955633] [DEBUG] [LOCAL ] HL: Primary data saved (54066 records). [2025-10-23T21:51:33.955812] [INFO ] [MAIN ] HL: Full history saved. [2025-10-23T21:51:33.955923] [INFO ] [MAIN ] Update Progress: 1027/2367 symbols completed. HL took 40.0s. Estimated remaining: 2h 51m 34s. Rate: 7.8 symbols/min [2025-10-23T21:51:34.134713] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:34.196256] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T21:51:34.203628] [DEBUG] [LOCAL ] HLN: Loaded 53128 existing records from primary storage. [2025-10-23T21:51:34.204347] [INFO ] [MAIN ] HLN: Loaded 53128 existing records. [2025-10-23T21:51:34.383410] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:34.383675] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-23T21:51:34.383752] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-23T21:51:34.384027] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-23T21:51:34.384097] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-23T21:51:34.404950] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-23T21:51:34.748630] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:35.199418] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-23T21:51:35.347552] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T21:51:35.569152] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T21:51:35.999450] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-23T21:51:36.057454] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T21:51:36.799430] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-23T21:51:37.570007] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T21:51:37.578246] [INFO ] [REMOTE ] HLF: Full fetch complete (70783 records). [2025-10-23T21:51:37.578407] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-23T21:51:37.609903] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-23T21:51:37.999587] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-23T21:51:38.000470] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-23T21:51:38.000308] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T21:51:38.001745] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-23T21:51:38.006990] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-23T21:51:38.008281] [DEBUG] [LOCAL ] HLF: Trimmed 70783 records to 48722 (keeping 200 days of data) [2025-10-23T21:51:38.282229] [DEBUG] [LOCAL ] HLF: Primary data saved (48722 records). [2025-10-23T21:51:38.282409] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-23T21:51:38.282522] [INFO ] [MAIN ] Update Progress: 1028/2367 symbols completed. HLF took 29.7s. Estimated remaining: 2h 51m 22s. Rate: 7.8 symbols/min [2025-10-23T21:51:38.404582] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-23T21:51:38.454795] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:38.501232] [DEBUG] [LOCAL ] HLT: Loaded 50461 existing records from primary storage. [2025-10-23T21:51:38.501585] [INFO ] [MAIN ] HLT: Loaded 50461 existing records. [2025-10-23T21:51:38.681764] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:38.682093] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-23T21:51:38.682188] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-23T21:51:38.682438] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-23T21:51:38.682512] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-23T21:51:38.975067] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T21:51:39.001112] [INFO ] [REMOTE ] HLIO: Full fetch complete (37223 records). [2025-10-23T21:51:39.036814] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-23T21:51:39.107395] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:39.205291] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-23T21:51:39.442486] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-23T21:51:39.442623] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-23T21:51:39.443459] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-23T21:51:39.443573] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-23T21:51:39.444519] [DEBUG] [LOCAL ] HLIO: Trimmed 37223 records to 28229 (keeping 200 days of data) [2025-10-23T21:51:39.614553] [DEBUG] [LOCAL ] HLIO: Primary data saved (28229 records). [2025-10-23T21:51:39.614767] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-23T21:51:39.614903] [INFO ] [MAIN ] Update Progress: 1029/2367 symbols completed. HLIO took 26.8s. Estimated remaining: 2h 51m 6s. Rate: 7.8 symbols/min [2025-10-23T21:51:39.787089] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:39.826877] [DEBUG] [LOCAL ] HLX: Loaded 47326 existing records from primary storage. [2025-10-23T21:51:39.827241] [INFO ] [MAIN ] HLX: Loaded 47326 existing records. [2025-10-23T21:51:40.004757] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-23T21:51:40.004698] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:40.005619] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-23T21:51:40.005713] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-23T21:51:40.005934] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-23T21:51:40.006006] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-23T21:51:40.383053] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:40.532553] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-23T21:51:40.799434] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-23T21:51:41.069467] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T21:51:41.414866] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T21:51:41.599467] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-23T21:51:42.026356] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T21:51:42.399480] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-23T21:51:43.199469] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-23T21:51:43.272982] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T21:51:43.904554] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T21:51:43.999468] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-23T21:51:44.193155] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T21:51:44.799431] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-23T21:51:45.599414] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-23T21:51:46.001383] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T21:51:46.090293] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T21:51:46.399457] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-23T21:51:47.199452] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-23T21:51:48.001413] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-23T21:51:48.004412] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-23T21:51:48.208863] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T21:51:48.450815] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T21:51:48.799443] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-23T21:51:49.599418] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-23T21:51:50.080452] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-23T21:51:50.233621] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T21:51:50.399431] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-23T21:51:50.530923] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T21:51:51.199496] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-23T21:51:51.999417] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-23T21:51:52.327468] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T21:51:52.640269] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T21:51:52.799457] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-23T21:51:53.509225] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T21:51:53.599472] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-23T21:51:54.196611] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T21:51:54.399463] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-23T21:51:55.199444] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-23T21:51:55.532820] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-23T21:51:55.999414] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-23T21:51:56.354122] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T21:51:56.438105] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T21:51:56.444105] [INFO ] [REMOTE ] HLLY: Full fetch complete (46033 records). [2025-10-23T21:51:56.444306] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-23T21:51:56.804756] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-23T21:51:56.826696] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-23T21:51:56.826847] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-23T21:51:56.828051] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-23T21:51:56.828236] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-23T21:51:56.829500] [DEBUG] [LOCAL ] HLLY: Trimmed 46033 records to 33526 (keeping 200 days of data) [2025-10-23T21:51:57.022146] [DEBUG] [LOCAL ] HLLY: Primary data saved (33526 records). [2025-10-23T21:51:57.022330] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-23T21:51:57.022454] [INFO ] [MAIN ] Update Progress: 1030/2367 symbols completed. HLLY took 24.9s. Estimated remaining: 2h 51m 11s. Rate: 7.8 symbols/min [2025-10-23T21:51:57.196682] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:51:57.238915] [DEBUG] [LOCAL ] HMC: Loaded 46285 existing records from primary storage. [2025-10-23T21:51:57.239247] [INFO ] [MAIN ] HMC: Loaded 46285 existing records. [2025-10-23T21:51:57.419373] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:51:57.419601] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-23T21:51:57.419698] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-23T21:51:57.419925] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-23T21:51:57.419997] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-23T21:51:57.607813] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-23T21:51:57.800689] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:51:57.835861] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T21:51:58.246475] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T21:51:58.399439] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-23T21:51:59.199441] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-23T21:51:59.404240] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T21:51:59.999438] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-23T21:52:00.154213] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T21:52:00.799432] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-23T21:52:01.191672] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T21:52:01.388676] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T21:52:01.599450] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-23T21:52:02.399410] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-23T21:52:02.511281] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T21:52:03.071885] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T21:52:03.199436] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-23T21:52:03.617806] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T21:52:03.999480] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-23T21:52:04.799415] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-23T21:52:05.196775] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T21:52:05.599453] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-23T21:52:05.952376] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T21:52:06.399412] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-23T21:52:06.591382] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T21:52:07.137776] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T21:52:07.199422] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-23T21:52:08.005486] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-23T21:52:08.022320] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T21:52:08.031752] [INFO ] [REMOTE ] HLN: Full fetch complete (77030 records). [2025-10-23T21:52:08.031897] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-23T21:52:08.426279] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-23T21:52:08.426444] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-23T21:52:08.428297] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-23T21:52:08.428411] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-23T21:52:08.430537] [DEBUG] [LOCAL ] HLN: Trimmed 77030 records to 53505 (keeping 200 days of data) [2025-10-23T21:52:08.756924] [DEBUG] [LOCAL ] HLN: Primary data saved (53505 records). [2025-10-23T21:52:08.757092] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-23T21:52:08.757204] [INFO ] [MAIN ] Update Progress: 1031/2367 symbols completed. HLN took 34.8s. Estimated remaining: 2h 51m 9s. Rate: 7.8 symbols/min [2025-10-23T21:52:08.806971] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-23T21:52:08.938074] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:52:08.968052] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T21:52:08.994907] [DEBUG] [LOCAL ] HMN: Loaded 23255 existing records from primary storage. [2025-10-23T21:52:08.995196] [INFO ] [MAIN ] HMN: Loaded 23255 existing records. [2025-10-23T21:52:09.167254] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:52:09.167451] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-23T21:52:09.167525] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-23T21:52:09.167771] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-23T21:52:09.167843] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-23T21:52:09.532678] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:52:09.563160] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T21:52:09.599399] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-23T21:52:09.688295] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T21:52:09.697212] [INFO ] [REMOTE ] HLT: Full fetch complete (73656 records). [2025-10-23T21:52:09.697377] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-23T21:52:10.075217] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-23T21:52:10.075328] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-23T21:52:10.076320] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-23T21:52:10.076399] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-23T21:52:10.077776] [DEBUG] [LOCAL ] HLT: Trimmed 73656 records to 50826 (keeping 200 days of data) [2025-10-23T21:52:10.385731] [DEBUG] [LOCAL ] HLT: Primary data saved (50826 records). [2025-10-23T21:52:10.385885] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-23T21:52:10.385994] [INFO ] [MAIN ] Update Progress: 1032/2367 symbols completed. HLT took 32.1s. Estimated remaining: 2h 50m 53s. Rate: 7.8 symbols/min [2025-10-23T21:52:10.406622] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-23T21:52:10.555577] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:52:10.604901] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-23T21:52:10.605244] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-23T21:52:10.784367] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:52:10.784615] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-23T21:52:10.784710] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-23T21:52:10.784963] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-23T21:52:10.785036] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-23T21:52:11.147223] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:52:11.199427] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-23T21:52:11.229072] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T21:52:11.978992] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T21:52:11.999421] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-23T21:52:12.089682] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T21:52:12.799448] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-23T21:52:13.024017] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T21:52:13.599450] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-23T21:52:14.399436] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-23T21:52:14.543822] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T21:52:14.552425] [INFO ] [REMOTE ] HLX: Full fetch complete (69022 records). [2025-10-23T21:52:14.552563] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-23T21:52:14.687717] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-23T21:52:14.959256] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-23T21:52:14.959371] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-23T21:52:14.960335] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-23T21:52:14.960413] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-23T21:52:14.961753] [DEBUG] [LOCAL ] HLX: Trimmed 69022 records to 47701 (keeping 200 days of data) [2025-10-23T21:52:15.207099] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-23T21:52:15.220106] [DEBUG] [LOCAL ] HLX: Primary data saved (47701 records). [2025-10-23T21:52:15.220202] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-23T21:52:15.220308] [INFO ] [MAIN ] Update Progress: 1033/2367 symbols completed. HLX took 35.6s. Estimated remaining: 2h 50m 42s. Rate: 7.8 symbols/min [2025-10-23T21:52:15.398896] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:52:15.399103] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-23T21:52:15.399178] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-23T21:52:15.399309] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-23T21:52:15.399406] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-23T21:52:15.399522] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-23T21:52:15.399613] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-23T21:52:15.771798] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:52:15.999442] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-23T21:52:16.058670] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T21:52:16.207453] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T21:52:16.207858] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-23T21:52:16.208113] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:52:16.208323] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-23T21:52:16.208453] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:52:16.208594] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-23T21:52:16.208807] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-23T21:52:16.208889] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-23T21:52:16.208968] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-23T21:52:16.209054] [INFO ] [MAIN ] Update Progress: 1034/2367 symbols completed. HNGE took 1.0s. Estimated remaining: 2h 50m 26s. Rate: 7.8 symbols/min [2025-10-23T21:52:16.375509] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:52:16.403881] [DEBUG] [LOCAL ] HNI: Loaded 29772 existing records from primary storage. [2025-10-23T21:52:16.404182] [INFO ] [MAIN ] HNI: Loaded 29772 existing records. [2025-10-23T21:52:16.576494] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:52:16.576749] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-23T21:52:16.576842] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-23T21:52:16.577044] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-23T21:52:16.577108] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-23T21:52:16.807300] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-23T21:52:16.955426] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:52:17.347597] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-23T21:52:17.599444] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-23T21:52:18.399412] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-23T21:52:18.432014] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T21:52:18.869488] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T21:52:19.199439] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-23T21:52:19.376445] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T21:52:19.999488] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-23T21:52:20.608768] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T21:52:20.799421] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-23T21:52:21.599440] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-23T21:52:21.835025] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T21:52:22.411572] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-23T21:52:22.418796] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T21:52:22.709376] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T21:52:23.199504] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-23T21:52:23.719860] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T21:52:23.999475] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-23T21:52:24.799407] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-23T21:52:25.275506] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-23T21:52:25.599411] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-23T21:52:25.650892] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T21:52:26.053044] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T21:52:26.399419] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-23T21:52:26.522108] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T21:52:27.199440] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-23T21:52:27.999406] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-23T21:52:28.055190] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T21:52:28.362074] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T21:52:28.799421] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-23T21:52:29.599415] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-23T21:52:29.795532] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T21:52:30.212765] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-23T21:52:30.399450] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-23T21:52:30.835925] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T21:52:31.199412] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-23T21:52:31.455132] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T21:52:31.999451] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-23T21:52:32.021882] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T21:52:32.799444] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-23T21:52:33.599440] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-23T21:52:33.795194] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T21:52:33.803092] [INFO ] [REMOTE ] HMC: Full fetch complete (68576 records). [2025-10-23T21:52:33.803238] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-23T21:52:34.165458] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T21:52:34.205594] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-23T21:52:34.206102] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-23T21:52:34.207105] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-23T21:52:34.207185] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-23T21:52:34.208476] [DEBUG] [LOCAL ] HMC: Trimmed 68576 records to 46564 (keeping 200 days of data) [2025-10-23T21:52:34.405942] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-23T21:52:34.480620] [DEBUG] [LOCAL ] HMC: Primary data saved (46564 records). [2025-10-23T21:52:34.480857] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-23T21:52:34.482169] [INFO ] [MAIN ] Update Progress: 1035/2367 symbols completed. HMC took 37.5s. Estimated remaining: 2h 50m 32s. Rate: 7.8 symbols/min [2025-10-23T21:52:34.657178] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:52:34.706855] [DEBUG] [LOCAL ] HOG: Loaded 50639 existing records from primary storage. [2025-10-23T21:52:34.707219] [INFO ] [MAIN ] HOG: Loaded 50639 existing records. [2025-10-23T21:52:34.878502] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:52:34.878749] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-23T21:52:34.878825] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-23T21:52:34.879044] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-23T21:52:34.879117] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-23T21:52:35.200038] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-23T21:52:35.223824] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:52:35.767018] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-23T21:52:35.825027] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T21:52:35.867970] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T21:52:35.871966] [INFO ] [REMOTE ] HMN: Full fetch complete (31615 records). [2025-10-23T21:52:35.872180] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-23T21:52:36.002039] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-23T21:52:36.352726] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-23T21:52:36.352857] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-23T21:52:36.353677] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-23T21:52:36.353762] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-23T21:52:36.354876] [DEBUG] [LOCAL ] HMN: Trimmed 31615 records to 23364 (keeping 200 days of data) [2025-10-23T21:52:36.499908] [DEBUG] [LOCAL ] HMN: Primary data saved (23364 records). [2025-10-23T21:52:36.500071] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-23T21:52:36.500188] [INFO ] [MAIN ] Update Progress: 1036/2367 symbols completed. HMN took 27.7s. Estimated remaining: 2h 50m 17s. Rate: 7.8 symbols/min [2025-10-23T21:52:36.669732] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:52:36.707092] [DEBUG] [LOCAL ] HOMB: Loaded 43676 existing records from primary storage. [2025-10-23T21:52:36.707441] [INFO ] [MAIN ] HOMB: Loaded 43676 existing records. [2025-10-23T21:52:36.805330] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-23T21:52:36.885609] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:52:36.885882] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-23T21:52:36.885991] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-23T21:52:36.886252] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-23T21:52:36.886330] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-23T21:52:37.233881] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:52:37.599426] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-23T21:52:38.002080] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T21:52:38.399502] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-23T21:52:38.679506] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T21:52:38.894288] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T21:52:39.199466] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-23T21:52:39.999427] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-23T21:52:40.247141] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T21:52:40.809984] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-23T21:52:40.816533] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T21:52:41.419954] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T21:52:41.425761] [INFO ] [REMOTE ] HNI: Full fetch complete (42230 records). [2025-10-23T21:52:41.425894] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-23T21:52:41.615567] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-23T21:52:41.812680] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-23T21:52:41.812797] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-23T21:52:41.813676] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-23T21:52:41.813757] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-23T21:52:41.814730] [DEBUG] [LOCAL ] HNI: Trimmed 42230 records to 29986 (keeping 200 days of data) [2025-10-23T21:52:41.999868] [DEBUG] [LOCAL ] HNI: Primary data saved (29986 records). [2025-10-23T21:52:42.000042] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-23T21:52:42.000159] [INFO ] [MAIN ] Update Progress: 1037/2367 symbols completed. HNI took 25.8s. Estimated remaining: 2h 50m 6s. Rate: 7.8 symbols/min [2025-10-23T21:52:42.399414] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-23T21:52:42.890535] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-23T21:52:43.199478] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-23T21:52:43.275466] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:52:43.968640] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T21:52:43.999398] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-23T21:52:44.799469] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-23T21:52:45.090523] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T21:52:45.599776] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-23T21:52:45.602797] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T21:52:46.399497] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-23T21:52:46.550065] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:52:47.199431] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-23T21:52:47.576871] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T21:52:47.586189] [INFO ] [REMOTE ] HMY: Full fetch complete (77150 records). [2025-10-23T21:52:47.586346] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-23T21:52:47.977251] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-23T21:52:47.977457] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-23T21:52:47.978587] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-23T21:52:47.978689] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-23T21:52:47.980126] [DEBUG] [LOCAL ] HMY: Trimmed 77150 records to 53556 (keeping 200 days of data) [2025-10-23T21:52:48.320705] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T21:52:48.337125] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-23T21:52:48.345205] [DEBUG] [LOCAL ] HMY: Primary data saved (53556 records). [2025-10-23T21:52:48.345314] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-23T21:52:48.345437] [INFO ] [MAIN ] Update Progress: 1038/2367 symbols completed. HMY took 38.0s. Estimated remaining: 2h 49m 57s. Rate: 7.8 symbols/min [2025-10-23T21:52:48.517218] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T21:52:48.799446] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-23T21:52:50.163185] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T21:52:50.174109] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-23T21:52:50.345203] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T21:52:50.399405] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-23T21:52:51.639046] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T21:52:51.649274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-23T21:52:51.841472] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T21:52:51.999424] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-23T21:52:53.317590] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T21:52:53.328639] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-23T21:52:53.631866] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T21:52:53.642133] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-23T21:52:54.947998] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T21:52:54.958914] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-23T21:52:55.075419] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T21:52:55.199416] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-23T21:52:56.815041] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T21:52:56.850382] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-23T21:52:56.852922] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T21:52:56.864237] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-23T21:52:58.861311] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-23T21:52:58.869824] [INFO ] [REMOTE ] HOG: Full fetch complete (74270 records). [2025-10-23T21:52:58.869980] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-23T21:52:59.112331] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-23T21:52:59.208432] [INFO ] [REMOTE ] HOMB: Full fetch complete (64474 records). [2025-10-23T21:52:59.211398] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-23T21:52:59.430339] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-23T21:52:59.453395] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-23T21:52:59.489201] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-23T21:52:59.511882] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-23T21:52:59.610339] [DEBUG] [LOCAL ] HOG: Trimmed 74270 records to 50975 (keeping 200 days of data) [2025-10-23T21:52:59.803106] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-23T21:52:59.807560] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-23T21:52:59.809138] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-23T21:52:59.814702] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-23T21:52:59.825201] [DEBUG] [LOCAL ] HOMB: Trimmed 64474 records to 44007 (keeping 200 days of data) [2025-10-23T21:53:00.240846] [DEBUG] [LOCAL ] HOG: Primary data saved (50975 records). [2025-10-23T21:53:00.252937] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-23T21:53:00.263373] [INFO ] [MAIN ] Update Progress: 1039/2367 symbols completed. HOG took 25.8s. Estimated remaining: 2h 49m 55s. Rate: 7.8 symbols/min [2025-10-23T21:53:00.276683] [DEBUG] [LOCAL ] HOMB: Primary data saved (44007 records). [2025-10-23T21:53:00.276786] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-23T21:53:00.276894] [INFO ] [MAIN ] Update Progress: 1040/2367 symbols completed. HOMB took 23.8s. Estimated remaining: 2h 49m 37s. Rate: 7.8 symbols/min [2025-10-23T21:53:00.859211] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:00.902880] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:00.958638] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:00.992760] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:01.009166] [DEBUG] [LOCAL ] HOV: Loaded 13798 existing records from primary storage. [2025-10-23T21:53:01.009636] [INFO ] [MAIN ] HOV: Loaded 13798 existing records. [2025-10-23T21:53:01.159934] [DEBUG] [LOCAL ] HOUS: Loaded 45734 existing records from primary storage. [2025-10-23T21:53:01.223941] [INFO ] [MAIN ] HOUS: Loaded 45734 existing records. [2025-10-23T21:53:01.273243] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:01.296908] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-23T21:53:01.297137] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-23T21:53:01.339864] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-23T21:53:01.368252] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-23T21:53:01.395770] [DEBUG] [LOCAL ] HP: Loaded 51399 existing records from primary storage. [2025-10-23T21:53:01.420729] [INFO ] [MAIN ] HP: Loaded 51399 existing records. [2025-10-23T21:53:01.436400] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-23T21:53:01.454788] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-23T21:53:01.867403] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:01.925291] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:01.960978] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-23T21:53:01.961263] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-23T21:53:01.960861] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-23T21:53:01.990622] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-23T21:53:01.991031] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-23T21:53:02.039049] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-23T21:53:02.064247] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:02.075149] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-23T21:53:02.126267] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-23T21:53:02.113398] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-23T21:53:02.157984] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-23T21:53:02.293078] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-23T21:53:02.330725] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-23T21:53:02.676781] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:02.868241] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-23T21:53:03.249117] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:03.253584] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-23T21:53:03.386057] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:03.395415] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-23T21:53:03.419304] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:03.419772] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-23T21:53:03.751479] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T21:53:03.754424] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-23T21:53:04.572257] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T21:53:04.575103] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-23T21:53:04.757209] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T21:53:04.766036] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-23T21:53:05.014781] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T21:53:05.024225] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-23T21:53:05.144484] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T21:53:05.147474] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-23T21:53:05.524177] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-23T21:53:05.534885] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-23T21:53:06.075510] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T21:53:06.079475] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-23T21:53:06.177013] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T21:53:06.399795] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-23T21:53:06.400634] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T21:53:06.904334] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T21:53:07.150448] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T21:53:07.199412] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-23T21:53:07.984073] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T21:53:07.999397] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-23T21:53:08.147359] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T21:53:08.799432] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-23T21:53:09.599405] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-23T21:53:10.097449] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-23T21:53:10.259547] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T21:53:10.399418] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-23T21:53:10.659140] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T21:53:11.199444] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-23T21:53:11.402789] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T21:53:11.999464] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-23T21:53:12.799455] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-23T21:53:13.318968] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-23T21:53:13.546603] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T21:53:13.599414] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-23T21:53:13.815598] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T21:53:14.399483] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-23T21:53:15.128145] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T21:53:15.199398] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-23T21:53:15.999414] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-23T21:53:16.302669] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T21:53:16.799437] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-23T21:53:16.837381] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T21:53:17.599432] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-23T21:53:18.066692] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-23T21:53:18.399430] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-23T21:53:18.484696] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T21:53:18.487042] [INFO ] [REMOTE ] HOV: Full fetch complete (18930 records). [2025-10-23T21:53:18.487130] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-23T21:53:18.909308] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-23T21:53:18.911031] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-23T21:53:18.911195] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-23T21:53:18.927323] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-23T21:53:18.927792] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-23T21:53:18.928488] [DEBUG] [LOCAL ] HOV: Trimmed 18930 records to 13847 (keeping 200 days of data) [2025-10-23T21:53:19.010598] [DEBUG] [LOCAL ] HOV: Primary data saved (13847 records). [2025-10-23T21:53:19.010768] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-23T21:53:19.010940] [INFO ] [MAIN ] Update Progress: 1041/2367 symbols completed. HOV took 18.7s. Estimated remaining: 2h 49m 44s. Rate: 7.8 symbols/min [2025-10-23T21:53:19.181411] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:19.189993] [DEBUG] [LOCAL ] HPF: Loaded 7482 existing records from primary storage. [2025-10-23T21:53:19.190221] [INFO ] [MAIN ] HPF: Loaded 7482 existing records. [2025-10-23T21:53:19.204699] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-23T21:53:19.369667] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:19.369854] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-23T21:53:19.369948] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-23T21:53:19.370225] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-23T21:53:19.370301] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-23T21:53:19.767537] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:19.769903] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T21:53:19.999436] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-23T21:53:20.758061] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T21:53:20.799396] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-23T21:53:21.008683] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T21:53:21.282241] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T21:53:21.599456] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-23T21:53:22.399433] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-23T21:53:23.199414] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-23T21:53:23.429512] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T21:53:23.999444] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-23T21:53:24.073348] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T21:53:24.799407] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-23T21:53:25.204182] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T21:53:25.477428] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T21:53:25.599400] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-23T21:53:26.030812] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T21:53:26.399494] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-23T21:53:26.853198] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T21:53:27.199413] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-23T21:53:27.291383] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T21:53:27.703159] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T21:53:27.999475] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-23T21:53:28.799495] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-23T21:53:28.823985] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T21:53:29.599432] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-23T21:53:30.360923] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T21:53:30.399397] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-23T21:53:30.560440] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T21:53:30.568982] [INFO ] [REMOTE ] HP: Full fetch complete (74156 records). [2025-10-23T21:53:30.569147] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-23T21:53:30.953846] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-23T21:53:30.953967] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-23T21:53:30.955017] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-23T21:53:30.955113] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-23T21:53:30.956548] [DEBUG] [LOCAL ] HP: Trimmed 74156 records to 51767 (keeping 200 days of data) [2025-10-23T21:53:31.200371] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-23T21:53:31.267826] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T21:53:31.282883] [DEBUG] [LOCAL ] HP: Primary data saved (51767 records). [2025-10-23T21:53:31.283069] [INFO ] [MAIN ] HP: Full history saved. [2025-10-23T21:53:31.284940] [INFO ] [MAIN ] Update Progress: 1042/2367 symbols completed. HP took 31.0s. Estimated remaining: 2h 49m 42s. Rate: 7.8 symbols/min [2025-10-23T21:53:31.451457] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:31.464974] [DEBUG] [LOCAL ] HPI: Loaded 10731 existing records from primary storage. [2025-10-23T21:53:31.465248] [INFO ] [MAIN ] HPI: Loaded 10731 existing records. [2025-10-23T21:53:31.639740] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:31.639970] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-23T21:53:31.640043] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-23T21:53:31.640354] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-23T21:53:31.640428] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-23T21:53:31.996035] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:31.999396] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-23T21:53:32.737767] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T21:53:32.799421] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-23T21:53:33.010532] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T21:53:33.019790] [INFO ] [REMOTE ] HOUS: Full fetch complete (64781 records). [2025-10-23T21:53:33.019948] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-23T21:53:33.401955] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-23T21:53:33.402069] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-23T21:53:33.403112] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-23T21:53:33.403193] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-23T21:53:33.404472] [DEBUG] [LOCAL ] HOUS: Trimmed 64781 records to 46115 (keeping 200 days of data) [2025-10-23T21:53:33.601889] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-23T21:53:33.660972] [DEBUG] [LOCAL ] HOUS: Primary data saved (46115 records). [2025-10-23T21:53:33.661132] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-23T21:53:33.661250] [INFO ] [MAIN ] Update Progress: 1043/2367 symbols completed. HOUS took 33.4s. Estimated remaining: 2h 49m 27s. Rate: 7.8 symbols/min [2025-10-23T21:53:33.828158] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:33.874303] [DEBUG] [LOCAL ] HPP: Loaded 51224 existing records from primary storage. [2025-10-23T21:53:33.874752] [INFO ] [MAIN ] HPP: Loaded 51224 existing records. [2025-10-23T21:53:34.058419] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:34.058701] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-23T21:53:34.058781] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-23T21:53:34.059111] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-23T21:53:34.059188] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-23T21:53:34.360548] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T21:53:34.406539] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-23T21:53:34.452853] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:34.804541] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T21:53:35.066686] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-23T21:53:35.199419] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-23T21:53:35.841943] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T21:53:35.999448] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-23T21:53:36.753441] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T21:53:36.799437] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-23T21:53:37.599426] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-23T21:53:38.374347] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T21:53:38.399400] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-23T21:53:38.403510] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T21:53:39.154053] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-23T21:53:39.199437] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-23T21:53:39.926488] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T21:53:39.999431] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-23T21:53:40.778633] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T21:53:40.799399] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-23T21:53:41.456967] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T21:53:41.458689] [INFO ] [REMOTE ] HPF: Full fetch complete (10499 records). [2025-10-23T21:53:41.458777] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-23T21:53:41.606589] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-23T21:53:41.815950] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-23T21:53:41.816056] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-23T21:53:41.816321] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-23T21:53:41.816392] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-23T21:53:41.816879] [DEBUG] [LOCAL ] HPF: Trimmed 10499 records to 7523 (keeping 200 days of data) [2025-10-23T21:53:41.861995] [DEBUG] [LOCAL ] HPF: Primary data saved (7523 records). [2025-10-23T21:53:41.862131] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-23T21:53:41.862261] [INFO ] [MAIN ] Update Progress: 1044/2367 symbols completed. HPF took 22.9s. Estimated remaining: 2h 49m 20s. Rate: 7.8 symbols/min [2025-10-23T21:53:42.027535] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:42.076136] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-23T21:53:42.076484] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-23T21:53:42.254711] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:42.254949] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-23T21:53:42.255025] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-23T21:53:42.255285] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-23T21:53:42.255358] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-23T21:53:42.404628] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-23T21:53:42.612572] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:43.197494] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T21:53:43.206120] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-23T21:53:43.308674] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-23T21:53:43.999437] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-23T21:53:44.799426] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-23T21:53:45.034995] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T21:53:45.599428] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-23T21:53:45.959985] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T21:53:46.399417] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-23T21:53:46.500434] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T21:53:46.708391] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T21:53:47.199449] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-23T21:53:47.995969] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T21:53:47.998273] [INFO ] [REMOTE ] HPI: Full fetch complete (13849 records). [2025-10-23T21:53:47.998378] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-23T21:53:48.010349] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-23T21:53:48.370073] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-23T21:53:48.370237] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-23T21:53:48.370731] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-23T21:53:48.370819] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-23T21:53:48.371517] [DEBUG] [LOCAL ] HPI: Trimmed 13849 records to 10768 (keeping 200 days of data) [2025-10-23T21:53:48.437685] [DEBUG] [LOCAL ] HPI: Primary data saved (10768 records). [2025-10-23T21:53:48.437857] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-23T21:53:48.438085] [INFO ] [MAIN ] Update Progress: 1045/2367 symbols completed. HPI took 17.2s. Estimated remaining: 2h 49m 11s. Rate: 7.8 symbols/min [2025-10-23T21:53:48.594872] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T21:53:48.655045] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:48.666929] [DEBUG] [LOCAL ] HPS: Loaded 10322 existing records from primary storage. [2025-10-23T21:53:48.667164] [INFO ] [MAIN ] HPS: Loaded 10322 existing records. [2025-10-23T21:53:48.807611] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-23T21:53:48.847599] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:48.847793] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-23T21:53:48.847867] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-23T21:53:48.848121] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-23T21:53:48.848203] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-23T21:53:49.205012] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:49.599425] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-23T21:53:49.725549] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T21:53:50.214433] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-23T21:53:50.399410] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-23T21:53:50.469816] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:53:51.199445] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-23T21:53:51.981525] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T21:53:52.013034] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-23T21:53:52.005658] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-23T21:53:52.016731] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-23T21:53:52.019172] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T21:53:52.424509] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-23T21:53:52.424620] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-23T21:53:52.425724] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-23T21:53:52.425803] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-23T21:53:52.427304] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 54087 (keeping 200 days of data) [2025-10-23T21:53:52.756285] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-10-23T21:53:52.756498] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-23T21:53:52.757402] [INFO ] [MAIN ] Update Progress: 1046/2367 symbols completed. HPE took 52.5s. Estimated remaining: 2h 48m 59s. Rate: 7.8 symbols/min [2025-10-23T21:53:52.804534] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-23T21:53:52.929231] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:53:52.957041] [DEBUG] [LOCAL ] HQH: Loaded 25772 existing records from primary storage. [2025-10-23T21:53:52.957326] [INFO ] [MAIN ] HQH: Loaded 25772 existing records. [2025-10-23T21:53:53.134768] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:53:53.134962] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-23T21:53:53.135038] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-23T21:53:53.135260] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-23T21:53:53.135332] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-23T21:53:53.494756] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:53:53.556078] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T21:53:53.599396] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-23T21:53:53.750394] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T21:53:54.399480] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-23T21:53:54.852139] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T21:53:55.199495] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-23T21:53:55.999489] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-23T21:53:56.533389] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T21:53:56.799447] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-23T21:53:56.895460] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T21:53:57.174375] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T21:53:57.593739] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T21:53:57.599400] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-23T21:53:58.199873] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T21:53:58.399488] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-23T21:53:59.199524] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-23T21:53:59.999403] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-23T21:54:00.356097] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T21:54:00.381048] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T21:54:00.799425] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-23T21:54:01.564957] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T21:54:01.599392] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-23T21:54:01.642089] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T21:54:02.399421] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-23T21:54:02.445477] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T21:54:03.199444] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-23T21:54:03.999406] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-23T21:54:04.236056] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T21:54:04.463261] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T21:54:04.799411] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-23T21:54:05.050120] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T21:54:05.599443] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-23T21:54:06.399455] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-23T21:54:06.522278] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T21:54:06.776106] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T21:54:07.199447] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-23T21:54:07.999450] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-23T21:54:08.289884] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T21:54:08.349932] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T21:54:08.799473] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-23T21:54:09.604836] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-23T21:54:09.627495] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T21:54:10.399445] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-23T21:54:10.673036] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T21:54:10.880477] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-23T21:54:10.998964] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T21:54:11.199507] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-23T21:54:11.999410] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-23T21:54:12.379697] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T21:54:12.799434] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-23T21:54:13.592447] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:54:13.599397] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-23T21:54:13.640345] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T21:54:14.399466] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-23T21:54:14.465929] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T21:54:14.468179] [INFO ] [REMOTE ] HPS: Full fetch complete (15099 records). [2025-10-23T21:54:14.468269] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-23T21:54:14.826452] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-23T21:54:14.826565] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-23T21:54:14.826988] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-23T21:54:14.827065] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-23T21:54:14.827676] [DEBUG] [LOCAL ] HPS: Trimmed 15099 records to 10382 (keeping 200 days of data) [2025-10-23T21:54:14.889954] [DEBUG] [LOCAL ] HPS: Primary data saved (10382 records). [2025-10-23T21:54:14.890117] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-23T21:54:14.890271] [INFO ] [MAIN ] Update Progress: 1047/2367 symbols completed. HPS took 26.5s. Estimated remaining: 2h 49m 10s. Rate: 7.8 symbols/min [2025-10-23T21:54:15.058394] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:15.075936] [DEBUG] [LOCAL ] HQL: Loaded 16898 existing records from primary storage. [2025-10-23T21:54:15.076240] [INFO ] [MAIN ] HQL: Loaded 16898 existing records. [2025-10-23T21:54:15.213228] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-23T21:54:15.253390] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:15.253587] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-23T21:54:15.253682] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-23T21:54:15.253896] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-23T21:54:15.253968] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-23T21:54:15.632899] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:15.657218] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-23T21:54:15.666227] [INFO ] [REMOTE ] HPP: Full fetch complete (73325 records). [2025-10-23T21:54:15.666404] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-23T21:54:16.011191] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-23T21:54:16.060889] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-23T21:54:16.061192] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-23T21:54:16.062404] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-23T21:54:16.062517] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-23T21:54:16.073550] [DEBUG] [LOCAL ] HPP: Trimmed 73325 records to 51560 (keeping 200 days of data) [2025-10-23T21:54:16.092692] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T21:54:16.198901] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-23T21:54:16.212756] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-23T21:54:16.788321] [DEBUG] [LOCAL ] HPP: Primary data saved (51560 records). [2025-10-23T21:54:16.803408] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-23T21:54:16.803541] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-23T21:54:16.858937] [INFO ] [MAIN ] Update Progress: 1048/2367 symbols completed. HPP took 43.2s. Estimated remaining: 2h 48m 55s. Rate: 7.8 symbols/min [2025-10-23T21:54:16.916852] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-23T21:54:16.926918] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-23T21:54:16.933310] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-23T21:54:16.957397] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-23T21:54:17.036257] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 54059 (keeping 200 days of data) [2025-10-23T21:54:17.039313] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:17.151537] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T21:54:17.321171] [DEBUG] [LOCAL ] HR: Loaded 52108 existing records from primary storage. [2025-10-23T21:54:17.329370] [INFO ] [MAIN ] HR: Loaded 52108 existing records. [2025-10-23T21:54:17.601670] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:17.603420] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-23T21:54:17.603531] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-23T21:54:17.602076] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-23T21:54:17.605736] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-23T21:54:17.607309] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-23T21:54:17.722486] [DEBUG] [LOCAL ] HPQ: Primary data saved (54059 records). [2025-10-23T21:54:17.722737] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-23T21:54:17.728598] [INFO ] [MAIN ] Update Progress: 1049/2367 symbols completed. HPQ took 35.9s. Estimated remaining: 2h 48m 39s. Rate: 7.8 symbols/min [2025-10-23T21:54:18.113467] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:18.178503] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T21:54:18.177212] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:18.225196] [DEBUG] [LOCAL ] HRB: Loaded 48219 existing records from primary storage. [2025-10-23T21:54:18.225512] [INFO ] [MAIN ] HRB: Loaded 48219 existing records. [2025-10-23T21:54:18.404930] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-23T21:54:18.409683] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:18.410955] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-23T21:54:18.421289] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-23T21:54:18.422223] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T21:54:18.426075] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-23T21:54:18.426903] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-23T21:54:18.772121] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:19.199434] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-23T21:54:19.635826] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T21:54:19.641031] [INFO ] [REMOTE ] HQH: Full fetch complete (36919 records). [2025-10-23T21:54:19.641173] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-23T21:54:20.004634] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-23T21:54:20.020557] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-23T21:54:20.020717] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-23T21:54:20.021552] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-23T21:54:20.021799] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-23T21:54:20.022801] [DEBUG] [LOCAL ] HQH: Trimmed 36919 records to 25921 (keeping 200 days of data) [2025-10-23T21:54:20.190028] [DEBUG] [LOCAL ] HQH: Primary data saved (25921 records). [2025-10-23T21:54:20.190220] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-23T21:54:20.190360] [INFO ] [MAIN ] Update Progress: 1050/2367 symbols completed. HQH took 27.4s. Estimated remaining: 2h 48m 25s. Rate: 7.8 symbols/min [2025-10-23T21:54:20.360452] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:20.396034] [DEBUG] [LOCAL ] HRI: Loaded 32142 existing records from primary storage. [2025-10-23T21:54:20.396363] [INFO ] [MAIN ] HRI: Loaded 32142 existing records. [2025-10-23T21:54:20.582199] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:20.582671] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-23T21:54:20.582754] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-23T21:54:20.582967] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-23T21:54:20.583039] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-23T21:54:20.805775] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-23T21:54:21.073125] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:21.116982] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T21:54:21.599458] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-23T21:54:21.732103] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T21:54:21.807420] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-23T21:54:22.399437] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-23T21:54:22.488187] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T21:54:23.199438] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-23T21:54:24.004570] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-23T21:54:24.023870] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T21:54:24.799474] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-23T21:54:24.832168] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T21:54:25.423818] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T21:54:25.599443] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-23T21:54:25.738331] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T21:54:26.399463] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-23T21:54:27.113702] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T21:54:27.199436] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-23T21:54:27.999424] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-23T21:54:28.319184] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T21:54:28.673213] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T21:54:28.799778] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-23T21:54:28.806633] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T21:54:29.599475] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-23T21:54:30.402309] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-23T21:54:30.419811] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T21:54:30.440507] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T21:54:31.199432] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-23T21:54:31.974777] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T21:54:31.999408] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-23T21:54:32.031109] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T21:54:32.799433] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-23T21:54:33.599410] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-23T21:54:33.794911] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T21:54:33.835696] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T21:54:34.399455] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-23T21:54:35.199420] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-23T21:54:35.328729] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T21:54:35.772725] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T21:54:35.999437] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-23T21:54:36.799420] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-23T21:54:36.849156] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T21:54:37.331987] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T21:54:37.487593] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T21:54:37.599456] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-23T21:54:38.399411] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-23T21:54:38.676892] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T21:54:38.681125] [INFO ] [REMOTE ] HQL: Full fetch complete (25221 records). [2025-10-23T21:54:38.681264] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-23T21:54:39.048229] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-23T21:54:39.048349] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-23T21:54:39.049000] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-23T21:54:39.049084] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-23T21:54:39.049797] [DEBUG] [LOCAL ] HQL: Trimmed 25221 records to 17005 (keeping 200 days of data) [2025-10-23T21:54:39.150625] [DEBUG] [LOCAL ] HQL: Primary data saved (17005 records). [2025-10-23T21:54:39.150838] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-23T21:54:39.150948] [INFO ] [MAIN ] Update Progress: 1051/2367 symbols completed. HQL took 24.3s. Estimated remaining: 2h 48m 31s. Rate: 7.8 symbols/min [2025-10-23T21:54:39.205597] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-23T21:54:39.324296] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:39.374899] [DEBUG] [LOCAL ] HRL: Loaded 53125 existing records from primary storage. [2025-10-23T21:54:39.375236] [INFO ] [MAIN ] HRL: Loaded 53125 existing records. [2025-10-23T21:54:39.553202] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:39.553414] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-23T21:54:39.553488] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-23T21:54:39.553775] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-23T21:54:39.553848] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-23T21:54:39.913622] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:39.999435] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-23T21:54:40.029116] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T21:54:40.799489] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-23T21:54:40.970482] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T21:54:41.504069] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T21:54:41.599449] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-23T21:54:42.399417] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-23T21:54:42.593417] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T21:54:43.199429] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-23T21:54:43.359516] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T21:54:43.473380] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T21:54:43.999469] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-23T21:54:44.799422] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-23T21:54:44.891131] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T21:54:45.410427] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T21:54:45.599435] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-23T21:54:46.399425] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-23T21:54:46.456242] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:54:46.982771] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T21:54:47.199445] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-23T21:54:47.999473] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-23T21:54:48.067106] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T21:54:48.464906] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T21:54:48.471823] [INFO ] [REMOTE ] HRI: Full fetch complete (46784 records). [2025-10-23T21:54:48.472065] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-23T21:54:48.804357] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-23T21:54:48.895357] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-23T21:54:48.895475] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-23T21:54:48.896386] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-23T21:54:48.896466] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-23T21:54:48.897868] [DEBUG] [LOCAL ] HRI: Trimmed 46784 records to 32395 (keeping 200 days of data) [2025-10-23T21:54:49.097122] [DEBUG] [LOCAL ] HRI: Primary data saved (32395 records). [2025-10-23T21:54:49.097312] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-23T21:54:49.097504] [INFO ] [MAIN ] Update Progress: 1052/2367 symbols completed. HRI took 28.9s. Estimated remaining: 2h 48m 26s. Rate: 7.8 symbols/min [2025-10-23T21:54:49.265802] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:49.296890] [DEBUG] [LOCAL ] HRTG: Loaded 34520 existing records from primary storage. [2025-10-23T21:54:49.297209] [INFO ] [MAIN ] HRTG: Loaded 34520 existing records. [2025-10-23T21:54:49.472701] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:49.473145] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-23T21:54:49.473225] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-23T21:54:49.473534] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-23T21:54:49.473609] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-23T21:54:49.610758] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-23T21:54:49.830675] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:49.863558] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T21:54:50.399487] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-23T21:54:50.471239] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:54:50.479450] [INFO ] [REMOTE ] HRB: Full fetch complete (69958 records). [2025-10-23T21:54:50.479638] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-23T21:54:50.861345] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-23T21:54:50.861457] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-23T21:54:50.862479] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-23T21:54:50.862563] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-23T21:54:50.863985] [DEBUG] [LOCAL ] HRB: Trimmed 69958 records to 48553 (keeping 200 days of data) [2025-10-23T21:54:51.166591] [DEBUG] [LOCAL ] HRB: Primary data saved (48553 records). [2025-10-23T21:54:51.166971] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-23T21:54:51.167088] [INFO ] [MAIN ] Update Progress: 1053/2367 symbols completed. HRB took 33.4s. Estimated remaining: 2h 48m 11s. Rate: 7.8 symbols/min [2025-10-23T21:54:51.208623] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-23T21:54:51.312300] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T21:54:51.394015] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:51.435068] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T21:54:51.454354] [DEBUG] [LOCAL ] HSBC: Loaded 50990 existing records from primary storage. [2025-10-23T21:54:51.454693] [INFO ] [MAIN ] HSBC: Loaded 50990 existing records. [2025-10-23T21:54:51.637126] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:51.637329] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-23T21:54:51.637403] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-23T21:54:51.637686] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-23T21:54:51.637773] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-23T21:54:51.982279] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:54:51.999399] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-23T21:54:52.799423] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-23T21:54:52.851177] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T21:54:53.599458] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-23T21:54:53.780351] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T21:54:54.262623] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-23T21:54:54.399423] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-23T21:54:54.635555] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T21:54:55.199422] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-23T21:54:55.999465] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-23T21:54:56.305085] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T21:54:56.799436] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-23T21:54:57.019092] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T21:54:57.077895] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T21:54:57.599509] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-23T21:54:58.399471] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-23T21:54:58.606453] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T21:54:58.616119] [INFO ] [REMOTE ] HR: Full fetch complete (75080 records). [2025-10-23T21:54:58.616297] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-23T21:54:59.002281] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-23T21:54:59.002407] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-23T21:54:59.003436] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-23T21:54:59.003517] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-23T21:54:59.005013] [DEBUG] [LOCAL ] HR: Trimmed 75080 records to 52495 (keeping 200 days of data) [2025-10-23T21:54:59.215759] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-23T21:54:59.327471] [DEBUG] [LOCAL ] HR: Primary data saved (52495 records). [2025-10-23T21:54:59.327686] [INFO ] [MAIN ] HR: Full history saved. [2025-10-23T21:54:59.327808] [INFO ] [MAIN ] Update Progress: 1054/2367 symbols completed. HR took 42.5s. Estimated remaining: 2h 48m 4s. Rate: 7.8 symbols/min [2025-10-23T21:54:59.517990] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:54:59.533447] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T21:54:59.557205] [DEBUG] [LOCAL ] HSHP: Loaded 14457 existing records from primary storage. [2025-10-23T21:54:59.557478] [INFO ] [MAIN ] HSHP: Loaded 14457 existing records. [2025-10-23T21:54:59.731290] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:54:59.731547] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-23T21:54:59.731624] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-23T21:54:59.731844] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-23T21:54:59.731914] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-23T21:55:00.004893] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-23T21:55:00.089833] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:00.123801] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T21:55:00.240502] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T21:55:00.799482] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-23T21:55:01.599456] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-23T21:55:02.177618] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-23T21:55:02.399457] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-23T21:55:02.603555] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T21:55:02.722517] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T21:55:03.199460] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-23T21:55:03.919959] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T21:55:03.999408] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-23T21:55:04.070972] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T21:55:04.799431] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-23T21:55:05.447587] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T21:55:05.599418] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-23T21:55:06.399485] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-23T21:55:06.859542] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T21:55:07.005781] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-23T21:55:07.199456] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-23T21:55:07.999490] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-23T21:55:08.120524] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T21:55:08.708967] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T21:55:08.804512] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-23T21:55:08.831597] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:55:09.599413] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-23T21:55:09.857752] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T21:55:10.399431] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-23T21:55:11.024936] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T21:55:11.199435] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-23T21:55:11.999516] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-23T21:55:12.362918] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T21:55:12.374154] [INFO ] [REMOTE ] HRL: Full fetch complete (77034 records). [2025-10-23T21:55:12.374450] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-23T21:55:12.810484] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T21:55:12.804335] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-23T21:55:12.811021] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-23T21:55:12.818793] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-23T21:55:12.820364] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-23T21:55:12.819034] [INFO ] [REMOTE ] HRTG: Full fetch complete (44465 records). [2025-10-23T21:55:12.820521] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-23T21:55:12.820765] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-23T21:55:12.915729] [DEBUG] [LOCAL ] HRL: Trimmed 77034 records to 53511 (keeping 200 days of data) [2025-10-23T21:55:13.411736] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-23T21:55:13.433057] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-23T21:55:13.437205] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-23T21:55:13.456710] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-23T21:55:13.539760] [DEBUG] [LOCAL ] HRTG: Trimmed 44465 records to 34749 (keeping 200 days of data) [2025-10-23T21:55:13.950972] [DEBUG] [LOCAL ] HRL: Primary data saved (53511 records). [2025-10-23T21:55:13.951408] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-23T21:55:13.965788] [INFO ] [MAIN ] Update Progress: 1055/2367 symbols completed. HRL took 34.8s. Estimated remaining: 2h 48m 5s. Rate: 7.8 symbols/min [2025-10-23T21:55:13.989179] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T21:55:13.986703] [DEBUG] [LOCAL ] HRTG: Primary data saved (34749 records). [2025-10-23T21:55:14.028575] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-23T21:55:14.052012] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-23T21:55:14.074515] [INFO ] [MAIN ] Update Progress: 1056/2367 symbols completed. HRTG took 25.0s. Estimated remaining: 2h 47m 48s. Rate: 7.8 symbols/min [2025-10-23T21:55:14.194215] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-23T21:55:14.388903] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:14.407933] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-23T21:55:14.409619] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:14.410875] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-23T21:55:14.410966] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-23T21:55:14.411094] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-23T21:55:14.411167] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-23T21:55:14.411245] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-23T21:55:14.411333] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-23T21:55:14.778637] [DEBUG] [LOCAL ] HSY: Loaded 50376 existing records from primary storage. [2025-10-23T21:55:14.802962] [INFO ] [MAIN ] HSY: Loaded 50376 existing records. [2025-10-23T21:55:14.806465] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:14.928631] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T21:55:14.998283] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:55:14.998528] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-23T21:55:14.998605] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-23T21:55:14.998838] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-23T21:55:14.998911] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-23T21:55:15.205148] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-23T21:55:15.382125] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:15.478559] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T21:55:15.478837] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-23T21:55:15.478919] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T21:55:15.478994] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-23T21:55:15.479064] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T21:55:15.479134] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-23T21:55:15.479220] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-23T21:55:15.479292] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-23T21:55:15.479371] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-23T21:55:15.479452] [INFO ] [MAIN ] Update Progress: 1057/2367 symbols completed. HTB took 1.4s. Estimated remaining: 2h 47m 33s. Rate: 7.8 symbols/min [2025-10-23T21:55:15.655898] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:15.670966] [DEBUG] [LOCAL ] HTD: Loaded 14245 existing records from primary storage. [2025-10-23T21:55:15.671219] [INFO ] [MAIN ] HTD: Loaded 14245 existing records. [2025-10-23T21:55:15.844290] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:55:15.844471] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-23T21:55:15.844550] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-23T21:55:15.844759] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-23T21:55:15.844835] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-23T21:55:16.001519] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-23T21:55:16.207273] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:16.391214] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T21:55:16.799460] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-23T21:55:17.599409] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-23T21:55:17.700597] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-23T21:55:17.979577] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-23T21:55:18.280932] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T21:55:18.399417] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-23T21:55:19.199410] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-23T21:55:19.357471] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T21:55:19.999430] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-23T21:55:20.799432] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-23T21:55:20.921807] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T21:55:20.951405] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:55:21.599418] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-23T21:55:22.399429] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-23T21:55:22.473807] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T21:55:22.667851] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T21:55:23.199464] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-23T21:55:23.844707] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T21:55:23.847300] [INFO ] [REMOTE ] HSHP: Full fetch complete (23082 records). [2025-10-23T21:55:23.847394] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-23T21:55:24.004295] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-23T21:55:24.251034] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-23T21:55:24.251174] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-23T21:55:24.251978] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-23T21:55:24.252081] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-23T21:55:24.253103] [DEBUG] [LOCAL ] HSHP: Trimmed 23082 records to 14520 (keeping 200 days of data) [2025-10-23T21:55:24.342965] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T21:55:24.375789] [DEBUG] [LOCAL ] HSHP: Primary data saved (14520 records). [2025-10-23T21:55:24.375945] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-23T21:55:24.376089] [INFO ] [MAIN ] Update Progress: 1058/2367 symbols completed. HSHP took 25.0s. Estimated remaining: 2h 47m 27s. Rate: 7.8 symbols/min [2025-10-23T21:55:24.548809] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:24.548991] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-23T21:55:24.549064] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-23T21:55:24.549172] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-23T21:55:24.549240] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-23T21:55:24.549321] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-23T21:55:24.549392] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-23T21:55:24.805977] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-23T21:55:24.916764] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:24.923919] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T21:55:25.599435] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-23T21:55:26.399420] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-23T21:55:26.540185] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T21:55:26.661526] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-23T21:55:26.761353] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T21:55:27.199496] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-23T21:55:27.831368] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T21:55:27.999437] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-23T21:55:28.617761] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T21:55:28.799464] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-23T21:55:29.143951] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-23T21:55:29.599455] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-23T21:55:30.399453] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-23T21:55:31.199454] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-23T21:55:31.476634] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-23T21:55:31.485921] [INFO ] [REMOTE ] HSBC: Full fetch complete (74223 records). [2025-10-23T21:55:31.486111] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-23T21:55:31.887968] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-23T21:55:31.888083] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-23T21:55:31.889308] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-23T21:55:31.889388] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-23T21:55:31.890802] [DEBUG] [LOCAL ] HSBC: Trimmed 74223 records to 51359 (keeping 200 days of data) [2025-10-23T21:55:32.003309] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-23T21:55:32.127186] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T21:55:32.215814] [DEBUG] [LOCAL ] HSBC: Primary data saved (51359 records). [2025-10-23T21:55:32.216091] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-23T21:55:32.216241] [INFO ] [MAIN ] Update Progress: 1059/2367 symbols completed. HSBC took 41.0s. Estimated remaining: 2h 47m 19s. Rate: 7.8 symbols/min [2025-10-23T21:55:32.393177] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:32.424317] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T21:55:32.473999] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T21:55:32.474821] [DEBUG] [LOCAL ] HTGC: Loaded 47694 existing records from primary storage. [2025-10-23T21:55:32.476171] [INFO ] [MAIN ] HTGC: Loaded 47694 existing records. [2025-10-23T21:55:32.658456] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:55:32.658763] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-23T21:55:32.658840] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-23T21:55:32.659210] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-23T21:55:32.659286] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-23T21:55:32.807898] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-23T21:55:33.019274] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:33.599449] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-23T21:55:34.024807] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-23T21:55:34.399421] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-23T21:55:34.788791] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T21:55:34.801233] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-23T21:55:35.199464] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-23T21:55:35.539180] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-23T21:55:35.999446] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-23T21:55:36.799432] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-23T21:55:37.018679] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-23T21:55:37.599422] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-23T21:55:37.670092] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T21:55:37.917774] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-23T21:55:38.399442] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-23T21:55:38.713189] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-23T21:55:39.199453] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-23T21:55:39.999434] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-23T21:55:40.227054] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T21:55:40.328096] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-23T21:55:40.328904] [INFO ] [REMOTE ] HTFC: Full fetch complete (820 records). [2025-10-23T21:55:40.328997] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-23T21:55:40.522071] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-23T21:55:40.522311] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:55:40.522385] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:55:40.522467] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-23T21:55:40.522544] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-23T21:55:40.522611] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-23T21:55:40.522715] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-23T21:55:40.522811] [INFO ] [MAIN ] Update Progress: 1060/2367 symbols completed. HTFC took 16.1s. Estimated remaining: 2h 47m 12s. Rate: 7.8 symbols/min [2025-10-23T21:55:40.696795] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:40.727295] [DEBUG] [LOCAL ] HTH: Loaded 32437 existing records from primary storage. [2025-10-23T21:55:40.727630] [INFO ] [MAIN ] HTH: Loaded 32437 existing records. [2025-10-23T21:55:40.804756] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-23T21:55:40.915590] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:55:40.915836] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-23T21:55:40.915912] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-23T21:55:40.916171] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-23T21:55:40.916246] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-23T21:55:41.289102] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:41.599423] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-23T21:55:42.399449] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-23T21:55:42.674134] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T21:55:42.769752] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T21:55:43.199447] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-23T21:55:43.999424] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-23T21:55:44.396417] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T21:55:44.638422] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T21:55:44.799432] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-23T21:55:44.889190] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T21:55:45.599434] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-23T21:55:46.399419] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-23T21:55:46.442312] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T21:55:46.519839] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T21:55:47.199411] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-23T21:55:47.352834] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T21:55:47.999429] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-23T21:55:48.619977] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T21:55:48.799447] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-23T21:55:49.037680] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T21:55:49.041100] [INFO ] [REMOTE ] HTD: Full fetch complete (19619 records). [2025-10-23T21:55:49.041208] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-23T21:55:49.403066] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-23T21:55:49.403187] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-23T21:55:49.403717] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-23T21:55:49.403831] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-23T21:55:49.404583] [DEBUG] [LOCAL ] HTD: Trimmed 19619 records to 14322 (keeping 200 days of data) [2025-10-23T21:55:49.490974] [DEBUG] [LOCAL ] HTD: Primary data saved (14322 records). [2025-10-23T21:55:49.491128] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-23T21:55:49.491237] [INFO ] [MAIN ] Update Progress: 1061/2367 symbols completed. HTD took 34.0s. Estimated remaining: 2h 47m 6s. Rate: 7.8 symbols/min [2025-10-23T21:55:49.604606] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-23T21:55:49.662044] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:55:49.696201] [DEBUG] [LOCAL ] HUBB: Loaded 36083 existing records from primary storage. [2025-10-23T21:55:49.696500] [INFO ] [MAIN ] HUBB: Loaded 36083 existing records. [2025-10-23T21:55:49.879512] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:55:49.879897] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-23T21:55:49.880013] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-23T21:55:49.880431] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-23T21:55:49.880561] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-23T21:55:49.994773] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T21:55:50.263484] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:55:50.399446] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-23T21:55:51.199437] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-23T21:55:51.354387] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:55:51.543098] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T21:55:51.999493] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-23T21:55:52.799413] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-23T21:55:52.952678] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:55:53.396151] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T21:55:53.599425] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-23T21:55:54.399420] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-23T21:55:54.583007] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T21:55:54.795672] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T21:55:55.199441] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-23T21:55:55.753110] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T21:55:55.999424] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-23T21:55:56.799414] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-23T21:55:57.013202] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T21:55:57.515290] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T21:55:57.599399] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-23T21:55:58.399422] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-23T21:55:58.644731] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T21:55:58.891785] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T21:55:59.176297] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T21:55:59.185195] [INFO ] [REMOTE ] HSY: Full fetch complete (73624 records). [2025-10-23T21:55:59.185341] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-23T21:55:59.206411] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-23T21:55:59.575997] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-23T21:55:59.576114] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-23T21:55:59.577216] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-23T21:55:59.577298] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-23T21:55:59.578723] [DEBUG] [LOCAL ] HSY: Trimmed 73624 records to 50734 (keeping 200 days of data) [2025-10-23T21:55:59.889865] [DEBUG] [LOCAL ] HSY: Primary data saved (50734 records). [2025-10-23T21:55:59.890023] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-23T21:55:59.891714] [INFO ] [MAIN ] Update Progress: 1062/2367 symbols completed. HSY took 45.9s. Estimated remaining: 2h 47m 2s. Rate: 7.8 symbols/min [2025-10-23T21:56:00.004599] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-23T21:56:00.061460] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:00.104417] [DEBUG] [LOCAL ] HUBS: Loaded 39936 existing records from primary storage. [2025-10-23T21:56:00.104762] [INFO ] [MAIN ] HUBS: Loaded 39936 existing records. [2025-10-23T21:56:00.281252] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:00.281445] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-23T21:56:00.281519] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-23T21:56:00.281768] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-23T21:56:00.281838] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-23T21:56:00.557931] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T21:56:00.589120] [INFO ] [REMOTE ] HTH: Full fetch complete (46818 records). [2025-10-23T21:56:00.621460] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-23T21:56:00.764274] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:00.804585] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-23T21:56:01.044477] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-23T21:56:01.044633] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-23T21:56:01.045538] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-23T21:56:01.045637] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-23T21:56:01.046714] [DEBUG] [LOCAL ] HTH: Trimmed 46818 records to 32621 (keeping 200 days of data) [2025-10-23T21:56:01.233327] [DEBUG] [LOCAL ] HTH: Primary data saved (32621 records). [2025-10-23T21:56:01.233481] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-23T21:56:01.233592] [INFO ] [MAIN ] Update Progress: 1063/2367 symbols completed. HTH took 20.7s. Estimated remaining: 2h 46m 46s. Rate: 7.8 symbols/min [2025-10-23T21:56:01.405077] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:01.447043] [DEBUG] [LOCAL ] HUM: Loaded 49274 existing records from primary storage. [2025-10-23T21:56:01.447379] [INFO ] [MAIN ] HUM: Loaded 49274 existing records. [2025-10-23T21:56:01.620974] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-23T21:56:01.627014] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:01.628159] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-23T21:56:01.628236] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-23T21:56:01.628617] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-23T21:56:01.628720] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-23T21:56:02.001149] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T21:56:02.030526] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:02.156196] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T21:56:02.399519] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-23T21:56:03.163738] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T21:56:03.199408] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-23T21:56:03.745893] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T21:56:03.999544] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-23T21:56:04.799509] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-23T21:56:04.857993] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T21:56:05.599472] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-23T21:56:05.743234] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T21:56:06.399440] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-23T21:56:06.441712] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T21:56:07.199431] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-23T21:56:07.239420] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T21:56:07.707771] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T21:56:07.999454] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-23T21:56:08.804528] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-23T21:56:08.828739] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T21:56:09.252763] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T21:56:09.599451] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-23T21:56:10.399419] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-23T21:56:10.502967] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T21:56:11.199425] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-23T21:56:11.299000] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T21:56:11.999413] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-23T21:56:12.067429] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T21:56:12.076803] [INFO ] [REMOTE ] HTGC: Full fetch complete (68873 records). [2025-10-23T21:56:12.077026] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-23T21:56:12.470300] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-23T21:56:12.470427] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-23T21:56:12.471424] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-23T21:56:12.471503] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-23T21:56:12.472862] [DEBUG] [LOCAL ] HTGC: Trimmed 68873 records to 48027 (keeping 200 days of data) [2025-10-23T21:56:12.757377] [DEBUG] [LOCAL ] HTGC: Primary data saved (48027 records). [2025-10-23T21:56:12.757527] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-23T21:56:12.757639] [INFO ] [MAIN ] Update Progress: 1064/2367 symbols completed. HTGC took 40.5s. Estimated remaining: 2h 46m 43s. Rate: 7.8 symbols/min [2025-10-23T21:56:12.811332] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-23T21:56:12.928234] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:12.951774] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:56:13.005892] [DEBUG] [LOCAL ] HUN: Loaded 53210 existing records from primary storage. [2025-10-23T21:56:13.006235] [INFO ] [MAIN ] HUN: Loaded 53210 existing records. [2025-10-23T21:56:13.177917] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:13.178138] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-23T21:56:13.178218] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-23T21:56:13.178546] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-23T21:56:13.178618] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-23T21:56:13.526661] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:13.599396] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-23T21:56:13.960250] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T21:56:14.190916] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T21:56:14.399431] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-23T21:56:14.829800] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T21:56:15.199434] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-23T21:56:15.936942] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T21:56:15.999416] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-23T21:56:16.799455] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-23T21:56:17.104487] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T21:56:17.599438] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-23T21:56:17.701080] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T21:56:18.180100] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T21:56:18.399442] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-23T21:56:19.199420] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-23T21:56:19.317800] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T21:56:19.920944] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T21:56:19.999448] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-23T21:56:20.791193] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T21:56:20.801132] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-23T21:56:21.599445] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-23T21:56:21.899633] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T21:56:22.399446] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-23T21:56:22.503922] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T21:56:23.199446] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-23T21:56:23.397021] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:56:23.999408] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-23T21:56:24.042818] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T21:56:24.670147] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T21:56:24.799422] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-23T21:56:25.372893] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T21:56:25.480028] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T21:56:25.599458] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-23T21:56:26.399459] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-23T21:56:27.199448] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-23T21:56:27.349455] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T21:56:27.872294] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T21:56:27.878987] [INFO ] [REMOTE ] HUBB: Full fetch complete (54241 records). [2025-10-23T21:56:27.879227] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-23T21:56:28.002318] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-23T21:56:28.209465] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T21:56:28.312028] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-23T21:56:28.312159] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-23T21:56:28.313105] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-23T21:56:28.313187] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-23T21:56:28.314507] [DEBUG] [LOCAL ] HUBB: Trimmed 54241 records to 36236 (keeping 200 days of data) [2025-10-23T21:56:28.542261] [DEBUG] [LOCAL ] HUBB: Primary data saved (36236 records). [2025-10-23T21:56:28.542445] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-23T21:56:28.542540] [INFO ] [MAIN ] Update Progress: 1065/2367 symbols completed. HUBB took 39.1s. Estimated remaining: 2h 46m 46s. Rate: 7.8 symbols/min [2025-10-23T21:56:28.717765] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:28.758574] [DEBUG] [LOCAL ] HUYA: Loaded 43617 existing records from primary storage. [2025-10-23T21:56:28.758979] [INFO ] [MAIN ] HUYA: Loaded 43617 existing records. [2025-10-23T21:56:28.804663] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-23T21:56:28.941006] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:28.941262] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-23T21:56:28.941337] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-23T21:56:28.941573] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-23T21:56:28.941682] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-23T21:56:29.289391] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:29.599449] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-23T21:56:29.919221] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T21:56:30.399443] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-23T21:56:30.557267] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T21:56:30.565323] [INFO ] [REMOTE ] HUBS: Full fetch complete (57058 records). [2025-10-23T21:56:30.565520] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-23T21:56:30.964157] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-23T21:56:30.964268] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-23T21:56:30.965141] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-23T21:56:30.965220] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-23T21:56:30.966387] [DEBUG] [LOCAL ] HUBS: Trimmed 57058 records to 40156 (keeping 200 days of data) [2025-10-23T21:56:31.205538] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-23T21:56:31.206107] [DEBUG] [LOCAL ] HUBS: Primary data saved (40156 records). [2025-10-23T21:56:31.207059] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-23T21:56:31.208495] [INFO ] [MAIN ] Update Progress: 1066/2367 symbols completed. HUBS took 31.3s. Estimated remaining: 2h 46m 32s. Rate: 7.8 symbols/min [2025-10-23T21:56:31.379456] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:31.409756] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T21:56:31.431237] [DEBUG] [LOCAL ] HVT: Loaded 14734 existing records from primary storage. [2025-10-23T21:56:31.431556] [INFO ] [MAIN ] HVT: Loaded 14734 existing records. [2025-10-23T21:56:31.610437] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:31.610776] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-23T21:56:31.610854] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-23T21:56:31.611087] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-23T21:56:31.611163] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-23T21:56:31.982811] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:32.004722] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-23T21:56:32.010495] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T21:56:32.044193] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T21:56:32.053075] [INFO ] [REMOTE ] HUM: Full fetch complete (71130 records). [2025-10-23T21:56:32.053237] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-23T21:56:32.445511] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-23T21:56:32.445634] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-23T21:56:32.446709] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-23T21:56:32.446793] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-23T21:56:32.448421] [DEBUG] [LOCAL ] HUM: Trimmed 71130 records to 49574 (keeping 200 days of data) [2025-10-23T21:56:32.759912] [DEBUG] [LOCAL ] HUM: Primary data saved (49574 records). [2025-10-23T21:56:32.760086] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-23T21:56:32.760199] [INFO ] [MAIN ] Update Progress: 1067/2367 symbols completed. HUM took 31.5s. Estimated remaining: 2h 46m 17s. Rate: 7.8 symbols/min [2025-10-23T21:56:32.804537] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-23T21:56:32.934777] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:32.985266] [DEBUG] [LOCAL ] HWM: Loaded 52700 existing records from primary storage. [2025-10-23T21:56:32.985608] [INFO ] [MAIN ] HWM: Loaded 52700 existing records. [2025-10-23T21:56:33.159743] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T21:56:33.179824] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:33.183534] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-23T21:56:33.183609] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-23T21:56:33.183860] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-23T21:56:33.183932] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-23T21:56:33.554179] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:33.599396] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-23T21:56:34.319573] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T21:56:34.399428] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-23T21:56:35.199436] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-23T21:56:35.601525] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T21:56:35.999435] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-23T21:56:36.156586] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T21:56:36.582753] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T21:56:36.799424] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-23T21:56:37.599415] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-23T21:56:37.871934] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T21:56:38.399413] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-23T21:56:38.544439] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T21:56:39.205195] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-23T21:56:39.222018] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T21:56:39.999419] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-23T21:56:40.210942] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T21:56:40.442317] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T21:56:40.799425] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-23T21:56:41.599420] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-23T21:56:41.746575] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T21:56:42.041668] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T21:56:42.399434] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-23T21:56:43.088139] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T21:56:43.199418] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-23T21:56:43.999423] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-23T21:56:44.155418] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T21:56:44.164940] [INFO ] [REMOTE ] HUN: Full fetch complete (77022 records). [2025-10-23T21:56:44.165091] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-23T21:56:44.417571] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T21:56:44.591603] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-23T21:56:44.591748] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-23T21:56:44.592953] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-23T21:56:44.593034] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-23T21:56:44.594498] [DEBUG] [LOCAL ] HUN: Trimmed 77022 records to 53600 (keeping 200 days of data) [2025-10-23T21:56:44.800037] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-23T21:56:44.923991] [DEBUG] [LOCAL ] HUN: Primary data saved (53600 records). [2025-10-23T21:56:44.924215] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-23T21:56:44.924419] [INFO ] [MAIN ] Update Progress: 1068/2367 symbols completed. HUN took 32.2s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-10-23T21:56:45.109020] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:56:45.158627] [DEBUG] [LOCAL ] HXL: Loaded 45788 existing records from primary storage. [2025-10-23T21:56:45.159018] [INFO ] [MAIN ] HXL: Loaded 45788 existing records. [2025-10-23T21:56:45.332161] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:56:45.332401] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-23T21:56:45.332475] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-23T21:56:45.332775] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-23T21:56:45.332850] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-23T21:56:45.605084] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-23T21:56:45.684059] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:56:46.001700] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T21:56:46.399440] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-23T21:56:46.512850] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T21:56:46.775759] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T21:56:47.199455] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-23T21:56:47.999457] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-23T21:56:48.137775] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T21:56:48.799408] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-23T21:56:49.252114] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-23T21:56:49.599422] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-23T21:56:49.680127] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T21:56:50.387062] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T21:56:50.399392] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-23T21:56:51.199421] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-23T21:56:51.503502] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T21:56:51.999401] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-23T21:56:52.147025] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T21:56:52.147349] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T21:56:52.799437] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-23T21:56:53.599404] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-23T21:56:53.698775] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T21:56:54.399415] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-23T21:56:54.527433] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T21:56:54.577620] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T21:56:55.199457] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-23T21:56:55.999448] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-23T21:56:56.055449] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T21:56:56.437064] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-23T21:56:56.799422] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-23T21:56:57.599429] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-23T21:56:57.824419] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T21:56:58.301842] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T21:56:58.399487] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-23T21:56:59.199421] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-23T21:56:59.233196] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:56:59.357504] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T21:56:59.999450] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-23T21:57:00.740194] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T21:57:00.744575] [INFO ] [REMOTE ] HVT: Full fetch complete (23040 records). [2025-10-23T21:57:00.744863] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-23T21:57:00.801749] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-23T21:57:00.882841] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T21:57:01.177349] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-23T21:57:01.177482] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-23T21:57:01.178086] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-23T21:57:01.178166] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-23T21:57:01.179003] [DEBUG] [LOCAL ] HVT: Trimmed 23040 records to 14832 (keeping 200 days of data) [2025-10-23T21:57:01.266634] [DEBUG] [LOCAL ] HVT: Primary data saved (14832 records). [2025-10-23T21:57:01.266820] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-23T21:57:01.266933] [INFO ] [MAIN ] Update Progress: 1069/2367 symbols completed. HVT took 30.1s. Estimated remaining: 2h 46m 17s. Rate: 7.8 symbols/min [2025-10-23T21:57:01.448894] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:01.460180] [DEBUG] [LOCAL ] HY: Loaded 9852 existing records from primary storage. [2025-10-23T21:57:01.460437] [INFO ] [MAIN ] HY: Loaded 9852 existing records. [2025-10-23T21:57:01.604685] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-23T21:57:01.642461] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:57:01.642809] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-23T21:57:01.642889] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-23T21:57:01.643201] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-23T21:57:01.643273] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-23T21:57:01.995903] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:02.399412] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-23T21:57:02.480862] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T21:57:02.489020] [INFO ] [REMOTE ] HUYA: Full fetch complete (63993 records). [2025-10-23T21:57:02.489215] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-23T21:57:02.875948] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-23T21:57:02.876055] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-23T21:57:02.876990] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-23T21:57:02.877065] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-23T21:57:02.878397] [DEBUG] [LOCAL ] HUYA: Trimmed 63993 records to 43945 (keeping 200 days of data) [2025-10-23T21:57:03.120713] [DEBUG] [LOCAL ] HUYA: Primary data saved (43945 records). [2025-10-23T21:57:03.120858] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-23T21:57:03.120961] [INFO ] [MAIN ] Update Progress: 1070/2367 symbols completed. HUYA took 34.6s. Estimated remaining: 2h 46m 3s. Rate: 7.8 symbols/min [2025-10-23T21:57:03.204504] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-23T21:57:03.309936] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:03.310759] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T21:57:03.311036] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-23T21:57:03.314308] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-23T21:57:03.314426] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-23T21:57:03.314509] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-23T21:57:03.314625] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-23T21:57:03.314749] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-23T21:57:03.665989] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:03.698366] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-23T21:57:03.999492] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-23T21:57:04.811414] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-23T21:57:04.829515] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T21:57:04.839585] [INFO ] [REMOTE ] HWM: Full fetch complete (76633 records). [2025-10-23T21:57:04.839801] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-23T21:57:05.274049] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T21:57:05.296234] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-23T21:57:05.306164] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-23T21:57:05.307371] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-23T21:57:05.307579] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-23T21:57:05.309703] [DEBUG] [LOCAL ] HWM: Trimmed 76633 records to 53083 (keeping 200 days of data) [2025-10-23T21:57:05.613344] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-23T21:57:05.640412] [DEBUG] [LOCAL ] HWM: Primary data saved (53083 records). [2025-10-23T21:57:05.641762] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-23T21:57:05.642048] [INFO ] [MAIN ] Update Progress: 1071/2367 symbols completed. HWM took 32.9s. Estimated remaining: 2h 45m 49s. Rate: 7.8 symbols/min [2025-10-23T21:57:05.761536] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T21:57:05.832516] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:05.832764] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-23T21:57:05.832838] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-23T21:57:05.832955] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-23T21:57:05.833059] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-23T21:57:05.833141] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-23T21:57:05.833268] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-23T21:57:06.183866] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:06.399437] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-23T21:57:06.761019] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-23T21:57:07.199472] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-23T21:57:07.257232] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T21:57:07.443550] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-23T21:57:07.999426] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-23T21:57:08.245006] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-23T21:57:08.799469] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-23T21:57:09.599431] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-23T21:57:09.686460] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T21:57:09.922432] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-23T21:57:10.399443] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-23T21:57:10.806658] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-23T21:57:11.199441] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-23T21:57:11.528311] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-23T21:57:11.999435] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-23T21:57:12.342057] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-23T21:57:12.799494] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-23T21:57:13.124031] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-23T21:57:13.599445] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-23T21:57:14.399448] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-23T21:57:14.635090] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-23T21:57:15.154860] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T21:57:15.199511] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-23T21:57:15.617087] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-23T21:57:15.999463] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-23T21:57:16.799424] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-23T21:57:17.140512] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-23T21:57:17.599412] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-23T21:57:17.699821] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T21:57:17.707835] [INFO ] [REMOTE ] HXL: Full fetch complete (66731 records). [2025-10-23T21:57:17.708013] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-23T21:57:17.886668] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-23T21:57:18.095003] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-23T21:57:18.095125] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-23T21:57:18.096119] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-23T21:57:18.096199] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-23T21:57:18.097591] [DEBUG] [LOCAL ] HXL: Trimmed 66731 records to 46178 (keeping 200 days of data) [2025-10-23T21:57:18.370789] [DEBUG] [LOCAL ] HXL: Primary data saved (46178 records). [2025-10-23T21:57:18.370978] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-23T21:57:18.371094] [INFO ] [MAIN ] Update Progress: 1072/2367 symbols completed. HXL took 33.4s. Estimated remaining: 2h 45m 47s. Rate: 7.8 symbols/min [2025-10-23T21:57:18.404685] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-23T21:57:18.544582] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:18.555870] [DEBUG] [LOCAL ] HYI: Loaded 9586 existing records from primary storage. [2025-10-23T21:57:18.556114] [INFO ] [MAIN ] HYI: Loaded 9586 existing records. [2025-10-23T21:57:18.733939] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:57:18.734137] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-23T21:57:18.734214] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-23T21:57:18.734402] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-23T21:57:18.734489] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-23T21:57:18.827035] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-23T21:57:19.092071] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:19.199446] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-23T21:57:19.963942] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T21:57:19.999410] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-23T21:57:20.799412] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-23T21:57:20.860311] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-23T21:57:21.139888] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-23T21:57:21.599430] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-23T21:57:22.034823] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T21:57:22.399462] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-23T21:57:22.656028] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-23T21:57:23.199444] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-23T21:57:23.992838] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T21:57:23.999389] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-23T21:57:24.751208] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T21:57:24.799466] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-23T21:57:25.050328] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-23T21:57:25.599442] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-23T21:57:25.854526] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-23T21:57:25.855281] [INFO ] [REMOTE ] HYBX: Full fetch complete (698 records). [2025-10-23T21:57:25.855369] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-23T21:57:26.048094] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-23T21:57:26.048309] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:57:26.048381] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:57:26.048455] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-23T21:57:26.048594] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-23T21:57:26.048693] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-23T21:57:26.048805] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-23T21:57:26.048929] [INFO ] [MAIN ] Update Progress: 1073/2367 symbols completed. HYBX took 20.4s. Estimated remaining: 2h 45m 39s. Rate: 7.8 symbols/min [2025-10-23T21:57:26.229603] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:26.260736] [DEBUG] [LOCAL ] HYT: Loaded 33567 existing records from primary storage. [2025-10-23T21:57:26.261065] [INFO ] [MAIN ] HYT: Loaded 33567 existing records. [2025-10-23T21:57:26.410716] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-23T21:57:26.456195] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:57:26.456575] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-23T21:57:26.456681] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-23T21:57:26.456976] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-23T21:57:26.457096] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-23T21:57:26.734341] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-23T21:57:26.810376] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:27.199446] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-23T21:57:27.958942] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T21:57:27.999441] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-23T21:57:28.799445] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-23T21:57:28.857319] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T21:57:29.599444] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-23T21:57:30.261240] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T21:57:30.399477] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-23T21:57:30.449998] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-23T21:57:31.199429] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-23T21:57:31.663593] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T21:57:31.954391] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T21:57:31.999437] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-23T21:57:32.791315] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T21:57:32.799387] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-23T21:57:33.599453] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-23T21:57:33.770365] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T21:57:34.399484] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-23T21:57:34.747297] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T21:57:34.748444] [INFO ] [REMOTE ] HYAC: Full fetch complete (919 records). [2025-10-23T21:57:34.748542] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-23T21:57:34.939663] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-23T21:57:34.946397] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T21:57:34.957045] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T21:57:34.957179] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-23T21:57:34.958429] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T21:57:34.958542] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-23T21:57:34.965105] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-23T21:57:34.965945] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-23T21:57:34.966054] [INFO ] [MAIN ] Update Progress: 1074/2367 symbols completed. HYAC took 31.8s. Estimated remaining: 2h 45m 33s. Rate: 7.8 symbols/min [2025-10-23T21:57:35.131408] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:35.136878] [DEBUG] [LOCAL ] HYTR: Loaded 3093 existing records from primary storage. [2025-10-23T21:57:35.137109] [INFO ] [MAIN ] HYTR: Loaded 3093 existing records. [2025-10-23T21:57:35.204603] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-23T21:57:35.314838] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:57:35.315080] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-23T21:57:35.315154] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-23T21:57:35.315300] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-23T21:57:35.315367] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-23T21:57:35.668918] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:35.999473] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-23T21:57:36.493306] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-23T21:57:36.799423] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-23T21:57:36.870736] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T21:57:37.599423] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-23T21:57:37.640081] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T21:57:38.171564] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T21:57:38.399404] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-23T21:57:39.199442] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-23T21:57:39.895784] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T21:57:39.997588] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T21:57:39.999621] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-23T21:57:39.999937] [INFO ] [REMOTE ] HY: Full fetch complete (14860 records). [2025-10-23T21:57:40.000864] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-23T21:57:40.358955] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-23T21:57:40.359066] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-23T21:57:40.359431] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-23T21:57:40.359537] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-23T21:57:40.360064] [DEBUG] [LOCAL ] HY: Trimmed 14860 records to 9894 (keeping 200 days of data) [2025-10-23T21:57:40.418166] [DEBUG] [LOCAL ] HY: Primary data saved (9894 records). [2025-10-23T21:57:40.418312] [INFO ] [MAIN ] HY: Full history saved. [2025-10-23T21:57:40.418455] [INFO ] [MAIN ] Update Progress: 1075/2367 symbols completed. HY took 39.2s. Estimated remaining: 2h 45m 23s. Rate: 7.8 symbols/min [2025-10-23T21:57:40.586215] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:40.614392] [DEBUG] [LOCAL ] HZO: Loaded 28526 existing records from primary storage. [2025-10-23T21:57:40.614692] [INFO ] [MAIN ] HZO: Loaded 28526 existing records. [2025-10-23T21:57:40.790004] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:57:40.790208] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-23T21:57:40.790282] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-23T21:57:40.790501] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-23T21:57:40.790579] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-23T21:57:40.804700] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-23T21:57:41.144244] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:41.463689] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T21:57:41.569262] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T21:57:41.599398] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-23T21:57:42.352616] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T21:57:42.399402] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-23T21:57:43.199448] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-23T21:57:43.632326] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T21:57:43.780350] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T21:57:43.999436] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-23T21:57:44.604447] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T21:57:44.799423] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-23T21:57:45.355363] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T21:57:45.599425] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-23T21:57:46.399400] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-23T21:57:46.644103] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T21:57:47.199541] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-23T21:57:47.795926] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T21:57:47.999484] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-23T21:57:48.596729] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T21:57:48.779917] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T21:57:48.799395] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-23T21:57:49.593678] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:57:49.599388] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-23T21:57:50.399426] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-23T21:57:50.458287] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T21:57:50.460988] [INFO ] [REMOTE ] HYI: Full fetch complete (14014 records). [2025-10-23T21:57:50.461079] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-23T21:57:50.841564] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-23T21:57:50.841695] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-23T21:57:50.841993] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-23T21:57:50.842078] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-23T21:57:50.842628] [DEBUG] [LOCAL ] HYI: Trimmed 14014 records to 9666 (keeping 200 days of data) [2025-10-23T21:57:50.898868] [DEBUG] [LOCAL ] HYI: Primary data saved (9666 records). [2025-10-23T21:57:50.899002] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-23T21:57:50.899108] [INFO ] [MAIN ] Update Progress: 1076/2367 symbols completed. HYI took 32.5s. Estimated remaining: 2h 45m 19s. Rate: 7.8 symbols/min [2025-10-23T21:57:51.063362] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:57:51.071583] [DEBUG] [LOCAL ] IAE: Loaded 6307 existing records from primary storage. [2025-10-23T21:57:51.071845] [INFO ] [MAIN ] IAE: Loaded 6307 existing records. [2025-10-23T21:57:51.209174] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-23T21:57:51.248757] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:57:51.248942] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-23T21:57:51.249036] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-23T21:57:51.249233] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-23T21:57:51.249307] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-23T21:57:51.606116] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:57:51.913202] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T21:57:51.999398] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-23T21:57:52.773314] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T21:57:52.799392] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-23T21:57:53.436991] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T21:57:53.599444] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-23T21:57:54.043339] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T21:57:54.399427] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-23T21:57:54.875792] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-23T21:57:54.979868] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T21:57:54.985878] [INFO ] [REMOTE ] HYT: Full fetch complete (47829 records). [2025-10-23T21:57:54.985993] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-23T21:57:55.204731] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-23T21:57:55.359565] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-23T21:57:55.359694] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-23T21:57:55.360538] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-23T21:57:55.360619] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-23T21:57:55.361622] [DEBUG] [LOCAL ] HYT: Trimmed 47829 records to 33782 (keeping 200 days of data) [2025-10-23T21:57:55.554277] [DEBUG] [LOCAL ] HYT: Primary data saved (33782 records). [2025-10-23T21:57:55.554434] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-23T21:57:55.554547] [INFO ] [MAIN ] Update Progress: 1077/2367 symbols completed. HYT took 29.5s. Estimated remaining: 2h 45m 7s. Rate: 7.8 symbols/min [2025-10-23T21:57:55.869929] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T21:57:55.999402] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-23T21:57:56.799439] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-23T21:57:57.173165] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T21:57:57.231523] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T21:57:57.599477] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-23T21:57:58.399439] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-23T21:57:58.874080] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T21:57:59.005663] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T21:57:59.199437] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-23T21:57:59.596923] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-23T21:57:59.999493] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-23T21:58:00.506238] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T21:58:00.799534] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-23T21:58:01.599488] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-23T21:58:02.308940] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T21:58:02.360357] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T21:58:02.399423] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-23T21:58:03.088612] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-23T21:58:03.199485] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-23T21:58:03.850062] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T21:58:03.999441] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-23T21:58:04.799428] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-23T21:58:05.562844] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T21:58:05.564079] [INFO ] [REMOTE ] HYTR: Full fetch complete (4722 records). [2025-10-23T21:58:05.564165] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-23T21:58:05.605581] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-23T21:58:05.799587] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T21:58:05.955557] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-23T21:58:05.955685] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-23T21:58:05.955873] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-23T21:58:05.955949] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-23T21:58:05.956340] [DEBUG] [LOCAL ] HYTR: Trimmed 4722 records to 3121 (keeping 200 days of data) [2025-10-23T21:58:05.975534] [DEBUG] [LOCAL ] HYTR: Primary data saved (3121 records). [2025-10-23T21:58:05.975622] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-23T21:58:05.975745] [INFO ] [MAIN ] Update Progress: 1078/2367 symbols completed. HYTR took 31.0s. Estimated remaining: 2h 45m 3s. Rate: 7.8 symbols/min [2025-10-23T21:58:06.285323] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T21:58:06.399417] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-23T21:58:06.917868] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-23T21:58:07.199451] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-23T21:58:07.999751] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-23T21:58:08.320965] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T21:58:08.328697] [INFO ] [REMOTE ] HZO: Full fetch complete (41267 records). [2025-10-23T21:58:08.328927] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-23T21:58:08.707141] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T21:58:08.810985] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-23T21:58:08.828253] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-23T21:58:08.829408] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-23T21:58:08.830199] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-23T21:58:08.830566] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-23T21:58:08.831610] [DEBUG] [LOCAL ] HZO: Trimmed 41267 records to 28679 (keeping 200 days of data) [2025-10-23T21:58:09.011251] [DEBUG] [LOCAL ] HZO: Primary data saved (28679 records). [2025-10-23T21:58:09.011945] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-23T21:58:09.012091] [INFO ] [MAIN ] Update Progress: 1079/2367 symbols completed. HZO took 28.6s. Estimated remaining: 2h 44m 50s. Rate: 7.8 symbols/min [2025-10-23T21:58:09.669351] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T21:58:09.671932] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-23T21:58:10.421950] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T21:58:10.424453] [INFO ] [REMOTE ] IAE: Full fetch complete (9056 records). [2025-10-23T21:58:10.424551] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-23T21:58:10.811961] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-23T21:58:10.812085] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-23T21:58:10.812373] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-23T21:58:10.812449] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-23T21:58:10.813000] [DEBUG] [LOCAL ] IAE: Trimmed 9056 records to 6361 (keeping 200 days of data) [2025-10-23T21:58:10.851035] [DEBUG] [LOCAL ] IAE: Primary data saved (6361 records). [2025-10-23T21:58:10.851222] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-23T21:58:10.851338] [INFO ] [MAIN ] Update Progress: 1080/2367 symbols completed. IAE took 20.0s. Estimated remaining: 2h 44m 35s. Rate: 7.8 symbols/min [2025-10-23T21:58:11.480784] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:11.554706] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:11.618626] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:11.623406] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:11.682312] [DEBUG] [LOCAL ] IBP: Loaded 28663 existing records from primary storage. [2025-10-23T21:58:11.714241] [INFO ] [MAIN ] IBP: Loaded 28663 existing records. [2025-10-23T21:58:11.716109] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-23T21:58:11.747347] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-23T21:58:11.789177] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-23T21:58:11.837349] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-23T21:58:11.925715] [DEBUG] [LOCAL ] IBN: Loaded 52834 existing records from primary storage. [2025-10-23T21:58:12.115173] [INFO ] [MAIN ] IBN: Loaded 52834 existing records. [2025-10-23T21:58:12.201237] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:12.291611] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-23T21:58:12.296965] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-23T21:58:12.375447] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-23T21:58:12.412238] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:12.438057] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-23T21:58:12.460330] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-23T21:58:12.418834] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:12.470234] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-23T21:58:12.471107] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-23T21:58:12.492029] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-23T21:58:12.492131] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-23T21:58:12.497454] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-23T21:58:12.513034] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-23T21:58:12.544765] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-23T21:58:12.770783] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:12.873322] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-23T21:58:12.926150] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-23T21:58:12.967560] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-23T21:58:13.039322] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-23T21:58:13.694881] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:13.731714] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-23T21:58:13.947062] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:13.887155] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:13.968341] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-23T21:58:13.994612] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-23T21:58:14.154034] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:14.154386] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-23T21:58:15.085297] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T21:58:15.090384] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-23T21:58:15.904226] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T21:58:15.915004] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-23T21:58:15.959159] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T21:58:15.969820] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-23T21:58:16.031997] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-23T21:58:16.043817] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-23T21:58:16.300573] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T21:58:16.799442] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-23T21:58:17.416599] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T21:58:17.599423] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-23T21:58:17.705388] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T21:58:18.152382] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T21:58:18.300626] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-23T21:58:18.399394] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-23T21:58:19.199491] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-23T21:58:19.395704] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T21:58:19.999428] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-23T21:58:20.599348] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-23T21:58:20.806713] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-23T21:58:20.826530] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T21:58:21.477591] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T21:58:21.599451] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-23T21:58:21.792360] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T21:58:22.399498] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-23T21:58:23.199449] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-23T21:58:23.595888] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-23T21:58:23.999505] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-23T21:58:24.487702] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T21:58:24.799506] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-23T21:58:24.838063] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-23T21:58:25.599524] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-23T21:58:25.895481] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T21:58:26.008375] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T21:58:26.399426] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-23T21:58:27.199413] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-23T21:58:27.698547] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-23T21:58:27.999399] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-23T21:58:28.284789] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T21:58:28.541628] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T21:58:28.799449] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-23T21:58:29.599439] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-23T21:58:30.214860] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-23T21:58:30.399410] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-23T21:58:30.711248] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T21:58:31.146513] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T21:58:31.199406] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-23T21:58:31.999442] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-23T21:58:32.571218] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T21:58:32.799445] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-23T21:58:33.095200] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-23T21:58:33.457602] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T21:58:33.599406] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-23T21:58:34.399410] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-23T21:58:34.926163] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-23T21:58:35.199436] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-23T21:58:35.999430] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-23T21:58:36.164401] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-23T21:58:36.240638] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T21:58:36.768407] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T21:58:36.777682] [INFO ] [REMOTE ] IAG: Full fetch complete (77510 records). [2025-10-23T21:58:36.777855] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-23T21:58:36.809695] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-23T21:58:37.174004] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-23T21:58:37.174211] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-23T21:58:37.175255] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-23T21:58:37.175335] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-23T21:58:37.176790] [DEBUG] [LOCAL ] IAG: Trimmed 77510 records to 53882 (keeping 200 days of data) [2025-10-23T21:58:37.386920] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T21:58:37.504483] [DEBUG] [LOCAL ] IAG: Primary data saved (53882 records). [2025-10-23T21:58:37.504695] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-23T21:58:37.504827] [INFO ] [MAIN ] Update Progress: 1081/2367 symbols completed. IAG took 26.7s. Estimated remaining: 2h 44m 50s. Rate: 7.8 symbols/min [2025-10-23T21:58:37.604350] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-23T21:58:37.675638] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:37.708687] [DEBUG] [LOCAL ] IBTA: Loaded 36072 existing records from primary storage. [2025-10-23T21:58:37.708987] [INFO ] [MAIN ] IBTA: Loaded 36072 existing records. [2025-10-23T21:58:37.887417] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:37.887672] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-23T21:58:37.887745] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-23T21:58:37.888291] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-23T21:58:37.888365] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-23T21:58:38.238450] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:38.399422] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-23T21:58:38.934601] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-23T21:58:39.199430] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-23T21:58:39.539528] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T21:58:39.595721] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T21:58:39.935736] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T21:58:39.946498] [INFO ] [REMOTE ] IBM: Full fetch complete (77743 records). [2025-10-23T21:58:39.946688] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-23T21:58:40.007569] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-23T21:58:40.365033] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-23T21:58:40.365144] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-23T21:58:40.366322] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-23T21:58:40.366409] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-23T21:58:40.368136] [DEBUG] [LOCAL ] IBM: Trimmed 77743 records to 54018 (keeping 200 days of data) [2025-10-23T21:58:40.702615] [DEBUG] [LOCAL ] IBM: Primary data saved (54018 records). [2025-10-23T21:58:40.702801] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-23T21:58:40.703693] [INFO ] [MAIN ] Update Progress: 1082/2367 symbols completed. IBM took 29.9s. Estimated remaining: 2h 44m 37s. Rate: 7.8 symbols/min [2025-10-23T21:58:40.805712] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-23T21:58:40.881130] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:40.936323] [DEBUG] [LOCAL ] ICE: Loaded 53009 existing records from primary storage. [2025-10-23T21:58:40.936689] [INFO ] [MAIN ] ICE: Loaded 53009 existing records. [2025-10-23T21:58:41.116226] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:41.116572] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-23T21:58:41.116737] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-23T21:58:41.116979] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-23T21:58:41.117051] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-23T21:58:41.405185] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T21:58:41.441932] [INFO ] [REMOTE ] IBP: Full fetch complete (41162 records). [2025-10-23T21:58:41.478274] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-23T21:58:41.498717] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:41.602551] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-23T21:58:41.884620] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-23T21:58:41.884760] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-23T21:58:41.885586] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-23T21:58:41.885681] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-23T21:58:41.886569] [DEBUG] [LOCAL ] IBP: Trimmed 41162 records to 28822 (keeping 200 days of data) [2025-10-23T21:58:42.067934] [DEBUG] [LOCAL ] IBP: Primary data saved (28822 records). [2025-10-23T21:58:42.068135] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-23T21:58:42.068283] [INFO ] [MAIN ] Update Progress: 1083/2367 symbols completed. IBP took 31.2s. Estimated remaining: 2h 44m 22s. Rate: 7.8 symbols/min [2025-10-23T21:58:42.256119] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:42.253718] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T21:58:42.294450] [DEBUG] [LOCAL ] ICL: Loaded 38132 existing records from primary storage. [2025-10-23T21:58:42.294794] [INFO ] [MAIN ] ICL: Loaded 38132 existing records. [2025-10-23T21:58:42.404559] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-23T21:58:42.471748] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:42.471925] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-23T21:58:42.471999] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-23T21:58:42.472207] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-23T21:58:42.472279] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-23T21:58:42.824772] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:43.199437] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-23T21:58:43.339570] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T21:58:43.999436] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-23T21:58:44.254731] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T21:58:44.451348] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T21:58:44.799509] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-23T21:58:45.599439] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-23T21:58:45.825374] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:58:46.258995] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T21:58:46.399427] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-23T21:58:47.199413] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-23T21:58:47.233687] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T21:58:47.847073] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T21:58:47.999422] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-23T21:58:48.799414] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-23T21:58:48.921218] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T21:58:48.930567] [INFO ] [REMOTE ] IBN: Full fetch complete (76650 records). [2025-10-23T21:58:48.930772] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-23T21:58:49.329536] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-23T21:58:49.329801] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-23T21:58:49.330877] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-23T21:58:49.330975] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-23T21:58:49.332626] [DEBUG] [LOCAL ] IBN: Trimmed 76650 records to 53220 (keeping 200 days of data) [2025-10-23T21:58:49.355825] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T21:58:49.601954] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-23T21:58:49.680504] [DEBUG] [LOCAL ] IBN: Primary data saved (53220 records). [2025-10-23T21:58:49.680694] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-23T21:58:49.682559] [INFO ] [MAIN ] Update Progress: 1084/2367 symbols completed. IBN took 38.8s. Estimated remaining: 2h 44m 14s. Rate: 7.8 symbols/min [2025-10-23T21:58:49.851072] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:58:49.887856] [DEBUG] [LOCAL ] IDA: Loaded 32728 existing records from primary storage. [2025-10-23T21:58:49.888254] [INFO ] [MAIN ] IDA: Loaded 32728 existing records. [2025-10-23T21:58:50.063287] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:58:50.063521] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-23T21:58:50.063614] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-23T21:58:50.063913] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-23T21:58:50.063986] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-23T21:58:50.416251] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-23T21:58:50.420848] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:58:50.573954] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T21:58:51.209481] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-23T21:58:51.215318] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T21:58:51.515855] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T21:58:51.999446] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-23T21:58:52.799520] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-23T21:58:53.169685] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T21:58:53.206262] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T21:58:53.599466] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-23T21:58:54.305600] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T21:58:54.399411] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-23T21:58:54.796420] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T21:58:55.199437] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-23T21:58:55.868481] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T21:58:55.999451] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-23T21:58:56.799405] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-23T21:58:57.183480] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T21:58:57.238838] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T21:58:57.599404] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-23T21:58:57.982136] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T21:58:58.399442] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-23T21:58:59.061057] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T21:58:59.199437] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-23T21:58:59.999704] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-23T21:59:00.178476] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T21:59:00.681431] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T21:59:00.799529] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-23T21:59:01.524382] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T21:59:01.599440] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-23T21:59:02.212870] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T21:59:02.399476] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-23T21:59:03.106826] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T21:59:03.199426] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-23T21:59:03.999413] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-23T21:59:04.176473] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T21:59:04.570252] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T21:59:04.799418] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-23T21:59:05.454117] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T21:59:05.460584] [INFO ] [REMOTE ] ICL: Full fetch complete (55877 records). [2025-10-23T21:59:05.460728] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-23T21:59:05.604580] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-23T21:59:05.841754] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-23T21:59:05.841865] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-23T21:59:05.842775] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-23T21:59:05.842852] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-23T21:59:05.843992] [DEBUG] [LOCAL ] ICL: Trimmed 55877 records to 38354 (keeping 200 days of data) [2025-10-23T21:59:06.056114] [DEBUG] [LOCAL ] ICL: Primary data saved (38354 records). [2025-10-23T21:59:06.056290] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-23T21:59:06.056448] [INFO ] [MAIN ] Update Progress: 1085/2367 symbols completed. ICL took 24.0s. Estimated remaining: 2h 44m 16s. Rate: 7.8 symbols/min [2025-10-23T21:59:06.227719] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:06.268034] [DEBUG] [LOCAL ] IDE: Loaded 9050 existing records from primary storage. [2025-10-23T21:59:06.270035] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T21:59:06.270303] [INFO ] [MAIN ] IDE: Loaded 9050 existing records. [2025-10-23T21:59:06.404534] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-23T21:59:06.464038] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:06.464278] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-23T21:59:06.464388] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-23T21:59:06.464635] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-23T21:59:06.464755] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-23T21:59:06.824002] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:07.199420] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-23T21:59:07.583788] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T21:59:07.718055] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T21:59:07.999446] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-23T21:59:08.666806] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T21:59:08.799444] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-23T21:59:09.474707] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T21:59:09.599413] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-23T21:59:10.142359] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T21:59:10.148800] [INFO ] [REMOTE ] IBTA: Full fetch complete (51207 records). [2025-10-23T21:59:10.148942] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-23T21:59:10.410204] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-23T21:59:10.562460] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-23T21:59:10.562570] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-23T21:59:10.563432] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-23T21:59:10.563510] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-23T21:59:10.564673] [DEBUG] [LOCAL ] IBTA: Trimmed 51207 records to 36287 (keeping 200 days of data) [2025-10-23T21:59:10.777523] [DEBUG] [LOCAL ] IBTA: Primary data saved (36287 records). [2025-10-23T21:59:10.777722] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-23T21:59:10.777838] [INFO ] [MAIN ] Update Progress: 1086/2367 symbols completed. IBTA took 33.3s. Estimated remaining: 2h 44m 5s. Rate: 7.8 symbols/min [2025-10-23T21:59:10.947327] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:10.965692] [DEBUG] [LOCAL ] IDT: Loaded 18550 existing records from primary storage. [2025-10-23T21:59:10.966016] [INFO ] [MAIN ] IDT: Loaded 18550 existing records. [2025-10-23T21:59:11.154789] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:11.155013] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-23T21:59:11.155091] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-23T21:59:11.155364] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-23T21:59:11.155439] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-23T21:59:11.214796] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-23T21:59:11.532066] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:11.566923] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T21:59:11.586843] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T21:59:11.999420] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-23T21:59:12.179510] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T21:59:12.765143] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T21:59:12.799407] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-23T21:59:13.580261] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T21:59:13.599406] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-23T21:59:14.248486] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T21:59:14.399484] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-23T21:59:15.031484] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T21:59:15.199473] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-23T21:59:15.999422] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-23T21:59:16.036072] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T21:59:16.799492] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-23T21:59:17.257436] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T21:59:17.599440] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-23T21:59:18.376475] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T21:59:18.399395] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-23T21:59:18.626731] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T21:59:19.203128] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-23T21:59:19.206514] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T21:59:19.931008] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T21:59:19.940585] [INFO ] [REMOTE ] ICE: Full fetch complete (77023 records). [2025-10-23T21:59:19.940794] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-23T21:59:20.004576] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-23T21:59:20.340444] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-23T21:59:20.340581] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-23T21:59:20.341670] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-23T21:59:20.341754] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-23T21:59:20.343260] [DEBUG] [LOCAL ] ICE: Trimmed 77023 records to 53399 (keeping 200 days of data) [2025-10-23T21:59:20.673331] [DEBUG] [LOCAL ] ICE: Primary data saved (53399 records). [2025-10-23T21:59:20.673528] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-23T21:59:20.674466] [INFO ] [MAIN ] Update Progress: 1087/2367 symbols completed. ICE took 40.0s. Estimated remaining: 2h 44m 0s. Rate: 7.8 symbols/min [2025-10-23T21:59:20.808897] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-23T21:59:20.887132] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:20.926809] [DEBUG] [LOCAL ] IEX: Loaded 38271 existing records from primary storage. [2025-10-23T21:59:20.927174] [INFO ] [MAIN ] IEX: Loaded 38271 existing records. [2025-10-23T21:59:21.107892] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:21.108125] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-23T21:59:21.108204] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-23T21:59:21.108478] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-23T21:59:21.108550] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-23T21:59:21.444697] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T21:59:21.486677] [INFO ] [REMOTE ] IDA: Full fetch complete (45424 records). [2025-10-23T21:59:21.491533] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:21.491941] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-23T21:59:21.601434] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-23T21:59:21.878095] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-23T21:59:21.878206] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-23T21:59:21.879046] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-23T21:59:21.879267] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-23T21:59:21.880289] [DEBUG] [LOCAL ] IDA: Trimmed 45424 records to 32984 (keeping 200 days of data) [2025-10-23T21:59:21.990753] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T21:59:22.103065] [DEBUG] [LOCAL ] IDA: Primary data saved (32984 records). [2025-10-23T21:59:22.103234] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-23T21:59:22.103353] [INFO ] [MAIN ] Update Progress: 1088/2367 symbols completed. IDA took 32.4s. Estimated remaining: 2h 43m 45s. Rate: 7.8 symbols/min [2025-10-23T21:59:22.285185] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:22.334478] [DEBUG] [LOCAL ] IFF: Loaded 51225 existing records from primary storage. [2025-10-23T21:59:22.334861] [INFO ] [MAIN ] IFF: Loaded 51225 existing records. [2025-10-23T21:59:22.404516] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-23T21:59:22.536232] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:22.537055] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T21:59:22.539532] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-23T21:59:22.540113] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-23T21:59:22.540697] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-23T21:59:22.540795] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-23T21:59:22.898415] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:23.199463] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-23T21:59:23.879103] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T21:59:23.895975] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T21:59:23.999428] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-23T21:59:24.799473] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-23T21:59:25.061237] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T21:59:25.599461] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-23T21:59:26.399409] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-23T21:59:26.444100] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T21:59:26.508816] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-23T21:59:27.199460] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-23T21:59:27.829573] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T21:59:27.999421] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-23T21:59:28.071573] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-23T21:59:28.803449] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-23T21:59:28.804708] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T21:59:29.597027] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T21:59:29.599629] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-23T21:59:30.399436] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-23T21:59:31.116722] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T21:59:31.199424] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-23T21:59:31.422867] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T21:59:31.999415] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-23T21:59:32.054363] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T21:59:32.056746] [INFO ] [REMOTE ] IDE: Full fetch complete (12839 records). [2025-10-23T21:59:32.056835] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-23T21:59:32.413097] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-23T21:59:32.413229] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-23T21:59:32.413558] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-23T21:59:32.413634] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-23T21:59:32.414143] [DEBUG] [LOCAL ] IDE: Trimmed 12839 records to 9157 (keeping 200 days of data) [2025-10-23T21:59:32.467898] [DEBUG] [LOCAL ] IDE: Primary data saved (9157 records). [2025-10-23T21:59:32.468080] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-23T21:59:32.468192] [INFO ] [MAIN ] Update Progress: 1089/2367 symbols completed. IDE took 26.4s. Estimated remaining: 2h 43m 41s. Rate: 7.8 symbols/min [2025-10-23T21:59:32.633622] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:32.652450] [DEBUG] [LOCAL ] IFN: Loaded 18590 existing records from primary storage. [2025-10-23T21:59:32.652745] [INFO ] [MAIN ] IFN: Loaded 18590 existing records. [2025-10-23T21:59:32.805639] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-23T21:59:32.832111] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:32.832317] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-23T21:59:32.832411] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-23T21:59:32.832710] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-23T21:59:32.832791] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-23T21:59:33.178067] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:33.599429] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-23T21:59:33.669832] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T21:59:34.399441] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-23T21:59:34.534772] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T21:59:34.865236] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T21:59:35.199431] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-23T21:59:35.999400] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-23T21:59:36.110128] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T21:59:36.765209] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T21:59:36.799394] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-23T21:59:36.826659] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T21:59:37.599428] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-23T21:59:38.302370] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T21:59:38.399401] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-23T21:59:38.790122] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T21:59:39.199444] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-23T21:59:39.999428] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-23T21:59:40.190854] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T21:59:40.356767] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T21:59:40.799424] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-23T21:59:41.040807] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T21:59:41.045359] [INFO ] [REMOTE ] IDT: Full fetch complete (24134 records). [2025-10-23T21:59:41.045514] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-23T21:59:41.405134] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-23T21:59:41.405240] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-23T21:59:41.405794] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-23T21:59:41.405873] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-23T21:59:41.406599] [DEBUG] [LOCAL ] IDT: Trimmed 24134 records to 18655 (keeping 200 days of data) [2025-10-23T21:59:41.516929] [DEBUG] [LOCAL ] IDT: Primary data saved (18655 records). [2025-10-23T21:59:41.517096] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-23T21:59:41.517211] [INFO ] [MAIN ] Update Progress: 1090/2367 symbols completed. IDT took 30.7s. Estimated remaining: 2h 43m 35s. Rate: 7.8 symbols/min [2025-10-23T21:59:41.605634] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-23T21:59:41.685605] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:41.706375] [DEBUG] [LOCAL ] IFS: Loaded 22165 existing records from primary storage. [2025-10-23T21:59:41.706669] [INFO ] [MAIN ] IFS: Loaded 22165 existing records. [2025-10-23T21:59:41.885107] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:41.885420] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-23T21:59:41.885494] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-23T21:59:41.885745] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-23T21:59:41.885833] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-23T21:59:42.020065] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T21:59:42.260241] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:42.399438] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-23T21:59:43.199396] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-23T21:59:43.291823] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T21:59:43.480288] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T21:59:43.999483] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-23T21:59:44.182528] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T21:59:44.680613] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T21:59:44.799429] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-23T21:59:45.599442] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-23T21:59:45.946918] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T21:59:46.399423] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-23T21:59:46.694432] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T21:59:47.199448] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-23T21:59:47.920155] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T21:59:47.999448] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-23T21:59:48.804534] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-23T21:59:48.826420] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T21:59:48.905021] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T21:59:49.599457] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-23T21:59:49.867103] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T21:59:50.399434] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-23T21:59:50.816904] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T21:59:51.199449] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-23T21:59:51.918078] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T21:59:51.999401] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-23T21:59:52.257754] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T21:59:52.718177] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T21:59:52.799420] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-23T21:59:53.599446] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-23T21:59:54.399445] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-23T21:59:54.531401] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T21:59:54.622478] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T21:59:55.095756] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T21:59:55.099732] [INFO ] [REMOTE ] IFN: Full fetch complete (28227 records). [2025-10-23T21:59:55.099869] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-23T21:59:55.208031] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-23T21:59:55.483805] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-23T21:59:55.483964] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-23T21:59:55.484610] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-23T21:59:55.484719] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-23T21:59:55.485639] [DEBUG] [LOCAL ] IFN: Trimmed 28227 records to 18692 (keeping 200 days of data) [2025-10-23T21:59:55.594707] [DEBUG] [LOCAL ] IFN: Primary data saved (18692 records). [2025-10-23T21:59:55.594868] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-23T21:59:55.594992] [INFO ] [MAIN ] Update Progress: 1091/2367 symbols completed. IFN took 23.1s. Estimated remaining: 2h 43m 34s. Rate: 7.8 symbols/min [2025-10-23T21:59:55.759202] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:55.770417] [DEBUG] [LOCAL ] IGA: Loaded 10128 existing records from primary storage. [2025-10-23T21:59:55.770698] [INFO ] [MAIN ] IGA: Loaded 10128 existing records. [2025-10-23T21:59:55.946953] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:55.947192] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-23T21:59:55.947268] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-23T21:59:55.947480] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-23T21:59:55.947563] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-23T21:59:56.005966] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-23T21:59:56.347523] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:56.398358] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T21:59:56.799439] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-23T21:59:57.413800] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T21:59:57.421207] [INFO ] [REMOTE ] IEX: Full fetch complete (53844 records). [2025-10-23T21:59:57.421460] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-23T21:59:57.602816] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-23T21:59:57.847975] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-23T21:59:57.848226] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-23T21:59:57.849863] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-23T21:59:57.849998] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-23T21:59:57.862681] [DEBUG] [LOCAL ] IEX: Trimmed 53844 records to 38489 (keeping 200 days of data) [2025-10-23T21:59:57.882220] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-23T21:59:58.146685] [DEBUG] [LOCAL ] IEX: Primary data saved (38489 records). [2025-10-23T21:59:58.146937] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-23T21:59:58.147085] [INFO ] [MAIN ] Update Progress: 1092/2367 symbols completed. IEX took 37.5s. Estimated remaining: 2h 43m 21s. Rate: 7.8 symbols/min [2025-10-23T21:59:58.330075] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T21:59:58.351229] [DEBUG] [LOCAL ] IGD: Loaded 19135 existing records from primary storage. [2025-10-23T21:59:58.351580] [INFO ] [MAIN ] IGD: Loaded 19135 existing records. [2025-10-23T21:59:58.406202] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-23T21:59:58.457104] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T21:59:58.549792] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T21:59:58.550005] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-23T21:59:58.550101] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-23T21:59:58.550315] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-23T21:59:58.550391] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-23T21:59:58.917533] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T21:59:59.199446] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-23T21:59:59.236568] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T21:59:59.999422] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-23T22:00:00.294751] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T22:00:00.428783] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T22:00:00.799409] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-23T22:00:01.599438] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-23T22:00:01.732184] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T22:00:01.741457] [INFO ] [REMOTE ] IFF: Full fetch complete (73774 records). [2025-10-23T22:00:01.741617] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-23T22:00:02.139562] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-23T22:00:02.139723] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-23T22:00:02.140792] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-23T22:00:02.140882] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-23T22:00:02.142430] [DEBUG] [LOCAL ] IFF: Trimmed 73774 records to 51608 (keeping 200 days of data) [2025-10-23T22:00:02.421609] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-23T22:00:02.467895] [DEBUG] [LOCAL ] IFF: Primary data saved (51608 records). [2025-10-23T22:00:02.468131] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-23T22:00:02.469804] [INFO ] [MAIN ] Update Progress: 1093/2367 symbols completed. IFF took 40.4s. Estimated remaining: 2h 43m 9s. Rate: 7.8 symbols/min [2025-10-23T22:00:02.648425] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:02.656422] [DEBUG] [LOCAL ] IGI: Loaded 4050 existing records from primary storage. [2025-10-23T22:00:02.656765] [INFO ] [MAIN ] IGI: Loaded 4050 existing records. [2025-10-23T22:00:02.850295] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:02.850749] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-23T22:00:02.850890] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-23T22:00:02.851245] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-23T22:00:02.851323] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-23T22:00:03.040304] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T22:00:03.204530] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-23T22:00:03.283209] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:03.285245] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T22:00:03.999459] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-23T22:00:04.413698] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-23T22:00:04.430086] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T22:00:04.799460] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-23T22:00:05.285596] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-23T22:00:05.599506] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-23T22:00:06.084507] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-23T22:00:06.399426] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-23T22:00:07.199409] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-23T22:00:07.430092] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T22:00:07.524018] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-23T22:00:07.999499] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-23T22:00:08.799474] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-23T22:00:09.162893] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T22:00:09.261820] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T22:00:09.599442] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-23T22:00:10.399413] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-23T22:00:10.626343] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T22:00:10.630221] [INFO ] [REMOTE ] IFS: Full fetch complete (32302 records). [2025-10-23T22:00:10.630357] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-23T22:00:10.995392] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-23T22:00:10.995517] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-23T22:00:10.996309] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-23T22:00:10.996389] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-23T22:00:10.997306] [DEBUG] [LOCAL ] IFS: Trimmed 32302 records to 22293 (keeping 200 days of data) [2025-10-23T22:00:11.125540] [DEBUG] [LOCAL ] IFS: Primary data saved (22293 records). [2025-10-23T22:00:11.125828] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-23T22:00:11.125980] [INFO ] [MAIN ] Update Progress: 1094/2367 symbols completed. IFS took 29.6s. Estimated remaining: 2h 43m 2s. Rate: 7.8 symbols/min [2025-10-23T22:00:11.205049] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-23T22:00:11.301221] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:11.333446] [DEBUG] [LOCAL ] IGR: Loaded 30409 existing records from primary storage. [2025-10-23T22:00:11.333804] [INFO ] [MAIN ] IGR: Loaded 30409 existing records. [2025-10-23T22:00:11.519018] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:11.520225] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-23T22:00:11.520398] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-23T22:00:11.524621] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-23T22:00:11.524918] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-23T22:00:11.525000] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-23T22:00:11.802791] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T22:00:11.883862] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:11.999433] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-23T22:00:12.676706] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-23T22:00:12.799436] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-23T22:00:13.465012] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T22:00:13.599407] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-23T22:00:14.399435] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-23T22:00:14.430478] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T22:00:15.199435] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-23T22:00:15.393536] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T22:00:15.583072] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-23T22:00:15.999477] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-23T22:00:16.799414] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-23T22:00:16.875509] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T22:00:17.599428] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-23T22:00:18.217546] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T22:00:18.399408] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-23T22:00:18.641582] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-23T22:00:19.064334] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T22:00:19.199448] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-23T22:00:19.827912] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T22:00:19.829775] [INFO ] [REMOTE ] IGI: Full fetch complete (5584 records). [2025-10-23T22:00:19.829895] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-23T22:00:20.004790] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-23T22:00:20.197882] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-23T22:00:20.198021] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-23T22:00:20.198219] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-23T22:00:20.198290] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-23T22:00:20.198726] [DEBUG] [LOCAL ] IGI: Trimmed 5584 records to 4171 (keeping 200 days of data) [2025-10-23T22:00:20.223710] [DEBUG] [LOCAL ] IGI: Primary data saved (4171 records). [2025-10-23T22:00:20.223867] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-23T22:00:20.223987] [INFO ] [MAIN ] Update Progress: 1095/2367 symbols completed. IGI took 17.8s. Estimated remaining: 2h 42m 56s. Rate: 7.8 symbols/min [2025-10-23T22:00:20.394056] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:20.399184] [DEBUG] [LOCAL ] IH: Loaded 2722 existing records from primary storage. [2025-10-23T22:00:20.399437] [INFO ] [MAIN ] IH: Loaded 2722 existing records. [2025-10-23T22:00:20.579123] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:20.579348] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-23T22:00:20.579423] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-23T22:00:20.579710] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-23T22:00:20.579794] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-23T22:00:20.804719] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-23T22:00:20.949773] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:21.454979] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T22:00:21.599451] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-23T22:00:21.608855] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T22:00:22.399420] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-23T22:00:22.955311] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T22:00:23.199471] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-23T22:00:23.395731] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T22:00:23.657619] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T22:00:23.999450] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-23T22:00:24.799432] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-23T22:00:25.400493] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T22:00:25.574508] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T22:00:25.599402] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-23T22:00:26.399406] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-23T22:00:26.415710] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T22:00:27.156823] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T22:00:27.199427] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-23T22:00:27.613811] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-23T22:00:27.999453] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-23T22:00:28.799434] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-23T22:00:29.106857] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T22:00:29.599408] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-23T22:00:30.064143] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T22:00:30.065256] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T22:00:30.399446] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-23T22:00:30.892524] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T22:00:31.199436] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-23T22:00:31.999407] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-23T22:00:32.314602] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T22:00:32.400638] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-23T22:00:32.799462] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-23T22:00:33.599429] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-23T22:00:33.910958] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T22:00:34.099167] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T22:00:34.399409] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-23T22:00:35.199451] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-23T22:00:35.946518] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T22:00:35.991327] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T22:00:35.995030] [INFO ] [REMOTE ] IGA: Full fetch complete (14320 records). [2025-10-23T22:00:35.995141] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-23T22:00:36.004737] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-23T22:00:36.405990] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-23T22:00:36.406117] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-23T22:00:36.406442] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-23T22:00:36.406537] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-23T22:00:36.407091] [DEBUG] [LOCAL ] IGA: Trimmed 14320 records to 10175 (keeping 200 days of data) [2025-10-23T22:00:36.465519] [DEBUG] [LOCAL ] IGA: Primary data saved (10175 records). [2025-10-23T22:00:36.465690] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-23T22:00:36.465804] [INFO ] [MAIN ] Update Progress: 1096/2367 symbols completed. IGA took 40.9s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-10-23T22:00:36.632689] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:36.641815] [DEBUG] [LOCAL ] IHD: Loaded 7364 existing records from primary storage. [2025-10-23T22:00:36.642048] [INFO ] [MAIN ] IHD: Loaded 7364 existing records. [2025-10-23T22:00:36.821537] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:36.800786] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-23T22:00:36.822565] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-23T22:00:36.822639] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-23T22:00:36.822844] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-23T22:00:36.822917] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-23T22:00:37.188152] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:37.189051] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T22:00:37.394931] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T22:00:37.599419] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-23T22:00:38.399463] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-23T22:00:38.885104] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T22:00:38.886221] [INFO ] [REMOTE ] IH: Full fetch complete (5035 records). [2025-10-23T22:00:38.886315] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-23T22:00:39.177594] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:00:39.207784] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-23T22:00:39.307868] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-23T22:00:39.308149] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-23T22:00:39.308407] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-23T22:00:39.308488] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-23T22:00:39.308922] [DEBUG] [LOCAL ] IH: Trimmed 5035 records to 2735 (keeping 200 days of data) [2025-10-23T22:00:39.323825] [DEBUG] [LOCAL ] IH: Primary data saved (2735 records). [2025-10-23T22:00:39.323911] [INFO ] [MAIN ] IH: Full history saved. [2025-10-23T22:00:39.324022] [INFO ] [MAIN ] Update Progress: 1097/2367 symbols completed. IH took 19.1s. Estimated remaining: 2h 42m 45s. Rate: 7.8 symbols/min [2025-10-23T22:00:39.495257] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:39.519839] [DEBUG] [LOCAL ] IHG: Loaded 23951 existing records from primary storage. [2025-10-23T22:00:39.520155] [INFO ] [MAIN ] IHG: Loaded 23951 existing records. [2025-10-23T22:00:39.695539] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:39.695807] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-23T22:00:39.695885] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-23T22:00:39.696124] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-23T22:00:39.696198] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-23T22:00:39.999433] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-23T22:00:40.060331] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:40.079165] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T22:00:40.799429] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-23T22:00:41.258855] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T22:00:41.599474] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-23T22:00:41.795959] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T22:00:42.399428] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-23T22:00:42.897217] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T22:00:42.903759] [INFO ] [REMOTE ] IGR: Full fetch complete (44705 records). [2025-10-23T22:00:42.903919] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-23T22:00:43.204537] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-23T22:00:43.320632] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-23T22:00:43.320820] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-23T22:00:43.321806] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-23T22:00:43.321891] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-23T22:00:43.323013] [DEBUG] [LOCAL ] IGR: Trimmed 44705 records to 30712 (keeping 200 days of data) [2025-10-23T22:00:43.513275] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T22:00:43.521857] [DEBUG] [LOCAL ] IGR: Primary data saved (30712 records). [2025-10-23T22:00:43.523052] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-23T22:00:43.523178] [INFO ] [MAIN ] Update Progress: 1098/2367 symbols completed. IGR took 32.4s. Estimated remaining: 2h 42m 34s. Rate: 7.8 symbols/min [2025-10-23T22:00:43.703695] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:43.739071] [DEBUG] [LOCAL ] IHS: Loaded 37211 existing records from primary storage. [2025-10-23T22:00:43.739434] [INFO ] [MAIN ] IHS: Loaded 37211 existing records. [2025-10-23T22:00:43.931356] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:43.931600] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-23T22:00:43.931699] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-23T22:00:43.931917] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-23T22:00:43.931991] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-23T22:00:44.002531] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-23T22:00:44.094894] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T22:00:44.320078] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:44.799441] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-23T22:00:45.333126] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T22:00:45.599454] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-23T22:00:46.037677] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T22:00:46.061437] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T22:00:46.399428] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-23T22:00:47.029856] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T22:00:47.199410] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-23T22:00:47.977108] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T22:00:47.999391] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-23T22:00:48.695407] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T22:00:48.799407] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-23T22:00:49.599406] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-23T22:00:49.994006] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T22:00:50.399470] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-23T22:00:50.780613] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T22:00:51.199431] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-23T22:00:51.656562] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T22:00:51.764256] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T22:00:51.999467] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-23T22:00:52.647219] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-23T22:00:52.799431] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-23T22:00:53.549075] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T22:00:53.599431] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-23T22:00:54.399505] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-23T22:00:54.891094] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T22:00:55.199415] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-23T22:00:55.396505] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T22:00:55.400909] [INFO ] [REMOTE ] IGD: Full fetch complete (30163 records). [2025-10-23T22:00:55.401055] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-23T22:00:55.794184] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-23T22:00:55.794299] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-23T22:00:55.795012] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-23T22:00:55.795107] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-23T22:00:55.795957] [DEBUG] [LOCAL ] IGD: Trimmed 30163 records to 19340 (keeping 200 days of data) [2025-10-23T22:00:55.904909] [DEBUG] [LOCAL ] IGD: Primary data saved (19340 records). [2025-10-23T22:00:55.905052] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-23T22:00:55.905140] [INFO ] [MAIN ] Update Progress: 1099/2367 symbols completed. IGD took 57.8s. Estimated remaining: 2h 42m 31s. Rate: 7.8 symbols/min [2025-10-23T22:00:56.004514] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-23T22:00:56.087208] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:56.094748] [DEBUG] [LOCAL ] IIF: Loaded 5278 existing records from primary storage. [2025-10-23T22:00:56.094982] [INFO ] [MAIN ] IIF: Loaded 5278 existing records. [2025-10-23T22:00:56.282073] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:56.282295] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-23T22:00:56.282371] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-23T22:00:56.282541] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-23T22:00:56.282613] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-23T22:00:56.626436] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T22:00:56.660919] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T22:00:56.698107] [INFO ] [REMOTE ] IHD: Full fetch complete (11747 records). [2025-10-23T22:00:56.697995] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:56.698826] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-23T22:00:56.802660] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-23T22:00:57.074990] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-23T22:00:57.075105] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-23T22:00:57.075444] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-23T22:00:57.075526] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-23T22:00:57.076083] [DEBUG] [LOCAL ] IHD: Trimmed 11747 records to 7400 (keeping 200 days of data) [2025-10-23T22:00:57.118839] [DEBUG] [LOCAL ] IHD: Primary data saved (7400 records). [2025-10-23T22:00:57.119018] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-23T22:00:57.119172] [INFO ] [MAIN ] Update Progress: 1100/2367 symbols completed. IHD took 20.7s. Estimated remaining: 2h 42m 16s. Rate: 7.8 symbols/min [2025-10-23T22:00:57.315199] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:00:57.331825] [DEBUG] [LOCAL ] IIIN: Loaded 16243 existing records from primary storage. [2025-10-23T22:00:57.332099] [INFO ] [MAIN ] IIIN: Loaded 16243 existing records. [2025-10-23T22:00:57.519101] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:00:57.519342] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-23T22:00:57.519436] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-23T22:00:57.519714] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-23T22:00:57.519805] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-23T22:00:57.602710] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-23T22:00:57.691316] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T22:00:57.907035] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:00:58.399499] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-23T22:00:58.769304] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T22:00:59.199443] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-23T22:00:59.258055] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T22:00:59.999440] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-23T22:01:00.447086] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T22:01:00.605407] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T22:01:00.799505] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-23T22:01:01.599513] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-23T22:01:01.807488] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T22:01:02.399431] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-23T22:01:03.134415] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T22:01:03.199416] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-23T22:01:03.478347] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T22:01:03.842792] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T22:01:03.999475] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-23T22:01:04.799484] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-23T22:01:05.515384] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T22:01:05.599419] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-23T22:01:06.002901] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T22:01:06.399436] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-23T22:01:07.058551] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T22:01:07.199425] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-23T22:01:07.562624] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T22:01:07.999452] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-23T22:01:08.331386] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T22:01:08.335474] [INFO ] [REMOTE ] IHG: Full fetch complete (34367 records). [2025-10-23T22:01:08.335570] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-23T22:01:08.701358] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-23T22:01:08.701461] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-23T22:01:08.702184] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-23T22:01:08.702264] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-23T22:01:08.703162] [DEBUG] [LOCAL ] IHG: Trimmed 34367 records to 24115 (keeping 200 days of data) [2025-10-23T22:01:08.800517] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-23T22:01:08.851857] [DEBUG] [LOCAL ] IHG: Primary data saved (24115 records). [2025-10-23T22:01:08.852005] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-23T22:01:08.852115] [INFO ] [MAIN ] Update Progress: 1101/2367 symbols completed. IHG took 29.5s. Estimated remaining: 2h 42m 13s. Rate: 7.8 symbols/min [2025-10-23T22:01:09.014074] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T22:01:09.030529] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:09.049080] [DEBUG] [LOCAL ] IIM: Loaded 15480 existing records from primary storage. [2025-10-23T22:01:09.049330] [INFO ] [MAIN ] IIM: Loaded 15480 existing records. [2025-10-23T22:01:09.222182] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:09.222361] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-23T22:01:09.222434] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-23T22:01:09.222748] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-23T22:01:09.222822] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-23T22:01:09.568577] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:09.599394] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-23T22:01:10.262855] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T22:01:10.321516] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-23T22:01:10.399440] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-23T22:01:11.199402] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-23T22:01:11.593948] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T22:01:11.891146] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T22:01:11.999491] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-23T22:01:12.799469] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-23T22:01:13.550999] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T22:01:13.599424] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-23T22:01:13.618395] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T22:01:14.399455] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-23T22:01:15.142524] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T22:01:15.207250] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-23T22:01:15.209550] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T22:01:15.999454] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-23T22:01:16.217884] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T22:01:16.799404] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-23T22:01:17.157880] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T22:01:17.599426] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-23T22:01:17.769070] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T22:01:18.399452] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-23T22:01:19.036987] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T22:01:19.053558] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T22:01:19.199438] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-23T22:01:19.999434] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-23T22:01:20.310254] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T22:01:20.799396] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-23T22:01:20.885725] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T22:01:20.891036] [INFO ] [REMOTE ] IHS: Full fetch complete (51582 records). [2025-10-23T22:01:20.891149] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-23T22:01:21.273486] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-23T22:01:21.273605] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-23T22:01:21.274445] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-23T22:01:21.274521] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-23T22:01:21.275592] [DEBUG] [LOCAL ] IHS: Trimmed 51582 records to 37440 (keeping 200 days of data) [2025-10-23T22:01:21.479367] [DEBUG] [LOCAL ] IHS: Primary data saved (37440 records). [2025-10-23T22:01:21.479605] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-23T22:01:21.479762] [INFO ] [MAIN ] Update Progress: 1102/2367 symbols completed. IHS took 38.0s. Estimated remaining: 2h 42m 11s. Rate: 7.8 symbols/min [2025-10-23T22:01:21.604528] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-23T22:01:21.653635] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:21.663362] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T22:01:21.690361] [DEBUG] [LOCAL ] IIPR: Loaded 28846 existing records from primary storage. [2025-10-23T22:01:21.690688] [INFO ] [MAIN ] IIPR: Loaded 28846 existing records. [2025-10-23T22:01:21.864249] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:21.864445] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-23T22:01:21.864517] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-23T22:01:21.864749] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-23T22:01:21.864822] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-23T22:01:22.217281] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:22.399404] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-23T22:01:22.651095] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T22:01:23.199439] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-23T22:01:23.999443] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-23T22:01:24.159681] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T22:01:24.235031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T22:01:24.483881] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-23T22:01:24.799492] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-23T22:01:25.599442] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-23T22:01:25.689933] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T22:01:26.113054] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T22:01:26.399443] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-23T22:01:27.199433] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-23T22:01:27.550845] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T22:01:27.552760] [INFO ] [REMOTE ] IIF: Full fetch complete (8814 records). [2025-10-23T22:01:27.552897] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-23T22:01:27.970610] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T22:01:27.999476] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-23T22:01:28.024075] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-23T22:01:28.025125] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-23T22:01:28.025428] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-23T22:01:28.025533] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-23T22:01:28.026168] [DEBUG] [LOCAL ] IIF: Trimmed 8814 records to 5300 (keeping 200 days of data) [2025-10-23T22:01:28.061246] [DEBUG] [LOCAL ] IIF: Primary data saved (5300 records). [2025-10-23T22:01:28.061426] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-23T22:01:28.061550] [INFO ] [MAIN ] Update Progress: 1103/2367 symbols completed. IIF took 32.2s. Estimated remaining: 2h 42m 2s. Rate: 7.8 symbols/min [2025-10-23T22:01:28.249965] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:28.290256] [DEBUG] [LOCAL ] IMAX: Loaded 43444 existing records from primary storage. [2025-10-23T22:01:28.290603] [INFO ] [MAIN ] IMAX: Loaded 43444 existing records. [2025-10-23T22:01:28.464573] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:28.464851] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-23T22:01:28.464927] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-23T22:01:28.465173] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-23T22:01:28.465246] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-23T22:01:28.807579] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-23T22:01:28.813375] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:29.553350] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T22:01:29.599438] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-23T22:01:29.756898] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T22:01:30.399412] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-23T22:01:30.448247] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T22:01:30.451556] [INFO ] [REMOTE ] IIIN: Full fetch complete (24926 records). [2025-10-23T22:01:30.451674] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-23T22:01:30.814377] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-23T22:01:30.814483] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-23T22:01:30.815088] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-23T22:01:30.815166] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-23T22:01:30.815899] [DEBUG] [LOCAL ] IIIN: Trimmed 24926 records to 16364 (keeping 200 days of data) [2025-10-23T22:01:30.911806] [DEBUG] [LOCAL ] IIIN: Primary data saved (16364 records). [2025-10-23T22:01:30.911976] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-23T22:01:30.912067] [INFO ] [MAIN ] Update Progress: 1104/2367 symbols completed. IIIN took 33.8s. Estimated remaining: 2h 41m 49s. Rate: 7.8 symbols/min [2025-10-23T22:01:31.104393] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:31.147074] [DEBUG] [LOCAL ] INFA: Loaded 48602 existing records from primary storage. [2025-10-23T22:01:31.147490] [INFO ] [MAIN ] INFA: Loaded 48602 existing records. [2025-10-23T22:01:31.209137] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-23T22:01:31.341754] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:31.342190] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-23T22:01:31.342272] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-23T22:01:31.342467] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-23T22:01:31.342534] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-23T22:01:31.476201] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T22:01:31.718111] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:31.999534] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-23T22:01:32.528748] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T22:01:32.799446] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-23T22:01:33.599428] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-23T22:01:33.630916] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T22:01:33.852995] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T22:01:34.399464] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-23T22:01:35.080433] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T22:01:35.199419] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-23T22:01:35.870398] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T22:01:35.999427] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-23T22:01:36.799422] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-23T22:01:37.368235] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-23T22:01:37.599427] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-23T22:01:37.893474] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T22:01:38.399437] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-23T22:01:38.491688] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-23T22:01:38.599292] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T22:01:39.199431] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-23T22:01:39.807596] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T22:01:39.999447] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-23T22:01:40.465892] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T22:01:40.799512] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-23T22:01:41.599430] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-23T22:01:41.700545] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T22:01:41.703997] [INFO ] [REMOTE ] IIM: Full fetch complete (24899 records). [2025-10-23T22:01:41.704134] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-23T22:01:41.898917] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T22:01:42.138531] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-23T22:01:42.138703] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-23T22:01:42.139375] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-23T22:01:42.139472] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-23T22:01:42.140400] [DEBUG] [LOCAL ] IIM: Trimmed 24899 records to 15593 (keeping 200 days of data) [2025-10-23T22:01:42.233537] [DEBUG] [LOCAL ] IIM: Primary data saved (15593 records). [2025-10-23T22:01:42.233765] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-23T22:01:42.233911] [INFO ] [MAIN ] Update Progress: 1105/2367 symbols completed. IIM took 33.4s. Estimated remaining: 2h 41m 45s. Rate: 7.8 symbols/min [2025-10-23T22:01:42.406220] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:42.404577] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-23T22:01:42.459323] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-23T22:01:42.459743] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-23T22:01:42.637101] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:42.637425] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-23T22:01:42.637522] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-23T22:01:42.637827] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-23T22:01:42.637920] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-23T22:01:43.012123] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:43.028340] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-23T22:01:43.199404] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-23T22:01:43.878441] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T22:01:43.999402] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-23T22:01:44.413757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T22:01:44.799421] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-23T22:01:45.454739] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T22:01:45.599472] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-23T22:01:46.238979] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T22:01:46.399513] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-23T22:01:47.199426] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-23T22:01:47.398469] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T22:01:48.005324] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-23T22:01:48.008682] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T22:01:48.532285] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T22:01:48.537673] [INFO ] [REMOTE ] IIPR: Full fetch complete (43703 records). [2025-10-23T22:01:48.537804] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-23T22:01:48.804540] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-23T22:01:48.910392] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-23T22:01:48.910507] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-23T22:01:48.911292] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-23T22:01:48.911370] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-23T22:01:48.912349] [DEBUG] [LOCAL ] IIPR: Trimmed 43703 records to 29025 (keeping 200 days of data) [2025-10-23T22:01:49.083405] [DEBUG] [LOCAL ] IIPR: Primary data saved (29025 records). [2025-10-23T22:01:49.083567] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-23T22:01:49.083711] [INFO ] [MAIN ] Update Progress: 1106/2367 symbols completed. IIPR took 27.6s. Estimated remaining: 2h 41m 37s. Rate: 7.8 symbols/min [2025-10-23T22:01:49.253345] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:49.299762] [DEBUG] [LOCAL ] ING: Loaded 50701 existing records from primary storage. [2025-10-23T22:01:49.300089] [INFO ] [MAIN ] ING: Loaded 50701 existing records. [2025-10-23T22:01:49.477151] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:49.477428] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-23T22:01:49.477667] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-23T22:01:49.477904] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-23T22:01:49.478077] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-23T22:01:49.602336] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-23T22:01:49.702563] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T22:01:49.873384] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:50.399408] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-23T22:01:50.518591] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:01:51.199413] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-23T22:01:51.266284] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T22:01:51.999437] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-23T22:01:52.177337] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T22:01:52.804912] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-23T22:01:52.810588] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T22:01:53.459381] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T22:01:53.599524] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-23T22:01:54.404637] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-23T22:01:54.423388] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T22:01:55.199425] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-23T22:01:55.342591] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T22:01:55.999408] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-23T22:01:56.137773] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T22:01:56.512348] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T22:01:56.799426] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-23T22:01:57.599457] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-23T22:01:58.247097] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-23T22:01:58.377273] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T22:01:58.385330] [INFO ] [REMOTE ] IMAX: Full fetch complete (61228 records). [2025-10-23T22:01:58.385509] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-23T22:01:58.407527] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-23T22:01:58.776412] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-23T22:01:58.776525] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-23T22:01:58.777437] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-23T22:01:58.777518] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-23T22:01:58.778837] [DEBUG] [LOCAL ] IMAX: Trimmed 61228 records to 43819 (keeping 200 days of data) [2025-10-23T22:01:59.027225] [DEBUG] [LOCAL ] IMAX: Primary data saved (43819 records). [2025-10-23T22:01:59.027380] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-23T22:01:59.027491] [INFO ] [MAIN ] Update Progress: 1107/2367 symbols completed. IMAX took 31.0s. Estimated remaining: 2h 41m 32s. Rate: 7.8 symbols/min [2025-10-23T22:01:59.219469] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-23T22:01:59.222527] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:01:59.251621] [DEBUG] [LOCAL ] INGM: Loaded 28088 existing records from primary storage. [2025-10-23T22:01:59.251949] [INFO ] [MAIN ] INGM: Loaded 28088 existing records. [2025-10-23T22:01:59.434163] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:01:59.434606] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-23T22:01:59.434729] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-23T22:01:59.434964] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-23T22:01:59.435056] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-23T22:01:59.722741] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-23T22:01:59.836597] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:01:59.999462] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-23T22:02:00.457217] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T22:02:00.799772] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-23T22:02:00.802315] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T22:02:00.813206] [INFO ] [REMOTE ] INFA: Full fetch complete (70760 records). [2025-10-23T22:02:00.813366] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-23T22:02:01.207019] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-23T22:02:01.207150] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-23T22:02:01.208308] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-23T22:02:01.208408] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-23T22:02:01.210009] [DEBUG] [LOCAL ] INFA: Trimmed 70760 records to 48954 (keeping 200 days of data) [2025-10-23T22:02:01.339725] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T22:02:01.520259] [DEBUG] [LOCAL ] INFA: Primary data saved (48954 records). [2025-10-23T22:02:01.520434] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-23T22:02:01.520549] [INFO ] [MAIN ] Update Progress: 1108/2367 symbols completed. INFA took 30.6s. Estimated remaining: 2h 41m 18s. Rate: 7.8 symbols/min [2025-10-23T22:02:01.604693] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-23T22:02:01.706615] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:01.743292] [DEBUG] [LOCAL ] INGR: Loaded 33764 existing records from primary storage. [2025-10-23T22:02:01.743634] [INFO ] [MAIN ] INGR: Loaded 33764 existing records. [2025-10-23T22:02:01.939398] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:01.939637] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-23T22:02:01.939735] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-23T22:02:01.940038] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-23T22:02:01.940112] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-23T22:02:02.304906] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:02.399428] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-23T22:02:02.637060] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T22:02:03.194435] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-23T22:02:03.199389] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-23T22:02:03.747857] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T22:02:03.999420] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-23T22:02:04.799485] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-23T22:02:05.004120] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:02:05.599432] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-23T22:02:05.780006] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T22:02:06.243952] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T22:02:06.399454] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-23T22:02:06.971299] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T22:02:07.199494] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-23T22:02:07.974495] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T22:02:07.999404] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-23T22:02:08.706571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T22:02:08.799415] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-23T22:02:09.599429] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-23T22:02:09.857509] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T22:02:10.399426] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-23T22:02:10.763317] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T22:02:11.068610] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T22:02:11.199431] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-23T22:02:11.999433] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-23T22:02:12.233476] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T22:02:12.297753] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T22:02:12.799438] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-23T22:02:13.509716] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T22:02:13.599437] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-23T22:02:14.399412] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-23T22:02:14.719463] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T22:02:15.199489] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-23T22:02:15.407785] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T22:02:15.999471] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-23T22:02:16.150109] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T22:02:16.427555] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T22:02:16.799456] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-23T22:02:17.599442] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-23T22:02:17.988127] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T22:02:18.348455] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-23T22:02:18.358385] [INFO ] [REMOTE ] ING: Full fetch complete (73816 records). [2025-10-23T22:02:18.358704] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-23T22:02:18.404628] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-23T22:02:18.780100] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-23T22:02:18.780270] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-23T22:02:18.781860] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-23T22:02:18.781958] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-23T22:02:18.784153] [DEBUG] [LOCAL ] ING: Trimmed 73816 records to 51066 (keeping 200 days of data) [2025-10-23T22:02:19.132407] [DEBUG] [LOCAL ] ING: Primary data saved (51066 records). [2025-10-23T22:02:19.132685] [INFO ] [MAIN ] ING: Full history saved. [2025-10-23T22:02:19.132839] [INFO ] [MAIN ] Update Progress: 1109/2367 symbols completed. ING took 30.0s. Estimated remaining: 2h 41m 22s. Rate: 7.8 symbols/min [2025-10-23T22:02:19.202335] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-23T22:02:19.330541] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:19.374971] [DEBUG] [LOCAL ] INN: Loaded 41470 existing records from primary storage. [2025-10-23T22:02:19.375465] [INFO ] [MAIN ] INN: Loaded 41470 existing records. [2025-10-23T22:02:19.549301] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-23T22:02:19.623531] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:19.623914] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-23T22:02:19.624005] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-23T22:02:19.624398] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-23T22:02:19.624482] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-23T22:02:20.003968] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-23T22:02:20.069374] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:20.073057] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T22:02:20.407494] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T22:02:20.799434] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-23T22:02:21.599431] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-23T22:02:21.983357] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T22:02:21.992717] [INFO ] [REMOTE ] INFY: Full fetch complete (77749 records). [2025-10-23T22:02:21.992888] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-23T22:02:22.179052] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T22:02:22.412223] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-23T22:02:22.437231] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-23T22:02:22.437329] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-23T22:02:22.438482] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-23T22:02:22.438564] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-23T22:02:22.440168] [DEBUG] [LOCAL ] INFY: Trimmed 77749 records to 53986 (keeping 200 days of data) [2025-10-23T22:02:22.759754] [DEBUG] [LOCAL ] INFY: Primary data saved (53986 records). [2025-10-23T22:02:22.759935] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-23T22:02:22.761356] [INFO ] [MAIN ] Update Progress: 1110/2367 symbols completed. INFY took 40.5s. Estimated remaining: 2h 41m 9s. Rate: 7.8 symbols/min [2025-10-23T22:02:22.940213] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:22.940482] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-23T22:02:22.940555] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-23T22:02:22.940694] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-23T22:02:22.940769] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-23T22:02:22.940851] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-23T22:02:22.940922] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-23T22:02:23.060049] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T22:02:23.211979] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-23T22:02:23.329071] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:23.343984] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T22:02:23.349316] [INFO ] [REMOTE ] INGM: Full fetch complete (41841 records). [2025-10-23T22:02:23.349437] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-23T22:02:23.731580] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-23T22:02:23.731735] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-23T22:02:23.732513] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-23T22:02:23.732590] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-23T22:02:23.733860] [DEBUG] [LOCAL ] INGM: Trimmed 41841 records to 28324 (keeping 200 days of data) [2025-10-23T22:02:23.907172] [DEBUG] [LOCAL ] INGM: Primary data saved (28324 records). [2025-10-23T22:02:23.907342] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-23T22:02:23.907456] [INFO ] [MAIN ] Update Progress: 1111/2367 symbols completed. INGM took 24.9s. Estimated remaining: 2h 40m 54s. Rate: 7.8 symbols/min [2025-10-23T22:02:24.005260] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-23T22:02:24.079681] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:24.115597] [DEBUG] [LOCAL ] INSP: Loaded 38560 existing records from primary storage. [2025-10-23T22:02:24.115947] [INFO ] [MAIN ] INSP: Loaded 38560 existing records. [2025-10-23T22:02:24.294759] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:24.294998] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-23T22:02:24.295078] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-23T22:02:24.295323] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-23T22:02:24.295398] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-23T22:02:24.481517] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-23T22:02:24.699572] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T22:02:24.720292] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:24.799409] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-23T22:02:25.599436] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-23T22:02:26.290616] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T22:02:26.399428] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-23T22:02:26.972972] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T22:02:27.199450] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-23T22:02:27.757119] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T22:02:27.999449] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-23T22:02:28.257430] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T22:02:28.799434] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-23T22:02:29.511809] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T22:02:29.599473] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-23T22:02:30.232635] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T22:02:30.399448] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-23T22:02:30.917291] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T22:02:31.199440] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-23T22:02:31.471157] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T22:02:31.999437] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-23T22:02:32.356083] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T22:02:32.799460] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-23T22:02:33.221032] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T22:02:33.599442] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-23T22:02:33.949231] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T22:02:34.399442] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-23T22:02:35.075717] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T22:02:35.082897] [INFO ] [REMOTE ] INGR: Full fetch complete (50826 records). [2025-10-23T22:02:35.083116] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-23T22:02:35.200571] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-23T22:02:35.423312] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T22:02:35.511817] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-23T22:02:35.511932] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-23T22:02:35.512871] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-23T22:02:35.512953] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-23T22:02:35.514113] [DEBUG] [LOCAL ] INGR: Trimmed 50826 records to 34005 (keeping 200 days of data) [2025-10-23T22:02:35.720213] [DEBUG] [LOCAL ] INGR: Primary data saved (34005 records). [2025-10-23T22:02:35.720380] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-23T22:02:35.720493] [INFO ] [MAIN ] Update Progress: 1112/2367 symbols completed. INGR took 34.2s. Estimated remaining: 2h 40m 51s. Rate: 7.8 symbols/min [2025-10-23T22:02:35.884370] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:35.920164] [DEBUG] [LOCAL ] INSW: Loaded 39208 existing records from primary storage. [2025-10-23T22:02:35.920483] [INFO ] [MAIN ] INSW: Loaded 39208 existing records. [2025-10-23T22:02:36.008413] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-23T22:02:36.102089] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:36.102333] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-23T22:02:36.102408] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-23T22:02:36.102635] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-23T22:02:36.102741] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-23T22:02:36.448045] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:36.799419] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-23T22:02:36.898092] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T22:02:37.495346] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T22:02:37.599431] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-23T22:02:37.907162] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T22:02:38.399433] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-23T22:02:39.199452] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-23T22:02:39.389396] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T22:02:39.668766] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T22:02:39.999441] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-23T22:02:40.799416] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-23T22:02:41.082263] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T22:02:41.599438] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-23T22:02:42.100450] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T22:02:42.399434] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-23T22:02:43.199436] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-23T22:02:43.275059] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T22:02:43.328762] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-23T22:02:43.356836] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T22:02:43.999482] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-23T22:02:44.532623] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T22:02:44.799433] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-23T22:02:45.599507] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-23T22:02:45.721425] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T22:02:46.244313] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T22:02:46.399522] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-23T22:02:47.199421] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-23T22:02:47.310079] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T22:02:47.588494] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T22:02:47.999462] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-23T22:02:48.799454] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-23T22:02:48.947085] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T22:02:49.599684] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-23T22:02:49.628993] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T22:02:50.374707] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:02:50.399428] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-23T22:02:51.199410] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-23T22:02:51.374632] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T22:02:51.561352] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T22:02:51.566680] [INFO ] [REMOTE ] INR: Full fetch complete (37472 records). [2025-10-23T22:02:51.566799] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-23T22:02:51.796271] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-23T22:02:51.796774] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:02:51.796839] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:02:51.797099] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-23T22:02:51.797193] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-23T22:02:51.797266] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-23T22:02:51.797325] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-23T22:02:51.797416] [INFO ] [MAIN ] Update Progress: 1113/2367 symbols completed. INR took 29.0s. Estimated remaining: 2h 40m 53s. Rate: 7.8 symbols/min [2025-10-23T22:02:51.963677] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:52.014495] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-23T22:02:52.017989] [DEBUG] [LOCAL ] INVH: Loaded 53194 existing records from primary storage. [2025-10-23T22:02:52.018421] [INFO ] [MAIN ] INVH: Loaded 53194 existing records. [2025-10-23T22:02:52.231754] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:52.232017] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-23T22:02:52.232112] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-23T22:02:52.232677] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-23T22:02:52.232771] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-23T22:02:52.610061] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:52.611710] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T22:02:52.799421] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-23T22:02:53.604537] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-23T22:02:53.619102] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T22:02:53.627062] [INFO ] [REMOTE ] INSP: Full fetch complete (53848 records). [2025-10-23T22:02:53.627242] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-23T22:02:54.013325] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-23T22:02:54.013450] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-23T22:02:54.014333] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-23T22:02:54.014474] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-23T22:02:54.015595] [DEBUG] [LOCAL ] INSP: Trimmed 53848 records to 38813 (keeping 200 days of data) [2025-10-23T22:02:54.236438] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T22:02:54.245156] [INFO ] [REMOTE ] INN: Full fetch complete (57647 records). [2025-10-23T22:02:54.246292] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-23T22:02:54.403158] [DEBUG] [LOCAL ] INSP: Primary data saved (38813 records). [2025-10-23T22:02:54.425856] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-23T22:02:54.473793] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-23T22:02:54.474796] [INFO ] [MAIN ] Update Progress: 1114/2367 symbols completed. INSP took 30.6s. Estimated remaining: 2h 40m 40s. Rate: 7.8 symbols/min [2025-10-23T22:02:54.811870] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-23T22:02:54.820690] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-23T22:02:54.842683] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-23T22:02:54.845416] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:54.845556] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-23T22:02:54.846785] [DEBUG] [LOCAL ] INN: Trimmed 57647 records to 41707 (keeping 200 days of data) [2025-10-23T22:02:54.989181] [DEBUG] [LOCAL ] INVX: Loaded 29045 existing records from primary storage. [2025-10-23T22:02:54.989609] [INFO ] [MAIN ] INVX: Loaded 29045 existing records. [2025-10-23T22:02:55.266939] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:55.273710] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-23T22:02:55.283669] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-23T22:02:55.299038] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-23T22:02:55.301815] [DEBUG] [LOCAL ] INN: Primary data saved (41707 records). [2025-10-23T22:02:55.301937] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-23T22:02:55.302068] [INFO ] [MAIN ] INN: Full history saved. [2025-10-23T22:02:55.313470] [INFO ] [MAIN ] Update Progress: 1115/2367 symbols completed. INN took 36.2s. Estimated remaining: 2h 40m 24s. Rate: 7.8 symbols/min [2025-10-23T22:02:55.501733] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T22:02:55.580519] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-23T22:02:55.722375] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:02:55.912750] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:55.949451] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-23T22:02:55.949825] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-23T22:02:56.012214] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-23T22:02:56.129992] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:02:56.130294] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-23T22:02:56.130370] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-23T22:02:56.130593] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-23T22:02:56.130705] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-23T22:02:56.485428] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:02:56.799415] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-23T22:02:57.154571] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-23T22:02:57.305395] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T22:02:57.465841] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:02:57.599410] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-23T22:02:58.399440] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-23T22:02:58.847504] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T22:02:59.199427] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-23T22:02:59.363181] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-23T22:02:59.592226] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T22:02:59.999484] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-23T22:03:00.513807] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T22:03:00.799434] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-23T22:03:01.345312] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T22:03:01.599492] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-23T22:03:02.127588] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T22:03:02.399474] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-23T22:03:03.199447] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-23T22:03:03.912694] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T22:03:03.999437] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-23T22:03:04.225976] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-23T22:03:04.752740] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-23T22:03:04.799396] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-23T22:03:05.380617] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T22:03:05.599437] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-23T22:03:06.319099] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T22:03:06.325542] [INFO ] [REMOTE ] INSW: Full fetch complete (59430 records). [2025-10-23T22:03:06.325756] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-23T22:03:06.405588] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-23T22:03:06.730215] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-23T22:03:06.730336] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-23T22:03:06.731274] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-23T22:03:06.731354] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-23T22:03:06.732782] [DEBUG] [LOCAL ] INSW: Trimmed 59430 records to 39476 (keeping 200 days of data) [2025-10-23T22:03:06.976105] [DEBUG] [LOCAL ] INSW: Primary data saved (39476 records). [2025-10-23T22:03:06.976298] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-23T22:03:06.976421] [INFO ] [MAIN ] Update Progress: 1116/2367 symbols completed. INSW took 31.3s. Estimated remaining: 2h 40m 21s. Rate: 7.8 symbols/min [2025-10-23T22:03:07.159269] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:03:07.205199] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-23T22:03:07.208340] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-23T22:03:07.208802] [INFO ] [MAIN ] IOT: Loaded 53475 existing records. [2025-10-23T22:03:07.399816] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:03:07.400205] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-23T22:03:07.400419] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-23T22:03:07.400840] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-23T22:03:07.400986] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-23T22:03:07.726899] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T22:03:07.843429] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:03:07.951452] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T22:03:07.999471] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-23T22:03:08.799415] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-23T22:03:09.599476] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-23T22:03:09.896393] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T22:03:10.118997] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-23T22:03:10.399444] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-23T22:03:10.607254] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T22:03:10.741879] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T22:03:11.199439] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-23T22:03:11.999459] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-23T22:03:12.799456] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-23T22:03:13.058741] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-23T22:03:13.135927] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-23T22:03:13.599473] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-23T22:03:13.849116] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T22:03:14.086121] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T22:03:14.399477] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-23T22:03:15.199454] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-23T22:03:15.999458] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-23T22:03:16.417007] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-23T22:03:16.510523] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T22:03:16.580970] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T22:03:16.799422] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-23T22:03:17.217707] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T22:03:17.599421] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-23T22:03:18.399456] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-23T22:03:18.531239] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T22:03:19.199540] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-23T22:03:19.476303] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T22:03:19.712788] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T22:03:19.717778] [INFO ] [REMOTE ] INVX: Full fetch complete (42786 records). [2025-10-23T22:03:19.717916] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-23T22:03:19.999783] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-23T22:03:20.088274] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-23T22:03:20.088407] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-23T22:03:20.089286] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-23T22:03:20.089384] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-23T22:03:20.090414] [DEBUG] [LOCAL ] INVX: Trimmed 42786 records to 29267 (keeping 200 days of data) [2025-10-23T22:03:20.257309] [DEBUG] [LOCAL ] INVX: Primary data saved (29267 records). [2025-10-23T22:03:20.257497] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-23T22:03:20.257685] [INFO ] [MAIN ] Update Progress: 1117/2367 symbols completed. INVX took 25.7s. Estimated remaining: 2h 40m 20s. Rate: 7.8 symbols/min [2025-10-23T22:03:20.799490] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-23T22:03:21.849868] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-23T22:03:21.861960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-23T22:03:21.900890] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T22:03:22.399500] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-23T22:03:22.527353] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T22:03:23.199489] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-23T22:03:24.025474] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T22:03:24.036911] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-23T22:03:24.364703] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-23T22:03:24.719404] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-23T22:03:24.766157] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:03:24.775694] [INFO ] [REMOTE ] INVH: Full fetch complete (76994 records). [2025-10-23T22:03:24.775863] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-23T22:03:24.807389] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-23T22:03:25.169574] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-23T22:03:25.169722] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-23T22:03:25.170907] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-23T22:03:25.170998] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-23T22:03:25.172499] [DEBUG] [LOCAL ] INVH: Trimmed 76994 records to 53583 (keeping 200 days of data) [2025-10-23T22:03:25.503963] [DEBUG] [LOCAL ] INVH: Primary data saved (53583 records). [2025-10-23T22:03:25.504165] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-23T22:03:25.505476] [INFO ] [MAIN ] Update Progress: 1118/2367 symbols completed. INVH took 33.7s. Estimated remaining: 2h 40m 9s. Rate: 7.8 symbols/min [2025-10-23T22:03:25.599434] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-23T22:03:27.680229] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-23T22:03:27.692142] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-23T22:03:27.730870] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-23T22:03:27.742919] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-23T22:03:29.529722] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T22:03:29.545041] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-23T22:03:30.063892] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-23T22:03:30.075486] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-23T22:03:31.553422] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T22:03:31.564818] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-23T22:03:32.775635] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-23T22:03:32.784820] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-23T22:03:32.784967] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-23T22:03:33.173252] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-23T22:03:33.173400] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-23T22:03:33.174563] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-23T22:03:33.174687] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-23T22:03:33.176143] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-23T22:03:33.503735] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-23T22:03:33.504081] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-23T22:03:33.504281] [INFO ] [MAIN ] Update Progress: 1119/2367 symbols completed. IONQ took 38.2s. Estimated remaining: 2h 40m 2s. Rate: 7.8 symbols/min [2025-10-23T22:03:33.528911] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T22:03:33.538192] [INFO ] [REMOTE ] IOT: Full fetch complete (77536 records). [2025-10-23T22:03:33.538343] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-23T22:03:33.918394] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-23T22:03:33.918507] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-23T22:03:33.919547] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-23T22:03:33.919626] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-23T22:03:33.921083] [DEBUG] [LOCAL ] IOT: Trimmed 77536 records to 53849 (keeping 200 days of data) [2025-10-23T22:03:34.220875] [DEBUG] [LOCAL ] IOT: Primary data saved (53849 records). [2025-10-23T22:03:34.221029] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-23T22:03:34.221138] [INFO ] [MAIN ] Update Progress: 1120/2367 symbols completed. IOT took 27.2s. Estimated remaining: 2h 39m 46s. Rate: 7.8 symbols/min [2025-10-23T22:03:34.828566] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:03:34.820411] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:03:34.896529] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:03:34.916688] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:03:34.948885] [DEBUG] [LOCAL ] IQI: Loaded 17764 existing records from primary storage. [2025-10-23T22:03:34.949822] [INFO ] [MAIN ] IQI: Loaded 17764 existing records. [2025-10-23T22:03:34.949636] [DEBUG] [LOCAL ] IPI: Loaded 21414 existing records from primary storage. [2025-10-23T22:03:34.950215] [INFO ] [MAIN ] IPI: Loaded 21414 existing records. [2025-10-23T22:03:35.220545] [DEBUG] [LOCAL ] IP: Loaded 53300 existing records from primary storage. [2025-10-23T22:03:35.243421] [INFO ] [MAIN ] IP: Loaded 53300 existing records. [2025-10-23T22:03:35.339881] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-23T22:03:35.490051] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:03:35.516962] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:03:35.497710] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-23T22:03:35.497902] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-23T22:03:35.536232] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-23T22:03:35.536313] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-23T22:03:35.576288] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-23T22:03:35.576365] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-23T22:03:35.614792] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-23T22:03:35.688940] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-23T22:03:35.815988] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:03:35.864048] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-23T22:03:35.872371] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-23T22:03:35.926604] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:03:35.958124] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-23T22:03:36.022539] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-23T22:03:36.022762] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-23T22:03:36.078624] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-23T22:03:36.124929] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-23T22:03:36.130255] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-23T22:03:36.221547] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-23T22:03:36.545200] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:03:36.589954] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-23T22:03:36.924347] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:03:37.027549] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-23T22:03:37.158372] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:03:37.179118] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-23T22:03:37.230365] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:03:37.230804] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-23T22:03:37.609903] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T22:03:37.613564] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-23T22:03:38.107129] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T22:03:38.111188] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-23T22:03:38.618450] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T22:03:38.622374] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-23T22:03:38.794028] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T22:03:38.804755] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-23T22:03:39.060744] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T22:03:39.065583] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-23T22:03:39.209362] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T22:03:39.219871] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-23T22:03:39.910050] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T22:03:39.915285] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-23T22:03:40.031337] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T22:03:40.035218] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-23T22:03:40.492758] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T22:03:40.502983] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-23T22:03:40.786690] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T22:03:40.799384] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-23T22:03:40.953982] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T22:03:40.986213] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T22:03:41.599439] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-23T22:03:41.756378] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T22:03:42.052879] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T22:03:42.399436] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-23T22:03:43.199423] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-23T22:03:43.456484] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T22:03:43.479041] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T22:03:43.999446] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-23T22:03:44.799417] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-23T22:03:45.031099] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T22:03:45.052670] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T22:03:45.599448] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-23T22:03:46.399404] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-23T22:03:46.593607] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T22:03:46.923727] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-23T22:03:47.199417] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-23T22:03:47.514180] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T22:03:47.999455] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-23T22:03:48.764847] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T22:03:48.799395] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-23T22:03:49.125882] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T22:03:49.599392] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-23T22:03:49.756580] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T22:03:50.399416] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-23T22:03:50.769505] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T22:03:50.774037] [INFO ] [REMOTE ] IPI: Full fetch complete (30334 records). [2025-10-23T22:03:50.774146] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-23T22:03:51.153954] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-23T22:03:51.154065] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-23T22:03:51.154751] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-23T22:03:51.154828] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-23T22:03:51.155589] [DEBUG] [LOCAL ] IPI: Trimmed 30334 records to 21531 (keeping 200 days of data) [2025-10-23T22:03:51.201891] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-23T22:03:51.278995] [DEBUG] [LOCAL ] IPI: Primary data saved (21531 records). [2025-10-23T22:03:51.279170] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-23T22:03:51.279299] [INFO ] [MAIN ] Update Progress: 1121/2367 symbols completed. IPI took 17.1s. Estimated remaining: 2h 39m 49s. Rate: 7.8 symbols/min [2025-10-23T22:03:51.446822] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:03:51.489160] [DEBUG] [LOCAL ] IQV: Loaded 49962 existing records from primary storage. [2025-10-23T22:03:51.489519] [INFO ] [MAIN ] IQV: Loaded 49962 existing records. [2025-10-23T22:03:51.666632] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:03:51.666887] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-23T22:03:51.666977] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-23T22:03:51.667302] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-23T22:03:51.667392] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-23T22:03:52.003560] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-23T22:03:52.034551] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:03:52.233496] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:03:52.334566] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T22:03:52.799432] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-23T22:03:53.599417] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-23T22:03:53.867212] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T22:03:54.399759] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-23T22:03:54.612089] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T22:03:55.199414] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-23T22:03:55.304228] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T22:03:55.669587] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T22:03:55.999450] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-23T22:03:56.799414] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-23T22:03:57.003188] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T22:03:57.599409] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-23T22:03:57.769445] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T22:03:57.855882] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T22:03:58.399438] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-23T22:03:59.199425] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-23T22:03:59.310581] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T22:03:59.916492] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:03:59.919607] [INFO ] [REMOTE ] IQI: Full fetch complete (26372 records). [2025-10-23T22:03:59.919749] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-23T22:04:00.007020] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-23T22:04:00.248658] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T22:04:00.333734] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-23T22:04:00.333845] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-23T22:04:00.334419] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-23T22:04:00.334493] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-23T22:04:00.335194] [DEBUG] [LOCAL ] IQI: Trimmed 26372 records to 17831 (keeping 200 days of data) [2025-10-23T22:04:00.437007] [DEBUG] [LOCAL ] IQI: Primary data saved (17831 records). [2025-10-23T22:04:00.437164] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-23T22:04:00.437275] [INFO ] [MAIN ] Update Progress: 1122/2367 symbols completed. IQI took 26.2s. Estimated remaining: 2h 39m 43s. Rate: 7.8 symbols/min [2025-10-23T22:04:00.602734] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:00.652303] [DEBUG] [LOCAL ] IR: Loaded 52749 existing records from primary storage. [2025-10-23T22:04:00.652690] [INFO ] [MAIN ] IR: Loaded 52749 existing records. [2025-10-23T22:04:00.804545] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-23T22:04:00.833865] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:00.835096] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-23T22:04:00.835170] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-23T22:04:00.835391] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-23T22:04:00.835463] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-23T22:04:01.213233] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:01.599442] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-23T22:04:02.399413] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-23T22:04:02.457250] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T22:04:02.528557] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-23T22:04:02.571713] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:04:03.199429] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-23T22:04:03.953218] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:04:03.962429] [INFO ] [REMOTE ] IP: Full fetch complete (77419 records). [2025-10-23T22:04:03.962572] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-23T22:04:04.004528] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-23T22:04:04.368002] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-23T22:04:04.368212] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-23T22:04:04.369308] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-23T22:04:04.369387] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-23T22:04:04.370894] [DEBUG] [LOCAL ] IP: Trimmed 77419 records to 53690 (keeping 200 days of data) [2025-10-23T22:04:04.487917] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-23T22:04:04.734250] [DEBUG] [LOCAL ] IP: Primary data saved (53690 records). [2025-10-23T22:04:04.734559] [INFO ] [MAIN ] IP: Full history saved. [2025-10-23T22:04:04.745207] [INFO ] [MAIN ] Update Progress: 1123/2367 symbols completed. IP took 30.5s. Estimated remaining: 2h 39m 32s. Rate: 7.8 symbols/min [2025-10-23T22:04:04.811580] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:04:04.804546] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-23T22:04:04.946577] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:04.990495] [DEBUG] [LOCAL ] IRM: Loaded 48910 existing records from primary storage. [2025-10-23T22:04:04.990893] [INFO ] [MAIN ] IRM: Loaded 48910 existing records. [2025-10-23T22:04:05.165599] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:05.165806] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-23T22:04:05.165888] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-23T22:04:05.166189] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-23T22:04:05.166259] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-23T22:04:05.514227] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:05.599479] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-23T22:04:06.399427] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-23T22:04:06.438575] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T22:04:06.450245] [INFO ] [REMOTE ] IPG: Full fetch complete (77442 records). [2025-10-23T22:04:06.450430] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-23T22:04:06.789631] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T22:04:06.983186] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-23T22:04:06.983315] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-23T22:04:06.984367] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-23T22:04:06.984455] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-23T22:04:06.985948] [DEBUG] [LOCAL ] IPG: Trimmed 77442 records to 53720 (keeping 200 days of data) [2025-10-23T22:04:07.202710] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-23T22:04:07.312003] [DEBUG] [LOCAL ] IPG: Primary data saved (53720 records). [2025-10-23T22:04:07.312147] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-23T22:04:07.312305] [INFO ] [MAIN ] Update Progress: 1124/2367 symbols completed. IPG took 33.1s. Estimated remaining: 2h 39m 18s. Rate: 7.8 symbols/min [2025-10-23T22:04:07.478787] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:07.503294] [DEBUG] [LOCAL ] IRS: Loaded 23290 existing records from primary storage. [2025-10-23T22:04:07.503601] [INFO ] [MAIN ] IRS: Loaded 23290 existing records. [2025-10-23T22:04:07.677756] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:07.678015] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-23T22:04:07.678117] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-23T22:04:07.678407] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-23T22:04:07.678482] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-23T22:04:08.001293] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-23T22:04:08.091601] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:08.121486] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T22:04:08.799422] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-23T22:04:08.986405] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T22:04:09.522713] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T22:04:09.599409] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-23T22:04:09.755896] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-23T22:04:10.399497] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-23T22:04:11.199458] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-23T22:04:11.524171] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T22:04:11.999429] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-23T22:04:12.092201] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T22:04:12.799445] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-23T22:04:13.059785] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T22:04:13.606794] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-23T22:04:13.630685] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:04:14.399417] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-23T22:04:14.650546] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T22:04:15.199502] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-23T22:04:15.414584] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T22:04:15.999420] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-23T22:04:16.799442] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-23T22:04:16.845230] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T22:04:17.599470] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-23T22:04:17.789040] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T22:04:17.904081] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T22:04:18.399434] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-23T22:04:19.199425] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-23T22:04:19.482703] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T22:04:19.498528] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (5.10 seconds). [2025-10-23T22:04:19.999463] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-23T22:04:20.278851] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T22:04:20.799487] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-23T22:04:21.565810] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-10-23T22:04:21.599401] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-23T22:04:22.314456] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T22:04:22.399403] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-23T22:04:23.199414] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-23T22:04:23.306963] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T22:04:23.890556] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T22:04:23.999402] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-23T22:04:24.329365] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T22:04:24.799426] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-23T22:04:25.298400] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (5.30 seconds). [2025-10-23T22:04:25.574697] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:04:25.599406] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-23T22:04:25.621180] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T22:04:26.399433] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-23T22:04:27.152237] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-23T22:04:27.199396] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-23T22:04:27.849117] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:04:27.857607] [INFO ] [REMOTE ] IRM: Full fetch complete (72054 records). [2025-10-23T22:04:27.857823] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-23T22:04:28.004012] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-23T22:04:28.277550] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-23T22:04:28.277797] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-23T22:04:28.279037] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-23T22:04:28.279146] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-23T22:04:28.307126] [DEBUG] [LOCAL ] IRM: Trimmed 72054 records to 49213 (keeping 200 days of data) [2025-10-23T22:04:28.308467] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T22:04:28.618401] [DEBUG] [LOCAL ] IRM: Primary data saved (49213 records). [2025-10-23T22:04:28.618585] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-23T22:04:28.618746] [INFO ] [MAIN ] Update Progress: 1125/2367 symbols completed. IRM took 23.9s. Estimated remaining: 2h 39m 26s. Rate: 7.8 symbols/min [2025-10-23T22:04:28.787573] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:28.799439] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-23T22:04:28.833421] [DEBUG] [LOCAL ] IRT: Loaded 50443 existing records from primary storage. [2025-10-23T22:04:28.833811] [INFO ] [MAIN ] IRT: Loaded 50443 existing records. [2025-10-23T22:04:29.008141] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:29.008361] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-23T22:04:29.008455] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-23T22:04:29.008903] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-23T22:04:29.008981] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-23T22:04:29.355945] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:29.599426] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-23T22:04:30.399452] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-23T22:04:30.669097] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T22:04:31.173675] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T22:04:31.199396] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-23T22:04:31.448269] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:04:31.999429] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-23T22:04:32.799473] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-23T22:04:33.317879] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T22:04:33.599410] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-23T22:04:33.761683] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T22:04:33.953296] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (5.95 seconds). [2025-10-23T22:04:33.962195] [INFO ] [REMOTE ] IQV: Full fetch complete (72605 records). [2025-10-23T22:04:33.962385] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-23T22:04:34.365112] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-23T22:04:34.365226] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-23T22:04:34.366244] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-23T22:04:34.366483] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-23T22:04:34.368079] [DEBUG] [LOCAL ] IQV: Trimmed 72605 records to 50338 (keeping 200 days of data) [2025-10-23T22:04:34.417713] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-23T22:04:34.671758] [DEBUG] [LOCAL ] IQV: Primary data saved (50338 records). [2025-10-23T22:04:34.671967] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-23T22:04:34.672117] [INFO ] [MAIN ] Update Progress: 1126/2367 symbols completed. IQV took 43.4s. Estimated remaining: 2h 39m 16s. Rate: 7.8 symbols/min [2025-10-23T22:04:34.848916] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:34.865513] [DEBUG] [LOCAL ] ISD: Loaded 15648 existing records from primary storage. [2025-10-23T22:04:34.865806] [INFO ] [MAIN ] ISD: Loaded 15648 existing records. [2025-10-23T22:04:35.045040] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:35.045364] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-23T22:04:35.045451] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-23T22:04:35.045722] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-23T22:04:35.045807] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-23T22:04:35.414002] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:35.414633] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-23T22:04:35.453045] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T22:04:35.536527] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T22:04:35.999428] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-23T22:04:36.272609] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (5.07 seconds). [2025-10-23T22:04:36.282012] [INFO ] [REMOTE ] IR: Full fetch complete (76482 records). [2025-10-23T22:04:36.282172] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-23T22:04:36.635066] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T22:04:36.733946] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-23T22:04:36.734063] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-23T22:04:36.735189] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-23T22:04:36.735276] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-23T22:04:36.736759] [DEBUG] [LOCAL ] IR: Trimmed 76482 records to 53119 (keeping 200 days of data) [2025-10-23T22:04:36.825076] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-23T22:04:37.059605] [DEBUG] [LOCAL ] IR: Primary data saved (53119 records). [2025-10-23T22:04:37.059791] [INFO ] [MAIN ] IR: Full history saved. [2025-10-23T22:04:37.059902] [INFO ] [MAIN ] Update Progress: 1127/2367 symbols completed. IR took 36.6s. Estimated remaining: 2h 39m 2s. Rate: 7.8 symbols/min [2025-10-23T22:04:37.228359] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:37.266776] [DEBUG] [LOCAL ] IT: Loaded 42205 existing records from primary storage. [2025-10-23T22:04:37.267096] [INFO ] [MAIN ] IT: Loaded 42205 existing records. [2025-10-23T22:04:37.445704] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:37.446113] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-23T22:04:37.446328] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-23T22:04:37.446623] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-23T22:04:37.447101] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-23T22:04:37.628831] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-23T22:04:37.777349] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T22:04:37.860816] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:38.184889] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T22:04:38.399437] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-23T22:04:38.442997] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T22:04:39.199451] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-23T22:04:39.668133] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T22:04:39.673267] [INFO ] [REMOTE ] IRS: Full fetch complete (32691 records). [2025-10-23T22:04:39.673362] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-23T22:04:40.006866] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-23T22:04:40.046146] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-23T22:04:40.046306] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-23T22:04:40.047030] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-23T22:04:40.047108] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-23T22:04:40.047931] [DEBUG] [LOCAL ] IRS: Trimmed 32691 records to 23500 (keeping 200 days of data) [2025-10-23T22:04:40.145809] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T22:04:40.200828] [DEBUG] [LOCAL ] IRS: Primary data saved (23500 records). [2025-10-23T22:04:40.201005] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-23T22:04:40.201122] [INFO ] [MAIN ] Update Progress: 1128/2367 symbols completed. IRS took 32.9s. Estimated remaining: 2h 38m 50s. Rate: 7.8 symbols/min [2025-10-23T22:04:40.368223] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:40.399532] [DEBUG] [LOCAL ] ITGR: Loaded 30945 existing records from primary storage. [2025-10-23T22:04:40.399860] [INFO ] [MAIN ] ITGR: Loaded 30945 existing records. [2025-10-23T22:04:40.576975] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:40.577175] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-23T22:04:40.577250] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-23T22:04:40.577456] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-23T22:04:40.577528] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-23T22:04:40.808358] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-23T22:04:40.933440] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:41.524704] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T22:04:41.599407] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-23T22:04:41.773098] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T22:04:42.399435] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-23T22:04:43.041026] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T22:04:43.199416] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-23T22:04:43.331610] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T22:04:43.999440] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-23T22:04:44.802278] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-23T22:04:44.804044] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T22:04:44.959784] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T22:04:45.599460] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-23T22:04:46.313846] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T22:04:46.399551] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-23T22:04:47.199487] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-23T22:04:47.374587] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T22:04:47.653752] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T22:04:47.999423] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-23T22:04:48.338335] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T22:04:48.799422] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-23T22:04:48.984045] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T22:04:49.599493] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-23T22:04:50.283809] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T22:04:50.399414] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-23T22:04:50.520831] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T22:04:51.199433] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-23T22:04:51.621471] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T22:04:51.999479] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-23T22:04:52.479515] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T22:04:52.799516] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-23T22:04:53.009297] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T22:04:53.599432] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-23T22:04:54.388836] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T22:04:54.399444] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-23T22:04:55.046918] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T22:04:55.199447] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-23T22:04:55.783528] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T22:04:55.999431] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-23T22:04:56.616025] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T22:04:56.725597] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:04:56.729106] [INFO ] [REMOTE ] ISD: Full fetch complete (24089 records). [2025-10-23T22:04:56.729207] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-23T22:04:56.804634] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-23T22:04:57.094829] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-23T22:04:57.094961] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-23T22:04:57.095555] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-23T22:04:57.095698] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-23T22:04:57.096368] [DEBUG] [LOCAL ] ISD: Trimmed 24089 records to 15726 (keeping 200 days of data) [2025-10-23T22:04:57.188847] [DEBUG] [LOCAL ] ISD: Primary data saved (15726 records). [2025-10-23T22:04:57.189019] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-23T22:04:57.189151] [INFO ] [MAIN ] Update Progress: 1129/2367 symbols completed. ISD took 22.5s. Estimated remaining: 2h 38m 52s. Rate: 7.8 symbols/min [2025-10-23T22:04:57.354767] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:04:57.387870] [DEBUG] [LOCAL ] ITT: Loaded 32352 existing records from primary storage. [2025-10-23T22:04:57.388174] [INFO ] [MAIN ] ITT: Loaded 32352 existing records. [2025-10-23T22:04:57.563956] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:04:57.564140] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-23T22:04:57.564213] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-23T22:04:57.564417] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-23T22:04:57.564487] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-23T22:04:57.605728] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-23T22:04:57.991875] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:04:58.399430] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-23T22:04:58.577334] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T22:04:59.199415] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-23T22:04:59.552344] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T22:04:59.999435] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-23T22:05:00.034365] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T22:05:00.702675] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T22:05:00.799400] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-23T22:05:01.599476] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-23T22:05:01.903517] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T22:05:02.207785] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T22:05:02.399469] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-23T22:05:03.063858] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T22:05:03.199405] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-23T22:05:03.939846] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T22:05:03.999401] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-23T22:05:04.799407] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-23T22:05:04.941571] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T22:05:04.949631] [INFO ] [REMOTE ] IT: Full fetch complete (58067 records). [2025-10-23T22:05:04.949774] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-23T22:05:05.324799] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-23T22:05:05.324907] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-23T22:05:05.325821] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-23T22:05:05.325899] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-23T22:05:05.327104] [DEBUG] [LOCAL ] IT: Trimmed 58067 records to 42542 (keeping 200 days of data) [2025-10-23T22:05:05.585090] [DEBUG] [LOCAL ] IT: Primary data saved (42542 records). [2025-10-23T22:05:05.585286] [INFO ] [MAIN ] IT: Full history saved. [2025-10-23T22:05:05.585405] [INFO ] [MAIN ] Update Progress: 1130/2367 symbols completed. IT took 28.5s. Estimated remaining: 2h 38m 45s. Rate: 7.8 symbols/min [2025-10-23T22:05:05.607551] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-23T22:05:05.764629] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:05.833789] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T22:05:05.853455] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:05:05.860278] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-10-23T22:05:05.867434] [INFO ] [MAIN ] ITUB: Loaded 53318 existing records. [2025-10-23T22:05:06.056148] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:06.056371] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-23T22:05:06.056447] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-23T22:05:06.056698] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-23T22:05:06.056771] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-23T22:05:06.404865] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-23T22:05:06.410188] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:07.199432] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-23T22:05:07.347679] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T22:05:07.356587] [INFO ] [REMOTE ] IRT: Full fetch complete (72881 records). [2025-10-23T22:05:07.356782] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-23T22:05:07.753123] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-23T22:05:07.753378] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-23T22:05:07.761156] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-23T22:05:07.772330] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-23T22:05:07.773702] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T22:05:07.782338] [DEBUG] [LOCAL ] IRT: Trimmed 72881 records to 50769 (keeping 200 days of data) [2025-10-23T22:05:08.010459] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-23T22:05:08.088130] [DEBUG] [LOCAL ] IRT: Primary data saved (50769 records). [2025-10-23T22:05:08.088300] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-23T22:05:08.088413] [INFO ] [MAIN ] Update Progress: 1131/2367 symbols completed. IRT took 39.5s. Estimated remaining: 2h 38m 32s. Rate: 7.8 symbols/min [2025-10-23T22:05:08.254353] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:08.294672] [DEBUG] [LOCAL ] ITW: Loaded 45583 existing records from primary storage. [2025-10-23T22:05:08.295001] [INFO ] [MAIN ] ITW: Loaded 45583 existing records. [2025-10-23T22:05:08.468171] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:08.468414] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-23T22:05:08.468490] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-23T22:05:08.468749] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-23T22:05:08.468835] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-23T22:05:08.818324] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-23T22:05:08.822893] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:09.447481] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T22:05:09.599415] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-23T22:05:09.982935] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T22:05:10.399452] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-23T22:05:10.633116] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:05:10.839433] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (3.64 seconds). [2025-10-23T22:05:11.199445] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-23T22:05:11.999495] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-23T22:05:12.115391] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T22:05:12.550709] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T22:05:12.799498] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-23T22:05:13.300429] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T22:05:13.599443] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-23T22:05:14.399416] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-23T22:05:15.199433] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-23T22:05:15.449631] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T22:05:15.650298] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-23T22:05:15.682184] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T22:05:15.688191] [INFO ] [REMOTE ] ITGR: Full fetch complete (43550 records). [2025-10-23T22:05:15.688332] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-23T22:05:16.000116] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-23T22:05:16.078138] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-23T22:05:16.078450] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-23T22:05:16.079680] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-23T22:05:16.079830] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-23T22:05:16.097557] [DEBUG] [LOCAL ] ITGR: Trimmed 43550 records to 31335 (keeping 200 days of data) [2025-10-23T22:05:16.098977] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-23T22:05:16.293493] [DEBUG] [LOCAL ] ITGR: Primary data saved (31335 records). [2025-10-23T22:05:16.293704] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-23T22:05:16.293808] [INFO ] [MAIN ] Update Progress: 1132/2367 symbols completed. ITGR took 36.1s. Estimated remaining: 2h 38m 25s. Rate: 7.8 symbols/min [2025-10-23T22:05:16.465098] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:16.507129] [DEBUG] [LOCAL ] IVR: Loaded 47827 existing records from primary storage. [2025-10-23T22:05:16.507487] [INFO ] [MAIN ] IVR: Loaded 47827 existing records. [2025-10-23T22:05:16.683893] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:16.684157] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-23T22:05:16.684237] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-23T22:05:16.684509] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-23T22:05:16.684583] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-23T22:05:16.804537] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-23T22:05:17.041209] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:17.599418] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-23T22:05:17.946673] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T22:05:18.399427] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-23T22:05:18.529376] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T22:05:18.678373] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T22:05:19.199445] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-23T22:05:19.999436] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-23T22:05:20.141075] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:05:20.601719] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T22:05:20.607331] [INFO ] [REMOTE ] ITT: Full fetch complete (47621 records). [2025-10-23T22:05:20.607466] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-23T22:05:20.804572] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-23T22:05:20.988178] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-23T22:05:20.988292] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-23T22:05:20.989167] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-23T22:05:20.989249] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-23T22:05:20.990250] [DEBUG] [LOCAL ] ITT: Trimmed 47621 records to 32539 (keeping 200 days of data) [2025-10-23T22:05:21.187853] [DEBUG] [LOCAL ] ITT: Primary data saved (32539 records). [2025-10-23T22:05:21.188036] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-23T22:05:21.188159] [INFO ] [MAIN ] Update Progress: 1133/2367 symbols completed. ITT took 24.0s. Estimated remaining: 2h 38m 14s. Rate: 7.8 symbols/min [2025-10-23T22:05:21.357092] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:21.386225] [DEBUG] [LOCAL ] IVT: Loaded 31418 existing records from primary storage. [2025-10-23T22:05:21.386522] [INFO ] [MAIN ] IVT: Loaded 31418 existing records. [2025-10-23T22:05:21.567171] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:21.567400] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-23T22:05:21.567477] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-23T22:05:21.567735] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-23T22:05:21.567810] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-23T22:05:21.609505] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-23T22:05:21.927091] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:21.955145] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T22:05:22.399473] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-23T22:05:22.548874] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T22:05:23.158419] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T22:05:23.199416] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-23T22:05:23.713422] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-23T22:05:23.999465] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-23T22:05:24.799443] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-23T22:05:25.031876] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:05:25.309257] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T22:05:25.599440] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-23T22:05:26.399424] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-23T22:05:26.599382] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T22:05:26.948718] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T22:05:27.199448] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-23T22:05:27.999442] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-23T22:05:28.200745] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T22:05:28.805681] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-23T22:05:28.817995] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T22:05:29.599471] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-23T22:05:29.644553] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T22:05:30.399419] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-23T22:05:30.610953] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T22:05:31.002051] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T22:05:31.199438] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-23T22:05:31.999422] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-23T22:05:32.799478] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-23T22:05:32.958492] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T22:05:33.484981] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-10-23T22:05:33.599425] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-23T22:05:34.163757] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-23T22:05:34.399410] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-23T22:05:34.454376] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T22:05:35.199393] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-23T22:05:35.304746] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:05:35.497794] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T22:05:35.999429] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-23T22:05:36.799400] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-23T22:05:37.008174] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T22:05:37.599430] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-23T22:05:37.905875] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T22:05:38.399416] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-23T22:05:38.562827] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T22:05:39.199454] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-23T22:05:39.731217] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T22:05:39.936424] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-23T22:05:39.999512] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-23T22:05:40.799451] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-23T22:05:41.482055] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-23T22:05:41.599404] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-23T22:05:42.065514] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T22:05:42.399441] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-23T22:05:42.788402] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T22:05:43.199472] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-23T22:05:43.427613] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T22:05:43.797275] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T22:05:43.806723] [INFO ] [REMOTE ] ITUB: Full fetch complete (77311 records). [2025-10-23T22:05:43.806897] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-23T22:05:44.012609] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-23T22:05:44.263544] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-23T22:05:44.263927] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-23T22:05:44.265290] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-23T22:05:44.265469] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-23T22:05:44.267060] [DEBUG] [LOCAL ] ITUB: Trimmed 77311 records to 53701 (keeping 200 days of data) [2025-10-23T22:05:44.377616] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-23T22:05:44.605896] [DEBUG] [LOCAL ] ITUB: Primary data saved (53701 records). [2025-10-23T22:05:44.606104] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-23T22:05:44.606368] [INFO ] [MAIN ] Update Progress: 1134/2367 symbols completed. ITUB took 39.0s. Estimated remaining: 2h 38m 23s. Rate: 7.8 symbols/min [2025-10-23T22:05:44.777184] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:44.799429] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-23T22:05:44.799361] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T22:05:44.808808] [INFO ] [REMOTE ] ITW: Full fetch complete (66833 records). [2025-10-23T22:05:44.808974] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-23T22:05:45.136534] [DEBUG] [LOCAL ] IVZ: Loaded 53130 existing records from primary storage. [2025-10-23T22:05:45.147571] [INFO ] [MAIN ] IVZ: Loaded 53130 existing records. [2025-10-23T22:05:45.380227] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-23T22:05:45.386215] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-23T22:05:45.387204] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-23T22:05:45.389170] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-23T22:05:45.411192] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:45.411467] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-23T22:05:45.411552] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-23T22:05:45.411924] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-23T22:05:45.412005] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-23T22:05:45.443339] [DEBUG] [LOCAL ] ITW: Trimmed 66833 records to 45963 (keeping 200 days of data) [2025-10-23T22:05:45.606757] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-23T22:05:45.880235] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:46.068029] [DEBUG] [LOCAL ] ITW: Primary data saved (45963 records). [2025-10-23T22:05:46.068201] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-23T22:05:46.068332] [INFO ] [MAIN ] Update Progress: 1135/2367 symbols completed. ITW took 38.0s. Estimated remaining: 2h 38m 9s. Rate: 7.8 symbols/min [2025-10-23T22:05:46.240263] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:46.257719] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T22:05:46.264528] [INFO ] [REMOTE ] IVT: Full fetch complete (45708 records). [2025-10-23T22:05:46.264681] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-23T22:05:46.383160] [DEBUG] [LOCAL ] IX: Loaded 22121 existing records from primary storage. [2025-10-23T22:05:46.403711] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-23T22:05:46.434068] [INFO ] [MAIN ] IX: Loaded 22121 existing records. [2025-10-23T22:05:46.817369] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:46.831848] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-23T22:05:46.831730] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-23T22:05:46.831960] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-23T22:05:46.832036] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-23T22:05:46.832936] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-23T22:05:46.832994] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-23T22:05:46.833125] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-23T22:05:46.864394] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-23T22:05:46.934808] [DEBUG] [LOCAL ] IVT: Trimmed 45708 records to 31625 (keeping 200 days of data) [2025-10-23T22:05:47.315712] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:47.318238] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-23T22:05:47.409095] [DEBUG] [LOCAL ] IVT: Primary data saved (31625 records). [2025-10-23T22:05:47.409276] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-23T22:05:47.409392] [INFO ] [MAIN ] Update Progress: 1136/2367 symbols completed. IVT took 26.2s. Estimated remaining: 2h 37m 54s. Rate: 7.8 symbols/min [2025-10-23T22:05:47.578942] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:47.616976] [DEBUG] [LOCAL ] J: Loaded 40527 existing records from primary storage. [2025-10-23T22:05:47.617355] [INFO ] [MAIN ] J: Loaded 40527 existing records. [2025-10-23T22:05:47.792583] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:47.792809] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-23T22:05:47.792889] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-23T22:05:47.793167] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-23T22:05:47.793241] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-23T22:05:47.980383] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T22:05:48.051127] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-23T22:05:48.186525] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:48.317847] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-23T22:05:48.327216] [INFO ] [REMOTE ] IVR: Full fetch complete (69090 records). [2025-10-23T22:05:48.327414] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-23T22:05:48.725025] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-23T22:05:48.725137] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-23T22:05:48.726122] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-23T22:05:48.726200] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-23T22:05:48.727531] [DEBUG] [LOCAL ] IVR: Trimmed 69090 records to 48202 (keeping 200 days of data) [2025-10-23T22:05:48.810542] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-23T22:05:49.004139] [DEBUG] [LOCAL ] IVR: Primary data saved (48202 records). [2025-10-23T22:05:49.004296] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-23T22:05:49.005620] [INFO ] [MAIN ] Update Progress: 1137/2367 symbols completed. IVR took 32.7s. Estimated remaining: 2h 37m 40s. Rate: 7.8 symbols/min [2025-10-23T22:05:49.175508] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:05:49.217829] [DEBUG] [LOCAL ] JBGS: Loaded 41708 existing records from primary storage. [2025-10-23T22:05:49.218239] [INFO ] [MAIN ] JBGS: Loaded 41708 existing records. [2025-10-23T22:05:49.396526] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:05:49.396796] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-23T22:05:49.396873] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-23T22:05:49.397214] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-23T22:05:49.397290] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-23T22:05:49.827430] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (3.42 seconds). [2025-10-23T22:05:49.825054] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:05:49.838427] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-23T22:05:49.985178] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T22:05:50.327366] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T22:05:50.399438] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-23T22:05:51.024219] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T22:05:51.199456] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-23T22:05:51.482941] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T22:05:51.999433] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-23T22:05:52.715733] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T22:05:52.799419] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-23T22:05:53.392916] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T22:05:53.599439] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-23T22:05:54.131182] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T22:05:54.399460] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-23T22:05:55.199403] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-23T22:05:55.258084] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T22:05:55.598437] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T22:05:55.999432] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-23T22:05:56.536504] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T22:05:56.799432] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-23T22:05:57.364777] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T22:05:57.599440] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-23T22:05:58.399420] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-23T22:05:59.199411] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-23T22:05:59.242167] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-23T22:05:59.277693] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T22:05:59.999402] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-23T22:06:00.211960] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T22:06:00.248715] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T22:06:00.799436] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-23T22:06:01.551814] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T22:06:01.599440] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-23T22:06:01.945503] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T22:06:02.399436] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-23T22:06:03.106525] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T22:06:03.199400] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-23T22:06:03.999403] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-23T22:06:04.259451] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T22:06:04.799413] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-23T22:06:05.152925] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T22:06:05.520701] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:06:05.599410] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-23T22:06:06.258864] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T22:06:06.399444] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-23T22:06:07.199429] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-23T22:06:07.459685] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T22:06:07.813772] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T22:06:07.999427] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-23T22:06:08.657545] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T22:06:08.799417] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-23T22:06:09.599447] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-23T22:06:09.756553] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T22:06:09.851116] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T22:06:10.399432] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-23T22:06:11.074205] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T22:06:11.129904] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:06:11.133951] [INFO ] [REMOTE ] IX: Full fetch complete (28748 records). [2025-10-23T22:06:11.134099] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-23T22:06:11.204568] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-23T22:06:11.517285] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-23T22:06:11.517412] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-23T22:06:11.518158] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-23T22:06:11.518264] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-23T22:06:11.519127] [DEBUG] [LOCAL ] IX: Trimmed 28748 records to 22244 (keeping 200 days of data) [2025-10-23T22:06:11.657788] [DEBUG] [LOCAL ] IX: Primary data saved (22244 records). [2025-10-23T22:06:11.657935] [INFO ] [MAIN ] IX: Full history saved. [2025-10-23T22:06:11.658084] [INFO ] [MAIN ] Update Progress: 1138/2367 symbols completed. IX took 25.6s. Estimated remaining: 2h 37m 49s. Rate: 7.8 symbols/min [2025-10-23T22:06:11.824606] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:11.862927] [DEBUG] [LOCAL ] JBI: Loaded 42579 existing records from primary storage. [2025-10-23T22:06:11.863261] [INFO ] [MAIN ] JBI: Loaded 42579 existing records. [2025-10-23T22:06:12.004602] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-23T22:06:12.040947] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:12.041107] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-23T22:06:12.041194] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-23T22:06:12.041398] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-23T22:06:12.041474] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-23T22:06:12.399217] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:12.676680] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T22:06:12.683056] [INFO ] [REMOTE ] JBGS: Full fetch complete (59183 records). [2025-10-23T22:06:12.683182] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-23T22:06:12.804629] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-23T22:06:13.064029] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-23T22:06:13.064128] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-23T22:06:13.065077] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-23T22:06:13.065156] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-23T22:06:13.066400] [DEBUG] [LOCAL ] JBGS: Trimmed 59183 records to 41920 (keeping 200 days of data) [2025-10-23T22:06:13.310299] [DEBUG] [LOCAL ] JBGS: Primary data saved (41920 records). [2025-10-23T22:06:13.310449] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-23T22:06:13.311629] [INFO ] [MAIN ] Update Progress: 1139/2367 symbols completed. JBGS took 24.3s. Estimated remaining: 2h 37m 34s. Rate: 7.8 symbols/min [2025-10-23T22:06:13.480507] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:13.527137] [DEBUG] [LOCAL ] JBL: Loaded 48330 existing records from primary storage. [2025-10-23T22:06:13.527512] [INFO ] [MAIN ] JBL: Loaded 48330 existing records. [2025-10-23T22:06:13.604624] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-23T22:06:13.708247] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:13.708432] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-23T22:06:13.708513] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-23T22:06:13.708927] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-23T22:06:13.709002] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-23T22:06:14.072099] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:14.102305] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T22:06:14.399485] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-23T22:06:14.492472] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T22:06:15.199439] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-23T22:06:15.999425] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-23T22:06:16.061562] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T22:06:16.577722] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T22:06:16.741337] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-10-23T22:06:16.799401] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-23T22:06:17.599448] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-23T22:06:18.197591] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T22:06:18.399430] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-23T22:06:18.509910] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T22:06:19.199418] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-23T22:06:19.290009] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T22:06:19.969736] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T22:06:19.999393] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-23T22:06:20.699390] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-23T22:06:20.799418] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-23T22:06:21.118908] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T22:06:21.599481] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-23T22:06:22.237910] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T22:06:22.399408] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-23T22:06:23.199420] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-23T22:06:23.547430] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T22:06:23.915066] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:06:23.923326] [INFO ] [REMOTE ] J: Full fetch complete (59867 records). [2025-10-23T22:06:23.923472] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-23T22:06:24.004129] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-23T22:06:24.275439] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T22:06:24.376937] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-23T22:06:24.377082] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-23T22:06:24.378079] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-23T22:06:24.378159] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-23T22:06:24.379369] [DEBUG] [LOCAL ] J: Trimmed 59867 records to 40852 (keeping 200 days of data) [2025-10-23T22:06:24.534622] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-23T22:06:24.668948] [DEBUG] [LOCAL ] J: Primary data saved (40852 records). [2025-10-23T22:06:24.669098] [INFO ] [MAIN ] J: Full history saved. [2025-10-23T22:06:24.669209] [INFO ] [MAIN ] Update Progress: 1140/2367 symbols completed. J took 37.3s. Estimated remaining: 2h 37m 31s. Rate: 7.8 symbols/min [2025-10-23T22:06:24.806093] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-23T22:06:24.836674] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:24.864428] [DEBUG] [LOCAL ] JBND: Loaded 27369 existing records from primary storage. [2025-10-23T22:06:24.864784] [INFO ] [MAIN ] JBND: Loaded 27369 existing records. [2025-10-23T22:06:25.056520] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:25.056767] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-23T22:06:25.056844] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-23T22:06:25.057065] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-23T22:06:25.057142] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-23T22:06:25.401593] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:25.599404] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-23T22:06:26.100506] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-23T22:06:26.110075] [INFO ] [REMOTE ] IVZ: Full fetch complete (77051 records). [2025-10-23T22:06:26.110245] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-23T22:06:26.404325] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-23T22:06:26.518479] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:06:26.545728] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-23T22:06:26.545972] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-23T22:06:26.547154] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-23T22:06:26.547580] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-23T22:06:26.549103] [DEBUG] [LOCAL ] IVZ: Trimmed 77051 records to 53518 (keeping 200 days of data) [2025-10-23T22:06:26.867534] [DEBUG] [LOCAL ] IVZ: Primary data saved (53518 records). [2025-10-23T22:06:26.867726] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-23T22:06:26.867839] [INFO ] [MAIN ] Update Progress: 1141/2367 symbols completed. IVZ took 42.3s. Estimated remaining: 2h 37m 17s. Rate: 7.8 symbols/min [2025-10-23T22:06:27.035265] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:27.035507] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-23T22:06:27.035595] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-23T22:06:27.035804] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-23T22:06:27.035895] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-23T22:06:27.036027] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-23T22:06:27.036124] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-23T22:06:27.207969] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-23T22:06:27.387453] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:27.999420] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-23T22:06:28.262198] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T22:06:28.284079] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:06:28.284404] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-23T22:06:28.284509] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:06:28.284615] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-23T22:06:28.284747] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:06:28.284834] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-23T22:06:28.284951] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-23T22:06:28.285024] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-23T22:06:28.285112] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-23T22:06:28.285210] [INFO ] [MAIN ] Update Progress: 1142/2367 symbols completed. JBS took 1.4s. Estimated remaining: 2h 37m 3s. Rate: 7.8 symbols/min [2025-10-23T22:06:28.453121] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:28.488483] [DEBUG] [LOCAL ] JBTM: Loaded 33593 existing records from primary storage. [2025-10-23T22:06:28.488868] [INFO ] [MAIN ] JBTM: Loaded 33593 existing records. [2025-10-23T22:06:28.670740] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:28.670938] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-23T22:06:28.671030] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-23T22:06:28.671580] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-23T22:06:28.671686] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-23T22:06:28.821049] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-23T22:06:29.053940] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T22:06:29.052527] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:29.599441] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-23T22:06:30.399444] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-23T22:06:30.745683] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-23T22:06:31.161764] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T22:06:31.199418] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-23T22:06:31.802895] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T22:06:31.999471] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-23T22:06:32.799498] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-23T22:06:33.599418] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-23T22:06:34.098881] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T22:06:34.399426] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-23T22:06:34.525337] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (3.33 seconds). [2025-10-23T22:06:34.811188] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T22:06:34.974517] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (2.98 seconds). [2025-10-23T22:06:35.199448] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-23T22:06:35.422149] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T22:06:35.999437] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-23T22:06:36.655323] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T22:06:36.662321] [INFO ] [REMOTE ] JBI: Full fetch complete (63507 records). [2025-10-23T22:06:36.662461] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-23T22:06:36.808759] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-23T22:06:37.062457] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-23T22:06:37.062601] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-23T22:06:37.063691] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-23T22:06:37.063773] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-23T22:06:37.065122] [DEBUG] [LOCAL ] JBI: Trimmed 63507 records to 42829 (keeping 200 days of data) [2025-10-23T22:06:37.305803] [DEBUG] [LOCAL ] JBI: Primary data saved (42829 records). [2025-10-23T22:06:37.305962] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-23T22:06:37.306074] [INFO ] [MAIN ] Update Progress: 1143/2367 symbols completed. JBI took 25.6s. Estimated remaining: 2h 36m 56s. Rate: 7.8 symbols/min [2025-10-23T22:06:37.482883] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:37.495299] [DEBUG] [LOCAL ] JCE: Loaded 7251 existing records from primary storage. [2025-10-23T22:06:37.495584] [INFO ] [MAIN ] JCE: Loaded 7251 existing records. [2025-10-23T22:06:37.609417] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-23T22:06:37.698688] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:37.699117] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-23T22:06:37.699290] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-23T22:06:37.699624] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-23T22:06:37.699801] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-23T22:06:38.030139] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T22:06:38.114975] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:38.401244] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-23T22:06:38.402972] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T22:06:38.681170] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T22:06:39.171241] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T22:06:39.199403] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-23T22:06:39.776973] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T22:06:39.999418] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-23T22:06:40.626328] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T22:06:40.799426] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-23T22:06:41.535501] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T22:06:41.599432] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-23T22:06:42.147281] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T22:06:42.399447] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-23T22:06:43.199520] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-23T22:06:43.488637] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-23T22:06:43.667761] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T22:06:43.999452] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-23T22:06:44.721588] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-23T22:06:44.799420] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-23T22:06:45.539597] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-23T22:06:45.599423] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-23T22:06:46.247386] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-23T22:06:46.399445] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-23T22:06:47.199489] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-23T22:06:47.545809] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T22:06:47.999488] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-23T22:06:48.365891] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T22:06:48.615150] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T22:06:48.628473] [INFO ] [REMOTE ] JBL: Full fetch complete (70617 records). [2025-10-23T22:06:48.628783] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-23T22:06:48.800967] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-23T22:06:49.040455] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-23T22:06:49.040581] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-23T22:06:49.041613] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-23T22:06:49.041722] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-23T22:06:49.043211] [DEBUG] [LOCAL ] JBL: Trimmed 70617 records to 48679 (keeping 200 days of data) [2025-10-23T22:06:49.342830] [DEBUG] [LOCAL ] JBL: Primary data saved (48679 records). [2025-10-23T22:06:49.343017] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-23T22:06:49.344764] [INFO ] [MAIN ] Update Progress: 1144/2367 symbols completed. JBL took 36.0s. Estimated remaining: 2h 36m 53s. Rate: 7.8 symbols/min [2025-10-23T22:06:49.511187] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:49.566362] [DEBUG] [LOCAL ] JCI: Loaded 53518 existing records from primary storage. [2025-10-23T22:06:49.566771] [INFO ] [MAIN ] JCI: Loaded 53518 existing records. [2025-10-23T22:06:49.608936] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-23T22:06:49.744052] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:49.744287] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-23T22:06:49.744392] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-23T22:06:49.744712] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-23T22:06:49.744805] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-23T22:06:50.096992] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:50.235991] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T22:06:50.333359] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T22:06:50.399412] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-23T22:06:51.199400] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-23T22:06:51.295982] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T22:06:51.757249] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-23T22:06:51.999473] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-23T22:06:52.799439] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-23T22:06:52.808700] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:06:52.811019] [INFO ] [REMOTE ] JCE: Full fetch complete (9616 records). [2025-10-23T22:06:52.811124] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-23T22:06:53.175924] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-23T22:06:53.176036] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-23T22:06:53.176354] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-23T22:06:53.176437] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-23T22:06:53.177019] [DEBUG] [LOCAL ] JCE: Trimmed 9616 records to 7275 (keeping 200 days of data) [2025-10-23T22:06:53.219036] [DEBUG] [LOCAL ] JCE: Primary data saved (7275 records). [2025-10-23T22:06:53.219186] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-23T22:06:53.219325] [INFO ] [MAIN ] Update Progress: 1145/2367 symbols completed. JCE took 15.9s. Estimated remaining: 2h 36m 41s. Rate: 7.8 symbols/min [2025-10-23T22:06:53.397764] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:06:53.442093] [DEBUG] [LOCAL ] JEF: Loaded 50191 existing records from primary storage. [2025-10-23T22:06:53.442479] [INFO ] [MAIN ] JEF: Loaded 50191 existing records. [2025-10-23T22:06:53.604590] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-23T22:06:53.683286] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:06:53.683578] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-23T22:06:53.683693] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-23T22:06:53.683973] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-23T22:06:53.684057] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-23T22:06:54.061183] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:06:54.399446] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-23T22:06:54.659607] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T22:06:55.136394] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T22:06:55.199447] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-23T22:06:55.999517] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-23T22:06:56.167410] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T22:06:56.559260] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T22:06:56.799456] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-23T22:06:57.191204] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T22:06:57.599501] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-23T22:06:58.184510] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T22:06:58.399418] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-23T22:06:59.199410] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-23T22:06:59.279516] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T22:06:59.686090] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T22:06:59.999454] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-23T22:07:00.799462] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-23T22:07:01.587077] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-23T22:07:01.599388] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-23T22:07:01.661209] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T22:07:01.668199] [INFO ] [REMOTE ] JBTM: Full fetch complete (47089 records). [2025-10-23T22:07:01.668345] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-23T22:07:02.043502] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-23T22:07:02.043627] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-23T22:07:02.044451] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-23T22:07:02.044532] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-23T22:07:02.045814] [DEBUG] [LOCAL ] JBTM: Trimmed 47089 records to 33794 (keeping 200 days of data) [2025-10-23T22:07:02.248541] [DEBUG] [LOCAL ] JBTM: Primary data saved (33794 records). [2025-10-23T22:07:02.248726] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-23T22:07:02.248838] [INFO ] [MAIN ] Update Progress: 1146/2367 symbols completed. JBTM took 34.0s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-23T22:07:02.400461] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-23T22:07:02.419292] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:02.460294] [DEBUG] [LOCAL ] JELD: Loaded 45878 existing records from primary storage. [2025-10-23T22:07:02.460607] [INFO ] [MAIN ] JELD: Loaded 45878 existing records. [2025-10-23T22:07:02.640665] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:02.641046] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-23T22:07:02.641141] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-23T22:07:02.641442] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-23T22:07:02.641512] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-23T22:07:02.810151] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T22:07:03.035139] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:03.199402] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-23T22:07:03.236235] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T22:07:03.999436] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-23T22:07:04.436206] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T22:07:04.660020] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T22:07:04.799435] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-23T22:07:05.532006] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T22:07:05.599478] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-23T22:07:06.407245] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-23T22:07:06.412040] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T22:07:07.199411] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-23T22:07:07.433535] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:07:07.790493] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T22:07:07.999531] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-23T22:07:08.701312] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T22:07:08.799431] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-23T22:07:09.599428] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-23T22:07:10.399412] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-23T22:07:10.615475] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T22:07:11.162374] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T22:07:11.199394] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-23T22:07:11.666575] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (3.67 seconds). [2025-10-23T22:07:11.999430] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-23T22:07:12.652504] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-23T22:07:12.658935] [INFO ] [REMOTE ] JBND: Full fetch complete (36317 records). [2025-10-23T22:07:12.659053] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-23T22:07:12.815349] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-23T22:07:13.043130] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-23T22:07:13.043256] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-23T22:07:13.044034] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-23T22:07:13.044133] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-23T22:07:13.045005] [DEBUG] [LOCAL ] JBND: Trimmed 36317 records to 27627 (keeping 200 days of data) [2025-10-23T22:07:13.209452] [DEBUG] [LOCAL ] JBND: Primary data saved (27627 records). [2025-10-23T22:07:13.209605] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-23T22:07:13.209740] [INFO ] [MAIN ] Update Progress: 1147/2367 symbols completed. JBND took 48.5s. Estimated remaining: 2h 36m 31s. Rate: 7.8 symbols/min [2025-10-23T22:07:13.380704] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:13.409764] [DEBUG] [LOCAL ] JFR: Loaded 30994 existing records from primary storage. [2025-10-23T22:07:13.410073] [INFO ] [MAIN ] JFR: Loaded 30994 existing records. [2025-10-23T22:07:13.596855] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:13.597296] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-23T22:07:13.597372] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-23T22:07:13.597589] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-23T22:07:13.597692] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-23T22:07:13.964988] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:13.966005] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-23T22:07:14.008187] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T22:07:14.118796] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-10-23T22:07:14.399420] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-23T22:07:14.755772] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-23T22:07:15.199451] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-23T22:07:15.455431] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T22:07:15.999417] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-23T22:07:16.033274] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:07:16.799450] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-23T22:07:16.870070] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T22:07:17.447128] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T22:07:17.599434] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-23T22:07:18.399493] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-23T22:07:18.503778] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T22:07:18.593472] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T22:07:19.199509] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-23T22:07:19.999457] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-23T22:07:20.059422] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T22:07:20.665824] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T22:07:20.799406] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-23T22:07:21.599500] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-23T22:07:21.779307] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T22:07:21.826828] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T22:07:22.399453] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-23T22:07:23.162075] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T22:07:23.199402] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-23T22:07:23.999419] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-23T22:07:24.091985] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T22:07:24.749251] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:07:24.760247] [INFO ] [REMOTE ] JCI: Full fetch complete (77657 records). [2025-10-23T22:07:24.760438] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-23T22:07:24.804575] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-23T22:07:24.992730] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T22:07:25.235727] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-23T22:07:25.235849] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-23T22:07:25.236932] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-23T22:07:25.237011] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-23T22:07:25.238576] [DEBUG] [LOCAL ] JCI: Trimmed 77657 records to 53905 (keeping 200 days of data) [2025-10-23T22:07:25.580015] [DEBUG] [LOCAL ] JCI: Primary data saved (53905 records). [2025-10-23T22:07:25.580149] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-23T22:07:25.581567] [INFO ] [MAIN ] Update Progress: 1148/2367 symbols completed. JCI took 36.2s. Estimated remaining: 2h 36m 28s. Rate: 7.8 symbols/min [2025-10-23T22:07:25.604538] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-23T22:07:25.775872] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:25.790487] [DEBUG] [LOCAL ] JGH: Loaded 12537 existing records from primary storage. [2025-10-23T22:07:25.790787] [INFO ] [MAIN ] JGH: Loaded 12537 existing records. [2025-10-23T22:07:25.967313] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:25.967553] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-23T22:07:25.967626] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-23T22:07:25.967834] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-23T22:07:25.967901] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-23T22:07:26.326087] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:26.399432] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-23T22:07:26.738684] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-23T22:07:26.748204] [INFO ] [REMOTE ] JEF: Full fetch complete (73339 records). [2025-10-23T22:07:26.748392] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-23T22:07:27.148161] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-23T22:07:27.148373] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-23T22:07:27.149821] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-23T22:07:27.149934] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-23T22:07:27.151707] [DEBUG] [LOCAL ] JEF: Trimmed 73339 records to 50570 (keeping 200 days of data) [2025-10-23T22:07:27.203536] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-23T22:07:27.251415] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T22:07:27.401407] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T22:07:27.502321] [DEBUG] [LOCAL ] JEF: Primary data saved (50570 records). [2025-10-23T22:07:27.502484] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-23T22:07:27.502632] [INFO ] [MAIN ] Update Progress: 1149/2367 symbols completed. JEF took 34.3s. Estimated remaining: 2h 36m 14s. Rate: 7.8 symbols/min [2025-10-23T22:07:27.668455] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:27.668671] [DEBUG] [LOCAL ] JHG: No existing data file found in primary storage. [2025-10-23T22:07:27.668744] [WARN ] [MAIN ] JHG: No existing data found, performing full refresh instead. [2025-10-23T22:07:27.668856] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-23T22:07:27.668926] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-23T22:07:27.669004] [DEBUG] [LOCAL ] JHG: No primary data file found to delete. [2025-10-23T22:07:27.669069] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-23T22:07:28.003428] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-23T22:07:28.013419] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:28.459750] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T22:07:28.799454] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-23T22:07:29.451526] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T22:07:29.599420] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-23T22:07:29.645670] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T22:07:30.372221] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T22:07:30.399429] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-23T22:07:31.199427] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-23T22:07:31.238387] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T22:07:31.999434] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-23T22:07:32.299568] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T22:07:32.786770] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:07:32.799402] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-23T22:07:33.583728] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T22:07:33.599441] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-23T22:07:34.399440] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-23T22:07:35.134802] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T22:07:35.142446] [INFO ] [REMOTE ] JELD: Full fetch complete (64616 records). [2025-10-23T22:07:35.142594] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-23T22:07:35.208082] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-23T22:07:35.535842] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-23T22:07:35.536025] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-23T22:07:35.537088] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-23T22:07:35.537448] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-23T22:07:35.556704] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T22:07:35.563971] [DEBUG] [LOCAL ] JELD: Trimmed 64616 records to 46140 (keeping 200 days of data) [2025-10-23T22:07:35.812925] [DEBUG] [LOCAL ] JELD: Primary data saved (46140 records). [2025-10-23T22:07:35.813082] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-23T22:07:35.813194] [INFO ] [MAIN ] Update Progress: 1150/2367 symbols completed. JELD took 33.6s. Estimated remaining: 2h 36m 7s. Rate: 7.8 symbols/min [2025-10-23T22:07:35.979792] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:35.986421] [DEBUG] [LOCAL ] JHI: Loaded 4142 existing records from primary storage. [2025-10-23T22:07:35.986631] [INFO ] [MAIN ] JHI: Loaded 4142 existing records. [2025-10-23T22:07:36.007407] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-23T22:07:36.164515] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:36.164735] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-23T22:07:36.164813] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-23T22:07:36.165074] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-23T22:07:36.165161] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-23T22:07:36.513350] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:36.799407] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-23T22:07:36.861470] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T22:07:37.198819] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-23T22:07:37.369461] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-23T22:07:37.599421] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-23T22:07:38.101537] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-23T22:07:38.399428] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-23T22:07:39.199441] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-23T22:07:39.933751] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T22:07:39.939254] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T22:07:39.953816] [INFO ] [REMOTE ] JFR: Full fetch complete (48617 records). [2025-10-23T22:07:39.954068] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-23T22:07:40.004827] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-23T22:07:40.514036] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-23T22:07:40.514204] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-23T22:07:40.515996] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-23T22:07:40.516107] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-23T22:07:40.517699] [DEBUG] [LOCAL ] JFR: Trimmed 48617 records to 31341 (keeping 200 days of data) [2025-10-23T22:07:40.725378] [DEBUG] [LOCAL ] JFR: Primary data saved (31341 records). [2025-10-23T22:07:40.725577] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-23T22:07:40.725721] [INFO ] [MAIN ] Update Progress: 1151/2367 symbols completed. JFR took 27.5s. Estimated remaining: 2h 35m 57s. Rate: 7.8 symbols/min [2025-10-23T22:07:40.804776] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-23T22:07:40.926342] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:40.927349] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T22:07:40.935227] [DEBUG] [LOCAL ] JHS: Loaded 2984 existing records from primary storage. [2025-10-23T22:07:40.935509] [INFO ] [MAIN ] JHS: Loaded 2984 existing records. [2025-10-23T22:07:41.131145] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:41.131358] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-23T22:07:41.131437] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-23T22:07:41.131604] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-23T22:07:41.131724] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-23T22:07:41.477799] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:41.599401] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-23T22:07:42.164114] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-23T22:07:42.399439] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-23T22:07:43.199418] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-23T22:07:43.209913] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T22:07:43.999478] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-23T22:07:44.584506] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T22:07:44.799433] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-23T22:07:45.315197] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-23T22:07:45.599476] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-23T22:07:46.233439] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T22:07:46.399497] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-23T22:07:47.199516] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-23T22:07:47.323576] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T22:07:47.710334] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-23T22:07:47.931372] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (7.13 seconds). [2025-10-23T22:07:47.986624] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (4.79 seconds). [2025-10-23T22:07:47.999396] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-23T22:07:48.410292] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-23T22:07:48.799469] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-23T22:07:49.222343] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-23T22:07:49.599489] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-23T22:07:50.072611] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T22:07:50.399448] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-23T22:07:51.199453] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-23T22:07:51.999425] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-23T22:07:52.157888] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T22:07:52.318429] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T22:07:52.322673] [INFO ] [REMOTE ] JGH: Full fetch complete (16370 records). [2025-10-23T22:07:52.322756] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-23T22:07:52.685205] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-23T22:07:52.685363] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-23T22:07:52.685762] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-23T22:07:52.685839] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-23T22:07:52.686551] [DEBUG] [LOCAL ] JGH: Trimmed 16370 records to 12607 (keeping 200 days of data) [2025-10-23T22:07:52.745396] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T22:07:52.768609] [DEBUG] [LOCAL ] JGH: Primary data saved (12607 records). [2025-10-23T22:07:52.768752] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-23T22:07:52.768857] [INFO ] [MAIN ] Update Progress: 1152/2367 symbols completed. JGH took 27.2s. Estimated remaining: 2h 35m 54s. Rate: 7.8 symbols/min [2025-10-23T22:07:52.805884] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-23T22:07:52.943007] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:52.995517] [DEBUG] [LOCAL ] JHX: Loaded 53199 existing records from primary storage. [2025-10-23T22:07:52.995887] [INFO ] [MAIN ] JHX: Loaded 53199 existing records. [2025-10-23T22:07:53.171630] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:53.171908] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-23T22:07:53.171985] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-23T22:07:53.172219] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-23T22:07:53.172293] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-23T22:07:53.438421] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-23T22:07:53.539816] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:53.599403] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-23T22:07:54.399402] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-23T22:07:54.632367] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T22:07:54.802239] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-23T22:07:55.199443] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-23T22:07:55.999427] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-23T22:07:56.128821] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T22:07:56.130820] [INFO ] [REMOTE ] JHI: Full fetch complete (5815 records). [2025-10-23T22:07:56.130929] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-23T22:07:56.482378] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-23T22:07:56.482504] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-23T22:07:56.482725] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-23T22:07:56.482805] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-23T22:07:56.483237] [DEBUG] [LOCAL ] JHI: Trimmed 5815 records to 4173 (keeping 200 days of data) [2025-10-23T22:07:56.507839] [DEBUG] [LOCAL ] JHI: Primary data saved (4173 records). [2025-10-23T22:07:56.507961] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-23T22:07:56.508064] [INFO ] [MAIN ] Update Progress: 1153/2367 symbols completed. JHI took 20.7s. Estimated remaining: 2h 35m 42s. Rate: 7.8 symbols/min [2025-10-23T22:07:56.671900] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:07:56.688479] [DEBUG] [LOCAL ] JILL: Loaded 15268 existing records from primary storage. [2025-10-23T22:07:56.688766] [INFO ] [MAIN ] JILL: Loaded 15268 existing records. [2025-10-23T22:07:56.804706] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-23T22:07:56.863613] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:07:56.863844] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-23T22:07:56.863919] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-23T22:07:56.864135] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-23T22:07:56.864211] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-23T22:07:57.216166] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:07:57.403726] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T22:07:57.599492] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-23T22:07:57.899773] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T22:07:58.408358] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-23T22:07:58.410790] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T22:07:59.199484] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-23T22:07:59.999437] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-23T22:08:00.261934] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T22:08:00.527270] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T22:08:00.799466] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-23T22:08:01.205007] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T22:08:01.599465] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-23T22:08:02.399456] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-23T22:08:02.693316] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T22:08:03.205231] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-23T22:08:03.236577] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-23T22:08:03.751375] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-23T22:08:03.752542] [INFO ] [REMOTE ] JHS: Full fetch complete (4571 records). [2025-10-23T22:08:03.752639] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-23T22:08:04.005074] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T22:08:04.003665] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-23T22:08:04.163989] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-23T22:08:04.164138] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-23T22:08:04.164429] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-23T22:08:04.164506] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-23T22:08:04.165038] [DEBUG] [LOCAL ] JHS: Trimmed 4571 records to 3034 (keeping 200 days of data) [2025-10-23T22:08:04.184840] [DEBUG] [LOCAL ] JHS: Primary data saved (3034 records). [2025-10-23T22:08:04.185041] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-23T22:08:04.185176] [INFO ] [MAIN ] Update Progress: 1154/2367 symbols completed. JHS took 23.5s. Estimated remaining: 2h 35m 34s. Rate: 7.8 symbols/min [2025-10-23T22:08:04.366290] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:04.407220] [DEBUG] [LOCAL ] JKS: Loaded 39215 existing records from primary storage. [2025-10-23T22:08:04.407705] [INFO ] [MAIN ] JKS: Loaded 39215 existing records. [2025-10-23T22:08:04.591356] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:08:04.591779] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-23T22:08:04.591873] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-23T22:08:04.592284] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-23T22:08:04.592390] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-23T22:08:04.807599] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-23T22:08:04.936541] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T22:08:05.012086] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:05.599450] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-23T22:08:06.399431] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-23T22:08:06.451910] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T22:08:06.793465] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T22:08:07.199446] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-23T22:08:07.965154] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T22:08:07.999411] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-23T22:08:08.016802] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T22:08:08.799444] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-23T22:08:09.599423] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-23T22:08:09.827696] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-23T22:08:10.120794] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-23T22:08:10.224958] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T22:08:10.399491] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-23T22:08:11.199472] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-23T22:08:11.996221] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T22:08:12.004090] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-23T22:08:12.298968] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T22:08:12.799441] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-23T22:08:13.599420] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-23T22:08:13.673460] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T22:08:14.399428] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-23T22:08:15.199409] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-23T22:08:15.449609] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-23T22:08:15.757053] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-23T22:08:15.917075] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (3.12 seconds). [2025-10-23T22:08:16.004516] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-23T22:08:16.017675] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T22:08:16.799401] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-23T22:08:16.972456] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T22:08:17.599429] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-23T22:08:18.369788] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T22:08:18.380706] [INFO ] [REMOTE ] JHG: Full fetch complete (68657 records). [2025-10-23T22:08:18.380912] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-23T22:08:18.404733] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-23T22:08:18.779878] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-23T22:08:18.779994] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-23T22:08:18.781442] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-23T22:08:18.781522] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-23T22:08:18.782964] [DEBUG] [LOCAL ] JHG: Trimmed 68657 records to 47835 (keeping 200 days of data) [2025-10-23T22:08:19.060494] [DEBUG] [LOCAL ] JHG: Primary data saved (47835 records). [2025-10-23T22:08:19.060676] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-23T22:08:19.060784] [INFO ] [MAIN ] Update Progress: 1155/2367 symbols completed. JHG took 51.6s. Estimated remaining: 2h 35m 34s. Rate: 7.8 symbols/min [2025-10-23T22:08:19.204529] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-23T22:08:19.238247] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:19.269673] [DEBUG] [LOCAL ] JLL: Loaded 31450 existing records from primary storage. [2025-10-23T22:08:19.270009] [INFO ] [MAIN ] JLL: Loaded 31450 existing records. [2025-10-23T22:08:19.456603] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:08:19.456906] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-23T22:08:19.456992] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-23T22:08:19.457371] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-23T22:08:19.457447] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-23T22:08:19.769344] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T22:08:19.865092] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:19.999432] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-23T22:08:20.311196] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T22:08:20.465080] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T22:08:20.799445] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-23T22:08:21.282599] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T22:08:21.599429] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-23T22:08:22.399440] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-23T22:08:22.929851] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-23T22:08:22.994849] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T22:08:23.199441] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-23T22:08:23.558941] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T22:08:23.721272] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-23T22:08:23.725229] [INFO ] [REMOTE ] JILL: Full fetch complete (22335 records). [2025-10-23T22:08:23.725421] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-23T22:08:24.007352] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-23T22:08:24.130225] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-23T22:08:24.130330] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-23T22:08:24.130841] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-23T22:08:24.130919] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-23T22:08:24.131521] [DEBUG] [LOCAL ] JILL: Trimmed 22335 records to 15317 (keeping 200 days of data) [2025-10-23T22:08:24.220102] [DEBUG] [LOCAL ] JILL: Primary data saved (15317 records). [2025-10-23T22:08:24.220263] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-23T22:08:24.220354] [INFO ] [MAIN ] Update Progress: 1156/2367 symbols completed. JILL took 27.7s. Estimated remaining: 2h 35m 23s. Rate: 7.8 symbols/min [2025-10-23T22:08:24.392437] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:24.399274] [DEBUG] [LOCAL ] JLS: Loaded 4013 existing records from primary storage. [2025-10-23T22:08:24.399501] [INFO ] [MAIN ] JLS: Loaded 4013 existing records. [2025-10-23T22:08:24.575106] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:08:24.575358] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-23T22:08:24.575416] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-23T22:08:24.575546] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-23T22:08:24.575614] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-23T22:08:24.812586] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-23T22:08:24.932699] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:25.599447] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-23T22:08:25.942749] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T22:08:25.951869] [INFO ] [REMOTE ] JHX: Full fetch complete (62868 records). [2025-10-23T22:08:25.951994] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-23T22:08:26.340055] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-23T22:08:26.340975] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-23T22:08:26.340875] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T22:08:26.341983] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-23T22:08:26.343914] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-23T22:08:26.364609] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T22:08:26.372387] [DEBUG] [LOCAL ] JHX: Trimmed 62868 records to 53589 (keeping 200 days of data) [2025-10-23T22:08:26.421301] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-23T22:08:26.683084] [DEBUG] [LOCAL ] JHX: Primary data saved (53589 records). [2025-10-23T22:08:26.683276] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-23T22:08:26.684809] [INFO ] [MAIN ] Update Progress: 1157/2367 symbols completed. JHX took 33.9s. Estimated remaining: 2h 35m 10s. Rate: 7.8 symbols/min [2025-10-23T22:08:27.199495] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-23T22:08:27.999428] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-23T22:08:28.062354] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T22:08:28.240427] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T22:08:28.442471] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T22:08:28.799444] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-23T22:08:29.400711] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-23T22:08:29.599456] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-23T22:08:30.399463] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-23T22:08:31.006124] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T22:08:31.199422] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-23T22:08:31.723171] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T22:08:31.999432] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-23T22:08:32.690073] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T22:08:32.799599] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-23T22:08:33.583333] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T22:08:33.599393] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-23T22:08:33.657218] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T22:08:34.201038] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T22:08:34.399435] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-23T22:08:35.199441] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-23T22:08:35.732928] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T22:08:35.999433] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-23T22:08:36.665525] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T22:08:36.672385] [INFO ] [REMOTE ] JKS: Full fetch complete (58671 records). [2025-10-23T22:08:36.672506] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-23T22:08:36.809587] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-23T22:08:37.050496] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-23T22:08:37.050771] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-23T22:08:37.051773] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-23T22:08:37.051851] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-23T22:08:37.053265] [DEBUG] [LOCAL ] JKS: Trimmed 58671 records to 39480 (keeping 200 days of data) [2025-10-23T22:08:37.278679] [DEBUG] [LOCAL ] JKS: Primary data saved (39480 records). [2025-10-23T22:08:37.278829] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-23T22:08:37.278939] [INFO ] [MAIN ] Update Progress: 1158/2367 symbols completed. JKS took 33.1s. Estimated remaining: 2h 35m 6s. Rate: 7.8 symbols/min [2025-10-23T22:08:37.423126] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T22:08:37.599413] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-23T22:08:37.955055] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-23T22:08:38.221807] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T22:08:38.399479] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-23T22:08:39.199448] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-23T22:08:39.858399] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-23T22:08:39.883231] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T22:08:39.999471] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-23T22:08:40.799453] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-23T22:08:41.277459] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-23T22:08:41.296779] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T22:08:41.599439] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-23T22:08:42.399444] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-23T22:08:42.545733] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T22:08:42.550723] [INFO ] [REMOTE ] JLL: Full fetch complete (45228 records). [2025-10-23T22:08:42.550838] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-23T22:08:42.835675] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T22:08:42.839926] [INFO ] [REMOTE ] JLS: Full fetch complete (5817 records). [2025-10-23T22:08:42.845704] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-23T22:08:43.034625] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-23T22:08:43.040547] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-23T22:08:43.046781] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-23T22:08:43.057173] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-23T22:08:43.114231] [DEBUG] [LOCAL ] JLL: Trimmed 45228 records to 31765 (keeping 200 days of data) [2025-10-23T22:08:43.417221] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-23T22:08:43.426964] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-23T22:08:43.427323] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-23T22:08:43.455465] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-23T22:08:43.482179] [DEBUG] [LOCAL ] JLS: Trimmed 5817 records to 4024 (keeping 200 days of data) [2025-10-23T22:08:43.523698] [DEBUG] [LOCAL ] JLL: Primary data saved (31765 records). [2025-10-23T22:08:43.527711] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-23T22:08:43.529617] [DEBUG] [LOCAL ] JLS: Primary data saved (4024 records). [2025-10-23T22:08:43.529778] [INFO ] [MAIN ] Update Progress: 1159/2367 symbols completed. JLL took 24.5s. Estimated remaining: 2h 34m 56s. Rate: 7.8 symbols/min [2025-10-23T22:08:43.529931] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-23T22:08:43.530273] [INFO ] [MAIN ] Update Progress: 1160/2367 symbols completed. JLS took 19.3s. Estimated remaining: 2h 34m 41s. Rate: 7.8 symbols/min [2025-10-23T22:08:44.093754] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:44.175695] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:44.244247] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:44.240826] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:08:44.244755] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-23T22:08:44.245107] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-23T22:08:44.245208] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-23T22:08:44.245251] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-23T22:08:44.245462] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-23T22:08:44.245521] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-23T22:08:44.607379] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-23T22:08:44.608765] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-23T22:08:44.643883] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-23T22:08:44.644076] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-23T22:08:44.684581] [DEBUG] [LOCAL ] JMIA: Loaded 51205 existing records from primary storage. [2025-10-23T22:08:44.737521] [INFO ] [MAIN ] JMIA: Loaded 51205 existing records. [2025-10-23T22:08:44.923582] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:45.018370] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-23T22:08:45.164396] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:08:45.209188] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-23T22:08:45.188295] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:08:45.209380] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-23T22:08:45.262423] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-23T22:08:45.262463] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-23T22:08:45.268105] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-23T22:08:45.265061] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-23T22:08:45.268015] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:08:45.268359] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-23T22:08:45.279463] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-23T22:08:45.279525] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-23T22:08:45.310399] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-23T22:08:45.342274] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-23T22:08:45.386264] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-23T22:08:45.616061] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-23T22:08:45.679458] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-23T22:08:46.314945] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:46.333584] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:46.353183] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-23T22:08:46.358980] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-23T22:08:46.358742] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-23T22:08:46.385697] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:08:46.399383] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-23T22:08:46.750015] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-23T22:08:47.199431] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-23T22:08:47.718218] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-23T22:08:47.999442] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-23T22:08:48.677721] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-23T22:08:48.802584] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-23T22:08:48.808606] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-23T22:08:49.599426] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-23T22:08:49.715380] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T22:08:50.399448] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-23T22:08:50.977466] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-23T22:08:51.199438] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-23T22:08:51.999471] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-23T22:08:52.051860] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-23T22:08:52.134415] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T22:08:52.537924] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T22:08:52.799441] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-23T22:08:53.112307] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T22:08:53.285101] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T22:08:53.599447] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-23T22:08:54.399436] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-23T22:08:55.199523] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-23T22:08:55.911855] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-23T22:08:55.999428] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-23T22:08:56.138999] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T22:08:56.473322] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T22:08:56.799454] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-23T22:08:57.599428] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-23T22:08:57.788073] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-23T22:08:58.399460] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-23T22:08:58.450578] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T22:08:58.687908] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-23T22:08:59.199428] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-23T22:08:59.514449] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-23T22:08:59.642459] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T22:08:59.999451] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-23T22:09:00.376357] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-23T22:09:00.377187] [INFO ] [REMOTE ] JMM: Full fetch complete (2305 records). [2025-10-23T22:09:00.377286] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-23T22:09:00.577586] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-23T22:09:00.577829] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:09:00.577902] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:09:00.578007] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-23T22:09:00.578118] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-23T22:09:00.578201] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-23T22:09:00.578281] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-23T22:09:00.578371] [INFO ] [MAIN ] Update Progress: 1161/2367 symbols completed. JMM took 17.0s. Estimated remaining: 2h 34m 43s. Rate: 7.8 symbols/min [2025-10-23T22:09:00.759888] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:00.782599] [DEBUG] [LOCAL ] JOE: Loaded 23683 existing records from primary storage. [2025-10-23T22:09:00.782960] [INFO ] [MAIN ] JOE: Loaded 23683 existing records. [2025-10-23T22:09:00.805356] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-23T22:09:00.973832] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:00.974093] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-23T22:09:00.974177] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-23T22:09:00.974552] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-23T22:09:00.974633] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-23T22:09:01.339232] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:01.599453] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-23T22:09:02.399550] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-23T22:09:02.886637] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T22:09:03.199425] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-23T22:09:03.380827] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-23T22:09:03.999456] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-23T22:09:04.254151] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T22:09:04.414300] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T22:09:04.799484] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-23T22:09:05.599470] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-23T22:09:06.399409] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-23T22:09:06.584437] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T22:09:06.868149] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T22:09:07.199431] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-23T22:09:07.996621] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (4.00 seconds). [2025-10-23T22:09:08.007216] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-23T22:09:08.370637] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T22:09:08.799428] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-23T22:09:09.599428] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-23T22:09:09.940598] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (3.54 seconds). [2025-10-23T22:09:09.980194] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-23T22:09:10.399436] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-23T22:09:11.199411] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-23T22:09:11.670879] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-23T22:09:11.999450] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-23T22:09:13.613100] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-23T22:09:13.624804] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-23T22:09:14.008384] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (5.21 seconds). [2025-10-23T22:09:14.019750] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-23T22:09:15.884747] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-23T22:09:15.896779] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-23T22:09:16.133521] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (5.73 seconds). [2025-10-23T22:09:16.144504] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-23T22:09:16.871439] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (4.87 seconds). [2025-10-23T22:09:16.877892] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-23T22:09:17.049034] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-23T22:09:17.061004] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-23T22:09:17.867999] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T22:09:17.879234] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-23T22:09:18.139376] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T22:09:18.188827] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-23T22:09:18.399486] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-23T22:09:19.208485] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-23T22:09:19.211210] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:09:19.221388] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-23T22:09:19.221565] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-23T22:09:19.638504] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-23T22:09:19.638625] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-23T22:09:19.639850] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-23T22:09:19.639941] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-23T22:09:19.641452] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54143 (keeping 200 days of data) [2025-10-23T22:09:19.890877] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-23T22:09:19.905626] [INFO ] [REMOTE ] JMIA: Full fetch complete (73488 records). [2025-10-23T22:09:19.908008] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-23T22:09:20.035405] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-10-23T22:09:20.114844] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-23T22:09:20.445627] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-23T22:09:20.450799] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-23T22:09:20.454571] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-23T22:09:20.461018] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-23T22:09:20.472612] [DEBUG] [LOCAL ] JMIA: Trimmed 73488 records to 51570 (keeping 200 days of data) [2025-10-23T22:09:20.475535] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-23T22:09:20.475803] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-23T22:09:20.476233] [INFO ] [MAIN ] Update Progress: 1162/2367 symbols completed. JNJ took 36.9s. Estimated remaining: 2h 34m 48s. Rate: 7.8 symbols/min [2025-10-23T22:09:20.939365] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:20.945567] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T22:09:20.963089] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-23T22:09:21.029345] [DEBUG] [LOCAL ] JOF: Loaded 6920 existing records from primary storage. [2025-10-23T22:09:21.031993] [INFO ] [MAIN ] JOF: Loaded 6920 existing records. [2025-10-23T22:09:21.074010] [DEBUG] [LOCAL ] JMIA: Primary data saved (51570 records). [2025-10-23T22:09:21.122225] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-23T22:09:21.145328] [INFO ] [MAIN ] Update Progress: 1163/2367 symbols completed. JMIA took 37.6s. Estimated remaining: 2h 34m 33s. Rate: 7.8 symbols/min [2025-10-23T22:09:21.349819] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:21.378146] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-23T22:09:21.407802] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-23T22:09:21.411624] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:21.412286] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-23T22:09:21.412390] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-23T22:09:21.724316] [DEBUG] [LOCAL ] JPC: Loaded 36948 existing records from primary storage. [2025-10-23T22:09:21.735518] [INFO ] [MAIN ] JPC: Loaded 36948 existing records. [2025-10-23T22:09:21.895090] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:21.913670] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-23T22:09:21.994078] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:21.994324] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-23T22:09:21.994403] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-23T22:09:21.994625] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-23T22:09:21.994728] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-23T22:09:22.260821] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-23T22:09:22.379812] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:22.399402] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-23T22:09:22.601330] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-23T22:09:22.928302] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-23T22:09:23.199436] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-23T22:09:23.668375] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T22:09:23.672887] [INFO ] [REMOTE ] JOE: Full fetch complete (35546 records). [2025-10-23T22:09:23.673001] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-23T22:09:24.004697] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-23T22:09:24.089956] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-23T22:09:24.090073] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-23T22:09:24.090807] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-23T22:09:24.090901] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-23T22:09:24.091871] [DEBUG] [LOCAL ] JOE: Trimmed 35546 records to 23818 (keeping 200 days of data) [2025-10-23T22:09:24.232522] [DEBUG] [LOCAL ] JOE: Primary data saved (23818 records). [2025-10-23T22:09:24.232718] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-23T22:09:24.232815] [INFO ] [MAIN ] Update Progress: 1164/2367 symbols completed. JOE took 23.7s. Estimated remaining: 2h 34m 20s. Rate: 7.8 symbols/min [2025-10-23T22:09:24.422440] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:24.486847] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-23T22:09:24.487272] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-23T22:09:24.729877] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:24.730156] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-23T22:09:24.730258] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-23T22:09:24.730496] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-23T22:09:24.730579] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-23T22:09:24.801746] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-23T22:09:25.231760] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:25.599494] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-23T22:09:25.785180] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-23T22:09:25.977544] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T22:09:26.399429] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-23T22:09:26.769066] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-23T22:09:26.778565] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-23T22:09:26.778759] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-23T22:09:27.171749] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-23T22:09:27.171865] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-23T22:09:27.173042] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-23T22:09:27.173131] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-23T22:09:27.174766] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54199 (keeping 200 days of data) [2025-10-23T22:09:27.230113] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-23T22:09:27.521459] [DEBUG] [LOCAL ] JOBY: Primary data saved (54199 records). [2025-10-23T22:09:27.521692] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-23T22:09:27.521810] [INFO ] [MAIN ] Update Progress: 1165/2367 symbols completed. JOBY took 44.0s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-23T22:09:27.720188] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:27.753776] [DEBUG] [LOCAL ] JQC: Loaded 33868 existing records from primary storage. [2025-10-23T22:09:27.754183] [INFO ] [MAIN ] JQC: Loaded 33868 existing records. [2025-10-23T22:09:27.949421] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T22:09:27.999569] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-23T22:09:27.998955] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:28.001060] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-23T22:09:28.001179] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-23T22:09:28.001592] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-23T22:09:28.001725] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-23T22:09:28.086136] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T22:09:28.254904] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-23T22:09:28.474157] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:28.799449] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-23T22:09:29.480235] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T22:09:29.599456] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-23T22:09:30.121801] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T22:09:30.399438] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-23T22:09:31.131221] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T22:09:31.199430] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-23T22:09:31.981850] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T22:09:31.999395] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-23T22:09:32.604063] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-23T22:09:32.799429] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-23T22:09:33.331593] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T22:09:33.599477] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-23T22:09:34.316408] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T22:09:34.399461] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-23T22:09:35.209985] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-23T22:09:35.229825] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-23T22:09:35.861325] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T22:09:35.891064] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T22:09:35.999423] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-23T22:09:36.799456] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-23T22:09:37.423889] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T22:09:37.582283] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T22:09:37.599442] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-23T22:09:38.399426] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-23T22:09:39.196064] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T22:09:39.199389] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-23T22:09:39.930970] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T22:09:39.999407] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-23T22:09:40.100570] [DEBUG] [REMOTE ] JPC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-23T22:09:40.100870] [WARN ] [REMOTE ] JPC: No data returned for month 2025-06 [2025-10-23T22:09:40.100955] [FATAL] [REMOTE ] JPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:09:40.101056] [FATAL] [MAIN ] JPC: Failed to fetch primary data. [2025-10-23T22:09:40.101136] [WARN ] [MAIN ] JPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:09:40.101225] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-23T22:09:40.101317] [DEBUG] [LOCAL ] JPC: No primary data file found to delete. [2025-10-23T22:09:40.101416] [INFO ] [LOCAL ] JPC: Starting deletion of derivative data. [2025-10-23T22:09:40.101622] [DEBUG] [LOCAL ] JPC: Deleted derivative data file. [2025-10-23T22:09:40.101767] [INFO ] [MAIN ] Update Progress: 1166/2367 symbols completed. JPC took 19.0s. Estimated remaining: 2h 34m 5s. Rate: 7.8 symbols/min [2025-10-23T22:09:40.270531] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:40.286624] [DEBUG] [LOCAL ] JRI: Loaded 15306 existing records from primary storage. [2025-10-23T22:09:40.286906] [INFO ] [MAIN ] JRI: Loaded 15306 existing records. [2025-10-23T22:09:40.464459] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:40.464675] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-23T22:09:40.464780] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-23T22:09:40.464980] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-23T22:09:40.465056] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-23T22:09:40.812784] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-23T22:09:40.817446] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:41.599396] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-23T22:09:42.250032] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T22:09:42.262930] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T22:09:42.264598] [INFO ] [REMOTE ] JOF: Full fetch complete (9535 records). [2025-10-23T22:09:42.264709] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-23T22:09:42.404510] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-23T22:09:42.639130] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-23T22:09:42.639250] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-23T22:09:42.639549] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-23T22:09:42.639627] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-23T22:09:42.640215] [DEBUG] [LOCAL ] JOF: Trimmed 9535 records to 6978 (keeping 200 days of data) [2025-10-23T22:09:42.681097] [DEBUG] [LOCAL ] JOF: Primary data saved (6978 records). [2025-10-23T22:09:42.681231] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-23T22:09:42.681339] [INFO ] [MAIN ] Update Progress: 1167/2367 symbols completed. JOF took 22.2s. Estimated remaining: 2h 33m 52s. Rate: 7.8 symbols/min [2025-10-23T22:09:42.854931] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:09:42.867600] [DEBUG] [LOCAL ] JRS: Loaded 11529 existing records from primary storage. [2025-10-23T22:09:42.867890] [INFO ] [MAIN ] JRS: Loaded 11529 existing records. [2025-10-23T22:09:43.048899] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:09:43.049150] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-23T22:09:43.049225] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-23T22:09:43.049415] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-23T22:09:43.049488] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-23T22:09:43.205742] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-23T22:09:43.372914] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T22:09:43.441026] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:09:43.999455] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-23T22:09:44.728278] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:09:44.742372] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T22:09:44.799401] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-23T22:09:45.146697] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (7.55 seconds). [2025-10-23T22:09:45.599438] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-23T22:09:45.636672] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T22:09:46.399464] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-23T22:09:46.602949] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T22:09:47.199479] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-23T22:09:47.251839] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T22:09:47.999466] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-23T22:09:48.178419] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T22:09:48.792402] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T22:09:48.799382] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-23T22:09:49.562242] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-23T22:09:49.599403] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-23T22:09:50.313299] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T22:09:50.399436] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-23T22:09:51.113801] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T22:09:51.199416] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-23T22:09:51.999467] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-23T22:09:52.010462] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T22:09:52.799442] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-23T22:09:52.822670] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T22:09:53.599431] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-23T22:09:54.399426] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-23T22:09:54.511110] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-23T22:09:55.199435] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-23T22:09:55.300513] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-23T22:09:55.999414] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-23T22:09:56.080095] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T22:09:56.292914] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T22:09:56.799437] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-23T22:09:57.599452] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-23T22:09:57.655301] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T22:09:58.141279] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-23T22:09:58.399432] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-23T22:09:58.557739] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T22:09:59.199448] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-23T22:09:59.787202] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T22:09:59.999452] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-23T22:10:00.194590] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T22:10:00.799461] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-23T22:10:01.142431] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-23T22:10:01.599474] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-23T22:10:01.675899] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T22:10:01.679490] [INFO ] [REMOTE ] JRI: Full fetch complete (22892 records). [2025-10-23T22:10:01.679730] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-23T22:10:02.053114] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-23T22:10:02.053230] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-23T22:10:02.053784] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-23T22:10:02.053865] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-23T22:10:02.054502] [DEBUG] [LOCAL ] JRI: Trimmed 22892 records to 15370 (keeping 200 days of data) [2025-10-23T22:10:02.148135] [DEBUG] [LOCAL ] JRI: Primary data saved (15370 records). [2025-10-23T22:10:02.148326] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-23T22:10:02.148464] [INFO ] [MAIN ] Update Progress: 1168/2367 symbols completed. JRI took 22.0s. Estimated remaining: 2h 33m 57s. Rate: 7.8 symbols/min [2025-10-23T22:10:02.318473] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:02.361964] [DEBUG] [LOCAL ] JXN: Loaded 44322 existing records from primary storage. [2025-10-23T22:10:02.362290] [INFO ] [MAIN ] JXN: Loaded 44322 existing records. [2025-10-23T22:10:02.404834] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-23T22:10:02.542980] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:02.543139] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-23T22:10:02.543214] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-23T22:10:02.543429] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-23T22:10:02.543497] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-23T22:10:02.890243] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:03.206030] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-23T22:10:03.206936] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T22:10:03.999410] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-23T22:10:04.282832] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-23T22:10:04.699302] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T22:10:04.706409] [INFO ] [REMOTE ] JQC: Full fetch complete (50123 records). [2025-10-23T22:10:04.706533] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-23T22:10:04.806612] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-23T22:10:05.085585] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-23T22:10:05.085721] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-23T22:10:05.086533] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-23T22:10:05.086608] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-23T22:10:05.087705] [DEBUG] [LOCAL ] JQC: Trimmed 50123 records to 34130 (keeping 200 days of data) [2025-10-23T22:10:05.283255] [DEBUG] [LOCAL ] JQC: Primary data saved (34130 records). [2025-10-23T22:10:05.283419] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-23T22:10:05.283534] [INFO ] [MAIN ] Update Progress: 1169/2367 symbols completed. JQC took 37.8s. Estimated remaining: 2h 33m 44s. Rate: 7.8 symbols/min [2025-10-23T22:10:05.457515] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:05.501481] [DEBUG] [LOCAL ] K: Loaded 50378 existing records from primary storage. [2025-10-23T22:10:05.501837] [INFO ] [MAIN ] K: Loaded 50378 existing records. [2025-10-23T22:10:05.609070] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-23T22:10:05.698689] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:05.699386] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-23T22:10:05.699625] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-23T22:10:05.709056] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-23T22:10:05.709678] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-23T22:10:05.709470] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T22:10:05.846887] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T22:10:06.101755] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:06.399466] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-23T22:10:07.199445] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-23T22:10:07.993709] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T22:10:08.002511] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-23T22:10:08.072026] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-23T22:10:08.564477] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T22:10:08.753148] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:10:08.755809] [INFO ] [REMOTE ] JRS: Full fetch complete (16205 records). [2025-10-23T22:10:08.755897] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-23T22:10:08.804726] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-23T22:10:09.117532] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-23T22:10:09.117638] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-23T22:10:09.118124] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-23T22:10:09.118204] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-23T22:10:09.118800] [DEBUG] [LOCAL ] JRS: Trimmed 16205 records to 11582 (keeping 200 days of data) [2025-10-23T22:10:09.183864] [DEBUG] [LOCAL ] JRS: Primary data saved (11582 records). [2025-10-23T22:10:09.184011] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-23T22:10:09.184120] [INFO ] [MAIN ] Update Progress: 1170/2367 symbols completed. JRS took 26.5s. Estimated remaining: 2h 33m 33s. Rate: 7.8 symbols/min [2025-10-23T22:10:09.351271] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:09.365886] [DEBUG] [LOCAL ] KAI: Loaded 13405 existing records from primary storage. [2025-10-23T22:10:09.366140] [INFO ] [MAIN ] KAI: Loaded 13405 existing records. [2025-10-23T22:10:09.542110] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:09.542309] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-23T22:10:09.542382] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-23T22:10:09.542569] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-23T22:10:09.542639] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-23T22:10:09.608868] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-23T22:10:09.902835] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:10.293990] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T22:10:10.399412] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-23T22:10:10.816507] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T22:10:11.199468] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-23T22:10:11.250158] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T22:10:11.972992] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T22:10:11.982297] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-23T22:10:11.982474] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-23T22:10:12.004593] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-23T22:10:12.369632] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-23T22:10:12.369760] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-23T22:10:12.370809] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-23T22:10:12.370889] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-23T22:10:12.372341] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54184 (keeping 200 days of data) [2025-10-23T22:10:12.707183] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-23T22:10:12.707394] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-23T22:10:12.707514] [INFO ] [MAIN ] Update Progress: 1171/2367 symbols completed. JPM took 48.5s. Estimated remaining: 2h 33m 21s. Rate: 7.8 symbols/min [2025-10-23T22:10:12.804580] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-23T22:10:12.874578] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:12.908241] [DEBUG] [LOCAL ] KAR: Loaded 39707 existing records from primary storage. [2025-10-23T22:10:12.908553] [INFO ] [MAIN ] KAR: Loaded 39707 existing records. [2025-10-23T22:10:13.084348] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:13.084550] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-23T22:10:13.084625] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-23T22:10:13.084913] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-23T22:10:13.084993] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-23T22:10:13.448224] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:13.551849] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T22:10:13.599399] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-23T22:10:13.825167] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T22:10:14.399447] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-23T22:10:15.199422] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-23T22:10:15.268316] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T22:10:15.865962] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T22:10:15.883551] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T22:10:15.999410] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-23T22:10:16.799502] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-23T22:10:17.571975] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T22:10:17.600330] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-23T22:10:17.605160] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T22:10:18.399535] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-23T22:10:19.199428] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-23T22:10:19.367346] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T22:10:19.999446] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-23T22:10:20.230606] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:10:20.503199] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T22:10:20.799430] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-23T22:10:21.599525] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-23T22:10:22.399417] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-23T22:10:22.502560] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-23T22:10:23.199408] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-23T22:10:23.226526] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-23T22:10:23.295020] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T22:10:23.999413] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-23T22:10:24.799510] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-23T22:10:24.850408] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T22:10:25.392854] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:10:25.599440] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-23T22:10:26.287116] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (3.89 seconds). [2025-10-23T22:10:26.399433] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-23T22:10:26.824186] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-23T22:10:27.199448] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-23T22:10:27.662145] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T22:10:27.832415] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T22:10:27.999417] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-23T22:10:28.207609] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-23T22:10:28.799432] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-23T22:10:29.599415] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-23T22:10:29.666730] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T22:10:29.682766] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-23T22:10:30.399435] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-23T22:10:30.996468] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T22:10:31.199397] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-23T22:10:31.296320] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T22:10:31.999464] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-23T22:10:32.758117] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T22:10:32.799396] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-23T22:10:32.838016] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T22:10:32.840853] [INFO ] [REMOTE ] KAI: Full fetch complete (19313 records). [2025-10-23T22:10:32.840945] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-23T22:10:33.210119] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-23T22:10:33.210246] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-23T22:10:33.210737] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-23T22:10:33.210816] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-23T22:10:33.211389] [DEBUG] [LOCAL ] KAI: Trimmed 19313 records to 13504 (keeping 200 days of data) [2025-10-23T22:10:33.294205] [DEBUG] [LOCAL ] KAI: Primary data saved (13504 records). [2025-10-23T22:10:33.294361] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-23T22:10:33.294475] [INFO ] [MAIN ] Update Progress: 1172/2367 symbols completed. KAI took 24.1s. Estimated remaining: 2h 33m 26s. Rate: 7.8 symbols/min [2025-10-23T22:10:33.465771] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:33.487929] [DEBUG] [LOCAL ] KB: Loaded 23045 existing records from primary storage. [2025-10-23T22:10:33.488242] [INFO ] [MAIN ] KB: Loaded 23045 existing records. [2025-10-23T22:10:33.604592] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-23T22:10:33.670060] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:33.670265] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-23T22:10:33.670344] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-23T22:10:33.670609] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-23T22:10:33.670725] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-23T22:10:34.031160] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:34.328876] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T22:10:34.399435] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-23T22:10:35.199434] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-23T22:10:35.479351] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T22:10:36.010464] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-23T22:10:36.016194] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T22:10:36.299945] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T22:10:36.799444] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-23T22:10:37.599411] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-23T22:10:37.710072] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T22:10:38.285624] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T22:10:38.399454] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-23T22:10:39.140909] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T22:10:39.148018] [INFO ] [REMOTE ] JXN: Full fetch complete (65414 records). [2025-10-23T22:10:39.148205] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-23T22:10:39.212051] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-23T22:10:39.534532] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-23T22:10:39.534662] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-23T22:10:39.535596] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-23T22:10:39.535703] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-23T22:10:39.536950] [DEBUG] [LOCAL ] JXN: Trimmed 65414 records to 44543 (keeping 200 days of data) [2025-10-23T22:10:39.802350] [DEBUG] [LOCAL ] JXN: Primary data saved (44543 records). [2025-10-23T22:10:39.802605] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-23T22:10:39.803888] [INFO ] [MAIN ] Update Progress: 1173/2367 symbols completed. JXN took 37.7s. Estimated remaining: 2h 33m 17s. Rate: 7.8 symbols/min [2025-10-23T22:10:39.948057] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T22:10:39.997103] [INFO ] [REMOTE ] KAR: Full fetch complete (57015 records). [2025-10-23T22:10:39.997014] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:39.997324] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-23T22:10:40.009628] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-23T22:10:40.240582] [DEBUG] [LOCAL ] KBDC: Loaded 22661 existing records from primary storage. [2025-10-23T22:10:40.309920] [INFO ] [MAIN ] KBDC: Loaded 22661 existing records. [2025-10-23T22:10:40.504496] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-23T22:10:40.515154] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-23T22:10:40.543800] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-23T22:10:40.554144] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-23T22:10:40.583061] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:40.583882] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-23T22:10:40.584059] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-23T22:10:40.597406] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-23T22:10:40.597112] [DEBUG] [LOCAL ] KAR: Trimmed 57015 records to 40036 (keeping 200 days of data) [2025-10-23T22:10:40.597967] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-23T22:10:40.598409] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T22:10:40.803954] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-23T22:10:41.104202] [DEBUG] [LOCAL ] KAR: Primary data saved (40036 records). [2025-10-23T22:10:41.151759] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-23T22:10:41.219315] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:41.236621] [INFO ] [MAIN ] Update Progress: 1174/2367 symbols completed. KAR took 28.5s. Estimated remaining: 2h 33m 3s. Rate: 7.8 symbols/min [2025-10-23T22:10:41.303258] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T22:10:41.421025] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:41.466004] [DEBUG] [LOCAL ] KBH: Loaded 48710 existing records from primary storage. [2025-10-23T22:10:41.466378] [INFO ] [MAIN ] KBH: Loaded 48710 existing records. [2025-10-23T22:10:41.604616] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-23T22:10:41.641668] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:41.641956] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-23T22:10:41.642033] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-23T22:10:41.642278] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-23T22:10:41.642352] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-23T22:10:41.997908] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:42.403571] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-23T22:10:42.408594] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T22:10:42.417564] [INFO ] [REMOTE ] K: Full fetch complete (72296 records). [2025-10-23T22:10:42.417754] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-23T22:10:42.543209] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T22:10:42.832405] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-23T22:10:42.832515] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-23T22:10:42.833682] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-23T22:10:42.833761] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-23T22:10:42.835126] [DEBUG] [LOCAL ] K: Trimmed 72296 records to 50741 (keeping 200 days of data) [2025-10-23T22:10:43.136918] [DEBUG] [LOCAL ] K: Primary data saved (50741 records). [2025-10-23T22:10:43.137083] [INFO ] [MAIN ] K: Full history saved. [2025-10-23T22:10:43.137193] [INFO ] [MAIN ] Update Progress: 1175/2367 symbols completed. K took 37.9s. Estimated remaining: 2h 32m 50s. Rate: 7.8 symbols/min [2025-10-23T22:10:43.204712] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-23T22:10:43.311304] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:10:43.352299] [DEBUG] [LOCAL ] KBR: Loaded 47970 existing records from primary storage. [2025-10-23T22:10:43.352619] [INFO ] [MAIN ] KBR: Loaded 47970 existing records. [2025-10-23T22:10:43.532717] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:10:43.532957] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-23T22:10:43.533032] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-23T22:10:43.533292] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-23T22:10:43.533370] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-23T22:10:43.881923] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:10:43.999415] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-23T22:10:44.219408] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T22:10:44.238236] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T22:10:44.799417] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-23T22:10:45.243070] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T22:10:45.599443] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-23T22:10:46.399426] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-23T22:10:46.759676] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-23T22:10:47.199419] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-23T22:10:47.288962] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T22:10:47.306903] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T22:10:47.999434] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-23T22:10:48.799414] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-23T22:10:49.048492] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T22:10:49.599421] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-23T22:10:49.657763] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T22:10:49.967305] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T22:10:50.399461] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-23T22:10:51.199431] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-23T22:10:51.605409] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T22:10:51.999455] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-23T22:10:52.120190] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T22:10:52.170867] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T22:10:52.799443] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-23T22:10:53.599421] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-23T22:10:53.683875] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T22:10:54.181622] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T22:10:54.399434] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-23T22:10:54.770779] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T22:10:55.199427] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-23T22:10:55.501083] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T22:10:55.999433] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-23T22:10:56.799444] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-23T22:10:57.005762] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T22:10:57.283096] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T22:10:57.599433] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-23T22:10:58.236963] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T22:10:58.399419] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-23T22:10:59.199440] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-23T22:10:59.316460] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T22:10:59.999413] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-23T22:11:00.138494] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T22:11:00.358253] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T22:11:00.799437] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-23T22:11:01.599415] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-23T22:11:01.797816] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T22:11:01.844019] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T22:11:02.399469] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-23T22:11:03.199425] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-23T22:11:03.283598] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T22:11:03.401934] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T22:11:03.999435] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-23T22:11:04.802189] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-23T22:11:04.805909] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T22:11:05.599467] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-23T22:11:05.628260] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T22:11:05.676111] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T22:11:06.399433] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-23T22:11:06.599486] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T22:11:06.603383] [INFO ] [REMOTE ] KB: Full fetch complete (33502 records). [2025-10-23T22:11:06.603573] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-23T22:11:06.980508] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-23T22:11:06.980637] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-23T22:11:06.981403] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-23T22:11:06.981484] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-23T22:11:06.982484] [DEBUG] [LOCAL ] KB: Trimmed 33502 records to 23127 (keeping 200 days of data) [2025-10-23T22:11:07.121355] [DEBUG] [LOCAL ] KB: Primary data saved (23127 records). [2025-10-23T22:11:07.121538] [INFO ] [MAIN ] KB: Full history saved. [2025-10-23T22:11:07.121682] [INFO ] [MAIN ] Update Progress: 1176/2367 symbols completed. KB took 33.8s. Estimated remaining: 2h 32m 59s. Rate: 7.8 symbols/min [2025-10-23T22:11:07.206448] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-23T22:11:07.303449] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:07.354083] [DEBUG] [LOCAL ] KD: Loaded 52332 existing records from primary storage. [2025-10-23T22:11:07.354485] [INFO ] [MAIN ] KD: Loaded 52332 existing records. [2025-10-23T22:11:07.536431] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:07.536770] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-23T22:11:07.536847] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-23T22:11:07.537088] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-23T22:11:07.537163] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-23T22:11:07.907995] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:07.949827] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T22:11:07.999421] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-23T22:11:08.303109] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T22:11:08.799457] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-23T22:11:09.599438] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-23T22:11:09.653311] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T22:11:10.399500] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-23T22:11:10.534490] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T22:11:10.545023] [INFO ] [REMOTE ] KBH: Full fetch complete (71057 records). [2025-10-23T22:11:10.545344] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-23T22:11:10.954105] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-23T22:11:10.954546] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-23T22:11:10.955574] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-23T22:11:10.955684] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-23T22:11:10.957103] [DEBUG] [LOCAL ] KBH: Trimmed 71057 records to 49027 (keeping 200 days of data) [2025-10-23T22:11:11.199450] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-23T22:11:11.259104] [DEBUG] [LOCAL ] KBH: Primary data saved (49027 records). [2025-10-23T22:11:11.259258] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-23T22:11:11.259374] [INFO ] [MAIN ] Update Progress: 1177/2367 symbols completed. KBH took 30.0s. Estimated remaining: 2h 32m 47s. Rate: 7.8 symbols/min [2025-10-23T22:11:11.446065] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:11.480695] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T22:11:11.480914] [DEBUG] [LOCAL ] KEN: Loaded 4612 existing records from primary storage. [2025-10-23T22:11:11.490984] [INFO ] [MAIN ] KEN: Loaded 4612 existing records. [2025-10-23T22:11:11.664819] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:11.665049] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-23T22:11:11.665120] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-23T22:11:11.665484] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-23T22:11:11.665556] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-23T22:11:12.005747] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-23T22:11:12.021673] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:12.156102] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T22:11:12.165258] [INFO ] [REMOTE ] KBR: Full fetch complete (70001 records). [2025-10-23T22:11:12.165455] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-23T22:11:12.594832] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-23T22:11:12.606591] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T22:11:12.606788] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-23T22:11:12.615399] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-23T22:11:12.616122] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-23T22:11:12.618688] [DEBUG] [LOCAL ] KBR: Trimmed 70001 records to 48343 (keeping 200 days of data) [2025-10-23T22:11:12.821443] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-23T22:11:12.961129] [DEBUG] [LOCAL ] KBR: Primary data saved (48343 records). [2025-10-23T22:11:12.961378] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-23T22:11:12.961520] [INFO ] [MAIN ] Update Progress: 1178/2367 symbols completed. KBR took 29.8s. Estimated remaining: 2h 32m 33s. Rate: 7.8 symbols/min [2025-10-23T22:11:13.143124] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:13.181279] [DEBUG] [LOCAL ] KEP: Loaded 32572 existing records from primary storage. [2025-10-23T22:11:13.181758] [INFO ] [MAIN ] KEP: Loaded 32572 existing records. [2025-10-23T22:11:13.386464] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:13.387055] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-23T22:11:13.387141] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-23T22:11:13.387485] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-23T22:11:13.387564] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-23T22:11:13.486395] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T22:11:13.600557] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-23T22:11:13.790038] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:13.818987] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T22:11:14.157659] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-23T22:11:14.399456] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-23T22:11:15.199451] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-23T22:11:15.695893] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-23T22:11:15.734167] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-23T22:11:15.743563] [INFO ] [REMOTE ] KBDC: Full fetch complete (30969 records). [2025-10-23T22:11:15.743768] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-23T22:11:16.004949] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-23T22:11:16.128363] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-23T22:11:16.128475] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-23T22:11:16.129142] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-23T22:11:16.129219] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-23T22:11:16.130048] [DEBUG] [LOCAL ] KBDC: Trimmed 30969 records to 22805 (keeping 200 days of data) [2025-10-23T22:11:16.266601] [DEBUG] [LOCAL ] KBDC: Primary data saved (22805 records). [2025-10-23T22:11:16.266768] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-23T22:11:16.266878] [INFO ] [MAIN ] Update Progress: 1179/2367 symbols completed. KBDC took 36.5s. Estimated remaining: 2h 32m 21s. Rate: 7.8 symbols/min [2025-10-23T22:11:16.434895] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:16.472988] [DEBUG] [LOCAL ] KEX: Loaded 38734 existing records from primary storage. [2025-10-23T22:11:16.473321] [INFO ] [MAIN ] KEX: Loaded 38734 existing records. [2025-10-23T22:11:16.652872] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:16.653106] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-23T22:11:16.653184] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-23T22:11:16.653557] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-23T22:11:16.653630] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-23T22:11:16.804897] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-23T22:11:17.018138] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:17.192079] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T22:11:17.599454] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-23T22:11:18.399410] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-23T22:11:18.582040] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T22:11:18.715383] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-23T22:11:19.199427] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-23T22:11:19.225825] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T22:11:19.999423] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-23T22:11:20.663119] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-23T22:11:20.758233] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T22:11:20.799409] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-23T22:11:21.599435] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-23T22:11:22.240827] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T22:11:22.399422] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-23T22:11:22.730332] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:11:23.199431] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-23T22:11:23.661758] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T22:11:23.999414] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-23T22:11:24.197776] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T22:11:24.643438] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-23T22:11:24.799457] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-23T22:11:25.599495] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-23T22:11:25.941729] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T22:11:26.399519] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-23T22:11:27.199418] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-23T22:11:27.356114] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T22:11:27.409189] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T22:11:27.999466] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-23T22:11:28.578848] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T22:11:28.747385] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T22:11:28.799439] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-23T22:11:29.223317] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-23T22:11:29.599446] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-23T22:11:30.399464] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-23T22:11:31.105371] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T22:11:31.199420] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-23T22:11:31.680093] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T22:11:31.681183] [INFO ] [REMOTE ] KEN: Full fetch complete (5855 records). [2025-10-23T22:11:31.681280] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-23T22:11:32.007800] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-23T22:11:32.049974] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-23T22:11:32.050206] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-23T22:11:32.050541] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-23T22:11:32.050630] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-23T22:11:32.051139] [DEBUG] [LOCAL ] KEN: Trimmed 5855 records to 4616 (keeping 200 days of data) [2025-10-23T22:11:32.077590] [DEBUG] [LOCAL ] KEN: Primary data saved (4616 records). [2025-10-23T22:11:32.077718] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-23T22:11:32.077837] [INFO ] [MAIN ] Update Progress: 1180/2367 symbols completed. KEN took 20.8s. Estimated remaining: 2h 32m 22s. Rate: 7.8 symbols/min [2025-10-23T22:11:32.251303] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:32.251563] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-23T22:11:32.251678] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-23T22:11:32.251819] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-23T22:11:32.251915] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-23T22:11:32.252081] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-23T22:11:32.252163] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-23T22:11:32.457742] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-23T22:11:32.659150] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:32.799418] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-23T22:11:33.594332] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T22:11:33.602598] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-23T22:11:34.399409] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-23T22:11:34.563749] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T22:11:34.601021] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T22:11:35.199447] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-23T22:11:35.999424] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-23T22:11:36.322855] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T22:11:36.762133] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T22:11:36.799434] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-23T22:11:37.496292] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T22:11:37.599409] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-23T22:11:38.353751] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T22:11:38.399481] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-23T22:11:39.199432] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-23T22:11:39.527097] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T22:11:39.999485] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-23T22:11:40.168720] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:11:40.465844] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T22:11:40.799464] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-23T22:11:41.600218] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-23T22:11:41.606165] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T22:11:42.376820] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T22:11:42.399400] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-23T22:11:43.059794] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T22:11:43.199442] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-23T22:11:43.999414] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-23T22:11:44.195481] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T22:11:44.799419] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-23T22:11:45.013866] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T22:11:45.023852] [INFO ] [REMOTE ] KD: Full fetch complete (76091 records). [2025-10-23T22:11:45.024147] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-23T22:11:45.426341] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-23T22:11:45.426590] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-23T22:11:45.427961] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-23T22:11:45.428063] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-23T22:11:45.429700] [DEBUG] [LOCAL ] KD: Trimmed 76091 records to 52704 (keeping 200 days of data) [2025-10-23T22:11:45.568411] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T22:11:45.613962] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-23T22:11:45.772164] [DEBUG] [LOCAL ] KD: Primary data saved (52704 records). [2025-10-23T22:11:45.772364] [INFO ] [MAIN ] KD: Full history saved. [2025-10-23T22:11:45.772490] [INFO ] [MAIN ] Update Progress: 1181/2367 symbols completed. KD took 38.7s. Estimated remaining: 2h 32m 20s. Rate: 7.8 symbols/min [2025-10-23T22:11:45.946948] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:45.991567] [DEBUG] [LOCAL ] KEYS: Loaded 43120 existing records from primary storage. [2025-10-23T22:11:45.991949] [INFO ] [MAIN ] KEYS: Loaded 43120 existing records. [2025-10-23T22:11:46.167915] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:46.168139] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-23T22:11:46.168215] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-23T22:11:46.168477] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-23T22:11:46.168552] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-23T22:11:46.405552] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-23T22:11:46.523237] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:46.558182] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T22:11:47.048485] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T22:11:47.199468] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-23T22:11:48.009955] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-23T22:11:48.015259] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T22:11:48.799429] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-23T22:11:48.885066] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T22:11:49.396831] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T22:11:49.402951] [INFO ] [REMOTE ] KEP: Full fetch complete (42438 records). [2025-10-23T22:11:49.403124] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-23T22:11:49.605219] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-23T22:11:49.783547] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-23T22:11:49.783687] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-23T22:11:49.784460] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-23T22:11:49.784538] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-23T22:11:49.785627] [DEBUG] [LOCAL ] KEP: Trimmed 42438 records to 32795 (keeping 200 days of data) [2025-10-23T22:11:49.973424] [DEBUG] [LOCAL ] KEP: Primary data saved (32795 records). [2025-10-23T22:11:49.973594] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-23T22:11:49.973723] [INFO ] [MAIN ] Update Progress: 1182/2367 symbols completed. KEP took 37.0s. Estimated remaining: 2h 32m 9s. Rate: 7.8 symbols/min [2025-10-23T22:11:50.165295] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:50.170020] [DEBUG] [LOCAL ] KF: Loaded 2360 existing records from primary storage. [2025-10-23T22:11:50.170201] [INFO ] [MAIN ] KF: Loaded 2360 existing records. [2025-10-23T22:11:50.346803] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:50.347012] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-23T22:11:50.347086] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-23T22:11:50.347246] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-23T22:11:50.347320] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-23T22:11:50.409167] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-23T22:11:50.717245] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:50.752384] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T22:11:51.199436] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-23T22:11:51.231536] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-23T22:11:51.238906] [INFO ] [REMOTE ] KEX: Full fetch complete (56106 records). [2025-10-23T22:11:51.239025] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-23T22:11:51.640751] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-23T22:11:51.640859] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-23T22:11:51.641835] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-23T22:11:51.641914] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-23T22:11:51.643072] [DEBUG] [LOCAL ] KEX: Trimmed 56106 records to 39000 (keeping 200 days of data) [2025-10-23T22:11:51.869141] [DEBUG] [LOCAL ] KEX: Primary data saved (39000 records). [2025-10-23T22:11:51.869421] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-23T22:11:51.869540] [INFO ] [MAIN ] Update Progress: 1183/2367 symbols completed. KEX took 35.6s. Estimated remaining: 2h 31m 55s. Rate: 7.8 symbols/min [2025-10-23T22:11:52.007708] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-23T22:11:52.038522] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:52.064587] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T22:11:52.087225] [DEBUG] [LOCAL ] KFRC: Loaded 20843 existing records from primary storage. [2025-10-23T22:11:52.087481] [INFO ] [MAIN ] KFRC: Loaded 20843 existing records. [2025-10-23T22:11:52.267889] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:52.268149] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-23T22:11:52.268227] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-23T22:11:52.268441] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-23T22:11:52.268515] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-23T22:11:52.552189] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-23T22:11:52.643086] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:52.799443] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-23T22:11:53.453849] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-23T22:11:53.545343] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T22:11:53.599446] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-23T22:11:54.399468] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-23T22:11:55.046765] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-23T22:11:55.199403] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-23T22:11:55.360664] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T22:11:55.589185] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-23T22:11:55.598381] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-23T22:11:55.598536] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-23T22:11:55.794156] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T22:11:55.795124] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:11:55.795204] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:11:55.795316] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-23T22:11:55.795458] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-23T22:11:55.795563] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-23T22:11:55.795705] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-23T22:11:55.795851] [INFO ] [MAIN ] Update Progress: 1184/2367 symbols completed. KEY took 23.7s. Estimated remaining: 2h 31m 44s. Rate: 7.8 symbols/min [2025-10-23T22:11:55.967469] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:11:55.978275] [DEBUG] [LOCAL ] KFS: Loaded 8701 existing records from primary storage. [2025-10-23T22:11:55.978585] [INFO ] [MAIN ] KFS: Loaded 8701 existing records. [2025-10-23T22:11:56.008750] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-23T22:11:56.163586] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:11:56.163820] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-23T22:11:56.163899] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-23T22:11:56.164087] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-23T22:11:56.164160] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-23T22:11:56.446197] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T22:11:56.522880] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:11:56.799459] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-23T22:11:57.481198] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-23T22:11:57.599417] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-23T22:11:58.252555] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T22:11:58.399433] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-23T22:11:59.024891] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T22:11:59.199435] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-23T22:11:59.607182] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-23T22:11:59.999478] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-23T22:12:00.597432] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T22:12:00.799453] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-23T22:12:01.599453] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-23T22:12:01.808917] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T22:12:02.399494] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-23T22:12:02.424859] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T22:12:02.990878] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T22:12:03.199418] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-23T22:12:03.981953] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T22:12:03.999392] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-23T22:12:04.771951] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T22:12:04.799403] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-23T22:12:05.599418] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-23T22:12:05.842880] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T22:12:06.107786] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-23T22:12:06.399443] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-23T22:12:06.987997] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T22:12:07.199443] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-23T22:12:07.999412] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-23T22:12:08.312195] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T22:12:08.799446] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-23T22:12:09.599409] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-23T22:12:09.680056] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T22:12:09.717329] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T22:12:10.399458] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-23T22:12:10.627743] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T22:12:11.199478] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-23T22:12:11.241521] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T22:12:11.999466] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-23T22:12:12.799418] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-23T22:12:12.877052] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T22:12:13.050373] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:12:13.322728] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-23T22:12:13.599440] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-23T22:12:14.351157] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:12:14.353222] [INFO ] [REMOTE ] KFS: Full fetch complete (11253 records). [2025-10-23T22:12:14.353310] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-23T22:12:14.406507] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-23T22:12:14.722249] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-23T22:12:14.722366] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-23T22:12:14.722688] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-23T22:12:14.722766] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-23T22:12:14.723315] [DEBUG] [LOCAL ] KFS: Trimmed 11253 records to 8762 (keeping 200 days of data) [2025-10-23T22:12:14.776823] [DEBUG] [LOCAL ] KFS: Primary data saved (8762 records). [2025-10-23T22:12:14.777011] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-23T22:12:14.777126] [INFO ] [MAIN ] Update Progress: 1185/2367 symbols completed. KFS took 19.0s. Estimated remaining: 2h 31m 47s. Rate: 7.8 symbols/min [2025-10-23T22:12:14.949418] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:12:14.977961] [DEBUG] [LOCAL ] KFY: Loaded 29511 existing records from primary storage. [2025-10-23T22:12:14.978279] [INFO ] [MAIN ] KFY: Loaded 29511 existing records. [2025-10-23T22:12:15.184235] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:12:15.184456] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-23T22:12:15.184535] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-23T22:12:15.184941] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-23T22:12:15.185018] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-23T22:12:15.205744] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-23T22:12:15.541464] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:12:15.553488] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T22:12:15.999490] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-23T22:12:16.799494] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-23T22:12:17.086775] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T22:12:17.173267] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T22:12:17.336359] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T22:12:17.599451] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-23T22:12:18.399515] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-23T22:12:19.194304] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T22:12:19.203005] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-23T22:12:19.547543] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T22:12:19.673819] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T22:12:19.999444] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-23T22:12:20.469491] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T22:12:20.470453] [INFO ] [REMOTE ] KF: Full fetch complete (3456 records). [2025-10-23T22:12:20.470537] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-23T22:12:20.803600] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-23T22:12:20.827145] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-23T22:12:20.827231] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-23T22:12:20.827381] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-23T22:12:20.827454] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-23T22:12:20.827883] [DEBUG] [LOCAL ] KF: Trimmed 3456 records to 2362 (keeping 200 days of data) [2025-10-23T22:12:20.841877] [DEBUG] [LOCAL ] KF: Primary data saved (2362 records). [2025-10-23T22:12:20.841971] [INFO ] [MAIN ] KF: Full history saved. [2025-10-23T22:12:20.842079] [INFO ] [MAIN ] Update Progress: 1186/2367 symbols completed. KF took 30.9s. Estimated remaining: 2h 31m 38s. Rate: 7.8 symbols/min [2025-10-23T22:12:21.009677] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:12:21.059440] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-23T22:12:21.059807] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-23T22:12:21.237147] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:12:21.237345] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-23T22:12:21.237419] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-23T22:12:21.237605] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-23T22:12:21.237701] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-23T22:12:21.599163] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:12:21.599447] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-23T22:12:22.172829] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T22:12:22.399426] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-23T22:12:23.182555] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:12:23.199406] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-23T22:12:23.971666] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T22:12:23.999407] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-23T22:12:24.580534] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T22:12:24.585253] [INFO ] [REMOTE ] KFRC: Full fetch complete (27114 records). [2025-10-23T22:12:24.585396] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-23T22:12:24.804560] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-23T22:12:24.957411] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-23T22:12:24.957526] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-23T22:12:24.958148] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-23T22:12:24.958227] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-23T22:12:24.959014] [DEBUG] [LOCAL ] KFRC: Trimmed 27114 records to 21004 (keeping 200 days of data) [2025-10-23T22:12:25.084765] [DEBUG] [LOCAL ] KFRC: Primary data saved (21004 records). [2025-10-23T22:12:25.084919] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-23T22:12:25.085008] [INFO ] [MAIN ] Update Progress: 1187/2367 symbols completed. KFRC took 33.2s. Estimated remaining: 2h 31m 27s. Rate: 7.8 symbols/min [2025-10-23T22:12:25.250854] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:12:25.292155] [DEBUG] [LOCAL ] KGS: Loaded 46063 existing records from primary storage. [2025-10-23T22:12:25.292487] [INFO ] [MAIN ] KGS: Loaded 46063 existing records. [2025-10-23T22:12:25.467286] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:12:25.467556] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-23T22:12:25.467632] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-23T22:12:25.467887] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-23T22:12:25.467974] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-23T22:12:25.606465] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-23T22:12:25.822972] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:12:26.399426] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-23T22:12:26.431406] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T22:12:26.907484] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T22:12:27.199423] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-23T22:12:27.889387] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (3.89 seconds). [2025-10-23T22:12:27.999460] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-23T22:12:28.032433] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T22:12:28.588467] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T22:12:28.799424] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-23T22:12:29.599436] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-23T22:12:29.862743] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T22:12:30.336358] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T22:12:30.399398] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-23T22:12:31.134244] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T22:12:31.141795] [INFO ] [REMOTE ] KEYS: Full fetch complete (63123 records). [2025-10-23T22:12:31.141929] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-23T22:12:31.204580] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-23T22:12:31.545267] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-23T22:12:31.545388] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-23T22:12:31.547026] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-23T22:12:31.547200] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-23T22:12:31.563084] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T22:12:31.568597] [DEBUG] [LOCAL ] KEYS: Trimmed 63123 records to 43425 (keeping 200 days of data) [2025-10-23T22:12:31.826403] [DEBUG] [LOCAL ] KEYS: Primary data saved (43425 records). [2025-10-23T22:12:31.826561] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-23T22:12:31.826696] [INFO ] [MAIN ] Update Progress: 1188/2367 symbols completed. KEYS took 46.1s. Estimated remaining: 2h 31m 18s. Rate: 7.8 symbols/min [2025-10-23T22:12:31.994366] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:12:31.994541] [DEBUG] [LOCAL ] KIM: No existing data file found in primary storage. [2025-10-23T22:12:31.994611] [WARN ] [MAIN ] KIM: No existing data found, performing full refresh instead. [2025-10-23T22:12:31.994741] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-23T22:12:31.994811] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-23T22:12:31.994891] [DEBUG] [LOCAL ] KIM: No primary data file found to delete. [2025-10-23T22:12:31.994960] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-23T22:12:32.006170] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-23T22:12:32.348318] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:12:32.726473] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T22:12:32.799426] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-23T22:12:33.599430] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-23T22:12:34.286346] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T22:12:34.399411] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-23T22:12:34.495787] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T22:12:35.009274] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T22:12:35.199454] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-23T22:12:35.999487] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-23T22:12:36.611984] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-23T22:12:36.799485] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-23T22:12:36.853575] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T22:12:36.891893] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-23T22:12:37.599459] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-23T22:12:38.399426] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-23T22:12:38.571383] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T22:12:39.146928] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T22:12:39.199405] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-23T22:12:39.527750] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T22:12:39.999448] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-23T22:12:40.799478] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-23T22:12:40.834586] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T22:12:41.360097] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T22:12:41.599457] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-23T22:12:42.366866] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T22:12:42.399402] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-23T22:12:42.854123] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T22:12:42.859230] [INFO ] [REMOTE ] KFY: Full fetch complete (43274 records). [2025-10-23T22:12:42.859334] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-23T22:12:43.211470] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-23T22:12:43.227202] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-23T22:12:43.227290] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-23T22:12:43.228098] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-23T22:12:43.228188] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-23T22:12:43.229291] [DEBUG] [LOCAL ] KFY: Trimmed 43274 records to 29699 (keeping 200 days of data) [2025-10-23T22:12:43.403476] [DEBUG] [LOCAL ] KFY: Primary data saved (29699 records). [2025-10-23T22:12:43.403634] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-23T22:12:43.403763] [INFO ] [MAIN ] Update Progress: 1189/2367 symbols completed. KFY took 28.6s. Estimated remaining: 2h 31m 14s. Rate: 7.8 symbols/min [2025-10-23T22:12:43.568722] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:12:43.589602] [DEBUG] [LOCAL ] KIO: Loaded 21683 existing records from primary storage. [2025-10-23T22:12:43.589887] [INFO ] [MAIN ] KIO: Loaded 21683 existing records. [2025-10-23T22:12:43.767497] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:12:43.767809] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-23T22:12:43.768045] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-23T22:12:43.768355] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-23T22:12:43.768487] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-23T22:12:44.006810] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-23T22:12:44.063321] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T22:12:44.171560] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:12:44.799437] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-23T22:12:45.007610] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:12:45.560442] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T22:12:45.599421] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-23T22:12:45.919010] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T22:12:46.399451] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-23T22:12:46.434311] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T22:12:47.199511] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-23T22:12:47.999429] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-23T22:12:48.542370] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-23T22:12:48.799419] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-23T22:12:49.017488] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T22:12:49.530299] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T22:12:49.599407] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-23T22:12:50.399488] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-23T22:12:50.988726] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-23T22:12:51.081464] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T22:12:51.106499] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T22:12:51.199461] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-23T22:12:51.999467] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-23T22:12:52.744183] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T22:12:52.799460] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-23T22:12:53.599470] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-23T22:12:53.689741] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T22:12:54.250812] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T22:12:54.399465] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-23T22:12:55.199433] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-23T22:12:55.514546] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-23T22:12:55.782432] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-23T22:12:55.999432] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-23T22:12:56.375406] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T22:12:56.383508] [INFO ] [REMOTE ] KGS: Full fetch complete (66528 records). [2025-10-23T22:12:56.383682] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-23T22:12:56.774238] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-23T22:12:56.774346] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-23T22:12:56.775310] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-23T22:12:56.775387] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-23T22:12:56.776707] [DEBUG] [LOCAL ] KGS: Trimmed 66528 records to 46358 (keeping 200 days of data) [2025-10-23T22:12:56.828050] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-23T22:12:57.047919] [DEBUG] [LOCAL ] KGS: Primary data saved (46358 records). [2025-10-23T22:12:57.048097] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-23T22:12:57.049425] [INFO ] [MAIN ] Update Progress: 1190/2367 symbols completed. KGS took 32.0s. Estimated remaining: 2h 31m 13s. Rate: 7.8 symbols/min [2025-10-23T22:12:57.222118] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:12:57.276727] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-23T22:12:57.277068] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-10-23T22:12:57.487044] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:12:57.487423] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-23T22:12:57.487500] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-23T22:12:57.487765] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-23T22:12:57.487839] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-23T22:12:57.604530] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-23T22:12:57.857775] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:12:57.892443] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T22:12:57.918935] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T22:12:58.399464] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-23T22:12:59.199426] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-23T22:12:59.383880] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T22:12:59.959547] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T22:12:59.999418] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-23T22:13:00.799418] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-23T22:13:01.024366] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (3.42 seconds). [2025-10-23T22:13:01.033975] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-23T22:13:01.034137] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-23T22:13:01.438858] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-23T22:13:01.438983] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-23T22:13:01.440132] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-23T22:13:01.440216] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-23T22:13:01.441820] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 54089 (keeping 200 days of data) [2025-10-23T22:13:01.615283] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-23T22:13:01.789739] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T22:13:01.805460] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-10-23T22:13:01.805661] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-23T22:13:01.805816] [INFO ] [MAIN ] Update Progress: 1191/2367 symbols completed. KGC took 41.0s. Estimated remaining: 2h 31m 2s. Rate: 7.8 symbols/min [2025-10-23T22:13:01.983098] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:01.991446] [DEBUG] [LOCAL ] KKRS: Loaded 5547 existing records from primary storage. [2025-10-23T22:13:01.991733] [INFO ] [MAIN ] KKRS: Loaded 5547 existing records. [2025-10-23T22:13:02.173083] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:02.173297] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-23T22:13:02.173372] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-23T22:13:02.173548] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-23T22:13:02.173620] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-23T22:13:02.411390] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-23T22:13:02.530581] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:02.558222] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T22:13:02.568352] [INFO ] [REMOTE ] KIM: Full fetch complete (76971 records). [2025-10-23T22:13:02.568590] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-23T22:13:02.930586] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-23T22:13:03.077729] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-23T22:13:03.077879] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-23T22:13:03.079514] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-23T22:13:03.079603] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-23T22:13:03.081297] [DEBUG] [LOCAL ] KIM: Trimmed 76971 records to 53384 (keeping 200 days of data) [2025-10-23T22:13:03.199459] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-23T22:13:03.449304] [DEBUG] [LOCAL ] KIM: Primary data saved (53384 records). [2025-10-23T22:13:03.450526] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T22:13:03.450702] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-23T22:13:03.455947] [INFO ] [MAIN ] Update Progress: 1192/2367 symbols completed. KIM took 31.6s. Estimated remaining: 2h 30m 48s. Rate: 7.8 symbols/min [2025-10-23T22:13:03.631005] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:03.631193] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-23T22:13:03.631263] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-23T22:13:03.631371] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-23T22:13:03.631441] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-23T22:13:03.631520] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-23T22:13:03.631586] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-23T22:13:03.919415] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-23T22:13:04.015292] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-23T22:13:04.032341] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:04.799447] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-23T22:13:05.026560] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:13:05.027098] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-23T22:13:05.027195] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:13:05.027296] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-23T22:13:05.027368] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:13:05.027444] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-23T22:13:05.027572] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-23T22:13:05.027672] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-23T22:13:05.027752] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-23T22:13:05.027837] [INFO ] [MAIN ] Update Progress: 1193/2367 symbols completed. KKRT took 1.6s. Estimated remaining: 2h 30m 35s. Rate: 7.8 symbols/min [2025-10-23T22:13:05.213620] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:05.213863] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-23T22:13:05.213984] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-23T22:13:05.214105] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-23T22:13:05.214179] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-23T22:13:05.214274] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-23T22:13:05.214325] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-23T22:13:05.455717] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T22:13:05.594860] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:05.599400] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-23T22:13:05.838246] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:13:05.838706] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-23T22:13:05.838795] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:13:05.838869] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-23T22:13:05.838937] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:13:05.839011] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-23T22:13:05.839104] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-23T22:13:05.839174] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-23T22:13:05.839256] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-23T22:13:05.839339] [INFO ] [MAIN ] Update Progress: 1194/2367 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 30m 20s. Rate: 7.8 symbols/min [2025-10-23T22:13:06.006545] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:06.040060] [DEBUG] [LOCAL ] KLC: Loaded 36128 existing records from primary storage. [2025-10-23T22:13:06.040404] [INFO ] [MAIN ] KLC: Loaded 36128 existing records. [2025-10-23T22:13:06.217746] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:06.218011] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-23T22:13:06.218088] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-23T22:13:06.218370] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-23T22:13:06.218443] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-23T22:13:06.404575] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-23T22:13:06.574860] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:07.199454] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-23T22:13:07.889042] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T22:13:07.999447] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-23T22:13:08.395751] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T22:13:08.799447] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-23T22:13:09.152942] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T22:13:09.158032] [INFO ] [REMOTE ] KIO: Full fetch complete (32309 records). [2025-10-23T22:13:09.158192] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-23T22:13:09.522058] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-23T22:13:09.522208] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-23T22:13:09.522929] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-23T22:13:09.523024] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-23T22:13:09.523810] [DEBUG] [LOCAL ] KIO: Trimmed 32309 records to 21847 (keeping 200 days of data) [2025-10-23T22:13:09.609209] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-23T22:13:09.657007] [DEBUG] [LOCAL ] KIO: Primary data saved (21847 records). [2025-10-23T22:13:09.657172] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-23T22:13:09.657292] [INFO ] [MAIN ] Update Progress: 1195/2367 symbols completed. KIO took 26.3s. Estimated remaining: 2h 30m 9s. Rate: 7.8 symbols/min [2025-10-23T22:13:09.829166] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:09.877195] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-23T22:13:09.877533] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-23T22:13:10.061296] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:10.061629] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-23T22:13:10.061798] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-23T22:13:10.062053] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-23T22:13:10.062128] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-23T22:13:10.190047] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T22:13:10.404709] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-23T22:13:10.488479] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:11.199515] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-23T22:13:11.591713] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T22:13:11.693728] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-23T22:13:11.999457] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-23T22:13:12.568456] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T22:13:12.799450] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-23T22:13:13.396788] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-23T22:13:13.599418] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-23T22:13:14.308853] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T22:13:14.367554] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T22:13:14.399393] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-23T22:13:15.137983] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T22:13:15.199420] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-23T22:13:15.999420] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-23T22:13:16.605852] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T22:13:16.799431] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-23T22:13:17.292972] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T22:13:17.599452] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-23T22:13:18.399424] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-23T22:13:18.802828] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-23T22:13:19.179958] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T22:13:19.199394] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-23T22:13:20.008552] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-23T22:13:20.011436] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T22:13:20.799484] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-23T22:13:21.106510] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T22:13:21.372057] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-23T22:13:21.599528] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-23T22:13:21.832425] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T22:13:22.399436] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-23T22:13:23.018372] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T22:13:23.199431] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-23T22:13:23.999425] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-23T22:13:24.231555] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T22:13:24.799451] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-23T22:13:25.397237] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T22:13:25.599411] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-23T22:13:26.399418] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-23T22:13:26.496608] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-10-23T22:13:26.841736] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T22:13:27.016047] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T22:13:27.199410] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-23T22:13:27.414788] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T22:13:27.999435] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-23T22:13:28.656455] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T22:13:28.799458] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-23T22:13:28.993424] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T22:13:29.599446] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-23T22:13:30.399432] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-23T22:13:30.703428] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T22:13:30.863120] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-23T22:13:30.864208] [INFO ] [REMOTE ] KKRS: Full fetch complete (7539 records). [2025-10-23T22:13:30.864296] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-23T22:13:31.204545] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-23T22:13:31.239879] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-23T22:13:31.239995] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-23T22:13:31.240265] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-23T22:13:31.240359] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-23T22:13:31.240882] [DEBUG] [LOCAL ] KKRS: Trimmed 7539 records to 5564 (keeping 200 days of data) [2025-10-23T22:13:31.275613] [DEBUG] [LOCAL ] KKRS: Primary data saved (5564 records). [2025-10-23T22:13:31.275784] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-23T22:13:31.275926] [INFO ] [MAIN ] Update Progress: 1196/2367 symbols completed. KKRS took 29.5s. Estimated remaining: 2h 30m 15s. Rate: 7.8 symbols/min [2025-10-23T22:13:31.451217] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:31.455990] [DEBUG] [LOCAL ] KMPB: Loaded 3484 existing records from primary storage. [2025-10-23T22:13:31.456209] [INFO ] [MAIN ] KMPB: Loaded 3484 existing records. [2025-10-23T22:13:31.639745] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:31.639970] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-23T22:13:31.640064] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-23T22:13:31.640341] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-23T22:13:31.640431] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-23T22:13:32.000245] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-23T22:13:32.003666] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:32.682112] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-10-23T22:13:32.727928] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T22:13:32.799409] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-23T22:13:33.599440] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-23T22:13:33.879074] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T22:13:34.065573] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-23T22:13:34.399406] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-23T22:13:34.826293] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T22:13:35.121290] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:13:35.130571] [INFO ] [REMOTE ] KKR: Full fetch complete (77661 records). [2025-10-23T22:13:35.130745] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-23T22:13:35.204593] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-23T22:13:35.562291] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-23T22:13:35.562454] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-23T22:13:35.563936] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-23T22:13:35.564064] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-23T22:13:35.566257] [DEBUG] [LOCAL ] KKR: Trimmed 77661 records to 53890 (keeping 200 days of data) [2025-10-23T22:13:35.931901] [DEBUG] [LOCAL ] KKR: Primary data saved (53890 records). [2025-10-23T22:13:35.932138] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-23T22:13:35.934201] [INFO ] [MAIN ] Update Progress: 1197/2367 symbols completed. KKR took 38.9s. Estimated remaining: 2h 30m 4s. Rate: 7.8 symbols/min [2025-10-23T22:13:35.999429] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-23T22:13:36.701792] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T22:13:36.724086] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T22:13:36.799484] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-23T22:13:37.599447] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-23T22:13:38.235801] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T22:13:38.399455] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-23T22:13:38.786767] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T22:13:39.199440] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-23T22:13:39.453548] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T22:13:39.460337] [INFO ] [REMOTE ] KLC: Full fetch complete (50639 records). [2025-10-23T22:13:39.460540] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-23T22:13:39.729102] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-23T22:13:39.851893] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-23T22:13:39.852019] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-23T22:13:39.852972] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-23T22:13:39.853053] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-23T22:13:39.854222] [DEBUG] [LOCAL ] KLC: Trimmed 50639 records to 36361 (keeping 200 days of data) [2025-10-23T22:13:40.005082] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-23T22:13:40.064813] [DEBUG] [LOCAL ] KLC: Primary data saved (36361 records). [2025-10-23T22:13:40.064992] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-23T22:13:40.065111] [INFO ] [MAIN ] Update Progress: 1198/2367 symbols completed. KLC took 34.2s. Estimated remaining: 2h 29m 53s. Rate: 7.8 symbols/min [2025-10-23T22:13:40.749921] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T22:13:40.759226] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-23T22:13:40.759381] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-23T22:13:40.824152] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-23T22:13:41.147535] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-23T22:13:41.147670] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-23T22:13:41.148784] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-23T22:13:41.148884] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-23T22:13:41.150341] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54083 (keeping 200 days of data) [2025-10-23T22:13:41.365525] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T22:13:41.484092] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-23T22:13:41.484291] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-23T22:13:41.484487] [INFO ] [MAIN ] Update Progress: 1199/2367 symbols completed. KMI took 31.8s. Estimated remaining: 2h 29m 39s. Rate: 7.8 symbols/min [2025-10-23T22:13:41.599440] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-23T22:13:42.231601] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-23T22:13:42.399551] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-23T22:13:42.878774] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T22:13:43.199453] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-23T22:13:43.795950] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T22:13:43.999516] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-23T22:13:44.573797] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T22:13:44.799452] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-23T22:13:45.288686] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T22:13:45.289724] [INFO ] [REMOTE ] KMPB: Full fetch complete (4938 records). [2025-10-23T22:13:45.289811] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-23T22:13:45.661695] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-23T22:13:45.661820] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-23T22:13:45.662035] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-23T22:13:45.662109] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-23T22:13:45.662530] [DEBUG] [LOCAL ] KMPB: Trimmed 4938 records to 3495 (keeping 200 days of data) [2025-10-23T22:13:45.683412] [DEBUG] [LOCAL ] KMPB: Primary data saved (3495 records). [2025-10-23T22:13:45.683534] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-23T22:13:45.683668] [INFO ] [MAIN ] Update Progress: 1200/2367 symbols completed. KMPB took 14.4s. Estimated remaining: 2h 29m 28s. Rate: 7.8 symbols/min [2025-10-23T22:13:46.409948] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:46.458901] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:46.463775] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:46.460018] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:13:46.539565] [DEBUG] [LOCAL ] KN: Loaded 38389 existing records from primary storage. [2025-10-23T22:13:46.540220] [INFO ] [MAIN ] KN: Loaded 38389 existing records. [2025-10-23T22:13:46.674692] [DEBUG] [LOCAL ] KMPR: Loaded 40496 existing records from primary storage. [2025-10-23T22:13:46.675212] [INFO ] [MAIN ] KMPR: Loaded 40496 existing records. [2025-10-23T22:13:46.681192] [DEBUG] [LOCAL ] KMX: Loaded 53286 existing records from primary storage. [2025-10-23T22:13:46.731785] [DEBUG] [LOCAL ] KMT: Loaded 42861 existing records from primary storage. [2025-10-23T22:13:46.732145] [INFO ] [MAIN ] KMX: Loaded 53286 existing records. [2025-10-23T22:13:46.795098] [INFO ] [MAIN ] KMT: Loaded 42861 existing records. [2025-10-23T22:13:47.087437] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:47.201449] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-23T22:13:47.264676] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-23T22:13:47.296159] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:47.305274] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-23T22:13:47.299614] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:47.310769] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-23T22:13:47.335215] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-23T22:13:47.338999] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-23T22:13:47.361271] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-23T22:13:47.368061] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:13:47.364835] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-23T22:13:47.368678] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-23T22:13:47.364716] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-23T22:13:47.368821] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-23T22:13:47.368187] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-23T22:13:47.389422] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-23T22:13:47.416592] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-23T22:13:47.438238] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-23T22:13:47.483115] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-23T22:13:48.780811] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:48.877727] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:48.870327] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-23T22:13:48.887911] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:48.899022] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-23T22:13:48.900479] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-23T22:13:49.001133] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:13:49.001548] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-23T22:13:50.168610] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T22:13:50.174770] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-23T22:13:50.324781] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T22:13:50.332819] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-23T22:13:50.676684] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T22:13:50.687432] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-23T22:13:51.027377] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-23T22:13:51.199539] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-23T22:13:51.471855] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T22:13:51.515965] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T22:13:51.999437] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-23T22:13:52.335127] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T22:13:52.666425] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T22:13:52.799457] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-23T22:13:53.589845] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T22:13:53.599405] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-23T22:13:54.399416] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-23T22:13:54.560753] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T22:13:55.178444] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T22:13:55.199406] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-23T22:13:55.715811] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T22:13:55.999451] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-23T22:13:56.799425] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-23T22:13:56.859511] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T22:13:57.432639] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T22:13:57.599463] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-23T22:13:58.399447] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-23T22:13:58.798680] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T22:13:58.960288] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T22:13:59.199446] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-23T22:13:59.796523] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T22:13:59.999435] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-23T22:14:00.680203] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T22:14:00.799433] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-23T22:14:01.481385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T22:14:01.599460] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-23T22:14:02.399504] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-23T22:14:02.598204] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:14:03.199519] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-23T22:14:03.884459] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-23T22:14:03.999523] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-23T22:14:04.799529] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-23T22:14:04.879105] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T22:14:04.948195] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-23T22:14:05.599425] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-23T22:14:05.975077] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T22:14:06.399431] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-23T22:14:06.429626] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T22:14:07.185359] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T22:14:07.199403] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-23T22:14:07.999422] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-23T22:14:08.025365] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T22:14:08.799478] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-23T22:14:08.903085] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T22:14:09.599489] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-23T22:14:09.712536] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T22:14:10.312766] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T22:14:10.399429] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-23T22:14:11.110144] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T22:14:11.117176] [INFO ] [REMOTE ] KMT: Full fetch complete (61911 records). [2025-10-23T22:14:11.117335] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-23T22:14:11.205843] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-23T22:14:11.496067] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-23T22:14:11.496177] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-23T22:14:11.497092] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-23T22:14:11.497183] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-23T22:14:11.498468] [DEBUG] [LOCAL ] KMT: Trimmed 61911 records to 43150 (keeping 200 days of data) [2025-10-23T22:14:11.751063] [DEBUG] [LOCAL ] KMT: Primary data saved (43150 records). [2025-10-23T22:14:11.751220] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-23T22:14:11.751330] [INFO ] [MAIN ] Update Progress: 1201/2367 symbols completed. KMT took 26.1s. Estimated remaining: 2h 29m 38s. Rate: 7.8 symbols/min [2025-10-23T22:14:11.925935] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:11.960177] [DEBUG] [LOCAL ] KNF: Loaded 36630 existing records from primary storage. [2025-10-23T22:14:11.960496] [INFO ] [MAIN ] KNF: Loaded 36630 existing records. [2025-10-23T22:14:12.002780] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-23T22:14:12.161967] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:14:12.132858] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T22:14:12.169754] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-23T22:14:12.180169] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-23T22:14:12.195039] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-23T22:14:12.198215] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-23T22:14:12.230570] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T22:14:12.197920] [INFO ] [REMOTE ] KMPR: Full fetch complete (53643 records). [2025-10-23T22:14:12.279113] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-23T22:14:12.803107] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-23T22:14:12.898948] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:13.039375] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-23T22:14:13.039510] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-23T22:14:13.040597] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-23T22:14:13.040714] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-23T22:14:13.042091] [DEBUG] [LOCAL ] KMPR: Trimmed 53643 records to 40795 (keeping 200 days of data) [2025-10-23T22:14:13.288524] [DEBUG] [LOCAL ] KMPR: Primary data saved (40795 records). [2025-10-23T22:14:13.288707] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-23T22:14:13.288822] [INFO ] [MAIN ] Update Progress: 1202/2367 symbols completed. KMPR took 27.6s. Estimated remaining: 2h 29m 24s. Rate: 7.8 symbols/min [2025-10-23T22:14:13.477609] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:13.500723] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T22:14:13.516497] [DEBUG] [LOCAL ] KNOP: Loaded 10075 existing records from primary storage. [2025-10-23T22:14:13.516776] [INFO ] [MAIN ] KNOP: Loaded 10075 existing records. [2025-10-23T22:14:13.604974] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-23T22:14:13.705010] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:14:13.705230] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-23T22:14:13.705316] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-23T22:14:13.705494] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-23T22:14:13.705574] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-23T22:14:14.063045] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:14.399425] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-23T22:14:14.532639] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T22:14:14.543998] [INFO ] [REMOTE ] KMX: Full fetch complete (76403 records). [2025-10-23T22:14:14.544201] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-23T22:14:14.945120] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-23T22:14:14.945342] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-23T22:14:14.946495] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-23T22:14:14.946575] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-23T22:14:14.966206] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T22:14:14.965331] [DEBUG] [LOCAL ] KMX: Trimmed 76403 records to 53676 (keeping 200 days of data) [2025-10-23T22:14:15.202628] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-23T22:14:15.284201] [DEBUG] [LOCAL ] KMX: Primary data saved (53676 records). [2025-10-23T22:14:15.284346] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-23T22:14:15.284455] [INFO ] [MAIN ] Update Progress: 1203/2367 symbols completed. KMX took 29.6s. Estimated remaining: 2h 29m 11s. Rate: 7.8 symbols/min [2025-10-23T22:14:15.457986] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:15.479526] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T22:14:15.500758] [DEBUG] [LOCAL ] KNSL: Loaded 18288 existing records from primary storage. [2025-10-23T22:14:15.501074] [INFO ] [MAIN ] KNSL: Loaded 18288 existing records. [2025-10-23T22:14:15.675254] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:14:15.675504] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-23T22:14:15.675598] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-23T22:14:15.675895] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-23T22:14:15.675970] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-23T22:14:16.003864] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-23T22:14:16.025577] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:16.551163] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T22:14:16.799437] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-23T22:14:17.337356] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T22:14:17.599466] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-23T22:14:18.399472] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-23T22:14:18.746900] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T22:14:18.955946] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-23T22:14:19.174194] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T22:14:19.199427] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-23T22:14:19.999432] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-23T22:14:20.729546] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T22:14:20.727491] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:14:20.799413] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-23T22:14:21.599446] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-23T22:14:22.257304] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T22:14:22.399501] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-23T22:14:22.428904] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T22:14:23.199435] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-23T22:14:23.570629] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T22:14:23.999491] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-23T22:14:24.284968] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T22:14:24.799485] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-23T22:14:25.599473] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-23T22:14:25.909057] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T22:14:26.298121] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-23T22:14:26.399425] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-23T22:14:27.059824] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T22:14:27.199419] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-23T22:14:27.801191] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T22:14:27.999420] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-23T22:14:28.703308] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T22:14:28.799424] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-23T22:14:29.223398] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T22:14:29.599441] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-23T22:14:30.249009] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T22:14:30.255950] [INFO ] [REMOTE ] KN: Full fetch complete (56756 records). [2025-10-23T22:14:30.256089] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-23T22:14:30.404616] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-23T22:14:30.643306] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-23T22:14:30.643445] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-23T22:14:30.644433] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-23T22:14:30.644531] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-23T22:14:30.645755] [DEBUG] [LOCAL ] KN: Trimmed 56756 records to 38737 (keeping 200 days of data) [2025-10-23T22:14:30.865776] [DEBUG] [LOCAL ] KN: Primary data saved (38737 records). [2025-10-23T22:14:30.865950] [INFO ] [MAIN ] KN: Full history saved. [2025-10-23T22:14:30.866106] [INFO ] [MAIN ] Update Progress: 1204/2367 symbols completed. KN took 45.2s. Estimated remaining: 2h 29m 11s. Rate: 7.8 symbols/min [2025-10-23T22:14:31.042197] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:31.083765] [DEBUG] [LOCAL ] KNTK: Loaded 47207 existing records from primary storage. [2025-10-23T22:14:31.084094] [INFO ] [MAIN ] KNTK: Loaded 47207 existing records. [2025-10-23T22:14:31.207035] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-23T22:14:31.272028] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:14:31.272403] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-23T22:14:31.272520] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-23T22:14:31.272982] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-23T22:14:31.273071] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-23T22:14:31.473026] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-23T22:14:31.674405] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-23T22:14:31.678865] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:31.687830] [INFO ] [REMOTE ] KNF: Full fetch complete (51558 records). [2025-10-23T22:14:31.688084] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-23T22:14:32.004584] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-23T22:14:32.082430] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-23T22:14:32.082538] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-23T22:14:32.083477] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-23T22:14:32.083557] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-23T22:14:32.084716] [DEBUG] [LOCAL ] KNF: Trimmed 51558 records to 36958 (keeping 200 days of data) [2025-10-23T22:14:32.303259] [DEBUG] [LOCAL ] KNF: Primary data saved (36958 records). [2025-10-23T22:14:32.303446] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-23T22:14:32.303567] [INFO ] [MAIN ] Update Progress: 1205/2367 symbols completed. KNF took 20.6s. Estimated remaining: 2h 28m 57s. Rate: 7.8 symbols/min [2025-10-23T22:14:32.477573] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:32.525511] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-23T22:14:32.525881] [INFO ] [MAIN ] KNX: Loaded 52645 existing records. [2025-10-23T22:14:32.706248] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:14:32.706514] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-23T22:14:32.706590] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-23T22:14:32.706853] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-23T22:14:32.706929] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-23T22:14:32.799743] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-23T22:14:32.824742] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T22:14:32.893878] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T22:14:33.102459] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:33.599421] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-23T22:14:34.399438] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-23T22:14:34.512986] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T22:14:35.199411] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-23T22:14:35.379626] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T22:14:35.422472] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T22:14:35.955484] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T22:14:35.999447] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-23T22:14:36.799439] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-23T22:14:36.969165] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T22:14:37.599445] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-23T22:14:38.325353] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T22:14:38.399404] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-23T22:14:38.645122] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:14:39.144790] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T22:14:39.199444] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-23T22:14:39.999484] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-23T22:14:40.068897] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-23T22:14:40.799409] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-23T22:14:41.323887] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T22:14:41.599456] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-23T22:14:42.399471] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-23T22:14:42.456849] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T22:14:43.199428] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-23T22:14:43.245608] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T22:14:43.785775] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:14:43.999437] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-23T22:14:44.799420] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-23T22:14:44.945012] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T22:14:44.947619] [INFO ] [REMOTE ] KNOP: Full fetch complete (14648 records). [2025-10-23T22:14:44.947740] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-23T22:14:45.325579] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T22:14:45.370502] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-23T22:14:45.371195] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-23T22:14:45.371937] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-23T22:14:45.372021] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-23T22:14:45.372560] [DEBUG] [LOCAL ] KNOP: Trimmed 14648 records to 10130 (keeping 200 days of data) [2025-10-23T22:14:45.430979] [DEBUG] [LOCAL ] KNOP: Primary data saved (10130 records). [2025-10-23T22:14:45.431160] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-23T22:14:45.431276] [INFO ] [MAIN ] Update Progress: 1206/2367 symbols completed. KNOP took 32.1s. Estimated remaining: 2h 28m 55s. Rate: 7.8 symbols/min [2025-10-23T22:14:45.596701] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:45.596908] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-23T22:14:45.596979] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-23T22:14:45.597069] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-23T22:14:45.597135] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-23T22:14:45.597195] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-23T22:14:45.597259] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-23T22:14:45.608291] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-23T22:14:45.950695] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:46.007017] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T22:14:46.399440] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-23T22:14:46.814195] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T22:14:47.199448] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-23T22:14:47.999466] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-23T22:14:48.146973] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T22:14:48.799446] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-23T22:14:49.070424] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-23T22:14:49.599430] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-23T22:14:49.724031] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T22:14:49.728774] [INFO ] [REMOTE ] KNSL: Full fetch complete (27073 records). [2025-10-23T22:14:49.728945] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-23T22:14:50.094467] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T22:14:50.233869] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-23T22:14:50.234039] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-23T22:14:50.235104] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-23T22:14:50.235189] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-23T22:14:50.236416] [DEBUG] [LOCAL ] KNSL: Trimmed 27073 records to 18471 (keeping 200 days of data) [2025-10-23T22:14:50.352596] [DEBUG] [LOCAL ] KNSL: Primary data saved (18471 records). [2025-10-23T22:14:50.352928] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-23T22:14:50.353041] [INFO ] [MAIN ] Update Progress: 1207/2367 symbols completed. KNSL took 35.1s. Estimated remaining: 2h 28m 45s. Rate: 7.8 symbols/min [2025-10-23T22:14:50.408622] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-23T22:14:50.528063] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:50.566487] [DEBUG] [LOCAL ] KODK: Loaded 43711 existing records from primary storage. [2025-10-23T22:14:50.566894] [INFO ] [MAIN ] KODK: Loaded 43711 existing records. [2025-10-23T22:14:50.740189] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:14:50.740392] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-23T22:14:50.740470] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-23T22:14:50.740742] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-23T22:14:50.740813] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-23T22:14:51.100140] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:14:51.199422] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-23T22:14:51.229981] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T22:14:51.999430] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-23T22:14:52.772172] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T22:14:52.799404] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-23T22:14:52.867520] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-23T22:14:53.266305] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T22:14:53.599476] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-23T22:14:54.287443] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T22:14:54.399446] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-23T22:14:55.199491] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-23T22:14:55.999440] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-23T22:14:56.110492] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-23T22:14:56.329358] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:14:56.799452] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-23T22:14:57.216406] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-23T22:14:57.599459] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-23T22:14:57.756199] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T22:14:58.399416] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-23T22:14:58.451941] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T22:14:58.845267] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T22:14:58.853666] [INFO ] [REMOTE ] KNTK: Full fetch complete (65893 records). [2025-10-23T22:14:58.853823] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-23T22:14:59.225916] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-23T22:14:59.251670] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-23T22:14:59.251763] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-23T22:14:59.253010] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-23T22:14:59.253230] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-23T22:14:59.254792] [DEBUG] [LOCAL ] KNTK: Trimmed 65893 records to 47587 (keeping 200 days of data) [2025-10-23T22:14:59.581881] [DEBUG] [LOCAL ] KNTK: Primary data saved (47587 records). [2025-10-23T22:14:59.582067] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-23T22:14:59.582197] [INFO ] [MAIN ] Update Progress: 1208/2367 symbols completed. KNTK took 28.7s. Estimated remaining: 2h 28m 38s. Rate: 7.8 symbols/min [2025-10-23T22:14:59.796036] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:14:59.822602] [DEBUG] [LOCAL ] KOF: Loaded 26529 existing records from primary storage. [2025-10-23T22:14:59.822914] [INFO ] [MAIN ] KOF: Loaded 26529 existing records. [2025-10-23T22:14:59.999960] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:00.000090] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-23T22:15:00.001457] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-23T22:15:00.001548] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-23T22:15:00.001774] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-23T22:15:00.001847] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-23T22:15:00.347171] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:00.799415] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-23T22:15:01.041890] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-23T22:15:01.599457] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-23T22:15:01.648056] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T22:15:02.187891] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-10-23T22:15:02.212904] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T22:15:02.399435] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-23T22:15:03.199432] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-23T22:15:03.917991] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T22:15:03.999415] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-23T22:15:04.276693] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-23T22:15:04.799454] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-23T22:15:05.181771] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T22:15:05.220920] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T22:15:05.599447] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-23T22:15:05.975555] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T22:15:06.399453] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-23T22:15:07.199501] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-23T22:15:07.343669] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T22:15:07.999410] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-23T22:15:08.243572] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:15:08.494067] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T22:15:08.799428] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-23T22:15:09.599492] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-23T22:15:09.705772] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T22:15:10.399481] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-23T22:15:11.199421] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-23T22:15:11.382452] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T22:15:11.999487] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-23T22:15:12.190316] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T22:15:12.199842] [INFO ] [REMOTE ] KNX: Full fetch complete (76312 records). [2025-10-23T22:15:12.200027] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-23T22:15:12.610771] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (3.81 seconds). [2025-10-23T22:15:12.682334] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-23T22:15:12.683034] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-23T22:15:12.684534] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-23T22:15:12.684623] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-23T22:15:12.686604] [DEBUG] [LOCAL ] KNX: Trimmed 76312 records to 53035 (keeping 200 days of data) [2025-10-23T22:15:12.823047] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-23T22:15:12.905097] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T22:15:13.187988] [DEBUG] [LOCAL ] KNX: Primary data saved (53035 records). [2025-10-23T22:15:13.188234] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-23T22:15:13.188368] [INFO ] [MAIN ] Update Progress: 1209/2367 symbols completed. KNX took 40.9s. Estimated remaining: 2h 28m 36s. Rate: 7.8 symbols/min [2025-10-23T22:15:13.435593] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:15:13.467549] [DEBUG] [LOCAL ] KOP: Loaded 17332 existing records from primary storage. [2025-10-23T22:15:13.468017] [INFO ] [MAIN ] KOP: Loaded 17332 existing records. [2025-10-23T22:15:13.600977] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-23T22:15:13.773526] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:13.773921] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-23T22:15:13.774012] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-23T22:15:13.774312] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-23T22:15:13.774398] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-23T22:15:13.863532] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T22:15:14.183228] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:14.399408] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-23T22:15:14.879085] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T22:15:15.100399] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-23T22:15:15.162153] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T22:15:15.199401] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-23T22:15:15.999447] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-23T22:15:16.799446] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-23T22:15:17.599459] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-23T22:15:17.644705] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T22:15:17.652777] [INFO ] [REMOTE ] KODK: Full fetch complete (63341 records). [2025-10-23T22:15:17.652912] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-23T22:15:18.038537] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-23T22:15:18.038746] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-23T22:15:18.039794] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-23T22:15:18.040103] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-23T22:15:18.056453] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T22:15:18.062172] [DEBUG] [LOCAL ] KODK: Trimmed 63341 records to 44027 (keeping 200 days of data) [2025-10-23T22:15:18.287219] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-10-23T22:15:18.329218] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:15:18.365507] [DEBUG] [LOCAL ] KODK: Primary data saved (44027 records). [2025-10-23T22:15:18.365669] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-23T22:15:18.365796] [INFO ] [MAIN ] Update Progress: 1210/2367 symbols completed. KODK took 28.0s. Estimated remaining: 2h 28m 26s. Rate: 7.8 symbols/min [2025-10-23T22:15:18.399586] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-23T22:15:18.537101] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:15:18.540611] [DEBUG] [LOCAL ] KORE: Loaded 2179 existing records from primary storage. [2025-10-23T22:15:18.540816] [INFO ] [MAIN ] KORE: Loaded 2179 existing records. [2025-10-23T22:15:18.713070] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:18.713263] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-23T22:15:18.713337] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-23T22:15:18.713548] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-23T22:15:18.713621] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-23T22:15:19.061169] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:19.199392] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-23T22:15:19.999410] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-23T22:15:20.147969] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T22:15:20.799416] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-23T22:15:21.175997] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T22:15:21.392204] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-23T22:15:21.413748] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T22:15:21.599429] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-23T22:15:22.399447] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-23T22:15:23.131198] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T22:15:23.199412] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-23T22:15:23.546112] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T22:15:23.999437] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-23T22:15:24.799492] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-23T22:15:25.241827] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T22:15:25.575989] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-23T22:15:25.599390] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-23T22:15:25.797805] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T22:15:25.912010] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-23T22:15:25.921373] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-23T22:15:25.921523] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-23T22:15:26.115893] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T22:15:26.116702] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:15:26.116777] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:15:26.116853] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-23T22:15:26.116952] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-23T22:15:26.117023] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-23T22:15:26.117080] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-23T22:15:26.117152] [INFO ] [MAIN ] Update Progress: 1211/2367 symbols completed. KO took 40.7s. Estimated remaining: 2h 28m 19s. Rate: 7.8 symbols/min [2025-10-23T22:15:26.280817] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:15:26.331041] [DEBUG] [LOCAL ] KOS: Loaded 53093 existing records from primary storage. [2025-10-23T22:15:26.331389] [INFO ] [MAIN ] KOS: Loaded 53093 existing records. [2025-10-23T22:15:26.404559] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-23T22:15:26.506578] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:26.506843] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-23T22:15:26.506920] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-23T22:15:26.507118] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-23T22:15:26.507186] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-23T22:15:26.851999] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:27.199419] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-23T22:15:27.240603] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T22:15:27.999447] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-23T22:15:28.799460] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-23T22:15:28.874237] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T22:15:28.910277] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T22:15:29.599507] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-23T22:15:30.165785] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T22:15:30.170767] [INFO ] [REMOTE ] KOF: Full fetch complete (37982 records). [2025-10-23T22:15:30.170870] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-23T22:15:30.410375] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-23T22:15:30.596800] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-23T22:15:30.597057] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-23T22:15:30.597812] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-23T22:15:30.597890] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-23T22:15:30.598795] [DEBUG] [LOCAL ] KOF: Trimmed 37982 records to 26676 (keeping 200 days of data) [2025-10-23T22:15:30.725165] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T22:15:30.783355] [DEBUG] [LOCAL ] KOF: Primary data saved (26676 records). [2025-10-23T22:15:30.783533] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-23T22:15:30.783668] [INFO ] [MAIN ] Update Progress: 1212/2367 symbols completed. KOF took 31.2s. Estimated remaining: 2h 28m 8s. Rate: 7.8 symbols/min [2025-10-23T22:15:30.949674] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:15:30.997754] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-23T22:15:30.998115] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-23T22:15:31.171083] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:31.171306] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-23T22:15:31.171380] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-23T22:15:31.172028] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-23T22:15:31.172102] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-23T22:15:31.204636] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-23T22:15:31.528324] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:31.715949] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-23T22:15:31.999448] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-23T22:15:32.291588] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-23T22:15:32.799444] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-23T22:15:33.599446] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-23T22:15:34.399430] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-23T22:15:34.575328] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T22:15:34.864371] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T22:15:34.952165] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-10-23T22:15:35.199408] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-23T22:15:35.581611] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-23T22:15:35.781416] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-23T22:15:35.999432] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-23T22:15:36.799417] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-23T22:15:36.962607] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T22:15:36.966012] [INFO ] [REMOTE ] KOP: Full fetch complete (25409 records). [2025-10-23T22:15:36.966111] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-23T22:15:37.332898] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-23T22:15:37.333008] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-23T22:15:37.333565] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-23T22:15:37.333658] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-23T22:15:37.334349] [DEBUG] [LOCAL ] KOP: Trimmed 25409 records to 17418 (keeping 200 days of data) [2025-10-23T22:15:37.436609] [DEBUG] [LOCAL ] KOP: Primary data saved (17418 records). [2025-10-23T22:15:37.436800] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-23T22:15:37.436917] [INFO ] [MAIN ] Update Progress: 1213/2367 symbols completed. KOP took 24.2s. Estimated remaining: 2h 27m 59s. Rate: 7.8 symbols/min [2025-10-23T22:15:37.612775] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:15:37.609290] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-23T22:15:37.656570] [DEBUG] [LOCAL ] KRC: Loaded 48094 existing records from primary storage. [2025-10-23T22:15:37.656912] [INFO ] [MAIN ] KRC: Loaded 48094 existing records. [2025-10-23T22:15:37.841016] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:37.841259] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-23T22:15:37.841331] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-23T22:15:37.841558] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-23T22:15:37.841628] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-23T22:15:38.193448] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:38.399410] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-23T22:15:38.509746] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T22:15:38.851570] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T22:15:39.199419] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-23T22:15:39.464522] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T22:15:39.999468] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-23T22:15:40.474933] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T22:15:40.799442] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-23T22:15:40.942233] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T22:15:41.599450] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-23T22:15:42.399454] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-23T22:15:42.647900] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T22:15:42.719027] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-23T22:15:43.199424] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-23T22:15:43.627998] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-23T22:15:43.665937] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T22:15:43.999449] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-23T22:15:44.488163] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T22:15:44.489263] [INFO ] [REMOTE ] KORE: Full fetch complete (3896 records). [2025-10-23T22:15:44.489352] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-23T22:15:44.804554] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-23T22:15:44.868921] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-23T22:15:44.869025] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-23T22:15:44.869215] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-23T22:15:44.869293] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-23T22:15:44.869789] [DEBUG] [LOCAL ] KORE: Trimmed 3896 records to 2189 (keeping 200 days of data) [2025-10-23T22:15:44.881798] [DEBUG] [LOCAL ] KORE: Primary data saved (2189 records). [2025-10-23T22:15:44.881893] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-23T22:15:44.882040] [INFO ] [MAIN ] Update Progress: 1214/2367 symbols completed. KORE took 26.5s. Estimated remaining: 2h 27m 51s. Rate: 7.8 symbols/min [2025-10-23T22:15:45.061213] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:15:45.096600] [DEBUG] [LOCAL ] KREF: Loaded 38061 existing records from primary storage. [2025-10-23T22:15:45.097005] [INFO ] [MAIN ] KREF: Loaded 38061 existing records. [2025-10-23T22:15:45.278616] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:15:45.278880] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-23T22:15:45.278978] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-23T22:15:45.279221] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-23T22:15:45.279299] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-23T22:15:45.604607] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-23T22:15:45.641909] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:15:46.399422] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-23T22:15:46.717040] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-23T22:15:47.199458] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-23T22:15:48.010177] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-23T22:15:48.037145] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T22:15:48.799465] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-23T22:15:49.367278] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (3.76 seconds). [2025-10-23T22:15:49.599500] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-23T22:15:49.910040] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T22:15:50.033431] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T22:15:50.399454] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-23T22:15:50.654141] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (3.45 seconds). [2025-10-23T22:15:51.199505] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-23T22:15:51.999455] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-23T22:15:52.176372] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T22:15:52.799451] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-23T22:15:53.219228] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (3.62 seconds). [2025-10-23T22:15:53.599495] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-23T22:15:54.500508] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T22:15:54.511525] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-23T22:15:54.943936] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (3.74 seconds). [2025-10-23T22:15:55.199438] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-23T22:15:55.556767] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T22:15:55.728819] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (3.73 seconds). [2025-10-23T22:15:55.999444] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-23T22:15:56.135144] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T22:15:56.799461] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-23T22:15:57.008077] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T22:15:57.599456] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-23T22:15:58.400943] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-23T22:15:58.409799] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-23T22:15:58.456553] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T22:15:58.998028] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T22:15:59.199468] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-23T22:16:00.007633] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-23T22:16:00.032950] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-23T22:16:00.042745] [INFO ] [REMOTE ] KOS: Full fetch complete (77024 records). [2025-10-23T22:16:00.042929] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-23T22:16:00.434456] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-23T22:16:00.434582] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-23T22:16:00.435613] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-23T22:16:00.435719] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-23T22:16:00.437152] [DEBUG] [LOCAL ] KOS: Trimmed 77024 records to 53483 (keeping 200 days of data) [2025-10-23T22:16:00.730068] [DEBUG] [LOCAL ] KOS: Primary data saved (53483 records). [2025-10-23T22:16:00.730224] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-23T22:16:00.731607] [INFO ] [MAIN ] Update Progress: 1215/2367 symbols completed. KOS took 34.6s. Estimated remaining: 2h 27m 51s. Rate: 7.8 symbols/min [2025-10-23T22:16:00.805385] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-23T22:16:00.901945] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:00.950246] [DEBUG] [LOCAL ] KRG: Loaded 49271 existing records from primary storage. [2025-10-23T22:16:00.950613] [INFO ] [MAIN ] KRG: Loaded 49271 existing records. [2025-10-23T22:16:01.128480] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:01.128753] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-23T22:16:01.128859] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-23T22:16:01.129152] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-23T22:16:01.129243] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-23T22:16:01.508484] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:01.539895] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-23T22:16:01.599400] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-23T22:16:01.624899] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T22:16:02.399434] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-23T22:16:02.645515] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:16:03.007860] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T22:16:03.018197] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-23T22:16:03.043884] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-23T22:16:03.046190] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:16:03.209556] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-23T22:16:03.460894] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-23T22:16:03.461045] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-23T22:16:03.462137] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-23T22:16:03.462241] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-23T22:16:03.463777] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 54071 (keeping 200 days of data) [2025-10-23T22:16:03.793911] [DEBUG] [LOCAL ] KR: Primary data saved (54071 records). [2025-10-23T22:16:03.794126] [INFO ] [MAIN ] KR: Full history saved. [2025-10-23T22:16:03.794263] [INFO ] [MAIN ] Update Progress: 1216/2367 symbols completed. KR took 33.0s. Estimated remaining: 2h 27m 39s. Rate: 7.8 symbols/min [2025-10-23T22:16:03.967518] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:03.967778] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-23T22:16:03.967864] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-23T22:16:03.968021] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-23T22:16:03.968106] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-23T22:16:03.968204] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-23T22:16:03.968296] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-23T22:16:04.004558] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-23T22:16:04.332968] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:04.799500] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-23T22:16:04.943010] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T22:16:05.599507] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-23T22:16:05.817123] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T22:16:05.836255] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:16:05.837584] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-23T22:16:05.837801] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:16:05.837885] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-23T22:16:05.837993] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:16:05.838116] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-23T22:16:05.838228] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-23T22:16:05.838331] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-23T22:16:05.838425] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-23T22:16:05.838529] [INFO ] [MAIN ] Update Progress: 1217/2367 symbols completed. KRMN took 2.0s. Estimated remaining: 2h 27m 26s. Rate: 7.8 symbols/min [2025-10-23T22:16:06.059243] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:06.100696] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T22:16:06.132945] [DEBUG] [LOCAL ] KRO: Loaded 26553 existing records from primary storage. [2025-10-23T22:16:06.133319] [INFO ] [MAIN ] KRO: Loaded 26553 existing records. [2025-10-23T22:16:06.325394] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:06.325699] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-23T22:16:06.325795] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-23T22:16:06.326040] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-23T22:16:06.326134] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-23T22:16:06.404548] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-23T22:16:06.802574] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:07.199436] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-23T22:16:07.999463] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-23T22:16:08.252261] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T22:16:08.799475] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-23T22:16:08.967081] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:16:09.029624] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T22:16:09.599453] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-23T22:16:10.044417] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T22:16:10.399433] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-23T22:16:10.607127] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T22:16:11.199442] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-23T22:16:11.671507] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T22:16:11.999455] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-23T22:16:12.799428] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-23T22:16:13.076036] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T22:16:13.599449] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-23T22:16:13.937964] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-23T22:16:14.226770] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T22:16:14.399493] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-23T22:16:15.201163] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-23T22:16:15.205635] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T22:16:15.214268] [INFO ] [REMOTE ] KRC: Full fetch complete (70056 records). [2025-10-23T22:16:15.214404] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-23T22:16:15.609560] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-23T22:16:15.609713] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-23T22:16:15.610734] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-23T22:16:15.610831] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-23T22:16:15.612185] [DEBUG] [LOCAL ] KRC: Trimmed 70056 records to 48386 (keeping 200 days of data) [2025-10-23T22:16:15.839739] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T22:16:15.924821] [DEBUG] [LOCAL ] KRC: Primary data saved (48386 records). [2025-10-23T22:16:15.924983] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-23T22:16:15.925096] [INFO ] [MAIN ] Update Progress: 1218/2367 symbols completed. KRC took 38.5s. Estimated remaining: 2h 27m 21s. Rate: 7.8 symbols/min [2025-10-23T22:16:16.004507] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-23T22:16:16.096928] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:16.129053] [DEBUG] [LOCAL ] KRP: Loaded 35928 existing records from primary storage. [2025-10-23T22:16:16.129357] [INFO ] [MAIN ] KRP: Loaded 35928 existing records. [2025-10-23T22:16:16.302943] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:16.303166] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-23T22:16:16.303240] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-23T22:16:16.303497] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-23T22:16:16.303572] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-23T22:16:16.657403] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:16.799403] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-23T22:16:17.051942] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T22:16:17.086679] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T22:16:17.599441] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-23T22:16:18.399428] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-23T22:16:18.705062] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T22:16:19.009501] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-23T22:16:19.199435] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-23T22:16:19.944492] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-23T22:16:19.999411] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-23T22:16:20.674632] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T22:16:20.799426] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-23T22:16:21.599414] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-23T22:16:21.813339] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T22:16:21.834311] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T22:16:21.840341] [INFO ] [REMOTE ] KREF: Full fetch complete (53059 records). [2025-10-23T22:16:21.840791] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-23T22:16:22.230593] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-23T22:16:22.230752] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-23T22:16:22.231747] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-23T22:16:22.231828] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-23T22:16:22.233034] [DEBUG] [LOCAL ] KREF: Trimmed 53059 records to 38364 (keeping 200 days of data) [2025-10-23T22:16:22.401579] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-23T22:16:22.456671] [DEBUG] [LOCAL ] KREF: Primary data saved (38364 records). [2025-10-23T22:16:22.456853] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-23T22:16:22.456973] [INFO ] [MAIN ] Update Progress: 1219/2367 symbols completed. KREF took 37.6s. Estimated remaining: 2h 27m 12s. Rate: 7.8 symbols/min [2025-10-23T22:16:22.634488] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:22.684752] [DEBUG] [LOCAL ] KSS: Loaded 53589 existing records from primary storage. [2025-10-23T22:16:22.685130] [INFO ] [MAIN ] KSS: Loaded 53589 existing records. [2025-10-23T22:16:22.877591] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:22.878056] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-23T22:16:22.878137] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-23T22:16:22.878706] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-23T22:16:22.878782] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-23T22:16:23.205979] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-23T22:16:23.274530] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:23.303895] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T22:16:24.009976] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-23T22:16:24.016529] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T22:16:24.608462] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T22:16:24.799451] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-23T22:16:25.599445] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-23T22:16:25.957704] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T22:16:26.123425] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-23T22:16:26.399461] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-23T22:16:26.818063] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T22:16:27.199429] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-23T22:16:27.597259] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T22:16:27.602193] [INFO ] [REMOTE ] KRO: Full fetch complete (35366 records). [2025-10-23T22:16:27.602348] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-23T22:16:27.973495] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-23T22:16:27.973600] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-23T22:16:27.974321] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-23T22:16:27.974399] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-23T22:16:27.975242] [DEBUG] [LOCAL ] KRO: Trimmed 35366 records to 26739 (keeping 200 days of data) [2025-10-23T22:16:28.021477] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-23T22:16:28.126324] [DEBUG] [LOCAL ] KRO: Primary data saved (26739 records). [2025-10-23T22:16:28.126485] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-23T22:16:28.126596] [INFO ] [MAIN ] Update Progress: 1220/2367 symbols completed. KRO took 22.3s. Estimated remaining: 2h 27m 2s. Rate: 7.8 symbols/min [2025-10-23T22:16:28.299624] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:28.351513] [DEBUG] [LOCAL ] KT: Loaded 45383 existing records from primary storage. [2025-10-23T22:16:28.351956] [INFO ] [MAIN ] KT: Loaded 45383 existing records. [2025-10-23T22:16:28.574268] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:28.574500] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-23T22:16:28.574574] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-23T22:16:28.574975] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-23T22:16:28.575050] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-23T22:16:28.816988] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-23T22:16:28.945921] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T22:16:28.986714] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:29.327734] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T22:16:29.599434] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-23T22:16:30.331813] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T22:16:30.399395] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-23T22:16:30.860127] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-23T22:16:31.199466] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-23T22:16:31.999459] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-23T22:16:32.644335] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-23T22:16:32.685735] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T22:16:32.799436] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-23T22:16:33.609213] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-23T22:16:33.612539] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T22:16:34.399412] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-23T22:16:34.796185] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T22:16:34.899659] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T22:16:35.199435] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-23T22:16:35.724526] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T22:16:35.999475] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-23T22:16:36.697810] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T22:16:36.799443] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-23T22:16:37.599446] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-23T22:16:37.658055] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T22:16:38.293294] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T22:16:38.399445] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-23T22:16:39.199416] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-23T22:16:39.686414] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T22:16:39.723012] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T22:16:39.999450] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-23T22:16:40.804542] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-23T22:16:40.821032] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T22:16:41.599422] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-23T22:16:41.965674] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-23T22:16:42.399452] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-23T22:16:42.877488] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-23T22:16:42.884135] [INFO ] [REMOTE ] KRP: Full fetch complete (54944 records). [2025-10-23T22:16:42.884295] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-23T22:16:43.204546] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-23T22:16:43.288246] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-23T22:16:43.288361] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-23T22:16:43.289283] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-23T22:16:43.289363] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-23T22:16:43.290545] [DEBUG] [LOCAL ] KRP: Trimmed 54944 records to 36127 (keeping 200 days of data) [2025-10-23T22:16:43.515051] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-23T22:16:43.554293] [DEBUG] [LOCAL ] KRP: Primary data saved (36127 records). [2025-10-23T22:16:43.554456] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-23T22:16:43.554568] [INFO ] [MAIN ] Update Progress: 1221/2367 symbols completed. KRP took 27.6s. Estimated remaining: 2h 27m 2s. Rate: 7.8 symbols/min [2025-10-23T22:16:43.723052] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:43.756610] [DEBUG] [LOCAL ] KTB: Loaded 40299 existing records from primary storage. [2025-10-23T22:16:43.756987] [INFO ] [MAIN ] KTB: Loaded 40299 existing records. [2025-10-23T22:16:43.933719] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:43.933945] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-23T22:16:43.934020] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-23T22:16:43.934297] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-23T22:16:43.934770] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-23T22:16:44.005001] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-23T22:16:44.252722] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T22:16:44.311901] [INFO ] [REMOTE ] KRG: Full fetch complete (71442 records). [2025-10-23T22:16:44.340344] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-23T22:16:44.347154] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:44.734953] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-23T22:16:44.735189] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-23T22:16:44.736321] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-23T22:16:44.736448] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-23T22:16:44.738058] [DEBUG] [LOCAL ] KRG: Trimmed 71442 records to 49641 (keeping 200 days of data) [2025-10-23T22:16:44.799825] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-23T22:16:44.992007] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T22:16:45.073502] [DEBUG] [LOCAL ] KRG: Primary data saved (49641 records). [2025-10-23T22:16:45.073697] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-23T22:16:45.075096] [INFO ] [MAIN ] Update Progress: 1222/2367 symbols completed. KRG took 44.3s. Estimated remaining: 2h 26m 49s. Rate: 7.8 symbols/min [2025-10-23T22:16:45.239742] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:45.252046] [DEBUG] [LOCAL ] KTF: Loaded 11658 existing records from primary storage. [2025-10-23T22:16:45.252299] [INFO ] [MAIN ] KTF: Loaded 11658 existing records. [2025-10-23T22:16:45.427142] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:45.427337] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-23T22:16:45.427410] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-23T22:16:45.427564] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-23T22:16:45.427627] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-23T22:16:45.631367] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-23T22:16:45.780891] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:46.196964] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T22:16:46.230952] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T22:16:46.399455] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-23T22:16:46.935052] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T22:16:47.199447] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-23T22:16:47.999545] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-23T22:16:48.356116] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T22:16:48.789187] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T22:16:48.799397] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-23T22:16:49.549116] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T22:16:49.599405] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-23T22:16:50.400973] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-23T22:16:50.401934] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T22:16:50.438907] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T22:16:51.199451] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-23T22:16:51.999421] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-23T22:16:52.039127] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T22:16:52.068062] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T22:16:52.799445] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-23T22:16:53.599405] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-23T22:16:54.013237] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T22:16:54.054563] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T22:16:54.399415] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-23T22:16:54.720335] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T22:16:55.199456] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-23T22:16:55.999445] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-23T22:16:56.668038] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-23T22:16:56.799410] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-23T22:16:57.007257] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T22:16:57.102884] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T22:16:57.112364] [INFO ] [REMOTE ] KSS: Full fetch complete (77743 records). [2025-10-23T22:16:57.112538] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-23T22:16:57.577591] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-23T22:16:57.577778] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-23T22:16:57.579212] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-23T22:16:57.579330] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-23T22:16:57.581106] [DEBUG] [LOCAL ] KSS: Trimmed 77743 records to 53970 (keeping 200 days of data) [2025-10-23T22:16:57.644864] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-23T22:16:58.068264] [DEBUG] [LOCAL ] KSS: Primary data saved (53970 records). [2025-10-23T22:16:58.068498] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-23T22:16:58.068634] [INFO ] [MAIN ] Update Progress: 1223/2367 symbols completed. KSS took 35.6s. Estimated remaining: 2h 26m 46s. Rate: 7.8 symbols/min [2025-10-23T22:16:58.304416] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:58.369418] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T22:16:58.398861] [INFO ] [REMOTE ] KT: Full fetch complete (66717 records). [2025-10-23T22:16:58.398684] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-23T22:16:58.399064] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-23T22:16:58.399425] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-23T22:16:58.399588] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-23T22:16:58.752032] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:16:58.805664] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-23T22:16:58.867636] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-23T22:16:58.880105] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-23T22:16:58.896784] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-23T22:16:59.136206] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-23T22:16:59.228441] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-23T22:16:59.243616] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-23T22:16:59.288184] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-23T22:16:59.340581] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T22:16:59.412626] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:16:59.415444] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-23T22:16:59.414477] [DEBUG] [LOCAL ] KT: Trimmed 66717 records to 45680 (keeping 200 days of data) [2025-10-23T22:16:59.440223] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:16:59.723983] [DEBUG] [LOCAL ] KT: Primary data saved (45680 records). [2025-10-23T22:16:59.724123] [INFO ] [MAIN ] KT: Full history saved. [2025-10-23T22:16:59.724242] [INFO ] [MAIN ] Update Progress: 1224/2367 symbols completed. KT took 31.6s. Estimated remaining: 2h 26m 32s. Rate: 7.8 symbols/min [2025-10-23T22:16:59.896699] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:16:59.942587] [DEBUG] [LOCAL ] KVYO: Loaded 50891 existing records from primary storage. [2025-10-23T22:16:59.942949] [INFO ] [MAIN ] KVYO: Loaded 50891 existing records. [2025-10-23T22:17:00.005878] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-23T22:17:00.123284] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:00.123488] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-23T22:17:00.123563] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-23T22:17:00.123829] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-23T22:17:00.123903] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-23T22:17:00.471338] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T22:17:00.522534] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:00.799429] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-23T22:17:01.599472] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-23T22:17:01.750899] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T22:17:02.217402] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-23T22:17:02.399446] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-23T22:17:03.095561] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T22:17:03.199421] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-23T22:17:03.999421] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-23T22:17:04.033824] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T22:17:04.788997] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T22:17:04.799392] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-23T22:17:05.599419] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-23T22:17:05.766895] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T22:17:06.193185] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T22:17:06.399415] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-23T22:17:06.565872] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:17:07.199431] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-23T22:17:07.999415] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-23T22:17:08.093765] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T22:17:08.799428] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-23T22:17:09.017728] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T22:17:09.573908] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T22:17:09.599398] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-23T22:17:10.399413] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-23T22:17:10.918966] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T22:17:10.926062] [INFO ] [REMOTE ] KTB: Full fetch complete (58349 records). [2025-10-23T22:17:10.926223] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-23T22:17:11.199473] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-23T22:17:11.388592] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-23T22:17:11.389457] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-23T22:17:11.391825] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-23T22:17:11.390729] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-23T22:17:11.392005] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-23T22:17:11.404746] [DEBUG] [LOCAL ] KTB: Trimmed 58349 records to 40495 (keeping 200 days of data) [2025-10-23T22:17:11.644162] [DEBUG] [LOCAL ] KTB: Primary data saved (40495 records). [2025-10-23T22:17:11.644312] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-23T22:17:11.644400] [INFO ] [MAIN ] Update Progress: 1225/2367 symbols completed. KTB took 28.1s. Estimated remaining: 2h 26m 29s. Rate: 7.8 symbols/min [2025-10-23T22:17:11.825890] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:17:11.864871] [DEBUG] [LOCAL ] KW: Loaded 40330 existing records from primary storage. [2025-10-23T22:17:11.865256] [INFO ] [MAIN ] KW: Loaded 40330 existing records. [2025-10-23T22:17:12.010191] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-23T22:17:12.052383] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:12.052981] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-23T22:17:12.060023] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T22:17:12.060285] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-23T22:17:12.063526] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-23T22:17:12.063666] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-23T22:17:12.446184] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:12.448141] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-23T22:17:12.799450] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-23T22:17:13.499603] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T22:17:13.501676] [INFO ] [REMOTE ] KTF: Full fetch complete (17317 records). [2025-10-23T22:17:13.501774] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-23T22:17:13.606911] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-23T22:17:13.882938] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-23T22:17:13.883163] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-23T22:17:13.883692] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-23T22:17:13.883881] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-23T22:17:13.884577] [DEBUG] [LOCAL ] KTF: Trimmed 17317 records to 11723 (keeping 200 days of data) [2025-10-23T22:17:13.957860] [DEBUG] [LOCAL ] KTF: Primary data saved (11723 records). [2025-10-23T22:17:13.958045] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-23T22:17:13.958158] [INFO ] [MAIN ] Update Progress: 1226/2367 symbols completed. KTF took 28.9s. Estimated remaining: 2h 26m 16s. Rate: 7.8 symbols/min [2025-10-23T22:17:14.100076] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T22:17:14.188938] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:17:14.206973] [DEBUG] [LOCAL ] KWR: Loaded 15690 existing records from primary storage. [2025-10-23T22:17:14.207282] [INFO ] [MAIN ] KWR: Loaded 15690 existing records. [2025-10-23T22:17:14.395681] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:14.395904] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-23T22:17:14.395980] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-23T22:17:14.396236] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-23T22:17:14.396314] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-23T22:17:14.407866] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-23T22:17:14.763595] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:15.199406] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-23T22:17:15.301088] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T22:17:15.999418] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-23T22:17:16.282035] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T22:17:16.488883] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-23T22:17:16.799442] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-23T22:17:17.599453] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-23T22:17:17.697906] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T22:17:17.961229] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T22:17:18.399439] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-23T22:17:19.199424] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-23T22:17:19.415937] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T22:17:19.494508] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T22:17:19.999429] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-23T22:17:20.567843] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T22:17:20.799433] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-23T22:17:21.599467] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-23T22:17:21.886760] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T22:17:21.926608] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T22:17:22.399442] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-23T22:17:22.931081] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T22:17:23.199418] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-23T22:17:23.999427] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-23T22:17:24.799417] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-23T22:17:24.931058] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-23T22:17:25.599395] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-23T22:17:25.778148] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-23T22:17:25.839423] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T22:17:25.889871] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T22:17:26.399467] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-23T22:17:27.199437] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-23T22:17:27.850445] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-23T22:17:27.889264] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T22:17:27.999465] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-23T22:17:28.205422] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T22:17:28.737893] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T22:17:28.747171] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-23T22:17:28.747326] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-23T22:17:28.804733] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-23T22:17:29.161988] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-23T22:17:29.162119] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-23T22:17:29.163229] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-23T22:17:29.163313] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-23T22:17:29.164802] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 54057 (keeping 200 days of data) [2025-10-23T22:17:29.490950] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-23T22:17:29.491122] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-23T22:17:29.491237] [INFO ] [MAIN ] Update Progress: 1227/2367 symbols completed. KVUE took 31.4s. Estimated remaining: 2h 26m 16s. Rate: 7.8 symbols/min [2025-10-23T22:17:29.604264] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-23T22:17:29.678223] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:17:29.715979] [DEBUG] [LOCAL ] KYN: Loaded 30129 existing records from primary storage. [2025-10-23T22:17:29.716369] [INFO ] [MAIN ] KYN: Loaded 30129 existing records. [2025-10-23T22:17:29.917728] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:29.918091] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-23T22:17:29.918190] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-23T22:17:29.923868] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-23T22:17:29.930030] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-23T22:17:29.996395] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T22:17:30.311466] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:30.399458] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-23T22:17:31.199450] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-23T22:17:31.410887] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T22:17:31.534119] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T22:17:31.999436] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-23T22:17:32.634889] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T22:17:32.799482] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-23T22:17:32.901088] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T22:17:33.599471] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-23T22:17:33.741087] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T22:17:34.399448] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-23T22:17:34.907769] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T22:17:35.199427] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-23T22:17:35.207147] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:17:35.209962] [INFO ] [REMOTE ] KWR: Full fetch complete (23201 records). [2025-10-23T22:17:35.210063] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-23T22:17:35.580612] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-23T22:17:35.580787] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-23T22:17:35.581297] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-23T22:17:35.581370] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-23T22:17:35.582200] [DEBUG] [LOCAL ] KWR: Trimmed 23201 records to 15764 (keeping 200 days of data) [2025-10-23T22:17:35.678372] [DEBUG] [LOCAL ] KWR: Primary data saved (15764 records). [2025-10-23T22:17:35.678543] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-23T22:17:35.678679] [INFO ] [MAIN ] Update Progress: 1228/2367 symbols completed. KWR took 21.7s. Estimated remaining: 2h 26m 6s. Rate: 7.8 symbols/min [2025-10-23T22:17:35.847019] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:17:35.887518] [DEBUG] [LOCAL ] L: Loaded 41146 existing records from primary storage. [2025-10-23T22:17:35.887857] [INFO ] [MAIN ] L: Loaded 41146 existing records. [2025-10-23T22:17:36.004510] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-23T22:17:36.071613] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:36.072068] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-23T22:17:36.072187] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-23T22:17:36.072529] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-23T22:17:36.072606] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-23T22:17:36.507870] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:36.640134] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T22:17:36.799441] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-23T22:17:37.572341] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T22:17:37.581498] [INFO ] [REMOTE ] KVYO: Full fetch complete (72290 records). [2025-10-23T22:17:37.581672] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-23T22:17:37.604554] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-23T22:17:37.976395] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-23T22:17:37.976574] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-23T22:17:37.977683] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-23T22:17:37.977787] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-23T22:17:37.979359] [DEBUG] [LOCAL ] KVYO: Trimmed 72290 records to 51270 (keeping 200 days of data) [2025-10-23T22:17:38.274184] [DEBUG] [LOCAL ] KVYO: Primary data saved (51270 records). [2025-10-23T22:17:38.274346] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-23T22:17:38.274457] [INFO ] [MAIN ] Update Progress: 1229/2367 symbols completed. KVYO took 38.6s. Estimated remaining: 2h 25m 54s. Rate: 7.8 symbols/min [2025-10-23T22:17:38.414808] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-23T22:17:38.464854] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T22:17:38.468128] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:17:38.523433] [DEBUG] [LOCAL ] LAC: Loaded 52571 existing records from primary storage. [2025-10-23T22:17:38.523800] [INFO ] [MAIN ] LAC: Loaded 52571 existing records. [2025-10-23T22:17:38.704459] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:38.704720] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-23T22:17:38.704826] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-23T22:17:38.705089] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-23T22:17:38.705166] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-23T22:17:39.071727] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:39.199414] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-23T22:17:39.277536] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T22:17:39.356710] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T22:17:39.999439] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-23T22:17:40.391008] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T22:17:40.799474] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-23T22:17:41.599431] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-23T22:17:41.878185] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T22:17:42.400897] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-23T22:17:42.412784] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T22:17:43.075718] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T22:17:43.199450] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-23T22:17:43.748973] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T22:17:43.999424] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-23T22:17:44.706321] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T22:17:44.799412] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-23T22:17:45.590890] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T22:17:45.599434] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-23T22:17:46.279696] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T22:17:46.286742] [INFO ] [REMOTE ] KW: Full fetch complete (57228 records). [2025-10-23T22:17:46.286914] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-23T22:17:46.404520] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-23T22:17:46.678077] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-23T22:17:46.678181] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-23T22:17:46.679070] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-23T22:17:46.679168] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-23T22:17:46.680319] [DEBUG] [LOCAL ] KW: Trimmed 57228 records to 40548 (keeping 200 days of data) [2025-10-23T22:17:46.912392] [DEBUG] [LOCAL ] KW: Primary data saved (40548 records). [2025-10-23T22:17:46.912536] [INFO ] [MAIN ] KW: Full history saved. [2025-10-23T22:17:46.912664] [INFO ] [MAIN ] Update Progress: 1230/2367 symbols completed. KW took 35.3s. Estimated remaining: 2h 25m 47s. Rate: 7.8 symbols/min [2025-10-23T22:17:47.089135] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:17:47.123884] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:17:47.140951] [DEBUG] [LOCAL ] LAD: Loaded 23290 existing records from primary storage. [2025-10-23T22:17:47.141245] [INFO ] [MAIN ] LAD: Loaded 23290 existing records. [2025-10-23T22:17:47.204552] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-23T22:17:47.320095] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:17:47.320336] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-23T22:17:47.320413] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-23T22:17:47.320638] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-23T22:17:47.320755] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-23T22:17:47.673019] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:17:47.760918] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T22:17:47.999440] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-23T22:17:48.799432] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-23T22:17:48.914365] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:17:49.413264] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T22:17:49.599472] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-23T22:17:49.857985] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T22:17:50.399543] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-23T22:17:51.199425] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-23T22:17:51.619115] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T22:17:51.678857] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T22:17:51.999451] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-23T22:17:52.799471] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-23T22:17:52.924696] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T22:17:53.036061] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T22:17:53.599460] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-23T22:17:54.399443] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-23T22:17:54.777620] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T22:17:54.994987] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T22:17:55.199507] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-23T22:17:55.999412] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-23T22:17:56.359627] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T22:17:56.799510] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-23T22:17:57.244635] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T22:17:57.372556] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T22:17:57.599432] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-23T22:17:58.033911] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T22:17:58.399442] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-23T22:17:58.699227] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T22:17:59.199418] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-23T22:17:59.572989] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T22:17:59.578581] [INFO ] [REMOTE ] KYN: Full fetch complete (44262 records). [2025-10-23T22:17:59.578798] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-23T22:17:59.951926] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-23T22:17:59.952038] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-23T22:17:59.952842] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-23T22:17:59.952921] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-23T22:17:59.953862] [DEBUG] [LOCAL ] KYN: Trimmed 44262 records to 30347 (keeping 200 days of data) [2025-10-23T22:18:00.006368] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-23T22:18:00.143963] [DEBUG] [LOCAL ] KYN: Primary data saved (30347 records). [2025-10-23T22:18:00.144116] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-23T22:18:00.144252] [INFO ] [MAIN ] Update Progress: 1231/2367 symbols completed. KYN took 30.7s. Estimated remaining: 2h 25m 45s. Rate: 7.8 symbols/min [2025-10-23T22:18:00.320504] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:18:00.356421] [DEBUG] [LOCAL ] LADR: Loaded 39334 existing records from primary storage. [2025-10-23T22:18:00.356767] [INFO ] [MAIN ] LADR: Loaded 39334 existing records. [2025-10-23T22:18:00.531000] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:18:00.531179] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-23T22:18:00.531253] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-23T22:18:00.531434] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-23T22:18:00.531530] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-23T22:18:00.806487] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-23T22:18:00.910613] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:18:00.926115] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T22:18:01.447403] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-23T22:18:01.599527] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-23T22:18:01.988681] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T22:18:02.399430] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-23T22:18:02.523404] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T22:18:02.531065] [INFO ] [REMOTE ] L: Full fetch complete (59362 records). [2025-10-23T22:18:02.531208] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-23T22:18:02.937814] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-23T22:18:02.937968] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-23T22:18:02.938937] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-23T22:18:02.939023] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-23T22:18:02.940344] [DEBUG] [LOCAL ] L: Trimmed 59362 records to 41436 (keeping 200 days of data) [2025-10-23T22:18:03.193847] [DEBUG] [LOCAL ] L: Primary data saved (41436 records). [2025-10-23T22:18:03.194015] [INFO ] [MAIN ] L: Full history saved. [2025-10-23T22:18:03.195334] [INFO ] [MAIN ] Update Progress: 1232/2367 symbols completed. L took 27.5s. Estimated remaining: 2h 25m 33s. Rate: 7.8 symbols/min [2025-10-23T22:18:03.207127] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-23T22:18:03.372375] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:18:03.377974] [DEBUG] [LOCAL ] LANV: Loaded 2784 existing records from primary storage. [2025-10-23T22:18:03.378217] [INFO ] [MAIN ] LANV: Loaded 2784 existing records. [2025-10-23T22:18:03.558336] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:18:03.558567] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-23T22:18:03.558675] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-23T22:18:03.558851] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-23T22:18:03.558933] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-23T22:18:03.913918] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:18:03.933976] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T22:18:03.999437] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-23T22:18:04.799438] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-23T22:18:05.376264] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-23T22:18:05.446485] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T22:18:05.599671] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-23T22:18:05.602690] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T22:18:06.399426] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-23T22:18:07.052129] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T22:18:07.199491] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-23T22:18:07.854996] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T22:18:07.999492] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-23T22:18:08.448234] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-23T22:18:08.799442] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-23T22:18:09.279036] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T22:18:09.381459] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T22:18:09.599452] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-23T22:18:10.399493] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-23T22:18:10.934346] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-23T22:18:10.939257] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-23T22:18:11.199488] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-23T22:18:11.999447] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-23T22:18:12.463400] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T22:18:12.799445] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-23T22:18:13.250408] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T22:18:13.513254] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-23T22:18:13.599490] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-23T22:18:14.399484] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-23T22:18:14.783193] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-23T22:18:14.841478] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-23T22:18:15.199439] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-23T22:18:15.999479] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-23T22:18:16.799492] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-23T22:18:17.285232] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T22:18:17.486402] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-23T22:18:17.516172] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:18:17.599419] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-23T22:18:18.170950] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T22:18:18.399429] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-23T22:18:19.199452] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-23T22:18:19.643913] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T22:18:19.651153] [INFO ] [REMOTE ] LAD: Full fetch complete (35641 records). [2025-10-23T22:18:19.651329] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-23T22:18:19.866680] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T22:18:20.012054] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-23T22:18:20.062726] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-23T22:18:20.062835] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-23T22:18:20.063609] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-23T22:18:20.063705] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-23T22:18:20.064706] [DEBUG] [LOCAL ] LAD: Trimmed 35641 records to 23562 (keeping 200 days of data) [2025-10-23T22:18:20.207202] [DEBUG] [LOCAL ] LAD: Primary data saved (23562 records). [2025-10-23T22:18:20.207356] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-23T22:18:20.207467] [INFO ] [MAIN ] Update Progress: 1233/2367 symbols completed. LAD took 33.3s. Estimated remaining: 2h 25m 34s. Rate: 7.8 symbols/min [2025-10-23T22:18:20.376908] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:18:20.377115] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-23T22:18:20.377188] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-23T22:18:20.377296] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-23T22:18:20.377365] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-23T22:18:20.377445] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-23T22:18:20.377514] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-23T22:18:20.757608] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:18:20.799406] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-23T22:18:21.485692] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T22:18:21.600441] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-23T22:18:21.602676] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T22:18:22.109123] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T22:18:22.110252] [INFO ] [REMOTE ] LANV: Full fetch complete (4243 records). [2025-10-23T22:18:22.110342] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-23T22:18:22.404565] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-23T22:18:22.467144] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-23T22:18:22.467248] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-23T22:18:22.467415] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-23T22:18:22.467489] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-23T22:18:22.467905] [DEBUG] [LOCAL ] LANV: Trimmed 4243 records to 2803 (keeping 200 days of data) [2025-10-23T22:18:22.482608] [DEBUG] [LOCAL ] LANV: Primary data saved (2803 records). [2025-10-23T22:18:22.482706] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-23T22:18:22.482808] [INFO ] [MAIN ] Update Progress: 1234/2367 symbols completed. LANV took 19.3s. Estimated remaining: 2h 25m 21s. Rate: 7.8 symbols/min [2025-10-23T22:18:22.647426] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:18:22.663326] [DEBUG] [LOCAL ] LAW: Loaded 14897 existing records from primary storage. [2025-10-23T22:18:22.663575] [INFO ] [MAIN ] LAW: Loaded 14897 existing records. [2025-10-23T22:18:22.840069] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:18:22.840314] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-23T22:18:22.840388] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-23T22:18:22.840563] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-23T22:18:22.840695] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-23T22:18:23.185516] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:18:23.199393] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-23T22:18:23.999447] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-23T22:18:24.035943] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T22:18:24.140769] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T22:18:24.799448] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-23T22:18:25.599425] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-23T22:18:25.678866] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T22:18:26.309245] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T22:18:26.399444] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-23T22:18:27.199451] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-23T22:18:27.905626] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-23T22:18:27.999398] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-23T22:18:28.025705] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T22:18:28.799451] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-23T22:18:29.184889] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T22:18:29.599439] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-23T22:18:30.399428] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-23T22:18:30.525469] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T22:18:30.597952] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T22:18:30.842615] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-23T22:18:30.853096] [INFO ] [REMOTE ] LAC: Full fetch complete (76146 records). [2025-10-23T22:18:30.853364] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-23T22:18:31.206867] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-23T22:18:31.271139] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-23T22:18:31.271272] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-23T22:18:31.272474] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-23T22:18:31.272563] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-23T22:18:31.274156] [DEBUG] [LOCAL ] LAC: Trimmed 76146 records to 52961 (keeping 200 days of data) [2025-10-23T22:18:31.586280] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T22:18:31.615735] [INFO ] [REMOTE ] LADR: Full fetch complete (55675 records). [2025-10-23T22:18:31.623033] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-23T22:18:31.635593] [DEBUG] [LOCAL ] LAC: Primary data saved (52961 records). [2025-10-23T22:18:31.636108] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-23T22:18:31.636232] [INFO ] [MAIN ] Update Progress: 1235/2367 symbols completed. LAC took 53.4s. Estimated remaining: 2h 25m 15s. Rate: 7.8 symbols/min [2025-10-23T22:18:32.023085] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-23T22:18:32.033452] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:18:32.233400] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-23T22:18:32.233534] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-23T22:18:32.244011] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-23T22:18:32.244232] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-23T22:18:32.245601] [DEBUG] [LOCAL ] LADR: Trimmed 55675 records to 39650 (keeping 200 days of data) [2025-10-23T22:18:32.359028] [DEBUG] [LOCAL ] LAZ: Loaded 44442 existing records from primary storage. [2025-10-23T22:18:32.374445] [INFO ] [MAIN ] LAZ: Loaded 44442 existing records. [2025-10-23T22:18:32.680581] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:18:32.714048] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-23T22:18:32.713794] [DEBUG] [LOCAL ] LADR: Primary data saved (39650 records). [2025-10-23T22:18:32.714266] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-23T22:18:32.714578] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-23T22:18:32.714776] [INFO ] [MAIN ] Update Progress: 1236/2367 symbols completed. LADR took 32.6s. Estimated remaining: 2h 25m 1s. Rate: 7.8 symbols/min [2025-10-23T22:18:32.714820] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-23T22:18:32.738801] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-23T22:18:33.072772] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T22:18:33.071348] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:18:33.092860] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-23T22:18:33.201967] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-23T22:18:33.349165] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:18:33.351511] [DEBUG] [LOCAL ] LB: Loaded 36982 existing records from primary storage. [2025-10-23T22:18:33.351863] [INFO ] [MAIN ] LB: Loaded 36982 existing records. [2025-10-23T22:18:33.527074] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:18:33.527268] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-23T22:18:33.527347] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-23T22:18:33.527631] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-23T22:18:33.527736] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-23T22:18:33.604544] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-23T22:18:33.890661] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:18:34.077625] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-23T22:18:34.399424] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-23T22:18:35.199410] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-23T22:18:35.244787] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T22:18:35.326298] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T22:18:35.999485] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-23T22:18:36.681554] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T22:18:36.799491] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-23T22:18:37.478180] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T22:18:37.599423] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-23T22:18:38.401469] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-23T22:18:38.403867] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T22:18:38.913751] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T22:18:39.199434] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-23T22:18:39.999426] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-23T22:18:40.215815] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T22:18:40.391244] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T22:18:40.799447] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-23T22:18:41.599473] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-23T22:18:42.065234] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T22:18:42.399451] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-23T22:18:42.567273] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T22:18:42.570585] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:18:43.199482] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-23T22:18:43.999490] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-23T22:18:44.039347] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T22:18:44.182839] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T22:18:44.799474] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-23T22:18:45.599421] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-23T22:18:45.821800] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T22:18:46.317486] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T22:18:46.399404] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-23T22:18:46.411159] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:18:47.199448] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-23T22:18:47.999508] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-23T22:18:48.086584] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T22:18:48.799470] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-23T22:18:49.024898] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T22:18:49.035259] [INFO ] [REMOTE ] LAR: Full fetch complete (62842 records). [2025-10-23T22:18:49.035513] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-23T22:18:49.158139] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T22:18:49.162739] [INFO ] [REMOTE ] LAW: Full fetch complete (21257 records). [2025-10-23T22:18:49.178785] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-23T22:18:49.357320] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-23T22:18:49.380671] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:18:49.402163] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:18:49.454885] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-23T22:18:49.527480] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-23T22:18:49.562472] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-23T22:18:49.570680] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-23T22:18:49.591502] [INFO ] [MAIN ] Update Progress: 1237/2367 symbols completed. LAR took 29.4s. Estimated remaining: 2h 25m 1s. Rate: 7.8 symbols/min [2025-10-23T22:18:49.603704] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-23T22:18:49.649126] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-23T22:18:49.650270] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-23T22:18:49.650858] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-23T22:18:49.651198] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-23T22:18:49.651991] [DEBUG] [LOCAL ] LAW: Trimmed 21257 records to 15075 (keeping 200 days of data) [2025-10-23T22:18:49.733490] [DEBUG] [LOCAL ] LAW: Primary data saved (15075 records). [2025-10-23T22:18:49.733692] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-23T22:18:49.733811] [INFO ] [MAIN ] Update Progress: 1238/2367 symbols completed. LAW took 27.3s. Estimated remaining: 2h 24m 47s. Rate: 7.8 symbols/min [2025-10-23T22:18:50.296187] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T22:18:50.399404] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-23T22:18:51.251926] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T22:18:51.261433] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-23T22:18:52.070409] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T22:18:52.079148] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-23T22:18:52.834418] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T22:18:52.844334] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-23T22:18:53.618138] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T22:18:53.626531] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-23T22:18:54.093461] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T22:18:54.101024] [INFO ] [REMOTE ] LAZ: Full fetch complete (65399 records). [2025-10-23T22:18:54.101213] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-23T22:18:54.503440] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-23T22:18:54.503553] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-23T22:18:54.504556] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-23T22:18:54.504693] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-23T22:18:54.506117] [DEBUG] [LOCAL ] LAZ: Trimmed 65399 records to 44787 (keeping 200 days of data) [2025-10-23T22:18:54.774290] [DEBUG] [LOCAL ] LAZ: Primary data saved (44787 records). [2025-10-23T22:18:54.774440] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-23T22:18:54.774575] [INFO ] [MAIN ] Update Progress: 1239/2367 symbols completed. LAZ took 23.1s. Estimated remaining: 2h 24m 37s. Rate: 7.8 symbols/min [2025-10-23T22:18:54.841006] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T22:18:54.848687] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-23T22:18:56.396177] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T22:18:56.403808] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-23T22:18:58.093205] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T22:18:58.102718] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-23T22:18:59.649873] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T22:18:59.659031] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-23T22:19:01.616525] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T22:19:01.624445] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-23T22:19:03.102702] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T22:19:03.110109] [INFO ] [REMOTE ] LB: Full fetch complete (55688 records). [2025-10-23T22:19:03.110292] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-23T22:19:03.530576] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-23T22:19:03.530717] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-23T22:19:03.531713] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-23T22:19:03.531795] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-23T22:19:03.533053] [DEBUG] [LOCAL ] LB: Trimmed 55688 records to 37214 (keeping 200 days of data) [2025-10-23T22:19:03.778571] [DEBUG] [LOCAL ] LB: Primary data saved (37214 records). [2025-10-23T22:19:03.778801] [INFO ] [MAIN ] LB: Full history saved. [2025-10-23T22:19:03.778932] [INFO ] [MAIN ] Update Progress: 1240/2367 symbols completed. LB took 31.1s. Estimated remaining: 2h 24m 30s. Rate: 7.8 symbols/min [2025-10-23T22:19:04.441503] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:04.543102] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:04.578499] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:04.600332] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:04.601517] [DEBUG] [LOCAL ] LBRT: No existing data file found in primary storage. [2025-10-23T22:19:04.601593] [WARN ] [MAIN ] LBRT: No existing data found, performing full refresh instead. [2025-10-23T22:19:04.601733] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-23T22:19:04.602027] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-23T22:19:04.602248] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-23T22:19:04.602592] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-23T22:19:04.812687] [DEBUG] [LOCAL ] LCII: Loaded 26860 existing records from primary storage. [2025-10-23T22:19:04.871528] [INFO ] [MAIN ] LCII: Loaded 26860 existing records. [2025-10-23T22:19:04.965114] [DEBUG] [LOCAL ] LDI: Loaded 45123 existing records from primary storage. [2025-10-23T22:19:05.086278] [INFO ] [MAIN ] LDI: Loaded 45123 existing records. [2025-10-23T22:19:05.145428] [DEBUG] [LOCAL ] LC: Loaded 48255 existing records from primary storage. [2025-10-23T22:19:05.211453] [INFO ] [MAIN ] LC: Loaded 48255 existing records. [2025-10-23T22:19:05.409934] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:05.506945] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:05.533139] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-23T22:19:05.566478] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-23T22:19:05.566610] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-23T22:19:05.643258] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:05.654129] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-23T22:19:05.659461] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-23T22:19:05.654237] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-23T22:19:05.664919] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-23T22:19:05.751754] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-23T22:19:05.767850] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-23T22:19:05.754694] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:05.788626] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-23T22:19:05.817859] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-23T22:19:05.942742] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-23T22:19:05.964838] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-23T22:19:06.827356] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:06.887953] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-23T22:19:06.966077] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:06.992480] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:06.992797] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-23T22:19:06.993115] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-23T22:19:07.446683] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T22:19:07.457441] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-23T22:19:08.228055] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T22:19:08.233026] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-23T22:19:08.465895] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T22:19:08.472481] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-23T22:19:08.833577] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T22:19:08.844398] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-23T22:19:09.305941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T22:19:09.316878] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-23T22:19:09.472830] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T22:19:09.477965] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-23T22:19:09.808288] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T22:19:09.815469] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-23T22:19:10.086841] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T22:19:10.096353] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-23T22:19:10.850528] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T22:19:10.857324] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-23T22:19:11.173763] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T22:19:11.185057] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-23T22:19:11.847345] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T22:19:11.860915] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T22:19:11.873624] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-23T22:19:11.874961] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-23T22:19:12.435884] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T22:19:12.443974] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-23T22:19:13.034186] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T22:19:13.045360] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-23T22:19:13.183420] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T22:19:13.194277] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-23T22:19:13.267965] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:19:13.599407] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-23T22:19:13.743320] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T22:19:14.399420] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-23T22:19:14.522268] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T22:19:14.913186] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T22:19:15.086095] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T22:19:15.199409] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-23T22:19:15.693729] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T22:19:15.999430] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-23T22:19:16.792711] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T22:19:16.801913] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-23T22:19:17.599442] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-23T22:19:17.764167] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T22:19:18.406838] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-23T22:19:18.423006] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T22:19:18.980397] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T22:19:19.199474] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-23T22:19:19.999460] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-23T22:19:20.297446] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T22:19:20.799413] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-23T22:19:21.217825] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T22:19:21.312383] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T22:19:21.599430] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-23T22:19:22.399443] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-23T22:19:22.924410] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T22:19:23.050635] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-23T22:19:23.199440] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-23T22:19:23.999437] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-23T22:19:24.320293] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T22:19:24.799432] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-23T22:19:25.108743] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T22:19:25.162707] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T22:19:25.599411] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-23T22:19:25.921258] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T22:19:26.399471] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-23T22:19:27.199429] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-23T22:19:27.571192] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T22:19:27.581432] [INFO ] [REMOTE ] LBRT: Full fetch complete (76924 records). [2025-10-23T22:19:27.581630] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-23T22:19:27.993815] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-23T22:19:27.993932] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-23T22:19:27.995053] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-23T22:19:27.995134] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-23T22:19:27.996668] [DEBUG] [LOCAL ] LBRT: Trimmed 76924 records to 53393 (keeping 200 days of data) [2025-10-23T22:19:28.050364] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-23T22:19:28.240185] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T22:19:28.356855] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T22:19:28.376899] [INFO ] [REMOTE ] LCII: Full fetch complete (39038 records). [2025-10-23T22:19:28.384259] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-23T22:19:28.384052] [DEBUG] [LOCAL ] LBRT: Primary data saved (53393 records). [2025-10-23T22:19:28.384626] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-23T22:19:28.384842] [INFO ] [MAIN ] Update Progress: 1241/2367 symbols completed. LBRT took 24.6s. Estimated remaining: 2h 24m 38s. Rate: 7.8 symbols/min [2025-10-23T22:19:28.731459] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:28.801461] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-23T22:19:28.985105] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-23T22:19:28.985262] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-23T22:19:28.986480] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-23T22:19:28.986690] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-23T22:19:28.988326] [DEBUG] [LOCAL ] LCII: Trimmed 39038 records to 26970 (keeping 200 days of data) [2025-10-23T22:19:29.097384] [DEBUG] [LOCAL ] LDOS: Loaded 44631 existing records from primary storage. [2025-10-23T22:19:29.105902] [INFO ] [MAIN ] LDOS: Loaded 44631 existing records. [2025-10-23T22:19:29.351765] [DEBUG] [LOCAL ] LCII: Primary data saved (26970 records). [2025-10-23T22:19:29.373853] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:29.374013] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-23T22:19:29.374612] [INFO ] [MAIN ] Update Progress: 1242/2367 symbols completed. LCII took 25.6s. Estimated remaining: 2h 24m 24s. Rate: 7.8 symbols/min [2025-10-23T22:19:29.374686] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-23T22:19:29.374919] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-23T22:19:29.375319] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-23T22:19:29.380590] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-23T22:19:29.734703] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:29.962225] [DEBUG] [LOCAL ] LDP: Loaded 12503 existing records from primary storage. [2025-10-23T22:19:29.968602] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:29.969444] [INFO ] [MAIN ] LDP: Loaded 12503 existing records. [2025-10-23T22:19:29.969954] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-23T22:19:30.176621] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:30.177202] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-23T22:19:30.177407] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-23T22:19:30.177809] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-23T22:19:30.177889] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-23T22:19:30.561731] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:30.562859] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-23T22:19:30.598629] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-23T22:19:30.896864] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-23T22:19:30.905789] [INFO ] [REMOTE ] LC: Full fetch complete (70728 records). [2025-10-23T22:19:30.905935] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-23T22:19:31.204592] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-23T22:19:31.326401] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-23T22:19:31.326565] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-23T22:19:31.327805] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-23T22:19:31.327891] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-23T22:19:31.329738] [DEBUG] [LOCAL ] LC: Trimmed 70728 records to 48645 (keeping 200 days of data) [2025-10-23T22:19:31.610155] [DEBUG] [LOCAL ] LC: Primary data saved (48645 records). [2025-10-23T22:19:31.610319] [INFO ] [MAIN ] LC: Full history saved. [2025-10-23T22:19:31.611697] [INFO ] [MAIN ] Update Progress: 1243/2367 symbols completed. LC took 27.8s. Estimated remaining: 2h 24m 11s. Rate: 7.8 symbols/min [2025-10-23T22:19:31.727112] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T22:19:31.804853] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:31.834419] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T22:19:31.876004] [DEBUG] [LOCAL ] LEA: Loaded 41127 existing records from primary storage. [2025-10-23T22:19:31.876336] [INFO ] [MAIN ] LEA: Loaded 41127 existing records. [2025-10-23T22:19:32.011775] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-23T22:19:32.055210] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:32.055417] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-23T22:19:32.055495] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-23T22:19:32.055806] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-23T22:19:32.055881] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-23T22:19:32.402468] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:32.799464] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-23T22:19:33.249731] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T22:19:33.259054] [INFO ] [REMOTE ] LDI: Full fetch complete (62304 records). [2025-10-23T22:19:33.259239] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-23T22:19:33.611375] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-23T22:19:33.650890] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-23T22:19:33.651030] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-23T22:19:33.652196] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-23T22:19:33.652385] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-23T22:19:33.653796] [DEBUG] [LOCAL ] LDI: Trimmed 62304 records to 45498 (keeping 200 days of data) [2025-10-23T22:19:33.946104] [DEBUG] [LOCAL ] LDI: Primary data saved (45498 records). [2025-10-23T22:19:33.947405] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T22:19:33.947581] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-23T22:19:33.956933] [INFO ] [MAIN ] Update Progress: 1244/2367 symbols completed. LDI took 30.2s. Estimated remaining: 2h 23m 59s. Rate: 7.8 symbols/min [2025-10-23T22:19:34.131282] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:34.174051] [DEBUG] [LOCAL ] LEG: Loaded 49950 existing records from primary storage. [2025-10-23T22:19:34.174414] [INFO ] [MAIN ] LEG: Loaded 49950 existing records. [2025-10-23T22:19:34.361463] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:34.362178] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-23T22:19:34.362316] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-23T22:19:34.368079] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-23T22:19:34.369796] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-23T22:19:34.394757] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T22:19:34.413014] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-23T22:19:34.435226] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T22:19:34.758102] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:35.199452] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-23T22:19:35.999493] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-23T22:19:36.639429] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-23T22:19:36.754862] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T22:19:36.799418] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-23T22:19:36.908574] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T22:19:37.599476] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-23T22:19:38.399423] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-23T22:19:38.839780] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T22:19:39.199439] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-23T22:19:39.374242] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T22:19:39.999421] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-23T22:19:40.117277] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T22:19:40.799470] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-23T22:19:41.033151] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:19:41.244142] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T22:19:41.599460] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-23T22:19:42.399419] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-23T22:19:42.533833] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T22:19:42.795886] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T22:19:43.199491] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-23T22:19:43.999413] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-23T22:19:44.117859] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T22:19:44.546788] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T22:19:44.765427] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T22:19:44.799438] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-23T22:19:45.576964] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T22:19:45.599417] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-23T22:19:45.706234] [DEBUG] [REMOTE ] LDP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-23T22:19:45.706564] [WARN ] [REMOTE ] LDP: No data returned for month 2025-07 [2025-10-23T22:19:45.706679] [FATAL] [REMOTE ] LDP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:19:45.706787] [FATAL] [MAIN ] LDP: Failed to fetch primary data. [2025-10-23T22:19:45.706857] [WARN ] [MAIN ] LDP: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:19:45.706927] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-23T22:19:45.707021] [DEBUG] [LOCAL ] LDP: No primary data file found to delete. [2025-10-23T22:19:45.707093] [INFO ] [LOCAL ] LDP: Starting deletion of derivative data. [2025-10-23T22:19:45.707965] [DEBUG] [LOCAL ] LDP: Deleted derivative data file. [2025-10-23T22:19:45.708083] [INFO ] [MAIN ] Update Progress: 1245/2367 symbols completed. LDP took 16.3s. Estimated remaining: 2h 23m 55s. Rate: 7.8 symbols/min [2025-10-23T22:19:45.878506] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:45.933375] [DEBUG] [LOCAL ] LEN: Loaded 53196 existing records from primary storage. [2025-10-23T22:19:45.933839] [INFO ] [MAIN ] LEN: Loaded 53196 existing records. [2025-10-23T22:19:46.121308] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:46.121551] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-23T22:19:46.121676] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-23T22:19:46.121949] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-23T22:19:46.122037] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-23T22:19:46.404540] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-23T22:19:46.476816] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:47.199497] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-23T22:19:47.972991] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T22:19:47.999395] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-23T22:19:48.799469] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-23T22:19:49.099438] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T22:19:49.253707] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T22:19:49.599472] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-23T22:19:50.399469] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-23T22:19:50.786735] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-23T22:19:51.199449] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-23T22:19:51.305215] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T22:19:51.999568] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-23T22:19:52.214168] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T22:19:52.799458] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-23T22:19:52.995010] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T22:19:53.599417] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-23T22:19:53.957120] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T22:19:54.399454] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-23T22:19:54.519433] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T22:19:55.164140] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T22:19:55.199394] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-23T22:19:55.925690] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T22:19:55.999398] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-23T22:19:56.435212] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T22:19:56.684636] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T22:19:56.691941] [INFO ] [REMOTE ] LDOS: Full fetch complete (66858 records). [2025-10-23T22:19:56.692086] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-23T22:19:56.804126] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-23T22:19:57.134590] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-23T22:19:57.134751] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-23T22:19:57.135928] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-23T22:19:57.136017] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-23T22:19:57.137685] [DEBUG] [LOCAL ] LDOS: Trimmed 66858 records to 44903 (keeping 200 days of data) [2025-10-23T22:19:57.451299] [DEBUG] [LOCAL ] LDOS: Primary data saved (44903 records). [2025-10-23T22:19:57.451466] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-23T22:19:57.451584] [INFO ] [MAIN ] Update Progress: 1246/2367 symbols completed. LDOS took 29.1s. Estimated remaining: 2h 23m 51s. Rate: 7.8 symbols/min [2025-10-23T22:19:57.609746] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-23T22:19:57.638795] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:19:57.660563] [DEBUG] [LOCAL ] LEO: Loaded 16855 existing records from primary storage. [2025-10-23T22:19:57.660884] [INFO ] [MAIN ] LEO: Loaded 16855 existing records. [2025-10-23T22:19:57.853702] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:19:57.854131] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-23T22:19:57.854207] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-23T22:19:57.854437] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-23T22:19:57.854512] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-23T22:19:58.233623] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:19:58.259272] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-23T22:19:58.399430] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-23T22:19:59.093767] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T22:19:59.199449] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-23T22:19:59.472759] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T22:19:59.999435] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-23T22:20:00.799443] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-23T22:20:01.593790] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-23T22:20:01.605508] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-23T22:20:01.646688] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T22:20:01.897234] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T22:20:02.399463] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-23T22:20:03.199420] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-23T22:20:03.384685] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T22:20:03.800809] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T22:20:03.808383] [INFO ] [REMOTE ] LEA: Full fetch complete (60495 records). [2025-10-23T22:20:03.808591] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-23T22:20:04.001392] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-23T22:20:04.248046] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-23T22:20:04.248503] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T22:20:04.248755] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-23T22:20:04.250725] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-23T22:20:04.255847] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-23T22:20:04.257898] [DEBUG] [LOCAL ] LEA: Trimmed 60495 records to 41368 (keeping 200 days of data) [2025-10-23T22:20:04.545192] [DEBUG] [LOCAL ] LEA: Primary data saved (41368 records). [2025-10-23T22:20:04.545419] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-23T22:20:04.545536] [INFO ] [MAIN ] Update Progress: 1247/2367 symbols completed. LEA took 32.9s. Estimated remaining: 2h 23m 43s. Rate: 7.8 symbols/min [2025-10-23T22:20:04.726001] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:04.784277] [DEBUG] [LOCAL ] LEVI: Loaded 51827 existing records from primary storage. [2025-10-23T22:20:04.784870] [INFO ] [MAIN ] LEVI: Loaded 51827 existing records. [2025-10-23T22:20:04.807028] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-23T22:20:04.965176] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:04.965386] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-23T22:20:04.965466] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-23T22:20:04.965767] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-23T22:20:04.965852] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-23T22:20:05.337483] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:05.599420] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-23T22:20:05.897669] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T22:20:06.399427] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-23T22:20:06.794113] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T22:20:07.180825] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T22:20:07.199471] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-23T22:20:07.629230] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T22:20:07.999426] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-23T22:20:08.799429] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-23T22:20:08.890532] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T22:20:09.064344] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T22:20:09.599500] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-23T22:20:10.404598] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-23T22:20:10.425439] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T22:20:11.199421] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-23T22:20:11.610386] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T22:20:11.633714] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T22:20:11.999452] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-23T22:20:12.799453] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-23T22:20:12.862890] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T22:20:13.410112] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-23T22:20:13.599456] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-23T22:20:14.399522] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-23T22:20:14.932310] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-23T22:20:15.199407] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-23T22:20:15.312661] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T22:20:15.321150] [INFO ] [REMOTE ] LEG: Full fetch complete (72799 records). [2025-10-23T22:20:15.321363] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-23T22:20:15.434178] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T22:20:15.724523] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-23T22:20:15.724695] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-23T22:20:15.725855] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-23T22:20:15.725958] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-23T22:20:15.727414] [DEBUG] [LOCAL ] LEG: Trimmed 72799 records to 50311 (keeping 200 days of data) [2025-10-23T22:20:16.007241] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-23T22:20:16.026330] [DEBUG] [LOCAL ] LEG: Primary data saved (50311 records). [2025-10-23T22:20:16.026955] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-23T22:20:16.027077] [INFO ] [MAIN ] Update Progress: 1248/2367 symbols completed. LEG took 42.1s. Estimated remaining: 2h 23m 38s. Rate: 7.8 symbols/min [2025-10-23T22:20:16.190618] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:16.208302] [DEBUG] [LOCAL ] LFT: Loaded 18119 existing records from primary storage. [2025-10-23T22:20:16.208567] [INFO ] [MAIN ] LFT: Loaded 18119 existing records. [2025-10-23T22:20:16.383308] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:16.383526] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-23T22:20:16.383601] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-23T22:20:16.383826] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-23T22:20:16.383898] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-23T22:20:16.753982] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:16.799416] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-23T22:20:16.964746] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T22:20:17.257818] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T22:20:17.599482] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-23T22:20:17.797381] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T22:20:18.399473] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-23T22:20:19.199538] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-23T22:20:19.214749] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T22:20:19.999418] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-23T22:20:20.108045] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-23T22:20:20.117522] [INFO ] [REMOTE ] LEN: Full fetch complete (77220 records). [2025-10-23T22:20:20.117729] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-23T22:20:20.235568] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T22:20:20.282591] [INFO ] [REMOTE ] LEO: Full fetch complete (26389 records). [2025-10-23T22:20:20.312345] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-23T22:20:20.779568] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-23T22:20:20.807476] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-23T22:20:20.807690] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-23T22:20:20.808998] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-23T22:20:20.810046] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-23T22:20:20.884772] [DEBUG] [LOCAL ] LEN: Trimmed 77220 records to 53586 (keeping 200 days of data) [2025-10-23T22:20:20.922447] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-23T22:20:20.922749] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-23T22:20:20.923119] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-23T22:20:20.923200] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-23T22:20:20.924143] [DEBUG] [LOCAL ] LEO: Trimmed 26389 records to 16918 (keeping 200 days of data) [2025-10-23T22:20:21.130517] [DEBUG] [LOCAL ] LEO: Primary data saved (16918 records). [2025-10-23T22:20:21.137694] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-23T22:20:21.137841] [INFO ] [MAIN ] Update Progress: 1249/2367 symbols completed. LEO took 23.7s. Estimated remaining: 2h 23m 28s. Rate: 7.8 symbols/min [2025-10-23T22:20:21.455615] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:21.552184] [DEBUG] [LOCAL ] LGI: Loaded 9951 existing records from primary storage. [2025-10-23T22:20:21.557414] [INFO ] [MAIN ] LGI: Loaded 9951 existing records. [2025-10-23T22:20:21.743329] [DEBUG] [LOCAL ] LEN: Primary data saved (53586 records). [2025-10-23T22:20:21.762262] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-23T22:20:21.766297] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:21.774306] [INFO ] [MAIN ] Update Progress: 1250/2367 symbols completed. LEN took 36.1s. Estimated remaining: 2h 23m 14s. Rate: 7.8 symbols/min [2025-10-23T22:20:21.774754] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-23T22:20:21.797634] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T22:20:21.774888] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-23T22:20:21.835896] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-23T22:20:21.860873] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-23T22:20:21.866819] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-23T22:20:22.087118] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:22.367493] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:22.379922] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-23T22:20:22.391359] [DEBUG] [LOCAL ] LH: Loaded 37024 existing records from primary storage. [2025-10-23T22:20:22.392092] [INFO ] [MAIN ] LH: Loaded 37024 existing records. [2025-10-23T22:20:22.405181] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-23T22:20:22.570191] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:22.570423] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-23T22:20:22.570504] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-23T22:20:22.570767] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-23T22:20:22.570841] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-23T22:20:22.926456] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:23.134136] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T22:20:23.199391] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-23T22:20:23.999412] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-23T22:20:24.011842] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T22:20:24.292331] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T22:20:24.799430] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-23T22:20:25.606301] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-23T22:20:25.611271] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T22:20:25.634711] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T22:20:26.399456] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-23T22:20:27.199426] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-23T22:20:27.328405] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T22:20:27.932059] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T22:20:27.965123] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T22:20:27.999408] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-23T22:20:28.799443] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-23T22:20:28.889372] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T22:20:29.599438] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-23T22:20:30.399424] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-23T22:20:30.711879] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T22:20:31.199428] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-23T22:20:31.230577] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T22:20:31.258758] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T22:20:31.999421] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-23T22:20:32.799491] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-23T22:20:32.960771] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T22:20:33.599505] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-23T22:20:33.623517] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T22:20:33.859306] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T22:20:34.399412] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-23T22:20:35.152005] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T22:20:35.199403] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-23T22:20:35.385143] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T22:20:35.919995] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T22:20:35.999436] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-23T22:20:36.799443] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-23T22:20:36.936637] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-23T22:20:37.599523] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-23T22:20:38.233923] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T22:20:38.399463] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-23T22:20:39.199480] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-23T22:20:39.435411] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T22:20:39.445172] [INFO ] [REMOTE ] LEVI: Full fetch complete (74990 records). [2025-10-23T22:20:39.445358] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-23T22:20:39.856765] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-23T22:20:39.856914] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-23T22:20:39.858123] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-23T22:20:39.858331] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-23T22:20:39.859903] [DEBUG] [LOCAL ] LEVI: Trimmed 74990 records to 52204 (keeping 200 days of data) [2025-10-23T22:20:40.049550] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-23T22:20:40.115342] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T22:20:40.197349] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:20:40.248796] [DEBUG] [LOCAL ] LEVI: Primary data saved (52204 records). [2025-10-23T22:20:40.248965] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-23T22:20:40.250292] [INFO ] [MAIN ] Update Progress: 1251/2367 symbols completed. LEVI took 35.7s. Estimated remaining: 2h 23m 16s. Rate: 7.8 symbols/min [2025-10-23T22:20:40.421374] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:40.470781] [DEBUG] [LOCAL ] LHX: Loaded 48471 existing records from primary storage. [2025-10-23T22:20:40.471173] [INFO ] [MAIN ] LHX: Loaded 48471 existing records. [2025-10-23T22:20:40.648773] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:40.649026] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-23T22:20:40.649100] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-23T22:20:40.649342] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-23T22:20:40.649415] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-23T22:20:40.802900] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-23T22:20:40.926089] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T22:20:41.014379] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:41.599427] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-23T22:20:42.399456] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-23T22:20:42.453037] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T22:20:43.021904] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T22:20:43.083534] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-23T22:20:43.199461] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-23T22:20:43.999421] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-23T22:20:44.296133] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T22:20:44.799467] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-23T22:20:45.573022] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T22:20:45.575531] [INFO ] [REMOTE ] LGI: Full fetch complete (14436 records). [2025-10-23T22:20:45.575709] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-23T22:20:45.604623] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-23T22:20:46.044324] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-23T22:20:46.044496] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-23T22:20:46.044984] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-23T22:20:46.045295] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-23T22:20:46.046863] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-23T22:20:46.058226] [DEBUG] [LOCAL ] LGI: Trimmed 14436 records to 10003 (keeping 200 days of data) [2025-10-23T22:20:46.117525] [DEBUG] [LOCAL ] LGI: Primary data saved (10003 records). [2025-10-23T22:20:46.117717] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-23T22:20:46.117832] [INFO ] [MAIN ] Update Progress: 1252/2367 symbols completed. LGI took 25.0s. Estimated remaining: 2h 23m 7s. Rate: 7.8 symbols/min [2025-10-23T22:20:46.283042] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:46.310912] [DEBUG] [LOCAL ] LII: Loaded 27810 existing records from primary storage. [2025-10-23T22:20:46.311235] [INFO ] [MAIN ] LII: Loaded 27810 existing records. [2025-10-23T22:20:46.409337] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-23T22:20:46.503744] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:46.503979] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-23T22:20:46.504058] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-23T22:20:46.504274] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-23T22:20:46.504348] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-23T22:20:46.797627] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T22:20:46.901711] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:47.199464] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-23T22:20:47.916105] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T22:20:47.999439] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-23T22:20:48.089887] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T22:20:48.094144] [INFO ] [REMOTE ] LFT: Full fetch complete (23771 records). [2025-10-23T22:20:48.094291] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-23T22:20:48.454501] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-23T22:20:48.454617] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-23T22:20:48.455172] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-23T22:20:48.455247] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-23T22:20:48.455962] [DEBUG] [LOCAL ] LFT: Trimmed 23771 records to 18234 (keeping 200 days of data) [2025-10-23T22:20:48.558560] [DEBUG] [LOCAL ] LFT: Primary data saved (18234 records). [2025-10-23T22:20:48.558746] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-23T22:20:48.558860] [INFO ] [MAIN ] Update Progress: 1253/2367 symbols completed. LFT took 32.5s. Estimated remaining: 2h 22m 54s. Rate: 7.8 symbols/min [2025-10-23T22:20:48.729456] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:48.770362] [DEBUG] [LOCAL ] LION: Loaded 46933 existing records from primary storage. [2025-10-23T22:20:48.770789] [INFO ] [MAIN ] LION: Loaded 46933 existing records. [2025-10-23T22:20:48.804760] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-23T22:20:48.955868] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:20:48.956128] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-23T22:20:48.956204] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-23T22:20:48.956467] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-23T22:20:48.956544] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-23T22:20:49.340247] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:49.603002] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-23T22:20:49.607581] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T22:20:49.872389] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T22:20:50.399428] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-23T22:20:50.723906] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T22:20:51.199458] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-23T22:20:51.953274] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:20:51.960205] [INFO ] [REMOTE ] LH: Full fetch complete (54792 records). [2025-10-23T22:20:51.960364] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-23T22:20:52.006868] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-23T22:20:52.372166] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-23T22:20:52.372343] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-23T22:20:52.373280] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-23T22:20:52.373459] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-23T22:20:52.401571] [DEBUG] [LOCAL ] LH: Trimmed 54792 records to 37267 (keeping 200 days of data) [2025-10-23T22:20:52.403405] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T22:20:52.654237] [DEBUG] [LOCAL ] LH: Primary data saved (37267 records). [2025-10-23T22:20:52.654414] [INFO ] [MAIN ] LH: Full history saved. [2025-10-23T22:20:52.654549] [INFO ] [MAIN ] Update Progress: 1254/2367 symbols completed. LH took 30.9s. Estimated remaining: 2h 22m 44s. Rate: 7.8 symbols/min [2025-10-23T22:20:52.807130] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-23T22:20:52.830607] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:20:52.830940] [DEBUG] [LOCAL ] LITB: No existing data file found in primary storage. [2025-10-23T22:20:52.831043] [WARN ] [MAIN ] LITB: No existing data found, performing full refresh instead. [2025-10-23T22:20:52.831166] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-23T22:20:52.831238] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-23T22:20:52.831322] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-10-23T22:20:52.831397] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-23T22:20:53.201522] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:20:53.215025] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T22:20:53.599447] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-23T22:20:54.349496] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T22:20:54.399430] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-23T22:20:54.900430] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-23T22:20:55.199493] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-23T22:20:55.696605] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-23T22:20:55.999433] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-23T22:20:56.620763] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T22:20:56.799440] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-23T22:20:57.599449] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-23T22:20:57.834390] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T22:20:57.976835] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T22:20:58.147228] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-23T22:20:58.399414] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-23T22:20:59.199461] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-23T22:20:59.834597] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T22:20:59.999435] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-23T22:21:00.799494] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-23T22:21:01.339580] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-23T22:21:01.376731] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T22:21:01.599444] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-23T22:21:02.276372] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T22:21:02.399462] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-23T22:21:03.199437] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-23T22:21:03.316176] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T22:21:03.745833] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T22:21:03.999423] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-23T22:21:04.799452] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-23T22:21:05.599451] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-23T22:21:06.587401] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T22:21:06.597465] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-23T22:21:06.798246] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T22:21:07.199438] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-23T22:21:08.392995] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (4.39 seconds). [2025-10-23T22:21:08.394913] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-23T22:21:08.442186] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:21:08.517639] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (5.32 seconds). [2025-10-23T22:21:08.657476] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T22:21:08.799446] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-23T22:21:09.185411] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T22:21:09.599455] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-23T22:21:10.399445] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-23T22:21:10.804370] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-23T22:21:10.941616] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-23T22:21:11.199453] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-23T22:21:11.898891] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T22:21:11.906792] [INFO ] [REMOTE ] LHX: Full fetch complete (70742 records). [2025-10-23T22:21:11.906939] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-23T22:21:12.004543] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-23T22:21:12.360838] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T22:21:12.394229] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-23T22:21:12.394462] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-23T22:21:12.395774] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-23T22:21:12.396240] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-23T22:21:12.397700] [DEBUG] [LOCAL ] LHX: Trimmed 70742 records to 48769 (keeping 200 days of data) [2025-10-23T22:21:12.634180] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T22:21:12.709093] [DEBUG] [LOCAL ] LHX: Primary data saved (48769 records). [2025-10-23T22:21:12.709268] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-23T22:21:12.711060] [INFO ] [MAIN ] Update Progress: 1255/2367 symbols completed. LHX took 32.5s. Estimated remaining: 2h 22m 47s. Rate: 7.8 symbols/min [2025-10-23T22:21:12.807584] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-23T22:21:12.880934] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:12.934099] [DEBUG] [LOCAL ] LLY: Loaded 53191 existing records from primary storage. [2025-10-23T22:21:12.934431] [INFO ] [MAIN ] LLY: Loaded 53191 existing records. [2025-10-23T22:21:13.113086] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:13.113311] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-23T22:21:13.113416] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-23T22:21:13.114049] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-23T22:21:13.114123] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-23T22:21:13.470483] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:13.505098] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-23T22:21:13.599411] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-23T22:21:14.399442] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-23T22:21:15.199443] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-23T22:21:15.944433] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T22:21:15.950308] [INFO ] [REMOTE ] LII: Full fetch complete (41890 records). [2025-10-23T22:21:15.950482] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-23T22:21:16.000092] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-23T22:21:16.352411] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-23T22:21:16.352888] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-23T22:21:16.353758] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-23T22:21:16.353868] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-23T22:21:16.355156] [DEBUG] [LOCAL ] LII: Trimmed 41890 records to 28039 (keeping 200 days of data) [2025-10-23T22:21:16.474765] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-23T22:21:16.578298] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-23T22:21:16.605053] [DEBUG] [LOCAL ] LII: Primary data saved (28039 records). [2025-10-23T22:21:16.607082] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-23T22:21:16.607211] [INFO ] [MAIN ] LII: Full history saved. [2025-10-23T22:21:16.607455] [INFO ] [MAIN ] Update Progress: 1256/2367 symbols completed. LII took 30.5s. Estimated remaining: 2h 22m 36s. Rate: 7.8 symbols/min [2025-10-23T22:21:16.785988] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:16.814105] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-23T22:21:16.840798] [DEBUG] [LOCAL ] LMND: Loaded 52122 existing records from primary storage. [2025-10-23T22:21:16.841207] [INFO ] [MAIN ] LMND: Loaded 52122 existing records. [2025-10-23T22:21:17.015152] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:17.015363] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-23T22:21:17.015436] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-23T22:21:17.015712] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-23T22:21:17.015786] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-23T22:21:17.332471] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-23T22:21:17.391870] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:17.599442] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-23T22:21:17.980931] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-23T22:21:18.399445] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-23T22:21:19.199451] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-23T22:21:19.999427] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-23T22:21:20.594452] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-23T22:21:20.799443] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-23T22:21:20.851370] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T22:21:20.860171] [INFO ] [REMOTE ] LION: Full fetch complete (58150 records). [2025-10-23T22:21:20.860319] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-23T22:21:21.242581] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-23T22:21:21.242712] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-23T22:21:21.243600] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-23T22:21:21.243702] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-23T22:21:21.244989] [DEBUG] [LOCAL ] LION: Trimmed 58150 records to 47284 (keeping 200 days of data) [2025-10-23T22:21:21.506220] [DEBUG] [LOCAL ] LION: Primary data saved (47284 records). [2025-10-23T22:21:21.506391] [INFO ] [MAIN ] LION: Full history saved. [2025-10-23T22:21:21.506509] [INFO ] [MAIN ] Update Progress: 1257/2367 symbols completed. LION took 32.9s. Estimated remaining: 2h 22m 26s. Rate: 7.8 symbols/min [2025-10-23T22:21:21.607799] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-23T22:21:21.693318] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:21.748791] [DEBUG] [LOCAL ] LMT: Loaded 49623 existing records from primary storage. [2025-10-23T22:21:21.749284] [INFO ] [MAIN ] LMT: Loaded 49623 existing records. [2025-10-23T22:21:21.952598] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:21.952951] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-23T22:21:21.953028] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-23T22:21:21.953518] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-23T22:21:21.953591] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-23T22:21:22.317000] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:22.323229] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T22:21:22.399397] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-23T22:21:22.562535] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-23T22:21:22.794319] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T22:21:23.199448] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-23T22:21:23.999434] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-23T22:21:24.805531] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-23T22:21:24.820122] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-23T22:21:25.329388] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-23T22:21:25.449927] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T22:21:25.451301] [INFO ] [REMOTE ] LITB: Full fetch complete (5800 records). [2025-10-23T22:21:25.451388] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-23T22:21:25.605967] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-23T22:21:25.811388] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-23T22:21:25.811512] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-23T22:21:25.811746] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-23T22:21:25.811824] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-23T22:21:25.812284] [DEBUG] [LOCAL ] LITB: Trimmed 5800 records to 3886 (keeping 200 days of data) [2025-10-23T22:21:25.833950] [DEBUG] [LOCAL ] LITB: Primary data saved (3886 records). [2025-10-23T22:21:25.834123] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-23T22:21:25.834230] [INFO ] [MAIN ] Update Progress: 1258/2367 symbols completed. LITB took 33.2s. Estimated remaining: 2h 22m 15s. Rate: 7.8 symbols/min [2025-10-23T22:21:26.013954] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:26.061116] [DEBUG] [LOCAL ] LNC: Loaded 51466 existing records from primary storage. [2025-10-23T22:21:26.061457] [INFO ] [MAIN ] LNC: Loaded 51466 existing records. [2025-10-23T22:21:26.251947] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:26.252271] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-23T22:21:26.252431] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-23T22:21:26.252819] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-23T22:21:26.252911] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-23T22:21:26.402618] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-23T22:21:26.656767] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-23T22:21:26.689623] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:27.199437] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-23T22:21:27.605739] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T22:21:27.999429] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-23T22:21:28.569416] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-23T22:21:28.799421] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-23T22:21:29.599453] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-23T22:21:30.150812] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-23T22:21:30.289555] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-10-23T22:21:30.399408] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-23T22:21:30.942598] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T22:21:31.058837] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-23T22:21:31.199437] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-23T22:21:31.999442] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-23T22:21:32.799460] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-23T22:21:32.954818] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-23T22:21:33.044436] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T22:21:33.599443] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-23T22:21:34.213170] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-23T22:21:34.399424] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-23T22:21:34.520442] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T22:21:35.199433] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-23T22:21:35.683822] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T22:21:35.999459] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-23T22:21:36.507819] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-23T22:21:36.799450] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-23T22:21:37.600327] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-23T22:21:37.600531] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-23T22:21:38.187323] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-23T22:21:38.399462] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-23T22:21:39.131402] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T22:21:39.199409] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-23T22:21:39.426671] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-23T22:21:39.999438] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-23T22:21:40.799567] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-23T22:21:41.107887] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T22:21:41.248353] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-23T22:21:41.599436] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-23T22:21:42.399549] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-23T22:21:42.477090] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-23T22:21:42.966304] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-23T22:21:43.199429] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-23T22:21:43.391734] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T22:21:43.999427] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-23T22:21:44.799427] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-23T22:21:45.155362] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-23T22:21:45.335623] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-23T22:21:45.599450] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-23T22:21:45.962936] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T22:21:46.399416] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-23T22:21:46.447285] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T22:21:46.878394] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-23T22:21:46.887433] [INFO ] [REMOTE ] LMND: Full fetch complete (75476 records). [2025-10-23T22:21:46.887581] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-23T22:21:47.204587] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-23T22:21:47.276567] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-23T22:21:47.276707] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-23T22:21:47.277793] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-23T22:21:47.277873] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-23T22:21:47.279415] [DEBUG] [LOCAL ] LMND: Trimmed 75476 records to 52502 (keeping 200 days of data) [2025-10-23T22:21:47.576790] [DEBUG] [LOCAL ] LMND: Primary data saved (52502 records). [2025-10-23T22:21:47.576958] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-23T22:21:47.577090] [INFO ] [MAIN ] Update Progress: 1259/2367 symbols completed. LMND took 31.0s. Estimated remaining: 2h 22m 20s. Rate: 7.8 symbols/min [2025-10-23T22:21:47.746661] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:47.753682] [DEBUG] [LOCAL ] LND: Loaded 4960 existing records from primary storage. [2025-10-23T22:21:47.753898] [INFO ] [MAIN ] LND: Loaded 4960 existing records. [2025-10-23T22:21:47.934734] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:47.934984] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-23T22:21:47.935085] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-23T22:21:47.935299] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-23T22:21:47.935376] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-23T22:21:48.008797] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-23T22:21:48.287800] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:48.799439] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-23T22:21:49.108424] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-23T22:21:49.110554] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T22:21:49.189400] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T22:21:49.200423] [INFO ] [REMOTE ] LMT: Full fetch complete (72560 records). [2025-10-23T22:21:49.200621] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-23T22:21:49.329130] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T22:21:49.609164] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-23T22:21:49.605370] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-23T22:21:49.609383] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-23T22:21:49.610550] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-23T22:21:49.611412] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-23T22:21:49.613010] [DEBUG] [LOCAL ] LMT: Trimmed 72560 records to 49977 (keeping 200 days of data) [2025-10-23T22:21:49.927329] [DEBUG] [LOCAL ] LMT: Primary data saved (49977 records). [2025-10-23T22:21:49.927507] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-23T22:21:49.927624] [INFO ] [MAIN ] Update Progress: 1260/2367 symbols completed. LMT took 28.4s. Estimated remaining: 2h 22m 7s. Rate: 7.8 symbols/min [2025-10-23T22:21:50.097140] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:50.144928] [DEBUG] [LOCAL ] LNG: Loaded 51063 existing records from primary storage. [2025-10-23T22:21:50.145322] [INFO ] [MAIN ] LNG: Loaded 51063 existing records. [2025-10-23T22:21:50.355620] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:50.355969] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-23T22:21:50.356191] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-23T22:21:50.356489] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-23T22:21:50.356608] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-23T22:21:50.400307] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-23T22:21:50.665892] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-23T22:21:50.698935] [INFO ] [REMOTE ] LLY: Full fetch complete (77204 records). [2025-10-23T22:21:50.735293] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-23T22:21:50.783253] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:51.219628] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-23T22:21:51.222002] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-23T22:21:51.222807] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T22:21:51.222887] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-23T22:21:51.226504] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-23T22:21:51.226599] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-23T22:21:51.228287] [DEBUG] [LOCAL ] LLY: Trimmed 77204 records to 53575 (keeping 200 days of data) [2025-10-23T22:21:51.577465] [DEBUG] [LOCAL ] LLY: Primary data saved (53575 records). [2025-10-23T22:21:51.577626] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-23T22:21:51.579305] [INFO ] [MAIN ] Update Progress: 1261/2367 symbols completed. LLY took 38.9s. Estimated remaining: 2h 21m 54s. Rate: 7.8 symbols/min [2025-10-23T22:21:51.747873] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:21:51.762333] [DEBUG] [LOCAL ] LNN: Loaded 11504 existing records from primary storage. [2025-10-23T22:21:51.762576] [INFO ] [MAIN ] LNN: Loaded 11504 existing records. [2025-10-23T22:21:51.935212] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:21:51.935431] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-23T22:21:51.935504] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-23T22:21:51.935733] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-23T22:21:51.935804] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-23T22:21:52.008678] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-23T22:21:52.282943] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:21:52.799430] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-23T22:21:52.820820] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-23T22:21:53.599413] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-23T22:21:53.682100] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T22:21:54.227526] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-10-23T22:21:54.399450] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-23T22:21:55.049161] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-23T22:21:55.199460] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-23T22:21:55.529983] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T22:21:55.812753] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T22:21:55.999429] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-23T22:21:56.663888] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T22:21:56.799492] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-23T22:21:57.599491] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-23T22:21:58.399406] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-23T22:21:58.436231] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T22:21:58.549321] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T22:21:59.027349] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T22:21:59.199503] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-23T22:21:59.999464] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-23T22:22:00.799416] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-23T22:22:01.270688] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-23T22:22:01.599464] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-23T22:22:01.640076] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T22:22:01.810399] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T22:22:01.819173] [INFO ] [REMOTE ] LNC: Full fetch complete (74578 records). [2025-10-23T22:22:01.819320] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-23T22:22:02.221049] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-23T22:22:02.221275] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T22:22:02.221534] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-23T22:22:02.224806] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-23T22:22:02.225238] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-23T22:22:02.226593] [DEBUG] [LOCAL ] LNC: Trimmed 74578 records to 51801 (keeping 200 days of data) [2025-10-23T22:22:02.400262] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-23T22:22:02.542672] [DEBUG] [LOCAL ] LNC: Primary data saved (51801 records). [2025-10-23T22:22:02.542843] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-23T22:22:02.542969] [INFO ] [MAIN ] Update Progress: 1262/2367 symbols completed. LNC took 36.7s. Estimated remaining: 2h 21m 49s. Rate: 7.8 symbols/min [2025-10-23T22:22:02.712018] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:02.749298] [DEBUG] [LOCAL ] LOAR: Loaded 42026 existing records from primary storage. [2025-10-23T22:22:02.749613] [INFO ] [MAIN ] LOAR: Loaded 42026 existing records. [2025-10-23T22:22:02.925078] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:02.925288] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-23T22:22:02.925360] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-23T22:22:02.925568] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-23T22:22:02.925639] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-23T22:22:03.202629] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-23T22:22:03.281374] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:03.297536] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-23T22:22:03.999440] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-23T22:22:04.785956] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:22:04.799399] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-23T22:22:05.357886] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-23T22:22:05.427902] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-23T22:22:05.599462] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-23T22:22:06.399492] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-23T22:22:07.054262] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:22:07.055756] [INFO ] [REMOTE ] LND: Full fetch complete (7789 records). [2025-10-23T22:22:07.055850] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-23T22:22:07.204614] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-23T22:22:07.434087] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-23T22:22:07.434296] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-23T22:22:07.434633] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-23T22:22:07.434804] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-23T22:22:07.435236] [DEBUG] [LOCAL ] LND: Trimmed 7789 records to 4995 (keeping 200 days of data) [2025-10-23T22:22:07.462871] [DEBUG] [LOCAL ] LND: Primary data saved (4995 records). [2025-10-23T22:22:07.463178] [INFO ] [MAIN ] LND: Full history saved. [2025-10-23T22:22:07.463294] [INFO ] [MAIN ] Update Progress: 1263/2367 symbols completed. LND took 19.9s. Estimated remaining: 2h 21m 39s. Rate: 7.8 symbols/min [2025-10-23T22:22:07.634792] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:07.666270] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T22:22:07.696888] [DEBUG] [LOCAL ] LOB: Loaded 26644 existing records from primary storage. [2025-10-23T22:22:07.697198] [INFO ] [MAIN ] LOB: Loaded 26644 existing records. [2025-10-23T22:22:07.879062] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:07.879293] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-23T22:22:07.879373] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-23T22:22:07.879595] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-23T22:22:07.879703] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-23T22:22:08.004579] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-23T22:22:08.241767] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:08.253602] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:22:08.799457] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-23T22:22:09.346030] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T22:22:09.599428] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-23T22:22:09.900734] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T22:22:10.399442] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-23T22:22:10.841273] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T22:22:11.199416] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-23T22:22:11.365026] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T22:22:11.999441] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-23T22:22:12.331355] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:22:12.795816] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T22:22:12.799384] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-23T22:22:13.599417] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-23T22:22:13.776127] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-23T22:22:14.399475] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-23T22:22:14.739723] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T22:22:15.199453] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-23T22:22:16.000065] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-23T22:22:16.009755] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T22:22:16.593243] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T22:22:16.799479] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-23T22:22:16.942431] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T22:22:16.945323] [INFO ] [REMOTE ] LNN: Full fetch complete (16290 records). [2025-10-23T22:22:16.945412] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-23T22:22:17.305051] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-23T22:22:17.305203] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-23T22:22:17.305607] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-23T22:22:17.305702] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-23T22:22:17.306224] [DEBUG] [LOCAL ] LNN: Trimmed 16290 records to 11727 (keeping 200 days of data) [2025-10-23T22:22:17.382370] [DEBUG] [LOCAL ] LNN: Primary data saved (11727 records). [2025-10-23T22:22:17.382553] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-23T22:22:17.382690] [INFO ] [MAIN ] Update Progress: 1264/2367 symbols completed. LNN took 25.8s. Estimated remaining: 2h 21m 33s. Rate: 7.8 symbols/min [2025-10-23T22:22:17.548599] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:17.553540] [DEBUG] [LOCAL ] LOCL: Loaded 3504 existing records from primary storage. [2025-10-23T22:22:17.553756] [INFO ] [MAIN ] LOCL: Loaded 3504 existing records. [2025-10-23T22:22:17.607210] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-23T22:22:17.733003] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:17.733249] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-23T22:22:17.733327] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-23T22:22:17.733506] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-23T22:22:17.733579] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-23T22:22:18.121165] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:18.399420] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-23T22:22:18.465135] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T22:22:18.622055] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T22:22:18.843661] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-23T22:22:19.199525] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-23T22:22:19.999439] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-23T22:22:20.799431] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-23T22:22:21.089880] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T22:22:21.527126] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T22:22:21.599408] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-23T22:22:21.975699] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T22:22:22.399445] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-23T22:22:22.775577] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-23T22:22:23.199435] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-23T22:22:23.584551] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-23T22:22:23.999431] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-23T22:22:24.286040] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T22:22:24.799442] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-23T22:22:25.608017] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-23T22:22:25.614501] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T22:22:26.396213] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T22:22:26.401011] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-23T22:22:26.869158] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T22:22:26.915853] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-23T22:22:27.199421] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-23T22:22:27.999446] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-23T22:22:28.473410] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T22:22:28.799440] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-23T22:22:29.599482] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-23T22:22:29.764513] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:22:29.947737] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T22:22:30.399437] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-23T22:22:30.777471] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-23T22:22:31.199372] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-23T22:22:31.230159] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T22:22:31.999448] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-23T22:22:32.699755] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T22:22:32.706421] [INFO ] [REMOTE ] LOAR: Full fetch complete (56057 records). [2025-10-23T22:22:32.706554] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-23T22:22:32.804552] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-23T22:22:33.086598] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-23T22:22:33.086749] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-23T22:22:33.087686] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-23T22:22:33.087767] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-23T22:22:33.089058] [DEBUG] [LOCAL ] LOAR: Trimmed 56057 records to 42355 (keeping 200 days of data) [2025-10-23T22:22:33.326270] [DEBUG] [LOCAL ] LOAR: Primary data saved (42355 records). [2025-10-23T22:22:33.326424] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-23T22:22:33.326538] [INFO ] [MAIN ] Update Progress: 1265/2367 symbols completed. LOAR took 30.8s. Estimated remaining: 2h 21m 33s. Rate: 7.8 symbols/min [2025-10-23T22:22:33.491959] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:33.523697] [DEBUG] [LOCAL ] LOMA: Loaded 32716 existing records from primary storage. [2025-10-23T22:22:33.523996] [INFO ] [MAIN ] LOMA: Loaded 32716 existing records. [2025-10-23T22:22:33.601325] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-23T22:22:33.709742] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:33.710138] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-23T22:22:33.710317] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-23T22:22:33.710794] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-23T22:22:33.710868] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-23T22:22:34.029772] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-23T22:22:34.044276] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T22:22:34.140596] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:34.141376] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-23T22:22:34.399396] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-23T22:22:35.204498] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-23T22:22:35.213154] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:22:35.218282] [INFO ] [REMOTE ] LOB: Full fetch complete (38711 records). [2025-10-23T22:22:35.218413] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-23T22:22:35.587960] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-23T22:22:35.588084] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-23T22:22:35.589004] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-23T22:22:35.589093] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-23T22:22:35.590109] [DEBUG] [LOCAL ] LOB: Trimmed 38711 records to 26868 (keeping 200 days of data) [2025-10-23T22:22:35.697670] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T22:22:35.760220] [DEBUG] [LOCAL ] LOB: Primary data saved (26868 records). [2025-10-23T22:22:35.760438] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-23T22:22:35.760586] [INFO ] [MAIN ] Update Progress: 1266/2367 symbols completed. LOB took 28.3s. Estimated remaining: 2h 21m 21s. Rate: 7.8 symbols/min [2025-10-23T22:22:35.933423] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:35.981904] [DEBUG] [LOCAL ] LOW: Loaded 52970 existing records from primary storage. [2025-10-23T22:22:35.982307] [INFO ] [MAIN ] LOW: Loaded 52970 existing records. [2025-10-23T22:22:36.004576] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-23T22:22:36.163205] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:36.163414] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-23T22:22:36.163513] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-23T22:22:36.163825] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-23T22:22:36.163910] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-23T22:22:36.515049] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:36.799439] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-23T22:22:37.540250] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T22:22:37.599419] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-23T22:22:38.399411] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-23T22:22:38.757778] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-23T22:22:38.759861] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T22:22:38.827730] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T22:22:39.199437] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-23T22:22:39.999499] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-23T22:22:40.799413] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-23T22:22:40.920378] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T22:22:41.276964] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-23T22:22:41.447530] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T22:22:41.456306] [INFO ] [REMOTE ] LNG: Full fetch complete (74686 records). [2025-10-23T22:22:41.456461] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-23T22:22:41.604778] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-23T22:22:41.865693] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-23T22:22:41.865815] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-23T22:22:41.866962] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-23T22:22:41.867046] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-23T22:22:41.868573] [DEBUG] [LOCAL ] LNG: Trimmed 74686 records to 51448 (keeping 200 days of data) [2025-10-23T22:22:42.195684] [DEBUG] [LOCAL ] LNG: Primary data saved (51448 records). [2025-10-23T22:22:42.195890] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-23T22:22:42.196012] [INFO ] [MAIN ] Update Progress: 1267/2367 symbols completed. LNG took 52.3s. Estimated remaining: 2h 21m 12s. Rate: 7.8 symbols/min [2025-10-23T22:22:42.364357] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:42.400075] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-23T22:22:42.400895] [DEBUG] [LOCAL ] LPG: Loaded 39248 existing records from primary storage. [2025-10-23T22:22:42.401872] [INFO ] [MAIN ] LPG: Loaded 39248 existing records. [2025-10-23T22:22:42.584961] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:42.585155] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-23T22:22:42.585260] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-23T22:22:42.585539] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-23T22:22:42.585622] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-23T22:22:42.937205] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:43.110762] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T22:22:43.199391] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-23T22:22:43.468838] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T22:22:43.999457] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-23T22:22:44.799476] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-23T22:22:44.869742] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T22:22:45.351339] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-23T22:22:45.352820] [INFO ] [REMOTE ] LOCL: Full fetch complete (4543 records). [2025-10-23T22:22:45.352971] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-23T22:22:45.604518] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-23T22:22:45.903958] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-23T22:22:45.904411] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-23T22:22:45.905175] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-23T22:22:45.905551] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-23T22:22:45.906537] [DEBUG] [LOCAL ] LOCL: Trimmed 4543 records to 3523 (keeping 200 days of data) [2025-10-23T22:22:45.980917] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T22:22:46.004896] [DEBUG] [LOCAL ] LOCL: Primary data saved (3523 records). [2025-10-23T22:22:46.005298] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-23T22:22:46.005453] [INFO ] [MAIN ] Update Progress: 1268/2367 symbols completed. LOCL took 28.6s. Estimated remaining: 2h 21m 1s. Rate: 7.8 symbols/min [2025-10-23T22:22:46.258746] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:22:46.298686] [DEBUG] [LOCAL ] LPL: Loaded 28986 existing records from primary storage. [2025-10-23T22:22:46.299122] [INFO ] [MAIN ] LPL: Loaded 28986 existing records. [2025-10-23T22:22:46.404603] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-23T22:22:46.563098] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:22:46.563419] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-23T22:22:46.563497] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-23T22:22:46.563742] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-23T22:22:46.563819] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-23T22:22:47.004573] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:22:47.024090] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T22:22:47.199469] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-23T22:22:47.933355] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T22:22:47.999449] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-23T22:22:48.246844] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T22:22:48.799438] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-23T22:22:49.577529] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T22:22:49.599461] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-23T22:22:49.928439] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T22:22:50.399449] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-23T22:22:50.891286] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T22:22:51.072575] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T22:22:51.199447] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-23T22:22:51.999419] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-23T22:22:52.397153] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T22:22:52.799458] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-23T22:22:53.599472] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-23T22:22:53.750392] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T22:22:53.807833] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-23T22:22:54.399435] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-23T22:22:55.199429] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-23T22:22:55.446825] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:22:55.999425] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-23T22:22:56.388950] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-23T22:22:56.799417] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-23T22:22:56.940455] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T22:22:57.241083] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T22:22:57.599437] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-23T22:22:58.023812] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T22:22:58.399428] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-23T22:22:59.199447] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-23T22:22:59.576778] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-23T22:22:59.999490] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-23T22:23:00.799522] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-23T22:23:05.234320] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (6.03 seconds). [2025-10-23T22:23:05.241663] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-23T22:23:05.345134] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (6.95 seconds). [2025-10-23T22:23:05.353559] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-23T22:23:05.490536] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (5.49 seconds). [2025-10-23T22:23:05.498697] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-23T22:23:06.204128] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (5.40 seconds). [2025-10-23T22:23:06.215784] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-23T22:23:06.537979] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T22:23:06.544158] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-23T22:23:07.053257] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T22:23:07.062050] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-23T22:23:07.107903] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T22:23:07.120002] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-23T22:23:07.883204] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T22:23:07.890164] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-23T22:23:08.237959] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-23T22:23:08.250081] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-23T22:23:08.276308] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T22:23:08.422823] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T22:23:08.430237] [INFO ] [REMOTE ] LPL: Full fetch complete (37668 records). [2025-10-23T22:23:08.430363] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-23T22:23:08.801093] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-23T22:23:08.819766] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-23T22:23:08.819945] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-23T22:23:08.821173] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-23T22:23:08.821369] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-23T22:23:08.823101] [DEBUG] [LOCAL ] LPL: Trimmed 37668 records to 29271 (keeping 200 days of data) [2025-10-23T22:23:08.935769] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T22:23:08.948857] [INFO ] [REMOTE ] LOW: Full fetch complete (76714 records). [2025-10-23T22:23:08.953403] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-23T22:23:09.311990] [DEBUG] [LOCAL ] LPL: Primary data saved (29271 records). [2025-10-23T22:23:09.312259] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-23T22:23:09.328523] [INFO ] [MAIN ] Update Progress: 1269/2367 symbols completed. LPL took 23.3s. Estimated remaining: 2h 21m 7s. Rate: 7.8 symbols/min [2025-10-23T22:23:09.510475] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-23T22:23:09.527469] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-23T22:23:09.529193] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-23T22:23:09.529308] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-23T22:23:09.623480] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:09.626428] [DEBUG] [LOCAL ] LOW: Trimmed 76714 records to 53351 (keeping 200 days of data) [2025-10-23T22:23:09.625459] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T22:23:09.635357] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-23T22:23:09.798221] [DEBUG] [LOCAL ] LPX: Loaded 40055 existing records from primary storage. [2025-10-23T22:23:09.804164] [INFO ] [MAIN ] LPX: Loaded 40055 existing records. [2025-10-23T22:23:10.094604] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:10.105013] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-23T22:23:10.109443] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-23T22:23:10.113947] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-23T22:23:10.114324] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-23T22:23:10.306965] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T22:23:10.363494] [DEBUG] [LOCAL ] LOW: Primary data saved (53351 records). [2025-10-23T22:23:10.381922] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-23T22:23:10.395469] [INFO ] [MAIN ] Update Progress: 1270/2367 symbols completed. LOW took 34.6s. Estimated remaining: 2h 20m 53s. Rate: 7.8 symbols/min [2025-10-23T22:23:10.401547] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-23T22:23:10.780618] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:10.818937] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:10.860393] [DEBUG] [LOCAL ] LRN: Loaded 39335 existing records from primary storage. [2025-10-23T22:23:10.860792] [INFO ] [MAIN ] LRN: Loaded 39335 existing records. [2025-10-23T22:23:11.069280] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:11.069523] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-23T22:23:11.069809] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-23T22:23:11.070066] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-23T22:23:11.070148] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-23T22:23:11.200411] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-23T22:23:11.510566] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T22:23:11.515467] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:11.924361] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T22:23:11.930485] [INFO ] [REMOTE ] LPG: Full fetch complete (58756 records). [2025-10-23T22:23:11.930606] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-23T22:23:12.004833] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-23T22:23:12.372180] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-23T22:23:12.372289] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-23T22:23:12.373308] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-23T22:23:12.373406] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-23T22:23:12.374675] [DEBUG] [LOCAL ] LPG: Trimmed 58756 records to 39472 (keeping 200 days of data) [2025-10-23T22:23:12.606205] [DEBUG] [LOCAL ] LPG: Primary data saved (39472 records). [2025-10-23T22:23:12.606368] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-23T22:23:12.606509] [INFO ] [MAIN ] Update Progress: 1271/2367 symbols completed. LPG took 30.4s. Estimated remaining: 2h 20m 41s. Rate: 7.8 symbols/min [2025-10-23T22:23:12.784881] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:12.804571] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-23T22:23:12.827864] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T22:23:12.850443] [DEBUG] [LOCAL ] LSPD: Loaded 42329 existing records from primary storage. [2025-10-23T22:23:12.850825] [INFO ] [MAIN ] LSPD: Loaded 42329 existing records. [2025-10-23T22:23:13.025611] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:13.025836] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-23T22:23:13.025913] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-23T22:23:13.026197] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-23T22:23:13.026271] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-23T22:23:13.386304] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:13.473980] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T22:23:13.480579] [INFO ] [REMOTE ] LOMA: Full fetch complete (47854 records). [2025-10-23T22:23:13.480716] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-23T22:23:13.604590] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-23T22:23:13.852682] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-23T22:23:13.852793] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-23T22:23:13.853607] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-23T22:23:13.853702] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-23T22:23:13.854752] [DEBUG] [LOCAL ] LOMA: Trimmed 47854 records to 33036 (keeping 200 days of data) [2025-10-23T22:23:14.036516] [DEBUG] [LOCAL ] LOMA: Primary data saved (33036 records). [2025-10-23T22:23:14.036695] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-23T22:23:14.036828] [INFO ] [MAIN ] Update Progress: 1272/2367 symbols completed. LOMA took 40.7s. Estimated remaining: 2h 20m 28s. Rate: 7.8 symbols/min [2025-10-23T22:23:14.207751] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:14.235431] [DEBUG] [LOCAL ] LTC: Loaded 30631 existing records from primary storage. [2025-10-23T22:23:14.235754] [INFO ] [MAIN ] LTC: Loaded 30631 existing records. [2025-10-23T22:23:14.411308] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:14.411551] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-23T22:23:14.412123] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-23T22:23:14.412823] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-23T22:23:14.413115] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-23T22:23:14.413188] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-23T22:23:14.777335] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T22:23:14.846696] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:15.038515] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T22:23:15.199423] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-23T22:23:15.999457] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-23T22:23:16.027206] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T22:23:16.708480] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T22:23:16.799481] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-23T22:23:17.393816] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T22:23:17.599429] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-23T22:23:18.405116] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-23T22:23:18.421266] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T22:23:18.809587] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T22:23:19.199447] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-23T22:23:19.801819] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T22:23:19.999435] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-23T22:23:20.799483] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-23T22:23:20.838221] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T22:23:21.582591] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T22:23:21.599394] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-23T22:23:22.172102] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T22:23:22.399450] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-23T22:23:23.199427] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-23T22:23:23.307104] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T22:23:23.906097] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T22:23:23.999443] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-23T22:23:24.259544] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:23:24.799442] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-23T22:23:25.599419] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-23T22:23:25.811707] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T22:23:26.344966] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T22:23:26.399400] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-23T22:23:26.949417] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T22:23:27.199427] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-23T22:23:27.977715] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T22:23:27.999411] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-23T22:23:28.466958] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T22:23:28.799440] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-23T22:23:29.561206] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T22:23:29.599407] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-23T22:23:30.399413] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-23T22:23:30.841154] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T22:23:31.064180] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-23T22:23:31.199418] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-23T22:23:31.999476] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-23T22:23:32.035008] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T22:23:32.348527] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T22:23:32.799453] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-23T22:23:33.411628] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-23T22:23:33.599453] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-23T22:23:34.288981] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T22:23:34.399458] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-23T22:23:34.942972] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T22:23:35.199473] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-23T22:23:35.920975] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T22:23:35.999436] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-23T22:23:36.666031] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T22:23:36.799492] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-23T22:23:37.541102] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T22:23:37.599404] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-23T22:23:38.372739] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T22:23:38.399490] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-23T22:23:39.157390] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T22:23:39.199458] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-23T22:23:39.800185] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T22:23:39.999475] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-23T22:23:40.248493] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T22:23:40.799486] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-23T22:23:41.426834] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T22:23:41.433141] [INFO ] [REMOTE ] LRN: Full fetch complete (58204 records). [2025-10-23T22:23:41.433271] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-23T22:23:41.600059] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-23T22:23:41.855531] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-23T22:23:41.855690] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-23T22:23:41.856785] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-23T22:23:41.856884] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-23T22:23:41.858194] [DEBUG] [LOCAL ] LRN: Trimmed 58204 records to 39569 (keeping 200 days of data) [2025-10-23T22:23:42.122447] [DEBUG] [LOCAL ] LRN: Primary data saved (39569 records). [2025-10-23T22:23:42.122728] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-23T22:23:42.122849] [INFO ] [MAIN ] Update Progress: 1273/2367 symbols completed. LRN took 31.7s. Estimated remaining: 2h 20m 37s. Rate: 7.8 symbols/min [2025-10-23T22:23:42.312603] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:42.343445] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T22:23:42.395933] [DEBUG] [LOCAL ] LTH: Loaded 51635 existing records from primary storage. [2025-10-23T22:23:42.396277] [INFO ] [MAIN ] LTH: Loaded 51635 existing records. [2025-10-23T22:23:42.410682] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-23T22:23:42.591846] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:42.592068] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-23T22:23:42.592166] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-23T22:23:42.592494] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-23T22:23:42.592576] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-23T22:23:42.946309] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:43.199418] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-23T22:23:43.223378] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T22:23:43.228980] [INFO ] [REMOTE ] LTC: Full fetch complete (43904 records). [2025-10-23T22:23:43.229085] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-23T22:23:43.599316] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-23T22:23:43.599429] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-23T22:23:43.600233] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-23T22:23:43.600309] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-23T22:23:43.601394] [DEBUG] [LOCAL ] LTC: Trimmed 43904 records to 30851 (keeping 200 days of data) [2025-10-23T22:23:43.794365] [DEBUG] [LOCAL ] LTC: Primary data saved (30851 records). [2025-10-23T22:23:43.794530] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-23T22:23:43.794680] [INFO ] [MAIN ] Update Progress: 1274/2367 symbols completed. LTC took 29.8s. Estimated remaining: 2h 20m 25s. Rate: 7.8 symbols/min [2025-10-23T22:23:43.970098] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:44.004731] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-23T22:23:44.007078] [DEBUG] [LOCAL ] LTM: Loaded 39222 existing records from primary storage. [2025-10-23T22:23:44.007415] [INFO ] [MAIN ] LTM: Loaded 39222 existing records. [2025-10-23T22:23:44.158482] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T22:23:44.219576] [INFO ] [REMOTE ] LSPD: Full fetch complete (62374 records). [2025-10-23T22:23:44.219449] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:44.219842] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-23T22:23:44.219936] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-23T22:23:44.220038] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-23T22:23:44.220454] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-23T22:23:44.220535] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-23T22:23:45.040840] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:45.041258] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-23T22:23:45.041858] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-23T22:23:45.041947] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-23T22:23:45.043926] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-23T22:23:45.044313] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-23T22:23:45.045555] [DEBUG] [LOCAL ] LSPD: Trimmed 62374 records to 42619 (keeping 200 days of data) [2025-10-23T22:23:45.286145] [DEBUG] [LOCAL ] LSPD: Primary data saved (42619 records). [2025-10-23T22:23:45.286300] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-23T22:23:45.286411] [INFO ] [MAIN ] Update Progress: 1275/2367 symbols completed. LSPD took 32.7s. Estimated remaining: 2h 20m 11s. Rate: 7.8 symbols/min [2025-10-23T22:23:45.453708] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:45.502440] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T22:23:45.527129] [DEBUG] [LOCAL ] LU: Loaded 49220 existing records from primary storage. [2025-10-23T22:23:45.527447] [INFO ] [MAIN ] LU: Loaded 49220 existing records. [2025-10-23T22:23:45.601601] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-23T22:23:45.709494] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:45.709822] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-23T22:23:45.710004] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-23T22:23:45.710428] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-23T22:23:45.710516] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-23T22:23:45.822883] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T22:23:45.852206] [INFO ] [REMOTE ] LPX: Full fetch complete (58715 records). [2025-10-23T22:23:45.867729] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-23T22:23:46.331658] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:46.401164] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-23T22:23:46.446785] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T22:23:46.539364] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-23T22:23:46.539466] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-23T22:23:46.540321] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-23T22:23:46.540399] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-23T22:23:46.541505] [DEBUG] [LOCAL ] LPX: Trimmed 58715 records to 40357 (keeping 200 days of data) [2025-10-23T22:23:46.782993] [DEBUG] [LOCAL ] LPX: Primary data saved (40357 records). [2025-10-23T22:23:46.783147] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-23T22:23:46.784972] [INFO ] [MAIN ] Update Progress: 1276/2367 symbols completed. LPX took 37.5s. Estimated remaining: 2h 19m 58s. Rate: 7.8 symbols/min [2025-10-23T22:23:46.960264] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:23:46.986675] [DEBUG] [LOCAL ] LUCK: Loaded 23877 existing records from primary storage. [2025-10-23T22:23:46.986963] [INFO ] [MAIN ] LUCK: Loaded 23877 existing records. [2025-10-23T22:23:47.170247] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:23:47.170611] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-23T22:23:47.170716] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-23T22:23:47.170931] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-23T22:23:47.171009] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-23T22:23:47.204693] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-23T22:23:47.537003] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T22:23:47.573448] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:23:47.999429] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-23T22:23:48.108676] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T22:23:48.477938] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T22:23:48.799446] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-23T22:23:49.270725] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T22:23:49.599448] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-23T22:23:50.222772] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T22:23:50.399405] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-23T22:23:51.199456] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-23T22:23:51.251893] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T22:23:51.999450] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-23T22:23:52.040104] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T22:23:52.584171] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T22:23:52.799493] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-23T22:23:53.353844] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T22:23:53.599423] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-23T22:23:54.169573] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T22:23:54.399474] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-23T22:23:54.932296] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T22:23:55.199417] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-23T22:23:55.999457] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-23T22:23:56.141231] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T22:23:56.656333] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T22:23:56.799459] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-23T22:23:57.599417] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-23T22:23:57.724188] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T22:23:58.069997] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T22:23:58.399515] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-23T22:23:59.013334] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T22:23:59.199422] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-23T22:23:59.825966] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T22:23:59.999462] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-23T22:24:00.507317] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T22:24:00.799460] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-23T22:24:01.518146] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T22:24:01.599443] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-23T22:24:02.399500] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-23T22:24:02.458143] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T22:24:03.176872] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T22:24:03.199410] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-23T22:24:03.784951] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T22:24:03.999433] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-23T22:24:04.799426] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-23T22:24:04.929170] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T22:24:05.497689] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T22:24:05.599445] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-23T22:24:06.399482] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-23T22:24:06.597909] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T22:24:07.162364] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T22:24:07.199417] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-23T22:24:07.543691] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T22:24:07.999433] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-23T22:24:08.799439] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-23T22:24:08.856342] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T22:24:09.005366] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T22:24:09.599439] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-23T22:24:10.399453] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-23T22:24:10.555556] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T22:24:11.199427] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-23T22:24:11.377842] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T22:24:11.994041] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T22:24:12.003960] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-23T22:24:12.291183] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T22:24:12.799450] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-23T22:24:13.599491] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-23T22:24:13.696594] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T22:24:13.705387] [INFO ] [REMOTE ] LU: Full fetch complete (70937 records). [2025-10-23T22:24:13.705537] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-23T22:24:14.091669] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-23T22:24:14.091796] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-23T22:24:14.092954] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-23T22:24:14.093177] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-23T22:24:14.094512] [DEBUG] [LOCAL ] LU: Trimmed 70937 records to 49548 (keeping 200 days of data) [2025-10-23T22:24:14.366857] [DEBUG] [LOCAL ] LU: Primary data saved (49548 records). [2025-10-23T22:24:14.367019] [INFO ] [MAIN ] LU: Full history saved. [2025-10-23T22:24:14.367134] [INFO ] [MAIN ] Update Progress: 1277/2367 symbols completed. LU took 29.1s. Estimated remaining: 2h 20m 8s. Rate: 7.8 symbols/min [2025-10-23T22:24:14.399408] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-23T22:24:14.516584] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T22:24:14.567618] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T22:24:14.571457] [INFO ] [REMOTE ] LUCK: Full fetch complete (39197 records). [2025-10-23T22:24:14.571573] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-23T22:24:14.943890] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-23T22:24:14.944006] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-23T22:24:14.944886] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-23T22:24:14.944979] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-23T22:24:14.945897] [DEBUG] [LOCAL ] LUCK: Trimmed 39197 records to 23995 (keeping 200 days of data) [2025-10-23T22:24:15.083361] [DEBUG] [LOCAL ] LUCK: Primary data saved (23995 records). [2025-10-23T22:24:15.083514] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-23T22:24:15.083687] [INFO ] [MAIN ] Update Progress: 1278/2367 symbols completed. LUCK took 28.3s. Estimated remaining: 2h 19m 54s. Rate: 7.8 symbols/min [2025-10-23T22:24:15.199491] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-23T22:24:15.846072] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T22:24:15.854482] [INFO ] [REMOTE ] LTM: Full fetch complete (51545 records). [2025-10-23T22:24:15.854628] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-23T22:24:16.227490] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-23T22:24:16.227614] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-23T22:24:16.228882] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-23T22:24:16.228961] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-23T22:24:16.230073] [DEBUG] [LOCAL ] LTM: Trimmed 51545 records to 39574 (keeping 200 days of data) [2025-10-23T22:24:16.451116] [DEBUG] [LOCAL ] LTM: Primary data saved (39574 records). [2025-10-23T22:24:16.451294] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-23T22:24:16.451412] [INFO ] [MAIN ] Update Progress: 1279/2367 symbols completed. LTM took 32.7s. Estimated remaining: 2h 19m 41s. Rate: 7.8 symbols/min [2025-10-23T22:24:16.927962] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T22:24:16.936738] [INFO ] [REMOTE ] LTH: Full fetch complete (74769 records). [2025-10-23T22:24:16.936917] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-23T22:24:17.326186] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-23T22:24:17.326304] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-23T22:24:17.327501] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-23T22:24:17.327581] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-23T22:24:17.329162] [DEBUG] [LOCAL ] LTH: Trimmed 74769 records to 51990 (keeping 200 days of data) [2025-10-23T22:24:17.622822] [DEBUG] [LOCAL ] LTH: Primary data saved (51990 records). [2025-10-23T22:24:17.622977] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-23T22:24:17.623091] [INFO ] [MAIN ] Update Progress: 1280/2367 symbols completed. LTH took 35.5s. Estimated remaining: 2h 19m 28s. Rate: 7.8 symbols/min [2025-10-23T22:24:18.202271] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:18.276714] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:18.314217] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-23T22:24:18.386749] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:18.387760] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:18.386978] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-23T22:24:18.388499] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-23T22:24:18.389402] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-23T22:24:18.389507] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-23T22:24:18.389663] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-23T22:24:18.704935] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-23T22:24:18.756633] [INFO ] [MAIN ] LVS: Loaded 53569 existing records. [2025-10-23T22:24:18.778157] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-23T22:24:18.794476] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-23T22:24:18.837309] [INFO ] [MAIN ] LUMN: Loaded 53645 existing records. [2025-10-23T22:24:18.846895] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-23T22:24:18.894000] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:18.963147] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-23T22:24:19.369183] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:24:19.372256] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:19.408888] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:19.405896] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-23T22:24:19.431780] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:19.432188] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-23T22:24:19.427506] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-23T22:24:19.425929] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-23T22:24:19.432042] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-23T22:24:19.432316] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-23T22:24:19.433032] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-23T22:24:19.433413] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-23T22:24:19.432685] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:24:19.433513] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-23T22:24:19.445421] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-23T22:24:19.455410] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-23T22:24:19.439514] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-23T22:24:19.475323] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-23T22:24:19.548372] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:24:19.537983] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-23T22:24:19.564008] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-23T22:24:19.582716] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-23T22:24:19.606229] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-23T22:24:19.617134] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-23T22:24:19.680525] [INFO ] [MAIN ] Update Progress: 1281/2367 symbols completed. LUXE took 2.1s. Estimated remaining: 2h 19m 15s. Rate: 7.8 symbols/min [2025-10-23T22:24:20.432455] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:20.649024] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:20.684688] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-23T22:24:20.678913] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:20.695507] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-23T22:24:20.755414] [DEBUG] [LOCAL ] LVWR: Loaded 18636 existing records from primary storage. [2025-10-23T22:24:20.777171] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:20.777782] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-23T22:24:20.777906] [INFO ] [MAIN ] LVWR: Loaded 18636 existing records. [2025-10-23T22:24:20.955952] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:20.956173] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-23T22:24:20.956248] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-23T22:24:20.956487] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-23T22:24:20.956563] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-23T22:24:21.302464] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:21.302836] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-23T22:24:21.758556] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T22:24:21.760405] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-23T22:24:22.342228] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T22:24:22.343844] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-23T22:24:22.609683] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T22:24:22.647220] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-23T22:24:22.653991] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T22:24:22.666584] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-23T22:24:22.707391] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T22:24:22.915251] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T22:24:23.199446] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-23T22:24:23.999432] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-23T22:24:24.516810] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T22:24:24.633816] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T22:24:24.678441] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T22:24:24.799432] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-23T22:24:25.599449] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-23T22:24:25.673193] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-23T22:24:26.399421] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-23T22:24:26.685845] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T22:24:27.199445] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-23T22:24:27.561003] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T22:24:27.999466] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-23T22:24:28.415334] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T22:24:28.799457] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-23T22:24:29.181726] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T22:24:29.550457] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T22:24:29.599402] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-23T22:24:30.399445] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-23T22:24:31.041601] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T22:24:31.199482] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-23T22:24:31.999911] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-23T22:24:32.144318] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-23T22:24:32.410106] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T22:24:32.411734] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-23T22:24:32.799412] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-23T22:24:33.599399] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-23T22:24:34.087159] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T22:24:34.404505] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-23T22:24:34.410363] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T22:24:35.199429] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-23T22:24:35.241284] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T22:24:35.999439] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-23T22:24:36.167900] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T22:24:36.777676] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T22:24:36.799401] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-23T22:24:37.599445] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-23T22:24:38.035900] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-23T22:24:38.322074] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T22:24:38.399396] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-23T22:24:38.959847] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-23T22:24:39.199437] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-23T22:24:39.428919] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T22:24:39.999441] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-23T22:24:40.799411] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-23T22:24:41.206948] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T22:24:41.599420] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-23T22:24:41.992538] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T22:24:42.258451] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T22:24:42.399465] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-23T22:24:42.918914] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-23T22:24:43.199418] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-23T22:24:43.999435] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-23T22:24:44.336128] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T22:24:44.799411] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-23T22:24:44.864627] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T22:24:44.867305] [INFO ] [REMOTE ] LVWR: Full fetch complete (20834 records). [2025-10-23T22:24:44.867409] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-23T22:24:45.202814] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T22:24:45.298331] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-23T22:24:45.298501] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-23T22:24:45.299076] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-23T22:24:45.299152] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-23T22:24:45.299848] [DEBUG] [LOCAL ] LVWR: Trimmed 20834 records to 18696 (keeping 200 days of data) [2025-10-23T22:24:45.401739] [DEBUG] [LOCAL ] LVWR: Primary data saved (18696 records). [2025-10-23T22:24:45.401888] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-23T22:24:45.401999] [INFO ] [MAIN ] Update Progress: 1282/2367 symbols completed. LVWR took 25.7s. Estimated remaining: 2h 19m 23s. Rate: 7.8 symbols/min [2025-10-23T22:24:45.570495] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:45.601037] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-23T22:24:45.604356] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T22:24:45.656878] [DEBUG] [LOCAL ] LW: Loaded 51164 existing records from primary storage. [2025-10-23T22:24:45.657263] [INFO ] [MAIN ] LW: Loaded 51164 existing records. [2025-10-23T22:24:45.831685] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:45.831907] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-23T22:24:45.831983] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-23T22:24:45.832212] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-23T22:24:45.832284] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-23T22:24:46.228111] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:46.399427] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-23T22:24:47.199463] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-23T22:24:47.800720] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-23T22:24:47.811591] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-23T22:24:47.811841] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-23T22:24:48.010893] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-23T22:24:48.246993] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T22:24:48.275135] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-23T22:24:48.275909] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-23T22:24:48.278162] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-23T22:24:48.278307] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-23T22:24:48.279453] [INFO ] [REMOTE ] LVS: Full fetch complete (77725 records). [2025-10-23T22:24:48.280096] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-23T22:24:48.324982] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 54035 (keeping 200 days of data) [2025-10-23T22:24:48.915312] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-23T22:24:49.000714] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-23T22:24:49.040913] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-23T22:24:49.045929] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-23T22:24:49.048586] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-23T22:24:49.051161] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-23T22:24:49.057612] [DEBUG] [LOCAL ] LVS: Trimmed 77725 records to 53959 (keeping 200 days of data) [2025-10-23T22:24:49.063045] [DEBUG] [LOCAL ] LUMN: Primary data saved (54035 records). [2025-10-23T22:24:49.063164] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-23T22:24:49.063289] [INFO ] [MAIN ] Update Progress: 1283/2367 symbols completed. LUMN took 31.4s. Estimated remaining: 2h 19m 12s. Rate: 7.8 symbols/min [2025-10-23T22:24:49.362616] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:49.512204] [DEBUG] [LOCAL ] LXFR: Loaded 16413 existing records from primary storage. [2025-10-23T22:24:49.518200] [INFO ] [MAIN ] LXFR: Loaded 16413 existing records. [2025-10-23T22:24:49.520986] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T22:24:49.603952] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-23T22:24:49.751736] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:49.793291] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-23T22:24:49.793831] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-23T22:24:49.813968] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-23T22:24:49.815207] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-23T22:24:49.981849] [DEBUG] [LOCAL ] LVS: Primary data saved (53959 records). [2025-10-23T22:24:50.009522] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-23T22:24:50.043985] [INFO ] [MAIN ] Update Progress: 1284/2367 symbols completed. LVS took 32.4s. Estimated remaining: 2h 18m 58s. Rate: 7.8 symbols/min [2025-10-23T22:24:50.405073] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:50.427168] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:50.427899] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-23T22:24:50.458064] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T22:24:50.468620] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-23T22:24:50.468848] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-23T22:24:50.799421] [DEBUG] [LOCAL ] LXP: Loaded 50756 existing records from primary storage. [2025-10-23T22:24:50.816548] [INFO ] [MAIN ] LXP: Loaded 50756 existing records. [2025-10-23T22:24:50.969389] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T22:24:51.153416] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-23T22:24:51.159255] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-23T22:24:51.176451] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-23T22:24:51.206788] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-23T22:24:51.193971] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-23T22:24:51.236400] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:51.236973] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-23T22:24:51.237050] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 54079 (keeping 200 days of data) [2025-10-23T22:24:51.237528] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-23T22:24:51.238280] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-23T22:24:51.238359] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-23T22:24:51.770833] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T22:24:51.987763] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:52.001730] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-23T22:24:52.019729] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-10-23T22:24:52.020196] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-23T22:24:52.020317] [INFO ] [MAIN ] Update Progress: 1285/2367 symbols completed. LUV took 34.4s. Estimated remaining: 2h 18m 46s. Rate: 7.8 symbols/min [2025-10-23T22:24:52.207060] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:24:52.238274] [DEBUG] [LOCAL ] LXU: Loaded 31461 existing records from primary storage. [2025-10-23T22:24:52.238681] [INFO ] [MAIN ] LXU: Loaded 31461 existing records. [2025-10-23T22:24:52.422762] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:24:52.423030] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-23T22:24:52.423110] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-23T22:24:52.423350] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-23T22:24:52.423429] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-23T22:24:52.800207] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:24:52.800341] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-23T22:24:53.093591] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T22:24:53.137463] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T22:24:53.599464] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-23T22:24:54.348172] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T22:24:54.399402] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-23T22:24:54.457455] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T22:24:55.199466] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-23T22:24:55.527105] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T22:24:55.999448] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-23T22:24:56.649010] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T22:24:56.799441] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-23T22:24:57.599404] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-23T22:24:57.854889] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T22:24:58.135797] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T22:24:58.399439] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-23T22:24:59.173770] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T22:24:59.199470] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-23T22:24:59.370917] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T22:24:59.999455] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-23T22:25:00.799490] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-23T22:25:01.009223] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T22:25:01.152868] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T22:25:01.599477] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-23T22:25:02.399458] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-23T22:25:02.610540] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T22:25:02.998050] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T22:25:03.199508] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-23T22:25:03.999425] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-23T22:25:04.142229] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T22:25:04.175576] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T22:25:04.799434] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-23T22:25:05.493678] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T22:25:05.599445] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-23T22:25:05.862667] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T22:25:06.399502] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-23T22:25:07.200485] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-23T22:25:07.203094] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T22:25:07.847195] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T22:25:07.999453] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-23T22:25:08.799407] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-23T22:25:08.912958] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:25:09.027606] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T22:25:09.599491] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-23T22:25:09.954592] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T22:25:10.399447] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-23T22:25:11.199424] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-23T22:25:11.551324] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T22:25:11.581388] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-23T22:25:11.999419] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-23T22:25:12.568114] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T22:25:12.799458] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-23T22:25:12.969931] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T22:25:13.599419] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-23T22:25:14.135289] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T22:25:14.399470] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-23T22:25:14.473163] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T22:25:14.477445] [INFO ] [REMOTE ] LXFR: Full fetch complete (24644 records). [2025-10-23T22:25:14.477596] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-23T22:25:14.871337] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-23T22:25:14.871455] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-23T22:25:14.872020] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-23T22:25:14.872099] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-23T22:25:14.872840] [DEBUG] [LOCAL ] LXFR: Trimmed 24644 records to 16511 (keeping 200 days of data) [2025-10-23T22:25:14.979433] [DEBUG] [LOCAL ] LXFR: Primary data saved (16511 records). [2025-10-23T22:25:14.979608] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-23T22:25:14.979744] [INFO ] [MAIN ] Update Progress: 1286/2367 symbols completed. LXFR took 25.9s. Estimated remaining: 2h 18m 51s. Rate: 7.8 symbols/min [2025-10-23T22:25:15.148778] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:15.196415] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-23T22:25:15.196811] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-23T22:25:15.207996] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-23T22:25:15.397136] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:15.397330] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-23T22:25:15.397408] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-23T22:25:15.397717] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-23T22:25:15.397792] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-23T22:25:15.732367] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T22:25:15.778238] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:15.999431] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-23T22:25:16.805685] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-23T22:25:16.813984] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T22:25:17.599416] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-23T22:25:17.843278] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T22:25:18.060132] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T22:25:18.065387] [INFO ] [REMOTE ] LXU: Full fetch complete (45318 records). [2025-10-23T22:25:18.065502] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-23T22:25:18.426041] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-23T22:25:18.442438] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-23T22:25:18.442524] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-23T22:25:18.443346] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-23T22:25:18.443519] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-23T22:25:18.444728] [DEBUG] [LOCAL ] LXU: Trimmed 45318 records to 31710 (keeping 200 days of data) [2025-10-23T22:25:18.628361] [DEBUG] [LOCAL ] LXU: Primary data saved (31710 records). [2025-10-23T22:25:18.628749] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-23T22:25:18.628866] [INFO ] [MAIN ] Update Progress: 1287/2367 symbols completed. LXU took 26.6s. Estimated remaining: 2h 18m 40s. Rate: 7.8 symbols/min [2025-10-23T22:25:18.802443] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:18.849902] [DEBUG] [LOCAL ] LYG: Loaded 52652 existing records from primary storage. [2025-10-23T22:25:18.850237] [INFO ] [MAIN ] LYG: Loaded 52652 existing records. [2025-10-23T22:25:19.027965] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:19.028173] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-23T22:25:19.028252] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-23T22:25:19.028523] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-23T22:25:19.028598] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-23T22:25:19.202846] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-23T22:25:19.414139] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:19.418686] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T22:25:19.999443] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-23T22:25:20.246134] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T22:25:20.799432] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-23T22:25:21.379834] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T22:25:21.599439] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-23T22:25:21.797678] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T22:25:22.399449] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-23T22:25:22.455910] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T22:25:22.746951] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T22:25:22.755931] [INFO ] [REMOTE ] LXP: Full fetch complete (72851 records). [2025-10-23T22:25:22.756112] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-23T22:25:23.166626] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-23T22:25:23.166779] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-23T22:25:23.167819] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-23T22:25:23.167899] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-23T22:25:23.169481] [DEBUG] [LOCAL ] LXP: Trimmed 72851 records to 51121 (keeping 200 days of data) [2025-10-23T22:25:23.223378] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-23T22:25:23.587580] [DEBUG] [LOCAL ] LXP: Primary data saved (51121 records). [2025-10-23T22:25:23.587981] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-23T22:25:23.588165] [INFO ] [MAIN ] Update Progress: 1288/2367 symbols completed. LXP took 33.5s. Estimated remaining: 2h 18m 30s. Rate: 7.8 symbols/min [2025-10-23T22:25:23.879435] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:23.931564] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T22:25:23.946066] [INFO ] [REMOTE ] LW: Full fetch complete (74773 records). [2025-10-23T22:25:23.946343] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-23T22:25:23.999853] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-23T22:25:24.177063] [DEBUG] [LOCAL ] LYV: Loaded 51001 existing records from primary storage. [2025-10-23T22:25:24.212582] [INFO ] [MAIN ] LYV: Loaded 51001 existing records. [2025-10-23T22:25:24.652843] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:24.664018] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-23T22:25:24.694031] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-23T22:25:24.712456] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-23T22:25:24.712674] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-23T22:25:24.713953] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-23T22:25:24.714065] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-23T22:25:24.714384] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-23T22:25:24.714992] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-23T22:25:24.835567] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-23T22:25:24.823021] [DEBUG] [LOCAL ] LW: Trimmed 74773 records to 51535 (keeping 200 days of data) [2025-10-23T22:25:24.865241] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-23T22:25:25.344027] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:25.440593] [DEBUG] [LOCAL ] LW: Primary data saved (51535 records). [2025-10-23T22:25:25.440789] [INFO ] [MAIN ] LW: Full history saved. [2025-10-23T22:25:25.440901] [INFO ] [MAIN ] Update Progress: 1289/2367 symbols completed. LW took 40.0s. Estimated remaining: 2h 18m 17s. Rate: 7.8 symbols/min [2025-10-23T22:25:25.612861] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:25.612977] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-23T22:25:25.645809] [DEBUG] [LOCAL ] LZB: Loaded 35036 existing records from primary storage. [2025-10-23T22:25:25.646127] [INFO ] [MAIN ] LZB: Loaded 35036 existing records. [2025-10-23T22:25:25.822873] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:25.823123] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-23T22:25:25.823391] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-23T22:25:25.823787] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-23T22:25:25.823864] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-23T22:25:25.954032] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T22:25:26.215884] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:26.399436] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-23T22:25:26.636019] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T22:25:27.199426] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-23T22:25:27.277867] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T22:25:27.726093] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T22:25:27.999447] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-23T22:25:28.799423] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-23T22:25:29.176317] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T22:25:29.599423] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-23T22:25:29.785752] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T22:25:30.399435] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-23T22:25:30.704588] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T22:25:30.789790] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T22:25:31.199458] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-23T22:25:31.999443] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-23T22:25:32.343439] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T22:25:32.799442] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-23T22:25:33.576318] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-23T22:25:33.599408] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-23T22:25:34.019234] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T22:25:34.399452] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-23T22:25:34.743142] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T22:25:35.102253] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T22:25:35.199476] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-23T22:25:35.999433] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-23T22:25:36.051611] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T22:25:36.799431] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-23T22:25:37.119772] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-23T22:25:37.599425] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-23T22:25:38.399480] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-23T22:25:38.468360] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-23T22:25:38.539978] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T22:25:39.199434] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-23T22:25:39.655155] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T22:25:39.685628] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T22:25:39.999457] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-23T22:25:40.799474] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-23T22:25:41.091291] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T22:25:41.580444] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:25:41.599416] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-23T22:25:42.244570] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T22:25:42.399476] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-23T22:25:43.199443] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-23T22:25:43.364695] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:25:43.899757] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T22:25:43.999424] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-23T22:25:44.799481] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-23T22:25:44.918499] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T22:25:45.473418] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T22:25:45.601275] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-23T22:25:45.609089] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:25:46.399469] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-23T22:25:47.199457] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-23T22:25:47.504270] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T22:25:47.865480] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T22:25:47.999527] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-23T22:25:48.799439] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-23T22:25:48.967096] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T22:25:49.320696] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T22:25:49.326747] [INFO ] [REMOTE ] LZB: Full fetch complete (51181 records). [2025-10-23T22:25:49.326888] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-23T22:25:49.604829] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-23T22:25:49.713922] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-23T22:25:49.714130] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-23T22:25:49.715112] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-23T22:25:49.715295] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-23T22:25:49.753154] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T22:25:49.750857] [DEBUG] [LOCAL ] LZB: Trimmed 51181 records to 35281 (keeping 200 days of data) [2025-10-23T22:25:49.763466] [INFO ] [REMOTE ] LYB: Full fetch complete (77635 records). [2025-10-23T22:25:49.822857] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-23T22:25:50.139933] [DEBUG] [LOCAL ] LZB: Primary data saved (35281 records). [2025-10-23T22:25:50.147436] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-23T22:25:50.159255] [INFO ] [MAIN ] Update Progress: 1290/2367 symbols completed. LZB took 24.7s. Estimated remaining: 2h 18m 24s. Rate: 7.8 symbols/min [2025-10-23T22:25:50.414340] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-23T22:25:50.484481] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:50.582130] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-23T22:25:50.582257] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-23T22:25:50.583598] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-23T22:25:50.589317] [DEBUG] [LOCAL ] LZM: Loaded 14818 existing records from primary storage. [2025-10-23T22:25:50.589472] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-23T22:25:50.589729] [INFO ] [MAIN ] LZM: Loaded 14818 existing records. [2025-10-23T22:25:50.692318] [DEBUG] [LOCAL ] LYB: Trimmed 77635 records to 54011 (keeping 200 days of data) [2025-10-23T22:25:50.926534] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:50.932893] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-23T22:25:50.940005] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-23T22:25:50.951999] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-23T22:25:50.956541] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-23T22:25:51.495669] [DEBUG] [LOCAL ] LYB: Primary data saved (54011 records). [2025-10-23T22:25:51.501275] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-23T22:25:51.558312] [INFO ] [MAIN ] Update Progress: 1291/2367 symbols completed. LYB took 36.6s. Estimated remaining: 2h 18m 11s. Rate: 7.8 symbols/min [2025-10-23T22:25:51.588021] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:51.630780] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-23T22:25:51.668832] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-23T22:25:51.723432] [INFO ] [REMOTE ] LYG: Full fetch complete (76235 records). [2025-10-23T22:25:51.747752] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-23T22:25:51.838607] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:52.211487] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-23T22:25:52.211848] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-23T22:25:52.212177] [INFO ] [MAIN ] M: Loaded 53544 existing records. [2025-10-23T22:25:52.223886] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-23T22:25:52.225214] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-23T22:25:52.225349] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-23T22:25:52.362359] [DEBUG] [LOCAL ] LYG: Trimmed 76235 records to 53036 (keeping 200 days of data) [2025-10-23T22:25:52.399992] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:52.400461] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-23T22:25:52.463134] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T22:25:52.488262] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-23T22:25:52.497689] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-23T22:25:52.498902] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-23T22:25:52.495314] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-23T22:25:52.694773] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-23T22:25:52.822273] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-23T22:25:53.039770] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:53.118916] [DEBUG] [LOCAL ] LYG: Primary data saved (53036 records). [2025-10-23T22:25:53.119081] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-23T22:25:53.120571] [INFO ] [MAIN ] Update Progress: 1292/2367 symbols completed. LYG took 34.5s. Estimated remaining: 2h 17m 58s. Rate: 7.8 symbols/min [2025-10-23T22:25:53.290300] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:53.342427] [DEBUG] [LOCAL ] MA: Loaded 52451 existing records from primary storage. [2025-10-23T22:25:53.342821] [INFO ] [MAIN ] MA: Loaded 52451 existing records. [2025-10-23T22:25:53.417840] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T22:25:53.530033] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:53.530256] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-23T22:25:53.530345] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-23T22:25:53.530705] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-23T22:25:53.530800] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-23T22:25:53.605730] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-23T22:25:53.927554] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:53.930328] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:25:54.399481] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-23T22:25:54.561867] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-23T22:25:55.119100] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:25:55.128269] [INFO ] [REMOTE ] LYV: Full fetch complete (74173 records). [2025-10-23T22:25:55.128427] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-23T22:25:55.204542] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-23T22:25:55.521589] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-23T22:25:55.521734] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-23T22:25:55.522808] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-23T22:25:55.522886] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-23T22:25:55.524372] [DEBUG] [LOCAL ] LYV: Trimmed 74173 records to 51383 (keeping 200 days of data) [2025-10-23T22:25:55.822924] [DEBUG] [LOCAL ] LYV: Primary data saved (51383 records). [2025-10-23T22:25:55.823084] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-23T22:25:55.823195] [INFO ] [MAIN ] Update Progress: 1293/2367 symbols completed. LYV took 32.2s. Estimated remaining: 2h 17m 46s. Rate: 7.8 symbols/min [2025-10-23T22:25:55.992448] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:25:55.999442] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-23T22:25:56.033536] [DEBUG] [LOCAL ] MAA: Loaded 43002 existing records from primary storage. [2025-10-23T22:25:56.033876] [INFO ] [MAIN ] MAA: Loaded 43002 existing records. [2025-10-23T22:25:56.207249] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:25:56.207482] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-23T22:25:56.207556] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-23T22:25:56.207792] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-23T22:25:56.207865] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-23T22:25:56.559969] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:25:56.799431] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-23T22:25:57.180498] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-23T22:25:57.599414] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-23T22:25:57.964495] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T22:25:58.387217] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T22:25:58.399383] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-23T22:25:59.199416] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-23T22:25:59.507245] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T22:25:59.999423] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-23T22:26:00.267197] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-23T22:26:00.316929] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-23T22:26:00.799446] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-23T22:26:01.599409] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-23T22:26:01.676529] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T22:26:02.399403] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-23T22:26:02.646682] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-23T22:26:03.199415] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-23T22:26:03.372390] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T22:26:03.999408] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-23T22:26:04.024218] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T22:26:04.334137] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T22:26:04.799446] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-23T22:26:05.599497] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-23T22:26:06.413522] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-23T22:26:06.415865] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T22:26:07.199407] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-23T22:26:07.231401] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T22:26:07.610143] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T22:26:07.999414] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-23T22:26:08.480557] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T22:26:08.481578] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (4.48 seconds). [2025-10-23T22:26:08.799431] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-23T22:26:09.599434] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-23T22:26:09.958530] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T22:26:10.382802] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T22:26:10.399385] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-23T22:26:10.435239] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T22:26:11.199417] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-23T22:26:11.444986] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T22:26:11.999463] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-23T22:26:12.743821] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T22:26:12.799454] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-23T22:26:13.083329] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T22:26:13.087764] [INFO ] [REMOTE ] LZM: Full fetch complete (19985 records). [2025-10-23T22:26:13.087895] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-23T22:26:13.458399] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-23T22:26:13.458514] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-23T22:26:13.458965] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-23T22:26:13.459044] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-23T22:26:13.459689] [DEBUG] [LOCAL ] LZM: Trimmed 19985 records to 14964 (keeping 200 days of data) [2025-10-23T22:26:13.538575] [DEBUG] [LOCAL ] LZM: Primary data saved (14964 records). [2025-10-23T22:26:13.538765] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-23T22:26:13.538876] [INFO ] [MAIN ] Update Progress: 1294/2367 symbols completed. LZM took 23.4s. Estimated remaining: 2h 17m 47s. Rate: 7.8 symbols/min [2025-10-23T22:26:13.605981] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-23T22:26:13.713855] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:26:13.757838] [DEBUG] [LOCAL ] MAC: Loaded 49610 existing records from primary storage. [2025-10-23T22:26:13.758200] [INFO ] [MAIN ] MAC: Loaded 49610 existing records. [2025-10-23T22:26:13.933673] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:26:13.933899] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-23T22:26:13.933976] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-23T22:26:13.934194] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-23T22:26:13.934266] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-23T22:26:14.286238] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:26:14.399418] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-23T22:26:14.992921] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-23T22:26:15.199505] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-23T22:26:15.712911] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-23T22:26:15.999450] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-23T22:26:16.170933] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T22:26:16.799424] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-23T22:26:17.288855] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T22:26:17.599444] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-23T22:26:17.635369] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T22:26:18.399420] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-23T22:26:18.786026] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-23T22:26:19.199457] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-23T22:26:19.779828] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T22:26:19.935047] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T22:26:19.999453] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-23T22:26:20.035118] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T22:26:20.717578] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:26:20.725261] [INFO ] [REMOTE ] MAA: Full fetch complete (61919 records). [2025-10-23T22:26:20.725440] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-23T22:26:20.804553] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-23T22:26:21.110033] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-23T22:26:21.110219] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-23T22:26:21.111334] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-23T22:26:21.111436] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-23T22:26:21.112843] [DEBUG] [LOCAL ] MAA: Trimmed 61919 records to 43322 (keeping 200 days of data) [2025-10-23T22:26:21.379500] [DEBUG] [LOCAL ] MAA: Primary data saved (43322 records). [2025-10-23T22:26:21.379673] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-23T22:26:21.379775] [INFO ] [MAIN ] Update Progress: 1295/2367 symbols completed. MAA took 25.6s. Estimated remaining: 2h 17m 39s. Rate: 7.8 symbols/min [2025-10-23T22:26:21.549157] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:26:21.583891] [DEBUG] [LOCAL ] MAGN: Loaded 36149 existing records from primary storage. [2025-10-23T22:26:21.584212] [INFO ] [MAIN ] MAGN: Loaded 36149 existing records. [2025-10-23T22:26:21.604722] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-23T22:26:21.762674] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:26:21.762877] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-23T22:26:21.762951] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-23T22:26:21.763188] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-23T22:26:21.763262] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-23T22:26:22.120709] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:26:22.399449] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-23T22:26:23.199497] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-23T22:26:23.348845] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T22:26:23.731260] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T22:26:23.999420] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-23T22:26:24.359982] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (3.56 seconds). [2025-10-23T22:26:24.799473] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-23T22:26:24.967806] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:26:25.599420] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-23T22:26:25.769722] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T22:26:26.399431] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-23T22:26:26.653721] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T22:26:26.850929] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T22:26:27.199448] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-23T22:26:27.999415] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-23T22:26:28.462110] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T22:26:28.549387] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T22:26:28.799426] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-23T22:26:29.426992] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T22:26:29.599443] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-23T22:26:29.958694] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T22:26:30.399438] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-23T22:26:30.769125] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-23T22:26:30.778422] [INFO ] [REMOTE ] MA: Full fetch complete (76393 records). [2025-10-23T22:26:30.778569] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-23T22:26:31.179138] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-23T22:26:31.179262] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-23T22:26:31.180449] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-23T22:26:31.180604] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-23T22:26:31.182356] [DEBUG] [LOCAL ] MA: Trimmed 76393 records to 52828 (keeping 200 days of data) [2025-10-23T22:26:31.252741] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-23T22:26:31.307834] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:26:31.557447] [DEBUG] [LOCAL ] MA: Primary data saved (52828 records). [2025-10-23T22:26:31.557638] [INFO ] [MAIN ] MA: Full history saved. [2025-10-23T22:26:31.559279] [INFO ] [MAIN ] Update Progress: 1296/2367 symbols completed. MA took 38.4s. Estimated remaining: 2h 17m 33s. Rate: 7.8 symbols/min [2025-10-23T22:26:31.725817] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:26:31.769708] [DEBUG] [LOCAL ] MAIN: Loaded 41940 existing records from primary storage. [2025-10-23T22:26:31.770073] [INFO ] [MAIN ] MAIN: Loaded 41940 existing records. [2025-10-23T22:26:31.994189] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:26:31.994497] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-23T22:26:31.994583] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-23T22:26:31.994860] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-23T22:26:31.994941] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-23T22:26:32.007445] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-23T22:26:32.505979] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:26:32.799761] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-23T22:26:32.807151] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T22:26:33.599443] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-23T22:26:33.831180] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T22:26:34.399449] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-23T22:26:35.199425] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-23T22:26:35.895052] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (3.10 seconds). [2025-10-23T22:26:35.999404] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-23T22:26:36.813615] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (3.21 seconds). [2025-10-23T22:26:36.822108] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-23T22:26:36.916271] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T22:26:37.573520] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (3.17 seconds). [2025-10-23T22:26:37.599416] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-23T22:26:38.287397] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-23T22:26:38.296977] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-23T22:26:38.297177] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-23T22:26:38.399866] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-23T22:26:38.782353] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-23T22:26:38.787593] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T22:26:38.787682] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-23T22:26:38.792207] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-23T22:26:38.798078] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-23T22:26:38.800059] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53934 (keeping 200 days of data) [2025-10-23T22:26:39.099297] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T22:26:39.205686] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-23T22:26:39.215848] [DEBUG] [LOCAL ] M: Primary data saved (53934 records). [2025-10-23T22:26:39.216031] [INFO ] [MAIN ] M: Full history saved. [2025-10-23T22:26:39.216211] [INFO ] [MAIN ] Update Progress: 1297/2367 symbols completed. M took 47.6s. Estimated remaining: 2h 17m 26s. Rate: 7.8 symbols/min [2025-10-23T22:26:39.392468] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:26:39.433145] [DEBUG] [LOCAL ] MAN: Loaded 44306 existing records from primary storage. [2025-10-23T22:26:39.433493] [INFO ] [MAIN ] MAN: Loaded 44306 existing records. [2025-10-23T22:26:39.620256] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:26:39.620509] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-23T22:26:39.620596] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-23T22:26:39.621003] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-23T22:26:39.621079] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-23T22:26:39.996908] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T22:26:40.000544] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:26:40.000599] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-23T22:26:40.586532] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T22:26:40.799457] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-23T22:26:41.599456] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-23T22:26:41.738519] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T22:26:42.407108] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-23T22:26:42.424004] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T22:26:42.433254] [INFO ] [REMOTE ] MAC: Full fetch complete (71582 records). [2025-10-23T22:26:42.433399] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-23T22:26:42.815914] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T22:26:42.870173] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-23T22:26:42.870677] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-23T22:26:42.872025] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-23T22:26:42.872104] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-23T22:26:42.873502] [DEBUG] [LOCAL ] MAC: Trimmed 71582 records to 49975 (keeping 200 days of data) [2025-10-23T22:26:43.163857] [DEBUG] [LOCAL ] MAC: Primary data saved (49975 records). [2025-10-23T22:26:43.164019] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-23T22:26:43.164131] [INFO ] [MAIN ] Update Progress: 1298/2367 symbols completed. MAC took 29.6s. Estimated remaining: 2h 17m 15s. Rate: 7.8 symbols/min [2025-10-23T22:26:43.207443] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-23T22:26:43.336082] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:26:43.361053] [DEBUG] [LOCAL ] MANU: Loaded 27190 existing records from primary storage. [2025-10-23T22:26:43.361335] [INFO ] [MAIN ] MANU: Loaded 27190 existing records. [2025-10-23T22:26:43.536414] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:26:43.536621] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-23T22:26:43.536719] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-23T22:26:43.536953] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-23T22:26:43.537024] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-23T22:26:43.887245] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:26:43.999418] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-23T22:26:44.171545] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:26:44.650426] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T22:26:44.715125] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-23T22:26:44.799458] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-23T22:26:45.599420] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-23T22:26:45.706163] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T22:26:46.399438] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-23T22:26:47.199520] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-23T22:26:47.420126] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T22:26:47.811599] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T22:26:47.999454] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-23T22:26:48.288917] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T22:26:48.799447] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-23T22:26:49.157252] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T22:26:49.599461] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-23T22:26:50.325519] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T22:26:50.333006] [INFO ] [REMOTE ] MAGN: Full fetch complete (51849 records). [2025-10-23T22:26:50.333160] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-23T22:26:50.408704] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-23T22:26:50.721294] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-23T22:26:50.721408] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-23T22:26:50.722383] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-23T22:26:50.722474] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-23T22:26:50.723544] [DEBUG] [LOCAL ] MAGN: Trimmed 51849 records to 36410 (keeping 200 days of data) [2025-10-23T22:26:50.836806] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T22:26:50.954251] [DEBUG] [LOCAL ] MAGN: Primary data saved (36410 records). [2025-10-23T22:26:50.954422] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-23T22:26:50.954556] [INFO ] [MAIN ] Update Progress: 1299/2367 symbols completed. MAGN took 29.6s. Estimated remaining: 2h 17m 7s. Rate: 7.8 symbols/min [2025-10-23T22:26:51.120927] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:26:51.166934] [DEBUG] [LOCAL ] MAS: Loaded 52226 existing records from primary storage. [2025-10-23T22:26:51.167261] [INFO ] [MAIN ] MAS: Loaded 52226 existing records. [2025-10-23T22:26:51.209186] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-23T22:26:51.345598] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:26:51.345825] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-23T22:26:51.345901] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-23T22:26:51.346183] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-23T22:26:51.346263] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-23T22:26:51.693184] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:26:51.999404] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-23T22:26:52.097735] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T22:26:52.620677] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T22:26:52.799457] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-23T22:26:53.388448] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T22:26:53.599406] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-23T22:26:54.399482] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-23T22:26:54.526372] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T22:26:54.654455] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:26:55.199440] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-23T22:26:55.999444] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-23T22:26:56.142069] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-23T22:26:56.535751] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T22:26:56.799475] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-23T22:26:57.519502] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:26:57.599407] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-23T22:26:57.683046] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-23T22:26:58.399444] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-23T22:26:59.084792] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T22:26:59.199413] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-23T22:26:59.999437] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-23T22:27:00.038671] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T22:27:00.791235] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T22:27:00.800809] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-23T22:27:01.599433] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-23T22:27:01.744438] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T22:27:02.399518] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-23T22:27:02.609504] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T22:27:02.905339] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T22:27:03.199422] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-23T22:27:03.999418] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-23T22:27:04.151697] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T22:27:04.799423] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-23T22:27:04.900299] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T22:27:05.455595] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T22:27:05.599416] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-23T22:27:06.399426] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-23T22:27:06.751479] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T22:27:06.759240] [INFO ] [REMOTE ] MAIN: Full fetch complete (60347 records). [2025-10-23T22:27:06.759371] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-23T22:27:07.120210] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T22:27:07.164822] [INFO ] [REMOTE ] MANU: Full fetch complete (39465 records). [2025-10-23T22:27:07.167785] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-23T22:27:07.167959] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-23T22:27:07.168031] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-23T22:27:07.169153] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-23T22:27:07.169293] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-23T22:27:07.201078] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-23T22:27:07.274975] [DEBUG] [LOCAL ] MAIN: Trimmed 60347 records to 42219 (keeping 200 days of data) [2025-10-23T22:27:07.671784] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-23T22:27:07.672595] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-23T22:27:07.676127] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-23T22:27:07.679577] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-23T22:27:07.731425] [DEBUG] [LOCAL ] MANU: Trimmed 39465 records to 27359 (keeping 200 days of data) [2025-10-23T22:27:07.924205] [DEBUG] [LOCAL ] MAIN: Primary data saved (42219 records). [2025-10-23T22:27:07.933739] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-23T22:27:07.955602] [INFO ] [MAIN ] Update Progress: 1300/2367 symbols completed. MAIN took 36.4s. Estimated remaining: 2h 17m 7s. Rate: 7.8 symbols/min [2025-10-23T22:27:08.022874] [DEBUG] [LOCAL ] MANU: Primary data saved (27359 records). [2025-10-23T22:27:08.065802] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-23T22:27:08.089537] [INFO ] [MAIN ] Update Progress: 1301/2367 symbols completed. MANU took 24.9s. Estimated remaining: 2h 16m 53s. Rate: 7.8 symbols/min [2025-10-23T22:27:08.278586] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:08.315982] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-23T22:27:08.382815] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:08.383819] [INFO ] [REMOTE ] MAN: Full fetch complete (62892 records). [2025-10-23T22:27:08.384026] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-23T22:27:08.591349] [DEBUG] [LOCAL ] MATV: Loaded 35045 existing records from primary storage. [2025-10-23T22:27:08.619501] [INFO ] [MAIN ] MATV: Loaded 35045 existing records. [2025-10-23T22:27:08.704048] [DEBUG] [LOCAL ] MATX: Loaded 31898 existing records from primary storage. [2025-10-23T22:27:08.759941] [INFO ] [MAIN ] MATX: Loaded 31898 existing records. [2025-10-23T22:27:09.123027] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-23T22:27:09.124685] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-23T22:27:09.131838] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-23T22:27:09.140133] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:09.176854] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-23T22:27:09.176622] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-23T22:27:09.199034] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:09.199124] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-23T22:27:09.199881] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-23T22:27:09.200436] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-23T22:27:09.200623] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-23T22:27:09.200946] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-23T22:27:09.206481] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-23T22:27:09.206582] [DEBUG] [LOCAL ] MAN: Trimmed 62892 records to 44638 (keeping 200 days of data) [2025-10-23T22:27:09.230717] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-23T22:27:09.962237] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-23T22:27:10.119048] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-23T22:27:10.158037] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:10.200040] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-23T22:27:10.258859] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:10.261232] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-23T22:27:10.267969] [DEBUG] [LOCAL ] MAN: Primary data saved (44638 records). [2025-10-23T22:27:10.268078] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-23T22:27:10.268217] [INFO ] [MAIN ] Update Progress: 1302/2367 symbols completed. MAN took 31.1s. Estimated remaining: 2h 16m 41s. Rate: 7.8 symbols/min [2025-10-23T22:27:10.435362] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:10.465195] [DEBUG] [LOCAL ] MAX: Loaded 30725 existing records from primary storage. [2025-10-23T22:27:10.465518] [INFO ] [MAIN ] MAX: Loaded 30725 existing records. [2025-10-23T22:27:10.640549] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:10.640783] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-23T22:27:10.640858] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-23T22:27:10.641044] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-23T22:27:10.641125] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-23T22:27:10.996000] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:10.996499] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-23T22:27:11.547675] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T22:27:11.552879] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-23T22:27:11.643283] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T22:27:12.004555] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-23T22:27:12.023192] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T22:27:12.263248] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T22:27:12.413366] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T22:27:12.799488] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-23T22:27:13.172443] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T22:27:13.599414] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-23T22:27:14.067333] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T22:27:14.399442] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-23T22:27:15.199416] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-23T22:27:15.250353] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T22:27:15.843681] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T22:27:15.999425] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-23T22:27:16.448344] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T22:27:16.799428] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-23T22:27:17.386911] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:27:17.599437] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-23T22:27:18.279705] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T22:27:18.399416] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-23T22:27:18.916934] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-23T22:27:19.199425] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-23T22:27:19.999407] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-23T22:27:20.164918] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T22:27:20.680786] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T22:27:20.799436] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-23T22:27:21.502526] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T22:27:21.599402] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-23T22:27:21.966600] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T22:27:22.399428] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-23T22:27:23.069676] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T22:27:23.199416] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-23T22:27:24.006103] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-23T22:27:24.010170] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T22:27:24.429982] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T22:27:24.799434] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-23T22:27:25.599426] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-23T22:27:25.768687] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T22:27:26.188678] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T22:27:26.399439] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-23T22:27:27.091871] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T22:27:27.199432] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-23T22:27:27.782982] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T22:27:27.999451] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-23T22:27:28.679351] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T22:27:28.742519] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T22:27:28.799401] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-23T22:27:29.599424] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-23T22:27:30.094063] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T22:27:30.099897] [INFO ] [REMOTE ] MAX: Full fetch complete (45114 records). [2025-10-23T22:27:30.100008] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-23T22:27:30.404560] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-23T22:27:30.484045] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-23T22:27:30.484495] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-23T22:27:30.485388] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-23T22:27:30.485470] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-23T22:27:30.486562] [DEBUG] [LOCAL ] MAX: Trimmed 45114 records to 30905 (keeping 200 days of data) [2025-10-23T22:27:30.662323] [DEBUG] [LOCAL ] MAX: Primary data saved (30905 records). [2025-10-23T22:27:30.662486] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-23T22:27:30.662601] [INFO ] [MAIN ] Update Progress: 1303/2367 symbols completed. MAX took 20.4s. Estimated remaining: 2h 16m 44s. Rate: 7.8 symbols/min [2025-10-23T22:27:30.860026] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:30.900889] [DEBUG] [LOCAL ] MBC: Loaded 43879 existing records from primary storage. [2025-10-23T22:27:30.901219] [INFO ] [MAIN ] MBC: Loaded 43879 existing records. [2025-10-23T22:27:31.082414] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:31.089241] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-23T22:27:31.100831] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-23T22:27:31.101377] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-23T22:27:31.102027] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T22:27:31.102144] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-23T22:27:31.205616] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-23T22:27:31.471127] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:31.933856] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T22:27:31.999399] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-23T22:27:32.765469] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T22:27:32.799401] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-23T22:27:32.885224] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T22:27:33.599471] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-23T22:27:34.129579] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T22:27:34.399435] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-23T22:27:34.788338] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T22:27:35.133338] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:27:35.143505] [INFO ] [REMOTE ] MAS: Full fetch complete (75379 records). [2025-10-23T22:27:35.143845] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-23T22:27:35.209144] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-23T22:27:35.548759] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-23T22:27:35.548931] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-23T22:27:35.550497] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-23T22:27:35.550585] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-23T22:27:35.552765] [DEBUG] [LOCAL ] MAS: Trimmed 75379 records to 52573 (keeping 200 days of data) [2025-10-23T22:27:35.899242] [DEBUG] [LOCAL ] MAS: Primary data saved (52573 records). [2025-10-23T22:27:35.899519] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-23T22:27:35.899695] [INFO ] [MAIN ] Update Progress: 1304/2367 symbols completed. MAS took 44.9s. Estimated remaining: 2h 16m 34s. Rate: 7.8 symbols/min [2025-10-23T22:27:36.004716] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-23T22:27:36.083167] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:36.108331] [DEBUG] [LOCAL ] MBI: Loaded 23968 existing records from primary storage. [2025-10-23T22:27:36.108744] [INFO ] [MAIN ] MBI: Loaded 23968 existing records. [2025-10-23T22:27:36.299434] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:36.299749] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-23T22:27:36.299835] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-23T22:27:36.300123] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-23T22:27:36.300204] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-23T22:27:36.626121] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T22:27:36.697955] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:36.799429] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-23T22:27:37.459023] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T22:27:37.464315] [INFO ] [REMOTE ] MATV: Full fetch complete (52140 records). [2025-10-23T22:27:37.464441] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-23T22:27:37.605873] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-23T22:27:37.850515] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-23T22:27:37.850779] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-23T22:27:37.851751] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-23T22:27:37.851830] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-23T22:27:37.852960] [DEBUG] [LOCAL ] MATV: Trimmed 52140 records to 35246 (keeping 200 days of data) [2025-10-23T22:27:38.062525] [DEBUG] [LOCAL ] MATV: Primary data saved (35246 records). [2025-10-23T22:27:38.062712] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-23T22:27:38.062831] [INFO ] [MAIN ] Update Progress: 1305/2367 symbols completed. MATV took 30.1s. Estimated remaining: 2h 16m 22s. Rate: 7.8 symbols/min [2025-10-23T22:27:38.236307] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T22:27:38.253137] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:38.259027] [INFO ] [REMOTE ] MATX: Full fetch complete (43901 records). [2025-10-23T22:27:38.259145] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-23T22:27:38.406049] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-23T22:27:38.591089] [DEBUG] [LOCAL ] MC: Loaded 43670 existing records from primary storage. [2025-10-23T22:27:38.612210] [INFO ] [MAIN ] MC: Loaded 43670 existing records. [2025-10-23T22:27:38.784517] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-23T22:27:38.784697] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-23T22:27:38.791258] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-23T22:27:38.801679] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-23T22:27:38.846461] [DEBUG] [LOCAL ] MATX: Trimmed 43901 records to 32093 (keeping 200 days of data) [2025-10-23T22:27:38.867508] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:38.868390] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-23T22:27:38.868490] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-23T22:27:38.869603] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-23T22:27:38.869757] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-23T22:27:39.361011] [DEBUG] [LOCAL ] MATX: Primary data saved (32093 records). [2025-10-23T22:27:39.366905] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-23T22:27:39.401130] [INFO ] [MAIN ] Update Progress: 1306/2367 symbols completed. MATX took 31.3s. Estimated remaining: 2h 16m 9s. Rate: 7.8 symbols/min [2025-10-23T22:27:39.443097] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:39.477129] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-23T22:27:39.546774] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T22:27:39.643681] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T22:27:39.675019] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:27:39.690223] [DEBUG] [LOCAL ] MCB: Loaded 11254 existing records from primary storage. [2025-10-23T22:27:39.690534] [INFO ] [MAIN ] MCB: Loaded 11254 existing records. [2025-10-23T22:27:39.876015] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:27:39.876200] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-23T22:27:39.876307] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-23T22:27:39.876550] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-23T22:27:39.876705] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-23T22:27:40.004526] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-23T22:27:40.248530] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:27:40.799451] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-23T22:27:40.961450] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T22:27:41.027705] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T22:27:41.599491] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-23T22:27:42.351111] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T22:27:42.399451] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-23T22:27:43.154466] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T22:27:43.199409] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-23T22:27:43.294179] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T22:27:43.999495] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-23T22:27:44.478858] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T22:27:44.794983] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-23T22:27:44.799382] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-23T22:27:45.599410] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-23T22:27:45.718103] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T22:27:46.399426] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-23T22:27:47.208261] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-23T22:27:47.239706] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T22:27:47.847771] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T22:27:47.918524] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T22:27:47.999401] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-23T22:27:48.799424] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-23T22:27:48.885340] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T22:27:49.599430] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-23T22:27:50.399430] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-23T22:27:50.476804] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T22:27:51.022833] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T22:27:51.199438] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-23T22:27:51.562019] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T22:27:51.999427] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-23T22:27:52.685681] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T22:27:52.799406] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-23T22:27:53.599420] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-23T22:27:53.629351] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:27:54.281079] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-23T22:27:54.399409] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-23T22:27:54.732364] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T22:27:55.199456] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-23T22:27:55.972033] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T22:27:55.999473] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T22:27:55.999540] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-23T22:27:56.799415] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-23T22:27:56.923743] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T22:27:57.599483] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-23T22:27:58.399402] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-23T22:27:58.510513] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T22:27:58.625787] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:27:59.199459] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-23T22:27:59.955221] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T22:27:59.999435] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-23T22:28:00.227444] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T22:28:00.799461] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-23T22:28:01.599442] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-23T22:28:01.690493] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T22:28:02.135926] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T22:28:02.144317] [INFO ] [REMOTE ] MBC: Full fetch complete (63157 records). [2025-10-23T22:28:02.144507] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-23T22:28:02.402581] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-23T22:28:02.457942] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T22:28:02.554217] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-23T22:28:02.554344] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-23T22:28:02.555442] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-23T22:28:02.555534] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-23T22:28:02.557040] [DEBUG] [LOCAL ] MBC: Trimmed 63157 records to 44219 (keeping 200 days of data) [2025-10-23T22:28:02.810367] [DEBUG] [LOCAL ] MBC: Primary data saved (44219 records). [2025-10-23T22:28:02.810534] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-23T22:28:02.810668] [INFO ] [MAIN ] Update Progress: 1307/2367 symbols completed. MBC took 32.1s. Estimated remaining: 2h 16m 14s. Rate: 7.8 symbols/min [2025-10-23T22:28:02.985463] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:02.985740] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-23T22:28:02.985816] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-23T22:28:02.985900] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-23T22:28:02.985972] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-23T22:28:02.986055] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-23T22:28:02.986126] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-23T22:28:03.204634] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-23T22:28:03.352583] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:03.972842] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T22:28:03.999407] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-23T22:28:04.168108] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T22:28:04.783143] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T22:28:04.799403] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-23T22:28:05.599415] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-23T22:28:05.662918] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T22:28:05.665792] [INFO ] [REMOTE ] MCB: Full fetch complete (16702 records). [2025-10-23T22:28:05.665907] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-23T22:28:06.066346] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-23T22:28:06.066454] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-23T22:28:06.066866] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-23T22:28:06.066943] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-23T22:28:06.067479] [DEBUG] [LOCAL ] MCB: Trimmed 16702 records to 11348 (keeping 200 days of data) [2025-10-23T22:28:06.134257] [DEBUG] [LOCAL ] MCB: Primary data saved (11348 records). [2025-10-23T22:28:06.134417] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-23T22:28:06.134528] [INFO ] [MAIN ] Update Progress: 1308/2367 symbols completed. MCB took 26.7s. Estimated remaining: 2h 16m 3s. Rate: 7.8 symbols/min [2025-10-23T22:28:06.303016] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:06.311283] [DEBUG] [LOCAL ] MCI: Loaded 6182 existing records from primary storage. [2025-10-23T22:28:06.311505] [INFO ] [MAIN ] MCI: Loaded 6182 existing records. [2025-10-23T22:28:06.408552] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-23T22:28:06.488866] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:06.489170] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-23T22:28:06.489292] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-23T22:28:06.489458] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-23T22:28:06.489525] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-23T22:28:06.872808] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-23T22:28:06.878278] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:07.199439] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-23T22:28:07.894776] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T22:28:07.999434] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-23T22:28:08.799448] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-23T22:28:09.130633] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T22:28:09.134864] [INFO ] [REMOTE ] MBI: Full fetch complete (35798 records). [2025-10-23T22:28:09.134998] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-23T22:28:09.539868] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-23T22:28:09.540015] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-23T22:28:09.540930] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-23T22:28:09.541018] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-23T22:28:09.542304] [DEBUG] [LOCAL ] MBI: Trimmed 35798 records to 24075 (keeping 200 days of data) [2025-10-23T22:28:09.575733] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T22:28:09.577290] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-23T22:28:09.621585] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-23T22:28:09.727094] [DEBUG] [LOCAL ] MBI: Primary data saved (24075 records). [2025-10-23T22:28:09.727260] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-23T22:28:09.727378] [INFO ] [MAIN ] Update Progress: 1309/2367 symbols completed. MBI took 33.8s. Estimated remaining: 2h 15m 52s. Rate: 7.8 symbols/min [2025-10-23T22:28:09.903821] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:09.942346] [DEBUG] [LOCAL ] MCK: Loaded 38009 existing records from primary storage. [2025-10-23T22:28:09.942748] [INFO ] [MAIN ] MCK: Loaded 38009 existing records. [2025-10-23T22:28:10.140830] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:10.141000] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-23T22:28:10.141089] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-23T22:28:10.141320] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-23T22:28:10.141406] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-23T22:28:10.403553] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-23T22:28:10.438340] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T22:28:10.527025] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:11.199462] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-23T22:28:11.999440] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-23T22:28:12.587201] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-23T22:28:12.799478] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-23T22:28:13.137538] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T22:28:13.145286] [INFO ] [REMOTE ] MC: Full fetch complete (63190 records). [2025-10-23T22:28:13.145469] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-23T22:28:13.551362] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-23T22:28:13.551582] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T22:28:13.551889] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-23T22:28:13.554979] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-23T22:28:13.555540] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-23T22:28:13.579581] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T22:28:13.580012] [DEBUG] [LOCAL ] MC: Trimmed 63190 records to 43947 (keeping 200 days of data) [2025-10-23T22:28:13.640922] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-23T22:28:13.852947] [DEBUG] [LOCAL ] MC: Primary data saved (43947 records). [2025-10-23T22:28:13.853108] [INFO ] [MAIN ] MC: Full history saved. [2025-10-23T22:28:13.854256] [INFO ] [MAIN ] Update Progress: 1310/2367 symbols completed. MC took 35.8s. Estimated remaining: 2h 15m 41s. Rate: 7.8 symbols/min [2025-10-23T22:28:14.020436] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:14.030319] [DEBUG] [LOCAL ] MCN: Loaded 7984 existing records from primary storage. [2025-10-23T22:28:14.030573] [INFO ] [MAIN ] MCN: Loaded 7984 existing records. [2025-10-23T22:28:14.207768] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:14.208031] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-23T22:28:14.208106] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-23T22:28:14.208286] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-23T22:28:14.208356] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-23T22:28:14.406931] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-23T22:28:14.568450] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:15.042235] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T22:28:15.199461] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-23T22:28:15.847449] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-23T22:28:15.944437] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T22:28:15.999445] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-23T22:28:16.799514] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-23T22:28:17.542432] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T22:28:17.599486] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-23T22:28:18.242231] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T22:28:18.399412] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-23T22:28:18.415346] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T22:28:19.199437] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-23T22:28:19.893715] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T22:28:19.999424] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-23T22:28:20.023113] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T22:28:20.799460] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-23T22:28:20.863896] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-23T22:28:21.599406] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-23T22:28:21.623841] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T22:28:22.399453] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-23T22:28:22.996199] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T22:28:23.199489] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-23T22:28:23.325067] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T22:28:23.808622] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T22:28:23.999436] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-23T22:28:24.505572] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T22:28:24.799434] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-23T22:28:25.401521] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T22:28:25.403191] [INFO ] [REMOTE ] MCI: Full fetch complete (9772 records). [2025-10-23T22:28:25.403290] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-23T22:28:25.609138] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-23T22:28:25.784465] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-23T22:28:25.784593] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-23T22:28:25.784916] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-23T22:28:25.785003] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-23T22:28:25.785576] [DEBUG] [LOCAL ] MCI: Trimmed 9772 records to 6219 (keeping 200 days of data) [2025-10-23T22:28:25.824037] [DEBUG] [LOCAL ] MCI: Primary data saved (6219 records). [2025-10-23T22:28:25.824214] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-23T22:28:25.824332] [INFO ] [MAIN ] Update Progress: 1311/2367 symbols completed. MCI took 19.7s. Estimated remaining: 2h 15m 37s. Rate: 7.8 symbols/min [2025-10-23T22:28:26.003400] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:26.040362] [DEBUG] [LOCAL ] MCO: Loaded 39425 existing records from primary storage. [2025-10-23T22:28:26.040713] [INFO ] [MAIN ] MCO: Loaded 39425 existing records. [2025-10-23T22:28:26.218414] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:26.218661] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-23T22:28:26.219518] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-23T22:28:26.219786] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-23T22:28:26.219866] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-23T22:28:26.404597] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-23T22:28:26.583028] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:27.199419] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-23T22:28:27.403732] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T22:28:27.558157] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T22:28:27.999449] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-23T22:28:28.694769] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T22:28:28.788152] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T22:28:28.799392] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-23T22:28:29.599445] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-23T22:28:30.399430] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-23T22:28:30.424607] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T22:28:31.199427] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-23T22:28:31.708810] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-23T22:28:31.999419] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-23T22:28:32.199174] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T22:28:32.580233] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-23T22:28:32.756811] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T22:28:32.799398] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-23T22:28:33.510592] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T22:28:33.599426] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-23T22:28:34.266667] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T22:28:34.399437] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-23T22:28:34.972220] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T22:28:34.973982] [INFO ] [REMOTE ] MCN: Full fetch complete (11479 records). [2025-10-23T22:28:34.974089] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-23T22:28:35.204618] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-23T22:28:35.341713] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-23T22:28:35.341822] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-23T22:28:35.342121] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-23T22:28:35.342200] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-23T22:28:35.342697] [DEBUG] [LOCAL ] MCN: Trimmed 11479 records to 8036 (keeping 200 days of data) [2025-10-23T22:28:35.390314] [DEBUG] [LOCAL ] MCN: Primary data saved (8036 records). [2025-10-23T22:28:35.390498] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-23T22:28:35.390615] [INFO ] [MAIN ] Update Progress: 1312/2367 symbols completed. MCN took 21.5s. Estimated remaining: 2h 15m 31s. Rate: 7.8 symbols/min [2025-10-23T22:28:35.556415] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:35.566882] [DEBUG] [LOCAL ] MCR: Loaded 8866 existing records from primary storage. [2025-10-23T22:28:35.567085] [INFO ] [MAIN ] MCR: Loaded 8866 existing records. [2025-10-23T22:28:35.747284] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:35.747563] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-23T22:28:35.747682] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-23T22:28:35.747944] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-23T22:28:35.748040] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-23T22:28:36.004779] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-23T22:28:36.114344] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:36.799423] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-23T22:28:37.136991] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T22:28:37.599470] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-23T22:28:37.759957] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T22:28:38.399495] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-23T22:28:39.073857] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T22:28:39.199403] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-23T22:28:39.417307] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-23T22:28:39.538838] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T22:28:39.794369] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T22:28:39.999457] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-23T22:28:40.722961] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T22:28:40.799442] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-23T22:28:41.599488] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-23T22:28:42.399429] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-23T22:28:42.958410] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-23T22:28:43.051067] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T22:28:43.051782] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T22:28:43.199414] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-23T22:28:43.999496] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-23T22:28:44.780615] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:28:44.804203] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-23T22:28:44.805367] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T22:28:45.599494] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-23T22:28:46.341366] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T22:28:46.371201] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T22:28:46.399395] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-23T22:28:47.129024] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T22:28:47.199448] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-23T22:28:47.946783] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T22:28:47.999451] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-23T22:28:48.799500] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-23T22:28:49.601011] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-23T22:28:49.603250] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T22:28:49.676413] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T22:28:50.399447] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-23T22:28:51.199470] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-23T22:28:51.298488] [DEBUG] [REMOTE ] MCO: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-23T22:28:51.298914] [WARN ] [REMOTE ] MCO: No data returned for month 2025-08 [2025-10-23T22:28:51.299021] [FATAL] [REMOTE ] MCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:28:51.299163] [FATAL] [MAIN ] MCO: Failed to fetch primary data. [2025-10-23T22:28:51.299259] [WARN ] [MAIN ] MCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:28:51.299358] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-23T22:28:51.299492] [DEBUG] [LOCAL ] MCO: No primary data file found to delete. [2025-10-23T22:28:51.299593] [INFO ] [LOCAL ] MCO: Starting deletion of derivative data. [2025-10-23T22:28:51.299888] [DEBUG] [LOCAL ] MCO: Deleted derivative data file. [2025-10-23T22:28:51.300010] [INFO ] [MAIN ] Update Progress: 1313/2367 symbols completed. MCO took 25.5s. Estimated remaining: 2h 15m 29s. Rate: 7.8 symbols/min [2025-10-23T22:28:51.492732] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:51.515336] [DEBUG] [LOCAL ] MCS: Loaded 21186 existing records from primary storage. [2025-10-23T22:28:51.515622] [INFO ] [MAIN ] MCS: Loaded 21186 existing records. [2025-10-23T22:28:51.711788] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:51.712078] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-23T22:28:51.712160] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-23T22:28:51.712405] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-23T22:28:51.712514] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-23T22:28:51.981746] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-23T22:28:52.004505] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-23T22:28:52.138710] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:52.160000] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T22:28:52.671638] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T22:28:52.799418] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-23T22:28:53.404216] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T22:28:53.410129] [INFO ] [REMOTE ] MCK: Full fetch complete (56529 records). [2025-10-23T22:28:53.410320] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-23T22:28:53.619822] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-23T22:28:53.864052] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-23T22:28:53.864197] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-23T22:28:53.865601] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-23T22:28:53.865714] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-23T22:28:53.867082] [DEBUG] [LOCAL ] MCK: Trimmed 56529 records to 38261 (keeping 200 days of data) [2025-10-23T22:28:54.110194] [DEBUG] [LOCAL ] MCK: Primary data saved (38261 records). [2025-10-23T22:28:54.110386] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-23T22:28:54.110481] [INFO ] [MAIN ] Update Progress: 1314/2367 symbols completed. MCK took 44.4s. Estimated remaining: 2h 15m 18s. Rate: 7.8 symbols/min [2025-10-23T22:28:54.287157] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:54.309379] [DEBUG] [LOCAL ] MCY: Loaded 23567 existing records from primary storage. [2025-10-23T22:28:54.309691] [INFO ] [MAIN ] MCY: Loaded 23567 existing records. [2025-10-23T22:28:54.408337] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-23T22:28:54.478929] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T22:28:54.503073] [INFO ] [REMOTE ] MCR: Full fetch complete (13446 records). [2025-10-23T22:28:54.502931] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:54.503602] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-23T22:28:54.503453] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-23T22:28:54.503936] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-23T22:28:54.547937] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-23T22:28:54.574299] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-23T22:28:55.190293] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-23T22:28:55.200688] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-23T22:28:55.200770] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-23T22:28:55.240144] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-23T22:28:55.241134] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-23T22:28:55.265220] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:55.266623] [DEBUG] [LOCAL ] MCR: Trimmed 13446 records to 8908 (keeping 200 days of data) [2025-10-23T22:28:55.318693] [DEBUG] [LOCAL ] MCR: Primary data saved (8908 records). [2025-10-23T22:28:55.318858] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-23T22:28:55.318980] [INFO ] [MAIN ] Update Progress: 1315/2367 symbols completed. MCR took 19.9s. Estimated remaining: 2h 15m 5s. Rate: 7.8 symbols/min [2025-10-23T22:28:55.508362] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:55.510555] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T22:28:55.555822] [DEBUG] [LOCAL ] MD: Loaded 38572 existing records from primary storage. [2025-10-23T22:28:55.556150] [INFO ] [MAIN ] MD: Loaded 38572 existing records. [2025-10-23T22:28:55.734630] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:55.734921] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-23T22:28:55.734999] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-23T22:28:55.735240] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-23T22:28:55.735313] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-23T22:28:56.011087] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-23T22:28:56.096260] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:56.122993] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T22:28:56.132303] [INFO ] [REMOTE ] MCD: Full fetch complete (77125 records). [2025-10-23T22:28:56.132468] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-23T22:28:56.322376] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T22:28:56.323176] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:28:56.323251] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:28:56.323323] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-23T22:28:56.323419] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-23T22:28:56.323491] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-23T22:28:56.323570] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-23T22:28:56.323688] [INFO ] [MAIN ] Update Progress: 1316/2367 symbols completed. MCD took 53.5s. Estimated remaining: 2h 14m 52s. Rate: 7.8 symbols/min [2025-10-23T22:28:56.487168] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:28:56.495278] [DEBUG] [LOCAL ] MDST: Loaded 6110 existing records from primary storage. [2025-10-23T22:28:56.495518] [INFO ] [MAIN ] MDST: Loaded 6110 existing records. [2025-10-23T22:28:56.672383] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:28:56.673261] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-23T22:28:56.673337] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-23T22:28:56.673539] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-23T22:28:56.673612] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-23T22:28:56.809827] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-23T22:28:57.047232] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:28:57.066835] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T22:28:57.599440] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-23T22:28:58.399455] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-23T22:28:58.539732] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T22:28:58.803845] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T22:28:59.020422] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-23T22:28:59.199423] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-23T22:28:59.823845] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T22:28:59.999453] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-23T22:29:00.799457] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-23T22:29:01.471283] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T22:29:01.599485] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-23T22:29:01.899419] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T22:29:02.399449] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-23T22:29:03.095625] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T22:29:03.199429] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-23T22:29:03.488413] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T22:29:03.594167] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-23T22:29:03.999467] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-23T22:29:04.799415] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-23T22:29:05.063284] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T22:29:05.599517] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-23T22:29:06.080499] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T22:29:06.399457] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-23T22:29:06.946359] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T22:29:07.199439] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-23T22:29:07.761982] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T22:29:07.788402] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T22:29:07.999439] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-23T22:29:08.689062] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T22:29:08.799457] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-23T22:29:09.599526] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-23T22:29:09.700270] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T22:29:10.399528] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-23T22:29:11.077237] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T22:29:11.199441] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-23T22:29:11.491935] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T22:29:11.999454] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-23T22:29:12.670966] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T22:29:12.799450] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-23T22:29:13.200678] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T22:29:13.599442] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-23T22:29:14.384036] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T22:29:14.399415] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-23T22:29:14.766001] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T22:29:15.008533] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T22:29:15.199438] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-23T22:29:15.857704] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T22:29:15.999469] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-23T22:29:16.799465] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-23T22:29:17.415100] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T22:29:17.427945] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T22:29:17.599443] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-23T22:29:18.399445] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-23T22:29:18.424614] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T22:29:19.199483] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-23T22:29:19.388319] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-23T22:29:19.990306] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T22:29:19.992462] [INFO ] [REMOTE ] MDST: Full fetch complete (8848 records). [2025-10-23T22:29:19.992613] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-23T22:29:20.004592] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-23T22:29:20.376832] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-23T22:29:20.376947] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-23T22:29:20.377201] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-23T22:29:20.377277] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-23T22:29:20.377745] [DEBUG] [LOCAL ] MDST: Trimmed 8848 records to 6167 (keeping 200 days of data) [2025-10-23T22:29:20.417699] [DEBUG] [LOCAL ] MDST: Primary data saved (6167 records). [2025-10-23T22:29:20.417849] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-23T22:29:20.418005] [INFO ] [MAIN ] Update Progress: 1317/2367 symbols completed. MDST took 24.1s. Estimated remaining: 2h 14m 57s. Rate: 7.8 symbols/min [2025-10-23T22:29:20.799484] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-23T22:29:21.599423] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-23T22:29:21.670602] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T22:29:21.871112] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T22:29:22.399423] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-23T22:29:22.474810] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-23T22:29:23.199441] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-23T22:29:23.966603] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T22:29:23.999402] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-23T22:29:24.325617] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T22:29:24.799453] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-23T22:29:25.468297] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T22:29:25.599417] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-23T22:29:25.811200] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T22:29:25.815787] [INFO ] [REMOTE ] MCS: Full fetch complete (30640 records). [2025-10-23T22:29:25.815920] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-23T22:29:26.196490] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-23T22:29:26.196598] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-23T22:29:26.197256] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-23T22:29:26.197331] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-23T22:29:26.198138] [DEBUG] [LOCAL ] MCS: Trimmed 30640 records to 21310 (keeping 200 days of data) [2025-10-23T22:29:26.320543] [DEBUG] [LOCAL ] MCS: Primary data saved (21310 records). [2025-10-23T22:29:26.320724] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-23T22:29:26.320835] [INFO ] [MAIN ] Update Progress: 1318/2367 symbols completed. MCS took 35.0s. Estimated remaining: 2h 14m 48s. Rate: 7.8 symbols/min [2025-10-23T22:29:26.399446] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-23T22:29:26.987637] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-23T22:29:26.994965] [INFO ] [REMOTE ] MD: Full fetch complete (55236 records). [2025-10-23T22:29:26.995154] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-23T22:29:27.391638] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-23T22:29:27.391840] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-23T22:29:27.392964] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-23T22:29:27.393164] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-23T22:29:27.394462] [DEBUG] [LOCAL ] MD: Trimmed 55236 records to 38809 (keeping 200 days of data) [2025-10-23T22:29:27.493277] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T22:29:27.530332] [INFO ] [REMOTE ] MCY: Full fetch complete (40726 records). [2025-10-23T22:29:27.530563] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-23T22:29:27.748580] [DEBUG] [LOCAL ] MD: Primary data saved (38809 records). [2025-10-23T22:29:27.764510] [INFO ] [MAIN ] MD: Full history saved. [2025-10-23T22:29:27.764703] [INFO ] [MAIN ] Update Progress: 1319/2367 symbols completed. MD took 32.4s. Estimated remaining: 2h 14m 35s. Rate: 7.8 symbols/min [2025-10-23T22:29:28.020981] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-23T22:29:28.021102] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-23T22:29:28.021884] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-23T22:29:28.021960] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-23T22:29:28.022820] [DEBUG] [LOCAL ] MCY: Trimmed 40726 records to 23681 (keeping 200 days of data) [2025-10-23T22:29:28.161782] [DEBUG] [LOCAL ] MCY: Primary data saved (23681 records). [2025-10-23T22:29:28.161933] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-23T22:29:28.162042] [INFO ] [MAIN ] Update Progress: 1320/2367 symbols completed. MCY took 34.1s. Estimated remaining: 2h 14m 22s. Rate: 7.8 symbols/min [2025-10-23T22:29:28.820584] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:29:28.874047] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:29:28.870564] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:29:28.893344] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:29:28.906248] [DEBUG] [LOCAL ] MDV: Loaded 8298 existing records from primary storage. [2025-10-23T22:29:28.906815] [INFO ] [MAIN ] MDV: Loaded 8298 existing records. [2025-10-23T22:29:29.017941] [DEBUG] [LOCAL ] MEC: Loaded 16914 existing records from primary storage. [2025-10-23T22:29:29.035875] [INFO ] [MAIN ] MEC: Loaded 16914 existing records. [2025-10-23T22:29:29.257613] [DEBUG] [LOCAL ] MDU: Loaded 48009 existing records from primary storage. [2025-10-23T22:29:29.263620] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-23T22:29:29.262279] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:29:29.264510] [INFO ] [MAIN ] MDU: Loaded 48009 existing records. [2025-10-23T22:29:29.291256] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-23T22:29:29.315790] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-23T22:29:29.285836] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-23T22:29:29.422942] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:29:29.431759] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-23T22:29:29.437234] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-23T22:29:29.461891] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-23T22:29:29.437309] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-23T22:29:29.572983] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-23T22:29:29.687820] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-23T22:29:29.761263] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:29:29.858238] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-23T22:29:29.883183] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-23T22:29:29.924158] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-23T22:29:29.995032] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:29:30.105156] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-23T22:29:30.104937] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-23T22:29:30.131805] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-23T22:29:30.218954] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-23T22:29:30.230086] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-23T22:29:30.533754] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:29:30.565945] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-23T22:29:31.100846] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:29:31.122952] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-23T22:29:31.203854] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:29:31.243125] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-23T22:29:31.278451] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:29:31.278927] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-23T22:29:31.280223] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T22:29:31.282244] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-23T22:29:31.917802] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T22:29:31.919857] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-23T22:29:32.242205] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T22:29:32.246200] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-23T22:29:32.713161] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T22:29:32.715592] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T22:29:32.740221] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-23T22:29:32.799401] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-23T22:29:33.217185] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T22:29:33.599516] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-23T22:29:33.820137] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T22:29:34.399447] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-23T22:29:35.041463] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T22:29:35.199433] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-23T22:29:35.991350] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T22:29:35.999390] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-23T22:29:36.239501] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T22:29:36.791244] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:29:36.799383] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-23T22:29:37.604870] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-23T22:29:37.608418] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T22:29:38.399448] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-23T22:29:38.567434] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T22:29:39.199467] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-23T22:29:39.951147] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T22:29:39.999463] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-23T22:29:40.163003] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T22:29:40.799420] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-23T22:29:40.984438] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-23T22:29:41.599466] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-23T22:29:42.399473] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-23T22:29:42.546382] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T22:29:42.603205] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T22:29:43.199449] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-23T22:29:43.999429] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-23T22:29:44.134298] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T22:29:44.411442] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T22:29:44.799487] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-23T22:29:45.599443] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-23T22:29:45.630023] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:29:46.399488] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-23T22:29:46.689833] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T22:29:46.870394] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T22:29:47.199462] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-23T22:29:48.000127] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-23T22:29:48.000005] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T22:29:48.799415] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-23T22:29:48.970136] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T22:29:49.159139] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-23T22:29:49.599438] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-23T22:29:49.658036] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T22:29:50.399446] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-23T22:29:51.019694] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T22:29:51.199425] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-23T22:29:51.374484] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T22:29:51.847836] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:29:51.849568] [INFO ] [REMOTE ] MDV: Full fetch complete (11664 records). [2025-10-23T22:29:51.849703] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-23T22:29:52.002566] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-23T22:29:52.208542] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-23T22:29:52.208689] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-23T22:29:52.209055] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-23T22:29:52.209153] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-23T22:29:52.209721] [DEBUG] [LOCAL ] MDV: Trimmed 11664 records to 8334 (keeping 200 days of data) [2025-10-23T22:29:52.259596] [DEBUG] [LOCAL ] MDV: Primary data saved (8334 records). [2025-10-23T22:29:52.259775] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-23T22:29:52.259901] [INFO ] [MAIN ] Update Progress: 1321/2367 symbols completed. MDV took 24.1s. Estimated remaining: 2h 14m 27s. Rate: 7.8 symbols/min [2025-10-23T22:29:52.427168] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:29:52.446527] [DEBUG] [LOCAL ] MED: Loaded 20919 existing records from primary storage. [2025-10-23T22:29:52.446828] [INFO ] [MAIN ] MED: Loaded 20919 existing records. [2025-10-23T22:29:52.618057] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:29:52.618297] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-23T22:29:52.618375] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-23T22:29:52.618777] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-23T22:29:52.618852] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-23T22:29:52.809077] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-23T22:29:52.992880] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:29:53.599419] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-23T22:29:53.795519] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T22:29:54.023553] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T22:29:54.027315] [INFO ] [REMOTE ] MEC: Full fetch complete (23195 records). [2025-10-23T22:29:54.027426] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-23T22:29:54.392094] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-23T22:29:54.392225] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-23T22:29:54.392830] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-23T22:29:54.392928] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-23T22:29:54.393705] [DEBUG] [LOCAL ] MEC: Trimmed 23195 records to 17069 (keeping 200 days of data) [2025-10-23T22:29:54.432807] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-23T22:29:54.493557] [DEBUG] [LOCAL ] MEC: Primary data saved (17069 records). [2025-10-23T22:29:54.493741] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-23T22:29:54.493852] [INFO ] [MAIN ] Update Progress: 1322/2367 symbols completed. MEC took 26.3s. Estimated remaining: 2h 14m 15s. Rate: 7.8 symbols/min [2025-10-23T22:29:54.671995] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:29:54.703419] [DEBUG] [LOCAL ] MEG: Loaded 31527 existing records from primary storage. [2025-10-23T22:29:54.703762] [INFO ] [MAIN ] MEG: Loaded 31527 existing records. [2025-10-23T22:29:54.898457] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:29:54.899970] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T22:29:54.900179] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-23T22:29:54.905762] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-23T22:29:54.906020] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-23T22:29:54.906096] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-23T22:29:55.214747] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-23T22:29:55.254215] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:29:55.999447] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-23T22:29:56.371720] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T22:29:56.536618] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T22:29:56.799440] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-23T22:29:57.360427] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T22:29:57.599447] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-23T22:29:58.399419] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-23T22:29:58.741544] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-23T22:29:59.199410] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-23T22:29:59.322842] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T22:29:59.662510] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T22:29:59.999416] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-23T22:30:00.385243] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T22:30:00.799534] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-23T22:30:01.599520] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-23T22:30:01.731435] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T22:30:02.399480] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-23T22:30:02.737424] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T22:30:02.844031] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T22:30:03.199466] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-23T22:30:03.709171] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T22:30:03.721766] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-23T22:30:03.722098] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-23T22:30:04.009688] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-23T22:30:04.217066] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-23T22:30:04.217249] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-23T22:30:04.218630] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-23T22:30:04.220292] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-23T22:30:04.220236] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T22:30:04.229542] [INFO ] [REMOTE ] MDU: Full fetch complete (70695 records). [2025-10-23T22:30:04.229872] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-23T22:30:04.230759] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 54068 (keeping 200 days of data) [2025-10-23T22:30:04.753075] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-23T22:30:04.754217] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-23T22:30:04.755499] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-23T22:30:04.760172] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-23T22:30:04.776711] [DEBUG] [LOCAL ] MDU: Trimmed 70695 records to 48379 (keeping 200 days of data) [2025-10-23T22:30:04.829330] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-23T22:30:05.233040] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-10-23T22:30:05.241420] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-23T22:30:05.242563] [INFO ] [MAIN ] Update Progress: 1323/2367 symbols completed. MDT took 37.1s. Estimated remaining: 2h 14m 10s. Rate: 7.8 symbols/min [2025-10-23T22:30:05.507530] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:05.520684] [DEBUG] [LOCAL ] MDU: Primary data saved (48379 records). [2025-10-23T22:30:05.521027] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-23T22:30:05.521169] [INFO ] [MAIN ] Update Progress: 1324/2367 symbols completed. MDU took 37.3s. Estimated remaining: 2h 13m 56s. Rate: 7.8 symbols/min [2025-10-23T22:30:05.688814] [DEBUG] [LOCAL ] MEGI: Loaded 19699 existing records from primary storage. [2025-10-23T22:30:05.706131] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T22:30:05.713267] [INFO ] [MAIN ] MEGI: Loaded 19699 existing records. [2025-10-23T22:30:05.788729] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-23T22:30:05.759396] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:05.939225] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:05.939802] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-23T22:30:05.940049] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-23T22:30:05.945503] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-23T22:30:05.953409] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-23T22:30:06.011450] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T22:30:06.096928] [DEBUG] [LOCAL ] MEI: Loaded 31216 existing records from primary storage. [2025-10-23T22:30:06.109070] [INFO ] [MAIN ] MEI: Loaded 31216 existing records. [2025-10-23T22:30:06.423923] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-23T22:30:06.488297] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:06.516137] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-23T22:30:06.536455] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-23T22:30:06.547956] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-23T22:30:06.572412] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-23T22:30:06.579369] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:06.947724] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:07.199440] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-23T22:30:07.318479] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T22:30:07.564627] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T22:30:07.999492] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-23T22:30:08.581790] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T22:30:08.799446] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-23T22:30:09.313364] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T22:30:09.599495] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-23T22:30:10.095889] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T22:30:10.399437] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-23T22:30:10.747549] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T22:30:11.199488] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-23T22:30:11.411157] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T22:30:11.999446] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-23T22:30:12.629572] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T22:30:12.799426] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-23T22:30:13.245884] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T22:30:13.599412] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-23T22:30:13.891574] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T22:30:14.399435] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-23T22:30:14.874481] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T22:30:15.199449] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-23T22:30:15.882976] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T22:30:15.916017] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:30:15.919885] [INFO ] [REMOTE ] MED: Full fetch complete (31826 records). [2025-10-23T22:30:15.920011] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-23T22:30:16.004504] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-23T22:30:16.311988] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-23T22:30:16.312109] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-23T22:30:16.312787] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-23T22:30:16.312902] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-23T22:30:16.313681] [DEBUG] [LOCAL ] MED: Trimmed 31826 records to 21092 (keeping 200 days of data) [2025-10-23T22:30:16.431315] [DEBUG] [LOCAL ] MED: Primary data saved (21092 records). [2025-10-23T22:30:16.431464] [INFO ] [MAIN ] MED: Full history saved. [2025-10-23T22:30:16.431572] [INFO ] [MAIN ] Update Progress: 1325/2367 symbols completed. MED took 24.2s. Estimated remaining: 2h 13m 51s. Rate: 7.8 symbols/min [2025-10-23T22:30:16.603738] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:16.652103] [DEBUG] [LOCAL ] MET: Loaded 53300 existing records from primary storage. [2025-10-23T22:30:16.652435] [INFO ] [MAIN ] MET: Loaded 53300 existing records. [2025-10-23T22:30:16.804550] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-23T22:30:16.840410] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:16.840595] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-23T22:30:16.840724] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-23T22:30:16.840998] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-23T22:30:16.841084] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-23T22:30:17.239264] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:17.290291] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T22:30:17.599551] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-23T22:30:17.970738] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T22:30:18.399474] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-23T22:30:19.199420] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-23T22:30:19.338094] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:30:19.541106] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T22:30:19.999485] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-23T22:30:20.375550] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T22:30:20.799483] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-23T22:30:21.059420] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:30:21.599488] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-23T22:30:22.340244] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T22:30:22.399426] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-23T22:30:22.808009] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T22:30:23.199482] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-23T22:30:23.999421] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-23T22:30:24.209772] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T22:30:24.248710] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T22:30:24.799486] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-23T22:30:25.213978] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-23T22:30:25.599430] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-23T22:30:25.761288] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T22:30:26.399457] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-23T22:30:26.747827] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T22:30:27.199495] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-23T22:30:27.999448] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-23T22:30:28.204819] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T22:30:28.243765] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T22:30:28.799490] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-23T22:30:29.401933] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T22:30:29.599466] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-23T22:30:29.927357] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T22:30:30.399496] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-23T22:30:31.034150] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T22:30:31.199453] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-23T22:30:31.461060] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T22:30:31.999434] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-23T22:30:32.333443] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T22:30:32.338756] [INFO ] [REMOTE ] MEI: Full fetch complete (45434 records). [2025-10-23T22:30:32.338882] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-23T22:30:32.693688] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T22:30:32.753466] [INFO ] [REMOTE ] MEGI: Full fetch complete (28953 records). [2025-10-23T22:30:32.765369] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-23T22:30:32.765663] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-23T22:30:32.766996] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-23T22:30:32.767099] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-23T22:30:32.767420] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-23T22:30:32.800582] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-23T22:30:32.868936] [DEBUG] [LOCAL ] MEI: Trimmed 45434 records to 31496 (keeping 200 days of data) [2025-10-23T22:30:33.250158] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-23T22:30:33.250910] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-23T22:30:33.251966] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-23T22:30:33.252322] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-23T22:30:33.257316] [DEBUG] [LOCAL ] MEGI: Trimmed 28953 records to 19865 (keeping 200 days of data) [2025-10-23T22:30:33.428954] [DEBUG] [LOCAL ] MEI: Primary data saved (31496 records). [2025-10-23T22:30:33.432705] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-23T22:30:33.435668] [INFO ] [MAIN ] Update Progress: 1326/2367 symbols completed. MEI took 27.9s. Estimated remaining: 2h 13m 51s. Rate: 7.8 symbols/min [2025-10-23T22:30:33.617337] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-23T22:30:33.620453] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:33.635942] [DEBUG] [LOCAL ] MEGI: Primary data saved (19865 records). [2025-10-23T22:30:33.636216] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-23T22:30:33.636360] [INFO ] [MAIN ] Update Progress: 1327/2367 symbols completed. MEGI took 28.4s. Estimated remaining: 2h 13m 37s. Rate: 7.8 symbols/min [2025-10-23T22:30:33.827855] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:33.842102] [DEBUG] [LOCAL ] MFA: Loaded 45582 existing records from primary storage. [2025-10-23T22:30:33.842561] [INFO ] [MAIN ] MFA: Loaded 45582 existing records. [2025-10-23T22:30:33.949893] [DEBUG] [LOCAL ] MFAN: Loaded 4309 existing records from primary storage. [2025-10-23T22:30:33.950701] [INFO ] [MAIN ] MFAN: Loaded 4309 existing records. [2025-10-23T22:30:34.104807] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:34.132159] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-23T22:30:34.132542] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-23T22:30:34.153598] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-23T22:30:34.176362] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-23T22:30:34.224263] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:34.249679] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-23T22:30:34.276531] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-23T22:30:34.293450] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-23T22:30:34.314745] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-23T22:30:34.629986] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T22:30:34.766428] [INFO ] [REMOTE ] MEG: Full fetch complete (47464 records). [2025-10-23T22:30:34.839970] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:34.868116] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-23T22:30:34.868439] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-23T22:30:35.105199] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:35.214742] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-23T22:30:35.393037] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-23T22:30:35.393189] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-23T22:30:35.394108] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-23T22:30:35.394186] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-23T22:30:35.395379] [DEBUG] [LOCAL ] MEG: Trimmed 47464 records to 31806 (keeping 200 days of data) [2025-10-23T22:30:35.574899] [DEBUG] [LOCAL ] MEG: Primary data saved (31806 records). [2025-10-23T22:30:35.575157] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-23T22:30:35.575288] [INFO ] [MAIN ] Update Progress: 1328/2367 symbols completed. MEG took 41.1s. Estimated remaining: 2h 13m 25s. Rate: 7.8 symbols/min [2025-10-23T22:30:35.780570] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:35.755619] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T22:30:35.796382] [DEBUG] [LOCAL ] MFAO: Loaded 3896 existing records from primary storage. [2025-10-23T22:30:35.796667] [INFO ] [MAIN ] MFAO: Loaded 3896 existing records. [2025-10-23T22:30:35.881094] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T22:30:35.978281] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:35.978491] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-23T22:30:35.978565] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-23T22:30:35.978812] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-23T22:30:35.978885] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-23T22:30:36.009136] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-23T22:30:36.336066] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:36.394445] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-23T22:30:36.653931] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T22:30:36.799495] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-23T22:30:37.163261] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-23T22:30:37.599492] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-23T22:30:38.399500] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-23T22:30:38.887556] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-23T22:30:39.156335] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T22:30:39.199450] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-23T22:30:39.999429] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-23T22:30:40.582268] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T22:30:40.799470] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-23T22:30:40.950680] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T22:30:41.176672] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-23T22:30:41.599496] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-23T22:30:42.235267] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T22:30:42.399475] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-23T22:30:43.199432] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-23T22:30:43.999405] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-23T22:30:44.048932] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T22:30:44.597858] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T22:30:44.799411] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-23T22:30:44.938767] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T22:30:45.393751] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T22:30:45.599487] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-23T22:30:46.235716] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T22:30:46.399489] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-23T22:30:47.161793] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T22:30:47.199425] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-23T22:30:47.808878] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T22:30:47.999477] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-23T22:30:48.569520] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-23T22:30:48.799431] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-23T22:30:49.599434] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-23T22:30:50.187262] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T22:30:50.294963] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T22:30:50.399440] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-23T22:30:50.978201] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T22:30:51.199433] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-23T22:30:51.793491] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T22:30:51.999430] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-23T22:30:52.618421] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T22:30:52.619882] [INFO ] [REMOTE ] MFAN: Full fetch complete (5990 records). [2025-10-23T22:30:52.619971] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-23T22:30:52.809430] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-23T22:30:53.005924] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-23T22:30:53.006049] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-23T22:30:53.006258] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-23T22:30:53.006337] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-23T22:30:53.006796] [DEBUG] [LOCAL ] MFAN: Trimmed 5990 records to 4331 (keeping 200 days of data) [2025-10-23T22:30:53.032020] [DEBUG] [LOCAL ] MFAN: Primary data saved (4331 records). [2025-10-23T22:30:53.032113] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-23T22:30:53.032216] [INFO ] [MAIN ] Update Progress: 1329/2367 symbols completed. MFAN took 19.4s. Estimated remaining: 2h 13m 25s. Rate: 7.8 symbols/min [2025-10-23T22:30:53.199046] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:53.245156] [DEBUG] [LOCAL ] MFC: Loaded 50997 existing records from primary storage. [2025-10-23T22:30:53.245475] [INFO ] [MAIN ] MFC: Loaded 50997 existing records. [2025-10-23T22:30:53.428085] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:53.428311] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-23T22:30:53.428388] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-23T22:30:53.428608] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-23T22:30:53.428713] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-23T22:30:53.526082] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T22:30:53.611175] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-23T22:30:53.817806] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:54.180964] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T22:30:54.399439] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-23T22:30:54.882347] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T22:30:54.883621] [INFO ] [REMOTE ] MFAO: Full fetch complete (5455 records). [2025-10-23T22:30:54.883752] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-23T22:30:55.204525] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-23T22:30:55.247025] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-23T22:30:55.247141] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-23T22:30:55.247369] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-23T22:30:55.247447] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-23T22:30:55.248005] [DEBUG] [LOCAL ] MFAO: Trimmed 5455 records to 3900 (keeping 200 days of data) [2025-10-23T22:30:55.275799] [DEBUG] [LOCAL ] MFAO: Primary data saved (3900 records). [2025-10-23T22:30:55.275982] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-23T22:30:55.276117] [INFO ] [MAIN ] Update Progress: 1330/2367 symbols completed. MFAO took 19.7s. Estimated remaining: 2h 13m 13s. Rate: 7.8 symbols/min [2025-10-23T22:30:55.443597] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:30:55.486261] [DEBUG] [LOCAL ] MFG: Loaded 49552 existing records from primary storage. [2025-10-23T22:30:55.486589] [INFO ] [MAIN ] MFG: Loaded 49552 existing records. [2025-10-23T22:30:55.662755] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:30:55.663005] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-23T22:30:55.663081] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-23T22:30:55.663395] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-23T22:30:55.663477] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-23T22:30:55.999453] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-23T22:30:56.020368] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:30:56.799422] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-23T22:30:57.013914] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T22:30:57.599449] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-23T22:30:57.920499] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T22:30:58.336314] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T22:30:58.399449] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-23T22:30:59.199470] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-23T22:30:59.318751] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T22:30:59.999430] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-23T22:31:00.113110] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T22:31:00.799464] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-23T22:31:00.865950] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T22:31:01.599468] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-23T22:31:01.772180] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:31:02.191287] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T22:31:02.399455] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-23T22:31:03.199507] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-23T22:31:03.406688] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T22:31:04.004529] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-23T22:31:04.026892] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T22:31:04.750200] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:31:04.759605] [INFO ] [REMOTE ] MET: Full fetch complete (77361 records). [2025-10-23T22:31:04.759820] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-23T22:31:04.803472] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-23T22:31:05.143829] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T22:31:05.211910] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-23T22:31:05.212314] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-23T22:31:05.213411] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-23T22:31:05.213490] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-23T22:31:05.214884] [DEBUG] [LOCAL ] MET: Trimmed 77361 records to 53677 (keeping 200 days of data) [2025-10-23T22:31:05.552550] [DEBUG] [LOCAL ] MET: Primary data saved (53677 records). [2025-10-23T22:31:05.552758] [INFO ] [MAIN ] MET: Full history saved. [2025-10-23T22:31:05.554166] [INFO ] [MAIN ] Update Progress: 1331/2367 symbols completed. MET took 49.1s. Estimated remaining: 2h 13m 7s. Rate: 7.8 symbols/min [2025-10-23T22:31:05.610730] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-23T22:31:05.757986] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:05.779632] [DEBUG] [LOCAL ] MFM: Loaded 14090 existing records from primary storage. [2025-10-23T22:31:05.779969] [INFO ] [MAIN ] MFM: Loaded 14090 existing records. [2025-10-23T22:31:05.955003] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:05.955252] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-23T22:31:05.955331] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-23T22:31:05.955539] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-23T22:31:05.955616] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-23T22:31:06.335950] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:06.399402] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-23T22:31:06.659711] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T22:31:06.833261] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-23T22:31:07.170451] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T22:31:07.199428] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-23T22:31:07.999474] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-23T22:31:08.799410] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-23T22:31:08.943794] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T22:31:09.399436] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T22:31:09.599505] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-23T22:31:09.773626] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T22:31:10.399507] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-23T22:31:11.149342] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T22:31:11.199394] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-23T22:31:11.282865] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:31:11.999443] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-23T22:31:12.799414] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-23T22:31:12.907214] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:31:13.182448] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T22:31:13.599432] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-23T22:31:14.381946] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T22:31:14.399393] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-23T22:31:15.199447] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-23T22:31:15.436899] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:31:15.999412] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-23T22:31:16.012519] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T22:31:16.397834] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T22:31:16.799434] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-23T22:31:17.599454] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-23T22:31:17.654493] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T22:31:17.910791] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T22:31:18.399478] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-23T22:31:19.199466] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-23T22:31:19.355585] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T22:31:19.999408] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-23T22:31:20.164513] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:31:20.271835] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T22:31:20.799420] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-23T22:31:21.289213] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T22:31:21.309775] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-23T22:31:21.599431] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-23T22:31:22.399445] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-23T22:31:23.022443] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T22:31:23.030542] [INFO ] [REMOTE ] MFA: Full fetch complete (65226 records). [2025-10-23T22:31:23.030724] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-23T22:31:23.209817] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-23T22:31:23.433521] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-23T22:31:23.433705] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-23T22:31:23.435061] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-23T22:31:23.435177] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-23T22:31:23.437027] [DEBUG] [LOCAL ] MFA: Trimmed 65226 records to 45870 (keeping 200 days of data) [2025-10-23T22:31:23.738453] [DEBUG] [LOCAL ] MFA: Primary data saved (45870 records). [2025-10-23T22:31:23.738706] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-23T22:31:23.739451] [INFO ] [MAIN ] Update Progress: 1332/2367 symbols completed. MFA took 50.3s. Estimated remaining: 2h 13m 7s. Rate: 7.8 symbols/min [2025-10-23T22:31:23.741233] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-23T22:31:23.927576] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:23.927778] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-23T22:31:23.927852] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-23T22:31:23.927983] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-23T22:31:23.928055] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-23T22:31:23.928134] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-23T22:31:23.928205] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-23T22:31:24.007475] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-23T22:31:24.310891] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:24.312217] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T22:31:24.799447] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-23T22:31:25.057150] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-23T22:31:25.599436] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-23T22:31:25.765005] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T22:31:25.774590] [INFO ] [REMOTE ] MFG: Full fetch complete (69891 records). [2025-10-23T22:31:25.774879] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-23T22:31:26.190067] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-23T22:31:26.190217] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-23T22:31:26.191581] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-23T22:31:26.191707] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-23T22:31:26.193609] [DEBUG] [LOCAL ] MFG: Trimmed 69891 records to 49876 (keeping 200 days of data) [2025-10-23T22:31:26.403855] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-23T22:31:26.493615] [DEBUG] [LOCAL ] MFG: Primary data saved (49876 records). [2025-10-23T22:31:26.493805] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-23T22:31:26.493968] [INFO ] [MAIN ] Update Progress: 1333/2367 symbols completed. MFG took 31.2s. Estimated remaining: 2h 12m 56s. Rate: 7.8 symbols/min [2025-10-23T22:31:26.660807] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:26.669053] [DEBUG] [LOCAL ] MFSG: Loaded 5956 existing records from primary storage. [2025-10-23T22:31:26.669296] [INFO ] [MAIN ] MFSG: Loaded 5956 existing records. [2025-10-23T22:31:26.746535] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-23T22:31:26.867092] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:26.867309] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-23T22:31:26.867386] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-23T22:31:26.867560] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-23T22:31:26.867632] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-23T22:31:27.218460] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-23T22:31:27.224756] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:27.329765] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T22:31:27.999487] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-23T22:31:28.113467] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T22:31:28.116483] [INFO ] [REMOTE ] MFM: Full fetch complete (19413 records). [2025-10-23T22:31:28.116683] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-23T22:31:28.477376] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-23T22:31:28.477486] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-23T22:31:28.477983] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-23T22:31:28.478062] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-23T22:31:28.478688] [DEBUG] [LOCAL ] MFM: Trimmed 19413 records to 14129 (keeping 200 days of data) [2025-10-23T22:31:28.558765] [DEBUG] [LOCAL ] MFM: Primary data saved (14129 records). [2025-10-23T22:31:28.558920] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-23T22:31:28.559031] [INFO ] [MAIN ] Update Progress: 1334/2367 symbols completed. MFM took 23.0s. Estimated remaining: 2h 12m 44s. Rate: 7.8 symbols/min [2025-10-23T22:31:28.723804] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:28.737669] [DEBUG] [LOCAL ] MFSI: Loaded 12648 existing records from primary storage. [2025-10-23T22:31:28.740923] [INFO ] [MAIN ] MFSI: Loaded 12648 existing records. [2025-10-23T22:31:28.804727] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-23T22:31:28.917265] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:28.917490] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-23T22:31:28.917564] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-23T22:31:28.917771] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-23T22:31:28.917843] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-23T22:31:29.231902] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-23T22:31:29.273358] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:29.599423] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-23T22:31:29.846866] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T22:31:29.855802] [INFO ] [REMOTE ] MFC: Full fetch complete (74375 records). [2025-10-23T22:31:29.855977] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-23T22:31:30.157593] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-23T22:31:30.263161] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-23T22:31:30.263292] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-23T22:31:30.264359] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-23T22:31:30.264455] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-23T22:31:30.265967] [DEBUG] [LOCAL ] MFC: Trimmed 74375 records to 51351 (keeping 200 days of data) [2025-10-23T22:31:30.437998] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-23T22:31:30.572544] [DEBUG] [LOCAL ] MFC: Primary data saved (51351 records). [2025-10-23T22:31:30.572718] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-23T22:31:30.572828] [INFO ] [MAIN ] Update Progress: 1335/2367 symbols completed. MFC took 37.5s. Estimated remaining: 2h 12m 32s. Rate: 7.8 symbols/min [2025-10-23T22:31:30.744055] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:30.748319] [DEBUG] [LOCAL ] MFSV: Loaded 2944 existing records from primary storage. [2025-10-23T22:31:30.748546] [INFO ] [MAIN ] MFSV: Loaded 2944 existing records. [2025-10-23T22:31:30.923342] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:30.923572] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-23T22:31:30.923666] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-23T22:31:30.923829] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-23T22:31:30.923900] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-23T22:31:31.101094] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T22:31:31.204743] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-23T22:31:31.290500] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:31.849052] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T22:31:31.999428] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-23T22:31:32.451688] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T22:31:32.799462] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-23T22:31:33.473479] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T22:31:33.599430] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-23T22:31:33.996679] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-23T22:31:34.399433] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-23T22:31:34.734462] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-23T22:31:35.199456] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-23T22:31:35.831296] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T22:31:35.999435] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-23T22:31:36.789754] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:31:36.799390] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-23T22:31:37.390186] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T22:31:37.599458] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-23T22:31:37.875848] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-23T22:31:38.399441] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-23T22:31:38.846674] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T22:31:39.199451] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-23T22:31:39.993936] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T22:31:39.999383] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-23T22:31:40.799486] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-23T22:31:40.924531] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T22:31:41.125592] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-23T22:31:41.599408] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-23T22:31:41.878639] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-23T22:31:42.399439] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-23T22:31:42.966704] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-23T22:31:43.199496] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-23T22:31:43.819436] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T22:31:43.999509] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-23T22:31:44.443164] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T22:31:44.799475] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-23T22:31:45.243002] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-23T22:31:45.599445] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-23T22:31:45.946628] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-23T22:31:46.399466] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-23T22:31:47.091154] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T22:31:47.199455] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-23T22:31:47.721921] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-23T22:31:47.999417] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-23T22:31:48.799425] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-23T22:31:48.948591] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T22:31:49.167117] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-23T22:31:49.599440] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-23T22:31:50.366739] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T22:31:50.399400] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-23T22:31:50.871884] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T22:31:51.199428] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-23T22:31:51.793030] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T22:31:51.999442] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-23T22:31:52.343707] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-23T22:31:52.799437] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-23T22:31:53.518788] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:31:53.520735] [INFO ] [REMOTE ] MFSG: Full fetch complete (6837 records). [2025-10-23T22:31:53.520822] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-23T22:31:53.604525] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-23T22:31:53.887726] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-23T22:31:53.887836] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-23T22:31:53.888104] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-23T22:31:53.888187] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-23T22:31:53.888614] [DEBUG] [LOCAL ] MFSG: Trimmed 6837 records to 5990 (keeping 200 days of data) [2025-10-23T22:31:53.924364] [DEBUG] [LOCAL ] MFSG: Primary data saved (5990 records). [2025-10-23T22:31:53.924498] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-23T22:31:53.924605] [INFO ] [MAIN ] Update Progress: 1336/2367 symbols completed. MFSG took 27.4s. Estimated remaining: 2h 12m 36s. Rate: 7.8 symbols/min [2025-10-23T22:31:54.097445] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:54.113768] [DEBUG] [LOCAL ] MG: Loaded 15383 existing records from primary storage. [2025-10-23T22:31:54.114025] [INFO ] [MAIN ] MG: Loaded 15383 existing records. [2025-10-23T22:31:54.297197] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:54.297399] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-23T22:31:54.297474] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-23T22:31:54.297706] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-23T22:31:54.297779] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-23T22:31:54.405875] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T22:31:54.405939] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-23T22:31:54.674222] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:55.199437] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-23T22:31:55.402326] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T22:31:55.999421] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-23T22:31:56.187839] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T22:31:56.799438] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-23T22:31:56.829943] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T22:31:56.833541] [INFO ] [REMOTE ] MFSI: Full fetch complete (15036 records). [2025-10-23T22:31:56.833660] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-23T22:31:57.212117] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-23T22:31:57.212225] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-23T22:31:57.212595] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-23T22:31:57.212712] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-23T22:31:57.213242] [DEBUG] [LOCAL ] MFSI: Trimmed 15036 records to 12771 (keeping 200 days of data) [2025-10-23T22:31:57.284228] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-23T22:31:57.296285] [DEBUG] [LOCAL ] MFSI: Primary data saved (12771 records). [2025-10-23T22:31:57.296448] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-23T22:31:57.296586] [INFO ] [MAIN ] Update Progress: 1337/2367 symbols completed. MFSI took 28.7s. Estimated remaining: 2h 12m 25s. Rate: 7.8 symbols/min [2025-10-23T22:31:57.477766] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:57.523387] [DEBUG] [LOCAL ] MGA: Loaded 50391 existing records from primary storage. [2025-10-23T22:31:57.523909] [INFO ] [MAIN ] MGA: Loaded 50391 existing records. [2025-10-23T22:31:57.604567] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-23T22:31:57.711212] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:57.711489] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-23T22:31:57.711568] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-23T22:31:57.712270] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-23T22:31:57.712345] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-23T22:31:58.094714] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:58.295142] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T22:31:58.297547] [INFO ] [REMOTE ] MFSV: Full fetch complete (3696 records). [2025-10-23T22:31:58.297708] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-23T22:31:58.404691] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-23T22:31:58.687718] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-23T22:31:58.687876] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-23T22:31:58.688097] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-23T22:31:58.688181] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-23T22:31:58.688709] [DEBUG] [LOCAL ] MFSV: Trimmed 3696 records to 2986 (keeping 200 days of data) [2025-10-23T22:31:58.708548] [DEBUG] [LOCAL ] MFSV: Primary data saved (2986 records). [2025-10-23T22:31:58.708768] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-23T22:31:58.708901] [INFO ] [MAIN ] Update Progress: 1338/2367 symbols completed. MFSV took 28.1s. Estimated remaining: 2h 12m 12s. Rate: 7.8 symbols/min [2025-10-23T22:31:58.878173] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:31:58.885279] [DEBUG] [LOCAL ] MGF: Loaded 4133 existing records from primary storage. [2025-10-23T22:31:58.885524] [INFO ] [MAIN ] MGF: Loaded 4133 existing records. [2025-10-23T22:31:59.010040] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T22:31:59.095398] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:31:59.095688] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-23T22:31:59.095770] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-23T22:31:59.095957] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-23T22:31:59.096033] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-23T22:31:59.204589] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-23T22:31:59.473169] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:31:59.778132] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T22:31:59.779686] [INFO ] [REMOTE ] MFSB: Full fetch complete (2089 records). [2025-10-23T22:31:59.779983] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-23T22:31:59.957176] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-23T22:31:59.957372] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:31:59.957460] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:31:59.957560] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-23T22:31:59.957693] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-23T22:31:59.957784] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-23T22:31:59.957886] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-23T22:31:59.958021] [INFO ] [MAIN ] Update Progress: 1339/2367 symbols completed. MFSB took 36.2s. Estimated remaining: 2h 11m 60s. Rate: 7.8 symbols/min [2025-10-23T22:32:00.004519] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-23T22:32:00.167452] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:00.216740] [DEBUG] [LOCAL ] MGM: Loaded 53605 existing records from primary storage. [2025-10-23T22:32:00.217152] [INFO ] [MAIN ] MGM: Loaded 53605 existing records. [2025-10-23T22:32:00.391710] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:32:00.391915] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-23T22:32:00.391991] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-23T22:32:00.392206] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-23T22:32:00.392276] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-23T22:32:00.748192] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:00.799417] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-23T22:32:00.883755] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-23T22:32:01.599512] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-23T22:32:02.399448] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-23T22:32:02.709733] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T22:32:02.975434] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-23T22:32:03.199466] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-23T22:32:03.257783] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T22:32:03.999462] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-23T22:32:04.416148] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T22:32:04.799495] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-23T22:32:05.599443] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-23T22:32:05.780468] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T22:32:06.105570] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-23T22:32:06.399457] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-23T22:32:06.642736] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T22:32:06.981931] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T22:32:07.199457] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-23T22:32:07.570900] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-23T22:32:07.999452] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-23T22:32:08.594834] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T22:32:08.799433] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-23T22:32:09.599461] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-23T22:32:10.248553] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T22:32:10.399422] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-23T22:32:10.585772] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T22:32:11.199453] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-23T22:32:11.999424] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-23T22:32:12.345215] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T22:32:12.597224] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T22:32:12.799427] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-23T22:32:13.599428] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-23T22:32:14.217762] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-23T22:32:14.218473] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T22:32:14.399412] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-23T22:32:14.732327] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T22:32:15.062367] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T22:32:15.199408] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-23T22:32:15.794129] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-23T22:32:15.795365] [INFO ] [REMOTE ] MGF: Full fetch complete (5710 records). [2025-10-23T22:32:15.795472] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-23T22:32:16.004587] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-23T22:32:16.158175] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-23T22:32:16.158315] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-23T22:32:16.158581] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-23T22:32:16.158711] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-23T22:32:16.159175] [DEBUG] [LOCAL ] MGF: Trimmed 5710 records to 4146 (keeping 200 days of data) [2025-10-23T22:32:16.182622] [DEBUG] [LOCAL ] MGF: Primary data saved (4146 records). [2025-10-23T22:32:16.182757] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-23T22:32:16.182903] [INFO ] [MAIN ] Update Progress: 1340/2367 symbols completed. MGF took 17.5s. Estimated remaining: 2h 11m 59s. Rate: 7.8 symbols/min [2025-10-23T22:32:16.349218] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:16.356927] [DEBUG] [LOCAL ] MGR: Loaded 5536 existing records from primary storage. [2025-10-23T22:32:16.357147] [INFO ] [MAIN ] MGR: Loaded 5536 existing records. [2025-10-23T22:32:16.531469] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:32:16.531678] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-23T22:32:16.531741] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-23T22:32:16.531920] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-23T22:32:16.532058] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-23T22:32:16.806179] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-23T22:32:16.887515] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:17.599409] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-23T22:32:18.063128] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T22:32:18.399435] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-23T22:32:18.479799] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T22:32:18.642689] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T22:32:19.199431] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-23T22:32:19.868597] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T22:32:19.999419] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-23T22:32:20.205526] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T22:32:20.667164] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T22:32:20.799449] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-23T22:32:21.431872] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T22:32:21.599428] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-23T22:32:22.399453] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-23T22:32:23.199409] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-23T22:32:23.335810] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T22:32:23.424558] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T22:32:23.800422] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T22:32:23.999456] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-23T22:32:24.799430] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-23T22:32:24.991944] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T22:32:25.169811] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-23T22:32:25.599427] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-23T22:32:26.084524] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T22:32:26.399479] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-23T22:32:27.199434] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-23T22:32:27.999480] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-23T22:32:28.260488] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T22:32:28.395452] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T22:32:28.638123] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T22:32:28.799444] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-23T22:32:29.388066] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T22:32:29.599491] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-23T22:32:30.399468] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-23T22:32:31.199479] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-23T22:32:31.396535] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:32:31.999452] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-23T22:32:32.021887] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T22:32:32.799421] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-23T22:32:33.100771] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T22:32:33.379368] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T22:32:33.380822] [INFO ] [REMOTE ] MGR: Full fetch complete (7818 records). [2025-10-23T22:32:33.380909] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-23T22:32:33.604533] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-23T22:32:33.766973] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-23T22:32:33.767163] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-23T22:32:33.767502] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-23T22:32:33.767590] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-23T22:32:33.768203] [DEBUG] [LOCAL ] MGR: Trimmed 7818 records to 5552 (keeping 200 days of data) [2025-10-23T22:32:33.803281] [DEBUG] [LOCAL ] MGR: Primary data saved (5552 records). [2025-10-23T22:32:33.803451] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-23T22:32:33.803584] [INFO ] [MAIN ] Update Progress: 1341/2367 symbols completed. MGR took 17.6s. Estimated remaining: 2h 11m 58s. Rate: 7.8 symbols/min [2025-10-23T22:32:33.957636] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T22:32:34.027279] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:34.034621] [DEBUG] [LOCAL ] MGRB: Loaded 3994 existing records from primary storage. [2025-10-23T22:32:34.034939] [INFO ] [MAIN ] MGRB: Loaded 3994 existing records. [2025-10-23T22:32:34.221751] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:32:34.222034] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-23T22:32:34.222110] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-23T22:32:34.222282] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-23T22:32:34.222353] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-23T22:32:34.400474] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-23T22:32:34.625706] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:34.656202] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-23T22:32:35.199507] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-23T22:32:35.933157] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T22:32:35.999448] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-23T22:32:36.177812] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T22:32:36.548813] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-23T22:32:36.799535] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-23T22:32:37.599452] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-23T22:32:38.321992] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T22:32:38.399457] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-23T22:32:39.099597] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T22:32:39.199431] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-23T22:32:39.999433] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-23T22:32:40.141711] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T22:32:40.146007] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T22:32:40.159072] [INFO ] [REMOTE ] MG: Full fetch complete (23253 records). [2025-10-23T22:32:40.159265] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-23T22:32:40.158913] [INFO ] [REMOTE ] MGA: Full fetch complete (73718 records). [2025-10-23T22:32:40.159639] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-23T22:32:40.811471] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-23T22:32:40.913864] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-23T22:32:40.929345] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-23T22:32:40.935108] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-23T22:32:40.948843] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-23T22:32:41.004903] [DEBUG] [LOCAL ] MG: Trimmed 23253 records to 15462 (keeping 200 days of data) [2025-10-23T22:32:41.008590] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-23T22:32:41.009018] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-23T22:32:41.010315] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-23T22:32:41.043710] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-23T22:32:41.080129] [DEBUG] [LOCAL ] MGA: Trimmed 73718 records to 50758 (keeping 200 days of data) [2025-10-23T22:32:41.159721] [DEBUG] [LOCAL ] MG: Primary data saved (15462 records). [2025-10-23T22:32:41.189152] [INFO ] [MAIN ] MG: Full history saved. [2025-10-23T22:32:41.192378] [INFO ] [MAIN ] Update Progress: 1342/2367 symbols completed. MG took 47.3s. Estimated remaining: 2h 11m 51s. Rate: 7.8 symbols/min [2025-10-23T22:32:41.487188] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:41.504525] [DEBUG] [LOCAL ] MGRD: Loaded 2206 existing records from primary storage. [2025-10-23T22:32:41.508293] [INFO ] [MAIN ] MGRD: Loaded 2206 existing records. [2025-10-23T22:32:41.784495] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:32:41.784835] [DEBUG] [LOCAL ] MGA: Primary data saved (50758 records). [2025-10-23T22:32:41.785010] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-23T22:32:41.785224] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-23T22:32:41.785382] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-23T22:32:41.785429] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-23T22:32:41.787010] [INFO ] [MAIN ] Update Progress: 1343/2367 symbols completed. MGA took 44.5s. Estimated remaining: 2h 11m 37s. Rate: 7.8 symbols/min [2025-10-23T22:32:41.792455] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-23T22:32:42.288033] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:42.383257] [DEBUG] [LOCAL ] MGRE: Loaded 6420 existing records from primary storage. [2025-10-23T22:32:42.386384] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:42.386699] [INFO ] [MAIN ] MGRE: Loaded 6420 existing records. [2025-10-23T22:32:42.387013] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-23T22:32:42.570002] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:32:42.570241] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-23T22:32:42.570341] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-23T22:32:42.570550] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-23T22:32:42.570625] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-23T22:32:42.716133] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-23T22:32:42.814384] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T22:32:42.814516] [INFO ] [REMOTE ] MGM: Full fetch complete (77759 records). [2025-10-23T22:32:42.859551] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-23T22:32:42.859682] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-23T22:32:43.099105] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:43.130948] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T22:32:43.205623] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-23T22:32:43.426046] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-23T22:32:43.426159] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-23T22:32:43.427256] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-23T22:32:43.427334] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-23T22:32:43.428794] [DEBUG] [LOCAL ] MGM: Trimmed 77759 records to 53993 (keeping 200 days of data) [2025-10-23T22:32:43.631410] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T22:32:43.643442] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T22:32:43.757572] [DEBUG] [LOCAL ] MGM: Primary data saved (53993 records). [2025-10-23T22:32:43.757756] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-23T22:32:43.757870] [INFO ] [MAIN ] Update Progress: 1344/2367 symbols completed. MGM took 43.8s. Estimated remaining: 2h 11m 25s. Rate: 7.8 symbols/min [2025-10-23T22:32:43.935076] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:43.983216] [DEBUG] [LOCAL ] MGY: Loaded 52424 existing records from primary storage. [2025-10-23T22:32:43.983549] [INFO ] [MAIN ] MGY: Loaded 52424 existing records. [2025-10-23T22:32:44.004631] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-23T22:32:44.165217] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:32:44.165431] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-23T22:32:44.165519] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-23T22:32:44.165817] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-23T22:32:44.165893] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-23T22:32:44.524817] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:44.549254] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-23T22:32:44.799448] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-23T22:32:45.599455] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-23T22:32:46.227566] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T22:32:46.399430] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-23T22:32:46.548261] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T22:32:47.061031] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T22:32:47.199444] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-23T22:32:47.783145] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T22:32:47.999420] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-23T22:32:48.745404] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T22:32:48.799441] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-23T22:32:49.338769] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T22:32:49.599444] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-23T22:32:50.399438] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-23T22:32:50.929741] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-23T22:32:50.930784] [INFO ] [REMOTE ] MGRB: Full fetch complete (5515 records). [2025-10-23T22:32:50.930872] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-23T22:32:51.204530] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-23T22:32:51.302345] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-23T22:32:51.302533] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-23T22:32:51.302916] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-23T22:32:51.317225] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-23T22:32:51.329428] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T22:32:51.328383] [DEBUG] [LOCAL ] MGRB: Trimmed 5515 records to 4007 (keeping 200 days of data) [2025-10-23T22:32:51.366231] [DEBUG] [LOCAL ] MGRB: Primary data saved (4007 records). [2025-10-23T22:32:51.366376] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-23T22:32:51.366500] [INFO ] [MAIN ] Update Progress: 1345/2367 symbols completed. MGRB took 17.6s. Estimated remaining: 2h 11m 18s. Rate: 7.8 symbols/min [2025-10-23T22:32:51.540150] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:32:51.540332] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-23T22:32:51.540410] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-23T22:32:51.540526] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-23T22:32:51.540601] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-23T22:32:51.540713] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-23T22:32:51.540783] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-23T22:32:51.840402] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T22:32:51.914253] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:32:51.999423] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-23T22:32:52.460215] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T22:32:52.799479] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-23T22:32:53.599493] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-23T22:32:54.059266] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-23T22:32:54.411497] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-23T22:32:54.448737] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T22:32:55.173905] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T22:32:55.199403] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-23T22:32:55.658257] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-23T22:32:55.999506] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-23T22:32:56.449201] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T22:32:56.799440] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-23T22:32:57.599448] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-23T22:32:58.065017] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T22:32:58.399420] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-23T22:32:58.557387] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:32:58.702543] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-23T22:32:59.199443] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-23T22:32:59.643352] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-23T22:32:59.999437] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-23T22:33:00.777742] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T22:33:00.799393] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-10-23T22:33:01.040127] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:33:01.040448] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-10-23T22:33:01.040538] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:33:01.040611] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-23T22:33:01.040706] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:33:01.040781] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-23T22:33:01.040881] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-23T22:33:01.040957] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-23T22:33:01.041038] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-23T22:33:01.041119] [INFO ] [MAIN ] Update Progress: 1346/2367 symbols completed. MH took 9.7s. Estimated remaining: 2h 11m 11s. Rate: 7.8 symbols/min [2025-10-23T22:33:01.210670] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:01.223789] [DEBUG] [LOCAL ] MHD: Loaded 11922 existing records from primary storage. [2025-10-23T22:33:01.224074] [INFO ] [MAIN ] MHD: Loaded 11922 existing records. [2025-10-23T22:33:01.408166] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:01.408412] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-23T22:33:01.408509] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-23T22:33:01.408758] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-23T22:33:01.408862] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-23T22:33:01.604576] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-23T22:33:01.759267] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:02.399447] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-23T22:33:03.199430] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-23T22:33:03.371426] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T22:33:03.447421] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T22:33:03.589809] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-23T22:33:03.999445] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-23T22:33:04.773616] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T22:33:04.799444] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-23T22:33:05.599414] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-23T22:33:05.662352] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T22:33:06.317174] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T22:33:06.399416] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-23T22:33:07.119348] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T22:33:07.199403] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-23T22:33:07.999426] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-23T22:33:08.078017] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:33:08.467458] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T22:33:08.468463] [INFO ] [REMOTE ] MGRD: Full fetch complete (3287 records). [2025-10-23T22:33:08.468554] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-23T22:33:08.800424] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-23T22:33:08.823342] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-23T22:33:08.823470] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-23T22:33:08.823635] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-23T22:33:08.823734] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-23T22:33:08.824124] [DEBUG] [LOCAL ] MGRD: Trimmed 3287 records to 2213 (keeping 200 days of data) [2025-10-23T22:33:08.837915] [DEBUG] [LOCAL ] MGRD: Primary data saved (2213 records). [2025-10-23T22:33:08.838017] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-23T22:33:08.838132] [INFO ] [MAIN ] Update Progress: 1347/2367 symbols completed. MGRD took 27.6s. Estimated remaining: 2h 11m 4s. Rate: 7.8 symbols/min [2025-10-23T22:33:09.003102] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:09.013791] [DEBUG] [LOCAL ] MHF: Loaded 9054 existing records from primary storage. [2025-10-23T22:33:09.014039] [INFO ] [MAIN ] MHF: Loaded 9054 existing records. [2025-10-23T22:33:09.192676] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:09.192879] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-23T22:33:09.192951] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-23T22:33:09.193129] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-23T22:33:09.193200] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-23T22:33:09.571952] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:09.599395] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-23T22:33:09.811396] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T22:33:10.063623] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T22:33:10.399438] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-23T22:33:11.199436] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-23T22:33:11.218119] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T22:33:11.999439] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-23T22:33:12.799412] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-23T22:33:12.834591] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T22:33:12.884792] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T22:33:13.548568] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T22:33:13.599429] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-23T22:33:14.162982] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T22:33:14.164413] [INFO ] [REMOTE ] MGRE: Full fetch complete (9175 records). [2025-10-23T22:33:14.164501] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-23T22:33:14.409149] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-23T22:33:14.530313] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-23T22:33:14.530422] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-23T22:33:14.530709] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-23T22:33:14.530786] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-23T22:33:14.531263] [DEBUG] [LOCAL ] MGRE: Trimmed 9175 records to 6452 (keeping 200 days of data) [2025-10-23T22:33:14.570270] [DEBUG] [LOCAL ] MGRE: Primary data saved (6452 records). [2025-10-23T22:33:14.570442] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-23T22:33:14.570562] [INFO ] [MAIN ] Update Progress: 1348/2367 symbols completed. MGRE took 32.8s. Estimated remaining: 2h 10m 54s. Rate: 7.8 symbols/min [2025-10-23T22:33:14.740252] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:14.784544] [DEBUG] [LOCAL ] MHK: Loaded 41973 existing records from primary storage. [2025-10-23T22:33:14.784907] [INFO ] [MAIN ] MHK: Loaded 41973 existing records. [2025-10-23T22:33:14.961721] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:14.961997] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-23T22:33:14.962097] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-23T22:33:14.962400] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-23T22:33:14.962475] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-23T22:33:15.207082] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-23T22:33:15.263139] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T22:33:15.350231] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:15.999414] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-23T22:33:16.116658] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T22:33:16.799515] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-23T22:33:17.210631] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-23T22:33:17.599411] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-23T22:33:17.807530] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T22:33:18.359870] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T22:33:18.399411] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-23T22:33:19.199447] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-23T22:33:19.331675] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T22:33:19.999461] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-23T22:33:20.758927] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T22:33:20.761441] [INFO ] [REMOTE ] MHD: Full fetch complete (18023 records). [2025-10-23T22:33:20.761532] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-23T22:33:20.805218] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-23T22:33:20.959819] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-23T22:33:21.168333] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-23T22:33:21.168448] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-23T22:33:21.168889] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-23T22:33:21.168986] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-23T22:33:21.169575] [DEBUG] [LOCAL ] MHD: Trimmed 18023 records to 11963 (keeping 200 days of data) [2025-10-23T22:33:21.242296] [DEBUG] [LOCAL ] MHD: Primary data saved (11963 records). [2025-10-23T22:33:21.242460] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-23T22:33:21.242549] [INFO ] [MAIN ] Update Progress: 1349/2367 symbols completed. MHD took 20.2s. Estimated remaining: 2h 10m 46s. Rate: 7.8 symbols/min [2025-10-23T22:33:21.415257] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:21.415486] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-23T22:33:21.415560] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-23T22:33:21.415700] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-23T22:33:21.415771] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-23T22:33:21.415857] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-23T22:33:21.415927] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-23T22:33:21.608361] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-23T22:33:21.821685] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:22.407618] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-23T22:33:22.413829] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T22:33:22.460847] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-23T22:33:22.809033] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-23T22:33:23.199452] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-23T22:33:23.999444] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-23T22:33:24.635146] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T22:33:24.799437] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-23T22:33:24.869788] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T22:33:25.599422] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-23T22:33:25.955032] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-23T22:33:26.398945] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T22:33:26.402022] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-23T22:33:27.199471] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-23T22:33:28.000058] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-23T22:33:28.001883] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T22:33:28.267266] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T22:33:28.276768] [INFO ] [REMOTE ] MGY: Full fetch complete (75965 records). [2025-10-23T22:33:28.276974] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-23T22:33:28.668292] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-23T22:33:28.668409] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-23T22:33:28.669516] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-23T22:33:28.669603] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-23T22:33:28.671146] [DEBUG] [LOCAL ] MGY: Trimmed 75965 records to 52808 (keeping 200 days of data) [2025-10-23T22:33:28.841372] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-23T22:33:28.987021] [DEBUG] [LOCAL ] MGY: Primary data saved (52808 records). [2025-10-23T22:33:28.987196] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-23T22:33:28.987317] [INFO ] [MAIN ] Update Progress: 1350/2367 symbols completed. MGY took 45.2s. Estimated remaining: 2h 10m 38s. Rate: 7.8 symbols/min [2025-10-23T22:33:29.153881] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:29.162352] [DEBUG] [LOCAL ] MHN: Loaded 7382 existing records from primary storage. [2025-10-23T22:33:29.162595] [INFO ] [MAIN ] MHN: Loaded 7382 existing records. [2025-10-23T22:33:29.270835] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-23T22:33:29.348089] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:29.348287] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-23T22:33:29.348376] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-23T22:33:29.348570] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-23T22:33:29.348670] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-23T22:33:29.609807] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-23T22:33:29.742507] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:29.768567] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:33:30.063604] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-23T22:33:30.399508] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-23T22:33:30.972283] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-23T22:33:31.199425] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-23T22:33:31.568231] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-23T22:33:31.999431] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-23T22:33:32.799417] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-23T22:33:32.853876] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T22:33:33.599434] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-23T22:33:34.380154] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T22:33:34.404732] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-23T22:33:34.417022] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T22:33:34.685848] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-23T22:33:35.199431] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-23T22:33:35.530633] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-23T22:33:35.999448] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-23T22:33:36.799428] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-23T22:33:36.825703] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T22:33:37.599437] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-23T22:33:38.324287] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:33:38.350038] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T22:33:38.399461] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-23T22:33:39.130355] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:33:39.199455] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-23T22:33:39.801603] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-23T22:33:39.999451] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-23T22:33:40.716432] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:33:40.723275] [INFO ] [REMOTE ] MHF: Full fetch complete (12783 records). [2025-10-23T22:33:40.723441] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-23T22:33:40.805558] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-23T22:33:41.151331] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-23T22:33:41.151459] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-23T22:33:41.151924] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-23T22:33:41.152006] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-23T22:33:41.152528] [DEBUG] [LOCAL ] MHF: Trimmed 12783 records to 9083 (keeping 200 days of data) [2025-10-23T22:33:41.208494] [DEBUG] [LOCAL ] MHF: Primary data saved (9083 records). [2025-10-23T22:33:41.208701] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-23T22:33:41.208823] [INFO ] [MAIN ] Update Progress: 1351/2367 symbols completed. MHF took 32.4s. Estimated remaining: 2h 10m 34s. Rate: 7.8 symbols/min [2025-10-23T22:33:41.409975] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:41.435135] [DEBUG] [LOCAL ] MHO: Loaded 23675 existing records from primary storage. [2025-10-23T22:33:41.435422] [INFO ] [MAIN ] MHO: Loaded 23675 existing records. [2025-10-23T22:33:41.604530] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-23T22:33:41.648145] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:41.648360] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-23T22:33:41.648453] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-23T22:33:41.648741] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-23T22:33:41.648815] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-23T22:33:42.039795] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:42.277519] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T22:33:42.399405] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-23T22:33:42.558299] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T22:33:43.199460] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-23T22:33:43.836860] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T22:33:43.999422] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-23T22:33:44.537042] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T22:33:44.799425] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-23T22:33:45.303048] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-23T22:33:45.599393] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-23T22:33:45.856982] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T22:33:46.399436] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-23T22:33:46.877712] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-23T22:33:47.121964] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T22:33:47.199425] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-23T22:33:47.901392] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T22:33:47.909066] [INFO ] [REMOTE ] MHK: Full fetch complete (61363 records). [2025-10-23T22:33:47.909207] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-23T22:33:48.005104] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-23T22:33:48.305750] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-23T22:33:48.305864] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-23T22:33:48.306822] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-23T22:33:48.306900] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-23T22:33:48.308205] [DEBUG] [LOCAL ] MHK: Trimmed 61363 records to 42331 (keeping 200 days of data) [2025-10-23T22:33:48.564259] [DEBUG] [LOCAL ] MHK: Primary data saved (42331 records). [2025-10-23T22:33:48.564382] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-23T22:33:48.565770] [INFO ] [MAIN ] Update Progress: 1352/2367 symbols completed. MHK took 34.0s. Estimated remaining: 2h 10m 26s. Rate: 7.8 symbols/min [2025-10-23T22:33:48.738319] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:48.738503] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-23T22:33:48.738574] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-23T22:33:48.738709] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-23T22:33:48.738780] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-23T22:33:48.738859] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-23T22:33:48.738930] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-23T22:33:48.804536] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-23T22:33:49.121403] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:49.219783] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-23T22:33:49.220693] [INFO ] [REMOTE ] MHLA: Full fetch complete (1490 records). [2025-10-23T22:33:49.220860] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-23T22:33:49.341460] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T22:33:49.424838] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-23T22:33:49.425029] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:33:49.425121] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:33:49.425207] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-23T22:33:49.425311] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-23T22:33:49.425385] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-23T22:33:49.425496] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-23T22:33:49.425618] [INFO ] [MAIN ] Update Progress: 1353/2367 symbols completed. MHLA took 28.2s. Estimated remaining: 2h 10m 13s. Rate: 7.8 symbols/min [2025-10-23T22:33:49.595271] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:49.599417] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-10-23T22:33:49.610796] [DEBUG] [LOCAL ] MIN: Loaded 13938 existing records from primary storage. [2025-10-23T22:33:49.611067] [INFO ] [MAIN ] MIN: Loaded 13938 existing records. [2025-10-23T22:33:49.800727] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:49.800958] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-23T22:33:49.801031] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-23T22:33:49.801240] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-23T22:33:49.801325] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-23T22:33:49.864995] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:33:49.892319] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-10-23T22:33:49.902719] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:33:49.903121] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-23T22:33:49.923957] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:33:49.952998] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-23T22:33:49.962144] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-23T22:33:49.962591] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-23T22:33:49.963080] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-23T22:33:49.963206] [INFO ] [MAIN ] Update Progress: 1354/2367 symbols completed. MIAX took 1.4s. Estimated remaining: 2h 10m 0s. Rate: 7.8 symbols/min [2025-10-23T22:33:50.338110] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:50.334450] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:33:50.388469] [DEBUG] [LOCAL ] MIR: Loaded 51402 existing records from primary storage. [2025-10-23T22:33:50.388860] [INFO ] [MAIN ] MIR: Loaded 51402 existing records. [2025-10-23T22:33:50.404531] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-23T22:33:50.576883] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:33:50.577150] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-23T22:33:50.577255] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-23T22:33:50.577513] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-23T22:33:50.577599] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-23T22:33:50.942047] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:33:51.199439] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-23T22:33:51.536897] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T22:33:51.999420] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-23T22:33:52.799463] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-23T22:33:53.048189] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T22:33:53.063630] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T22:33:53.599459] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-23T22:33:54.399443] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-23T22:33:55.173399] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T22:33:55.199412] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-23T22:33:55.425177] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-23T22:33:55.579587] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T22:33:55.951748] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T22:33:55.999501] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-23T22:33:56.799451] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-23T22:33:56.846284] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T22:33:57.540886] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T22:33:57.599451] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-23T22:33:58.335380] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T22:33:58.399471] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-23T22:33:59.199424] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-23T22:33:59.402368] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T22:33:59.952943] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T22:33:59.999420] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-23T22:34:00.799447] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-23T22:34:01.451141] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:34:01.452690] [INFO ] [REMOTE ] MHN: Full fetch complete (11392 records). [2025-10-23T22:34:01.452778] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-23T22:34:01.605517] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-23T22:34:01.814444] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-23T22:34:01.814558] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-23T22:34:01.814991] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-23T22:34:01.815075] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-23T22:34:01.815895] [DEBUG] [LOCAL ] MHN: Trimmed 11392 records to 7408 (keeping 200 days of data) [2025-10-23T22:34:01.885179] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T22:34:01.904778] [DEBUG] [LOCAL ] MHN: Primary data saved (7408 records). [2025-10-23T22:34:01.905259] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-23T22:34:01.905707] [INFO ] [MAIN ] Update Progress: 1355/2367 symbols completed. MHN took 32.9s. Estimated remaining: 2h 9m 56s. Rate: 7.8 symbols/min [2025-10-23T22:34:02.073096] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:34:02.073319] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-23T22:34:02.073392] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-23T22:34:02.073501] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-23T22:34:02.073571] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-23T22:34:02.073671] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-23T22:34:02.073740] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-23T22:34:02.417711] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:34:02.413209] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-23T22:34:02.826120] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T22:34:03.199424] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-23T22:34:03.285798] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T22:34:03.999503] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-23T22:34:04.799442] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-23T22:34:04.964246] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:34:05.256280] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T22:34:05.354588] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T22:34:05.599434] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-23T22:34:06.399488] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-23T22:34:07.199423] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-23T22:34:07.664760] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T22:34:07.727409] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T22:34:07.975933] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-23T22:34:07.999399] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-23T22:34:08.799511] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-23T22:34:09.079142] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-23T22:34:09.599436] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-23T22:34:09.753091] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T22:34:10.399425] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-23T22:34:10.453394] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T22:34:11.199475] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-23T22:34:11.766005] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T22:34:11.999417] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-23T22:34:12.296539] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T22:34:12.799457] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-23T22:34:13.316414] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T22:34:13.599474] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-23T22:34:13.895118] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T22:34:14.185122] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T22:34:14.399424] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-23T22:34:14.770801] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-23T22:34:15.199431] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-23T22:34:15.999406] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-23T22:34:16.273312] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T22:34:16.277509] [INFO ] [REMOTE ] MHO: Full fetch complete (36575 records). [2025-10-23T22:34:16.277616] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-23T22:34:16.651158] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-23T22:34:16.651284] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-23T22:34:16.652155] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-23T22:34:16.652249] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-23T22:34:16.653182] [DEBUG] [LOCAL ] MHO: Trimmed 36575 records to 23852 (keeping 200 days of data) [2025-10-23T22:34:16.760817] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T22:34:16.805447] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-23T22:34:16.809242] [DEBUG] [LOCAL ] MHO: Primary data saved (23852 records). [2025-10-23T22:34:16.810130] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-23T22:34:16.810242] [INFO ] [MAIN ] Update Progress: 1356/2367 symbols completed. MHO took 35.6s. Estimated remaining: 2h 9m 53s. Rate: 7.8 symbols/min [2025-10-23T22:34:16.979486] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:34:16.979722] [DEBUG] [LOCAL ] MITP: No existing data file found in primary storage. [2025-10-23T22:34:16.979794] [WARN ] [MAIN ] MITP: No existing data found, performing full refresh instead. [2025-10-23T22:34:16.979932] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-23T22:34:16.980003] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-23T22:34:16.980136] [DEBUG] [LOCAL ] MITP: No primary data file found to delete. [2025-10-23T22:34:16.980207] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-23T22:34:17.255284] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T22:34:17.358122] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:34:17.599419] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-23T22:34:18.122044] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-23T22:34:18.399440] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-23T22:34:19.199420] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-23T22:34:19.641598] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T22:34:19.999425] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-23T22:34:20.454702] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T22:34:20.799412] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-23T22:34:20.890274] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-23T22:34:21.170665] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-23T22:34:21.599431] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-23T22:34:22.043897] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T22:34:22.399441] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-23T22:34:23.199443] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-23T22:34:23.963841] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T22:34:23.999398] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-23T22:34:24.173251] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T22:34:24.337474] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-23T22:34:24.799427] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-23T22:34:25.599402] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-23T22:34:25.685892] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-23T22:34:25.689101] [INFO ] [REMOTE ] MIN: Full fetch complete (17656 records). [2025-10-23T22:34:25.689218] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-23T22:34:25.987793] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-23T22:34:25.989412] [INFO ] [REMOTE ] MITN: Full fetch complete (2332 records). [2025-10-23T22:34:26.005240] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-23T22:34:26.163407] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-23T22:34:26.175158] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-23T22:34:26.184090] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-23T22:34:26.186606] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-23T22:34:26.213669] [DEBUG] [LOCAL ] MIN: Trimmed 17656 records to 13984 (keeping 200 days of data) [2025-10-23T22:34:26.305831] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T22:34:26.306316] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:34:26.324747] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:34:26.348558] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-23T22:34:26.348639] [DEBUG] [LOCAL ] MIN: Primary data saved (13984 records). [2025-10-23T22:34:26.348847] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-23T22:34:26.349004] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-23T22:34:26.349288] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-23T22:34:26.349409] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-23T22:34:26.349210] [INFO ] [MAIN ] Update Progress: 1357/2367 symbols completed. MIN took 36.9s. Estimated remaining: 2h 9m 47s. Rate: 7.8 symbols/min [2025-10-23T22:34:26.349722] [INFO ] [MAIN ] Update Progress: 1358/2367 symbols completed. MITN took 24.4s. Estimated remaining: 2h 9m 33s. Rate: 7.8 symbols/min [2025-10-23T22:34:26.399399] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-23T22:34:26.974947] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T22:34:27.199403] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-23T22:34:27.788419] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T22:34:27.999444] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-23T22:34:28.453691] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T22:34:28.799440] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-23T22:34:29.315159] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-23T22:34:29.599480] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-23T22:34:30.399523] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-23T22:34:30.840283] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T22:34:31.199421] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-23T22:34:31.558801] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T22:34:31.568151] [INFO ] [REMOTE ] MIR: Full fetch complete (73990 records). [2025-10-23T22:34:31.568303] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-23T22:34:31.679449] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-23T22:34:31.961986] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-23T22:34:31.962116] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-23T22:34:31.963220] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-23T22:34:31.963319] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-23T22:34:31.964748] [DEBUG] [LOCAL ] MIR: Trimmed 73990 records to 51787 (keeping 200 days of data) [2025-10-23T22:34:32.014869] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-23T22:34:32.264617] [DEBUG] [LOCAL ] MIR: Primary data saved (51787 records). [2025-10-23T22:34:32.264821] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-23T22:34:32.264932] [INFO ] [MAIN ] Update Progress: 1359/2367 symbols completed. MIR took 42.3s. Estimated remaining: 2h 9m 24s. Rate: 7.8 symbols/min [2025-10-23T22:34:32.414869] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-23T22:34:32.415711] [INFO ] [REMOTE ] MITP: Full fetch complete (3223 records). [2025-10-23T22:34:32.415798] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-23T22:34:32.769424] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-23T22:34:32.769527] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-23T22:34:32.769685] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-23T22:34:32.769769] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-23T22:34:32.770200] [DEBUG] [LOCAL ] MITP: Trimmed 3223 records to 2207 (keeping 200 days of data) [2025-10-23T22:34:32.783036] [DEBUG] [LOCAL ] MITP: Primary data saved (2207 records). [2025-10-23T22:34:32.783128] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-23T22:34:32.783225] [INFO ] [MAIN ] Update Progress: 1360/2367 symbols completed. MITP took 16.0s. Estimated remaining: 2h 9m 11s. Rate: 7.8 symbols/min [2025-10-23T22:34:33.356673] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:34:33.418836] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:34:33.437340] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:34:33.502823] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:34:33.519804] [DEBUG] [LOCAL ] MIY: Loaded 6216 existing records from primary storage. [2025-10-23T22:34:33.520044] [INFO ] [MAIN ] MIY: Loaded 6216 existing records. [2025-10-23T22:34:33.569334] [DEBUG] [LOCAL ] MITT: Loaded 22283 existing records from primary storage. [2025-10-23T22:34:33.612535] [INFO ] [MAIN ] MITT: Loaded 22283 existing records. [2025-10-23T22:34:33.656713] [DEBUG] [LOCAL ] MKL: Loaded 33801 existing records from primary storage. [2025-10-23T22:34:33.687443] [INFO ] [MAIN ] MKL: Loaded 33801 existing records. [2025-10-23T22:34:33.875533] [DEBUG] [LOCAL ] MKC: Loaded 52525 existing records from primary storage. [2025-10-23T22:34:33.968961] [INFO ] [MAIN ] MKC: Loaded 52525 existing records. [2025-10-23T22:34:34.030423] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:34:34.096582] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:34:34.149008] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-23T22:34:34.188584] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-23T22:34:34.232152] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-23T22:34:34.220784] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:34:34.214434] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-23T22:34:34.235974] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-23T22:34:34.236282] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-23T22:34:34.236673] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-23T22:34:34.236987] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-23T22:34:34.236796] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-23T22:34:34.307323] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-23T22:34:34.332946] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-23T22:34:34.348628] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-23T22:34:34.413172] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:34:34.564993] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-23T22:34:34.615131] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-23T22:34:34.771138] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-23T22:34:34.851404] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-23T22:34:35.576478] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:34:35.639059] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:34:35.681711] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-23T22:34:35.707902] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:34:35.697012] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-23T22:34:35.729621] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-23T22:34:35.865004] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:34:35.865348] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-23T22:34:36.594089] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T22:34:36.595936] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-23T22:34:36.978032] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T22:34:36.983425] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-23T22:34:37.163768] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T22:34:37.185565] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T22:34:37.599458] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-23T22:34:37.743934] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T22:34:37.948521] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-23T22:34:38.399434] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-23T22:34:39.119927] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T22:34:39.199417] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-23T22:34:39.999406] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-23T22:34:40.105630] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T22:34:40.191334] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T22:34:40.799489] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-23T22:34:41.292449] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T22:34:41.448835] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T22:34:41.599451] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-23T22:34:42.399462] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-23T22:34:43.199427] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-23T22:34:43.262827] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T22:34:43.999417] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-23T22:34:44.710077] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T22:34:44.710294] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T22:34:44.799416] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-23T22:34:44.858740] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-23T22:34:45.485893] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T22:34:45.599422] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-23T22:34:46.399530] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-23T22:34:47.161581] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T22:34:47.199398] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-23T22:34:47.213166] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T22:34:47.999460] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-23T22:34:48.603537] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T22:34:48.799459] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-23T22:34:49.585925] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T22:34:49.599411] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-23T22:34:49.866416] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T22:34:50.399491] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-23T22:34:50.721553] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T22:34:51.199489] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-23T22:34:51.804176] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T22:34:51.999451] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-23T22:34:52.289588] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T22:34:52.799447] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-23T22:34:53.129176] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T22:34:53.599458] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-23T22:34:53.896226] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T22:34:54.399435] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-23T22:34:55.199476] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-23T22:34:55.397246] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:34:55.786693] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T22:34:55.999524] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-23T22:34:56.342097] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T22:34:56.799440] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-23T22:34:57.599404] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-23T22:34:57.660604] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T22:34:58.053710] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T22:34:58.399430] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-23T22:34:59.037060] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T22:34:59.073856] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T22:34:59.199472] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-23T22:34:59.854760] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T22:34:59.856721] [INFO ] [REMOTE ] MIY: Full fetch complete (8668 records). [2025-10-23T22:34:59.856808] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-23T22:35:00.006509] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-23T22:35:00.221678] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-23T22:35:00.221789] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-23T22:35:00.222067] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-23T22:35:00.222147] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-23T22:35:00.222619] [DEBUG] [LOCAL ] MIY: Trimmed 8668 records to 6252 (keeping 200 days of data) [2025-10-23T22:35:00.259836] [DEBUG] [LOCAL ] MIY: Primary data saved (6252 records). [2025-10-23T22:35:00.259968] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-23T22:35:00.260078] [INFO ] [MAIN ] Update Progress: 1361/2367 symbols completed. MIY took 27.4s. Estimated remaining: 2h 9m 18s. Rate: 7.8 symbols/min [2025-10-23T22:35:00.428226] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:00.467067] [DEBUG] [LOCAL ] MLI: Loaded 43388 existing records from primary storage. [2025-10-23T22:35:00.467400] [INFO ] [MAIN ] MLI: Loaded 43388 existing records. [2025-10-23T22:35:00.645073] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:00.645287] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-23T22:35:00.645363] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-23T22:35:00.645583] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-23T22:35:00.645696] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-23T22:35:00.803371] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-23T22:35:01.000701] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:01.431979] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T22:35:01.438223] [INFO ] [REMOTE ] MKL: Full fetch complete (49856 records). [2025-10-23T22:35:01.438403] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-23T22:35:01.618785] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-23T22:35:01.827576] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-23T22:35:01.827706] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-23T22:35:01.828683] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-23T22:35:01.828764] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-23T22:35:01.829853] [DEBUG] [LOCAL ] MKL: Trimmed 49856 records to 33977 (keeping 200 days of data) [2025-10-23T22:35:02.041862] [DEBUG] [LOCAL ] MKL: Primary data saved (33977 records). [2025-10-23T22:35:02.042102] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-23T22:35:02.042327] [INFO ] [MAIN ] Update Progress: 1362/2367 symbols completed. MKL took 29.3s. Estimated remaining: 2h 9m 6s. Rate: 7.8 symbols/min [2025-10-23T22:35:02.224635] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:02.237299] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T22:35:02.267286] [DEBUG] [LOCAL ] MLM: Loaded 28634 existing records from primary storage. [2025-10-23T22:35:02.267570] [INFO ] [MAIN ] MLM: Loaded 28634 existing records. [2025-10-23T22:35:02.407391] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-23T22:35:02.449097] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:02.449436] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-23T22:35:02.449514] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-23T22:35:02.449724] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-23T22:35:02.449807] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-23T22:35:02.832189] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:03.199467] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-23T22:35:03.583473] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T22:35:03.999430] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-23T22:35:04.380583] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T22:35:04.408419] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T22:35:04.412455] [INFO ] [REMOTE ] MITT: Full fetch complete (33319 records). [2025-10-23T22:35:04.412591] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-23T22:35:04.800280] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-23T22:35:04.810125] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-23T22:35:04.811233] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-23T22:35:04.811968] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-23T22:35:04.812173] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-23T22:35:04.813027] [DEBUG] [LOCAL ] MITT: Trimmed 33319 records to 22373 (keeping 200 days of data) [2025-10-23T22:35:04.940857] [DEBUG] [LOCAL ] MITT: Primary data saved (22373 records). [2025-10-23T22:35:04.941016] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-23T22:35:04.941125] [INFO ] [MAIN ] Update Progress: 1363/2367 symbols completed. MITT took 32.2s. Estimated remaining: 2h 8m 55s. Rate: 7.8 symbols/min [2025-10-23T22:35:05.112832] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:05.140493] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T22:35:05.172546] [DEBUG] [LOCAL ] MLNK: Loaded 27397 existing records from primary storage. [2025-10-23T22:35:05.172849] [INFO ] [MAIN ] MLNK: Loaded 27397 existing records. [2025-10-23T22:35:05.348229] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:05.348448] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-23T22:35:05.348525] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-23T22:35:05.348759] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-23T22:35:05.348844] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-23T22:35:05.604754] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-23T22:35:05.696962] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:06.405383] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-23T22:35:06.425708] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T22:35:06.470511] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T22:35:07.199460] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-23T22:35:07.992713] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T22:35:08.000468] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-23T22:35:08.603015] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T22:35:08.739437] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T22:35:08.751575] [INFO ] [REMOTE ] MKC: Full fetch complete (75996 records). [2025-10-23T22:35:08.751789] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-23T22:35:08.805781] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-23T22:35:09.142817] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-23T22:35:09.142978] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-23T22:35:09.144295] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-23T22:35:09.144379] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-23T22:35:09.146012] [DEBUG] [LOCAL ] MKC: Trimmed 75996 records to 52909 (keeping 200 days of data) [2025-10-23T22:35:09.472149] [DEBUG] [LOCAL ] MKC: Primary data saved (52909 records). [2025-10-23T22:35:09.472323] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-23T22:35:09.472437] [INFO ] [MAIN ] Update Progress: 1364/2367 symbols completed. MKC took 36.7s. Estimated remaining: 2h 8m 45s. Rate: 7.8 symbols/min [2025-10-23T22:35:09.611387] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-23T22:35:09.642894] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:09.647985] [DEBUG] [LOCAL ] MLP: Loaded 3004 existing records from primary storage. [2025-10-23T22:35:09.648176] [INFO ] [MAIN ] MLP: Loaded 3004 existing records. [2025-10-23T22:35:09.821031] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:09.821286] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-23T22:35:09.821361] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-23T22:35:09.821556] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-23T22:35:09.821630] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-23T22:35:10.196997] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:10.399412] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-23T22:35:10.645112] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T22:35:11.199410] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-23T22:35:11.254979] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T22:35:11.288830] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T22:35:11.999422] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-23T22:35:12.220052] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T22:35:12.799451] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-23T22:35:13.297403] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-23T22:35:13.554672] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T22:35:13.599408] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-23T22:35:14.399464] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-23T22:35:14.846761] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T22:35:15.199446] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-23T22:35:15.999490] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-23T22:35:16.113684] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T22:35:16.329466] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:35:16.484553] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-23T22:35:16.799453] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-23T22:35:17.599410] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-23T22:35:17.817972] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T22:35:18.194544] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T22:35:18.399437] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-23T22:35:19.027721] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T22:35:19.199402] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-23T22:35:19.742347] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T22:35:19.999428] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-23T22:35:20.489389] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T22:35:20.799452] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-23T22:35:21.599426] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-23T22:35:22.385403] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-23T22:35:22.399403] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-23T22:35:22.654292] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T22:35:22.872999] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-23T22:35:23.199439] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-23T22:35:23.801162] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T22:35:23.999440] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-23T22:35:24.799444] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-23T22:35:25.599428] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-23T22:35:25.671235] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T22:35:26.033782] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T22:35:26.399414] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-23T22:35:26.721815] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T22:35:26.899270] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-23T22:35:26.900337] [INFO ] [REMOTE ] MLP: Full fetch complete (4320 records). [2025-10-23T22:35:26.900428] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-23T22:35:27.204534] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-23T22:35:27.257235] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-23T22:35:27.257344] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-23T22:35:27.257558] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-23T22:35:27.257635] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-23T22:35:27.258103] [DEBUG] [LOCAL ] MLP: Trimmed 4320 records to 3014 (keeping 200 days of data) [2025-10-23T22:35:27.275141] [DEBUG] [LOCAL ] MLP: Primary data saved (3014 records). [2025-10-23T22:35:27.275243] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-23T22:35:27.275365] [INFO ] [MAIN ] Update Progress: 1365/2367 symbols completed. MLP took 17.8s. Estimated remaining: 2h 8m 45s. Rate: 7.8 symbols/min [2025-10-23T22:35:27.441797] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:27.454280] [DEBUG] [LOCAL ] MLR: Loaded 12116 existing records from primary storage. [2025-10-23T22:35:27.454524] [INFO ] [MAIN ] MLR: Loaded 12116 existing records. [2025-10-23T22:35:27.633493] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:27.633752] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-23T22:35:27.633836] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-23T22:35:27.634042] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-23T22:35:27.634116] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-23T22:35:27.983444] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:27.999410] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-23T22:35:28.401930] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T22:35:28.799477] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-23T22:35:29.124397] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T22:35:29.599524] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-23T22:35:30.391155] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T22:35:30.400904] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-23T22:35:30.613561] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T22:35:31.199426] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-23T22:35:31.276038] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-23T22:35:31.999456] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-23T22:35:32.227176] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T22:35:32.799493] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-23T22:35:33.170707] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T22:35:33.599444] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-23T22:35:34.370582] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T22:35:34.399399] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-23T22:35:34.587370] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T22:35:35.199438] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-23T22:35:35.805763] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T22:35:35.999423] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-23T22:35:36.314847] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T22:35:36.396442] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-23T22:35:36.401021] [INFO ] [REMOTE ] MLM: Full fetch complete (45048 records). [2025-10-23T22:35:36.401130] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-23T22:35:36.766395] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-23T22:35:36.766505] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-23T22:35:36.767281] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-23T22:35:36.767359] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-23T22:35:36.768368] [DEBUG] [LOCAL ] MLM: Trimmed 45048 records to 28771 (keeping 200 days of data) [2025-10-23T22:35:36.822569] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-23T22:35:36.943505] [DEBUG] [LOCAL ] MLM: Primary data saved (28771 records). [2025-10-23T22:35:36.943672] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-23T22:35:36.943804] [INFO ] [MAIN ] Update Progress: 1366/2367 symbols completed. MLM took 34.9s. Estimated remaining: 2h 8m 38s. Rate: 7.8 symbols/min [2025-10-23T22:35:37.112811] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:37.161014] [DEBUG] [LOCAL ] MMC: Loaded 51936 existing records from primary storage. [2025-10-23T22:35:37.161369] [INFO ] [MAIN ] MMC: Loaded 51936 existing records. [2025-10-23T22:35:37.334867] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:37.335030] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-23T22:35:37.335103] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-23T22:35:37.335412] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-23T22:35:37.335494] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-23T22:35:37.604577] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-23T22:35:37.685630] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:38.377385] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T22:35:38.384841] [INFO ] [REMOTE ] MLI: Full fetch complete (63299 records). [2025-10-23T22:35:38.385077] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-23T22:35:38.406276] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-23T22:35:38.773968] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-23T22:35:38.774182] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-23T22:35:38.775310] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-23T22:35:38.775397] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-23T22:35:38.776763] [DEBUG] [LOCAL ] MLI: Trimmed 63299 records to 43734 (keeping 200 days of data) [2025-10-23T22:35:39.012144] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T22:35:39.064584] [DEBUG] [LOCAL ] MLI: Primary data saved (43734 records). [2025-10-23T22:35:39.064768] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-23T22:35:39.064907] [INFO ] [MAIN ] Update Progress: 1367/2367 symbols completed. MLI took 38.8s. Estimated remaining: 2h 8m 27s. Rate: 7.8 symbols/min [2025-10-23T22:35:39.206440] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-23T22:35:39.231303] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:39.243322] [DEBUG] [LOCAL ] MMD: Loaded 10733 existing records from primary storage. [2025-10-23T22:35:39.243580] [INFO ] [MAIN ] MMD: Loaded 10733 existing records. [2025-10-23T22:35:39.416378] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:39.416584] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-23T22:35:39.416706] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-23T22:35:39.416932] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-23T22:35:39.417025] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-23T22:35:39.768055] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:39.999459] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-23T22:35:40.046316] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T22:35:40.399506] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-23T22:35:40.799435] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-23T22:35:40.980624] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T22:35:41.599503] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-23T22:35:42.366694] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T22:35:42.399411] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-23T22:35:42.607472] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T22:35:43.199433] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-23T22:35:43.229122] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T22:35:43.999438] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-23T22:35:44.107184] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T22:35:44.799451] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-23T22:35:45.599415] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-23T22:35:45.931394] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T22:35:45.966400] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-23T22:35:46.399424] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-23T22:35:46.928627] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T22:35:47.139796] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T22:35:47.199426] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-23T22:35:47.999496] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-23T22:35:48.107284] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T22:35:48.110122] [INFO ] [REMOTE ] MLR: Full fetch complete (18923 records). [2025-10-23T22:35:48.110223] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-23T22:35:48.561054] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-23T22:35:48.561212] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-23T22:35:48.561853] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-23T22:35:48.561955] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-23T22:35:48.562829] [DEBUG] [LOCAL ] MLR: Trimmed 18923 records to 12181 (keeping 200 days of data) [2025-10-23T22:35:48.662963] [DEBUG] [LOCAL ] MLR: Primary data saved (12181 records). [2025-10-23T22:35:48.663179] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-23T22:35:48.663303] [INFO ] [MAIN ] Update Progress: 1368/2367 symbols completed. MLR took 21.4s. Estimated remaining: 2h 8m 20s. Rate: 7.8 symbols/min [2025-10-23T22:35:48.805703] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-23T22:35:48.926400] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:48.950956] [DEBUG] [LOCAL ] MMI: Loaded 15372 existing records from primary storage. [2025-10-23T22:35:48.951343] [INFO ] [MAIN ] MMI: Loaded 15372 existing records. [2025-10-23T22:35:49.179195] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:35:49.179555] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-23T22:35:49.179761] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-23T22:35:49.180023] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-23T22:35:49.180101] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-23T22:35:49.514584] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T22:35:49.585801] [INFO ] [REMOTE ] MLNK: Full fetch complete (37934 records). [2025-10-23T22:35:49.592154] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:49.592623] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-23T22:35:49.604708] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-23T22:35:49.686619] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:35:49.982322] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-23T22:35:49.982436] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-23T22:35:49.983345] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-23T22:35:49.983428] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-23T22:35:49.984376] [DEBUG] [LOCAL ] MLNK: Trimmed 37934 records to 27685 (keeping 200 days of data) [2025-10-23T22:35:50.139350] [DEBUG] [LOCAL ] MLNK: Primary data saved (27685 records). [2025-10-23T22:35:50.139513] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-23T22:35:50.139627] [INFO ] [MAIN ] Update Progress: 1369/2367 symbols completed. MLNK took 45.2s. Estimated remaining: 2h 8m 8s. Rate: 7.8 symbols/min [2025-10-23T22:35:50.308368] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:50.308571] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-23T22:35:50.308640] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-23T22:35:50.308793] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-23T22:35:50.308861] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-23T22:35:50.308972] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-23T22:35:50.309040] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-23T22:35:50.406038] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-23T22:35:50.691103] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:51.199433] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-23T22:35:51.444936] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T22:35:51.681925] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-23T22:35:51.999473] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-10-23T22:35:52.147452] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T22:35:52.198552] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:35:52.198920] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-10-23T22:35:52.199011] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:35:52.199084] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-23T22:35:52.199150] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:35:52.199222] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-23T22:35:52.199312] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-23T22:35:52.199382] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-23T22:35:52.199493] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-23T22:35:52.199585] [INFO ] [MAIN ] Update Progress: 1370/2367 symbols completed. MMID took 2.1s. Estimated remaining: 2h 7m 56s. Rate: 7.8 symbols/min [2025-10-23T22:35:52.365397] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:35:52.365580] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-23T22:35:52.365676] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-23T22:35:52.365819] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-23T22:35:52.365907] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-23T22:35:52.366018] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-23T22:35:52.366107] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-23T22:35:52.724842] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:35:52.799431] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-23T22:35:53.321818] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-23T22:35:53.599439] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-23T22:35:54.375742] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T22:35:54.399403] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-23T22:35:55.199423] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-23T22:35:55.453063] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T22:35:55.999454] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-23T22:35:56.285467] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-23T22:35:56.755261] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T22:35:56.799399] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-23T22:35:57.262379] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T22:35:57.599434] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-23T22:35:58.399438] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-23T22:35:59.199427] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-23T22:35:59.386349] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T22:35:59.406010] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T22:35:59.661371] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T22:35:59.999441] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-23T22:36:00.799471] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-23T22:36:00.962094] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T22:36:01.599424] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-23T22:36:01.972562] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T22:36:02.044121] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T22:36:02.399433] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-23T22:36:03.177580] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T22:36:03.199390] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-23T22:36:03.559529] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-23T22:36:03.999489] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-23T22:36:04.799443] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-23T22:36:04.971755] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T22:36:05.180268] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-23T22:36:05.599476] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-23T22:36:06.119404] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-23T22:36:06.399462] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-23T22:36:07.199430] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-23T22:36:07.425943] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:36:07.621987] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-23T22:36:07.999493] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-23T22:36:08.311899] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-23T22:36:08.312853] [INFO ] [REMOTE ] MMKT: Full fetch complete (2132 records). [2025-10-23T22:36:08.312941] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-23T22:36:08.487493] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T22:36:08.487732] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:36:08.487808] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:36:08.487909] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-23T22:36:08.488008] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-23T22:36:08.488085] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-23T22:36:08.488168] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-23T22:36:08.488308] [INFO ] [MAIN ] Update Progress: 1371/2367 symbols completed. MMKT took 16.3s. Estimated remaining: 2h 7m 55s. Rate: 7.8 symbols/min [2025-10-23T22:36:08.654145] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:08.704757] [DEBUG] [LOCAL ] MMM: Loaded 53112 existing records from primary storage. [2025-10-23T22:36:08.705114] [INFO ] [MAIN ] MMM: Loaded 53112 existing records. [2025-10-23T22:36:08.804543] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-23T22:36:08.909673] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:08.909985] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-23T22:36:08.910071] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-23T22:36:08.910358] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-23T22:36:08.910435] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-23T22:36:09.277637] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:09.599423] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-23T22:36:09.753774] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T22:36:10.399462] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-23T22:36:11.199483] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-23T22:36:11.469960] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T22:36:11.999481] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-23T22:36:12.097311] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T22:36:12.535766] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-23T22:36:12.579704] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T22:36:12.799439] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-23T22:36:13.599423] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-23T22:36:13.753540] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T22:36:14.399437] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-23T22:36:14.440943] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T22:36:14.443368] [INFO ] [REMOTE ] MMD: Full fetch complete (16996 records). [2025-10-23T22:36:14.443492] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-23T22:36:14.878368] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-23T22:36:14.878484] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-23T22:36:14.878931] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-23T22:36:14.879013] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-23T22:36:14.879634] [DEBUG] [LOCAL ] MMD: Trimmed 16996 records to 10792 (keeping 200 days of data) [2025-10-23T22:36:14.948431] [DEBUG] [LOCAL ] MMD: Primary data saved (10792 records). [2025-10-23T22:36:14.948601] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-23T22:36:14.948739] [INFO ] [MAIN ] Update Progress: 1372/2367 symbols completed. MMD took 35.9s. Estimated remaining: 2h 7m 46s. Rate: 7.8 symbols/min [2025-10-23T22:36:15.155359] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:15.187541] [DEBUG] [LOCAL ] MMS: Loaded 33396 existing records from primary storage. [2025-10-23T22:36:15.188068] [INFO ] [MAIN ] MMS: Loaded 33396 existing records. [2025-10-23T22:36:15.207304] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:36:15.206799] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-23T22:36:15.375822] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:15.376030] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-23T22:36:15.376116] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-23T22:36:15.376354] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-23T22:36:15.376428] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-23T22:36:15.721006] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:15.999494] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-23T22:36:16.799418] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-23T22:36:17.184068] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T22:36:17.187521] [INFO ] [REMOTE ] MMI: Full fetch complete (21887 records). [2025-10-23T22:36:17.187612] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-23T22:36:17.549525] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-23T22:36:17.549726] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-23T22:36:17.550290] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-23T22:36:17.550374] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-23T22:36:17.551154] [DEBUG] [LOCAL ] MMI: Trimmed 21887 records to 15494 (keeping 200 days of data) [2025-10-23T22:36:17.619692] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-23T22:36:17.671998] [DEBUG] [LOCAL ] MMI: Primary data saved (15494 records). [2025-10-23T22:36:17.672286] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-23T22:36:17.672527] [INFO ] [MAIN ] Update Progress: 1373/2367 symbols completed. MMI took 29.0s. Estimated remaining: 2h 7m 35s. Rate: 7.8 symbols/min [2025-10-23T22:36:17.674101] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-23T22:36:17.849927] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:17.860983] [DEBUG] [LOCAL ] MMT: Loaded 10142 existing records from primary storage. [2025-10-23T22:36:17.861203] [INFO ] [MAIN ] MMT: Loaded 10142 existing records. [2025-10-23T22:36:18.033903] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:18.034077] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-23T22:36:18.034158] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-23T22:36:18.034338] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-23T22:36:18.034423] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-23T22:36:18.384452] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:18.399390] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-23T22:36:18.673446] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T22:36:19.078596] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T22:36:19.199400] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-23T22:36:19.538181] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T22:36:19.999435] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-23T22:36:20.799453] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-23T22:36:20.880270] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T22:36:21.516089] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T22:36:21.599424] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-23T22:36:22.399424] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-23T22:36:22.700510] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T22:36:23.149272] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T22:36:23.199410] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-23T22:36:23.249687] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T22:36:23.999431] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-23T22:36:24.764780] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T22:36:24.799399] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-23T22:36:25.004894] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T22:36:25.599419] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-23T22:36:26.018043] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T22:36:26.407205] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-23T22:36:26.412047] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:36:26.421570] [INFO ] [REMOTE ] MMC: Full fetch complete (75236 records). [2025-10-23T22:36:26.421745] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-23T22:36:26.805987] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-23T22:36:26.806104] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-23T22:36:26.807301] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-23T22:36:26.807404] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-23T22:36:26.808949] [DEBUG] [LOCAL ] MMC: Trimmed 75236 records to 52316 (keeping 200 days of data) [2025-10-23T22:36:27.128089] [DEBUG] [LOCAL ] MMC: Primary data saved (52316 records). [2025-10-23T22:36:27.128243] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-23T22:36:27.128367] [INFO ] [MAIN ] Update Progress: 1374/2367 symbols completed. MMC took 50.2s. Estimated remaining: 2h 7m 28s. Rate: 7.8 symbols/min [2025-10-23T22:36:27.204534] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-23T22:36:27.296702] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:27.313818] [DEBUG] [LOCAL ] MMU: Loaded 16784 existing records from primary storage. [2025-10-23T22:36:27.314089] [INFO ] [MAIN ] MMU: Loaded 16784 existing records. [2025-10-23T22:36:27.487225] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:27.487451] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-23T22:36:27.487526] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-23T22:36:27.487743] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-23T22:36:27.487816] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-23T22:36:27.835596] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:27.912057] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T22:36:27.999409] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-23T22:36:28.593908] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-23T22:36:28.799482] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-23T22:36:29.317294] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T22:36:29.599453] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-23T22:36:30.399442] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-23T22:36:30.730051] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T22:36:30.782158] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T22:36:31.186102] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:36:31.199403] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-23T22:36:31.951415] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T22:36:31.999408] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-23T22:36:32.799452] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-23T22:36:33.374730] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T22:36:33.599472] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-23T22:36:34.399480] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-23T22:36:34.576723] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-23T22:36:34.754880] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T22:36:35.058848] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-23T22:36:35.199424] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-23T22:36:35.960978] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T22:36:35.999418] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-23T22:36:36.751720] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T22:36:36.799420] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-23T22:36:37.599450] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-23T22:36:38.399429] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-23T22:36:38.975101] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T22:36:39.024332] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-23T22:36:39.135156] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T22:36:39.199406] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-23T22:36:39.999496] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-23T22:36:40.706776] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T22:36:40.799506] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-23T22:36:40.857605] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T22:36:41.599502] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-23T22:36:42.115081] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T22:36:42.399481] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-23T22:36:43.199422] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-23T22:36:43.666700] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-23T22:36:43.702044] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T22:36:43.709030] [INFO ] [REMOTE ] MMS: Full fetch complete (51069 records). [2025-10-23T22:36:43.709270] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-23T22:36:43.848503] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:36:43.870028] [INFO ] [REMOTE ] MMT: Full fetch complete (15908 records). [2025-10-23T22:36:43.891343] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-23T22:36:44.006744] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-23T22:36:44.498311] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-23T22:36:44.498501] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-23T22:36:44.499599] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-23T22:36:44.500111] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-23T22:36:44.578022] [DEBUG] [LOCAL ] MMS: Trimmed 51069 records to 33605 (keeping 200 days of data) [2025-10-23T22:36:44.588475] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-23T22:36:44.589004] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-23T22:36:44.589250] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-23T22:36:44.589327] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-23T22:36:44.651041] [DEBUG] [LOCAL ] MMT: Trimmed 15908 records to 10170 (keeping 200 days of data) [2025-10-23T22:36:44.804528] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-23T22:36:44.852606] [DEBUG] [LOCAL ] MMS: Primary data saved (33605 records). [2025-10-23T22:36:44.853764] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-23T22:36:44.854384] [INFO ] [MAIN ] Update Progress: 1375/2367 symbols completed. MMS took 29.9s. Estimated remaining: 2h 7m 28s. Rate: 7.8 symbols/min [2025-10-23T22:36:44.960538] [DEBUG] [LOCAL ] MMT: Primary data saved (10170 records). [2025-10-23T22:36:44.960957] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-23T22:36:44.966423] [INFO ] [MAIN ] Update Progress: 1376/2367 symbols completed. MMT took 27.3s. Estimated remaining: 2h 7m 15s. Rate: 7.8 symbols/min [2025-10-23T22:36:45.136318] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:45.199360] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:45.217746] [DEBUG] [LOCAL ] MNR: Loaded 24999 existing records from primary storage. [2025-10-23T22:36:45.218064] [INFO ] [MAIN ] MNR: Loaded 24999 existing records. [2025-10-23T22:36:45.405876] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:45.416823] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-23T22:36:45.417630] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-23T22:36:45.418340] [DEBUG] [LOCAL ] MNSO: Loaded 44038 existing records from primary storage. [2025-10-23T22:36:45.418379] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-23T22:36:45.418532] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-23T22:36:45.460955] [INFO ] [MAIN ] MNSO: Loaded 44038 existing records. [2025-10-23T22:36:45.842399] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:45.852748] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T22:36:45.863324] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-23T22:36:45.868671] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-23T22:36:45.898215] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-23T22:36:45.898632] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-23T22:36:45.898938] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-23T22:36:46.059435] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:46.288307] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-23T22:36:46.373706] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:46.399390] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-23T22:36:46.943949] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T22:36:47.199489] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-23T22:36:47.999475] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-23T22:36:48.206305] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T22:36:48.438258] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T22:36:48.612091] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T22:36:48.621692] [INFO ] [REMOTE ] MMM: Full fetch complete (77221 records). [2025-10-23T22:36:48.621865] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-23T22:36:48.805073] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-23T22:36:49.038674] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-23T22:36:49.038790] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-23T22:36:49.040027] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-23T22:36:49.040113] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-23T22:36:49.041600] [DEBUG] [LOCAL ] MMM: Trimmed 77221 records to 53501 (keeping 200 days of data) [2025-10-23T22:36:49.362901] [DEBUG] [LOCAL ] MMM: Primary data saved (53501 records). [2025-10-23T22:36:49.363056] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-23T22:36:49.363164] [INFO ] [MAIN ] Update Progress: 1377/2367 symbols completed. MMM took 40.9s. Estimated remaining: 2h 7m 5s. Rate: 7.8 symbols/min [2025-10-23T22:36:49.531835] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:49.531979] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-23T22:36:49.532052] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-23T22:36:49.532166] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-23T22:36:49.532233] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-23T22:36:49.532311] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-23T22:36:49.532386] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-23T22:36:49.605593] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-23T22:36:49.888582] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:50.059388] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T22:36:50.399447] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-10-23T22:36:50.619500] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:36:50.619876] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-10-23T22:36:50.619962] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:36:50.620034] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-23T22:36:50.620101] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:36:50.620173] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-23T22:36:50.620263] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-23T22:36:50.620334] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-23T22:36:50.620414] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-23T22:36:50.620494] [INFO ] [MAIN ] Update Progress: 1378/2367 symbols completed. MNTN took 1.3s. Estimated remaining: 2h 6m 52s. Rate: 7.8 symbols/min [2025-10-23T22:36:50.785754] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:50.785944] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-23T22:36:50.786016] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-23T22:36:50.786098] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-23T22:36:50.786168] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-23T22:36:50.786251] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-23T22:36:50.786325] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-23T22:36:51.136114] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:51.199408] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-23T22:36:51.282384] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T22:36:51.999518] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-23T22:36:52.576153] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T22:36:52.799422] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-23T22:36:53.104885] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:36:53.599445] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-23T22:36:54.399423] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-23T22:36:54.569525] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T22:36:54.789010] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T22:36:55.199448] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-23T22:36:55.315111] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T22:36:55.322293] [INFO ] [REMOTE ] MMU: Full fetch complete (25018 records). [2025-10-23T22:36:55.323397] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-23T22:36:55.683435] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-23T22:36:55.683551] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-23T22:36:55.684134] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-23T22:36:55.684211] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-23T22:36:55.684947] [DEBUG] [LOCAL ] MMU: Trimmed 25018 records to 16875 (keeping 200 days of data) [2025-10-23T22:36:55.783797] [DEBUG] [LOCAL ] MMU: Primary data saved (16875 records). [2025-10-23T22:36:55.783949] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-23T22:36:55.784059] [INFO ] [MAIN ] Update Progress: 1379/2367 symbols completed. MMU took 28.7s. Estimated remaining: 2h 6m 43s. Rate: 7.8 symbols/min [2025-10-23T22:36:55.952102] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:36:55.996310] [DEBUG] [LOCAL ] MOD: Loaded 44505 existing records from primary storage. [2025-10-23T22:36:55.996676] [INFO ] [MAIN ] MOD: Loaded 44505 existing records. [2025-10-23T22:36:56.007956] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-23T22:36:56.192889] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:36:56.194068] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T22:36:56.194132] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-23T22:36:56.198716] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-23T22:36:56.199456] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-23T22:36:56.199533] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-23T22:36:56.545739] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:36:56.799417] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-23T22:36:57.599465] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-23T22:36:57.772346] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:36:58.046383] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-23T22:36:58.399443] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-23T22:36:59.029039] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T22:36:59.199389] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-23T22:36:59.235019] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T22:36:59.999451] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-23T22:37:00.799432] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-23T22:37:01.201910] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-23T22:37:01.599477] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-23T22:37:01.914596] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T22:37:02.399464] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-23T22:37:02.617196] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T22:37:03.113358] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-23T22:37:03.199410] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-23T22:37:03.999443] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-23T22:37:04.049815] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T22:37:04.799423] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-23T22:37:05.148147] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T22:37:05.353911] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-23T22:37:05.599464] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-23T22:37:06.358712] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T22:37:06.399401] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-23T22:37:06.671350] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T22:37:07.199456] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-23T22:37:08.005957] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-23T22:37:08.021444] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T22:37:08.799399] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-23T22:37:09.082147] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T22:37:09.599435] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-23T22:37:10.376608] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T22:37:10.399402] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-23T22:37:10.487681] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-23T22:37:11.024000] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T22:37:11.199446] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-23T22:37:12.004626] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-23T22:37:12.020334] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T22:37:12.028575] [INFO ] [REMOTE ] MNSO: Full fetch complete (64534 records). [2025-10-23T22:37:12.028764] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-23T22:37:12.415544] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-23T22:37:12.415683] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-23T22:37:12.416670] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-23T22:37:12.416749] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-23T22:37:12.418058] [DEBUG] [LOCAL ] MNSO: Trimmed 64534 records to 44260 (keeping 200 days of data) [2025-10-23T22:37:12.704376] [DEBUG] [LOCAL ] MNSO: Primary data saved (44260 records). [2025-10-23T22:37:12.704538] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-23T22:37:12.704674] [INFO ] [MAIN ] Update Progress: 1380/2367 symbols completed. MNSO took 27.7s. Estimated remaining: 2h 6m 42s. Rate: 7.8 symbols/min [2025-10-23T22:37:12.806698] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-23T22:37:12.881383] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:37:12.958113] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T22:37:12.958929] [DEBUG] [LOCAL ] MODG: Loaded 51534 existing records from primary storage. [2025-10-23T22:37:12.969355] [INFO ] [MAIN ] MODG: Loaded 51534 existing records. [2025-10-23T22:37:13.143162] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:37:13.143384] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-23T22:37:13.143459] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-23T22:37:13.143708] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-23T22:37:13.143855] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-23T22:37:13.491989] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:37:13.599399] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-23T22:37:14.042679] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T22:37:14.047385] [INFO ] [REMOTE ] MNR: Full fetch complete (36984 records). [2025-10-23T22:37:14.047498] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-23T22:37:14.419863] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-23T22:37:14.435852] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-23T22:37:14.436176] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-23T22:37:14.437133] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-23T22:37:14.437631] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-23T22:37:14.438946] [DEBUG] [LOCAL ] MNR: Trimmed 36984 records to 25198 (keeping 200 days of data) [2025-10-23T22:37:14.562144] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-23T22:37:14.634532] [DEBUG] [LOCAL ] MNR: Primary data saved (25198 records). [2025-10-23T22:37:14.634733] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-23T22:37:14.634859] [INFO ] [MAIN ] Update Progress: 1381/2367 symbols completed. MNR took 29.8s. Estimated remaining: 2h 6m 30s. Rate: 7.8 symbols/min [2025-10-23T22:37:14.800500] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:37:14.839822] [DEBUG] [LOCAL ] MOH: Loaded 43041 existing records from primary storage. [2025-10-23T22:37:14.840141] [INFO ] [MAIN ] MOH: Loaded 43041 existing records. [2025-10-23T22:37:15.021531] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:37:15.021794] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-23T22:37:15.021872] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-23T22:37:15.022083] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-23T22:37:15.022163] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-23T22:37:15.221070] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-23T22:37:15.386144] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:37:15.595851] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T22:37:16.003268] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-23T22:37:16.008519] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T22:37:16.799432] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-23T22:37:17.599429] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-23T22:37:17.684028] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-23T22:37:17.745166] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T22:37:18.223525] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T22:37:18.399438] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-23T22:37:19.199472] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-23T22:37:19.276159] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T22:37:19.999417] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-23T22:37:20.209826] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T22:37:20.799433] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-23T22:37:21.275499] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T22:37:21.505750] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-23T22:37:21.599410] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-23T22:37:22.361479] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T22:37:22.399431] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-23T22:37:23.199417] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-23T22:37:23.999417] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-23T22:37:24.051829] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T22:37:24.065567] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-23T22:37:24.799422] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-23T22:37:24.951142] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T22:37:25.599409] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-23T22:37:25.701600] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T22:37:26.399432] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-23T22:37:26.528118] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T22:37:27.199446] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-23T22:37:27.827747] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-23T22:37:27.989310] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T22:37:27.996916] [INFO ] [REMOTE ] MOD: Full fetch complete (66463 records). [2025-10-23T22:37:27.997094] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-23T22:37:28.009143] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-23T22:37:28.389340] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-23T22:37:28.389452] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-23T22:37:28.390482] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-23T22:37:28.390561] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-23T22:37:28.391892] [DEBUG] [LOCAL ] MOD: Trimmed 66463 records to 44795 (keeping 200 days of data) [2025-10-23T22:37:28.652172] [DEBUG] [LOCAL ] MOD: Primary data saved (44795 records). [2025-10-23T22:37:28.652331] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-23T22:37:28.652444] [INFO ] [MAIN ] Update Progress: 1382/2367 symbols completed. MOD took 32.9s. Estimated remaining: 2h 6m 27s. Rate: 7.8 symbols/min [2025-10-23T22:37:28.803132] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-23T22:37:28.850849] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:37:28.833515] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:37:28.905744] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-23T22:37:28.906101] [INFO ] [MAIN ] MOS: Loaded 53511 existing records. [2025-10-23T22:37:29.083894] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:37:29.084167] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-23T22:37:29.084251] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-23T22:37:29.084511] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-23T22:37:29.084586] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-23T22:37:29.444185] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:37:29.536791] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T22:37:29.599398] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-23T22:37:30.399444] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-23T22:37:31.110360] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-23T22:37:31.199429] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-23T22:37:31.421724] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T22:37:31.758020] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T22:37:31.999450] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-23T22:37:32.799438] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-23T22:37:33.243911] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-23T22:37:33.545918] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:37:33.555167] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-23T22:37:33.555307] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-23T22:37:33.604627] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-23T22:37:33.775504] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T22:37:33.776295] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:37:33.776372] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:37:33.776455] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-23T22:37:33.776553] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-23T22:37:33.776632] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-23T22:37:33.776744] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-23T22:37:33.776860] [INFO ] [MAIN ] Update Progress: 1383/2367 symbols completed. MO took 43.2s. Estimated remaining: 2h 6m 17s. Rate: 7.8 symbols/min [2025-10-23T22:37:33.945673] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:37:33.966756] [DEBUG] [LOCAL ] MOV: Loaded 21161 existing records from primary storage. [2025-10-23T22:37:33.967039] [INFO ] [MAIN ] MOV: Loaded 21161 existing records. [2025-10-23T22:37:34.149193] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:37:34.149589] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-23T22:37:34.165694] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-23T22:37:34.176336] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-23T22:37:34.176455] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-23T22:37:34.244063] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-23T22:37:34.404537] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-23T22:37:34.551386] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:37:35.199457] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-23T22:37:35.522181] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T22:37:35.756471] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T22:37:35.999449] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-23T22:37:36.799421] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-23T22:37:37.009306] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-23T22:37:37.046099] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T22:37:37.599469] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-23T22:37:38.227304] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T22:37:38.264604] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T22:37:38.399411] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-23T22:37:39.131244] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:37:39.139139] [INFO ] [REMOTE ] MOH: Full fetch complete (60002 records). [2025-10-23T22:37:39.139287] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-23T22:37:39.204625] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-23T22:37:39.522357] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-23T22:37:39.522485] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-23T22:37:39.523514] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-23T22:37:39.523594] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-23T22:37:39.524862] [DEBUG] [LOCAL ] MOH: Trimmed 60002 records to 43431 (keeping 200 days of data) [2025-10-23T22:37:39.784516] [DEBUG] [LOCAL ] MOH: Primary data saved (43431 records). [2025-10-23T22:37:39.784695] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-23T22:37:39.784810] [INFO ] [MAIN ] Update Progress: 1384/2367 symbols completed. MOH took 25.1s. Estimated remaining: 2h 6m 8s. Rate: 7.8 symbols/min [2025-10-23T22:37:39.951606] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:37:40.001213] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-23T22:37:40.003098] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-23T22:37:40.003533] [INFO ] [MAIN ] MP: Loaded 53744 existing records. [2025-10-23T22:37:40.195046] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T22:37:40.194465] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:37:40.199517] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-23T22:37:40.199939] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-23T22:37:40.200158] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-23T22:37:40.200229] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-23T22:37:40.549199] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:37:40.799435] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-23T22:37:41.599445] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-23T22:37:41.834564] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T22:37:42.325769] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T22:37:42.399401] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-23T22:37:42.716407] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T22:37:43.199426] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-23T22:37:43.999416] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-23T22:37:44.473958] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-23T22:37:44.799486] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-23T22:37:45.099243] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T22:37:45.599439] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-23T22:37:45.890485] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T22:37:45.899427] [INFO ] [REMOTE ] MODG: Full fetch complete (74791 records). [2025-10-23T22:37:45.899620] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-23T22:37:46.282728] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-23T22:37:46.282838] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-23T22:37:46.283870] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-23T22:37:46.283949] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-23T22:37:46.285348] [DEBUG] [LOCAL ] MODG: Trimmed 74791 records to 51898 (keeping 200 days of data) [2025-10-23T22:37:46.444922] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-23T22:37:46.593750] [DEBUG] [LOCAL ] MODG: Primary data saved (51898 records). [2025-10-23T22:37:46.593931] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-23T22:37:46.595227] [INFO ] [MAIN ] Update Progress: 1385/2367 symbols completed. MODG took 33.9s. Estimated remaining: 2h 5m 60s. Rate: 7.8 symbols/min [2025-10-23T22:37:46.772428] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:37:46.781696] [DEBUG] [LOCAL ] MPA: Loaded 5192 existing records from primary storage. [2025-10-23T22:37:46.781955] [INFO ] [MAIN ] MPA: Loaded 5192 existing records. [2025-10-23T22:37:46.990866] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:37:46.993739] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:37:47.002038] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-23T22:37:47.002916] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-23T22:37:47.023508] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-23T22:37:47.033891] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-23T22:37:47.129324] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-23T22:37:47.211912] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-23T22:37:47.436172] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:37:47.999530] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-23T22:37:48.202275] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:37:48.745741] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T22:37:48.799453] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-23T22:37:49.355730] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T22:37:49.399167] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T22:37:49.599515] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-23T22:37:50.399402] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-23T22:37:50.797399] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T22:37:51.052044] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T22:37:51.199454] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-23T22:37:51.999432] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-23T22:37:52.799420] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-23T22:37:53.013334] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T22:37:53.521355] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-23T22:37:53.521742] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T22:37:53.599437] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-23T22:37:54.399460] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-23T22:37:55.199448] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-23T22:37:55.473692] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T22:37:55.650334] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-23T22:37:55.650508] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T22:37:55.999465] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-23T22:37:56.799444] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-23T22:37:57.409924] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T22:37:57.599450] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-23T22:37:58.399434] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-23T22:37:58.486201] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-23T22:37:58.615921] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T22:37:59.199477] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-23T22:37:59.834562] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-23T22:37:59.883343] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T22:37:59.999401] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-23T22:38:00.703202] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-23T22:38:00.799414] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-23T22:38:01.599434] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-23T22:38:02.399488] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-23T22:38:03.076792] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T22:38:03.199444] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-23T22:38:03.482970] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T22:38:03.549825] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-23T22:38:03.812661] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T22:38:03.814350] [INFO ] [REMOTE ] MPA: Full fetch complete (7082 records). [2025-10-23T22:38:03.814460] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-23T22:38:04.004722] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-23T22:38:04.182164] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-23T22:38:04.182290] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-23T22:38:04.182570] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-23T22:38:04.182674] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-23T22:38:04.183129] [DEBUG] [LOCAL ] MPA: Trimmed 7082 records to 5223 (keeping 200 days of data) [2025-10-23T22:38:04.214121] [DEBUG] [LOCAL ] MPA: Primary data saved (5223 records). [2025-10-23T22:38:04.214260] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-23T22:38:04.214374] [INFO ] [MAIN ] Update Progress: 1386/2367 symbols completed. MPA took 17.6s. Estimated remaining: 2h 5m 59s. Rate: 7.8 symbols/min [2025-10-23T22:38:04.388408] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:04.446797] [DEBUG] [LOCAL ] MPC: Loaded 51893 existing records from primary storage. [2025-10-23T22:38:04.447218] [INFO ] [MAIN ] MPC: Loaded 51893 existing records. [2025-10-23T22:38:04.645151] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:04.645435] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-23T22:38:04.645518] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-23T22:38:04.645780] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-23T22:38:04.645856] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-23T22:38:04.803114] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-23T22:38:05.014936] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:05.599415] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-23T22:38:05.903099] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T22:38:05.930431] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T22:38:06.399448] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-23T22:38:07.199511] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-23T22:38:07.480280] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T22:38:07.483673] [INFO ] [REMOTE ] MOV: Full fetch complete (30504 records). [2025-10-23T22:38:07.483783] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-23T22:38:07.856611] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-23T22:38:07.856772] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-23T22:38:07.857421] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-23T22:38:07.857497] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-23T22:38:07.858274] [DEBUG] [LOCAL ] MOV: Trimmed 30504 records to 21238 (keeping 200 days of data) [2025-10-23T22:38:07.988807] [DEBUG] [LOCAL ] MOV: Primary data saved (21238 records). [2025-10-23T22:38:07.989117] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-23T22:38:07.989289] [INFO ] [MAIN ] Update Progress: 1387/2367 symbols completed. MOV took 34.2s. Estimated remaining: 2h 5m 49s. Rate: 7.8 symbols/min [2025-10-23T22:38:08.020893] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-23T22:38:08.163195] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:08.210116] [DEBUG] [LOCAL ] MPLX: Loaded 50774 existing records from primary storage. [2025-10-23T22:38:08.210526] [INFO ] [MAIN ] MPLX: Loaded 50774 existing records. [2025-10-23T22:38:08.394729] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:08.395110] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-23T22:38:08.395271] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-23T22:38:08.395680] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-23T22:38:08.395774] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-23T22:38:08.506915] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-10-23T22:38:08.810107] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:08.811210] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-23T22:38:08.867225] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T22:38:08.971585] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T22:38:09.599506] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-23T22:38:10.399472] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-23T22:38:11.199483] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-23T22:38:11.414228] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T22:38:11.648548] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-23T22:38:11.690387] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T22:38:11.699911] [INFO ] [REMOTE ] MOS: Full fetch complete (77630 records). [2025-10-23T22:38:11.700071] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-23T22:38:12.004625] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-23T22:38:12.121606] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-23T22:38:12.121772] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-23T22:38:12.123087] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-23T22:38:12.123262] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-23T22:38:12.124803] [DEBUG] [LOCAL ] MOS: Trimmed 77630 records to 53900 (keeping 200 days of data) [2025-10-23T22:38:12.371731] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T22:38:12.496081] [DEBUG] [LOCAL ] MOS: Primary data saved (53900 records). [2025-10-23T22:38:12.496244] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-23T22:38:12.496361] [INFO ] [MAIN ] Update Progress: 1388/2367 symbols completed. MOS took 43.8s. Estimated remaining: 2h 5m 39s. Rate: 7.8 symbols/min [2025-10-23T22:38:12.660346] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:12.667440] [DEBUG] [LOCAL ] MPV: Loaded 4350 existing records from primary storage. [2025-10-23T22:38:12.667672] [INFO ] [MAIN ] MPV: Loaded 4350 existing records. [2025-10-23T22:38:12.804610] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-23T22:38:12.841739] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:12.842882] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-23T22:38:12.843002] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-23T22:38:12.843188] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-23T22:38:12.843326] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-23T22:38:13.271398] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:13.599422] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-23T22:38:13.758094] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T22:38:14.399424] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-23T22:38:15.199417] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-23T22:38:15.381549] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T22:38:15.748463] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-23T22:38:15.757828] [INFO ] [REMOTE ] MP: Full fetch complete (77581 records). [2025-10-23T22:38:15.758005] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-23T22:38:16.005686] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-23T22:38:16.041584] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T22:38:16.176275] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-23T22:38:16.176517] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-23T22:38:16.177694] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-23T22:38:16.177937] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-23T22:38:16.179529] [DEBUG] [LOCAL ] MP: Trimmed 77581 records to 54134 (keeping 200 days of data) [2025-10-23T22:38:16.429685] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T22:38:16.546492] [DEBUG] [LOCAL ] MP: Primary data saved (54134 records). [2025-10-23T22:38:16.546715] [INFO ] [MAIN ] MP: Full history saved. [2025-10-23T22:38:16.546847] [INFO ] [MAIN ] Update Progress: 1389/2367 symbols completed. MP took 36.8s. Estimated remaining: 2h 5m 29s. Rate: 7.8 symbols/min [2025-10-23T22:38:16.718620] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:16.765105] [DEBUG] [LOCAL ] MPW: Loaded 53485 existing records from primary storage. [2025-10-23T22:38:16.765456] [INFO ] [MAIN ] MPW: Loaded 53485 existing records. [2025-10-23T22:38:16.807723] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-23T22:38:16.947370] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:16.947608] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-23T22:38:16.947714] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-23T22:38:16.948011] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-23T22:38:16.948115] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-23T22:38:17.300460] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:17.598114] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T22:38:17.601382] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-23T22:38:17.857835] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T22:38:18.399432] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-23T22:38:18.437225] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T22:38:19.199438] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-23T22:38:19.999424] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-23T22:38:20.139146] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T22:38:20.624589] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T22:38:20.799412] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-23T22:38:21.334833] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-23T22:38:21.599427] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-23T22:38:22.399470] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-23T22:38:22.634001] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:38:23.199503] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-23T22:38:23.362534] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-23T22:38:23.834760] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T22:38:23.835482] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T22:38:23.999441] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-23T22:38:24.799452] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-23T22:38:25.412792] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T22:38:25.599407] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-23T22:38:26.090852] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T22:38:26.399487] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-23T22:38:26.982528] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T22:38:27.199406] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-23T22:38:27.312384] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:38:27.999461] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-23T22:38:28.597075] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-23T22:38:28.799418] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-23T22:38:29.164576] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T22:38:29.599439] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-23T22:38:30.211818] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T22:38:30.399421] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-23T22:38:30.552997] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T22:38:31.199441] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-23T22:38:31.713102] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T22:38:31.714456] [INFO ] [REMOTE ] MPV: Full fetch complete (7602 records). [2025-10-23T22:38:31.714561] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-23T22:38:32.007609] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-23T22:38:32.095916] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-23T22:38:32.096255] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-23T22:38:32.096509] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-23T22:38:32.096592] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-23T22:38:32.097354] [DEBUG] [LOCAL ] MPV: Trimmed 7602 records to 4393 (keeping 200 days of data) [2025-10-23T22:38:32.126515] [DEBUG] [LOCAL ] MPV: Primary data saved (4393 records). [2025-10-23T22:38:32.126698] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-23T22:38:32.126830] [INFO ] [MAIN ] Update Progress: 1390/2367 symbols completed. MPV took 19.6s. Estimated remaining: 2h 5m 26s. Rate: 7.8 symbols/min [2025-10-23T22:38:32.320885] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:32.341538] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T22:38:32.356127] [DEBUG] [LOCAL ] MPX: Loaded 3955 existing records from primary storage. [2025-10-23T22:38:32.356371] [INFO ] [MAIN ] MPX: Loaded 3955 existing records. [2025-10-23T22:38:32.548951] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:32.549156] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-23T22:38:32.549234] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-23T22:38:32.549435] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-23T22:38:32.549512] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-23T22:38:32.808144] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-23T22:38:32.926830] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:33.599466] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-23T22:38:34.066242] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-23T22:38:34.284819] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T22:38:34.399409] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-23T22:38:35.199464] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-23T22:38:35.398096] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T22:38:35.999433] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-23T22:38:36.205523] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T22:38:36.622529] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T22:38:36.799419] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-23T22:38:37.599426] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-23T22:38:37.809094] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T22:38:38.321439] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:38:38.330411] [INFO ] [REMOTE ] MPC: Full fetch complete (75700 records). [2025-10-23T22:38:38.330595] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-23T22:38:38.406754] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-23T22:38:38.737804] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-23T22:38:38.738015] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-23T22:38:38.739184] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-23T22:38:38.739273] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-23T22:38:38.740784] [DEBUG] [LOCAL ] MPC: Trimmed 75700 records to 52270 (keeping 200 days of data) [2025-10-23T22:38:39.028933] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T22:38:39.114811] [DEBUG] [LOCAL ] MPC: Primary data saved (52270 records). [2025-10-23T22:38:39.114971] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-23T22:38:39.116670] [INFO ] [MAIN ] Update Progress: 1391/2367 symbols completed. MPC took 34.9s. Estimated remaining: 2h 5m 18s. Rate: 7.8 symbols/min [2025-10-23T22:38:39.208324] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-23T22:38:39.288922] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:39.303335] [DEBUG] [LOCAL ] MQT: Loaded 7975 existing records from primary storage. [2025-10-23T22:38:39.303819] [INFO ] [MAIN ] MQT: Loaded 7975 existing records. [2025-10-23T22:38:39.407808] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T22:38:39.485136] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:39.485342] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-23T22:38:39.485435] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-23T22:38:39.485679] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-23T22:38:39.485746] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-23T22:38:39.829981] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:39.999398] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-23T22:38:40.799493] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-23T22:38:41.076008] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-23T22:38:41.129831] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T22:38:41.599469] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-23T22:38:42.189598] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T22:38:42.399541] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-23T22:38:42.471869] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T22:38:43.199444] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-23T22:38:43.999417] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-23T22:38:44.334784] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T22:38:44.672842] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T22:38:44.799451] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-23T22:38:44.959445] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T22:38:44.968836] [INFO ] [REMOTE ] MPLX: Full fetch complete (74360 records). [2025-10-23T22:38:44.969034] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-23T22:38:45.364141] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-23T22:38:45.365136] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-23T22:38:45.365415] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-23T22:38:45.370409] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-23T22:38:45.371068] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-23T22:38:45.372915] [DEBUG] [LOCAL ] MPLX: Trimmed 74360 records to 51157 (keeping 200 days of data) [2025-10-23T22:38:45.602351] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-23T22:38:45.703380] [DEBUG] [LOCAL ] MPLX: Primary data saved (51157 records). [2025-10-23T22:38:45.703556] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-23T22:38:45.703744] [INFO ] [MAIN ] Update Progress: 1392/2367 symbols completed. MPLX took 37.7s. Estimated remaining: 2h 5m 10s. Rate: 7.8 symbols/min [2025-10-23T22:38:45.875308] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:45.891332] [DEBUG] [LOCAL ] MQY: Loaded 16545 existing records from primary storage. [2025-10-23T22:38:45.891604] [INFO ] [MAIN ] MQY: Loaded 16545 existing records. [2025-10-23T22:38:46.062513] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:46.062757] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-23T22:38:46.062833] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-23T22:38:46.063070] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-23T22:38:46.063143] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-23T22:38:46.404598] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-23T22:38:46.408494] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:47.199444] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-23T22:38:47.243727] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T22:38:47.566961] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T22:38:47.576262] [INFO ] [REMOTE ] MPW: Full fetch complete (77572 records). [2025-10-23T22:38:47.576421] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-23T22:38:47.990560] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-23T22:38:47.990701] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-23T22:38:47.991979] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-23T22:38:47.992073] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-23T22:38:47.993569] [DEBUG] [LOCAL ] MPW: Trimmed 77572 records to 53872 (keeping 200 days of data) [2025-10-23T22:38:48.041518] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-23T22:38:48.306155] [DEBUG] [LOCAL ] MPW: Primary data saved (53872 records). [2025-10-23T22:38:48.306337] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-23T22:38:48.306496] [INFO ] [MAIN ] Update Progress: 1393/2367 symbols completed. MPW took 31.8s. Estimated remaining: 2h 4m 58s. Rate: 7.8 symbols/min [2025-10-23T22:38:48.464318] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-23T22:38:48.504200] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:48.540549] [DEBUG] [LOCAL ] MRC: Loaded 37105 existing records from primary storage. [2025-10-23T22:38:48.540888] [INFO ] [MAIN ] MRC: Loaded 37105 existing records. [2025-10-23T22:38:48.721061] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:48.721317] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-23T22:38:48.721395] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-23T22:38:48.721713] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-23T22:38:48.721788] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-23T22:38:48.804155] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-23T22:38:48.922908] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:38:49.093276] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:38:49.599408] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-23T22:38:49.977532] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T22:38:50.399455] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-23T22:38:50.512584] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-23T22:38:51.199432] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-23T22:38:51.528210] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:38:51.790907] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T22:38:51.999507] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-23T22:38:52.613704] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T22:38:52.799461] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-23T22:38:53.475114] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-23T22:38:53.599449] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-23T22:38:54.399441] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-23T22:38:55.092606] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T22:38:55.145333] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T22:38:55.199425] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-23T22:38:55.937383] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-23T22:38:55.999400] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-23T22:38:56.724010] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T22:38:56.799436] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-23T22:38:57.599446] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-23T22:38:57.858322] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:38:58.358145] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T22:38:58.399404] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-23T22:38:59.020604] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T22:38:59.022473] [INFO ] [REMOTE ] MQT: Full fetch complete (12985 records). [2025-10-23T22:38:59.022562] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-23T22:38:59.204542] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-23T22:38:59.382497] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-23T22:38:59.382613] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-23T22:38:59.383127] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-23T22:38:59.383203] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-23T22:38:59.383721] [DEBUG] [LOCAL ] MQT: Trimmed 12985 records to 8068 (keeping 200 days of data) [2025-10-23T22:38:59.431063] [DEBUG] [LOCAL ] MQT: Primary data saved (8068 records). [2025-10-23T22:38:59.431222] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-23T22:38:59.431339] [INFO ] [MAIN ] Update Progress: 1394/2367 symbols completed. MQT took 20.3s. Estimated remaining: 2h 4m 53s. Rate: 7.8 symbols/min [2025-10-23T22:38:59.598927] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:38:59.652864] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-23T22:38:59.653228] [INFO ] [MAIN ] MRK: Loaded 53790 existing records. [2025-10-23T22:38:59.832965] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:38:59.833252] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-23T22:38:59.833350] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-23T22:38:59.833761] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-10-23T22:38:59.833843] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-23T22:39:00.004630] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-23T22:39:00.196211] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:00.767736] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T22:39:00.790162] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T22:39:00.799397] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-23T22:39:01.599507] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-23T22:39:02.207496] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T22:39:02.325766] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T22:39:02.399469] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-23T22:39:03.199453] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-23T22:39:03.999483] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-23T22:39:04.617272] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-23T22:39:04.676569] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T22:39:04.731098] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T22:39:04.799394] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-23T22:39:05.599476] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-23T22:39:06.115043] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-23T22:39:06.116257] [INFO ] [REMOTE ] MPX: Full fetch complete (6476 records). [2025-10-23T22:39:06.116344] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-23T22:39:06.403798] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-23T22:39:06.505481] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T22:39:06.538111] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-23T22:39:06.538561] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-23T22:39:06.538848] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-23T22:39:06.538944] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-23T22:39:06.539402] [DEBUG] [LOCAL ] MPX: Trimmed 6476 records to 3981 (keeping 200 days of data) [2025-10-23T22:39:06.562464] [DEBUG] [LOCAL ] MPX: Primary data saved (3981 records). [2025-10-23T22:39:06.562564] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-23T22:39:06.562692] [INFO ] [MAIN ] Update Progress: 1395/2367 symbols completed. MPX took 34.4s. Estimated remaining: 2h 4m 45s. Rate: 7.8 symbols/min [2025-10-23T22:39:06.728076] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:06.728275] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-23T22:39:06.728345] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-23T22:39:06.728448] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-23T22:39:06.728521] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-23T22:39:06.728580] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-23T22:39:06.728717] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-23T22:39:07.072913] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:07.199419] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-10-23T22:39:07.414691] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:39:07.414960] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-10-23T22:39:07.415048] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:39:07.415136] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-23T22:39:07.415219] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:39:07.415295] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-23T22:39:07.415397] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-23T22:39:07.415536] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-23T22:39:07.415680] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-23T22:39:07.415779] [INFO ] [MAIN ] Update Progress: 1396/2367 symbols completed. MRP took 0.9s. Estimated remaining: 2h 4m 33s. Rate: 7.8 symbols/min [2025-10-23T22:39:07.581962] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:07.634198] [DEBUG] [LOCAL ] MS: Loaded 53688 existing records from primary storage. [2025-10-23T22:39:07.634571] [INFO ] [MAIN ] MS: Loaded 53688 existing records. [2025-10-23T22:39:07.809312] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:39:07.809537] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-23T22:39:07.809672] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-23T22:39:07.809920] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-23T22:39:07.809994] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-23T22:39:08.004635] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-23T22:39:08.168134] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:08.810192] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-23T22:39:08.817405] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-23T22:39:09.487731] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T22:39:09.599416] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-23T22:39:10.399433] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-23T22:39:10.977840] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-23T22:39:11.167796] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T22:39:11.199397] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-23T22:39:11.999493] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-23T22:39:12.650981] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T22:39:12.753421] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-23T22:39:12.799407] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-23T22:39:12.996158] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T22:39:13.599416] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-23T22:39:14.181278] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T22:39:14.399417] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-23T22:39:15.199418] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-23T22:39:15.959293] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-23T22:39:15.999403] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-23T22:39:16.256034] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-23T22:39:16.617122] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T22:39:16.623877] [INFO ] [REMOTE ] MRC: Full fetch complete (55101 records). [2025-10-23T22:39:16.623995] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-23T22:39:16.811689] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-23T22:39:17.000891] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T22:39:17.022891] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-23T22:39:17.023259] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-23T22:39:17.024256] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-23T22:39:17.024348] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-23T22:39:17.025419] [DEBUG] [LOCAL ] MRC: Trimmed 55101 records to 37336 (keeping 200 days of data) [2025-10-23T22:39:17.236982] [DEBUG] [LOCAL ] MRC: Primary data saved (37336 records). [2025-10-23T22:39:17.237133] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-23T22:39:17.237278] [INFO ] [MAIN ] Update Progress: 1397/2367 symbols completed. MRC took 28.9s. Estimated remaining: 2h 4m 26s. Rate: 7.8 symbols/min [2025-10-23T22:39:17.599444] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-23T22:39:18.399417] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-23T22:39:18.908683] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-23T22:39:19.199415] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-23T22:39:19.451987] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T22:39:20.002068] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-23T22:39:20.005053] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-23T22:39:20.799414] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-23T22:39:20.955932] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:39:21.005418] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T22:39:21.599439] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-23T22:39:22.399455] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-23T22:39:22.695830] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-23T22:39:23.199417] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-23T22:39:23.474273] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T22:39:23.662473] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-23T22:39:23.999435] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-23T22:39:24.799493] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-23T22:39:25.629582] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-23T22:39:25.641997] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-23T22:39:25.701227] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T22:39:25.705096] [INFO ] [REMOTE ] MQY: Full fetch complete (25866 records). [2025-10-23T22:39:25.705201] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-23T22:39:26.100020] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-23T22:39:26.100184] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-23T22:39:26.100984] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-23T22:39:26.112376] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-23T22:39:26.131149] [DEBUG] [LOCAL ] MQY: Trimmed 25866 records to 16740 (keeping 200 days of data) [2025-10-23T22:39:26.133324] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-23T22:39:26.251321] [DEBUG] [LOCAL ] MQY: Primary data saved (16740 records). [2025-10-23T22:39:26.251501] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-23T22:39:26.251620] [INFO ] [MAIN ] Update Progress: 1398/2367 symbols completed. MQY took 40.5s. Estimated remaining: 2h 4m 20s. Rate: 7.8 symbols/min [2025-10-23T22:39:26.399475] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-23T22:39:27.661254] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-23T22:39:27.672475] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-23T22:39:28.578623] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T22:39:28.590320] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-23T22:39:30.154279] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-23T22:39:30.165423] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-23T22:39:30.239852] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T22:39:30.251057] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-23T22:39:30.882097] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:39:30.891276] [INFO ] [REMOTE ] MRK: Full fetch complete (77968 records). [2025-10-23T22:39:30.891416] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-23T22:39:31.272057] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-10-23T22:39:31.272165] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-10-23T22:39:31.273209] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-10-23T22:39:31.273287] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-10-23T22:39:31.274709] [DEBUG] [LOCAL ] MRK: Trimmed 77968 records to 54180 (keeping 200 days of data) [2025-10-23T22:39:31.601509] [DEBUG] [LOCAL ] MRK: Primary data saved (54180 records). [2025-10-23T22:39:31.601699] [INFO ] [MAIN ] MRK: Full history saved. [2025-10-23T22:39:31.603424] [INFO ] [MAIN ] Update Progress: 1399/2367 symbols completed. MRK took 32.2s. Estimated remaining: 2h 4m 10s. Rate: 7.8 symbols/min [2025-10-23T22:39:32.066931] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T22:39:32.078291] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-23T22:39:32.810055] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:39:32.819480] [INFO ] [REMOTE ] MS: Full fetch complete (77857 records). [2025-10-23T22:39:32.819711] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-23T22:39:33.216317] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-23T22:39:33.216443] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-23T22:39:33.217512] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-23T22:39:33.217592] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-23T22:39:33.219130] [DEBUG] [LOCAL ] MS: Trimmed 77857 records to 54077 (keeping 200 days of data) [2025-10-23T22:39:33.546997] [DEBUG] [LOCAL ] MS: Primary data saved (54077 records). [2025-10-23T22:39:33.547150] [INFO ] [MAIN ] MS: Full history saved. [2025-10-23T22:39:33.547937] [INFO ] [MAIN ] Update Progress: 1400/2367 symbols completed. MS took 26.1s. Estimated remaining: 2h 3m 59s. Rate: 7.8 symbols/min [2025-10-23T22:39:34.096130] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:34.303796] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:34.307626] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:34.324598] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:34.325438] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-23T22:39:34.325691] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-23T22:39:34.326211] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-23T22:39:34.326301] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-23T22:39:34.326403] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-23T22:39:34.326492] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-23T22:39:34.420357] [DEBUG] [LOCAL ] MSB: Loaded 7968 existing records from primary storage. [2025-10-23T22:39:34.486360] [DEBUG] [LOCAL ] MSA: Loaded 18830 existing records from primary storage. [2025-10-23T22:39:34.486720] [INFO ] [MAIN ] MSB: Loaded 7968 existing records. [2025-10-23T22:39:34.524774] [INFO ] [MAIN ] MSA: Loaded 18830 existing records. [2025-10-23T22:39:34.670038] [DEBUG] [LOCAL ] MSCI: Loaded 34183 existing records from primary storage. [2025-10-23T22:39:34.872571] [INFO ] [MAIN ] MSCI: Loaded 34183 existing records. [2025-10-23T22:39:35.369263] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:39:35.384031] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:39:35.389487] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-23T22:39:35.389635] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-23T22:39:35.419512] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-23T22:39:35.406942] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-23T22:39:35.455027] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-23T22:39:35.458165] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:35.449877] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-23T22:39:35.468566] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-23T22:39:35.496862] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-23T22:39:35.496960] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-23T22:39:35.639824] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:39:35.693965] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-23T22:39:35.730581] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-23T22:39:35.731125] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-23T22:39:35.767353] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-23T22:39:36.397033] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-23T22:39:36.417094] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:36.491525] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-23T22:39:36.492941] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-23T22:39:36.496215] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:36.510573] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-23T22:39:36.654821] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:36.655346] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-23T22:39:37.143886] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T22:39:37.145606] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-23T22:39:37.546871] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T22:39:37.550492] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-23T22:39:37.710899] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T22:39:37.714087] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-23T22:39:37.775690] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T22:39:37.776827] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-23T22:39:38.008596] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T22:39:38.060379] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-23T22:39:38.144969] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T22:39:38.399442] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-23T22:39:38.604430] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T22:39:38.748110] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T22:39:39.199445] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-23T22:39:39.999463] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-23T22:39:40.033213] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T22:39:40.799453] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-23T22:39:40.922574] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T22:39:41.599470] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-23T22:39:42.341205] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T22:39:42.399405] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-23T22:39:42.418324] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T22:39:43.199437] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-23T22:39:43.553612] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-23T22:39:43.632747] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T22:39:43.999439] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-23T22:39:44.443797] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T22:39:44.799450] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-23T22:39:45.157529] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-23T22:39:45.599442] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-23T22:39:46.399466] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-23T22:39:46.680840] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T22:39:47.156502] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-23T22:39:47.199407] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-23T22:39:47.999442] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-23T22:39:48.040973] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T22:39:48.799472] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-23T22:39:49.599437] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-23T22:39:49.623830] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T22:39:49.810715] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T22:39:50.399428] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-23T22:39:50.420131] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T22:39:50.907945] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T22:39:51.199430] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-23T22:39:51.999457] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-23T22:39:52.762897] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T22:39:52.799401] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-23T22:39:52.873050] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T22:39:53.180483] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-23T22:39:53.181350] [INFO ] [REMOTE ] MSC: Full fetch complete (2473 records). [2025-10-23T22:39:53.181439] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-23T22:39:53.181868] [FATAL] [VALIDATOR ] MSC: Data is stale - most recent date (2025-10-22) is before last completed trading day (2025-10-23). Symbol may be delisted or halted. [2025-10-23T22:39:53.181948] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:39:53.182023] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:39:53.182113] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-23T22:39:53.182209] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-23T22:39:53.182282] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-23T22:39:53.182366] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-23T22:39:53.182453] [INFO ] [MAIN ] Update Progress: 1401/2367 symbols completed. MSC took 19.6s. Estimated remaining: 2h 3m 59s. Rate: 7.8 symbols/min [2025-10-23T22:39:53.353068] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:53.369240] [DEBUG] [LOCAL ] MSD: Loaded 16543 existing records from primary storage. [2025-10-23T22:39:53.369496] [INFO ] [MAIN ] MSD: Loaded 16543 existing records. [2025-10-23T22:39:53.544893] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:39:53.545121] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-23T22:39:53.545195] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-23T22:39:53.545422] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-23T22:39:53.545497] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-23T22:39:53.605757] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-23T22:39:53.894191] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:54.399412] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-23T22:39:55.002741] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T22:39:55.091780] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T22:39:55.199422] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-23T22:39:55.999430] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-23T22:39:56.238857] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T22:39:56.799504] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-23T22:39:57.134363] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T22:39:57.528585] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T22:39:57.599441] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-23T22:39:58.269701] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T22:39:58.271753] [INFO ] [REMOTE ] MSB: Full fetch complete (13202 records). [2025-10-23T22:39:58.271874] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-23T22:39:58.404626] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-23T22:39:58.641938] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-23T22:39:58.642054] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-23T22:39:58.642398] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-23T22:39:58.642487] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-23T22:39:58.643016] [DEBUG] [LOCAL ] MSB: Trimmed 13202 records to 8024 (keeping 200 days of data) [2025-10-23T22:39:58.689716] [DEBUG] [LOCAL ] MSB: Primary data saved (8024 records). [2025-10-23T22:39:58.689874] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-23T22:39:58.689984] [INFO ] [MAIN ] Update Progress: 1402/2367 symbols completed. MSB took 25.1s. Estimated remaining: 2h 3m 50s. Rate: 7.8 symbols/min [2025-10-23T22:39:58.858929] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:39:58.895536] [DEBUG] [LOCAL ] MSDL: Loaded 38577 existing records from primary storage. [2025-10-23T22:39:58.895867] [INFO ] [MAIN ] MSDL: Loaded 38577 existing records. [2025-10-23T22:39:59.069938] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:39:59.070145] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-23T22:39:59.070221] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-23T22:39:59.070469] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-23T22:39:59.070545] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-23T22:39:59.209090] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-23T22:39:59.451613] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:39:59.999462] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-23T22:40:00.014669] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T22:40:00.592446] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T22:40:00.799410] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-23T22:40:01.143342] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T22:40:01.599431] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-23T22:40:02.338804] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T22:40:02.399537] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-23T22:40:02.682925] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T22:40:02.686960] [INFO ] [REMOTE ] MSA: Full fetch complete (25904 records). [2025-10-23T22:40:02.687191] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-23T22:40:03.127479] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-23T22:40:03.127620] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-23T22:40:03.128383] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-23T22:40:03.128476] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-23T22:40:03.129600] [DEBUG] [LOCAL ] MSA: Trimmed 25904 records to 18945 (keeping 200 days of data) [2025-10-23T22:40:03.217812] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-23T22:40:03.257261] [DEBUG] [LOCAL ] MSA: Primary data saved (18945 records). [2025-10-23T22:40:03.257479] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-23T22:40:03.257633] [INFO ] [MAIN ] Update Progress: 1403/2367 symbols completed. MSA took 29.7s. Estimated remaining: 2h 3m 40s. Rate: 7.8 symbols/min [2025-10-23T22:40:03.451248] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:03.461437] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T22:40:03.489714] [DEBUG] [LOCAL ] MSGE: Loaded 27002 existing records from primary storage. [2025-10-23T22:40:03.490070] [INFO ] [MAIN ] MSGE: Loaded 27002 existing records. [2025-10-23T22:40:03.681289] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:40:03.681527] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-23T22:40:03.681603] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-23T22:40:03.681844] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-23T22:40:03.681917] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-23T22:40:04.009386] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-23T22:40:04.065943] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:04.799455] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-23T22:40:05.403977] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T22:40:05.473022] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T22:40:05.599412] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-23T22:40:05.691947] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T22:40:06.399443] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-23T22:40:06.996773] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T22:40:07.199435] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-23T22:40:07.255024] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T22:40:07.999435] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-23T22:40:08.808898] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-23T22:40:08.815372] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T22:40:09.585126] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T22:40:09.599399] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-23T22:40:10.007459] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T22:40:10.399465] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-23T22:40:10.980048] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T22:40:11.199432] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-23T22:40:11.860772] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T22:40:11.999436] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-23T22:40:12.628287] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T22:40:12.799453] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-23T22:40:13.400501] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T22:40:13.406210] [INFO ] [REMOTE ] MSCI: Full fetch complete (50544 records). [2025-10-23T22:40:13.406396] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-23T22:40:13.606030] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-23T22:40:13.838535] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-23T22:40:13.839953] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-23T22:40:13.839785] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T22:40:13.847773] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-23T22:40:13.848113] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-23T22:40:13.849376] [DEBUG] [LOCAL ] MSCI: Trimmed 50544 records to 34366 (keeping 200 days of data) [2025-10-23T22:40:14.063895] [DEBUG] [LOCAL ] MSCI: Primary data saved (34366 records). [2025-10-23T22:40:14.064076] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-23T22:40:14.064232] [INFO ] [MAIN ] Update Progress: 1404/2367 symbols completed. MSCI took 40.5s. Estimated remaining: 2h 3m 34s. Rate: 7.8 symbols/min [2025-10-23T22:40:14.239584] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:14.257666] [DEBUG] [LOCAL ] MSGS: Loaded 17199 existing records from primary storage. [2025-10-23T22:40:14.257956] [INFO ] [MAIN ] MSGS: Loaded 17199 existing records. [2025-10-23T22:40:14.404202] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-23T22:40:14.443150] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:40:14.443381] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-23T22:40:14.443456] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-23T22:40:14.443674] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-23T22:40:14.443752] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-23T22:40:14.739480] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T22:40:14.818448] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:15.199399] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-23T22:40:15.597113] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T22:40:15.999443] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-23T22:40:16.700093] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T22:40:16.715491] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-23T22:40:16.799398] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-23T22:40:17.599435] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-23T22:40:17.807501] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T22:40:18.399417] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-23T22:40:18.708733] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T22:40:19.199428] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-23T22:40:19.922841] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T22:40:19.999439] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-23T22:40:20.309127] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T22:40:20.799423] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-23T22:40:21.236328] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T22:40:21.516113] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-23T22:40:21.599438] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-23T22:40:22.305263] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T22:40:22.399476] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-23T22:40:23.199407] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-23T22:40:23.334382] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T22:40:23.999441] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-23T22:40:24.706807] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T22:40:24.762188] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-23T22:40:24.799505] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-23T22:40:25.599445] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-23T22:40:26.399450] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-23T22:40:26.459595] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T22:40:26.472281] [INFO ] [REMOTE ] MSDL: Full fetch complete (56476 records). [2025-10-23T22:40:26.472536] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-23T22:40:26.841983] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T22:40:27.011145] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-23T22:40:27.011304] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-23T22:40:27.012975] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-23T22:40:27.013121] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-23T22:40:27.014886] [DEBUG] [LOCAL ] MSDL: Trimmed 56476 records to 38893 (keeping 200 days of data) [2025-10-23T22:40:27.199623] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-23T22:40:27.372250] [DEBUG] [LOCAL ] MSDL: Primary data saved (38893 records). [2025-10-23T22:40:27.372485] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-23T22:40:27.372628] [INFO ] [MAIN ] Update Progress: 1405/2367 symbols completed. MSDL took 28.7s. Estimated remaining: 2h 3m 31s. Rate: 7.8 symbols/min [2025-10-23T22:40:27.577604] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T22:40:27.581554] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:27.629602] [DEBUG] [LOCAL ] MSI: Loaded 39574 existing records from primary storage. [2025-10-23T22:40:27.630005] [INFO ] [MAIN ] MSI: Loaded 39574 existing records. [2025-10-23T22:40:27.831039] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:40:27.831275] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-23T22:40:27.831367] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-23T22:40:27.831589] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-23T22:40:27.831694] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-23T22:40:28.001018] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-23T22:40:28.235478] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:28.522597] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T22:40:28.799432] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-23T22:40:29.114587] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:40:29.599489] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-23T22:40:29.865945] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T22:40:30.399503] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-23T22:40:30.650027] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T22:40:30.654090] [INFO ] [REMOTE ] MSD: Full fetch complete (23125 records). [2025-10-23T22:40:30.654184] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-23T22:40:31.018475] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-23T22:40:31.018585] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-23T22:40:31.019084] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-23T22:40:31.019163] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-23T22:40:31.019847] [DEBUG] [LOCAL ] MSD: Trimmed 23125 records to 16719 (keeping 200 days of data) [2025-10-23T22:40:31.111855] [DEBUG] [LOCAL ] MSD: Primary data saved (16719 records). [2025-10-23T22:40:31.112020] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-23T22:40:31.112132] [INFO ] [MAIN ] Update Progress: 1406/2367 symbols completed. MSD took 37.9s. Estimated remaining: 2h 3m 20s. Rate: 7.8 symbols/min [2025-10-23T22:40:31.208585] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-23T22:40:31.284752] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:31.284945] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-23T22:40:31.285016] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-23T22:40:31.285121] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-23T22:40:31.285217] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-23T22:40:31.285316] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-23T22:40:31.285390] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-23T22:40:31.629033] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:31.999426] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-23T22:40:32.118342] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T22:40:32.239829] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T22:40:32.799512] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-23T22:40:33.249382] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T22:40:33.599467] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-10-23T22:40:34.121508] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-23T22:40:34.372858] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T22:40:34.399455] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-23T22:40:35.199414] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-23T22:40:35.562136] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T22:40:35.999425] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-10-23T22:40:36.429051] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T22:40:36.799422] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-23T22:40:36.873311] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T22:40:37.599447] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-23T22:40:38.045821] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T22:40:38.051363] [INFO ] [REMOTE ] MSGE: Full fetch complete (39968 records). [2025-10-23T22:40:38.051470] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-23T22:40:38.414020] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-23T22:40:38.416519] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-23T22:40:38.416991] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-23T22:40:38.418614] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-23T22:40:38.418810] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-23T22:40:38.419779] [DEBUG] [LOCAL ] MSGE: Trimmed 39968 records to 27255 (keeping 200 days of data) [2025-10-23T22:40:38.571847] [DEBUG] [LOCAL ] MSGE: Primary data saved (27255 records). [2025-10-23T22:40:38.571998] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-23T22:40:38.572105] [INFO ] [MAIN ] Update Progress: 1407/2367 symbols completed. MSGE took 35.3s. Estimated remaining: 2h 3m 12s. Rate: 7.8 symbols/min [2025-10-23T22:40:38.745697] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:38.778944] [DEBUG] [LOCAL ] MSM: Loaded 35407 existing records from primary storage. [2025-10-23T22:40:38.779295] [INFO ] [MAIN ] MSM: Loaded 35407 existing records. [2025-10-23T22:40:38.961136] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:40:38.961371] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-23T22:40:38.961465] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-23T22:40:38.961746] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-23T22:40:38.961854] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-23T22:40:39.204866] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-10-23T22:40:39.327589] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:39.485846] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T22:40:39.583583] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T22:40:39.587117] [INFO ] [REMOTE ] MSGS: Full fetch complete (23758 records). [2025-10-23T22:40:39.587214] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-23T22:40:39.954908] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-23T22:40:39.955015] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-23T22:40:39.955535] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-23T22:40:39.955620] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-23T22:40:39.956309] [DEBUG] [LOCAL ] MSGS: Trimmed 23758 records to 17313 (keeping 200 days of data) [2025-10-23T22:40:40.009754] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-23T22:40:40.064290] [DEBUG] [LOCAL ] MSGS: Primary data saved (17313 records). [2025-10-23T22:40:40.064426] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-23T22:40:40.064533] [INFO ] [MAIN ] Update Progress: 1408/2367 symbols completed. MSGS took 26.0s. Estimated remaining: 2h 3m 0s. Rate: 7.8 symbols/min [2025-10-23T22:40:40.196386] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T22:40:40.247776] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:40.290289] [DEBUG] [LOCAL ] MT: Loaded 50419 existing records from primary storage. [2025-10-23T22:40:40.290634] [INFO ] [MAIN ] MT: Loaded 50419 existing records. [2025-10-23T22:40:40.464235] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:40:40.464475] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-23T22:40:40.464574] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-23T22:40:40.464852] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-23T22:40:40.464945] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-23T22:40:40.802853] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-23T22:40:40.826444] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:41.556449] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T22:40:41.599397] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-23T22:40:42.399425] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-10-23T22:40:42.630466] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T22:40:43.083826] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T22:40:43.095085] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T22:40:43.199418] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-23T22:40:43.999445] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-23T22:40:44.784402] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T22:40:44.799403] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-10-23T22:40:45.184970] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-23T22:40:45.447577] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:40:45.599470] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-10-23T22:40:46.399426] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-23T22:40:46.618834] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T22:40:47.199448] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-10-23T22:40:47.999424] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-23T22:40:48.076839] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T22:40:48.154721] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T22:40:48.799435] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-23T22:40:49.409718] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T22:40:49.599452] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-10-23T22:40:50.395739] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T22:40:50.404703] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-23T22:40:50.856194] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T22:40:51.199448] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-23T22:40:51.999420] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-10-23T22:40:52.292716] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T22:40:52.589345] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T22:40:52.735790] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T22:40:52.799428] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-23T22:40:53.599439] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-10. [2025-10-23T22:40:54.269230] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T22:40:54.399445] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-23T22:40:54.685875] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T22:40:54.689959] [INFO ] [REMOTE ] MSIF: Full fetch complete (19437 records). [2025-10-23T22:40:54.690061] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-10-23T22:40:54.876914] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-23T22:40:54.877379] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:40:54.877470] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:40:54.877566] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-23T22:40:54.877722] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-23T22:40:54.877801] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-23T22:40:54.877908] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-23T22:40:54.878001] [INFO ] [MAIN ] Update Progress: 1409/2367 symbols completed. MSIF took 23.8s. Estimated remaining: 2h 2m 58s. Rate: 7.8 symbols/min [2025-10-23T22:40:55.053314] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:40:55.102992] [DEBUG] [LOCAL ] MTB: Loaded 46640 existing records from primary storage. [2025-10-23T22:40:55.103369] [INFO ] [MAIN ] MTB: Loaded 46640 existing records. [2025-10-23T22:40:55.204564] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-23T22:40:55.288804] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:40:55.289020] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-23T22:40:55.289095] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-23T22:40:55.289370] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-23T22:40:55.289453] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-23T22:40:55.653068] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:40:55.754232] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T22:40:55.999459] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-23T22:40:56.799472] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-23T22:40:57.253308] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T22:40:57.599498] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-23T22:40:57.823559] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T22:40:58.031419] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T22:40:58.399448] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-23T22:40:59.166367] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T22:40:59.199396] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-23T22:40:59.999468] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-23T22:41:00.087819] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T22:41:00.361744] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T22:41:00.799467] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-23T22:41:01.599434] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-23T22:41:01.831485] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:41:02.240501] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T22:41:02.399486] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-23T22:41:02.786810] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T22:41:03.199459] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-23T22:41:03.531569] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T22:41:03.539271] [INFO ] [REMOTE ] MSM: Full fetch complete (51925 records). [2025-10-23T22:41:03.539413] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-23T22:41:03.840607] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T22:41:03.883147] [INFO ] [REMOTE ] MSI: Full fetch complete (58017 records). [2025-10-23T22:41:03.901404] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-23T22:41:04.008708] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-23T22:41:04.086931] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-23T22:41:04.087149] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-23T22:41:04.093762] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-23T22:41:04.127708] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-23T22:41:04.179994] [DEBUG] [LOCAL ] MSM: Trimmed 51925 records to 35752 (keeping 200 days of data) [2025-10-23T22:41:04.490354] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-23T22:41:04.492587] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-23T22:41:04.493535] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-23T22:41:04.496833] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-23T22:41:04.546066] [DEBUG] [LOCAL ] MSI: Trimmed 58017 records to 39876 (keeping 200 days of data) [2025-10-23T22:41:04.688222] [DEBUG] [LOCAL ] MSM: Primary data saved (35752 records). [2025-10-23T22:41:04.694836] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-23T22:41:04.698813] [INFO ] [MAIN ] Update Progress: 1410/2367 symbols completed. MSM took 26.1s. Estimated remaining: 2h 2m 51s. Rate: 7.8 symbols/min [2025-10-23T22:41:04.805778] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-23T22:41:04.975288] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:05.021539] [DEBUG] [LOCAL ] MTD: Loaded 15156 existing records from primary storage. [2025-10-23T22:41:05.021195] [DEBUG] [LOCAL ] MSI: Primary data saved (39876 records). [2025-10-23T22:41:05.021824] [INFO ] [MAIN ] MTD: Loaded 15156 existing records. [2025-10-23T22:41:05.021971] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-23T22:41:05.055831] [INFO ] [MAIN ] Update Progress: 1411/2367 symbols completed. MSI took 37.7s. Estimated remaining: 2h 2m 39s. Rate: 7.8 symbols/min [2025-10-23T22:41:05.360917] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:05.378717] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:05.378870] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-23T22:41:05.379232] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-23T22:41:05.379474] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-23T22:41:05.379566] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-23T22:41:05.786825] [DEBUG] [LOCAL ] MTDR: Loaded 51762 existing records from primary storage. [2025-10-23T22:41:05.809268] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:05.809912] [INFO ] [MAIN ] MTDR: Loaded 51762 existing records. [2025-10-23T22:41:05.810199] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-23T22:41:06.019082] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:06.013773] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-23T22:41:06.019381] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-23T22:41:06.027434] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-23T22:41:06.028294] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-23T22:41:06.028389] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-23T22:41:06.409016] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:06.409196] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-23T22:41:06.672901] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T22:41:06.761487] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T22:41:07.199443] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-23T22:41:07.999422] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-23T22:41:08.044917] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T22:41:08.799445] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-23T22:41:08.930639] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T22:41:08.969740] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T22:41:09.599457] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-23T22:41:10.399428] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-23T22:41:10.579702] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T22:41:11.199446] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-23T22:41:11.321230] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T22:41:11.416999] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T22:41:11.999465] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-23T22:41:12.805940] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-23T22:41:12.811873] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T22:41:13.345489] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T22:41:13.599448] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-23T22:41:14.399425] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-23T22:41:14.613411] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T22:41:14.768690] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T22:41:15.199436] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-23T22:41:15.999400] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-23T22:41:16.221349] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T22:41:16.799457] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-23T22:41:17.275717] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T22:41:17.599434] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-23T22:41:17.742935] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-23T22:41:18.399441] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-23T22:41:18.633976] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T22:41:18.692011] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-23T22:41:18.701799] [INFO ] [REMOTE ] MT: Full fetch complete (73723 records). [2025-10-23T22:41:18.701976] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-23T22:41:19.176796] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-23T22:41:19.176945] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-23T22:41:19.178209] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-23T22:41:19.178297] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-23T22:41:19.179986] [DEBUG] [LOCAL ] MT: Trimmed 73723 records to 50743 (keeping 200 days of data) [2025-10-23T22:41:19.237936] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-23T22:41:19.494441] [DEBUG] [LOCAL ] MT: Primary data saved (50743 records). [2025-10-23T22:41:19.494619] [INFO ] [MAIN ] MT: Full history saved. [2025-10-23T22:41:19.494762] [INFO ] [MAIN ] Update Progress: 1412/2367 symbols completed. MT took 39.4s. Estimated remaining: 2h 2m 35s. Rate: 7.8 symbols/min [2025-10-23T22:41:19.676664] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:19.725614] [DEBUG] [LOCAL ] MTG: Loaded 51061 existing records from primary storage. [2025-10-23T22:41:19.725963] [INFO ] [MAIN ] MTG: Loaded 51061 existing records. [2025-10-23T22:41:19.900578] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:19.900794] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-23T22:41:19.900921] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-23T22:41:19.901234] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-23T22:41:19.901306] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-23T22:41:20.002811] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-23T22:41:20.262174] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:20.294177] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T22:41:20.799445] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-23T22:41:21.024184] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T22:41:21.599475] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-23T22:41:22.399511] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-23T22:41:22.593316] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T22:41:23.199493] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-23T22:41:23.308892] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-23T22:41:23.999451] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-23T22:41:24.249301] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (5.01 seconds). [2025-10-23T22:41:24.468666] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T22:41:24.471580] [INFO ] [REMOTE ] MTD: Full fetch complete (21493 records). [2025-10-23T22:41:24.471697] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-23T22:41:24.803077] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-23T22:41:24.838343] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-23T22:41:24.838459] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-23T22:41:24.838981] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-23T22:41:24.839058] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-23T22:41:24.839678] [DEBUG] [LOCAL ] MTD: Trimmed 21493 records to 15251 (keeping 200 days of data) [2025-10-23T22:41:24.936557] [DEBUG] [LOCAL ] MTD: Primary data saved (15251 records). [2025-10-23T22:41:24.936766] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-23T22:41:24.936893] [INFO ] [MAIN ] Update Progress: 1413/2367 symbols completed. MTD took 20.2s. Estimated remaining: 2h 2m 26s. Rate: 7.8 symbols/min [2025-10-23T22:41:25.112536] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:25.151107] [DEBUG] [LOCAL ] MTH: Loaded 43777 existing records from primary storage. [2025-10-23T22:41:25.151445] [INFO ] [MAIN ] MTH: Loaded 43777 existing records. [2025-10-23T22:41:25.331373] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:25.331592] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-23T22:41:25.331692] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-23T22:41:25.331901] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-23T22:41:25.331969] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-23T22:41:25.690215] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:25.690586] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-23T22:41:26.534392] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T22:41:26.544940] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-23T22:41:26.580882] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (4.98 seconds). [2025-10-23T22:41:27.199426] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-23T22:41:27.252823] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T22:41:27.999523] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-23T22:41:28.764237] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (5.56 seconds). [2025-10-23T22:41:28.799392] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-23T22:41:28.971871] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T22:41:29.599455] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-23T22:41:29.716817] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T22:41:30.399434] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-23T22:41:30.523135] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T22:41:30.789509] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (4.24 seconds). [2025-10-23T22:41:31.199466] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-23T22:41:31.338244] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T22:41:31.999448] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-23T22:41:32.799429] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-23T22:41:32.871051] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T22:41:33.314683] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-23T22:41:33.576618] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:41:33.599449] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-23T22:41:34.402550] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-23T22:41:34.408002] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T22:41:35.199499] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-23T22:41:35.248696] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T22:41:35.999450] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-23T22:41:36.237760] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-23T22:41:36.799420] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-23T22:41:37.599435] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-23T22:41:37.967287] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-23T22:41:38.380699] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T22:41:38.399391] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-23T22:41:39.191202] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (3.19 seconds). [2025-10-23T22:41:39.199536] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-23T22:41:39.201017] [INFO ] [REMOTE ] MTB: Full fetch complete (68315 records). [2025-10-23T22:41:39.201132] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-23T22:41:39.649527] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-23T22:41:39.680531] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-23T22:41:39.681864] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-23T22:41:39.683355] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-23T22:41:39.683540] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-23T22:41:39.685129] [DEBUG] [LOCAL ] MTB: Trimmed 68315 records to 46978 (keeping 200 days of data) [2025-10-23T22:41:39.799789] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T22:41:40.006007] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-23T22:41:40.033789] [DEBUG] [LOCAL ] MTB: Primary data saved (46978 records). [2025-10-23T22:41:40.033967] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-23T22:41:40.035752] [INFO ] [MAIN ] Update Progress: 1414/2367 symbols completed. MTB took 45.2s. Estimated remaining: 2h 2m 24s. Rate: 7.8 symbols/min [2025-10-23T22:41:40.207972] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:40.249438] [DEBUG] [LOCAL ] MTN: Loaded 39380 existing records from primary storage. [2025-10-23T22:41:40.249769] [INFO ] [MAIN ] MTN: Loaded 39380 existing records. [2025-10-23T22:41:40.424956] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:40.425182] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-23T22:41:40.425257] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-23T22:41:40.425482] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-23T22:41:40.425553] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-23T22:41:40.772872] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:40.799394] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-23T22:41:41.030585] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T22:41:41.039701] [INFO ] [REMOTE ] MTDR: Full fetch complete (74363 records). [2025-10-23T22:41:41.039850] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-23T22:41:41.429760] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-23T22:41:41.429979] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-23T22:41:41.431259] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-23T22:41:41.431360] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-23T22:41:41.432884] [DEBUG] [LOCAL ] MTDR: Trimmed 74363 records to 52152 (keeping 200 days of data) [2025-10-23T22:41:41.605702] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-23T22:41:41.735238] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T22:41:41.788899] [DEBUG] [LOCAL ] MTDR: Primary data saved (52152 records). [2025-10-23T22:41:41.789056] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-23T22:41:41.789200] [INFO ] [MAIN ] Update Progress: 1415/2367 symbols completed. MTDR took 36.7s. Estimated remaining: 2h 2m 12s. Rate: 7.8 symbols/min [2025-10-23T22:41:41.958857] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:41.959029] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-23T22:41:41.959103] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-23T22:41:41.959211] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-23T22:41:41.959280] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-23T22:41:41.959359] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-23T22:41:41.959425] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-23T22:41:42.312410] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:42.334391] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T22:41:42.399395] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-23T22:41:42.863613] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T22:41:43.199407] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-23T22:41:43.441401] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:41:43.999449] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-23T22:41:44.594847] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T22:41:44.799429] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-23T22:41:45.599422] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-23T22:41:45.834804] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:41:46.309362] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T22:41:46.399422] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-23T22:41:47.199423] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-23T22:41:47.279479] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T22:41:47.999501] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-23T22:41:48.070602] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T22:41:48.799448] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-23T22:41:49.566055] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T22:41:49.599398] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-23T22:41:49.879479] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-23T22:41:50.399503] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T22:41:50.399582] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-23T22:41:50.782288] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-23T22:41:51.199414] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-23T22:41:51.754854] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-23T22:41:51.762481] [INFO ] [REMOTE ] MTH: Full fetch complete (64111 records). [2025-10-23T22:41:51.762609] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-23T22:41:52.010427] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-23T22:41:52.149093] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-23T22:41:52.149208] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-23T22:41:52.150209] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-23T22:41:52.150290] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-23T22:41:52.151761] [DEBUG] [LOCAL ] MTH: Trimmed 64111 records to 44086 (keeping 200 days of data) [2025-10-23T22:41:52.433276] [DEBUG] [LOCAL ] MTH: Primary data saved (44086 records). [2025-10-23T22:41:52.433432] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-23T22:41:52.433541] [INFO ] [MAIN ] Update Progress: 1416/2367 symbols completed. MTH took 27.5s. Estimated remaining: 2h 2m 6s. Rate: 7.8 symbols/min [2025-10-23T22:41:52.606594] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:52.625209] [DEBUG] [LOCAL ] MTRN: Loaded 18137 existing records from primary storage. [2025-10-23T22:41:52.625497] [INFO ] [MAIN ] MTRN: Loaded 18137 existing records. [2025-10-23T22:41:52.808139] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-23T22:41:52.811678] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:52.812737] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-23T22:41:52.812920] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-23T22:41:52.813119] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-23T22:41:52.813191] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-23T22:41:52.929488] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T22:41:53.197556] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:53.268626] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T22:41:53.599441] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-23T22:41:53.749343] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T22:41:53.970129] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-23T22:41:54.399443] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-23T22:41:54.769661] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-23T22:41:55.199416] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-23T22:41:55.999453] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-23T22:41:56.799435] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-23T22:41:56.870748] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T22:41:56.879664] [INFO ] [REMOTE ] MTG: Full fetch complete (74288 records). [2025-10-23T22:41:56.879823] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-23T22:41:57.268184] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-23T22:41:57.268292] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-23T22:41:57.269417] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-23T22:41:57.269497] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-23T22:41:57.270966] [DEBUG] [LOCAL ] MTG: Trimmed 74288 records to 51417 (keeping 200 days of data) [2025-10-23T22:41:57.460311] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T22:41:57.586221] [DEBUG] [LOCAL ] MTG: Primary data saved (51417 records). [2025-10-23T22:41:57.586377] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-23T22:41:57.586520] [INFO ] [MAIN ] Update Progress: 1417/2367 symbols completed. MTG took 38.1s. Estimated remaining: 2h 1m 57s. Rate: 7.8 symbols/min [2025-10-23T22:41:57.606781] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-23T22:41:57.757319] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:41:57.784020] [DEBUG] [LOCAL ] MTUS: Loaded 27451 existing records from primary storage. [2025-10-23T22:41:57.784324] [INFO ] [MAIN ] MTUS: Loaded 27451 existing records. [2025-10-23T22:41:57.963816] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:41:57.964005] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-23T22:41:57.964093] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-23T22:41:57.964336] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-23T22:41:57.964421] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-23T22:41:58.322945] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-23T22:41:58.365660] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:41:58.399396] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-23T22:41:58.501381] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T22:41:59.183160] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T22:41:59.199390] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-23T22:41:59.673064] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T22:41:59.999441] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-23T22:42:00.799479] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-23T22:42:01.599000] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T22:42:01.601680] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-23T22:42:01.800998] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-23T22:42:02.399492] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-23T22:42:03.199475] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-23T22:42:03.339919] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-23T22:42:03.341951] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:42:03.999433] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-23T22:42:04.772567] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T22:42:04.799439] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-23T22:42:05.243541] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T22:42:05.599454] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-23T22:42:05.973567] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-23T22:42:06.291425] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T22:42:06.298493] [INFO ] [REMOTE ] MTN: Full fetch complete (56763 records). [2025-10-23T22:42:06.298619] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-23T22:42:06.400133] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-23T22:42:06.691866] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-23T22:42:06.692017] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-23T22:42:06.693495] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-23T22:42:06.693581] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-23T22:42:06.695127] [DEBUG] [LOCAL ] MTN: Trimmed 56763 records to 39602 (keeping 200 days of data) [2025-10-23T22:42:06.963313] [DEBUG] [LOCAL ] MTN: Primary data saved (39602 records). [2025-10-23T22:42:06.963570] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-23T22:42:06.963750] [INFO ] [MAIN ] Update Progress: 1418/2367 symbols completed. MTN took 26.9s. Estimated remaining: 2h 1m 50s. Rate: 7.8 symbols/min [2025-10-23T22:42:07.153047] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:07.182582] [DEBUG] [LOCAL ] MTW: Loaded 26422 existing records from primary storage. [2025-10-23T22:42:07.183003] [INFO ] [MAIN ] MTW: Loaded 26422 existing records. [2025-10-23T22:42:07.204804] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-23T22:42:07.378279] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:07.378614] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-23T22:42:07.378723] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-23T22:42:07.378993] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-23T22:42:07.379071] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-23T22:42:07.779948] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:07.999423] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-23T22:42:08.248508] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T22:42:08.291113] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T22:42:08.353621] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T22:42:08.354470] [INFO ] [REMOTE ] MTR: Full fetch complete (2354 records). [2025-10-23T22:42:08.354572] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-23T22:42:08.538992] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T22:42:08.539182] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:42:08.539248] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:42:08.539318] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-23T22:42:08.539448] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-23T22:42:08.539519] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-23T22:42:08.539636] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-23T22:42:08.539789] [INFO ] [MAIN ] Update Progress: 1419/2367 symbols completed. MTR took 26.8s. Estimated remaining: 2h 1m 38s. Rate: 7.8 symbols/min [2025-10-23T22:42:08.717150] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:08.738746] [DEBUG] [LOCAL ] MTX: Loaded 22589 existing records from primary storage. [2025-10-23T22:42:08.739023] [INFO ] [MAIN ] MTX: Loaded 22589 existing records. [2025-10-23T22:42:08.807399] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-23T22:42:08.924914] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:08.925138] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-23T22:42:08.925228] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-23T22:42:08.925472] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-23T22:42:08.925577] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-23T22:42:09.293832] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:09.599443] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-23T22:42:10.252440] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:42:10.328985] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T22:42:10.399401] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-23T22:42:11.199418] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-23T22:42:11.490600] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T22:42:11.999426] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-23T22:42:12.399544] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T22:42:12.799424] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-23T22:42:13.179021] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T22:42:13.599438] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-23T22:42:14.002674] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T22:42:14.399445] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-23T22:42:14.897825] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T22:42:15.158874] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T22:42:15.199394] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-23T22:42:15.999445] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-23T22:42:16.593877] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:42:16.791245] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:42:16.799402] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-23T22:42:17.599424] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-23T22:42:17.864947] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T22:42:18.399433] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-23T22:42:18.975491] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T22:42:19.199423] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-23T22:42:19.209880] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T22:42:19.999426] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-23T22:42:20.459891] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T22:42:20.799449] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-23T22:42:21.599432] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-23T22:42:21.663240] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T22:42:21.889344] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T22:42:22.399415] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-23T22:42:22.914055] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T22:42:23.199439] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-23T22:42:23.730420] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T22:42:23.999443] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-23T22:42:24.419185] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T22:42:24.799453] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-23T22:42:25.140051] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T22:42:25.599461] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-23T22:42:25.827849] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T22:42:26.399447] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-23T22:42:26.962686] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T22:42:27.199472] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-23T22:42:27.494460] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T22:42:27.999518] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-23T22:42:28.186814] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T22:42:28.193757] [INFO ] [REMOTE ] MTX: Full fetch complete (31415 records). [2025-10-23T22:42:28.193956] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-23T22:42:28.644461] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-23T22:42:28.644594] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-23T22:42:28.645287] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-23T22:42:28.645362] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-23T22:42:28.646128] [DEBUG] [LOCAL ] MTX: Trimmed 31415 records to 22713 (keeping 200 days of data) [2025-10-23T22:42:28.779160] [DEBUG] [LOCAL ] MTX: Primary data saved (22713 records). [2025-10-23T22:42:28.779316] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-23T22:42:28.779427] [INFO ] [MAIN ] Update Progress: 1420/2367 symbols completed. MTX took 20.2s. Estimated remaining: 2h 1m 39s. Rate: 7.8 symbols/min [2025-10-23T22:42:28.810137] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-23T22:42:28.957615] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:28.997704] [DEBUG] [LOCAL ] MTZ: Loaded 42746 existing records from primary storage. [2025-10-23T22:42:28.998073] [INFO ] [MAIN ] MTZ: Loaded 42746 existing records. [2025-10-23T22:42:29.178918] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:29.179245] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-23T22:42:29.179333] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-23T22:42:29.179973] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-23T22:42:29.180051] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-23T22:42:29.485188] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T22:42:29.569994] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:29.599442] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-23T22:42:29.801722] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T22:42:29.805100] [INFO ] [REMOTE ] MTRN: Full fetch complete (24138 records). [2025-10-23T22:42:29.805224] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-23T22:42:30.174477] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-23T22:42:30.174586] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-23T22:42:30.175180] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-23T22:42:30.175261] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-23T22:42:30.175956] [DEBUG] [LOCAL ] MTRN: Trimmed 24138 records to 18229 (keeping 200 days of data) [2025-10-23T22:42:30.286033] [DEBUG] [LOCAL ] MTRN: Primary data saved (18229 records). [2025-10-23T22:42:30.286211] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-23T22:42:30.286342] [INFO ] [MAIN ] Update Progress: 1421/2367 symbols completed. MTRN took 37.9s. Estimated remaining: 2h 1m 27s. Rate: 7.8 symbols/min [2025-10-23T22:42:30.404574] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-23T22:42:30.457931] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:30.470269] [DEBUG] [LOCAL ] MUA: Loaded 11533 existing records from primary storage. [2025-10-23T22:42:30.470522] [INFO ] [MAIN ] MUA: Loaded 11533 existing records. [2025-10-23T22:42:30.646375] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:30.646618] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-23T22:42:30.646721] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-23T22:42:30.646980] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-23T22:42:30.647057] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-23T22:42:30.999980] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:31.199419] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-23T22:42:31.289819] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T22:42:31.352809] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T22:42:31.999453] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-23T22:42:32.576584] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T22:42:32.799437] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-23T22:42:33.289329] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T22:42:33.599453] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-23T22:42:34.353120] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T22:42:34.399465] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-23T22:42:34.586591] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T22:42:35.199522] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-23T22:42:35.999425] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-23T22:42:36.042249] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T22:42:36.248729] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T22:42:36.799446] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-23T22:42:36.990912] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-23T22:42:37.599427] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-23T22:42:37.910518] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:42:38.338807] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T22:42:38.399429] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-23T22:42:39.199438] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-23T22:42:39.331958] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T22:42:39.999427] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-23T22:42:40.307505] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T22:42:40.312012] [INFO ] [REMOTE ] MTUS: Full fetch complete (41097 records). [2025-10-23T22:42:40.312121] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-23T22:42:40.697915] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-23T22:42:40.698035] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-23T22:42:40.698959] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-23T22:42:40.699040] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-23T22:42:40.700018] [DEBUG] [LOCAL ] MTUS: Trimmed 41097 records to 27624 (keeping 200 days of data) [2025-10-23T22:42:40.787168] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:42:40.804347] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-23T22:42:40.865264] [DEBUG] [LOCAL ] MTUS: Primary data saved (27624 records). [2025-10-23T22:42:40.865416] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-23T22:42:40.865527] [INFO ] [MAIN ] Update Progress: 1422/2367 symbols completed. MTUS took 43.3s. Estimated remaining: 2h 1m 21s. Rate: 7.8 symbols/min [2025-10-23T22:42:41.033171] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:41.053246] [DEBUG] [LOCAL ] MUC: Loaded 20640 existing records from primary storage. [2025-10-23T22:42:41.053535] [INFO ] [MAIN ] MUC: Loaded 20640 existing records. [2025-10-23T22:42:41.236175] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:41.236371] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-23T22:42:41.236446] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-23T22:42:41.236693] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-23T22:42:41.236800] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-23T22:42:41.538166] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T22:42:41.604759] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-23T22:42:41.609116] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:42.399407] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-23T22:42:42.483028] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T22:42:43.199450] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-23T22:42:43.394121] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T22:42:43.999446] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-23T22:42:44.784895] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T22:42:44.799673] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-23T22:42:45.192267] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T22:42:45.197001] [INFO ] [REMOTE ] MTW: Full fetch complete (38220 records). [2025-10-23T22:42:45.197126] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-23T22:42:45.570807] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-23T22:42:45.570927] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-23T22:42:45.571765] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-23T22:42:45.571845] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-23T22:42:45.572779] [DEBUG] [LOCAL ] MTW: Trimmed 38220 records to 26615 (keeping 200 days of data) [2025-10-23T22:42:45.618374] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-23T22:42:45.721913] [DEBUG] [LOCAL ] MTW: Primary data saved (26615 records). [2025-10-23T22:42:45.722069] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-23T22:42:45.722182] [INFO ] [MAIN ] Update Progress: 1423/2367 symbols completed. MTW took 38.8s. Estimated remaining: 2h 1m 12s. Rate: 7.8 symbols/min [2025-10-23T22:42:45.888509] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:45.899927] [DEBUG] [LOCAL ] MUE: Loaded 12225 existing records from primary storage. [2025-10-23T22:42:45.900162] [INFO ] [MAIN ] MUE: Loaded 12225 existing records. [2025-10-23T22:42:46.075072] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:46.075292] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-23T22:42:46.075366] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-23T22:42:46.075563] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-23T22:42:46.075675] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-23T22:42:46.403970] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-23T22:42:46.445855] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:46.505925] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T22:42:46.552035] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T22:42:47.199410] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-23T22:42:47.286110] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-23T22:42:47.999452] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-23T22:42:48.749423] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T22:42:48.799401] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-23T22:42:49.119320] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T22:42:49.599420] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-23T22:42:50.399473] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-23T22:42:50.449281] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T22:42:50.593835] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T22:42:51.025046] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-23T22:42:51.199488] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-23T22:42:51.999424] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-23T22:42:52.244029] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-23T22:42:52.799429] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-23T22:42:52.819123] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-23T22:42:52.821533] [INFO ] [REMOTE ] MUA: Full fetch complete (18306 records). [2025-10-23T22:42:52.821623] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-23T22:42:53.192879] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-23T22:42:53.192995] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-23T22:42:53.193494] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-23T22:42:53.193573] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-23T22:42:53.194200] [DEBUG] [LOCAL ] MUA: Trimmed 18306 records to 11632 (keeping 200 days of data) [2025-10-23T22:42:53.264085] [DEBUG] [LOCAL ] MUA: Primary data saved (11632 records). [2025-10-23T22:42:53.264237] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-23T22:42:53.264381] [INFO ] [MAIN ] Update Progress: 1424/2367 symbols completed. MUA took 23.0s. Estimated remaining: 2h 1m 4s. Rate: 7.8 symbols/min [2025-10-23T22:42:53.438422] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:42:53.488065] [DEBUG] [LOCAL ] MUFG: Loaded 52428 existing records from primary storage. [2025-10-23T22:42:53.488464] [INFO ] [MAIN ] MUFG: Loaded 52428 existing records. [2025-10-23T22:42:53.593990] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T22:42:53.604528] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-23T22:42:53.678063] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:42:53.678363] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-23T22:42:53.678462] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-23T22:42:53.678767] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-23T22:42:53.678859] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-23T22:42:54.025480] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:42:54.399479] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-23T22:42:55.186833] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T22:42:55.187550] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T22:42:55.199392] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-23T22:42:55.999448] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-23T22:42:56.187888] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T22:42:56.799444] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-23T22:42:57.599416] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-23T22:42:57.666337] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T22:42:57.827404] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:42:58.399428] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-23T22:42:58.422861] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T22:42:59.199452] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-23T22:43:00.002404] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-23T22:43:00.006392] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T22:43:00.018801] [INFO ] [REMOTE ] MTZ: Full fetch complete (63638 records). [2025-10-23T22:43:00.019058] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-23T22:43:00.414027] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T22:43:00.439328] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-23T22:43:00.439437] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-23T22:43:00.440581] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-23T22:43:00.440971] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-23T22:43:00.442143] [DEBUG] [LOCAL ] MTZ: Trimmed 63638 records to 43006 (keeping 200 days of data) [2025-10-23T22:43:00.695289] [DEBUG] [LOCAL ] MTZ: Primary data saved (43006 records). [2025-10-23T22:43:00.695463] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-23T22:43:00.695588] [INFO ] [MAIN ] Update Progress: 1425/2367 symbols completed. MTZ took 31.9s. Estimated remaining: 2h 0m 56s. Rate: 7.8 symbols/min [2025-10-23T22:43:00.804515] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-23T22:43:00.865406] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:00.879747] [DEBUG] [LOCAL ] MUJ: Loaded 13888 existing records from primary storage. [2025-10-23T22:43:00.880074] [INFO ] [MAIN ] MUJ: Loaded 13888 existing records. [2025-10-23T22:43:01.053077] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:01.053293] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-23T22:43:01.053374] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-23T22:43:01.053586] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-23T22:43:01.053689] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-23T22:43:01.407668] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:01.599410] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-23T22:43:01.701540] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T22:43:01.864304] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T22:43:02.399447] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-23T22:43:02.852337] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T22:43:03.199432] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-23T22:43:03.999419] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-23T22:43:04.042292] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T22:43:04.076570] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T22:43:04.721511] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-23T22:43:04.799422] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-23T22:43:05.596500] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T22:43:05.599344] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-23T22:43:06.399411] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-23T22:43:06.579463] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T22:43:06.906378] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-23T22:43:07.199433] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-23T22:43:07.999425] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-23T22:43:08.114190] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-23T22:43:08.782112] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T22:43:08.799398] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-23T22:43:09.602465] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T22:43:09.601575] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-23T22:43:10.399428] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-23T22:43:10.458885] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T22:43:10.461603] [INFO ] [REMOTE ] MUE: Full fetch complete (15926 records). [2025-10-23T22:43:10.461730] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-23T22:43:10.841578] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-23T22:43:10.841710] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-23T22:43:10.842147] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-23T22:43:10.842226] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-23T22:43:10.842900] [DEBUG] [LOCAL ] MUE: Trimmed 15926 records to 12258 (keeping 200 days of data) [2025-10-23T22:43:10.915455] [DEBUG] [LOCAL ] MUE: Primary data saved (12258 records). [2025-10-23T22:43:10.915620] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-23T22:43:10.915785] [INFO ] [MAIN ] Update Progress: 1426/2367 symbols completed. MUE took 25.2s. Estimated remaining: 2h 0m 50s. Rate: 7.8 symbols/min [2025-10-23T22:43:11.085075] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:11.134848] [DEBUG] [LOCAL ] MUR: Loaded 52861 existing records from primary storage. [2025-10-23T22:43:11.135204] [INFO ] [MAIN ] MUR: Loaded 52861 existing records. [2025-10-23T22:43:11.204580] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-23T22:43:11.327689] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T22:43:11.362885] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:11.366606] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-23T22:43:11.366733] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-23T22:43:11.367384] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-23T22:43:11.367469] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-23T22:43:11.795457] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:11.999439] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-23T22:43:12.799447] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-23T22:43:13.126125] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T22:43:13.208538] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-23T22:43:13.599425] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-23T22:43:14.399437] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-23T22:43:14.654843] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T22:43:15.161089] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T22:43:15.199436] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-23T22:43:15.423297] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T22:43:15.999438] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-23T22:43:16.799425] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-23T22:43:17.094710] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T22:43:17.120360] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T22:43:17.599427] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-23T22:43:18.399415] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-23T22:43:18.626794] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T22:43:19.102774] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T22:43:19.124400] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:43:19.128451] [INFO ] [REMOTE ] MUC: Full fetch complete (29574 records). [2025-10-23T22:43:19.128551] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-23T22:43:19.204538] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-23T22:43:19.532020] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-23T22:43:19.532137] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-23T22:43:19.532891] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-23T22:43:19.532973] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-23T22:43:19.533830] [DEBUG] [LOCAL ] MUC: Trimmed 29574 records to 20783 (keeping 200 days of data) [2025-10-23T22:43:19.666353] [DEBUG] [LOCAL ] MUC: Primary data saved (20783 records). [2025-10-23T22:43:19.666524] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-23T22:43:19.666661] [INFO ] [MAIN ] Update Progress: 1427/2367 symbols completed. MUC took 38.8s. Estimated remaining: 2h 0m 43s. Rate: 7.8 symbols/min [2025-10-23T22:43:19.859742] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:19.884690] [DEBUG] [LOCAL ] MUSA: Loaded 24600 existing records from primary storage. [2025-10-23T22:43:19.884994] [INFO ] [MAIN ] MUSA: Loaded 24600 existing records. [2025-10-23T22:43:19.999753] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-23T22:43:20.084720] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:20.084946] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-23T22:43:20.085032] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-23T22:43:20.085344] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-23T22:43:20.085420] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-23T22:43:20.496682] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:20.799511] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-23T22:43:20.983082] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-23T22:43:21.133354] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T22:43:21.599429] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-23T22:43:21.623624] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T22:43:22.274768] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T22:43:22.399463] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-23T22:43:23.199529] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-23T22:43:23.298209] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T22:43:23.301516] [INFO ] [REMOTE ] MUJ: Full fetch complete (19434 records). [2025-10-23T22:43:23.301623] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-23T22:43:23.709341] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-23T22:43:23.709482] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-23T22:43:23.710239] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-23T22:43:23.710322] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-23T22:43:23.711065] [DEBUG] [LOCAL ] MUJ: Trimmed 19434 records to 13954 (keeping 200 days of data) [2025-10-23T22:43:23.813298] [DEBUG] [LOCAL ] MUJ: Primary data saved (13954 records). [2025-10-23T22:43:23.813602] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-23T22:43:23.813761] [INFO ] [MAIN ] Update Progress: 1428/2367 symbols completed. MUJ took 23.1s. Estimated remaining: 2h 0m 33s. Rate: 7.8 symbols/min [2025-10-23T22:43:23.993447] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:23.993773] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-23T22:43:23.993846] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-23T22:43:23.993960] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-23T22:43:23.994029] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-23T22:43:23.994108] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-23T22:43:23.994188] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-23T22:43:24.005587] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-23T22:43:24.365267] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:24.799530] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-23T22:43:25.031691] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T22:43:25.554606] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T22:43:25.599441] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-23T22:43:26.058876] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T22:43:26.399474] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-23T22:43:27.199423] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-23T22:43:27.421578] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T22:43:27.540117] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:43:27.540457] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-23T22:43:27.540565] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:43:27.540685] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-23T22:43:27.540772] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:43:27.540864] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-23T22:43:27.540975] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-23T22:43:27.541061] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-23T22:43:27.541199] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-23T22:43:27.541318] [INFO ] [MAIN ] Update Progress: 1429/2367 symbols completed. MUSE took 3.7s. Estimated remaining: 2h 0m 23s. Rate: 7.8 symbols/min [2025-10-23T22:43:27.708168] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:27.747365] [DEBUG] [LOCAL ] MUX: Loaded 43833 existing records from primary storage. [2025-10-23T22:43:27.747750] [INFO ] [MAIN ] MUX: Loaded 43833 existing records. [2025-10-23T22:43:27.929852] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:27.930078] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-23T22:43:27.930171] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-23T22:43:27.930435] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-23T22:43:27.930540] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-23T22:43:28.001696] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-23T22:43:28.296309] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:28.325839] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T22:43:28.799506] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-23T22:43:29.599432] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-23T22:43:29.803750] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T22:43:29.872839] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T22:43:30.399430] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-23T22:43:30.844401] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T22:43:31.199471] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-23T22:43:31.999457] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-23T22:43:32.413256] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-23T22:43:32.464377] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T22:43:32.799456] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-23T22:43:33.599498] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-23T22:43:33.798940] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T22:43:34.399436] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-23T22:43:34.568943] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:43:35.173046] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T22:43:35.199404] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-23T22:43:35.767832] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T22:43:35.999435] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-23T22:43:36.799440] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-23T22:43:36.846221] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T22:43:37.437640] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T22:43:37.446617] [INFO ] [REMOTE ] MUFG: Full fetch complete (75871 records). [2025-10-23T22:43:37.446788] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-23T22:43:37.619927] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-23T22:43:37.840345] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-23T22:43:37.840470] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-23T22:43:37.841584] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-23T22:43:37.841698] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-23T22:43:37.843194] [DEBUG] [LOCAL ] MUFG: Trimmed 75871 records to 52806 (keeping 200 days of data) [2025-10-23T22:43:38.165027] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T22:43:38.192814] [DEBUG] [LOCAL ] MUFG: Primary data saved (52806 records). [2025-10-23T22:43:38.192944] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-23T22:43:38.193048] [INFO ] [MAIN ] Update Progress: 1430/2367 symbols completed. MUFG took 44.9s. Estimated remaining: 2h 0m 17s. Rate: 7.8 symbols/min [2025-10-23T22:43:38.361464] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:38.375323] [DEBUG] [LOCAL ] MVF: Loaded 12686 existing records from primary storage. [2025-10-23T22:43:38.375569] [INFO ] [MAIN ] MVF: Loaded 12686 existing records. [2025-10-23T22:43:38.406004] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-23T22:43:38.560236] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:38.560456] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-23T22:43:38.560529] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-23T22:43:38.560800] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-23T22:43:38.560870] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-23T22:43:38.911485] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:39.199427] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-23T22:43:39.259671] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T22:43:39.624675] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T22:43:39.999439] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-23T22:43:40.767677] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T22:43:40.799408] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-23T22:43:41.451076] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T22:43:41.599429] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-23T22:43:42.399507] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-23T22:43:42.518520] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T22:43:42.527884] [INFO ] [REMOTE ] MUR: Full fetch complete (76822 records). [2025-10-23T22:43:42.528058] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-23T22:43:42.917823] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-23T22:43:42.918074] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-23T22:43:42.919303] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-23T22:43:42.919388] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-23T22:43:42.920908] [DEBUG] [LOCAL ] MUR: Trimmed 76822 records to 53250 (keeping 200 days of data) [2025-10-23T22:43:43.166346] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T22:43:43.228196] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-23T22:43:43.277165] [DEBUG] [LOCAL ] MUR: Primary data saved (53250 records). [2025-10-23T22:43:43.277819] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-23T22:43:43.279426] [INFO ] [MAIN ] Update Progress: 1431/2367 symbols completed. MUR took 32.4s. Estimated remaining: 2h 0m 7s. Rate: 7.8 symbols/min [2025-10-23T22:43:43.458107] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:43.467726] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T22:43:43.481675] [DEBUG] [LOCAL ] MVO: Loaded 8969 existing records from primary storage. [2025-10-23T22:43:43.481987] [INFO ] [MAIN ] MVO: Loaded 8969 existing records. [2025-10-23T22:43:43.667631] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:43.667915] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-23T22:43:43.667996] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-23T22:43:43.668164] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-23T22:43:43.668230] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-23T22:43:44.012695] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-23T22:43:44.018707] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:44.400634] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T22:43:44.799442] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-23T22:43:45.599489] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-23T22:43:45.743821] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T22:43:45.822704] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T22:43:46.199873] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T22:43:46.399439] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-23T22:43:47.199440] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-23T22:43:47.999433] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-23T22:43:48.059749] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T22:43:48.272628] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-23T22:43:48.799456] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-23T22:43:49.004115] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T22:43:49.480104] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T22:43:49.599456] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-23T22:43:50.399437] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-23T22:43:50.543122] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T22:43:51.199520] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-23T22:43:51.998540] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T22:43:51.999785] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-23T22:43:52.238437] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T22:43:52.478670] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T22:43:52.799419] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-23T22:43:53.599409] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-23T22:43:53.990908] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T22:43:53.995149] [INFO ] [REMOTE ] MUSA: Full fetch complete (35632 records). [2025-10-23T22:43:53.995251] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-23T22:43:54.370426] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-23T22:43:54.370534] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-23T22:43:54.371383] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-23T22:43:54.371481] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-23T22:43:54.372416] [DEBUG] [LOCAL ] MUSA: Trimmed 35632 records to 24766 (keeping 200 days of data) [2025-10-23T22:43:54.425697] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-23T22:43:54.493567] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-23T22:43:54.539319] [DEBUG] [LOCAL ] MUSA: Primary data saved (24766 records). [2025-10-23T22:43:54.539495] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-23T22:43:54.539691] [INFO ] [MAIN ] Update Progress: 1432/2367 symbols completed. MUSA took 34.9s. Estimated remaining: 2h 0m 2s. Rate: 7.8 symbols/min [2025-10-23T22:43:54.705374] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:54.716405] [DEBUG] [LOCAL ] MVT: Loaded 9790 existing records from primary storage. [2025-10-23T22:43:54.716666] [INFO ] [MAIN ] MVT: Loaded 9790 existing records. [2025-10-23T22:43:54.888565] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:54.888802] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-23T22:43:54.888882] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-23T22:43:54.889099] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-23T22:43:54.889178] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-23T22:43:55.204367] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-23T22:43:55.243624] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:43:55.304707] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:43:55.821738] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T22:43:55.999454] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-23T22:43:56.803819] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T22:43:56.801552] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-23T22:43:57.599457] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-23T22:43:58.399452] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-23T22:43:58.771356] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T22:43:58.780423] [INFO ] [REMOTE ] MUX: Full fetch complete (61620 records). [2025-10-23T22:43:58.780600] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-23T22:43:58.893150] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T22:43:59.144115] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T22:43:59.191680] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-23T22:43:59.191817] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-23T22:43:59.192970] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-23T22:43:59.193050] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-23T22:43:59.194434] [DEBUG] [LOCAL ] MUX: Trimmed 61620 records to 44187 (keeping 200 days of data) [2025-10-23T22:43:59.238930] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-23T22:43:59.443431] [DEBUG] [LOCAL ] MUX: Primary data saved (44187 records). [2025-10-23T22:43:59.443605] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-23T22:43:59.443744] [INFO ] [MAIN ] Update Progress: 1433/2367 symbols completed. MUX took 31.9s. Estimated remaining: 1h 59m 53s. Rate: 7.8 symbols/min [2025-10-23T22:43:59.612767] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:43:59.652972] [DEBUG] [LOCAL ] MWA: Loaded 45767 existing records from primary storage. [2025-10-23T22:43:59.653311] [INFO ] [MAIN ] MWA: Loaded 45767 existing records. [2025-10-23T22:43:59.830390] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:43:59.830597] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-23T22:43:59.830695] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-23T22:43:59.830921] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-23T22:43:59.830992] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-23T22:44:00.005382] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-23T22:44:00.125712] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T22:44:00.209837] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:00.799487] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-23T22:44:00.941841] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T22:44:01.599426] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-23T22:44:01.752059] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T22:44:01.755410] [INFO ] [REMOTE ] MVF: Full fetch complete (18584 records). [2025-10-23T22:44:01.755559] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-23T22:44:02.168618] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-23T22:44:02.168789] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-23T22:44:02.169311] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-23T22:44:02.169410] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-23T22:44:02.170227] [DEBUG] [LOCAL ] MVF: Trimmed 18584 records to 12832 (keeping 200 days of data) [2025-10-23T22:44:02.246663] [DEBUG] [LOCAL ] MVF: Primary data saved (12832 records). [2025-10-23T22:44:02.246832] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-23T22:44:02.246957] [INFO ] [MAIN ] Update Progress: 1434/2367 symbols completed. MVF took 24.1s. Estimated remaining: 1h 59m 42s. Rate: 7.8 symbols/min [2025-10-23T22:44:02.416750] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-23T22:44:02.420323] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:02.443958] [DEBUG] [LOCAL ] MX: Loaded 22229 existing records from primary storage. [2025-10-23T22:44:02.444280] [INFO ] [MAIN ] MX: Loaded 22229 existing records. [2025-10-23T22:44:02.598406] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-23T22:44:02.642012] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:44:02.642403] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-23T22:44:02.642479] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-23T22:44:02.642732] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-23T22:44:02.642807] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-23T22:44:02.993709] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:03.146522] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:44:03.199416] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-23T22:44:03.999436] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-23T22:44:04.328000] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T22:44:04.772593] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T22:44:04.799418] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-23T22:44:05.599455] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-23T22:44:05.631008] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T22:44:06.399446] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-23T22:44:07.199439] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-23T22:44:07.209346] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T22:44:07.250928] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T22:44:07.765897] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T22:44:07.999457] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-23T22:44:08.547206] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-23T22:44:08.799453] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-23T22:44:09.599437] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-23T22:44:10.399413] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-23T22:44:10.421267] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T22:44:10.574481] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T22:44:11.199436] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-23T22:44:11.297107] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T22:44:11.999425] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-23T22:44:12.018335] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T22:44:12.799523] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-23T22:44:13.599484] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-23T22:44:13.808677] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T22:44:13.925074] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:44:14.366406] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T22:44:14.399442] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-23T22:44:15.199425] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-23T22:44:16.001605] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-23T22:44:16.004124] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T22:44:16.123314] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T22:44:16.799445] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-23T22:44:17.201603] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T22:44:17.420875] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-23T22:44:17.423121] [INFO ] [REMOTE ] MVO: Full fetch complete (14663 records). [2025-10-23T22:44:17.423216] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-23T22:44:17.599932] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-23T22:44:17.860283] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-23T22:44:17.860441] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-23T22:44:17.861267] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-23T22:44:17.861384] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-23T22:44:17.862035] [DEBUG] [LOCAL ] MVO: Trimmed 14663 records to 9083 (keeping 200 days of data) [2025-10-23T22:44:17.920706] [DEBUG] [LOCAL ] MVO: Primary data saved (9083 records). [2025-10-23T22:44:17.920962] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-23T22:44:17.921105] [INFO ] [MAIN ] Update Progress: 1435/2367 symbols completed. MVO took 34.6s. Estimated remaining: 1h 59m 39s. Rate: 7.8 symbols/min [2025-10-23T22:44:18.120063] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:18.120423] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-23T22:44:18.120501] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-23T22:44:18.120635] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-23T22:44:18.120733] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-23T22:44:18.120823] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-23T22:44:18.120904] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-23T22:44:18.404582] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-23T22:44:18.496261] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:19.050463] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:44:19.053159] [INFO ] [REMOTE ] MVT: Full fetch complete (13674 records). [2025-10-23T22:44:19.053352] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-23T22:44:19.201988] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-23T22:44:19.470087] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-23T22:44:19.470333] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-23T22:44:19.470961] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-23T22:44:19.472246] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T22:44:19.472306] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-23T22:44:19.482518] [DEBUG] [LOCAL ] MVT: Trimmed 13674 records to 9850 (keeping 200 days of data) [2025-10-23T22:44:19.543746] [DEBUG] [LOCAL ] MVT: Primary data saved (9850 records). [2025-10-23T22:44:19.543930] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-23T22:44:19.544046] [INFO ] [MAIN ] Update Progress: 1436/2367 symbols completed. MVT took 25.0s. Estimated remaining: 1h 59m 28s. Rate: 7.8 symbols/min [2025-10-23T22:44:19.718485] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:19.726550] [DEBUG] [LOCAL ] MXF: Loaded 5491 existing records from primary storage. [2025-10-23T22:44:19.726834] [INFO ] [MAIN ] MXF: Loaded 5491 existing records. [2025-10-23T22:44:19.910336] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:44:19.910524] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-23T22:44:19.910598] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-23T22:44:19.910797] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-23T22:44:19.910868] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-23T22:44:20.004547] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-23T22:44:20.301755] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:20.392407] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T22:44:20.799447] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-23T22:44:21.551837] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T22:44:21.599429] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-23T22:44:21.637802] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T22:44:22.052318] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T22:44:22.399445] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-23T22:44:23.199455] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-23T22:44:23.251530] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T22:44:23.999491] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-23T22:44:24.799532] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-23T22:44:25.115274] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T22:44:25.138600] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T22:44:25.569025] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T22:44:25.599427] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-23T22:44:26.065584] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-23T22:44:26.399449] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-23T22:44:27.199419] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-23T22:44:27.524586] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T22:44:27.656821] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T22:44:27.999464] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-23T22:44:28.781519] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T22:44:28.799401] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-23T22:44:29.582313] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T22:44:29.599402] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-23T22:44:30.123679] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-23T22:44:30.399458] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-23T22:44:31.199450] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-23T22:44:31.849949] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T22:44:31.854297] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T22:44:31.999465] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-23T22:44:32.799424] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-23T22:44:33.153272] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T22:44:33.425825] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T22:44:33.599437] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-23T22:44:34.399442] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-23T22:44:34.780829] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-23T22:44:35.094781] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T22:44:35.199429] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-23T22:44:35.999478] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-23T22:44:36.485261] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T22:44:36.686609] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T22:44:36.799491] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-23T22:44:37.599489] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-23T22:44:37.851515] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T22:44:37.855163] [INFO ] [REMOTE ] MX: Full fetch complete (31572 records). [2025-10-23T22:44:37.855296] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-23T22:44:38.216800] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-23T22:44:38.216909] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-23T22:44:38.217551] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-23T22:44:38.217624] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-23T22:44:38.218419] [DEBUG] [LOCAL ] MX: Trimmed 31572 records to 22387 (keeping 200 days of data) [2025-10-23T22:44:38.337364] [DEBUG] [LOCAL ] MX: Primary data saved (22387 records). [2025-10-23T22:44:38.337519] [INFO ] [MAIN ] MX: Full history saved. [2025-10-23T22:44:38.337624] [INFO ] [MAIN ] Update Progress: 1437/2367 symbols completed. MX took 36.1s. Estimated remaining: 1h 59m 27s. Rate: 7.8 symbols/min [2025-10-23T22:44:38.399414] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-23T22:44:38.904054] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T22:44:39.101993] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T22:44:39.110172] [INFO ] [REMOTE ] MWA: Full fetch complete (68184 records). [2025-10-23T22:44:39.110364] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-23T22:44:39.208727] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-23T22:44:39.496165] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-23T22:44:39.496275] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-23T22:44:39.497304] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-23T22:44:39.497401] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-23T22:44:39.498743] [DEBUG] [LOCAL ] MWA: Trimmed 68184 records to 46053 (keeping 200 days of data) [2025-10-23T22:44:39.736063] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-23T22:44:39.775051] [DEBUG] [LOCAL ] MWA: Primary data saved (46053 records). [2025-10-23T22:44:39.775196] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-23T22:44:39.775317] [INFO ] [MAIN ] Update Progress: 1438/2367 symbols completed. MWA took 40.3s. Estimated remaining: 1h 59m 15s. Rate: 7.8 symbols/min [2025-10-23T22:44:39.999435] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-23T22:44:40.697113] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T22:44:40.698925] [INFO ] [REMOTE ] MXF: Full fetch complete (9799 records). [2025-10-23T22:44:40.699025] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-23T22:44:40.804566] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-23T22:44:41.057373] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-23T22:44:41.057484] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-23T22:44:41.057810] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-23T22:44:41.057918] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-23T22:44:41.058438] [DEBUG] [LOCAL ] MXF: Trimmed 9799 records to 5580 (keeping 200 days of data) [2025-10-23T22:44:41.091172] [DEBUG] [LOCAL ] MXF: Primary data saved (5580 records). [2025-10-23T22:44:41.091310] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-23T22:44:41.091453] [INFO ] [MAIN ] Update Progress: 1439/2367 symbols completed. MXF took 21.5s. Estimated remaining: 1h 59m 3s. Rate: 7.8 symbols/min [2025-10-23T22:44:41.350159] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-23T22:44:41.599432] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-23T22:44:42.062349] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T22:44:42.399455] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-23T22:44:42.845228] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T22:44:43.199509] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-23T22:44:43.652566] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T22:44:43.653478] [INFO ] [REMOTE ] MXE: Full fetch complete (2542 records). [2025-10-23T22:44:43.653578] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-23T22:44:43.833285] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-23T22:44:43.833502] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:44:43.833595] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:44:43.833693] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-23T22:44:43.833787] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-23T22:44:43.833859] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-23T22:44:43.833938] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-23T22:44:43.834045] [INFO ] [MAIN ] Update Progress: 1440/2367 symbols completed. MXE took 25.9s. Estimated remaining: 1h 58m 53s. Rate: 7.8 symbols/min [2025-10-23T22:44:44.427578] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:44.515870] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:44.537503] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:44.538979] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:44:44.558586] [DEBUG] [LOCAL ] MYN: Loaded 9951 existing records from primary storage. [2025-10-23T22:44:44.563387] [DEBUG] [LOCAL ] MYD: Loaded 13143 existing records from primary storage. [2025-10-23T22:44:44.568425] [INFO ] [MAIN ] MYN: Loaded 9951 existing records. [2025-10-23T22:44:44.568589] [INFO ] [MAIN ] MYD: Loaded 13143 existing records. [2025-10-23T22:44:44.575115] [DEBUG] [LOCAL ] MYI: Loaded 19068 existing records from primary storage. [2025-10-23T22:44:44.665174] [DEBUG] [LOCAL ] MYE: Loaded 24003 existing records from primary storage. [2025-10-23T22:44:44.674107] [INFO ] [MAIN ] MYI: Loaded 19068 existing records. [2025-10-23T22:44:44.721177] [INFO ] [MAIN ] MYE: Loaded 24003 existing records. [2025-10-23T22:44:44.937522] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:44:45.093092] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-23T22:44:45.112524] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:44:45.112800] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-23T22:44:45.167712] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-23T22:44:45.188092] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-23T22:44:45.188195] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-23T22:44:45.228497] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:44:45.228779] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-23T22:44:45.229580] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-23T22:44:45.228798] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-23T22:44:45.240257] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-23T22:44:45.240179] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-23T22:44:45.305173] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-23T22:44:45.348606] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-23T22:44:45.560192] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:44:45.620019] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-23T22:44:45.663953] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-23T22:44:45.712076] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-23T22:44:45.756682] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-23T22:44:46.354242] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:46.425316] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-23T22:44:46.599717] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:46.650636] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-23T22:44:46.679945] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:46.708925] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-23T22:44:46.799018] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:44:46.799334] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-23T22:44:47.366073] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T22:44:47.369176] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-23T22:44:47.782871] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T22:44:48.000177] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-23T22:44:48.002151] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T22:44:48.081269] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T22:44:48.264398] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T22:44:48.548950] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-23T22:44:48.799459] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-23T22:44:49.599467] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-23T22:44:49.882627] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T22:44:50.368416] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T22:44:50.399400] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-23T22:44:51.184723] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T22:44:51.199393] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-23T22:44:51.999428] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-23T22:44:52.040241] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T22:44:52.799444] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-23T22:44:53.076129] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T22:44:53.563309] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T22:44:53.599402] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-23T22:44:54.399422] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-23T22:44:54.615868] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T22:44:55.199444] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-23T22:44:55.395328] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-23T22:44:55.999452] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-23T22:44:56.557250] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T22:44:56.799420] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-23T22:44:56.942235] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T22:44:57.599451] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-23T22:44:57.941058] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-23T22:44:58.381336] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T22:44:58.399388] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-23T22:44:59.199462] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-23T22:44:59.212141] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:44:59.999491] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-23T22:45:00.502516] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T22:45:00.799503] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-23T22:45:00.989988] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T22:45:01.599492] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-23T22:45:01.857557] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:45:02.399438] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-23T22:45:02.439449] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T22:45:02.442045] [INFO ] [REMOTE ] MYN: Full fetch complete (15011 records). [2025-10-23T22:45:02.442198] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-23T22:45:02.841368] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-23T22:45:02.841512] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-23T22:45:02.842109] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-23T22:45:02.842195] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-23T22:45:02.842930] [DEBUG] [LOCAL ] MYN: Trimmed 15011 records to 10063 (keeping 200 days of data) [2025-10-23T22:45:02.907241] [DEBUG] [LOCAL ] MYN: Primary data saved (10063 records). [2025-10-23T22:45:02.907418] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-23T22:45:02.907570] [INFO ] [MAIN ] Update Progress: 1441/2367 symbols completed. MYN took 19.1s. Estimated remaining: 1h 58m 52s. Rate: 7.8 symbols/min [2025-10-23T22:45:03.108927] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:03.154384] [DEBUG] [LOCAL ] NABL: Loaded 38946 existing records from primary storage. [2025-10-23T22:45:03.154764] [INFO ] [MAIN ] NABL: Loaded 38946 existing records. [2025-10-23T22:45:03.204535] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-23T22:45:03.348493] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:03.348796] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-23T22:45:03.348875] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-23T22:45:03.349104] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-23T22:45:03.349179] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-23T22:45:03.726853] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:03.740266] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T22:45:03.999432] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-23T22:45:04.090742] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T22:45:04.799451] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-23T22:45:05.448506] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:45:05.599420] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-23T22:45:06.058934] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T22:45:06.399434] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-23T22:45:06.910526] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T22:45:07.199428] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-23T22:45:07.518948] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T22:45:07.999413] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-23T22:45:08.293402] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T22:45:08.799417] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-23T22:45:09.027785] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T22:45:09.599453] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-23T22:45:10.399403] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-23T22:45:10.502129] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T22:45:10.782570] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T22:45:11.199417] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-23T22:45:11.209828] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T22:45:11.999455] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-23T22:45:12.387681] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T22:45:12.799442] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-23T22:45:13.166415] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T22:45:13.599442] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-23T22:45:14.340883] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T22:45:14.399464] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-23T22:45:14.705065] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T22:45:14.709503] [INFO ] [REMOTE ] MYE: Full fetch complete (35923 records). [2025-10-23T22:45:14.709677] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-23T22:45:15.085908] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-23T22:45:15.086018] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-23T22:45:15.086763] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-23T22:45:15.086840] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-23T22:45:15.087581] [DEBUG] [LOCAL ] MYE: Trimmed 35923 records to 24133 (keeping 200 days of data) [2025-10-23T22:45:15.203344] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-23T22:45:15.239892] [DEBUG] [LOCAL ] MYE: Primary data saved (24133 records). [2025-10-23T22:45:15.240051] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-23T22:45:15.240231] [INFO ] [MAIN ] Update Progress: 1442/2367 symbols completed. MYE took 31.4s. Estimated remaining: 1h 58m 47s. Rate: 7.8 symbols/min [2025-10-23T22:45:15.422991] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:15.448852] [DEBUG] [LOCAL ] NAC: Loaded 24487 existing records from primary storage. [2025-10-23T22:45:15.449205] [INFO ] [MAIN ] NAC: Loaded 24487 existing records. [2025-10-23T22:45:15.639426] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:15.635042] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T22:45:15.639717] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-23T22:45:15.644348] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-23T22:45:15.644582] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-23T22:45:15.644687] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-23T22:45:16.003266] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-23T22:45:16.031388] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T22:45:16.037285] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:16.799475] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-23T22:45:17.210488] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T22:45:17.214903] [INFO ] [REMOTE ] MYI: Full fetch complete (29008 records). [2025-10-23T22:45:17.215018] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-23T22:45:17.606581] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-23T22:45:17.622270] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-23T22:45:17.622388] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-23T22:45:17.623143] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-23T22:45:17.623238] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-23T22:45:17.624160] [DEBUG] [LOCAL ] MYI: Trimmed 29008 records to 19487 (keeping 200 days of data) [2025-10-23T22:45:17.748818] [DEBUG] [LOCAL ] MYI: Primary data saved (19487 records). [2025-10-23T22:45:17.748981] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-23T22:45:17.749096] [INFO ] [MAIN ] Update Progress: 1443/2367 symbols completed. MYI took 33.9s. Estimated remaining: 1h 58m 36s. Rate: 7.8 symbols/min [2025-10-23T22:45:17.926022] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:17.957969] [DEBUG] [LOCAL ] NAD: Loaded 33581 existing records from primary storage. [2025-10-23T22:45:17.958317] [INFO ] [MAIN ] NAD: Loaded 33581 existing records. [2025-10-23T22:45:18.136238] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:18.136583] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-23T22:45:18.136700] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-23T22:45:18.137114] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-23T22:45:18.137193] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-23T22:45:18.409562] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-23T22:45:18.436965] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T22:45:18.526364] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T22:45:18.530247] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:19.199464] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-23T22:45:19.999409] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-23T22:45:20.035362] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:45:20.321160] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-23T22:45:20.565510] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T22:45:20.799489] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-23T22:45:21.599498] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-23T22:45:22.366267] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T22:45:22.399437] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-23T22:45:22.767984] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T22:45:23.199453] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-23T22:45:23.311162] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T22:45:23.314118] [INFO ] [REMOTE ] MYD: Full fetch complete (20006 records). [2025-10-23T22:45:23.314225] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-23T22:45:23.668687] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-23T22:45:23.668786] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-23T22:45:23.669230] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-23T22:45:23.669308] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-23T22:45:23.669897] [DEBUG] [LOCAL ] MYD: Trimmed 20006 records to 13242 (keeping 200 days of data) [2025-10-23T22:45:23.745818] [DEBUG] [LOCAL ] MYD: Primary data saved (13242 records). [2025-10-23T22:45:23.745959] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-23T22:45:23.746045] [INFO ] [MAIN ] Update Progress: 1444/2367 symbols completed. MYD took 39.9s. Estimated remaining: 1h 58m 28s. Rate: 7.8 symbols/min [2025-10-23T22:45:23.911300] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:23.921936] [DEBUG] [LOCAL ] NAN: Loaded 8427 existing records from primary storage. [2025-10-23T22:45:23.922179] [INFO ] [MAIN ] NAN: Loaded 8427 existing records. [2025-10-23T22:45:24.004736] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-23T22:45:24.097358] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:24.097520] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-23T22:45:24.097593] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-23T22:45:24.097898] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-23T22:45:24.097975] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-23T22:45:24.451427] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:24.585119] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T22:45:24.799415] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-23T22:45:25.352739] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T22:45:25.552945] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T22:45:25.599400] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-23T22:45:26.342841] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T22:45:26.399419] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-23T22:45:27.199503] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-23T22:45:27.225688] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T22:45:27.999442] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-23T22:45:28.698206] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T22:45:28.799447] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-23T22:45:29.602755] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-23T22:45:29.606241] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T22:45:29.744567] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T22:45:30.399492] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-23T22:45:30.755765] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T22:45:31.199433] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-23T22:45:31.829254] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T22:45:31.999460] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-23T22:45:32.464795] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T22:45:32.753502] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-23T22:45:32.799422] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-23T22:45:33.599844] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-23T22:45:34.072308] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T22:45:34.399486] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-23T22:45:34.628606] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T22:45:34.635200] [INFO ] [REMOTE ] NABL: Full fetch complete (56901 records). [2025-10-23T22:45:34.635376] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-23T22:45:35.033844] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-23T22:45:35.034299] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-23T22:45:35.035237] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-23T22:45:35.035330] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-23T22:45:35.036535] [DEBUG] [LOCAL ] NABL: Trimmed 56901 records to 39110 (keeping 200 days of data) [2025-10-23T22:45:35.200757] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-23T22:45:35.270446] [DEBUG] [LOCAL ] NABL: Primary data saved (39110 records). [2025-10-23T22:45:35.270744] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-23T22:45:35.270951] [INFO ] [MAIN ] Update Progress: 1445/2367 symbols completed. NABL took 32.4s. Estimated remaining: 1h 58m 22s. Rate: 7.8 symbols/min [2025-10-23T22:45:35.447319] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:35.491873] [DEBUG] [LOCAL ] NAT: Loaded 49207 existing records from primary storage. [2025-10-23T22:45:35.492303] [INFO ] [MAIN ] NAT: Loaded 49207 existing records. [2025-10-23T22:45:35.686779] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-23T22:45:35.691207] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:35.697117] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-23T22:45:35.697550] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-23T22:45:35.698022] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-23T22:45:35.698098] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-23T22:45:35.880507] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T22:45:36.004579] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-23T22:45:36.068200] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:36.799506] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-23T22:45:37.129370] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T22:45:37.545009] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T22:45:37.599471] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-23T22:45:38.400517] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-23T22:45:38.403262] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T22:45:39.199458] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-23T22:45:39.713145] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T22:45:39.969257] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T22:45:39.999393] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-23T22:45:40.743634] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T22:45:40.745941] [INFO ] [REMOTE ] NAN: Full fetch complete (13578 records). [2025-10-23T22:45:40.746110] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-23T22:45:40.808082] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-23T22:45:41.124024] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-23T22:45:41.124141] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-23T22:45:41.124595] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-23T22:45:41.124713] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-23T22:45:41.125256] [DEBUG] [LOCAL ] NAN: Trimmed 13578 records to 8556 (keeping 200 days of data) [2025-10-23T22:45:41.176690] [DEBUG] [LOCAL ] NAN: Primary data saved (8556 records). [2025-10-23T22:45:41.176900] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-23T22:45:41.177023] [INFO ] [MAIN ] Update Progress: 1446/2367 symbols completed. NAN took 17.4s. Estimated remaining: 1h 58m 13s. Rate: 7.8 symbols/min [2025-10-23T22:45:41.345181] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:41.375840] [DEBUG] [LOCAL ] NATL: Loaded 32096 existing records from primary storage. [2025-10-23T22:45:41.376169] [INFO ] [MAIN ] NATL: Loaded 32096 existing records. [2025-10-23T22:45:41.555430] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:41.555696] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-23T22:45:41.555773] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-23T22:45:41.555998] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-23T22:45:41.556072] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-23T22:45:41.609821] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-23T22:45:41.915841] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:42.228283] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T22:45:42.399427] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-23T22:45:42.851431] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T22:45:42.855723] [INFO ] [REMOTE ] NAC: Full fetch complete (35402 records). [2025-10-23T22:45:42.855821] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-23T22:45:43.209962] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-23T22:45:43.224613] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-23T22:45:43.224731] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-23T22:45:43.225484] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-23T22:45:43.225572] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-23T22:45:43.226575] [DEBUG] [LOCAL ] NAC: Trimmed 35402 records to 24674 (keeping 200 days of data) [2025-10-23T22:45:43.387894] [DEBUG] [LOCAL ] NAC: Primary data saved (24674 records). [2025-10-23T22:45:43.388057] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-23T22:45:43.388170] [INFO ] [MAIN ] Update Progress: 1447/2367 symbols completed. NAC took 28.1s. Estimated remaining: 1h 58m 2s. Rate: 7.8 symbols/min [2025-10-23T22:45:43.568353] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:45:43.593672] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T22:45:43.596065] [DEBUG] [LOCAL ] NAZ: Loaded 2670 existing records from primary storage. [2025-10-23T22:45:43.605162] [INFO ] [MAIN ] NAZ: Loaded 2670 existing records. [2025-10-23T22:45:43.791528] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:45:43.791825] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-23T22:45:43.791905] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-23T22:45:43.792102] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-23T22:45:43.792178] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-23T22:45:44.004579] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-23T22:45:44.164140] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:45:44.728065] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T22:45:44.799416] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-23T22:45:45.496696] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T22:45:45.599435] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-23T22:45:45.613205] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T22:45:46.399451] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-23T22:45:46.954197] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T22:45:47.199436] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-23T22:45:47.779053] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T22:45:47.999471] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-23T22:45:48.596325] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-23T22:45:48.799439] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-23T22:45:49.338854] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T22:45:49.373399] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T22:45:49.599453] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-23T22:45:50.399418] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-23T22:45:50.766630] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T22:45:50.872466] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-23T22:45:51.199497] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-23T22:45:51.999453] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-23T22:45:52.799460] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-23T22:45:52.922400] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T22:45:53.257778] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T22:45:53.278568] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T22:45:53.599449] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-23T22:45:54.399483] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-23T22:45:54.931083] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T22:45:55.199481] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-23T22:45:55.999415] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-23T22:45:56.235175] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T22:45:56.329239] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-23T22:45:56.553929] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T22:45:56.799441] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-23T22:45:57.599426] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-23T22:45:58.399432] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-23T22:45:58.695758] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T22:45:58.768547] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-23T22:45:59.199459] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-23T22:45:59.627988] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T22:45:59.999407] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-23T22:46:00.326691] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T22:46:00.799432] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-23T22:46:01.599421] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-23T22:46:01.631618] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-23T22:46:02.200419] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T22:46:02.217423] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T22:46:02.226098] [INFO ] [REMOTE ] NAD: Full fetch complete (48429 records). [2025-10-23T22:46:02.226246] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-23T22:46:02.413121] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-23T22:46:02.602826] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-23T22:46:02.602950] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-23T22:46:02.603918] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-23T22:46:02.604014] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-23T22:46:02.605057] [DEBUG] [LOCAL ] NAD: Trimmed 48429 records to 33735 (keeping 200 days of data) [2025-10-23T22:46:02.804060] [DEBUG] [LOCAL ] NAD: Primary data saved (33735 records). [2025-10-23T22:46:02.804229] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-23T22:46:02.804360] [INFO ] [MAIN ] Update Progress: 1448/2367 symbols completed. NAD took 45.1s. Estimated remaining: 1h 58m 2s. Rate: 7.8 symbols/min [2025-10-23T22:46:02.982105] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:02.992731] [DEBUG] [LOCAL ] NBB: Loaded 9022 existing records from primary storage. [2025-10-23T22:46:02.992972] [INFO ] [MAIN ] NBB: Loaded 9022 existing records. [2025-10-23T22:46:03.139562] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T22:46:03.179852] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:03.180018] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-23T22:46:03.180093] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-23T22:46:03.180304] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-23T22:46:03.180379] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-23T22:46:03.209255] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-23T22:46:03.532016] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:03.999431] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-23T22:46:04.783126] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T22:46:04.799393] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-23T22:46:05.395412] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T22:46:05.599429] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-23T22:46:05.665386] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T22:46:06.399442] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-23T22:46:07.083084] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T22:46:07.199406] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-23T22:46:07.433953] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T22:46:07.999438] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-23T22:46:08.484201] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T22:46:08.485334] [INFO ] [REMOTE ] NAZ: Full fetch complete (4070 records). [2025-10-23T22:46:08.485426] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-23T22:46:08.790873] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T22:46:08.803453] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-23T22:46:08.879855] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-23T22:46:08.879972] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-23T22:46:08.880171] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-23T22:46:08.880264] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-23T22:46:08.880745] [DEBUG] [LOCAL ] NAZ: Trimmed 4070 records to 2688 (keeping 200 days of data) [2025-10-23T22:46:08.903269] [DEBUG] [LOCAL ] NAZ: Primary data saved (2688 records). [2025-10-23T22:46:08.903412] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-23T22:46:08.903544] [INFO ] [MAIN ] Update Progress: 1449/2367 symbols completed. NAZ took 25.5s. Estimated remaining: 1h 57m 53s. Rate: 7.8 symbols/min [2025-10-23T22:46:09.081205] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:09.103562] [DEBUG] [LOCAL ] NBHC: Loaded 23669 existing records from primary storage. [2025-10-23T22:46:09.103887] [INFO ] [MAIN ] NBHC: Loaded 23669 existing records. [2025-10-23T22:46:09.280770] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:09.280991] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-23T22:46:09.281065] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-23T22:46:09.281300] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-23T22:46:09.281373] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-23T22:46:09.615181] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-23T22:46:09.646419] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:09.653261] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T22:46:10.399434] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-23T22:46:11.199423] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-23T22:46:11.345071] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T22:46:11.550796] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T22:46:11.999399] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-23T22:46:12.048460] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T22:46:12.053405] [INFO ] [REMOTE ] NATL: Full fetch complete (44939 records). [2025-10-23T22:46:12.053529] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-23T22:46:12.472812] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-23T22:46:12.472967] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-23T22:46:12.473912] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-23T22:46:12.474008] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-23T22:46:12.475016] [DEBUG] [LOCAL ] NATL: Trimmed 44939 records to 32261 (keeping 200 days of data) [2025-10-23T22:46:12.657207] [DEBUG] [LOCAL ] NATL: Primary data saved (32261 records). [2025-10-23T22:46:12.657389] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-23T22:46:12.657523] [INFO ] [MAIN ] Update Progress: 1450/2367 symbols completed. NATL took 31.5s. Estimated remaining: 1h 57m 43s. Rate: 7.8 symbols/min [2025-10-23T22:46:12.804527] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-23T22:46:12.832233] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:12.864695] [DEBUG] [LOCAL ] NBR: Loaded 34369 existing records from primary storage. [2025-10-23T22:46:12.864987] [INFO ] [MAIN ] NBR: Loaded 34369 existing records. [2025-10-23T22:46:13.045046] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:13.045325] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-23T22:46:13.045409] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-23T22:46:13.045710] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-23T22:46:13.045782] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-23T22:46:13.441524] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:13.599430] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-23T22:46:13.682018] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T22:46:13.844255] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T22:46:14.362180] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T22:46:14.399450] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-23T22:46:15.199453] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-23T22:46:15.818815] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T22:46:15.999499] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-23T22:46:16.073449] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T22:46:16.799497] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-23T22:46:17.551423] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-23T22:46:17.599408] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-23T22:46:17.784035] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T22:46:18.399431] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-23T22:46:18.426278] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T22:46:19.199439] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-23T22:46:19.631570] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T22:46:19.999418] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-23T22:46:20.304596] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T22:46:20.799449] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-23T22:46:21.601905] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-23T22:46:21.607215] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T22:46:21.616939] [INFO ] [REMOTE ] NAT: Full fetch complete (72214 records). [2025-10-23T22:46:21.617075] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-23T22:46:22.044343] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-23T22:46:22.045113] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-23T22:46:22.045708] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T22:46:22.046950] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-23T22:46:22.052731] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-23T22:46:22.054919] [DEBUG] [LOCAL ] NAT: Trimmed 72214 records to 49578 (keeping 200 days of data) [2025-10-23T22:46:22.334362] [DEBUG] [LOCAL ] NAT: Primary data saved (49578 records). [2025-10-23T22:46:22.334519] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-23T22:46:22.335857] [INFO ] [MAIN ] Update Progress: 1451/2367 symbols completed. NAT took 47.1s. Estimated remaining: 1h 57m 37s. Rate: 7.8 symbols/min [2025-10-23T22:46:22.404541] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-23T22:46:22.508057] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:22.530909] [DEBUG] [LOCAL ] NBXG: Loaded 21680 existing records from primary storage. [2025-10-23T22:46:22.531198] [INFO ] [MAIN ] NBXG: Loaded 21680 existing records. [2025-10-23T22:46:22.709682] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:22.709913] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-23T22:46:22.709990] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-23T22:46:22.710197] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-23T22:46:22.710272] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-23T22:46:23.072952] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:23.128215] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T22:46:23.199397] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-23T22:46:23.516998] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T22:46:23.999406] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-23T22:46:24.588987] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T22:46:24.799438] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-23T22:46:25.154323] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T22:46:25.599464] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-23T22:46:26.317748] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T22:46:26.399419] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-23T22:46:26.617038] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T22:46:26.843017] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T22:46:27.199427] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-23T22:46:27.999459] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-23T22:46:28.413335] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T22:46:28.799447] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-23T22:46:29.028368] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:46:29.604767] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T22:46:29.603884] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-23T22:46:30.399440] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-23T22:46:30.758748] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T22:46:31.199414] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-23T22:46:31.207925] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:46:31.999451] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-23T22:46:32.420249] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-23T22:46:32.799455] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-23T22:46:33.521745] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T22:46:33.599427] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-23T22:46:33.883848] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T22:46:34.399456] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-23T22:46:34.816235] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T22:46:34.821562] [INFO ] [REMOTE ] NBHC: Full fetch complete (33456 records). [2025-10-23T22:46:34.821696] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-23T22:46:35.197633] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-23T22:46:35.197771] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-23T22:46:35.198513] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-23T22:46:35.198594] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-23T22:46:35.199417] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-23T22:46:35.199544] [DEBUG] [LOCAL ] NBHC: Trimmed 33456 records to 23975 (keeping 200 days of data) [2025-10-23T22:46:35.341930] [DEBUG] [LOCAL ] NBHC: Primary data saved (23975 records). [2025-10-23T22:46:35.342073] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-23T22:46:35.342217] [INFO ] [MAIN ] Update Progress: 1452/2367 symbols completed. NBHC took 26.4s. Estimated remaining: 1h 57m 32s. Rate: 7.8 symbols/min [2025-10-23T22:46:35.513977] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:35.529950] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T22:46:35.531912] [DEBUG] [LOCAL ] NC: Loaded 1998 existing records from primary storage. [2025-10-23T22:46:35.537545] [INFO ] [MAIN ] NC: Loaded 1998 existing records. [2025-10-23T22:46:35.714274] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:35.714481] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-23T22:46:35.714555] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-23T22:46:35.714740] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-23T22:46:35.714820] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-23T22:46:36.004552] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-23T22:46:36.073584] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:36.752953] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T22:46:36.799406] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-23T22:46:37.201105] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-23T22:46:37.599444] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-23T22:46:38.343855] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T22:46:38.399460] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-23T22:46:38.708877] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T22:46:39.185167] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T22:46:39.199413] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-23T22:46:39.999447] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-23T22:46:40.070810] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-23T22:46:40.799451] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-23T22:46:41.273962] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T22:46:41.279476] [INFO ] [REMOTE ] NBR: Full fetch complete (49108 records). [2025-10-23T22:46:41.279611] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-23T22:46:41.589433] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T22:46:41.600098] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-23T22:46:41.635699] [INFO ] [REMOTE ] NBB: Full fetch complete (13056 records). [2025-10-23T22:46:41.671175] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-23T22:46:41.690927] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-23T22:46:41.696737] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-23T22:46:41.742746] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-23T22:46:41.773992] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-23T22:46:41.831405] [DEBUG] [LOCAL ] NBR: Trimmed 49108 records to 34642 (keeping 200 days of data) [2025-10-23T22:46:42.133266] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T22:46:42.253474] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-23T22:46:42.253621] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-23T22:46:42.254204] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-23T22:46:42.291408] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-23T22:46:42.325482] [DEBUG] [LOCAL ] NBB: Trimmed 13056 records to 9081 (keeping 200 days of data) [2025-10-23T22:46:42.370345] [DEBUG] [LOCAL ] NBR: Primary data saved (34642 records). [2025-10-23T22:46:42.382993] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-23T22:46:42.393225] [INFO ] [MAIN ] Update Progress: 1453/2367 symbols completed. NBR took 29.7s. Estimated remaining: 1h 57m 24s. Rate: 7.8 symbols/min [2025-10-23T22:46:42.398775] [DEBUG] [LOCAL ] NBB: Primary data saved (9081 records). [2025-10-23T22:46:42.404603] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-23T22:46:42.404691] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-23T22:46:42.465944] [INFO ] [MAIN ] Update Progress: 1454/2367 symbols completed. NBB took 39.7s. Estimated remaining: 1h 57m 12s. Rate: 7.8 symbols/min [2025-10-23T22:46:42.691758] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:42.755435] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:42.760877] [DEBUG] [LOCAL ] NCA: Loaded 9773 existing records from primary storage. [2025-10-23T22:46:42.761138] [INFO ] [MAIN ] NCA: Loaded 9773 existing records. [2025-10-23T22:46:42.952304] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:42.959576] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-23T22:46:42.959730] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-23T22:46:42.960112] [DEBUG] [LOCAL ] NCDL: Loaded 21597 existing records from primary storage. [2025-10-23T22:46:42.960443] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-23T22:46:42.960713] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-23T22:46:42.960602] [INFO ] [MAIN ] NCDL: Loaded 21597 existing records. [2025-10-23T22:46:43.012169] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T22:46:43.204145] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-23T22:46:43.318222] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:43.319811] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-23T22:46:43.319902] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-23T22:46:43.320686] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-23T22:46:43.372477] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-23T22:46:43.654677] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:43.897295] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:43.945430] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T22:46:43.999416] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-23T22:46:44.322240] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-23T22:46:44.799478] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-23T22:46:45.599442] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-23T22:46:45.955402] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T22:46:46.399473] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-23T22:46:46.735825] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T22:46:47.059615] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T22:46:47.199466] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-23T22:46:47.999483] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-23T22:46:48.223071] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T22:46:48.799486] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-23T22:46:49.340439] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T22:46:49.599434] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-23T22:46:49.891503] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T22:46:50.399436] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-23T22:46:50.642970] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T22:46:50.907671] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-23T22:46:51.199421] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-23T22:46:51.999414] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-23T22:46:52.358025] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T22:46:52.383805] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-23T22:46:52.799419] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-23T22:46:53.339885] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T22:46:53.599413] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-23T22:46:54.399408] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-23T22:46:54.616624] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T22:46:55.199410] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-23T22:46:55.565581] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T22:46:55.999471] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-23T22:46:56.215987] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T22:46:56.219933] [INFO ] [REMOTE ] NBXG: Full fetch complete (32481 records). [2025-10-23T22:46:56.220048] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-23T22:46:56.590728] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-23T22:46:56.590847] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-23T22:46:56.591572] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-23T22:46:56.591680] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-23T22:46:56.592472] [DEBUG] [LOCAL ] NBXG: Trimmed 32481 records to 21773 (keeping 200 days of data) [2025-10-23T22:46:56.725760] [DEBUG] [LOCAL ] NBXG: Primary data saved (21773 records). [2025-10-23T22:46:56.725915] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-23T22:46:56.726032] [INFO ] [MAIN ] Update Progress: 1455/2367 symbols completed. NBXG took 34.4s. Estimated remaining: 1h 57m 8s. Rate: 7.8 symbols/min [2025-10-23T22:46:56.806137] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-23T22:46:56.836504] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T22:46:56.911144] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:56.960763] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-23T22:46:56.961133] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-10-23T22:46:57.139932] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:57.140194] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-23T22:46:57.140276] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-23T22:46:57.140561] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-10-23T22:46:57.140683] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-23T22:46:57.404159] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T22:46:57.429288] [INFO ] [REMOTE ] NC: Full fetch complete (2764 records). [2025-10-23T22:46:57.431717] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-23T22:46:57.605743] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-23T22:46:57.625671] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:57.876820] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-23T22:46:57.876930] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-23T22:46:57.877088] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-23T22:46:57.877163] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-23T22:46:57.877545] [DEBUG] [LOCAL ] NC: Trimmed 2764 records to 2009 (keeping 200 days of data) [2025-10-23T22:46:57.889893] [DEBUG] [LOCAL ] NC: Primary data saved (2009 records). [2025-10-23T22:46:57.889977] [INFO ] [MAIN ] NC: Full history saved. [2025-10-23T22:46:57.890094] [INFO ] [MAIN ] Update Progress: 1456/2367 symbols completed. NC took 22.5s. Estimated remaining: 1h 56m 56s. Rate: 7.8 symbols/min [2025-10-23T22:46:58.058944] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:46:58.074491] [DEBUG] [LOCAL ] NCV: Loaded 13884 existing records from primary storage. [2025-10-23T22:46:58.074784] [INFO ] [MAIN ] NCV: Loaded 13884 existing records. [2025-10-23T22:46:58.252368] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:46:58.252610] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-23T22:46:58.252705] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-23T22:46:58.252911] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-23T22:46:58.252985] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-23T22:46:58.401421] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-23T22:46:58.618901] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:46:58.724018] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T22:46:59.199443] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-23T22:46:59.999432] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-23T22:47:00.451586] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T22:47:00.594546] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T22:47:00.799430] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-23T22:47:00.811618] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T22:47:01.035200] [DEBUG] [REMOTE ] NCV: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-23T22:47:01.035518] [WARN ] [REMOTE ] NCV: No data returned for month 2025-02 [2025-10-23T22:47:01.035604] [FATAL] [REMOTE ] NCV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:47:01.035722] [FATAL] [MAIN ] NCV: Failed to fetch primary data. [2025-10-23T22:47:01.035792] [WARN ] [MAIN ] NCV: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:47:01.035867] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-23T22:47:01.035957] [DEBUG] [LOCAL ] NCV: No primary data file found to delete. [2025-10-23T22:47:01.036029] [INFO ] [LOCAL ] NCV: Starting deletion of derivative data. [2025-10-23T22:47:01.036184] [DEBUG] [LOCAL ] NCV: Deleted derivative data file. [2025-10-23T22:47:01.036285] [INFO ] [MAIN ] Update Progress: 1457/2367 symbols completed. NCV took 3.1s. Estimated remaining: 1h 56m 46s. Rate: 7.8 symbols/min [2025-10-23T22:47:01.208798] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:01.223202] [DEBUG] [LOCAL ] NCZ: Loaded 12268 existing records from primary storage. [2025-10-23T22:47:01.223515] [INFO ] [MAIN ] NCZ: Loaded 12268 existing records. [2025-10-23T22:47:01.406091] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:01.406366] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-23T22:47:01.406442] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-23T22:47:01.406703] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-23T22:47:01.406774] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-23T22:47:01.604556] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-23T22:47:01.778030] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:02.399462] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-23T22:47:03.199410] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-23T22:47:03.536155] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T22:47:03.702435] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-23T22:47:03.730976] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T22:47:03.999457] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-23T22:47:04.799406] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-23T22:47:05.041093] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T22:47:05.599428] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-23T22:47:05.696147] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T22:47:06.399438] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-23T22:47:07.100307] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T22:47:07.191520] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T22:47:07.199409] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-23T22:47:07.999461] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-23T22:47:08.329499] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T22:47:08.799470] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-23T22:47:08.856358] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T22:47:09.599520] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-23T22:47:09.911277] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:47:10.377031] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T22:47:10.399431] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-23T22:47:11.199432] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-23T22:47:11.311927] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T22:47:11.999447] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-23T22:47:12.799405] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-23T22:47:13.184493] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T22:47:13.189270] [INFO ] [REMOTE ] NCDL: Full fetch complete (32976 records). [2025-10-23T22:47:13.189371] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-23T22:47:13.597261] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-23T22:47:13.597420] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-23T22:47:13.598680] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-23T22:47:13.598834] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-23T22:47:13.606185] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-23T22:47:13.609074] [DEBUG] [LOCAL ] NCDL: Trimmed 32976 records to 21793 (keeping 200 days of data) [2025-10-23T22:47:13.612011] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T22:47:13.753379] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-23T22:47:13.800368] [DEBUG] [LOCAL ] NCDL: Primary data saved (21793 records). [2025-10-23T22:47:13.800519] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-23T22:47:13.800631] [INFO ] [MAIN ] Update Progress: 1458/2367 symbols completed. NCDL took 31.3s. Estimated remaining: 1h 56m 41s. Rate: 7.8 symbols/min [2025-10-23T22:47:13.968685] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:13.984636] [DEBUG] [LOCAL ] NDMO: Loaded 16956 existing records from primary storage. [2025-10-23T22:47:13.984972] [INFO ] [MAIN ] NDMO: Loaded 16956 existing records. [2025-10-23T22:47:14.183615] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:14.183850] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-23T22:47:14.183923] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-23T22:47:14.184134] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-23T22:47:14.184203] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-23T22:47:14.404617] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-23T22:47:14.548253] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:14.604958] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-23T22:47:15.115485] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T22:47:15.117179] [INFO ] [REMOTE ] NCA: Full fetch complete (14253 records). [2025-10-23T22:47:15.117294] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-23T22:47:15.204663] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-23T22:47:15.487409] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-23T22:47:15.487526] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-23T22:47:15.487953] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-23T22:47:15.488222] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-23T22:47:15.488792] [DEBUG] [LOCAL ] NCA: Trimmed 14253 records to 9801 (keeping 200 days of data) [2025-10-23T22:47:15.545758] [DEBUG] [LOCAL ] NCA: Primary data saved (9801 records). [2025-10-23T22:47:15.545921] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-23T22:47:15.546036] [INFO ] [MAIN ] Update Progress: 1459/2367 symbols completed. NCA took 33.1s. Estimated remaining: 1h 56m 30s. Rate: 7.8 symbols/min [2025-10-23T22:47:15.722324] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:15.768847] [DEBUG] [LOCAL ] NE: Loaded 52301 existing records from primary storage. [2025-10-23T22:47:15.769205] [INFO ] [MAIN ] NE: Loaded 52301 existing records. [2025-10-23T22:47:15.945930] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:15.946196] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-23T22:47:15.946274] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-23T22:47:15.946497] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-23T22:47:15.946568] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-23T22:47:16.004626] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-23T22:47:16.328103] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:16.799448] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-23T22:47:17.005675] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T22:47:17.432688] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-23T22:47:17.599407] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-23T22:47:17.623539] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T22:47:18.399459] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-23T22:47:19.034565] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-23T22:47:19.199422] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-23T22:47:19.411526] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T22:47:19.786054] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T22:47:19.999446] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-23T22:47:20.775358] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T22:47:20.799393] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-23T22:47:21.599423] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-23T22:47:21.698669] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T22:47:22.399488] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-23T22:47:23.199443] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-23T22:47:23.471294] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T22:47:23.474948] [INFO ] [REMOTE ] NCZ: Full fetch complete (20975 records). [2025-10-23T22:47:23.475067] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-23T22:47:23.877689] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-23T22:47:23.887752] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-23T22:47:23.906478] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-23T22:47:23.906606] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-23T22:47:23.911407] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-23T22:47:23.911687] [DEBUG] [LOCAL ] NCZ: Trimmed 20975 records to 12391 (keeping 200 days of data) [2025-10-23T22:47:23.999960] [DEBUG] [LOCAL ] NCZ: Primary data saved (12391 records). [2025-10-23T22:47:24.000038] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-23T22:47:24.000484] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-23T22:47:24.001608] [INFO ] [MAIN ] Update Progress: 1460/2367 symbols completed. NCZ took 23.0s. Estimated remaining: 1h 56m 23s. Rate: 7.8 symbols/min [2025-10-23T22:47:24.187248] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T22:47:24.189010] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:24.227018] [DEBUG] [LOCAL ] NEA: Loaded 35122 existing records from primary storage. [2025-10-23T22:47:24.227355] [INFO ] [MAIN ] NEA: Loaded 35122 existing records. [2025-10-23T22:47:24.403145] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:24.403368] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-23T22:47:24.403444] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-23T22:47:24.403710] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-23T22:47:24.403786] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-23T22:47:24.761708] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:24.799411] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-23T22:47:25.599478] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-23T22:47:26.237071] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-23T22:47:26.406184] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-23T22:47:26.408101] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-23T22:47:26.449063] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T22:47:27.199466] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-23T22:47:27.999471] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-23T22:47:28.266341] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-23T22:47:28.545713] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-23T22:47:28.799433] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-23T22:47:29.599432] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-23T22:47:29.654509] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T22:47:29.739877] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:47:30.399411] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-23T22:47:31.025555] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T22:47:31.199478] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-23T22:47:31.862063] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T22:47:31.949592] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T22:47:31.959062] [INFO ] [REMOTE ] NCLH: Full fetch complete (77933 records). [2025-10-23T22:47:31.959219] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-23T22:47:32.004574] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-23T22:47:32.349547] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-10-23T22:47:32.349688] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-10-23T22:47:32.350846] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-10-23T22:47:32.350926] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-10-23T22:47:32.352437] [DEBUG] [LOCAL ] NCLH: Trimmed 77933 records to 54143 (keeping 200 days of data) [2025-10-23T22:47:32.677210] [DEBUG] [LOCAL ] NCLH: Primary data saved (54143 records). [2025-10-23T22:47:32.677372] [INFO ] [MAIN ] NCLH: Full history saved. [2025-10-23T22:47:32.677498] [INFO ] [MAIN ] Update Progress: 1461/2367 symbols completed. NCLH took 36.0s. Estimated remaining: 1h 56m 15s. Rate: 7.8 symbols/min [2025-10-23T22:47:32.804630] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-23T22:47:32.850260] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:32.897022] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-23T22:47:32.897423] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-10-23T22:47:33.087278] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:33.089451] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-23T22:47:33.089204] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T22:47:33.089777] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-23T22:47:33.094302] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-10-23T22:47:33.094391] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-23T22:47:33.445431] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:33.599423] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-23T22:47:33.890681] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-23T22:47:34.399495] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-23T22:47:35.199472] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-23T22:47:35.217694] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T22:47:35.690256] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-23T22:47:35.999498] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-23T22:47:36.799426] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-23T22:47:37.094353] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T22:47:37.599425] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-23T22:47:38.048492] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-23T22:47:38.120518] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T22:47:38.399424] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-23T22:47:39.199477] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-23T22:47:39.391486] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T22:47:39.493459] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T22:47:39.999434] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-23T22:47:40.551762] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T22:47:40.799448] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-23T22:47:41.405506] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T22:47:41.599418] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-23T22:47:41.841392] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T22:47:42.399438] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-23T22:47:43.015919] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T22:47:43.199464] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-23T22:47:43.984755] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T22:47:43.999418] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-23T22:47:44.551700] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T22:47:44.799435] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-23T22:47:45.599431] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-23T22:47:45.916048] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T22:47:45.968747] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T22:47:46.399449] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-23T22:47:46.698012] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T22:47:47.199438] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-23T22:47:47.838397] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T22:47:47.999417] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-23T22:47:48.201374] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T22:47:48.204437] [INFO ] [REMOTE ] NDMO: Full fetch complete (23329 records). [2025-10-23T22:47:48.204540] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-23T22:47:48.590034] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-23T22:47:48.590140] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-23T22:47:48.590682] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-23T22:47:48.590759] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-23T22:47:48.591470] [DEBUG] [LOCAL ] NDMO: Trimmed 23329 records to 17101 (keeping 200 days of data) [2025-10-23T22:47:48.692925] [DEBUG] [LOCAL ] NDMO: Primary data saved (17101 records). [2025-10-23T22:47:48.693064] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-23T22:47:48.693174] [INFO ] [MAIN ] Update Progress: 1462/2367 symbols completed. NDMO took 34.9s. Estimated remaining: 1h 56m 13s. Rate: 7.8 symbols/min [2025-10-23T22:47:48.804572] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-23T22:47:48.864071] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:48.910201] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-23T22:47:48.910537] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-10-23T22:47:49.086558] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:49.086817] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-23T22:47:49.086894] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-23T22:47:49.087275] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-10-23T22:47:49.087352] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-23T22:47:49.457236] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:49.458782] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T22:47:49.464632] [INFO ] [REMOTE ] NEA: Full fetch complete (50953 records). [2025-10-23T22:47:49.464774] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-23T22:47:49.604559] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-23T22:47:49.843055] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-23T22:47:49.843167] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-23T22:47:49.844131] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-23T22:47:49.844212] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-23T22:47:49.845278] [DEBUG] [LOCAL ] NEA: Trimmed 50953 records to 35402 (keeping 200 days of data) [2025-10-23T22:47:50.062531] [DEBUG] [LOCAL ] NEA: Primary data saved (35402 records). [2025-10-23T22:47:50.063098] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-23T22:47:50.063245] [INFO ] [MAIN ] Update Progress: 1463/2367 symbols completed. NEA took 26.1s. Estimated remaining: 1h 56m 1s. Rate: 7.8 symbols/min [2025-10-23T22:47:50.229626] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:47:50.279089] [DEBUG] [LOCAL ] NET: Loaded 52801 existing records from primary storage. [2025-10-23T22:47:50.279435] [INFO ] [MAIN ] NET: Loaded 52801 existing records. [2025-10-23T22:47:50.404753] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-23T22:47:50.456898] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:47:50.457301] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-23T22:47:50.457378] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-23T22:47:50.458108] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-23T22:47:50.458186] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-23T22:47:50.817156] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:47:50.994346] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-23T22:47:51.199424] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-23T22:47:51.475625] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T22:47:51.999460] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-23T22:47:52.567475] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-23T22:47:52.799438] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-23T22:47:53.377579] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-23T22:47:53.599425] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-23T22:47:53.916209] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T22:47:54.399417] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-23T22:47:54.911048] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-23T22:47:55.199466] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-23T22:47:55.532226] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T22:47:55.999439] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-23T22:47:56.403776] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T22:47:56.799429] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-23T22:47:56.990940] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T22:47:57.599422] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-23T22:47:58.273395] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-23T22:47:58.399409] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-23T22:47:58.994841] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T22:47:59.114669] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T22:47:59.199502] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-23T22:47:59.999490] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-23T22:48:00.623352] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-23T22:48:00.799410] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-23T22:48:00.990058] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T22:48:00.999098] [INFO ] [REMOTE ] NE: Full fetch complete (75754 records). [2025-10-23T22:48:00.999282] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-23T22:48:01.391983] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-23T22:48:01.392092] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-23T22:48:01.393157] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-23T22:48:01.393235] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-23T22:48:01.394676] [DEBUG] [LOCAL ] NE: Trimmed 75754 records to 52682 (keeping 200 days of data) [2025-10-23T22:48:01.609427] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-23T22:48:01.721194] [DEBUG] [LOCAL ] NE: Primary data saved (52682 records). [2025-10-23T22:48:01.721361] [INFO ] [MAIN ] NE: Full history saved. [2025-10-23T22:48:01.721473] [INFO ] [MAIN ] Update Progress: 1464/2367 symbols completed. NE took 46.2s. Estimated remaining: 1h 55m 56s. Rate: 7.8 symbols/min [2025-10-23T22:48:01.898205] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:01.912839] [DEBUG] [LOCAL ] NEU: Loaded 8614 existing records from primary storage. [2025-10-23T22:48:01.913177] [INFO ] [MAIN ] NEU: Loaded 8614 existing records. [2025-10-23T22:48:02.100610] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:02.101012] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-23T22:48:02.101232] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-23T22:48:02.101491] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-23T22:48:02.101720] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-23T22:48:02.419970] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-23T22:48:02.469631] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-23T22:48:02.544085] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:03.111179] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-23T22:48:03.199458] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-23T22:48:03.435833] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T22:48:03.980765] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T22:48:03.999452] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-23T22:48:04.499587] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T22:48:04.799452] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-23T22:48:05.532284] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:48:05.599450] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-23T22:48:05.995467] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T22:48:06.094561] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-23T22:48:06.399453] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-23T22:48:07.100031] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T22:48:07.199438] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-23T22:48:07.917076] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T22:48:07.999438] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-23T22:48:08.799432] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-23T22:48:09.061839] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T22:48:09.599449] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-23T22:48:10.331714] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:48:10.341157] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-23T22:48:10.341332] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-23T22:48:10.404838] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-23T22:48:10.736981] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-23T22:48:10.737114] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-23T22:48:10.738334] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-23T22:48:10.738430] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-23T22:48:10.739885] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 54097 (keeping 200 days of data) [2025-10-23T22:48:11.094362] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-23T22:48:11.113443] [DEBUG] [LOCAL ] NEE: Primary data saved (54097 records). [2025-10-23T22:48:11.113920] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-23T22:48:11.115544] [INFO ] [MAIN ] Update Progress: 1465/2367 symbols completed. NEE took 38.4s. Estimated remaining: 1h 55m 49s. Rate: 7.8 symbols/min [2025-10-23T22:48:11.204556] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-23T22:48:11.284775] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:11.292895] [DEBUG] [LOCAL ] NEXA: Loaded 5704 existing records from primary storage. [2025-10-23T22:48:11.293145] [INFO ] [MAIN ] NEXA: Loaded 5704 existing records. [2025-10-23T22:48:11.464814] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:11.465090] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-23T22:48:11.465167] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-23T22:48:11.465341] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-23T22:48:11.465415] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-23T22:48:11.816175] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:11.894190] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T22:48:11.999434] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-23T22:48:12.705877] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T22:48:12.794473] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-23T22:48:12.805314] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-23T22:48:13.390068] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T22:48:13.599485] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-23T22:48:14.399472] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-23T22:48:15.199867] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T22:48:15.199671] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-23T22:48:15.202957] [INFO ] [REMOTE ] NEU: Full fetch complete (10843 records). [2025-10-23T22:48:15.203055] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-23T22:48:15.572546] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-23T22:48:15.572727] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-23T22:48:15.573158] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-23T22:48:15.573361] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-23T22:48:15.574109] [DEBUG] [LOCAL ] NEU: Trimmed 10843 records to 8671 (keeping 200 days of data) [2025-10-23T22:48:15.652767] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T22:48:15.676288] [DEBUG] [LOCAL ] NEU: Primary data saved (8671 records). [2025-10-23T22:48:15.676486] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-23T22:48:15.676987] [INFO ] [MAIN ] Update Progress: 1466/2367 symbols completed. NEU took 14.0s. Estimated remaining: 1h 55m 40s. Rate: 7.8 symbols/min [2025-10-23T22:48:15.843417] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:15.883973] [DEBUG] [LOCAL ] NFG: Loaded 38254 existing records from primary storage. [2025-10-23T22:48:15.884336] [INFO ] [MAIN ] NFG: Loaded 38254 existing records. [2025-10-23T22:48:16.004522] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-23T22:48:16.066284] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:16.066561] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-23T22:48:16.066682] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-23T22:48:16.066945] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-23T22:48:16.067036] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-23T22:48:16.412147] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:16.799475] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-23T22:48:16.824942] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-23T22:48:17.440233] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-23T22:48:17.599468] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-23T22:48:18.194213] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T22:48:18.399420] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-23T22:48:18.634150] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-23T22:48:19.199451] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-23T22:48:19.999449] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-23T22:48:20.486455] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-23T22:48:20.729992] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T22:48:20.799448] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-23T22:48:21.599446] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-23T22:48:22.348975] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-23T22:48:22.386543] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T22:48:22.399397] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-23T22:48:23.199466] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-23T22:48:23.904275] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-23T22:48:23.999410] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-23T22:48:24.042164] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T22:48:24.051408] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-23T22:48:24.052032] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-23T22:48:24.209483] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T22:48:24.497535] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-23T22:48:24.497670] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-23T22:48:24.498795] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-23T22:48:24.498874] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-23T22:48:24.500438] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 54098 (keeping 200 days of data) [2025-10-23T22:48:24.592133] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T22:48:24.808160] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-23T22:48:24.835127] [DEBUG] [LOCAL ] NEM: Primary data saved (54098 records). [2025-10-23T22:48:24.835259] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-23T22:48:24.835373] [INFO ] [MAIN ] Update Progress: 1467/2367 symbols completed. NEM took 36.1s. Estimated remaining: 1h 55m 33s. Rate: 7.8 symbols/min [2025-10-23T22:48:25.007897] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:25.027977] [DEBUG] [LOCAL ] NFJ: Loaded 19717 existing records from primary storage. [2025-10-23T22:48:25.028260] [INFO ] [MAIN ] NFJ: Loaded 19717 existing records. [2025-10-23T22:48:25.208038] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:25.208267] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-23T22:48:25.208348] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-23T22:48:25.208550] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-23T22:48:25.208623] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-23T22:48:25.588316] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:25.599400] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-23T22:48:26.127776] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-23T22:48:26.253163] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T22:48:26.399437] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-23T22:48:27.199445] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-23T22:48:27.866813] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T22:48:27.999416] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-23T22:48:28.572312] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T22:48:28.616313] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T22:48:28.799417] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-23T22:48:29.599433] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-23T22:48:29.971310] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T22:48:30.209085] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T22:48:30.399478] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-23T22:48:31.199445] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-23T22:48:31.660112] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T22:48:31.688753] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-23T22:48:31.999481] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-23T22:48:32.434633] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-23T22:48:32.799447] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-23T22:48:33.599450] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-23T22:48:34.368988] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T22:48:34.399413] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-23T22:48:34.479857] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T22:48:34.483119] [INFO ] [REMOTE ] NEXA: Full fetch complete (8015 records). [2025-10-23T22:48:34.483216] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-23T22:48:34.847908] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-23T22:48:34.848052] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-23T22:48:34.848328] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-23T22:48:34.848404] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-23T22:48:34.848902] [DEBUG] [LOCAL ] NEXA: Trimmed 8015 records to 5766 (keeping 200 days of data) [2025-10-23T22:48:34.879878] [DEBUG] [LOCAL ] NEXA: Primary data saved (5766 records). [2025-10-23T22:48:34.880004] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-23T22:48:34.880114] [INFO ] [MAIN ] Update Progress: 1468/2367 symbols completed. NEXA took 23.8s. Estimated remaining: 1h 55m 27s. Rate: 7.8 symbols/min [2025-10-23T22:48:35.045605] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:35.089685] [DEBUG] [LOCAL ] NGG: Loaded 46767 existing records from primary storage. [2025-10-23T22:48:35.090042] [INFO ] [MAIN ] NGG: Loaded 46767 existing records. [2025-10-23T22:48:35.204517] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-23T22:48:35.278798] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:35.279060] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-23T22:48:35.279147] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-23T22:48:35.279419] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-23T22:48:35.279501] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-23T22:48:35.636162] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:35.999425] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-23T22:48:36.232716] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T22:48:36.495518] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-23T22:48:36.799447] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-23T22:48:37.364598] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-23T22:48:37.599411] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-23T22:48:37.984595] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T22:48:38.399435] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-23T22:48:39.199462] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-23T22:48:39.549011] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T22:48:39.955168] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-23T22:48:39.964284] [INFO ] [REMOTE ] NET: Full fetch complete (76841 records). [2025-10-23T22:48:39.964491] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-23T22:48:40.006823] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-23T22:48:40.355930] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-23T22:48:40.356072] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-23T22:48:40.357205] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-23T22:48:40.357304] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-23T22:48:40.358824] [DEBUG] [LOCAL ] NET: Trimmed 76841 records to 53162 (keeping 200 days of data) [2025-10-23T22:48:40.675673] [DEBUG] [LOCAL ] NET: Primary data saved (53162 records). [2025-10-23T22:48:40.675924] [INFO ] [MAIN ] NET: Full history saved. [2025-10-23T22:48:40.676062] [INFO ] [MAIN ] Update Progress: 1469/2367 symbols completed. NET took 50.6s. Estimated remaining: 1h 55m 18s. Rate: 7.8 symbols/min [2025-10-23T22:48:40.803844] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-23T22:48:40.873582] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:40.875958] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T22:48:40.910723] [DEBUG] [LOCAL ] NGL: Loaded 29896 existing records from primary storage. [2025-10-23T22:48:40.911047] [INFO ] [MAIN ] NGL: Loaded 29896 existing records. [2025-10-23T22:48:41.084700] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:41.084909] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-23T22:48:41.084981] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-23T22:48:41.085187] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-23T22:48:41.085258] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-23T22:48:41.434354] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:41.533527] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T22:48:41.599403] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-23T22:48:41.942014] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-23T22:48:42.399431] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-23T22:48:42.732248] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T22:48:43.199413] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-23T22:48:43.419211] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T22:48:43.999440] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-23T22:48:44.403740] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T22:48:44.799425] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-23T22:48:45.096110] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T22:48:45.599439] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-23T22:48:46.399426] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-23T22:48:46.518771] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T22:48:47.040353] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T22:48:47.199417] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-23T22:48:47.512277] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T22:48:47.999435] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-23T22:48:48.799456] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-23T22:48:49.215163] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T22:48:49.599494] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-23T22:48:49.943365] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-23T22:48:50.031866] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-23T22:48:50.399441] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-23T22:48:51.199429] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-23T22:48:51.226165] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T22:48:51.999411] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-23T22:48:52.233512] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T22:48:52.238827] [INFO ] [REMOTE ] NFJ: Full fetch complete (29456 records). [2025-10-23T22:48:52.238996] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-23T22:48:52.369905] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T22:48:52.646042] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-23T22:48:52.646152] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-23T22:48:52.646819] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-23T22:48:52.646898] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-23T22:48:52.647759] [DEBUG] [LOCAL ] NFJ: Trimmed 29456 records to 19799 (keeping 200 days of data) [2025-10-23T22:48:52.762082] [DEBUG] [LOCAL ] NFJ: Primary data saved (19799 records). [2025-10-23T22:48:52.762246] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-23T22:48:52.762357] [INFO ] [MAIN ] Update Progress: 1470/2367 symbols completed. NFJ took 27.9s. Estimated remaining: 1h 55m 13s. Rate: 7.8 symbols/min [2025-10-23T22:48:52.805314] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-23T22:48:52.935271] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:52.947320] [DEBUG] [LOCAL ] NGS: Loaded 10875 existing records from primary storage. [2025-10-23T22:48:52.947564] [INFO ] [MAIN ] NGS: Loaded 10875 existing records. [2025-10-23T22:48:53.127025] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:53.127247] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-23T22:48:53.127320] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-23T22:48:53.127527] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-23T22:48:53.127605] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-23T22:48:53.491208] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:53.509583] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T22:48:53.516500] [INFO ] [REMOTE ] NFG: Full fetch complete (57248 records). [2025-10-23T22:48:53.516616] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-23T22:48:53.604526] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-23T22:48:53.907344] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-23T22:48:53.907454] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-23T22:48:53.908395] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-23T22:48:53.908475] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-23T22:48:53.909551] [DEBUG] [LOCAL ] NFG: Trimmed 57248 records to 38484 (keeping 200 days of data) [2025-10-23T22:48:54.019446] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T22:48:54.167382] [DEBUG] [LOCAL ] NFG: Primary data saved (38484 records). [2025-10-23T22:48:54.167555] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-23T22:48:54.167693] [INFO ] [MAIN ] Update Progress: 1471/2367 symbols completed. NFG took 38.5s. Estimated remaining: 1h 55m 1s. Rate: 7.8 symbols/min [2025-10-23T22:48:54.332153] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:48:54.352401] [DEBUG] [LOCAL ] NGVC: Loaded 22759 existing records from primary storage. [2025-10-23T22:48:54.352700] [INFO ] [MAIN ] NGVC: Loaded 22759 existing records. [2025-10-23T22:48:54.406054] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-23T22:48:54.529917] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:48:54.530164] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-23T22:48:54.530246] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-23T22:48:54.530518] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-23T22:48:54.530590] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-23T22:48:54.895073] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:48:54.956817] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T22:48:55.199447] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-23T22:48:55.898684] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T22:48:55.999458] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-23T22:48:56.201296] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T22:48:56.799412] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-23T22:48:56.880638] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-23T22:48:57.599502] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-23T22:48:57.933896] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T22:48:58.399441] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-23T22:48:58.764838] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T22:48:59.199475] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-23T22:48:59.427966] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T22:48:59.999492] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-23T22:49:00.805018] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-23T22:49:00.823106] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T22:49:01.335970] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T22:49:01.599441] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-23T22:49:02.155529] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T22:49:02.399466] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-23T22:49:03.012353] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T22:49:03.203823] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-23T22:49:03.206524] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-23T22:49:03.999414] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-23T22:49:04.368963] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T22:49:04.373796] [INFO ] [REMOTE ] NGL: Full fetch complete (41681 records). [2025-10-23T22:49:04.373933] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-23T22:49:04.766854] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-23T22:49:04.767021] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-23T22:49:04.768326] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-23T22:49:04.768413] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-23T22:49:04.770060] [DEBUG] [LOCAL ] NGL: Trimmed 41681 records to 30035 (keeping 200 days of data) [2025-10-23T22:49:04.813607] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-23T22:49:04.954616] [DEBUG] [LOCAL ] NGL: Primary data saved (30035 records). [2025-10-23T22:49:04.954894] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-23T22:49:04.955037] [INFO ] [MAIN ] Update Progress: 1472/2367 symbols completed. NGL took 24.3s. Estimated remaining: 1h 54m 55s. Rate: 7.8 symbols/min [2025-10-23T22:49:05.140870] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:05.157178] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T22:49:05.182350] [DEBUG] [LOCAL ] NGVT: Loaded 23771 existing records from primary storage. [2025-10-23T22:49:05.182830] [INFO ] [MAIN ] NGVT: Loaded 23771 existing records. [2025-10-23T22:49:05.378488] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:49:05.378823] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-23T22:49:05.378907] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-23T22:49:05.379265] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-23T22:49:05.379343] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-23T22:49:05.604727] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-23T22:49:05.762105] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:49:06.391960] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T22:49:06.401595] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-23T22:49:06.664949] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:49:07.199426] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-23T22:49:07.448618] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T22:49:07.815215] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T22:49:07.999449] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-23T22:49:08.799419] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-23T22:49:08.831305] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T22:49:09.599437] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-23T22:49:10.399441] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-23T22:49:10.430495] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T22:49:10.760530] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T22:49:11.199407] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-23T22:49:11.278682] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T22:49:11.999435] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-23T22:49:12.728262] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T22:49:12.799418] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-23T22:49:12.900264] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T22:49:13.599437] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-23T22:49:13.619127] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T22:49:14.399473] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-23T22:49:14.746213] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T22:49:15.199472] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-23T22:49:15.999409] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-23T22:49:16.056789] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T22:49:16.065620] [INFO ] [REMOTE ] NGG: Full fetch complete (66706 records). [2025-10-23T22:49:16.065819] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-23T22:49:16.488173] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-23T22:49:16.489086] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-23T22:49:16.490550] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-23T22:49:16.490753] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-23T22:49:16.510062] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T22:49:16.510891] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-23T22:49:16.518871] [INFO ] [REMOTE ] NGS: Full fetch complete (16591 records). [2025-10-23T22:49:16.519260] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-23T22:49:16.519732] [DEBUG] [LOCAL ] NGG: Trimmed 66706 records to 47110 (keeping 200 days of data) [2025-10-23T22:49:16.810084] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-23T22:49:17.127225] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-23T22:49:17.130707] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-23T22:49:17.136510] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-23T22:49:17.136702] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-23T22:49:17.153857] [DEBUG] [LOCAL ] NGS: Trimmed 16591 records to 10918 (keeping 200 days of data) [2025-10-23T22:49:17.223615] [DEBUG] [LOCAL ] NGG: Primary data saved (47110 records). [2025-10-23T22:49:17.241433] [DEBUG] [LOCAL ] NGS: Primary data saved (10918 records). [2025-10-23T22:49:17.241537] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-23T22:49:17.238167] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-23T22:49:17.242895] [INFO ] [MAIN ] Update Progress: 1473/2367 symbols completed. NGG took 42.4s. Estimated remaining: 1h 54m 50s. Rate: 7.8 symbols/min [2025-10-23T22:49:17.243184] [INFO ] [MAIN ] Update Progress: 1474/2367 symbols completed. NGS took 24.5s. Estimated remaining: 1h 54m 38s. Rate: 7.8 symbols/min [2025-10-23T22:49:17.563873] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:17.582047] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:17.603475] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-23T22:49:17.606399] [DEBUG] [LOCAL ] NHI: Loaded 21900 existing records from primary storage. [2025-10-23T22:49:17.619805] [INFO ] [MAIN ] NHI: Loaded 21900 existing records. [2025-10-23T22:49:17.764742] [DEBUG] [LOCAL ] NI: Loaded 53408 existing records from primary storage. [2025-10-23T22:49:17.801244] [INFO ] [MAIN ] NI: Loaded 53408 existing records. [2025-10-23T22:49:17.864980] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:49:17.892433] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-23T22:49:17.898211] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-23T22:49:17.914137] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-23T22:49:17.921739] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-23T22:49:18.126458] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:49:18.188698] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-23T22:49:18.188834] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-23T22:49:18.220605] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-10-23T22:49:18.227345] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-23T22:49:18.554334] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:49:18.600937] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-23T22:49:18.630019] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T22:49:18.796571] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:49:18.900574] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-23T22:49:19.199454] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-23T22:49:19.999444] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-23T22:49:20.045771] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-23T22:49:20.128618] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-23T22:49:20.799433] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-23T22:49:21.599419] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-23T22:49:21.785970] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T22:49:22.048594] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T22:49:22.399415] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-23T22:49:22.667168] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T22:49:22.671195] [INFO ] [REMOTE ] NGVC: Full fetch complete (31122 records). [2025-10-23T22:49:22.671333] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-23T22:49:23.035115] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-23T22:49:23.035243] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-23T22:49:23.036003] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-23T22:49:23.036100] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-23T22:49:23.036906] [DEBUG] [LOCAL ] NGVC: Trimmed 31122 records to 22904 (keeping 200 days of data) [2025-10-23T22:49:23.171970] [DEBUG] [LOCAL ] NGVC: Primary data saved (22904 records). [2025-10-23T22:49:23.172144] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-23T22:49:23.172278] [INFO ] [MAIN ] Update Progress: 1475/2367 symbols completed. NGVC took 29.0s. Estimated remaining: 1h 54m 29s. Rate: 7.8 symbols/min [2025-10-23T22:49:23.204520] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-23T22:49:23.345873] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:23.357145] [DEBUG] [LOCAL ] NIC: Loaded 8868 existing records from primary storage. [2025-10-23T22:49:23.357407] [INFO ] [MAIN ] NIC: Loaded 8868 existing records. [2025-10-23T22:49:23.535667] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:49:23.541234] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-23T22:49:23.547930] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-23T22:49:23.549033] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T22:49:23.549275] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-23T22:49:23.554044] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-23T22:49:23.902808] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:49:23.999442] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-23T22:49:24.799453] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-23T22:49:24.841827] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T22:49:24.947638] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T22:49:25.599491] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-23T22:49:26.399423] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-23T22:49:26.436922] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T22:49:26.633293] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:49:27.199421] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-23T22:49:27.319626] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T22:49:27.999444] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-23T22:49:28.799425] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-23T22:49:29.026004] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T22:49:29.166474] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T22:49:29.599457] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-23T22:49:29.881703] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T22:49:30.399464] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-23T22:49:31.199410] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-23T22:49:31.451715] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T22:49:31.645267] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T22:49:31.999477] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-23T22:49:32.105861] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T22:49:32.799439] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-23T22:49:33.599426] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-23T22:49:33.873213] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T22:49:33.965754] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T22:49:34.382026] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T22:49:34.399391] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-23T22:49:35.166284] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-23T22:49:35.199497] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-23T22:49:35.999430] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-23T22:49:36.268922] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T22:49:36.799451] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-23T22:49:37.244219] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-23T22:49:37.599426] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-23T22:49:38.399432] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-23T22:49:38.519051] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T22:49:38.777900] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-23T22:49:39.199432] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-23T22:49:39.479446] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T22:49:39.483316] [INFO ] [REMOTE ] NGVT: Full fetch complete (34314 records). [2025-10-23T22:49:39.483422] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-23T22:49:39.874452] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-23T22:49:39.874562] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-23T22:49:39.875294] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-23T22:49:39.875371] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-23T22:49:39.876203] [DEBUG] [LOCAL ] NGVT: Trimmed 34314 records to 23895 (keeping 200 days of data) [2025-10-23T22:49:40.000678] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-23T22:49:40.011892] [DEBUG] [LOCAL ] NGVT: Primary data saved (23895 records). [2025-10-23T22:49:40.012870] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-23T22:49:40.013011] [INFO ] [MAIN ] Update Progress: 1476/2367 symbols completed. NGVT took 35.1s. Estimated remaining: 1h 54m 27s. Rate: 7.8 symbols/min [2025-10-23T22:49:40.182191] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:40.195281] [DEBUG] [LOCAL ] NIE: Loaded 11724 existing records from primary storage. [2025-10-23T22:49:40.195531] [INFO ] [MAIN ] NIE: Loaded 11724 existing records. [2025-10-23T22:49:40.367763] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:49:40.367982] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-23T22:49:40.368055] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-23T22:49:40.368248] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-23T22:49:40.368322] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-23T22:49:40.724034] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T22:49:40.723177] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:49:40.799398] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-23T22:49:41.061576] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T22:49:41.263018] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-23T22:49:41.599477] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-23T22:49:42.399481] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-23T22:49:42.998856] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T22:49:43.157052] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T22:49:43.159096] [INFO ] [REMOTE ] NIC: Full fetch complete (12588 records). [2025-10-23T22:49:43.159185] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-23T22:49:43.204722] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-23T22:49:43.516832] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-23T22:49:43.516934] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-23T22:49:43.517262] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-23T22:49:43.517343] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-23T22:49:43.517973] [DEBUG] [LOCAL ] NIC: Trimmed 12588 records to 8934 (keeping 200 days of data) [2025-10-23T22:49:43.571135] [DEBUG] [LOCAL ] NIC: Primary data saved (8934 records). [2025-10-23T22:49:43.571284] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-23T22:49:43.571410] [INFO ] [MAIN ] Update Progress: 1477/2367 symbols completed. NIC took 20.4s. Estimated remaining: 1h 54m 17s. Rate: 7.8 symbols/min [2025-10-23T22:49:43.999511] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-23T22:49:44.368638] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-23T22:49:44.414208] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T22:49:44.799457] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-23T22:49:45.506029] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T22:49:45.515374] [INFO ] [REMOTE ] NI: Full fetch complete (77513 records). [2025-10-23T22:49:45.515559] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-23T22:49:45.604685] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-23T22:49:45.920271] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-23T22:49:45.920401] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-23T22:49:45.921771] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-23T22:49:45.921864] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-23T22:49:45.923427] [DEBUG] [LOCAL ] NI: Trimmed 77513 records to 53798 (keeping 200 days of data) [2025-10-23T22:49:46.212125] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-23T22:49:46.256668] [DEBUG] [LOCAL ] NI: Primary data saved (53798 records). [2025-10-23T22:49:46.256835] [INFO ] [MAIN ] NI: Full history saved. [2025-10-23T22:49:46.257617] [INFO ] [MAIN ] Update Progress: 1478/2367 symbols completed. NI took 29.0s. Estimated remaining: 1h 54m 6s. Rate: 7.8 symbols/min [2025-10-23T22:49:46.399420] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-23T22:49:47.199477] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-23T22:49:47.660678] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T22:49:47.929393] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:49:47.999450] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-23T22:49:48.799448] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-23T22:49:49.164834] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T22:49:49.599449] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-23T22:49:49.640436] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T22:49:50.399494] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-23T22:49:50.466859] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-23T22:49:51.199410] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-23T22:49:51.352790] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T22:49:51.999414] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-23T22:49:52.276314] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T22:49:52.799412] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-23T22:49:52.854220] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T22:49:53.599413] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-23T22:49:53.825405] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T22:49:53.829140] [INFO ] [REMOTE ] NHI: Full fetch complete (31075 records). [2025-10-23T22:49:53.829275] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-23T22:49:54.193311] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-23T22:49:54.193499] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-23T22:49:54.194278] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-23T22:49:54.194356] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-23T22:49:54.195206] [DEBUG] [LOCAL ] NHI: Trimmed 31075 records to 21978 (keeping 200 days of data) [2025-10-23T22:49:54.328352] [DEBUG] [LOCAL ] NHI: Primary data saved (21978 records). [2025-10-23T22:49:54.328505] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-23T22:49:54.328617] [INFO ] [MAIN ] Update Progress: 1479/2367 symbols completed. NHI took 37.1s. Estimated remaining: 1h 53m 59s. Rate: 7.8 symbols/min [2025-10-23T22:49:54.390406] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T22:49:54.399406] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-23T22:49:55.371452] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T22:49:55.374974] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-23T22:49:56.265512] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T22:49:56.268474] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-23T22:49:57.063535] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T22:49:57.066681] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-23T22:49:57.924158] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T22:49:57.927140] [INFO ] [REMOTE ] NIE: Full fetch complete (16902 records). [2025-10-23T22:49:57.927241] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-23T22:49:58.282620] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-23T22:49:58.282781] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-23T22:49:58.283184] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-23T22:49:58.283272] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-23T22:49:58.283855] [DEBUG] [LOCAL ] NIE: Trimmed 16902 records to 11861 (keeping 200 days of data) [2025-10-23T22:49:58.355595] [DEBUG] [LOCAL ] NIE: Primary data saved (11861 records). [2025-10-23T22:49:58.355739] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-23T22:49:58.355851] [INFO ] [MAIN ] Update Progress: 1480/2367 symbols completed. NIE took 18.3s. Estimated remaining: 1h 53m 49s. Rate: 7.8 symbols/min [2025-10-23T22:49:59.021451] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:59.060413] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:59.104675] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-23T22:49:59.100612] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:59.104424] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:49:59.105124] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-23T22:49:59.105921] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-23T22:49:59.106016] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-23T22:49:59.106128] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-23T22:49:59.106340] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-23T22:49:59.219979] [DEBUG] [LOCAL ] NIM: Loaded 3526 existing records from primary storage. [2025-10-23T22:49:59.232557] [INFO ] [MAIN ] NIM: Loaded 3526 existing records. [2025-10-23T22:49:59.354233] [DEBUG] [LOCAL ] NINE: Loaded 28666 existing records from primary storage. [2025-10-23T22:49:59.411980] [INFO ] [MAIN ] NINE: Loaded 28666 existing records. [2025-10-23T22:49:59.682219] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-23T22:49:59.795894] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-23T22:49:59.943100] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:00.081246] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-23T22:50:00.148038] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-23T22:50:00.215771] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:00.238277] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-23T22:50:00.296992] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-23T22:50:00.296439] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:00.296847] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-10-23T22:50:00.340764] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-23T22:50:00.415963] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-23T22:50:00.427718] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:00.486694] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-23T22:50:00.481206] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-23T22:50:00.486903] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-23T22:50:00.498941] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-23T22:50:00.535681] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-23T22:50:00.600755] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-23T22:50:00.867208] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:50:00.991884] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-10-23T22:50:01.002427] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:50:01.041053] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-23T22:50:01.092216] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:50:01.165268] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-23T22:50:01.228004] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-23T22:50:01.304789] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-23T22:50:01.323878] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:01.344991] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-23T22:50:01.344878] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-23T22:50:01.351417] [INFO ] [MAIN ] Update Progress: 1481/2367 symbols completed. NIQ took 3.0s. Estimated remaining: 1h 53m 38s. Rate: 7.8 symbols/min [2025-10-23T22:50:01.564187] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:01.544820] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:01.589032] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-23T22:50:01.597966] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-23T22:50:01.697601] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:01.732932] [DEBUG] [LOCAL ] NJR: Loaded 37856 existing records from primary storage. [2025-10-23T22:50:01.733495] [INFO ] [MAIN ] NJR: Loaded 37856 existing records. [2025-10-23T22:50:01.913527] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:01.913853] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-23T22:50:01.913947] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-23T22:50:01.914286] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-23T22:50:01.914386] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-23T22:50:02.265579] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T22:50:02.297734] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-23T22:50:02.342355] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:02.342788] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-23T22:50:02.983792] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T22:50:02.985810] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-23T22:50:03.521554] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-23T22:50:03.530504] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-23T22:50:03.600679] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-23T22:50:03.999405] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-23T22:50:04.009108] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T22:50:04.215061] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-23T22:50:04.799419] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-23T22:50:04.902844] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T22:50:05.045093] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T22:50:05.300435] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T22:50:05.599437] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-23T22:50:06.399435] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-23T22:50:07.140139] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T22:50:07.199396] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-23T22:50:07.999435] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-23T22:50:08.721331] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T22:50:08.787637] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-23T22:50:08.799400] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-23T22:50:09.343782] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T22:50:09.599453] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-23T22:50:10.399444] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-23T22:50:10.691109] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T22:50:11.074733] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-23T22:50:11.199415] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-23T22:50:11.526432] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T22:50:11.999399] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-23T22:50:12.649296] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T22:50:12.650017] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T22:50:12.799445] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-23T22:50:13.599440] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-23T22:50:14.220022] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T22:50:14.399419] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-23T22:50:15.199422] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-23T22:50:15.340414] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-23T22:50:15.817259] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-23T22:50:15.853493] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T22:50:15.999478] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-23T22:50:16.799442] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-23T22:50:17.343044] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T22:50:17.537342] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T22:50:17.599410] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-23T22:50:18.399481] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-23T22:50:18.848962] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T22:50:18.903032] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T22:50:19.199461] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-23T22:50:19.999482] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-23T22:50:20.799482] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-23T22:50:21.599416] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-23T22:50:21.616974] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-23T22:50:21.618281] [INFO ] [REMOTE ] NIM: Full fetch complete (6133 records). [2025-10-23T22:50:21.618486] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-23T22:50:21.786505] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-23T22:50:22.032943] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-23T22:50:22.052942] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-23T22:50:22.053774] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-23T22:50:22.054727] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-23T22:50:22.054895] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-23T22:50:22.063319] [DEBUG] [LOCAL ] NIM: Trimmed 6133 records to 3546 (keeping 200 days of data) [2025-10-23T22:50:22.084324] [DEBUG] [LOCAL ] NIM: Primary data saved (3546 records). [2025-10-23T22:50:22.084433] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-23T22:50:22.084525] [INFO ] [MAIN ] Update Progress: 1482/2367 symbols completed. NIM took 23.7s. Estimated remaining: 1h 53m 38s. Rate: 7.8 symbols/min [2025-10-23T22:50:22.248164] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:22.248381] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-23T22:50:22.248451] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-23T22:50:22.248560] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-23T22:50:22.248629] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-23T22:50:22.248731] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-23T22:50:22.248800] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-23T22:50:22.417168] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-23T22:50:22.599764] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:23.099952] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T22:50:23.199447] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-23T22:50:23.917674] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T22:50:23.999474] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-23T22:50:24.799506] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-23T22:50:25.599441] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-23T22:50:25.800693] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-23T22:50:25.992377] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T22:50:26.173045] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-23T22:50:26.399520] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-23T22:50:27.112254] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T22:50:27.118824] [INFO ] [REMOTE ] NJR: Full fetch complete (54828 records). [2025-10-23T22:50:27.118980] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-23T22:50:27.204678] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-23T22:50:27.500766] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-23T22:50:27.500886] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-23T22:50:27.501849] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-23T22:50:27.501930] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-23T22:50:27.503133] [DEBUG] [LOCAL ] NJR: Trimmed 54828 records to 38100 (keeping 200 days of data) [2025-10-23T22:50:27.731601] [DEBUG] [LOCAL ] NJR: Primary data saved (38100 records). [2025-10-23T22:50:27.731798] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-23T22:50:27.731911] [INFO ] [MAIN ] Update Progress: 1483/2367 symbols completed. NJR took 26.4s. Estimated remaining: 1h 53m 29s. Rate: 7.8 symbols/min [2025-10-23T22:50:27.902397] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:27.917832] [DEBUG] [LOCAL ] NKX: Loaded 13670 existing records from primary storage. [2025-10-23T22:50:27.918104] [INFO ] [MAIN ] NKX: Loaded 13670 existing records. [2025-10-23T22:50:28.009174] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-23T22:50:28.097121] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:28.097317] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-23T22:50:28.097389] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-23T22:50:28.097564] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-23T22:50:28.097631] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-23T22:50:28.463551] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:28.466353] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T22:50:28.799418] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-23T22:50:29.012386] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-23T22:50:29.599456] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-23T22:50:29.940775] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-23T22:50:29.946932] [INFO ] [REMOTE ] NINE: Full fetch complete (43323 records). [2025-10-23T22:50:29.947094] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-23T22:50:30.347599] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-23T22:50:30.347853] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-23T22:50:30.349088] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-23T22:50:30.349170] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-23T22:50:30.350407] [DEBUG] [LOCAL ] NINE: Trimmed 43323 records to 29054 (keeping 200 days of data) [2025-10-23T22:50:30.418844] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-23T22:50:30.463687] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-23T22:50:30.566855] [DEBUG] [LOCAL ] NINE: Primary data saved (29054 records). [2025-10-23T22:50:30.567064] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-23T22:50:30.567189] [INFO ] [MAIN ] Update Progress: 1484/2367 symbols completed. NINE took 32.2s. Estimated remaining: 1h 53m 19s. Rate: 7.8 symbols/min [2025-10-23T22:50:30.759915] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:30.760135] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-23T22:50:30.760207] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-23T22:50:30.760294] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-23T22:50:30.760360] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-23T22:50:30.760445] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-23T22:50:30.760516] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-23T22:50:31.119074] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:31.199431] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-23T22:50:31.386390] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T22:50:31.999445] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-23T22:50:32.089553] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T22:50:32.120678] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-23T22:50:32.799485] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-23T22:50:33.599432] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-23T22:50:34.399429] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-23T22:50:34.700118] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-23T22:50:34.711619] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T22:50:35.016364] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T22:50:35.199414] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-23T22:50:35.999432] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-23T22:50:36.589440] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T22:50:36.799424] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-23T22:50:37.184307] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (4.38 seconds). [2025-10-23T22:50:37.478578] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T22:50:37.599415] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-23T22:50:38.043847] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-23T22:50:38.399455] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-23T22:50:38.431474] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T22:50:39.199465] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-23T22:50:39.999426] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-23T22:50:40.068990] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T22:50:40.608191] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T22:50:40.799428] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-23T22:50:41.096577] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-23T22:50:41.599444] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-23T22:50:42.399500] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-23T22:50:43.182761] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T22:50:43.199403] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-23T22:50:43.484398] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-23T22:50:43.494006] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-23T22:50:43.494195] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-23T22:50:43.899710] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-23T22:50:43.900106] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-23T22:50:43.901825] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-23T22:50:43.907032] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-23T22:50:43.907349] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T22:50:43.912223] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 54192 (keeping 200 days of data) [2025-10-23T22:50:44.011627] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-23T22:50:44.249163] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-23T22:50:44.282709] [DEBUG] [LOCAL ] NIO: Primary data saved (54192 records). [2025-10-23T22:50:44.282902] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-23T22:50:44.284678] [INFO ] [MAIN ] Update Progress: 1485/2367 symbols completed. NIO took 45.9s. Estimated remaining: 1h 53m 15s. Rate: 7.8 symbols/min [2025-10-23T22:50:44.451853] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:44.464778] [DEBUG] [LOCAL ] NLOP: Loaded 11491 existing records from primary storage. [2025-10-23T22:50:44.465039] [INFO ] [MAIN ] NLOP: Loaded 11491 existing records. [2025-10-23T22:50:44.642765] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:44.642973] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-23T22:50:44.643047] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-23T22:50:44.643262] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-23T22:50:44.643335] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-23T22:50:44.799839] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-23T22:50:44.930327] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T22:50:45.009606] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:45.376936] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T22:50:45.599434] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-23T22:50:46.399477] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-23T22:50:47.199426] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-23T22:50:47.434424] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T22:50:47.999418] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-23T22:50:48.315888] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-23T22:50:48.337595] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T22:50:48.799443] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-23T22:50:49.006145] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-23T22:50:49.599434] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-23T22:50:49.621025] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T22:50:50.207050] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T22:50:50.399435] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-23T22:50:51.199429] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-23T22:50:51.551020] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T22:50:51.795865] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T22:50:51.797347] [INFO ] [REMOTE ] NL: Full fetch complete (6889 records). [2025-10-23T22:50:51.797462] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-23T22:50:51.978491] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T22:50:51.978744] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:50:51.978826] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:50:51.978897] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-23T22:50:51.978985] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-23T22:50:51.979032] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-23T22:50:51.979110] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-23T22:50:51.979198] [INFO ] [MAIN ] Update Progress: 1486/2367 symbols completed. NL took 21.4s. Estimated remaining: 1h 53m 7s. Rate: 7.8 symbols/min [2025-10-23T22:50:52.007528] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-23T22:50:52.163718] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:52.214035] [DEBUG] [LOCAL ] NLY: Loaded 53564 existing records from primary storage. [2025-10-23T22:50:52.214360] [INFO ] [MAIN ] NLY: Loaded 53564 existing records. [2025-10-23T22:50:52.391314] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:52.391523] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-23T22:50:52.391597] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-23T22:50:52.391854] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-23T22:50:52.391929] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-23T22:50:52.738776] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:52.799437] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-23T22:50:53.599467] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-23T22:50:54.403261] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-23T22:50:54.456151] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-23T22:50:54.451885] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-23T22:50:54.536904] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:50:55.199458] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-23T22:50:55.307554] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-23T22:50:55.999437] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-23T22:50:56.210839] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T22:50:56.799426] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-23T22:50:56.838965] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T22:50:57.599431] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-23T22:50:57.726450] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T22:50:57.728925] [INFO ] [REMOTE ] NKX: Full fetch complete (19041 records). [2025-10-23T22:50:57.729017] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-23T22:50:58.085626] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-23T22:50:58.085754] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-23T22:50:58.086179] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-23T22:50:58.086254] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-23T22:50:58.086856] [DEBUG] [LOCAL ] NKX: Trimmed 19041 records to 13725 (keeping 200 days of data) [2025-10-23T22:50:58.166248] [DEBUG] [LOCAL ] NKX: Primary data saved (13725 records). [2025-10-23T22:50:58.166400] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-23T22:50:58.166509] [INFO ] [MAIN ] Update Progress: 1487/2367 symbols completed. NKX took 30.4s. Estimated remaining: 1h 52m 58s. Rate: 7.8 symbols/min [2025-10-23T22:50:58.330506] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:50:58.344234] [DEBUG] [LOCAL ] NMAI: Loaded 12567 existing records from primary storage. [2025-10-23T22:50:58.344486] [INFO ] [MAIN ] NMAI: Loaded 12567 existing records. [2025-10-23T22:50:58.405955] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-23T22:50:58.519500] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:50:58.519720] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-23T22:50:58.519794] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-23T22:50:58.519981] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-23T22:50:58.520053] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-23T22:50:58.867411] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:50:59.199409] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-23T22:50:59.542898] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T22:50:59.710508] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-23T22:50:59.999497] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-23T22:51:00.799438] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-23T22:51:00.939593] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T22:51:00.985762] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-23T22:51:01.599436] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-23T22:51:02.399437] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-23T22:51:02.685932] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T22:51:02.774795] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T22:51:03.199466] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-23T22:51:03.776133] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T22:51:03.785577] [INFO ] [REMOTE ] NKE: Full fetch complete (77217 records). [2025-10-23T22:51:03.785831] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-23T22:51:03.978332] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T22:51:03.979175] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:51:03.979267] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:51:03.979361] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-23T22:51:03.979482] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-23T22:51:03.979575] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-23T22:51:03.979710] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-23T22:51:03.979830] [INFO ] [MAIN ] Update Progress: 1488/2367 symbols completed. NKE took 41.9s. Estimated remaining: 1h 52m 50s. Rate: 7.8 symbols/min [2025-10-23T22:51:04.009105] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-23T22:51:04.150087] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:04.150280] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-23T22:51:04.150367] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-23T22:51:04.150498] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-23T22:51:04.150587] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-23T22:51:04.150722] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-23T22:51:04.150808] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-23T22:51:04.495053] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:04.799431] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-10-23T22:51:05.086580] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T22:51:05.228739] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:51:05.243058] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-10-23T22:51:05.248352] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:51:05.263574] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-23T22:51:05.263787] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:51:05.263920] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-23T22:51:05.264117] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-23T22:51:05.264393] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-23T22:51:05.265092] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-23T22:51:05.267255] [INFO ] [MAIN ] Update Progress: 1489/2367 symbols completed. NMAX took 1.3s. Estimated remaining: 1h 52m 38s. Rate: 7.8 symbols/min [2025-10-23T22:51:05.266977] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T22:51:05.448011] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:05.465604] [DEBUG] [LOCAL ] NMCO: Loaded 16631 existing records from primary storage. [2025-10-23T22:51:05.465892] [INFO ] [MAIN ] NMCO: Loaded 16631 existing records. [2025-10-23T22:51:05.607737] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-23T22:51:05.649069] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:05.649248] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-23T22:51:05.649411] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-23T22:51:05.649621] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-23T22:51:05.649719] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-23T22:51:05.999142] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:06.399413] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-23T22:51:06.627630] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T22:51:06.629833] [INFO ] [REMOTE ] NLOP: Full fetch complete (17647 records). [2025-10-23T22:51:06.629934] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-23T22:51:06.990511] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-23T22:51:06.990659] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-23T22:51:06.991098] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-23T22:51:06.991178] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-23T22:51:06.991768] [DEBUG] [LOCAL ] NLOP: Trimmed 17647 records to 11532 (keeping 200 days of data) [2025-10-23T22:51:07.062537] [DEBUG] [LOCAL ] NLOP: Primary data saved (11532 records). [2025-10-23T22:51:07.062743] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-23T22:51:07.062855] [INFO ] [MAIN ] Update Progress: 1490/2367 symbols completed. NLOP took 22.8s. Estimated remaining: 1h 52m 27s. Rate: 7.8 symbols/min [2025-10-23T22:51:07.208447] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-23T22:51:07.234815] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:07.252905] [DEBUG] [LOCAL ] NMG: Loaded 12064 existing records from primary storage. [2025-10-23T22:51:07.253141] [INFO ] [MAIN ] NMG: Loaded 12064 existing records. [2025-10-23T22:51:07.436173] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T22:51:07.440373] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:07.440610] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-23T22:51:07.444472] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-23T22:51:07.444750] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-23T22:51:07.444834] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-23T22:51:07.796307] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:07.999390] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-23T22:51:08.226849] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T22:51:08.799415] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-23T22:51:09.206856] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T22:51:09.599425] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-23T22:51:09.645019] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T22:51:10.399446] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-23T22:51:11.199497] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-23T22:51:11.199561] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-23T22:51:11.678681] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-23T22:51:11.999561] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-23T22:51:12.023069] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T22:51:12.754671] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T22:51:12.799524] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-23T22:51:13.599517] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-23T22:51:13.849248] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T22:51:14.280875] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T22:51:14.399444] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-23T22:51:15.194006] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T22:51:15.199382] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-23T22:51:15.989520] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T22:51:15.999385] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-23T22:51:16.799429] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-23T22:51:17.003620] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-23T22:51:17.599423] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-23T22:51:18.361197] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T22:51:18.399427] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-23T22:51:19.199408] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-23T22:51:19.303576] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T22:51:19.999416] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-23T22:51:20.674439] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-10-23T22:51:20.799420] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-23T22:51:20.873371] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T22:51:21.257601] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T22:51:21.599456] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-23T22:51:21.763838] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-23T22:51:22.399458] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-23T22:51:22.676222] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T22:51:23.199462] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-23T22:51:23.999472] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-23T22:51:24.118148] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T22:51:24.799451] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-23T22:51:24.911041] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-23T22:51:25.454328] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-23T22:51:25.536546] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T22:51:25.599462] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-23T22:51:26.399439] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-23T22:51:26.543325] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T22:51:27.161403] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T22:51:27.199438] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-23T22:51:27.828197] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T22:51:27.830821] [INFO ] [REMOTE ] NMAI: Full fetch complete (19454 records). [2025-10-23T22:51:27.830910] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-23T22:51:28.007608] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-23T22:51:28.197239] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-23T22:51:28.197353] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-23T22:51:28.197904] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-23T22:51:28.197984] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-23T22:51:28.198704] [DEBUG] [LOCAL ] NMAI: Trimmed 19454 records to 12639 (keeping 200 days of data) [2025-10-23T22:51:28.276499] [DEBUG] [LOCAL ] NMAI: Primary data saved (12639 records). [2025-10-23T22:51:28.276700] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-23T22:51:28.276816] [INFO ] [MAIN ] Update Progress: 1491/2367 symbols completed. NMAI took 30.1s. Estimated remaining: 1h 52m 27s. Rate: 7.8 symbols/min [2025-10-23T22:51:28.450130] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:28.456702] [DEBUG] [LOCAL ] NMI: Loaded 4049 existing records from primary storage. [2025-10-23T22:51:28.456933] [INFO ] [MAIN ] NMI: Loaded 4049 existing records. [2025-10-23T22:51:28.632217] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:28.632480] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-23T22:51:28.632557] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-23T22:51:28.632762] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-23T22:51:28.632836] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-23T22:51:28.804922] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-23T22:51:28.983268] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T22:51:29.007127] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:29.007945] [INFO ] [REMOTE ] NMCO: Full fetch complete (22905 records). [2025-10-23T22:51:29.008051] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-23T22:51:29.376887] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-23T22:51:29.377000] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-23T22:51:29.377545] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-23T22:51:29.377659] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-23T22:51:29.378295] [DEBUG] [LOCAL ] NMCO: Trimmed 22905 records to 16776 (keeping 200 days of data) [2025-10-23T22:51:29.477244] [DEBUG] [LOCAL ] NMCO: Primary data saved (16776 records). [2025-10-23T22:51:29.477409] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-23T22:51:29.477525] [INFO ] [MAIN ] Update Progress: 1492/2367 symbols completed. NMCO took 24.2s. Estimated remaining: 1h 52m 16s. Rate: 7.8 symbols/min [2025-10-23T22:51:29.613825] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-23T22:51:29.645211] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:29.659370] [DEBUG] [LOCAL ] NMM: Loaded 14137 existing records from primary storage. [2025-10-23T22:51:29.659627] [INFO ] [MAIN ] NMM: Loaded 14137 existing records. [2025-10-23T22:51:29.832100] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:29.832383] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-23T22:51:29.832456] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-23T22:51:29.832788] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-23T22:51:29.832860] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-23T22:51:30.181818] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:30.258958] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T22:51:30.399441] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-23T22:51:30.454836] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T22:51:31.199421] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-23T22:51:31.499258] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T22:51:31.999484] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-23T22:51:32.799426] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-23T22:51:32.898127] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T22:51:33.097530] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T22:51:33.140762] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-23T22:51:33.599457] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-23T22:51:34.359273] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T22:51:34.399392] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-23T22:51:35.199458] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-23T22:51:35.289822] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T22:51:35.999461] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-23T22:51:36.799447] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-23T22:51:36.917958] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T22:51:37.438149] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-23T22:51:37.447539] [INFO ] [REMOTE ] NLY: Full fetch complete (77699 records). [2025-10-23T22:51:37.447731] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-23T22:51:37.603891] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-23T22:51:37.851970] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-23T22:51:37.852101] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-23T22:51:37.853225] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-23T22:51:37.853326] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-23T22:51:37.854843] [DEBUG] [LOCAL ] NLY: Trimmed 77699 records to 53954 (keeping 200 days of data) [2025-10-23T22:51:38.109619] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-23T22:51:38.124988] [INFO ] [REMOTE ] NMG: Full fetch complete (16184 records). [2025-10-23T22:51:38.131294] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-23T22:51:38.357407] [DEBUG] [LOCAL ] NLY: Primary data saved (53954 records). [2025-10-23T22:51:38.375996] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-23T22:51:38.377688] [INFO ] [MAIN ] Update Progress: 1493/2367 symbols completed. NLY took 46.4s. Estimated remaining: 1h 52m 9s. Rate: 7.8 symbols/min [2025-10-23T22:51:38.403080] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-23T22:51:38.760921] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-23T22:51:38.752303] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:38.761310] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-23T22:51:38.775945] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-23T22:51:38.776322] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-23T22:51:38.778909] [DEBUG] [LOCAL ] NMG: Trimmed 16184 records to 12292 (keeping 200 days of data) [2025-10-23T22:51:38.778736] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T22:51:38.853372] [DEBUG] [LOCAL ] NMG: Primary data saved (12292 records). [2025-10-23T22:51:38.863081] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-23T22:51:38.863202] [INFO ] [MAIN ] Update Progress: 1494/2367 symbols completed. NMG took 31.8s. Estimated remaining: 1h 51m 57s. Rate: 7.8 symbols/min [2025-10-23T22:51:39.001195] [DEBUG] [LOCAL ] NMR: Loaded 35454 existing records from primary storage. [2025-10-23T22:51:39.007402] [INFO ] [MAIN ] NMR: Loaded 35454 existing records. [2025-10-23T22:51:39.102967] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:39.122451] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T22:51:39.206561] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-23T22:51:39.224285] [DEBUG] [LOCAL ] NMS: Loaded 2889 existing records from primary storage. [2025-10-23T22:51:39.273687] [INFO ] [MAIN ] NMS: Loaded 2889 existing records. [2025-10-23T22:51:39.292500] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:39.349684] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-23T22:51:39.364174] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-23T22:51:39.393108] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-23T22:51:39.395533] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-23T22:51:39.618155] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:39.638993] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-23T22:51:39.653715] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-23T22:51:39.716251] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-23T22:51:39.736876] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-23T22:51:40.007023] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-23T22:51:40.006232] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:40.233445] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:40.235227] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T22:51:40.703980] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T22:51:40.799436] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-23T22:51:41.381288] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T22:51:41.599440] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-23T22:51:42.114167] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-23T22:51:42.399482] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-23T22:51:43.010472] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-23T22:51:43.199493] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-23T22:51:43.999439] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-23T22:51:44.423284] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T22:51:44.614998] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-23T22:51:44.799437] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-23T22:51:45.599468] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-23T22:51:46.178272] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T22:51:46.236389] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T22:51:46.399499] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-23T22:51:47.019494] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T22:51:47.199499] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-23T22:51:47.999471] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-23T22:51:48.131948] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T22:51:48.620104] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T22:51:48.799458] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-23T22:51:49.599461] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-23T22:51:50.050112] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T22:51:50.051496] [INFO ] [REMOTE ] NMI: Full fetch complete (5648 records). [2025-10-23T22:51:50.051605] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-23T22:51:50.207160] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T22:51:50.412603] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-23T22:51:50.455799] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-23T22:51:50.455909] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-23T22:51:50.456154] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-23T22:51:50.456232] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-23T22:51:50.456754] [DEBUG] [LOCAL ] NMI: Trimmed 5648 records to 4059 (keeping 200 days of data) [2025-10-23T22:51:50.481302] [DEBUG] [LOCAL ] NMI: Primary data saved (4059 records). [2025-10-23T22:51:50.481451] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-23T22:51:50.481568] [INFO ] [MAIN ] Update Progress: 1495/2367 symbols completed. NMI took 22.2s. Estimated remaining: 1h 51m 51s. Rate: 7.8 symbols/min [2025-10-23T22:51:50.650821] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:51:50.655204] [DEBUG] [LOCAL ] NMT: Loaded 2811 existing records from primary storage. [2025-10-23T22:51:50.655406] [INFO ] [MAIN ] NMT: Loaded 2811 existing records. [2025-10-23T22:51:50.827139] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:51:50.827375] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-23T22:51:50.827449] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-23T22:51:50.827633] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-23T22:51:50.827762] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-23T22:51:51.167427] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:51:51.199402] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-23T22:51:51.748774] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T22:51:51.748960] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-23T22:51:51.999481] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-23T22:51:52.799476] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-23T22:51:53.273896] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-23T22:51:53.599464] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-23T22:51:54.283230] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T22:51:54.399402] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-23T22:51:54.605046] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T22:51:55.199457] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-23T22:51:55.825699] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T22:51:55.826866] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T22:51:55.999399] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-23T22:51:56.477480] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-23T22:51:56.799442] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-23T22:51:57.387067] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T22:51:57.599426] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-23T22:51:58.113320] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-23T22:51:58.399429] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-23T22:51:59.199427] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-23T22:51:59.784379] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T22:51:59.787418] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T22:51:59.999421] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-23T22:52:00.484514] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T22:52:00.799440] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-23T22:52:01.397233] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T22:52:01.599451] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-23T22:52:02.166474] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-23T22:52:02.399424] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-23T22:52:03.199430] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-23T22:52:03.689532] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-23T22:52:03.890396] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T22:52:03.999417] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-23T22:52:04.472886] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T22:52:04.799436] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-23T22:52:05.599422] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-23T22:52:05.656363] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T22:52:06.094222] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-23T22:52:06.399449] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-23T22:52:07.199490] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-23T22:52:07.699260] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T22:52:07.794841] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T22:52:07.999450] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-23T22:52:08.799412] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-23T22:52:08.996486] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T22:52:09.330867] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-23T22:52:09.599462] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-23T22:52:09.990731] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-23T22:52:09.991732] [INFO ] [REMOTE ] NMT: Full fetch complete (3878 records). [2025-10-23T22:52:09.991821] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-23T22:52:10.350165] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-23T22:52:10.350275] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-23T22:52:10.350437] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-23T22:52:10.350520] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-23T22:52:10.350935] [DEBUG] [LOCAL ] NMT: Trimmed 3878 records to 2826 (keeping 200 days of data) [2025-10-23T22:52:10.368057] [DEBUG] [LOCAL ] NMT: Primary data saved (2826 records). [2025-10-23T22:52:10.368165] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-23T22:52:10.368272] [INFO ] [MAIN ] Update Progress: 1496/2367 symbols completed. NMT took 19.9s. Estimated remaining: 1h 51m 51s. Rate: 7.8 symbols/min [2025-10-23T22:52:10.400372] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-23T22:52:10.538776] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:10.558985] [DEBUG] [LOCAL ] NMZ: Loaded 21383 existing records from primary storage. [2025-10-23T22:52:10.559317] [INFO ] [MAIN ] NMZ: Loaded 21383 existing records. [2025-10-23T22:52:10.731092] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:10.731286] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-23T22:52:10.731360] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-23T22:52:10.731753] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-23T22:52:10.731831] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-23T22:52:11.081875] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:11.199404] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-23T22:52:11.471634] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T22:52:11.999423] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-23T22:52:12.258423] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T22:52:12.799440] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-23T22:52:13.448249] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T22:52:13.599429] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-23T22:52:13.776399] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T22:52:13.779424] [INFO ] [REMOTE ] NMM: Full fetch complete (21671 records). [2025-10-23T22:52:13.779547] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-23T22:52:14.135759] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-23T22:52:14.135887] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-23T22:52:14.136394] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-23T22:52:14.136490] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-23T22:52:14.137146] [DEBUG] [LOCAL ] NMM: Trimmed 21671 records to 14355 (keeping 200 days of data) [2025-10-23T22:52:14.226258] [DEBUG] [LOCAL ] NMM: Primary data saved (14355 records). [2025-10-23T22:52:14.226416] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-23T22:52:14.226546] [INFO ] [MAIN ] Update Progress: 1497/2367 symbols completed. NMM took 44.7s. Estimated remaining: 1h 51m 41s. Rate: 7.8 symbols/min [2025-10-23T22:52:14.397859] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:14.399406] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-23T22:52:14.412192] [DEBUG] [LOCAL ] NNI: Loaded 10508 existing records from primary storage. [2025-10-23T22:52:14.412440] [INFO ] [MAIN ] NNI: Loaded 10508 existing records. [2025-10-23T22:52:14.591033] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:14.591238] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-23T22:52:14.591319] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-23T22:52:14.591515] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-23T22:52:14.591589] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-23T22:52:14.942075] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-23T22:52:14.973086] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:15.014605] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T22:52:15.021597] [INFO ] [REMOTE ] NMR: Full fetch complete (51271 records). [2025-10-23T22:52:15.021820] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-23T22:52:15.209270] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-23T22:52:15.410818] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-23T22:52:15.410937] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-23T22:52:15.411919] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-23T22:52:15.411999] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-23T22:52:15.413181] [DEBUG] [LOCAL ] NMR: Trimmed 51271 records to 35672 (keeping 200 days of data) [2025-10-23T22:52:15.606845] [DEBUG] [LOCAL ] NMR: Primary data saved (35672 records). [2025-10-23T22:52:15.607034] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-23T22:52:15.607189] [INFO ] [MAIN ] Update Progress: 1498/2367 symbols completed. NMR took 37.2s. Estimated remaining: 1h 51m 29s. Rate: 7.8 symbols/min [2025-10-23T22:52:15.776998] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:15.821399] [DEBUG] [LOCAL ] NNN: Loaded 48165 existing records from primary storage. [2025-10-23T22:52:15.821904] [INFO ] [MAIN ] NNN: Loaded 48165 existing records. [2025-10-23T22:52:16.006605] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-23T22:52:16.042449] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:16.048717] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T22:52:16.048910] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-23T22:52:16.051044] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-23T22:52:16.051418] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-23T22:52:16.051492] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-23T22:52:16.397532] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:16.799450] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-23T22:52:17.523413] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T22:52:17.524570] [INFO ] [REMOTE ] NMS: Full fetch complete (4089 records). [2025-10-23T22:52:17.524672] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-23T22:52:17.600297] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-23T22:52:17.707436] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T22:52:17.925082] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-23T22:52:17.925194] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-23T22:52:17.925364] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-23T22:52:17.925441] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-23T22:52:17.925906] [DEBUG] [LOCAL ] NMS: Trimmed 4089 records to 2935 (keeping 200 days of data) [2025-10-23T22:52:17.943943] [DEBUG] [LOCAL ] NMS: Primary data saved (2935 records). [2025-10-23T22:52:17.944104] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-23T22:52:17.944218] [INFO ] [MAIN ] Update Progress: 1499/2367 symbols completed. NMS took 39.1s. Estimated remaining: 1h 51m 19s. Rate: 7.8 symbols/min [2025-10-23T22:52:18.119143] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:18.125734] [DEBUG] [LOCAL ] NNY: Loaded 5674 existing records from primary storage. [2025-10-23T22:52:18.125960] [INFO ] [MAIN ] NNY: Loaded 5674 existing records. [2025-10-23T22:52:18.309675] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:18.309894] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-23T22:52:18.309970] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-23T22:52:18.310229] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-23T22:52:18.310306] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-23T22:52:18.405924] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-23T22:52:18.676601] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:19.199423] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-23T22:52:19.742446] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-23T22:52:19.955582] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T22:52:19.999404] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-23T22:52:20.105922] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T22:52:20.799424] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-23T22:52:21.108326] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T22:52:21.599447] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-23T22:52:22.257639] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T22:52:22.404609] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-23T22:52:22.416237] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T22:52:23.199454] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-23T22:52:23.425328] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T22:52:23.874995] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-23T22:52:23.999429] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-23T22:52:24.724314] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T22:52:24.799415] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-23T22:52:25.599431] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-23T22:52:26.316869] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T22:52:26.399437] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-23T22:52:26.514538] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T22:52:27.199424] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-23T22:52:27.422421] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T22:52:27.731863] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T22:52:27.999453] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-23T22:52:28.597182] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T22:52:28.799471] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-23T22:52:29.599421] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-23T22:52:29.891568] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T22:52:30.306360] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T22:52:30.399489] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-23T22:52:31.199488] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-23T22:52:31.497954] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T22:52:31.983893] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T22:52:31.999386] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-23T22:52:32.799420] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-23T22:52:32.864703] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T22:52:33.549725] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T22:52:33.599408] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-23T22:52:34.291977] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T22:52:34.399407] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-23T22:52:35.100278] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T22:52:35.102017] [INFO ] [REMOTE ] NNY: Full fetch complete (8410 records). [2025-10-23T22:52:35.102109] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-23T22:52:35.199825] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-23T22:52:35.470031] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-23T22:52:35.470272] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-23T22:52:35.470594] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-23T22:52:35.470709] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-23T22:52:35.471225] [DEBUG] [LOCAL ] NNY: Trimmed 8410 records to 5814 (keeping 200 days of data) [2025-10-23T22:52:35.504448] [DEBUG] [LOCAL ] NNY: Primary data saved (5814 records). [2025-10-23T22:52:35.504574] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-23T22:52:35.504699] [INFO ] [MAIN ] Update Progress: 1500/2367 symbols completed. NNY took 17.6s. Estimated remaining: 1h 51m 17s. Rate: 7.8 symbols/min [2025-10-23T22:52:35.669293] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:35.690226] [DEBUG] [LOCAL ] NOA: Loaded 15736 existing records from primary storage. [2025-10-23T22:52:35.690464] [INFO ] [MAIN ] NOA: Loaded 15736 existing records. [2025-10-23T22:52:35.862892] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:35.863080] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-23T22:52:35.863153] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-23T22:52:35.863546] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-23T22:52:35.863619] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-23T22:52:36.011421] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-23T22:52:36.218569] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:36.313976] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:52:36.799451] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-23T22:52:37.599460] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-23T22:52:37.717165] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T22:52:37.721017] [INFO ] [REMOTE ] NMZ: Full fetch complete (30996 records). [2025-10-23T22:52:37.721154] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-23T22:52:38.148867] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-23T22:52:38.149008] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-23T22:52:38.149862] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-23T22:52:38.150140] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-23T22:52:38.152678] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T22:52:38.163922] [DEBUG] [LOCAL ] NMZ: Trimmed 30996 records to 21507 (keeping 200 days of data) [2025-10-23T22:52:38.296045] [DEBUG] [LOCAL ] NMZ: Primary data saved (21507 records). [2025-10-23T22:52:38.296199] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-23T22:52:38.296308] [INFO ] [MAIN ] Update Progress: 1501/2367 symbols completed. NMZ took 27.9s. Estimated remaining: 1h 51m 6s. Rate: 7.8 symbols/min [2025-10-23T22:52:38.404536] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-23T22:52:38.470954] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:38.478891] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T22:52:38.502395] [DEBUG] [LOCAL ] NOAH: Loaded 19844 existing records from primary storage. [2025-10-23T22:52:38.502761] [INFO ] [MAIN ] NOAH: Loaded 19844 existing records. [2025-10-23T22:52:38.675244] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:38.675409] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-23T22:52:38.675539] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-23T22:52:38.675777] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-23T22:52:38.675852] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-23T22:52:39.019033] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:39.199457] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-23T22:52:39.286686] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T22:52:39.999427] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-23T22:52:40.021248] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T22:52:40.799423] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-23T22:52:40.916625] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T22:52:41.599427] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-23T22:52:41.629359] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T22:52:42.256599] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T22:52:42.399413] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-23T22:52:42.881743] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-23T22:52:43.199455] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-23T22:52:43.999413] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-23T22:52:44.118726] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T22:52:44.799417] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-23T22:52:45.094689] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-23T22:52:45.469237] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T22:52:45.599439] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-23T22:52:46.399417] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-23T22:52:46.644957] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T22:52:47.165915] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T22:52:47.168000] [INFO ] [REMOTE ] NNI: Full fetch complete (13135 records). [2025-10-23T22:52:47.168088] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-23T22:52:47.204718] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-23T22:52:47.539675] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-23T22:52:47.539800] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-23T22:52:47.540137] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-23T22:52:47.540209] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-23T22:52:47.540763] [DEBUG] [LOCAL ] NNI: Trimmed 13135 records to 10530 (keeping 200 days of data) [2025-10-23T22:52:47.605597] [DEBUG] [LOCAL ] NNI: Primary data saved (10530 records). [2025-10-23T22:52:47.605784] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-23T22:52:47.605899] [INFO ] [MAIN ] Update Progress: 1502/2367 symbols completed. NNI took 33.4s. Estimated remaining: 1h 50m 59s. Rate: 7.8 symbols/min [2025-10-23T22:52:47.781389] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:52:47.818697] [DEBUG] [LOCAL ] NOC: Loaded 41598 existing records from primary storage. [2025-10-23T22:52:47.819018] [INFO ] [MAIN ] NOC: Loaded 41598 existing records. [2025-10-23T22:52:47.996530] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:52:47.996791] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-23T22:52:47.996881] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-23T22:52:47.997154] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-23T22:52:47.997230] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-23T22:52:48.008514] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-23T22:52:48.353699] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:52:48.799460] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-23T22:52:48.871775] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T22:52:49.356406] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T22:52:49.599465] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-23T22:52:49.858818] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T22:52:50.399432] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-23T22:52:51.199428] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-23T22:52:51.247258] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T22:52:51.281969] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T22:52:51.999457] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-23T22:52:52.799417] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-23T22:52:52.923270] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T22:52:52.951916] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T22:52:53.599463] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-23T22:52:54.362140] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T22:52:54.399407] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-23T22:52:54.519216] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T22:52:55.199459] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-23T22:52:56.008555] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-23T22:52:56.036438] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T22:52:56.324826] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T22:52:56.799418] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-23T22:52:56.889278] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T22:52:57.599473] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-23T22:52:58.399415] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-23T22:52:58.593552] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-23T22:52:59.154352] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-23T22:52:59.199425] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-23T22:52:59.958310] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T22:52:59.999401] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-23T22:53:00.157723] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T22:53:00.799439] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-23T22:53:01.242877] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T22:53:01.599440] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-23T22:53:02.216197] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T22:53:02.224504] [INFO ] [REMOTE ] NNN: Full fetch complete (70307 records). [2025-10-23T22:53:02.224698] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-23T22:53:02.405447] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-23T22:53:02.659081] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T22:53:02.659232] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-23T22:53:02.662717] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-23T22:53:02.664696] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-23T22:53:02.664789] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-23T22:53:02.666314] [DEBUG] [LOCAL ] NNN: Trimmed 70307 records to 48512 (keeping 200 days of data) [2025-10-23T22:53:02.959230] [DEBUG] [LOCAL ] NNN: Primary data saved (48512 records). [2025-10-23T22:53:02.959393] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-23T22:53:02.959507] [INFO ] [MAIN ] Update Progress: 1503/2367 symbols completed. NNN took 47.4s. Estimated remaining: 1h 50m 56s. Rate: 7.8 symbols/min [2025-10-23T22:53:03.157116] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:03.201841] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-23T22:53:03.202711] [DEBUG] [LOCAL ] NOG: Loaded 51348 existing records from primary storage. [2025-10-23T22:53:03.204033] [INFO ] [MAIN ] NOG: Loaded 51348 existing records. [2025-10-23T22:53:03.382153] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:03.382353] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-23T22:53:03.382426] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-23T22:53:03.382691] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-23T22:53:03.382767] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-23T22:53:03.732880] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:03.999404] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-23T22:53:04.324489] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T22:53:04.328162] [INFO ] [REMOTE ] NOA: Full fetch complete (22617 records). [2025-10-23T22:53:04.328348] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-23T22:53:04.497349] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-23T22:53:04.725044] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-23T22:53:04.725157] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-23T22:53:04.725694] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-23T22:53:04.725772] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-23T22:53:04.726419] [DEBUG] [LOCAL ] NOA: Trimmed 22617 records to 15889 (keeping 200 days of data) [2025-10-23T22:53:04.800350] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-23T22:53:04.823335] [DEBUG] [LOCAL ] NOA: Primary data saved (15889 records). [2025-10-23T22:53:04.823511] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-23T22:53:04.823629] [INFO ] [MAIN ] Update Progress: 1504/2367 symbols completed. NOA took 29.3s. Estimated remaining: 1h 50m 45s. Rate: 7.8 symbols/min [2025-10-23T22:53:04.994360] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:05.045945] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-23T22:53:05.046277] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-23T22:53:05.217751] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:05.217954] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-23T22:53:05.218027] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-23T22:53:05.218285] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-23T22:53:05.218398] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-23T22:53:05.575285] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:05.599407] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-23T22:53:05.820570] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T22:53:05.969624] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T22:53:06.399439] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-23T22:53:07.199432] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-23T22:53:07.300877] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T22:53:07.304408] [INFO ] [REMOTE ] NOAH: Full fetch complete (27200 records). [2025-10-23T22:53:07.304535] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-23T22:53:07.693223] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-23T22:53:07.714270] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-23T22:53:07.714812] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-23T22:53:07.715763] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-23T22:53:07.715842] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-23T22:53:07.716616] [DEBUG] [LOCAL ] NOAH: Trimmed 27200 records to 19894 (keeping 200 days of data) [2025-10-23T22:53:07.831480] [DEBUG] [LOCAL ] NOAH: Primary data saved (19894 records). [2025-10-23T22:53:07.831687] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-23T22:53:07.831823] [INFO ] [MAIN ] Update Progress: 1505/2367 symbols completed. NOAH took 29.5s. Estimated remaining: 1h 50m 35s. Rate: 7.8 symbols/min [2025-10-23T22:53:07.999434] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-23T22:53:07.999314] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:08.000419] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-23T22:53:08.000493] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-23T22:53:08.000584] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-23T22:53:08.000626] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-23T22:53:08.000713] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-23T22:53:08.000761] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-23T22:53:08.354097] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:08.799442] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-23T22:53:08.948493] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T22:53:09.599505] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-23T22:53:10.241498] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-23T22:53:10.399414] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-23T22:53:10.602252] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T22:53:10.957230] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-23T22:53:11.117915] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T22:53:11.199398] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-23T22:53:11.617044] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-23T22:53:11.999438] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-23T22:53:12.799436] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-23T22:53:13.167749] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-23T22:53:13.599460] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-23T22:53:13.765540] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T22:53:14.399482] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-23T22:53:14.768223] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-23T22:53:15.199425] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-23T22:53:15.666327] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-23T22:53:15.999494] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-23T22:53:16.799458] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-23T22:53:16.883238] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T22:53:17.599448] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-23T22:53:18.150016] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-23T22:53:18.399547] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-23T22:53:18.559821] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T22:53:18.752916] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T22:53:19.199478] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-23T22:53:19.417000] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T22:53:19.567148] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-23T22:53:19.999477] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-23T22:53:20.799529] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-23T22:53:21.599486] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-23T22:53:21.705902] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:53:22.072247] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-23T22:53:22.075714] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T22:53:22.399470] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-23T22:53:23.199513] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-23T22:53:23.715545] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-23T22:53:23.999433] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-23T22:53:24.450360] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T22:53:24.466330] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T22:53:24.799495] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-23T22:53:25.599474] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-23T22:53:26.037069] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T22:53:26.038387] [INFO ] [REMOTE ] NOM: Full fetch complete (1522 records). [2025-10-23T22:53:26.038498] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-23T22:53:26.249625] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-23T22:53:26.249911] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:53:26.249990] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:53:26.250070] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-23T22:53:26.250221] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-23T22:53:26.250297] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-23T22:53:26.250408] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-23T22:53:26.250588] [INFO ] [MAIN ] Update Progress: 1506/2367 symbols completed. NOM took 18.4s. Estimated remaining: 1h 50m 33s. Rate: 7.8 symbols/min [2025-10-23T22:53:26.410635] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-23T22:53:26.451172] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:26.502066] [DEBUG] [LOCAL ] NOMD: Loaded 43199 existing records from primary storage. [2025-10-23T22:53:26.502604] [INFO ] [MAIN ] NOMD: Loaded 43199 existing records. [2025-10-23T22:53:26.717921] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:26.718355] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-23T22:53:26.718441] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-23T22:53:26.718785] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-23T22:53:26.718975] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-23T22:53:26.876327] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-23T22:53:27.177820] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:27.199406] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-23T22:53:27.999564] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-23T22:53:28.110539] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T22:53:28.717858] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T22:53:28.799494] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-23T22:53:29.599465] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-23T22:53:29.862678] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T22:53:30.198803] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T22:53:30.266765] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T22:53:30.274222] [INFO ] [REMOTE ] NOC: Full fetch complete (61988 records). [2025-10-23T22:53:30.274442] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-23T22:53:30.404785] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-23T22:53:30.670944] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-23T22:53:30.671154] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-23T22:53:30.672525] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-23T22:53:30.672610] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-23T22:53:30.674368] [DEBUG] [LOCAL ] NOC: Trimmed 61988 records to 41909 (keeping 200 days of data) [2025-10-23T22:53:30.958776] [DEBUG] [LOCAL ] NOC: Primary data saved (41909 records). [2025-10-23T22:53:30.958992] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-23T22:53:30.959143] [INFO ] [MAIN ] Update Progress: 1507/2367 symbols completed. NOC took 43.4s. Estimated remaining: 1h 50m 24s. Rate: 7.8 symbols/min [2025-10-23T22:53:31.140158] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:31.179745] [DEBUG] [LOCAL ] NOTE: Loaded 39580 existing records from primary storage. [2025-10-23T22:53:31.180284] [INFO ] [MAIN ] NOTE: Loaded 39580 existing records. [2025-10-23T22:53:31.204575] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-23T22:53:31.385350] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:31.385778] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-23T22:53:31.385864] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-23T22:53:31.386202] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-23T22:53:31.386282] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-23T22:53:31.765752] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:31.999468] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-23T22:53:32.278002] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T22:53:32.799422] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-23T22:53:33.295747] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T22:53:33.599454] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-23T22:53:33.942073] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T22:53:34.399465] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-23T22:53:34.609202] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T22:53:34.619091] [INFO ] [REMOTE ] NOG: Full fetch complete (74352 records). [2025-10-23T22:53:34.619336] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-23T22:53:35.074171] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-23T22:53:35.074381] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-23T22:53:35.075881] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-23T22:53:35.076171] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-23T22:53:35.100020] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T22:53:35.108329] [DEBUG] [LOCAL ] NOG: Trimmed 74352 records to 51729 (keeping 200 days of data) [2025-10-23T22:53:35.203729] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-23T22:53:35.465474] [DEBUG] [LOCAL ] NOG: Primary data saved (51729 records). [2025-10-23T22:53:35.465753] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-23T22:53:35.465903] [INFO ] [MAIN ] Update Progress: 1508/2367 symbols completed. NOG took 32.5s. Estimated remaining: 1h 50m 14s. Rate: 7.8 symbols/min [2025-10-23T22:53:35.651316] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:35.706768] [DEBUG] [LOCAL ] NOV: Loaded 53163 existing records from primary storage. [2025-10-23T22:53:35.707220] [INFO ] [MAIN ] NOV: Loaded 53163 existing records. [2025-10-23T22:53:35.894181] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:35.895345] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-23T22:53:35.895490] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-23T22:53:35.896014] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-23T22:53:35.896090] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-23T22:53:36.001011] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-23T22:53:36.339196] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T22:53:36.350930] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:36.799470] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-23T22:53:37.146109] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T22:53:37.234880] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T22:53:37.599470] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-23T22:53:38.399416] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-23T22:53:38.503705] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T22:53:39.199443] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-23T22:53:39.283610] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T22:53:39.999441] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-23T22:53:40.197223] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T22:53:40.799458] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-23T22:53:41.271444] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T22:53:41.599485] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-23T22:53:41.749622] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T22:53:41.813730] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T22:53:42.399437] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-23T22:53:43.201262] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-23T22:53:43.206087] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T22:53:43.999457] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-23T22:53:44.205189] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T22:53:44.750136] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T22:53:44.799438] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-23T22:53:45.361505] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T22:53:45.599456] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-23T22:53:46.274203] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T22:53:46.399472] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-23T22:53:47.199443] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-23T22:53:47.354897] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T22:53:48.009324] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-23T22:53:48.036777] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T22:53:48.799530] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-23T22:53:49.211019] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T22:53:49.599422] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-23T22:53:49.699306] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T22:53:50.399464] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-23T22:53:50.841934] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-23T22:53:51.204940] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-23T22:53:51.218636] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T22:53:51.999460] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-23T22:53:52.271519] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T22:53:52.799437] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-23T22:53:52.884740] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T22:53:53.599442] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-23T22:53:53.773824] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T22:53:53.783050] [INFO ] [REMOTE ] NOMD: Full fetch complete (60922 records). [2025-10-23T22:53:53.783291] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-23T22:53:54.167193] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-23T22:53:54.167310] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-23T22:53:54.168333] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-23T22:53:54.168425] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-23T22:53:54.169743] [DEBUG] [LOCAL ] NOMD: Trimmed 60922 records to 43545 (keeping 200 days of data) [2025-10-23T22:53:54.406725] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-23T22:53:54.431722] [DEBUG] [LOCAL ] NOMD: Primary data saved (43545 records). [2025-10-23T22:53:54.431915] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-23T22:53:54.432040] [INFO ] [MAIN ] Update Progress: 1509/2367 symbols completed. NOMD took 28.2s. Estimated remaining: 1h 50m 13s. Rate: 7.8 symbols/min [2025-10-23T22:53:54.617906] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:54.654231] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T22:53:54.665913] [INFO ] [REMOTE ] NOK: Full fetch complete (77774 records). [2025-10-23T22:53:54.666202] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-23T22:53:54.966234] [DEBUG] [LOCAL ] NOW: Loaded 47850 existing records from primary storage. [2025-10-23T22:53:55.012502] [INFO ] [MAIN ] NOW: Loaded 47850 existing records. [2025-10-23T22:53:55.254018] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-23T22:53:55.299523] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-23T22:53:55.325724] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-23T22:53:55.326195] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-23T22:53:55.324330] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:55.326853] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-23T22:53:55.327343] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-23T22:53:55.328032] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-10-23T22:53:55.328119] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-23T22:53:55.339750] [DEBUG] [LOCAL ] NOK: Trimmed 77774 records to 54012 (keeping 200 days of data) [2025-10-23T22:53:55.824659] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T22:53:55.859277] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:55.863191] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-23T22:53:56.008351] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-23T22:53:56.017397] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T22:53:56.151190] [DEBUG] [LOCAL ] NOK: Primary data saved (54012 records). [2025-10-23T22:53:56.151452] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-23T22:53:56.153359] [INFO ] [MAIN ] Update Progress: 1510/2367 symbols completed. NOK took 51.3s. Estimated remaining: 1h 50m 2s. Rate: 7.8 symbols/min [2025-10-23T22:53:56.326131] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:56.326465] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-23T22:53:56.326555] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-23T22:53:56.326680] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-23T22:53:56.326768] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-23T22:53:56.326852] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-23T22:53:56.326958] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-23T22:53:56.696399] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:56.799474] [INFO ] [REMOTE ] NP: Fetching primary data for 2025-01. [2025-10-23T22:53:57.012866] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:53:57.013341] [WARN ] [REMOTE ] NP: No data returned for month 2025-01 [2025-10-23T22:53:57.013435] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:53:57.013529] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-23T22:53:57.013617] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:53:57.013734] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-23T22:53:57.013862] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-23T22:53:57.013942] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-23T22:53:57.014124] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-23T22:53:57.014241] [INFO ] [MAIN ] Update Progress: 1511/2367 symbols completed. NP took 0.9s. Estimated remaining: 1h 49m 50s. Rate: 7.8 symbols/min [2025-10-23T22:53:57.194014] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:57.194275] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-23T22:53:57.194402] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-23T22:53:57.194552] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-23T22:53:57.194671] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-23T22:53:57.194767] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-23T22:53:57.194845] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-23T22:53:57.579347] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:57.599504] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-10-23T22:53:57.695385] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T22:53:57.790989] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T22:53:57.809685] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:53:57.810183] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-10-23T22:53:57.810280] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:53:57.810358] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-23T22:53:57.810429] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:53:57.810508] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-23T22:53:57.810592] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-23T22:53:57.810693] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-23T22:53:57.810779] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-23T22:53:57.810869] [INFO ] [MAIN ] Update Progress: 1512/2367 symbols completed. NPB took 0.8s. Estimated remaining: 1h 49m 39s. Rate: 7.8 symbols/min [2025-10-23T22:53:57.989117] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:53:58.010217] [DEBUG] [LOCAL ] NPCT: Loaded 16365 existing records from primary storage. [2025-10-23T22:53:58.010624] [INFO ] [MAIN ] NPCT: Loaded 16365 existing records. [2025-10-23T22:53:58.202292] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:53:58.202688] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-23T22:53:58.202793] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-23T22:53:58.203188] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-23T22:53:58.203269] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-23T22:53:58.404577] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-23T22:53:58.593257] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:53:59.199483] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-23T22:53:59.999428] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-23T22:54:00.459268] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-23T22:54:00.616431] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-23T22:54:00.799449] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-23T22:54:01.599442] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-23T22:54:01.773319] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T22:54:02.063857] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-23T22:54:02.399445] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-23T22:54:03.199435] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-23T22:54:03.594137] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T22:54:03.614320] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T22:54:03.620667] [INFO ] [REMOTE ] NOTE: Full fetch complete (60772 records). [2025-10-23T22:54:03.620872] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-23T22:54:04.004691] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-23T22:54:04.091014] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-23T22:54:04.091186] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-23T22:54:04.092507] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-23T22:54:04.092589] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-23T22:54:04.094589] [DEBUG] [LOCAL ] NOTE: Trimmed 60772 records to 39696 (keeping 200 days of data) [2025-10-23T22:54:04.335534] [DEBUG] [LOCAL ] NOTE: Primary data saved (39696 records). [2025-10-23T22:54:04.335809] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-23T22:54:04.335992] [INFO ] [MAIN ] Update Progress: 1513/2367 symbols completed. NOTE took 33.4s. Estimated remaining: 1h 49m 30s. Rate: 7.8 symbols/min [2025-10-23T22:54:04.513734] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:04.527582] [DEBUG] [LOCAL ] NPFD: Loaded 9999 existing records from primary storage. [2025-10-23T22:54:04.527965] [INFO ] [MAIN ] NPFD: Loaded 9999 existing records. [2025-10-23T22:54:04.714852] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:04.715430] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-23T22:54:04.715515] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-23T22:54:04.715783] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-23T22:54:04.715861] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-23T22:54:04.800196] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-23T22:54:05.042040] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T22:54:05.189519] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:05.193383] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T22:54:05.203961] [INFO ] [REMOTE ] NOV: Full fetch complete (77184 records). [2025-10-23T22:54:05.204263] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-23T22:54:05.599480] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-23T22:54:05.623479] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-23T22:54:05.623593] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-23T22:54:05.625398] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-23T22:54:05.625596] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-23T22:54:05.628146] [DEBUG] [LOCAL ] NOV: Trimmed 77184 records to 53551 (keeping 200 days of data) [2025-10-23T22:54:05.981558] [DEBUG] [LOCAL ] NOV: Primary data saved (53551 records). [2025-10-23T22:54:05.981834] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-23T22:54:05.982007] [INFO ] [MAIN ] Update Progress: 1514/2367 symbols completed. NOV took 30.5s. Estimated remaining: 1h 49m 19s. Rate: 7.8 symbols/min [2025-10-23T22:54:06.165008] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:06.176637] [DEBUG] [LOCAL ] NPK: Loaded 8371 existing records from primary storage. [2025-10-23T22:54:06.176970] [INFO ] [MAIN ] NPK: Loaded 8371 existing records. [2025-10-23T22:54:06.366167] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:06.366461] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-23T22:54:06.366543] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-23T22:54:06.366790] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-23T22:54:06.366868] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-23T22:54:06.405161] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-23T22:54:06.491600] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T22:54:06.760087] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:07.196073] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-23T22:54:07.207208] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-23T22:54:07.222993] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T22:54:07.999474] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-23T22:54:08.018908] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T22:54:08.799506] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-23T22:54:09.571058] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T22:54:09.599482] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-23T22:54:10.206805] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-23T22:54:10.344542] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T22:54:10.399462] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-23T22:54:11.126246] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-23T22:54:11.199480] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-23T22:54:11.999474] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-23T22:54:12.804615] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-23T22:54:12.808409] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T22:54:13.076406] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T22:54:13.551841] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T22:54:13.599504] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-23T22:54:14.400674] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-23T22:54:14.403814] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T22:54:15.199494] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-23T22:54:15.999493] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-23T22:54:16.251827] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T22:54:16.589299] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T22:54:16.799469] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-23T22:54:16.858691] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T22:54:17.599522] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-23T22:54:18.299250] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-23T22:54:18.399430] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-23T22:54:18.768443] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T22:54:19.199458] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-23T22:54:19.472952] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T22:54:19.999456] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-23T22:54:20.016896] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T22:54:20.799536] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-23T22:54:21.599467] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-23T22:54:21.642703] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-23T22:54:22.169370] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-23T22:54:22.399502] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-23T22:54:22.691753] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T22:54:23.187074] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T22:54:23.199440] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-23T22:54:23.999436] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-23T22:54:24.304892] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T22:54:24.799433] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-23T22:54:24.952111] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T22:54:25.488695] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-23T22:54:25.599452] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-23T22:54:26.362082] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T22:54:26.399441] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-23T22:54:27.167588] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T22:54:27.199434] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-23T22:54:27.823054] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T22:54:27.999445] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-23T22:54:28.798004] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T22:54:28.801174] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-23T22:54:29.499114] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T22:54:29.507025] [INFO ] [REMOTE ] NOW: Full fetch complete (70721 records). [2025-10-23T22:54:29.507172] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-23T22:54:29.604634] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-23T22:54:29.891288] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-23T22:54:29.891406] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-23T22:54:29.892487] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-23T22:54:29.892570] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-23T22:54:29.893953] [DEBUG] [LOCAL ] NOW: Trimmed 70721 records to 48142 (keeping 200 days of data) [2025-10-23T22:54:30.185443] [DEBUG] [LOCAL ] NOW: Primary data saved (48142 records). [2025-10-23T22:54:30.185627] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-23T22:54:30.185759] [INFO ] [MAIN ] Update Progress: 1515/2367 symbols completed. NOW took 35.8s. Estimated remaining: 1h 49m 21s. Rate: 7.8 symbols/min [2025-10-23T22:54:30.352786] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:30.388482] [DEBUG] [LOCAL ] NPKI: Loaded 40429 existing records from primary storage. [2025-10-23T22:54:30.388819] [INFO ] [MAIN ] NPKI: Loaded 40429 existing records. [2025-10-23T22:54:30.409059] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-23T22:54:30.575775] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:30.576724] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-23T22:54:30.577024] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-23T22:54:30.579918] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-23T22:54:30.579994] [INFO ] [REMOTE ] NPFD: Full fetch complete (14737 records). [2025-10-23T22:54:30.580253] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-23T22:54:30.580574] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-10-23T22:54:30.643579] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-23T22:54:31.200238] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-23T22:54:31.233375] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-23T22:54:31.272362] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-23T22:54:31.303826] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-23T22:54:31.323467] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-23T22:54:31.345872] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:31.347072] [DEBUG] [LOCAL ] NPFD: Trimmed 14737 records to 10132 (keeping 200 days of data) [2025-10-23T22:54:31.407189] [DEBUG] [LOCAL ] NPFD: Primary data saved (10132 records). [2025-10-23T22:54:31.407347] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-23T22:54:31.407472] [INFO ] [MAIN ] Update Progress: 1516/2367 symbols completed. NPFD took 27.1s. Estimated remaining: 1h 49m 9s. Rate: 7.8 symbols/min [2025-10-23T22:54:31.538616] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T22:54:31.589830] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:31.605107] [DEBUG] [LOCAL ] NPO: Loaded 13496 existing records from primary storage. [2025-10-23T22:54:31.605425] [INFO ] [MAIN ] NPO: Loaded 13496 existing records. [2025-10-23T22:54:31.783661] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:31.783904] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-23T22:54:31.783981] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-23T22:54:31.784215] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-23T22:54:31.784289] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-23T22:54:32.007488] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-23T22:54:32.073762] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T22:54:32.076874] [INFO ] [REMOTE ] NPK: Full fetch complete (11127 records). [2025-10-23T22:54:32.124320] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-23T22:54:32.193169] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:32.516784] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-23T22:54:32.516896] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-23T22:54:32.517248] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-23T22:54:32.517322] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-23T22:54:32.517852] [DEBUG] [LOCAL ] NPK: Trimmed 11127 records to 8417 (keeping 200 days of data) [2025-10-23T22:54:32.566674] [DEBUG] [LOCAL ] NPK: Primary data saved (8417 records). [2025-10-23T22:54:32.566836] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-23T22:54:32.566953] [INFO ] [MAIN ] Update Progress: 1517/2367 symbols completed. NPK took 26.6s. Estimated remaining: 1h 48m 58s. Rate: 7.8 symbols/min [2025-10-23T22:54:32.799452] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-23T22:54:33.474826] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T22:54:33.599424] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-23T22:54:33.623040] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-23T22:54:33.625702] [INFO ] [REMOTE ] NPCT: Full fetch complete (24333 records). [2025-10-23T22:54:33.625800] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-23T22:54:34.007014] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-23T22:54:34.007128] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-23T22:54:34.007694] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-23T22:54:34.007772] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-23T22:54:34.008485] [DEBUG] [LOCAL ] NPCT: Trimmed 24333 records to 16524 (keeping 200 days of data) [2025-10-23T22:54:34.107337] [DEBUG] [LOCAL ] NPCT: Primary data saved (16524 records). [2025-10-23T22:54:34.107489] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-23T22:54:34.107597] [INFO ] [MAIN ] Update Progress: 1518/2367 symbols completed. NPCT took 36.3s. Estimated remaining: 1h 48m 47s. Rate: 7.8 symbols/min [2025-10-23T22:54:34.399423] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-23T22:54:34.407744] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T22:54:35.199444] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-23T22:54:35.710765] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T22:54:35.999417] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-23T22:54:36.010435] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T22:54:36.799441] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-23T22:54:37.395715] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T22:54:37.599434] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-23T22:54:37.730606] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T22:54:38.399427] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-23T22:54:39.317342] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T22:54:39.326391] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-23T22:54:39.437515] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-23T22:54:39.999443] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-23T22:54:40.536756] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T22:54:40.799500] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-23T22:54:40.968848] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T22:54:41.599499] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-23T22:54:42.005071] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T22:54:42.399416] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-23T22:54:42.455886] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T22:54:43.199454] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-23T22:54:43.889625] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T22:54:43.999442] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-23T22:54:44.031122] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T22:54:44.799438] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-23T22:54:45.524940] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T22:54:45.542009] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T22:54:45.599407] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-23T22:54:46.399561] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-23T22:54:46.957206] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T22:54:47.199459] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-23T22:54:47.240309] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T22:54:47.999503] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-23T22:54:48.629538] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T22:54:48.641826] [INFO ] [REMOTE ] NPKI: Full fetch complete (56468 records). [2025-10-23T22:54:48.645826] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-23T22:54:48.646096] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T22:54:48.693122] [INFO ] [REMOTE ] NPO: Full fetch complete (18946 records). [2025-10-23T22:54:48.719548] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-23T22:54:49.432745] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-23T22:54:49.432504] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-23T22:54:49.433133] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-23T22:54:49.433055] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-23T22:54:49.433513] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-23T22:54:49.434721] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-23T22:54:49.434795] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-23T22:54:49.434971] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-23T22:54:49.436069] [DEBUG] [LOCAL ] NPO: Trimmed 18946 records to 13600 (keeping 200 days of data) [2025-10-23T22:54:49.437299] [DEBUG] [LOCAL ] NPKI: Trimmed 56468 records to 40736 (keeping 200 days of data) [2025-10-23T22:54:49.615693] [DEBUG] [LOCAL ] NPO: Primary data saved (13600 records). [2025-10-23T22:54:49.618170] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-23T22:54:49.626745] [INFO ] [MAIN ] Update Progress: 1519/2367 symbols completed. NPO took 18.2s. Estimated remaining: 1h 48m 44s. Rate: 7.8 symbols/min [2025-10-23T22:54:49.748855] [DEBUG] [LOCAL ] NPKI: Primary data saved (40736 records). [2025-10-23T22:54:49.749038] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-23T22:54:49.749169] [INFO ] [MAIN ] Update Progress: 1520/2367 symbols completed. NPKI took 19.6s. Estimated remaining: 1h 48m 32s. Rate: 7.8 symbols/min [2025-10-23T22:54:50.328940] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:50.418927] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:50.480965] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:50.502783] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:54:50.530309] [DEBUG] [LOCAL ] NPV: Loaded 5380 existing records from primary storage. [2025-10-23T22:54:50.530676] [INFO ] [MAIN ] NPV: Loaded 5380 existing records. [2025-10-23T22:54:50.589844] [DEBUG] [LOCAL ] NQP: Loaded 9070 existing records from primary storage. [2025-10-23T22:54:50.605874] [DEBUG] [LOCAL ] NPWR: Loaded 43444 existing records from primary storage. [2025-10-23T22:54:50.639049] [INFO ] [MAIN ] NQP: Loaded 9070 existing records. [2025-10-23T22:54:50.662382] [DEBUG] [LOCAL ] NRDY: Loaded 32164 existing records from primary storage. [2025-10-23T22:54:50.649976] [INFO ] [MAIN ] NPWR: Loaded 43444 existing records. [2025-10-23T22:54:50.683607] [INFO ] [MAIN ] NRDY: Loaded 32164 existing records. [2025-10-23T22:54:50.915969] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:51.046414] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-23T22:54:51.090078] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-23T22:54:51.116546] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-23T22:54:51.257964] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-23T22:54:51.310006] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:51.314859] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:51.374750] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:54:51.398281] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-23T22:54:51.398514] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-23T22:54:51.411926] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-23T22:54:51.428700] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-23T22:54:51.417348] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-23T22:54:51.443153] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-23T22:54:51.469840] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-23T22:54:51.482591] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-23T22:54:51.493114] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-23T22:54:51.464602] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-23T22:54:51.518009] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-23T22:54:51.533734] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-23T22:54:52.244320] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:52.293366] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-23T22:54:52.859153] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:52.876988] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:52.904881] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:54:52.905539] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-23T22:54:52.906238] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-23T22:54:52.907998] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-23T22:54:53.197262] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-23T22:54:53.198966] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-23T22:54:53.614480] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T22:54:53.616619] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-23T22:54:53.760112] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-23T22:54:53.761598] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-23T22:54:54.269156] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T22:54:54.326031] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-23T22:54:54.399409] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-23T22:54:54.444361] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T22:54:54.469591] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T22:54:55.137852] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T22:54:55.199484] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-23T22:54:55.999437] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-23T22:54:56.021816] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-23T22:54:56.799469] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-23T22:54:57.342360] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T22:54:57.599455] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-23T22:54:58.046755] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T22:54:58.399433] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-23T22:54:59.199428] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-23T22:54:59.255745] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T22:54:59.812390] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T22:54:59.999439] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-23T22:55:00.056191] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T22:55:00.733805] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T22:55:00.799459] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-23T22:55:01.599450] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-23T22:55:01.655232] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T22:55:02.399444] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-23T22:55:03.198383] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T22:55:03.206988] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-23T22:55:03.824455] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T22:55:03.915206] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T22:55:03.999448] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-23T22:55:04.637725] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T22:55:04.799446] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-23T22:55:05.599435] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-23T22:55:06.275468] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T22:55:06.399435] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-23T22:55:06.815371] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-23T22:55:07.177126] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T22:55:07.199404] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-23T22:55:07.999458] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-23T22:55:08.057374] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-23T22:55:08.799494] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-23T22:55:09.599491] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-23T22:55:09.812726] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-23T22:55:09.880174] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-23T22:55:10.278123] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T22:55:10.279962] [INFO ] [REMOTE ] NQP: Full fetch complete (12682 records). [2025-10-23T22:55:10.280050] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-23T22:55:10.404568] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-23T22:55:10.656788] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-23T22:55:10.656905] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-23T22:55:10.657237] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-23T22:55:10.657310] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-23T22:55:10.657882] [DEBUG] [LOCAL ] NQP: Trimmed 12682 records to 9104 (keeping 200 days of data) [2025-10-23T22:55:10.714381] [DEBUG] [LOCAL ] NQP: Primary data saved (9104 records). [2025-10-23T22:55:10.714545] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-23T22:55:10.714684] [INFO ] [MAIN ] Update Progress: 1521/2367 symbols completed. NQP took 21.0s. Estimated remaining: 1h 48m 31s. Rate: 7.8 symbols/min [2025-10-23T22:55:10.881722] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:55:10.891291] [DEBUG] [LOCAL ] NREF: Loaded 7815 existing records from primary storage. [2025-10-23T22:55:10.891562] [INFO ] [MAIN ] NREF: Loaded 7815 existing records. [2025-10-23T22:55:11.065916] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:55:11.066086] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-23T22:55:11.066166] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-23T22:55:11.066408] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-23T22:55:11.066481] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-23T22:55:11.204630] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-23T22:55:11.411431] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:55:11.891367] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T22:55:11.999407] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-23T22:55:12.203825] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T22:55:12.434690] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-23T22:55:12.799417] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-23T22:55:13.404099] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T22:55:13.599448] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-23T22:55:14.399440] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-23T22:55:15.097872] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T22:55:15.199408] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-23T22:55:15.761555] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T22:55:15.999445] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-23T22:55:16.727096] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T22:55:16.799408] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-23T22:55:16.812715] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-23T22:55:17.435785] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-23T22:55:17.599444] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-23T22:55:18.399434] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-23T22:55:19.128886] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T22:55:19.199404] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-23T22:55:19.355491] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T22:55:19.364135] [INFO ] [REMOTE ] NPWR: Full fetch complete (60814 records). [2025-10-23T22:55:19.364300] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-23T22:55:19.746560] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-23T22:55:19.746704] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-23T22:55:19.747673] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-23T22:55:19.747752] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-23T22:55:19.749010] [DEBUG] [LOCAL ] NPWR: Trimmed 60814 records to 43826 (keeping 200 days of data) [2025-10-23T22:55:19.846356] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T22:55:20.002488] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-23T22:55:20.009902] [DEBUG] [LOCAL ] NPWR: Primary data saved (43826 records). [2025-10-23T22:55:20.010824] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-23T22:55:20.010941] [INFO ] [MAIN ] Update Progress: 1522/2367 symbols completed. NPWR took 30.3s. Estimated remaining: 1h 48m 25s. Rate: 7.8 symbols/min [2025-10-23T22:55:20.180529] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:55:20.231308] [DEBUG] [LOCAL ] NRG: Loaded 52825 existing records from primary storage. [2025-10-23T22:55:20.231696] [INFO ] [MAIN ] NRG: Loaded 52825 existing records. [2025-10-23T22:55:20.407991] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:55:20.408244] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-23T22:55:20.408319] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-23T22:55:20.408566] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-10-23T22:55:20.408637] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-23T22:55:20.763094] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:55:20.799399] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-23T22:55:20.894294] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T22:55:21.599414] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-23T22:55:22.399423] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-23T22:55:22.420295] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T22:55:22.757771] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T22:55:23.048354] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-23T22:55:23.199510] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-23T22:55:23.999466] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-23T22:55:24.730525] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T22:55:24.800291] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-23T22:55:24.816260] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T22:55:25.599490] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-23T22:55:26.120522] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T22:55:26.363012] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T22:55:26.399422] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-23T22:55:27.199518] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-23T22:55:27.829284] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T22:55:27.863381] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T22:55:27.865033] [INFO ] [REMOTE ] NPV: Full fetch complete (7164 records). [2025-10-23T22:55:27.865124] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-23T22:55:28.004515] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-23T22:55:28.224066] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-23T22:55:28.224174] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-23T22:55:28.224422] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-23T22:55:28.224505] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-23T22:55:28.224931] [DEBUG] [LOCAL ] NPV: Trimmed 7164 records to 5400 (keeping 200 days of data) [2025-10-23T22:55:28.256284] [DEBUG] [LOCAL ] NPV: Primary data saved (5400 records). [2025-10-23T22:55:28.256380] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-23T22:55:28.256489] [INFO ] [MAIN ] Update Progress: 1523/2367 symbols completed. NPV took 38.5s. Estimated remaining: 1h 48m 17s. Rate: 7.8 symbols/min [2025-10-23T22:55:28.422460] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:55:28.459543] [DEBUG] [LOCAL ] NRGV: Loaded 43940 existing records from primary storage. [2025-10-23T22:55:28.459875] [INFO ] [MAIN ] NRGV: Loaded 43940 existing records. [2025-10-23T22:55:28.633260] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:55:28.633488] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-23T22:55:28.633583] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-23T22:55:28.633936] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-23T22:55:28.634008] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-23T22:55:28.804627] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-23T22:55:28.988618] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:55:29.599475] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-23T22:55:30.176415] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-23T22:55:30.209145] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T22:55:30.216443] [INFO ] [REMOTE ] NRDY: Full fetch complete (49775 records). [2025-10-23T22:55:30.216597] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-23T22:55:30.403989] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-23T22:55:30.679108] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-23T22:55:30.679254] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-23T22:55:30.680268] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-23T22:55:30.680355] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-23T22:55:30.681469] [DEBUG] [LOCAL ] NRDY: Trimmed 49775 records to 32344 (keeping 200 days of data) [2025-10-23T22:55:30.875124] [DEBUG] [LOCAL ] NRDY: Primary data saved (32344 records). [2025-10-23T22:55:30.875288] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-23T22:55:30.875422] [INFO ] [MAIN ] Update Progress: 1524/2367 symbols completed. NRDY took 41.1s. Estimated remaining: 1h 48m 7s. Rate: 7.8 symbols/min [2025-10-23T22:55:31.083019] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:55:31.104586] [DEBUG] [LOCAL ] NRK: Loaded 20423 existing records from primary storage. [2025-10-23T22:55:31.104930] [INFO ] [MAIN ] NRK: Loaded 20423 existing records. [2025-10-23T22:55:31.211072] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-23T22:55:31.339073] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:55:31.341517] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:55:31.349346] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T22:55:31.349488] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-23T22:55:31.361415] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-23T22:55:31.361914] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-23T22:55:31.361992] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-23T22:55:31.794375] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:55:31.999447] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-23T22:55:32.689265] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T22:55:32.691481] [INFO ] [REMOTE ] NREF: Full fetch complete (10852 records). [2025-10-23T22:55:32.691587] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-23T22:55:32.806394] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-23T22:55:33.218763] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-23T22:55:33.219009] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-23T22:55:33.219406] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-23T22:55:33.219506] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-23T22:55:33.220548] [DEBUG] [LOCAL ] NREF: Trimmed 10852 records to 7848 (keeping 200 days of data) [2025-10-23T22:55:33.282046] [DEBUG] [LOCAL ] NREF: Primary data saved (7848 records). [2025-10-23T22:55:33.282343] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-23T22:55:33.282494] [INFO ] [MAIN ] Update Progress: 1525/2367 symbols completed. NREF took 22.6s. Estimated remaining: 1h 47m 56s. Rate: 7.8 symbols/min [2025-10-23T22:55:33.583416] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-23T22:55:33.588769] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:55:33.600799] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-23T22:55:33.618940] [DEBUG] [LOCAL ] NRP: Loaded 4126 existing records from primary storage. [2025-10-23T22:55:33.619263] [INFO ] [MAIN ] NRP: Loaded 4126 existing records. [2025-10-23T22:55:33.851594] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:55:33.852103] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-23T22:55:33.852198] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-23T22:55:33.852398] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-23T22:55:33.852478] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-23T22:55:34.241600] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:55:34.263745] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T22:55:34.399424] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-23T22:55:34.651294] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T22:55:35.199459] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-23T22:55:36.004528] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-23T22:55:36.018430] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T22:55:36.145700] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T22:55:36.645594] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-23T22:55:36.799447] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-23T22:55:37.599430] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-23T22:55:38.399528] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-23T22:55:38.442263] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T22:55:38.997306] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T22:55:39.199434] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-23T22:55:39.581432] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T22:55:39.875715] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T22:55:39.999417] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-23T22:55:40.639488] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T22:55:40.799441] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-23T22:55:41.599424] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-23T22:55:41.680922] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:55:42.399456] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-23T22:55:43.003258] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T22:55:43.136354] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T22:55:43.199415] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-23T22:55:43.999443] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-23T22:55:44.710180] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T22:55:44.799445] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-23T22:55:45.599463] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-23T22:55:46.178733] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-23T22:55:46.246446] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T22:55:46.264613] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T22:55:46.399438] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-23T22:55:47.030605] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T22:55:47.199424] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-23T22:55:47.999422] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-23T22:55:48.233013] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T22:55:48.522702] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-23T22:55:48.799462] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-23T22:55:49.436076] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T22:55:49.599458] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-23T22:55:50.399446] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-23T22:55:50.683431] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T22:55:51.199528] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-23T22:55:51.999424] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-23T22:55:52.419740] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-23T22:55:52.450860] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T22:55:52.639141] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T22:55:52.640550] [INFO ] [REMOTE ] NRP: Full fetch complete (6320 records). [2025-10-23T22:55:52.640671] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-23T22:55:52.799737] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-23T22:55:53.001547] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-23T22:55:53.001680] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-23T22:55:53.001884] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-23T22:55:53.001958] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-23T22:55:53.002368] [DEBUG] [LOCAL ] NRP: Trimmed 6320 records to 4185 (keeping 200 days of data) [2025-10-23T22:55:53.027585] [DEBUG] [LOCAL ] NRP: Primary data saved (4185 records). [2025-10-23T22:55:53.027706] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-23T22:55:53.027813] [INFO ] [MAIN ] Update Progress: 1526/2367 symbols completed. NRP took 19.7s. Estimated remaining: 1h 47m 55s. Rate: 7.8 symbols/min [2025-10-23T22:55:53.195525] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:55:53.201795] [DEBUG] [LOCAL ] NRT: Loaded 4872 existing records from primary storage. [2025-10-23T22:55:53.202008] [INFO ] [MAIN ] NRT: Loaded 4872 existing records. [2025-10-23T22:55:53.375825] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:55:53.376022] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-23T22:55:53.376098] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-23T22:55:53.376332] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-23T22:55:53.376413] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-23T22:55:53.610077] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-23T22:55:53.738995] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:55:54.399409] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-23T22:55:54.748736] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T22:55:54.888078] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-23T22:55:55.169387] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T22:55:55.199445] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-23T22:55:55.999439] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-23T22:55:56.673371] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T22:55:56.799452] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-23T22:55:57.055994] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T22:55:57.599438] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-23T22:55:58.288566] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-23T22:55:58.399418] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-23T22:55:58.591925] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T22:55:59.090051] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-23T22:55:59.199458] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-23T22:55:59.893350] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T22:55:59.999447] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-23T22:56:00.759538] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-23T22:56:00.768906] [INFO ] [REMOTE ] NRG: Full fetch complete (76804 records). [2025-10-23T22:56:00.769101] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-23T22:56:00.804618] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-23T22:56:01.176827] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-10-23T22:56:01.176953] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-10-23T22:56:01.178163] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-10-23T22:56:01.178246] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-10-23T22:56:01.179797] [DEBUG] [LOCAL ] NRG: Trimmed 76804 records to 53197 (keeping 200 days of data) [2025-10-23T22:56:01.505263] [DEBUG] [LOCAL ] NRG: Primary data saved (53197 records). [2025-10-23T22:56:01.505445] [INFO ] [MAIN ] NRG: Full history saved. [2025-10-23T22:56:01.507106] [INFO ] [MAIN ] Update Progress: 1527/2367 symbols completed. NRG took 41.5s. Estimated remaining: 1h 47m 48s. Rate: 7.8 symbols/min [2025-10-23T22:56:01.604548] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-23T22:56:01.676564] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:01.682385] [DEBUG] [LOCAL ] NRUC: Loaded 3098 existing records from primary storage. [2025-10-23T22:56:01.682609] [INFO ] [MAIN ] NRUC: Loaded 3098 existing records. [2025-10-23T22:56:01.861016] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:01.861432] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-23T22:56:01.861595] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-23T22:56:01.861929] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-23T22:56:01.862007] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-23T22:56:02.116525] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T22:56:02.247867] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:02.399417] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-23T22:56:03.199441] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-23T22:56:03.213925] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T22:56:03.525825] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T22:56:03.999426] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-23T22:56:04.317914] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T22:56:04.613155] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T22:56:04.799428] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-23T22:56:05.444202] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T22:56:05.599436] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-23T22:56:05.703035] [DEBUG] [REMOTE ] NRUC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-23T22:56:05.703380] [WARN ] [REMOTE ] NRUC: No data returned for month 2025-04 [2025-10-23T22:56:05.703479] [FATAL] [REMOTE ] NRUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:56:05.703598] [FATAL] [MAIN ] NRUC: Failed to fetch primary data. [2025-10-23T22:56:05.703708] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:56:05.703796] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-23T22:56:05.703909] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-23T22:56:05.703995] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-23T22:56:05.704173] [DEBUG] [LOCAL ] NRUC: Deleted derivative data file. [2025-10-23T22:56:05.704287] [INFO ] [MAIN ] Update Progress: 1528/2367 symbols completed. NRUC took 4.2s. Estimated remaining: 1h 47m 38s. Rate: 7.8 symbols/min [2025-10-23T22:56:05.868637] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:05.912251] [DEBUG] [LOCAL ] NSA: Loaded 45071 existing records from primary storage. [2025-10-23T22:56:05.912581] [INFO ] [MAIN ] NSA: Loaded 45071 existing records. [2025-10-23T22:56:06.090264] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:06.090484] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-23T22:56:06.090562] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-23T22:56:06.090801] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-23T22:56:06.090876] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-23T22:56:06.409828] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-23T22:56:06.450994] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:07.199455] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-23T22:56:07.999429] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-23T22:56:08.311908] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T22:56:08.320629] [INFO ] [REMOTE ] NRGV: Full fetch complete (62550 records). [2025-10-23T22:56:08.320800] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-23T22:56:08.705358] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-23T22:56:08.705529] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-23T22:56:08.706601] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-23T22:56:08.706742] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-23T22:56:08.728161] [DEBUG] [LOCAL ] NRGV: Trimmed 62550 records to 44291 (keeping 200 days of data) [2025-10-23T22:56:08.731825] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T22:56:08.799406] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-23T22:56:08.849305] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T22:56:08.924147] [INFO ] [REMOTE ] NRK: Full fetch complete (27666 records). [2025-10-23T22:56:08.933521] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-23T22:56:09.172615] [DEBUG] [LOCAL ] NRGV: Primary data saved (44291 records). [2025-10-23T22:56:09.193336] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-23T22:56:09.209099] [INFO ] [MAIN ] Update Progress: 1529/2367 symbols completed. NRGV took 41.0s. Estimated remaining: 1h 47m 28s. Rate: 7.8 symbols/min [2025-10-23T22:56:09.573664] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:09.600576] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-23T22:56:09.602014] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-23T22:56:09.602133] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-23T22:56:09.602806] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-23T22:56:09.603104] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-23T22:56:09.604284] [DEBUG] [LOCAL ] NRK: Trimmed 27666 records to 20613 (keeping 200 days of data) [2025-10-23T22:56:09.730673] [DEBUG] [LOCAL ] NRK: Primary data saved (20613 records). [2025-10-23T22:56:09.741013] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-23T22:56:09.741129] [INFO ] [MAIN ] Update Progress: 1530/2367 symbols completed. NRK took 38.9s. Estimated remaining: 1h 47m 16s. Rate: 7.8 symbols/min [2025-10-23T22:56:09.899095] [DEBUG] [LOCAL ] NSC: Loaded 48653 existing records from primary storage. [2025-10-23T22:56:09.912891] [INFO ] [MAIN ] NSC: Loaded 48653 existing records. [2025-10-23T22:56:09.930186] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:10.112975] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:10.113443] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-23T22:56:10.122191] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-23T22:56:10.123218] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-10-23T22:56:10.123298] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-23T22:56:10.239339] [DEBUG] [LOCAL ] NSP: Loaded 35753 existing records from primary storage. [2025-10-23T22:56:10.284167] [INFO ] [MAIN ] NSP: Loaded 35753 existing records. [2025-10-23T22:56:10.284467] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-23T22:56:10.326498] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T22:56:10.400952] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-23T22:56:10.705573] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:10.724944] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-23T22:56:10.724779] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:10.725062] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-23T22:56:10.725541] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-23T22:56:10.725633] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-23T22:56:11.088005] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:11.199428] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-23T22:56:11.999497] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-23T22:56:12.148315] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T22:56:12.649806] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:56:12.799509] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-23T22:56:13.604581] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-23T22:56:13.632044] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T22:56:14.365499] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T22:56:14.399403] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-23T22:56:15.050588] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T22:56:15.199430] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-23T22:56:15.999454] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-23T22:56:16.246488] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T22:56:16.373913] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-23T22:56:16.799436] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-23T22:56:16.971058] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T22:56:17.599426] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-23T22:56:17.612208] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T22:56:18.399426] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-23T22:56:19.199468] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-23T22:56:19.246804] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T22:56:19.822425] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T22:56:19.999411] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-23T22:56:20.261469] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T22:56:20.393413] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-23T22:56:20.395118] [INFO ] [REMOTE ] NRT: Full fetch complete (7657 records). [2025-10-23T22:56:20.395217] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-23T22:56:20.793371] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-23T22:56:20.793480] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-23T22:56:20.793766] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-23T22:56:20.793843] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-23T22:56:20.794259] [DEBUG] [LOCAL ] NRT: Trimmed 7657 records to 4930 (keeping 200 days of data) [2025-10-23T22:56:20.805521] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-23T22:56:20.827623] [DEBUG] [LOCAL ] NRT: Primary data saved (4930 records). [2025-10-23T22:56:20.827775] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-23T22:56:20.827931] [INFO ] [MAIN ] Update Progress: 1531/2367 symbols completed. NRT took 27.8s. Estimated remaining: 1h 47m 11s. Rate: 7.8 symbols/min [2025-10-23T22:56:20.995151] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:21.013859] [DEBUG] [LOCAL ] NTB: Loaded 20182 existing records from primary storage. [2025-10-23T22:56:21.014145] [INFO ] [MAIN ] NTB: Loaded 20182 existing records. [2025-10-23T22:56:21.186393] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:21.186604] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-23T22:56:21.186703] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-23T22:56:21.186934] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-23T22:56:21.187004] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-23T22:56:21.537273] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:21.599398] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-23T22:56:22.367429] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T22:56:22.399398] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-23T22:56:22.735157] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T22:56:23.199438] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-23T22:56:23.969425] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T22:56:23.999402] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-23T22:56:24.191394] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T22:56:24.799442] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-23T22:56:25.606245] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-23T22:56:25.607787] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T22:56:25.905777] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T22:56:26.399433] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-23T22:56:27.199458] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-23T22:56:27.340110] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T22:56:27.796742] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T22:56:27.999400] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-23T22:56:28.380690] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T22:56:28.799442] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-23T22:56:29.599434] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-23T22:56:29.732162] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T22:56:30.399415] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-23T22:56:30.573506] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T22:56:30.724778] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T22:56:31.199442] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-23T22:56:31.999427] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-23T22:56:32.060913] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T22:56:32.799421] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-23T22:56:32.843615] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T22:56:33.067065] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T22:56:33.599443] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-23T22:56:34.399450] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-23T22:56:34.751592] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T22:56:35.023315] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T22:56:35.199445] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-23T22:56:35.731474] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T22:56:35.999485] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-23T22:56:36.739743] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T22:56:36.799410] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-23T22:56:37.574205] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T22:56:37.582299] [INFO ] [REMOTE ] NSA: Full fetch complete (62864 records). [2025-10-23T22:56:37.582455] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-23T22:56:37.604753] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-23T22:56:38.009486] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-23T22:56:38.009624] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-23T22:56:38.010736] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-23T22:56:38.010816] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-23T22:56:38.012223] [DEBUG] [LOCAL ] NSA: Trimmed 62864 records to 45453 (keeping 200 days of data) [2025-10-23T22:56:38.293458] [DEBUG] [LOCAL ] NSA: Primary data saved (45453 records). [2025-10-23T22:56:38.293731] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-23T22:56:38.295425] [INFO ] [MAIN ] Update Progress: 1532/2367 symbols completed. NSA took 32.6s. Estimated remaining: 1h 47m 8s. Rate: 7.8 symbols/min [2025-10-23T22:56:38.388746] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T22:56:38.399874] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-23T22:56:38.502938] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:38.503130] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-23T22:56:38.503199] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-23T22:56:38.503307] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-23T22:56:38.503377] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-23T22:56:38.503456] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-23T22:56:38.503524] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-23T22:56:38.867260] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:39.199450] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-23T22:56:39.447578] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-23T22:56:39.497517] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T22:56:39.900568] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-23T22:56:39.999473] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-23T22:56:40.528870] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T22:56:40.799461] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-23T22:56:41.599513] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-23T22:56:42.399493] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-23T22:56:42.845118] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T22:56:42.846906] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-23T22:56:42.984340] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T22:56:42.991112] [INFO ] [REMOTE ] NSP: Full fetch complete (50328 records). [2025-10-23T22:56:42.991282] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-23T22:56:43.204994] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-23T22:56:43.441659] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-23T22:56:43.441769] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-23T22:56:43.442661] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-23T22:56:43.442739] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-23T22:56:43.443725] [DEBUG] [LOCAL ] NSP: Trimmed 50328 records to 36010 (keeping 200 days of data) [2025-10-23T22:56:43.655911] [DEBUG] [LOCAL ] NSP: Primary data saved (36010 records). [2025-10-23T22:56:43.656077] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-23T22:56:43.656191] [INFO ] [MAIN ] Update Progress: 1533/2367 symbols completed. NSP took 33.9s. Estimated remaining: 1h 46m 59s. Rate: 7.8 symbols/min [2025-10-23T22:56:43.839952] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:43.885975] [DEBUG] [LOCAL ] NTR: Loaded 52631 existing records from primary storage. [2025-10-23T22:56:43.886335] [INFO ] [MAIN ] NTR: Loaded 52631 existing records. [2025-10-23T22:56:44.004548] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-23T22:56:44.069552] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:44.069799] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-23T22:56:44.069878] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-23T22:56:44.070452] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-23T22:56:44.070526] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-23T22:56:44.489827] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:44.492608] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T22:56:44.804531] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-23T22:56:44.816342] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:56:44.825062] [INFO ] [REMOTE ] NSC: Full fetch complete (70903 records). [2025-10-23T22:56:44.825221] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-23T22:56:45.218741] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-10-23T22:56:45.218859] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-10-23T22:56:45.219912] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-10-23T22:56:45.219991] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-10-23T22:56:45.221370] [DEBUG] [LOCAL ] NSC: Trimmed 70903 records to 49001 (keeping 200 days of data) [2025-10-23T22:56:45.522755] [DEBUG] [LOCAL ] NSC: Primary data saved (49001 records). [2025-10-23T22:56:45.523027] [INFO ] [MAIN ] NSC: Full history saved. [2025-10-23T22:56:45.523969] [INFO ] [MAIN ] Update Progress: 1534/2367 symbols completed. NSC took 36.3s. Estimated remaining: 1h 46m 48s. Rate: 7.8 symbols/min [2025-10-23T22:56:45.604626] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-23T22:56:45.692738] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:45.735012] [DEBUG] [LOCAL ] NTST: Loaded 44049 existing records from primary storage. [2025-10-23T22:56:45.735323] [INFO ] [MAIN ] NTST: Loaded 44049 existing records. [2025-10-23T22:56:45.919378] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:45.923320] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-23T22:56:45.924037] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-23T22:56:45.924492] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T22:56:45.929061] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-23T22:56:45.929437] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-23T22:56:46.276341] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:46.399397] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-23T22:56:47.055172] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:56:47.199391] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-23T22:56:47.853639] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T22:56:47.999400] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-23T22:56:48.458983] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T22:56:48.799439] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-23T22:56:48.978350] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T22:56:49.248667] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-23T22:56:49.599435] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-23T22:56:50.399447] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-23T22:56:51.199462] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-23T22:56:51.327333] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T22:56:51.411698] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-23T22:56:51.999422] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-23T22:56:52.532985] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-23T22:56:52.799419] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-23T22:56:53.005738] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-23T22:56:53.434625] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-23T22:56:53.599458] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-23T22:56:54.399456] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-23T22:56:54.691107] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T22:56:54.695179] [INFO ] [REMOTE ] NTB: Full fetch complete (30763 records). [2025-10-23T22:56:54.695283] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-23T22:56:55.092702] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-23T22:56:55.092816] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-23T22:56:55.093440] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-23T22:56:55.093509] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-23T22:56:55.094257] [DEBUG] [LOCAL ] NTB: Trimmed 30763 records to 20317 (keeping 200 days of data) [2025-10-23T22:56:55.200604] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-23T22:56:55.218192] [DEBUG] [LOCAL ] NTB: Primary data saved (20317 records). [2025-10-23T22:56:55.218314] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-23T22:56:55.218420] [INFO ] [MAIN ] Update Progress: 1535/2367 symbols completed. NTB took 34.4s. Estimated remaining: 1h 46m 42s. Rate: 7.8 symbols/min [2025-10-23T22:56:55.391181] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:56:55.441503] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-23T22:56:55.441878] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-10-23T22:56:55.622206] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:56:55.622444] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-23T22:56:55.622518] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-23T22:56:55.622785] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-23T22:56:55.622859] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-23T22:56:55.975768] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:56:55.999445] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-23T22:56:56.298686] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T22:56:56.799479] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-23T22:56:56.869957] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T22:56:57.599472] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-23T22:56:58.144390] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T22:56:58.306258] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-23T22:56:58.409444] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-23T22:56:58.414909] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T22:56:59.199430] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-23T22:56:59.664175] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-23T22:56:59.882072] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T22:56:59.999445] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-23T22:57:00.799461] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-23T22:57:01.599417] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-23T22:57:01.711960] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T22:57:02.052633] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T22:57:02.053393] [INFO ] [REMOTE ] NTEST: Full fetch complete (1964 records). [2025-10-23T22:57:02.053481] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-23T22:57:02.232876] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-23T22:57:02.233120] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:57:02.233329] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:57:02.233405] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-23T22:57:02.233500] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-23T22:57:02.233579] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-23T22:57:02.233685] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-23T22:57:02.233779] [INFO ] [MAIN ] Update Progress: 1536/2367 symbols completed. NTEST took 23.9s. Estimated remaining: 1h 46m 34s. Rate: 7.8 symbols/min [2025-10-23T22:57:02.411062] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-23T22:57:02.414774] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T22:57:02.433022] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:02.437113] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-23T22:57:02.442155] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-23T22:57:02.442965] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-23T22:57:02.443039] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-23T22:57:02.443392] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-23T22:57:02.443461] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-23T22:57:02.800719] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:03.199442] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-23T22:57:03.999439] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-23T22:57:04.710876] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-23T22:57:04.799400] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-23T22:57:04.936477] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-23T22:57:05.599476] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-23T22:57:05.842116] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T22:57:06.399435] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-23T22:57:07.199462] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-23T22:57:07.263814] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-23T22:57:07.317204] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T22:57:07.674445] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T22:57:07.999469] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-23T22:57:08.799467] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-23T22:57:08.970593] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T22:57:09.599456] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-23T22:57:10.235267] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-23T22:57:10.399419] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-23T22:57:10.892576] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-23T22:57:11.026573] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T22:57:11.199415] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-23T22:57:11.999424] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-23T22:57:12.491919] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T22:57:12.765852] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T22:57:12.773994] [INFO ] [REMOTE ] NTST: Full fetch complete (61889 records). [2025-10-23T22:57:12.774164] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-23T22:57:12.807170] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-23T22:57:13.195136] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-23T22:57:13.195287] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-23T22:57:13.196763] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-23T22:57:13.196850] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-23T22:57:13.198599] [DEBUG] [LOCAL ] NTST: Trimmed 61889 records to 44366 (keeping 200 days of data) [2025-10-23T22:57:13.494005] [DEBUG] [LOCAL ] NTST: Primary data saved (44366 records). [2025-10-23T22:57:13.494244] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-23T22:57:13.494409] [INFO ] [MAIN ] Update Progress: 1537/2367 symbols completed. NTST took 28.0s. Estimated remaining: 1h 46m 28s. Rate: 7.8 symbols/min [2025-10-23T22:57:13.601543] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-23T22:57:13.678110] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:13.711370] [DEBUG] [LOCAL ] NUS: Loaded 36083 existing records from primary storage. [2025-10-23T22:57:13.711707] [INFO ] [MAIN ] NUS: Loaded 36083 existing records. [2025-10-23T22:57:13.895577] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:13.895946] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-23T22:57:13.896111] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-23T22:57:13.896438] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-23T22:57:13.896524] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-23T22:57:14.213695] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-23T22:57:14.300187] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:14.399396] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-23T22:57:14.975277] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-23T22:57:15.199435] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-23T22:57:15.739314] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-23T22:57:15.863493] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T22:57:15.999491] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-23T22:57:16.799435] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-23T22:57:17.361410] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-23T22:57:17.599430] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-23T22:57:18.300773] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-23T22:57:18.399426] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-23T22:57:18.746793] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T22:57:18.756569] [INFO ] [REMOTE ] NTR: Full fetch complete (76490 records). [2025-10-23T22:57:18.756759] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-23T22:57:19.197754] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-23T22:57:19.198140] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-23T22:57:19.199332] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-23T22:57:19.199565] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-23T22:57:19.199715] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-23T22:57:19.202284] [DEBUG] [LOCAL ] NTR: Trimmed 76490 records to 53001 (keeping 200 days of data) [2025-10-23T22:57:19.467836] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T22:57:19.563053] [DEBUG] [LOCAL ] NTR: Primary data saved (53001 records). [2025-10-23T22:57:19.563218] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-23T22:57:19.563333] [INFO ] [MAIN ] Update Progress: 1538/2367 symbols completed. NTR took 35.9s. Estimated remaining: 1h 46m 19s. Rate: 7.8 symbols/min [2025-10-23T22:57:19.734283] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:19.754771] [DEBUG] [LOCAL ] NUV: Loaded 23286 existing records from primary storage. [2025-10-23T22:57:19.755091] [INFO ] [MAIN ] NUV: Loaded 23286 existing records. [2025-10-23T22:57:19.928860] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:19.929113] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-23T22:57:19.929220] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-23T22:57:19.929604] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-23T22:57:19.929719] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-23T22:57:20.005451] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-23T22:57:20.290920] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:20.573492] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-23T22:57:20.786859] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-23T22:57:20.799400] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-23T22:57:21.599469] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-23T22:57:21.954408] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T22:57:22.115346] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T22:57:22.301693] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-23T22:57:22.399424] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-23T22:57:23.199448] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-23T22:57:23.971448] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T22:57:23.999396] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-23T22:57:24.799419] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-23T22:57:25.129843] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T22:57:25.394320] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-23T22:57:25.599432] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-23T22:57:26.399421] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-23T22:57:26.491303] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T22:57:26.701464] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-23T22:57:27.199526] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-23T22:57:27.929525] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T22:57:27.999455] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-23T22:57:28.799420] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-23T22:57:29.208913] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-23T22:57:29.218141] [INFO ] [REMOTE ] NU: Full fetch complete (77925 records). [2025-10-23T22:57:29.218292] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-23T22:57:29.539935] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T22:57:29.605431] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-23T22:57:29.646420] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-23T22:57:29.646533] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-23T22:57:29.647687] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-23T22:57:29.647903] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-23T22:57:29.649328] [DEBUG] [LOCAL ] NU: Trimmed 77925 records to 54136 (keeping 200 days of data) [2025-10-23T22:57:29.971216] [DEBUG] [LOCAL ] NU: Primary data saved (54136 records). [2025-10-23T22:57:29.971441] [INFO ] [MAIN ] NU: Full history saved. [2025-10-23T22:57:29.971553] [INFO ] [MAIN ] Update Progress: 1539/2367 symbols completed. NU took 34.8s. Estimated remaining: 1h 46m 13s. Rate: 7.8 symbols/min [2025-10-23T22:57:30.191317] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:30.193150] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T22:57:30.245193] [DEBUG] [LOCAL ] NUVB: Loaded 51712 existing records from primary storage. [2025-10-23T22:57:30.245531] [INFO ] [MAIN ] NUVB: Loaded 51712 existing records. [2025-10-23T22:57:30.404024] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-23T22:57:30.428350] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:30.429500] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-23T22:57:30.429576] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-23T22:57:30.429838] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-23T22:57:30.429913] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-23T22:57:30.786179] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:30.802453] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T22:57:31.199455] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-23T22:57:31.999424] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-23T22:57:32.465232] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-23T22:57:32.759592] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T22:57:32.799452] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-23T22:57:33.575928] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T22:57:33.599399] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-23T22:57:34.399432] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-23T22:57:34.672073] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T22:57:35.036478] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T22:57:35.199472] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-23T22:57:35.732278] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-23T22:57:35.999413] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-23T22:57:36.799540] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-23T22:57:36.912247] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T22:57:37.044000] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T22:57:37.599442] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-23T22:57:37.969320] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T22:57:38.399456] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-23T22:57:38.810399] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-23T22:57:39.127904] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T22:57:39.136807] [INFO ] [REMOTE ] NUE: Full fetch complete (74764 records). [2025-10-23T22:57:39.137009] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-23T22:57:39.204603] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-23T22:57:39.336669] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T22:57:39.337405] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-23T22:57:39.337498] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-23T22:57:39.337576] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-23T22:57:39.337698] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-23T22:57:39.337771] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-23T22:57:39.337873] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-23T22:57:39.337971] [INFO ] [MAIN ] Update Progress: 1540/2367 symbols completed. NUE took 37.1s. Estimated remaining: 1h 46m 6s. Rate: 7.8 symbols/min [2025-10-23T22:57:39.502308] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:39.510447] [DEBUG] [LOCAL ] NUW: Loaded 6639 existing records from primary storage. [2025-10-23T22:57:39.510736] [INFO ] [MAIN ] NUW: Loaded 6639 existing records. [2025-10-23T22:57:39.685377] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:39.685586] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-23T22:57:39.685687] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-23T22:57:39.685919] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-23T22:57:39.685996] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-23T22:57:40.004548] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-23T22:57:40.066418] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:40.681035] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T22:57:40.686861] [INFO ] [REMOTE ] NUS: Full fetch complete (53120 records). [2025-10-23T22:57:40.686988] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-23T22:57:40.804574] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-23T22:57:41.074328] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-23T22:57:41.074451] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-23T22:57:41.075588] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-23T22:57:41.075696] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-23T22:57:41.076971] [DEBUG] [LOCAL ] NUS: Trimmed 53120 records to 36280 (keeping 200 days of data) [2025-10-23T22:57:41.309886] [DEBUG] [LOCAL ] NUS: Primary data saved (36280 records). [2025-10-23T22:57:41.310853] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-23T22:57:41.311784] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T22:57:41.312068] [INFO ] [MAIN ] Update Progress: 1541/2367 symbols completed. NUS took 27.8s. Estimated remaining: 1h 45m 56s. Rate: 7.8 symbols/min [2025-10-23T22:57:41.493441] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:41.522165] [DEBUG] [LOCAL ] NVG: Loaded 27394 existing records from primary storage. [2025-10-23T22:57:41.522468] [INFO ] [MAIN ] NVG: Loaded 27394 existing records. [2025-10-23T22:57:41.604692] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-23T22:57:41.704154] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:41.704394] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-23T22:57:41.704470] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-23T22:57:41.704728] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-23T22:57:41.704801] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-23T22:57:42.061007] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:42.399427] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-23T22:57:42.477968] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T22:57:42.857480] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T22:57:43.199411] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-23T22:57:43.283431] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T22:57:43.999405] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-23T22:57:44.395896] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T22:57:44.400752] [INFO ] [REMOTE ] NUV: Full fetch complete (33835 records). [2025-10-23T22:57:44.400862] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-23T22:57:44.698631] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T22:57:44.771979] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-23T22:57:44.772074] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-23T22:57:44.772782] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-23T22:57:44.772860] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-23T22:57:44.773610] [DEBUG] [LOCAL ] NUV: Trimmed 33835 records to 23426 (keeping 200 days of data) [2025-10-23T22:57:44.822217] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-23T22:57:44.909369] [DEBUG] [LOCAL ] NUV: Primary data saved (23426 records). [2025-10-23T22:57:44.909524] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-23T22:57:44.909635] [INFO ] [MAIN ] Update Progress: 1542/2367 symbols completed. NUV took 25.3s. Estimated remaining: 1h 45m 46s. Rate: 7.8 symbols/min [2025-10-23T22:57:45.078247] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:45.108135] [DEBUG] [LOCAL ] NVGS: Loaded 29948 existing records from primary storage. [2025-10-23T22:57:45.108434] [INFO ] [MAIN ] NVGS: Loaded 29948 existing records. [2025-10-23T22:57:45.282660] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:45.282916] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-23T22:57:45.283007] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-23T22:57:45.283256] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-23T22:57:45.283338] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-23T22:57:45.637083] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:45.606016] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-23T22:57:45.705238] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T22:57:46.399429] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-23T22:57:47.199417] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-23T22:57:47.348123] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T22:57:47.418072] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T22:57:47.999416] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-23T22:57:48.321173] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T22:57:48.728740] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T22:57:48.799461] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-23T22:57:49.504788] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-23T22:57:49.599411] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-23T22:57:50.399420] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-23T22:57:50.792436] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T22:57:51.090328] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T22:57:51.199450] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-23T22:57:51.999501] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-23T22:57:52.290631] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T22:57:52.629356] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T22:57:52.799418] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-23T22:57:53.599438] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-23T22:57:54.214851] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T22:57:54.399438] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-23T22:57:54.466376] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T22:57:54.900577] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-23T22:57:54.901776] [INFO ] [REMOTE ] NUW: Full fetch complete (10675 records). [2025-10-23T22:57:54.901866] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-23T22:57:55.204602] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-23T22:57:55.272446] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-23T22:57:55.272578] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-23T22:57:55.272929] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-23T22:57:55.273007] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-23T22:57:55.273830] [DEBUG] [LOCAL ] NUW: Trimmed 10675 records to 6664 (keeping 200 days of data) [2025-10-23T22:57:55.316144] [DEBUG] [LOCAL ] NUW: Primary data saved (6664 records). [2025-10-23T22:57:55.316321] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-23T22:57:55.316463] [INFO ] [MAIN ] Update Progress: 1543/2367 symbols completed. NUW took 16.0s. Estimated remaining: 1h 45m 39s. Rate: 7.8 symbols/min [2025-10-23T22:57:55.483445] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:57:55.535002] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-23T22:57:55.535389] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-10-23T22:57:55.741105] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:57:55.741404] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-23T22:57:55.741493] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-23T22:57:55.741802] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-23T22:57:55.741891] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-23T22:57:56.007303] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-23T22:57:56.099883] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:57:56.510711] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T22:57:56.799449] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-23T22:57:57.599437] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-23T22:57:57.794631] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T22:57:58.399435] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-23T22:57:58.650712] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T22:57:58.815831] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T22:57:59.199439] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-23T22:57:59.999414] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-23T22:58:00.532529] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T22:58:00.559112] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-23T22:58:00.799433] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-23T22:58:01.599436] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-23T22:58:02.056248] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T22:58:02.272257] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-23T22:58:02.399460] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-23T22:58:02.895680] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T22:58:03.199441] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-23T22:58:03.628375] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T22:58:03.999433] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-23T22:58:04.573860] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-23T22:58:04.799419] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-23T22:58:05.568557] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T22:58:05.599402] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-23T22:58:06.161925] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T22:58:06.399441] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-23T22:58:07.199415] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-23T22:58:07.597964] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T22:58:07.819322] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T22:58:07.999415] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-23T22:58:08.518896] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T22:58:08.799451] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-23T22:58:09.599443] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-23T22:58:10.319412] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T22:58:10.399407] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-23T22:58:10.649606] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-23T22:58:10.989953] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T22:58:11.199436] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-23T22:58:11.688143] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T22:58:11.999431] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-23T22:58:12.799450] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-23T22:58:13.599410] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-23T22:58:13.866023] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-23T22:58:13.897970] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T22:58:13.986696] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T22:58:13.995827] [INFO ] [REMOTE ] NUVB: Full fetch complete (73530 records). [2025-10-23T22:58:13.995982] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-23T22:58:14.382626] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-23T22:58:14.382896] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-23T22:58:14.384202] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-23T22:58:14.384330] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-23T22:58:14.397565] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T22:58:14.402583] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-23T22:58:14.404144] [INFO ] [REMOTE ] NVG: Full fetch complete (39353 records). [2025-10-23T22:58:14.404271] [DEBUG] [LOCAL ] NUVB: Trimmed 73530 records to 52098 (keeping 200 days of data) [2025-10-23T22:58:14.404463] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-23T22:58:15.090337] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-23T22:58:15.094415] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-23T22:58:15.096542] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-23T22:58:15.111719] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-23T22:58:15.113811] [DEBUG] [LOCAL ] NUVB: Primary data saved (52098 records). [2025-10-23T22:58:15.114138] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-23T22:58:15.114718] [INFO ] [MAIN ] Update Progress: 1544/2367 symbols completed. NUVB took 45.1s. Estimated remaining: 1h 45m 38s. Rate: 7.8 symbols/min [2025-10-23T22:58:15.126469] [DEBUG] [LOCAL ] NVG: Trimmed 39353 records to 27531 (keeping 200 days of data) [2025-10-23T22:58:15.239797] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-23T22:58:15.407390] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:15.411376] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-23T22:58:15.412113] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-23T22:58:15.422588] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-23T22:58:15.422955] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-23T22:58:15.423503] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-23T22:58:15.442275] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-23T22:58:15.594101] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T22:58:15.601693] [DEBUG] [LOCAL ] NVG: Primary data saved (27531 records). [2025-10-23T22:58:15.617868] [INFO ] [REMOTE ] NVGS: Full fetch complete (41867 records). [2025-10-23T22:58:15.623155] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-23T22:58:15.652682] [INFO ] [MAIN ] Update Progress: 1545/2367 symbols completed. NVG took 34.3s. Estimated remaining: 1h 45m 27s. Rate: 7.8 symbols/min [2025-10-23T22:58:15.652948] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-23T22:58:16.151705] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:16.194803] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:16.247224] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-23T22:58:16.443852] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-23T22:58:16.444027] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-23T22:58:16.454616] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-23T22:58:16.455618] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-23T22:58:16.456454] [DEBUG] [LOCAL ] NVRI: Loaded 38962 existing records from primary storage. [2025-10-23T22:58:16.457008] [INFO ] [MAIN ] NVRI: Loaded 38962 existing records. [2025-10-23T22:58:16.520498] [DEBUG] [LOCAL ] NVGS: Trimmed 41867 records to 30091 (keeping 200 days of data) [2025-10-23T22:58:16.744029] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:58:16.750874] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-23T22:58:16.751998] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-23T22:58:16.753933] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-23T22:58:16.754799] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-23T22:58:17.031694] [DEBUG] [LOCAL ] NVGS: Primary data saved (30091 records). [2025-10-23T22:58:17.043046] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-23T22:58:17.068887] [INFO ] [MAIN ] Update Progress: 1546/2367 symbols completed. NVGS took 32.2s. Estimated remaining: 1h 45m 16s. Rate: 7.8 symbols/min [2025-10-23T22:58:17.291564] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:17.325045] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-23T22:58:17.359593] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:17.408483] [DEBUG] [LOCAL ] NVS: Loaded 51301 existing records from primary storage. [2025-10-23T22:58:17.408986] [INFO ] [MAIN ] NVS: Loaded 51301 existing records. [2025-10-23T22:58:17.589310] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:58:17.589853] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-23T22:58:17.590009] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-23T22:58:17.602423] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-23T22:58:17.602542] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-23T22:58:17.650477] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T22:58:17.677358] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-23T22:58:17.968569] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:18.106441] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-23T22:58:18.399407] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-23T22:58:18.738043] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T22:58:18.803226] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T22:58:19.199517] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-23T22:58:19.999466] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-23T22:58:20.113338] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T22:58:20.279417] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T22:58:20.799464] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-23T22:58:20.915795] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-23T22:58:21.599448] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-23T22:58:22.399400] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-23T22:58:22.589009] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T22:58:22.679525] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T22:58:23.199418] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-23T22:58:23.999439] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-23T22:58:24.415809] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T22:58:24.799425] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-23T22:58:25.008752] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-23T22:58:25.509624] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T22:58:25.599398] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-23T22:58:25.881560] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T22:58:26.399445] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-23T22:58:27.058452] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T22:58:27.199537] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-23T22:58:27.999447] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-23T22:58:28.420806] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T22:58:28.799429] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-23T22:58:28.843718] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-23T22:58:29.098856] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T22:58:29.599498] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-23T22:58:29.935895] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T22:58:30.399438] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-23T22:58:31.199449] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-23T22:58:31.999408] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-23T22:58:32.260174] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T22:58:32.393717] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-23T22:58:32.793337] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T22:58:32.802039] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-23T22:58:32.857287] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T22:58:33.599447] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-23T22:58:34.399512] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-23T22:58:35.182936] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T22:58:35.199390] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-23T22:58:35.405559] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T22:58:35.517522] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-23T22:58:35.999455] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-23T22:58:36.385895] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T22:58:36.394298] [INFO ] [REMOTE ] NVRI: Full fetch complete (56019 records). [2025-10-23T22:58:36.394475] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-23T22:58:36.790826] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-23T22:58:36.790998] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-23T22:58:36.792553] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-23T22:58:36.792662] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-23T22:58:36.794350] [DEBUG] [LOCAL ] NVRI: Trimmed 56019 records to 39257 (keeping 200 days of data) [2025-10-23T22:58:36.839558] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-23T22:58:37.037165] [DEBUG] [LOCAL ] NVRI: Primary data saved (39257 records). [2025-10-23T22:58:37.037446] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-23T22:58:37.037617] [INFO ] [MAIN ] Update Progress: 1547/2367 symbols completed. NVRI took 21.4s. Estimated remaining: 1h 45m 14s. Rate: 7.8 symbols/min [2025-10-23T22:58:37.212911] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:37.265735] [DEBUG] [LOCAL ] NVST: Loaded 51406 existing records from primary storage. [2025-10-23T22:58:37.266195] [INFO ] [MAIN ] NVST: Loaded 51406 existing records. [2025-10-23T22:58:37.448819] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:58:37.449126] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-23T22:58:37.449208] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-23T22:58:37.449822] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-23T22:58:37.449901] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-23T22:58:37.606391] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-23T22:58:37.827619] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:38.300249] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T22:58:38.399397] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-23T22:58:38.745184] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T22:58:38.793344] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-23T22:58:38.794733] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-23T22:58:38.807534] [INFO ] [REMOTE ] NVR: Full fetch complete (29093 records). [2025-10-23T22:58:38.807863] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-23T22:58:38.851201] [INFO ] [REMOTE ] NVO: Full fetch complete (77964 records). [2025-10-23T22:58:38.889236] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-23T22:58:39.212497] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-23T22:58:39.558462] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-23T22:58:39.563525] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-23T22:58:39.580342] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-23T22:58:39.584434] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-23T22:58:39.584332] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-23T22:58:39.584829] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-23T22:58:39.586088] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-23T22:58:39.586421] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-23T22:58:39.586894] [DEBUG] [LOCAL ] NVR: Trimmed 29093 records to 18511 (keeping 200 days of data) [2025-10-23T22:58:39.588517] [DEBUG] [LOCAL ] NVO: Trimmed 77964 records to 54174 (keeping 200 days of data) [2025-10-23T22:58:39.805914] [DEBUG] [LOCAL ] NVR: Primary data saved (18511 records). [2025-10-23T22:58:39.809981] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-23T22:58:39.812316] [INFO ] [MAIN ] Update Progress: 1548/2367 symbols completed. NVR took 24.7s. Estimated remaining: 1h 45m 4s. Rate: 7.8 symbols/min [2025-10-23T22:58:40.015014] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-23T22:58:40.088778] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:40.235385] [DEBUG] [LOCAL ] NVO: Primary data saved (54174 records). [2025-10-23T22:58:40.236394] [DEBUG] [LOCAL ] NVT: Loaded 51415 existing records from primary storage. [2025-10-23T22:58:40.236593] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-23T22:58:40.238187] [INFO ] [MAIN ] Update Progress: 1549/2367 symbols completed. NVO took 44.9s. Estimated remaining: 1h 44m 53s. Rate: 7.8 symbols/min [2025-10-23T22:58:40.238326] [INFO ] [MAIN ] NVT: Loaded 51415 existing records. [2025-10-23T22:58:40.565534] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:40.584186] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:58:40.584821] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-23T22:58:40.584895] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-23T22:58:40.585267] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-23T22:58:40.585339] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-23T22:58:40.974634] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:40.977343] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-23T22:58:40.977024] [DEBUG] [LOCAL ] NWG: Loaded 51400 existing records from primary storage. [2025-10-23T22:58:40.978970] [INFO ] [MAIN ] NWG: Loaded 51400 existing records. [2025-10-23T22:58:41.162034] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:58:41.162440] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-23T22:58:41.162531] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-23T22:58:41.162992] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-23T22:58:41.163073] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-23T22:58:41.299581] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-23T22:58:41.562504] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:41.599395] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-23T22:58:41.688504] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T22:58:42.399412] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-23T22:58:42.551112] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T22:58:43.199472] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-23T22:58:43.398702] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T22:58:43.999418] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-23T22:58:44.047447] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T22:58:44.799437] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-23T22:58:44.941529] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T22:58:45.377882] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T22:58:45.599458] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-23T22:58:46.354918] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T22:58:46.399404] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-23T22:58:47.199421] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-23T22:58:47.586520] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T22:58:47.999482] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-23T22:58:48.133461] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T22:58:48.799420] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-23T22:58:49.188361] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T22:58:49.599423] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-23T22:58:49.636543] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T22:58:50.399413] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-23T22:58:50.482919] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T22:58:51.199410] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-23T22:58:51.635303] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T22:58:51.866582] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T22:58:51.999469] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-23T22:58:52.718560] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T22:58:52.799414] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-23T22:58:53.347239] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T22:58:53.599460] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-23T22:58:54.401150] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-23T22:58:54.406334] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T22:58:54.415479] [INFO ] [REMOTE ] NVS: Full fetch complete (74951 records). [2025-10-23T22:58:54.415621] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-23T22:58:54.801599] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-23T22:58:54.801741] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-23T22:58:54.802836] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-23T22:58:54.802934] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-23T22:58:54.804331] [DEBUG] [LOCAL ] NVS: Trimmed 74951 records to 51660 (keeping 200 days of data) [2025-10-23T22:58:55.103782] [DEBUG] [LOCAL ] NVS: Primary data saved (51660 records). [2025-10-23T22:58:55.103954] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-23T22:58:55.104084] [INFO ] [MAIN ] Update Progress: 1550/2367 symbols completed. NVS took 38.0s. Estimated remaining: 1h 44m 49s. Rate: 7.8 symbols/min [2025-10-23T22:58:55.203300] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-23T22:58:55.276138] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:58:55.302047] [DEBUG] [LOCAL ] NWN: Loaded 26434 existing records from primary storage. [2025-10-23T22:58:55.302360] [INFO ] [MAIN ] NWN: Loaded 26434 existing records. [2025-10-23T22:58:55.479439] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:58:55.506501] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-23T22:58:55.507147] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-23T22:58:55.508122] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T22:58:55.518896] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-23T22:58:55.519118] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-23T22:58:55.895300] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:58:55.999408] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-23T22:58:56.316453] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T22:58:56.799491] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-23T22:58:57.004267] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T22:58:57.599413] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-23T22:58:57.754972] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T22:58:58.399412] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-23T22:58:58.492222] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T22:58:59.199431] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-23T22:58:59.308291] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T22:58:59.999484] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-23T22:59:00.272570] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T22:59:00.799405] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-23T22:59:00.872384] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T22:59:01.111545] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T22:59:01.599459] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-23T22:59:02.399406] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-23T22:59:02.462825] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T22:59:02.471666] [INFO ] [REMOTE ] NVST: Full fetch complete (74447 records). [2025-10-23T22:59:02.471822] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-23T22:59:02.856882] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-23T22:59:02.857008] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-23T22:59:02.858084] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-23T22:59:02.858174] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-23T22:59:02.859683] [DEBUG] [LOCAL ] NVST: Trimmed 74447 records to 51815 (keeping 200 days of data) [2025-10-23T22:59:03.149056] [DEBUG] [LOCAL ] NVST: Primary data saved (51815 records). [2025-10-23T22:59:03.149205] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-23T22:59:03.149315] [INFO ] [MAIN ] Update Progress: 1551/2367 symbols completed. NVST took 26.1s. Estimated remaining: 1h 44m 41s. Rate: 7.8 symbols/min [2025-10-23T22:59:03.211558] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-23T22:59:03.324857] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:59:03.355117] [DEBUG] [LOCAL ] NX: Loaded 33325 existing records from primary storage. [2025-10-23T22:59:03.355444] [INFO ] [MAIN ] NX: Loaded 33325 existing records. [2025-10-23T22:59:03.543737] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:59:03.544065] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-23T22:59:03.544343] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-23T22:59:03.544758] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-23T22:59:03.544878] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-23T22:59:03.725012] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-23T22:59:03.956131] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:59:03.999432] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-23T22:59:04.062795] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T22:59:04.124992] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T22:59:04.799426] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-23T22:59:05.037476] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T22:59:05.599432] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-23T22:59:05.947322] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T22:59:06.399489] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-23T22:59:07.199438] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-23T22:59:07.389042] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T22:59:07.778349] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T22:59:07.999415] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-23T22:59:08.799442] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-23T22:59:08.877310] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T22:59:09.493770] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T22:59:09.599396] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-23T22:59:10.399422] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-23T22:59:10.595684] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T22:59:10.604780] [INFO ] [REMOTE ] NWG: Full fetch complete (74079 records). [2025-10-23T22:59:10.604916] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-23T22:59:10.898584] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T22:59:11.023521] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-23T22:59:11.023633] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-23T22:59:11.024847] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-23T22:59:11.024951] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-23T22:59:11.026418] [DEBUG] [LOCAL ] NWG: Trimmed 74079 records to 51774 (keeping 200 days of data) [2025-10-23T22:59:11.206494] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-23T22:59:11.334957] [DEBUG] [LOCAL ] NWG: Primary data saved (51774 records). [2025-10-23T22:59:11.335112] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-23T22:59:11.336384] [INFO ] [MAIN ] Update Progress: 1552/2367 symbols completed. NWG took 31.1s. Estimated remaining: 1h 44m 34s. Rate: 7.8 symbols/min [2025-10-23T22:59:11.507457] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:59:11.515200] [DEBUG] [LOCAL ] NXC: Loaded 4057 existing records from primary storage. [2025-10-23T22:59:11.515440] [INFO ] [MAIN ] NXC: Loaded 4057 existing records. [2025-10-23T22:59:11.692066] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:59:11.692250] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-23T22:59:11.692321] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-23T22:59:11.692515] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-23T22:59:11.692589] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-23T22:59:12.002738] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-23T22:59:12.057334] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:59:12.146361] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T22:59:12.694368] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T22:59:12.799409] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-23T22:59:13.161894] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T22:59:13.256796] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T22:59:13.599424] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-23T22:59:14.399424] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-23T22:59:14.979877] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T22:59:15.199443] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-23T22:59:15.713751] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T22:59:15.777765] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T22:59:15.999491] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-23T22:59:16.799458] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-23T22:59:17.599427] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-23T22:59:17.861326] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T22:59:18.207840] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-23T22:59:18.399455] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-23T22:59:18.985628] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T22:59:18.986686] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T22:59:19.199514] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-23T22:59:19.999519] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-23T22:59:20.433458] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T22:59:20.799449] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-23T22:59:21.599411] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-23T22:59:21.767746] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T22:59:21.776880] [INFO ] [REMOTE ] NVT: Full fetch complete (74913 records). [2025-10-23T22:59:21.777049] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-23T22:59:22.106063] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-23T22:59:22.193978] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-23T22:59:22.194163] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-23T22:59:22.195395] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-23T22:59:22.195612] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-23T22:59:22.222977] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T22:59:22.223122] [DEBUG] [LOCAL ] NVT: Trimmed 74913 records to 51798 (keeping 200 days of data) [2025-10-23T22:59:22.402711] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-23T22:59:22.551798] [DEBUG] [LOCAL ] NVT: Primary data saved (51798 records). [2025-10-23T22:59:22.552039] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-23T22:59:22.552187] [INFO ] [MAIN ] Update Progress: 1553/2367 symbols completed. NVT took 42.7s. Estimated remaining: 1h 44m 28s. Rate: 7.8 symbols/min [2025-10-23T22:59:22.724576] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:59:22.724829] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-23T22:59:22.724900] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-23T22:59:22.725028] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-23T22:59:22.725102] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-23T22:59:22.725180] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-23T22:59:22.725252] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-23T22:59:23.051206] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T22:59:23.129978] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:59:23.199405] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-10-23T22:59:23.425044] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T22:59:23.425376] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-10-23T22:59:23.425464] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T22:59:23.425540] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-23T22:59:23.425604] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T22:59:23.425702] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-23T22:59:23.425796] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-23T22:59:23.425871] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-23T22:59:23.425950] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-23T22:59:23.426035] [INFO ] [MAIN ] Update Progress: 1554/2367 symbols completed. NXDR took 0.9s. Estimated remaining: 1h 44m 17s. Rate: 7.8 symbols/min [2025-10-23T22:59:23.602143] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:59:23.617952] [DEBUG] [LOCAL ] NXDT: Loaded 14784 existing records from primary storage. [2025-10-23T22:59:23.618273] [INFO ] [MAIN ] NXDT: Loaded 14784 existing records. [2025-10-23T22:59:23.802451] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:59:23.802697] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-23T22:59:23.802772] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-23T22:59:23.803017] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-23T22:59:23.803092] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-23T22:59:24.004615] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-23T22:59:24.176563] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:59:24.799452] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-23T22:59:25.474618] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T22:59:25.599399] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-23T22:59:25.944198] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T22:59:26.399478] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-23T22:59:27.206442] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-23T22:59:27.211229] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T22:59:27.513948] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-23T22:59:27.999433] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-23T22:59:28.340989] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T22:59:28.799404] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-23T22:59:28.879546] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T22:59:28.883621] [INFO ] [REMOTE ] NWN: Full fetch complete (37370 records). [2025-10-23T22:59:28.883746] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-23T22:59:29.250500] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-23T22:59:29.250610] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-23T22:59:29.251390] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-23T22:59:29.251495] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-23T22:59:29.252492] [DEBUG] [LOCAL ] NWN: Trimmed 37370 records to 26582 (keeping 200 days of data) [2025-10-23T22:59:29.406265] [DEBUG] [LOCAL ] NWN: Primary data saved (26582 records). [2025-10-23T22:59:29.406522] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-23T22:59:29.406676] [INFO ] [MAIN ] Update Progress: 1555/2367 symbols completed. NWN took 34.3s. Estimated remaining: 1h 44m 8s. Rate: 7.8 symbols/min [2025-10-23T22:59:29.520197] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T22:59:29.592099] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:59:29.599420] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-23T22:59:29.640453] [DEBUG] [LOCAL ] NXE: Loaded 53067 existing records from primary storage. [2025-10-23T22:59:29.640869] [INFO ] [MAIN ] NXE: Loaded 53067 existing records. [2025-10-23T22:59:29.815197] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:59:29.815425] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-23T22:59:29.815523] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-23T22:59:29.815834] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-23T22:59:29.815911] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-23T22:59:30.175613] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:59:30.186407] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T22:59:30.399417] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-23T22:59:30.996528] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T22:59:31.199436] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-23T22:59:31.999463] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-23T22:59:32.799418] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-23T22:59:33.117036] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T22:59:33.149057] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-23T22:59:33.599451] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-23T22:59:34.103135] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T22:59:34.109594] [INFO ] [REMOTE ] NX: Full fetch complete (48366 records). [2025-10-23T22:59:34.109773] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-23T22:59:34.404689] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-23T22:59:34.480623] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-23T22:59:34.480762] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-23T22:59:34.481703] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-23T22:59:34.481784] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-23T22:59:34.482905] [DEBUG] [LOCAL ] NX: Trimmed 48366 records to 33545 (keeping 200 days of data) [2025-10-23T22:59:34.682520] [DEBUG] [LOCAL ] NX: Primary data saved (33545 records). [2025-10-23T22:59:34.682730] [INFO ] [MAIN ] NX: Full history saved. [2025-10-23T22:59:34.682846] [INFO ] [MAIN ] Update Progress: 1556/2367 symbols completed. NX took 31.5s. Estimated remaining: 1h 43m 59s. Rate: 7.8 symbols/min [2025-10-23T22:59:34.846227] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T22:59:34.858036] [DEBUG] [LOCAL ] NXG: Loaded 10466 existing records from primary storage. [2025-10-23T22:59:34.858292] [INFO ] [MAIN ] NXG: Loaded 10466 existing records. [2025-10-23T22:59:35.034340] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T22:59:35.034613] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-23T22:59:35.034713] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-23T22:59:35.034931] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-23T22:59:35.035005] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-23T22:59:35.206076] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-23T22:59:35.400900] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T22:59:35.434785] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-23T22:59:35.504783] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T22:59:35.766297] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-23T22:59:35.999450] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-23T22:59:36.799423] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-23T22:59:36.878171] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T22:59:37.599474] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-23T22:59:38.227987] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-23T22:59:38.399425] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-23T22:59:38.723439] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T22:59:39.119798] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T22:59:39.199506] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-23T22:59:39.999456] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-23T22:59:40.056112] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T22:59:40.799456] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-23T22:59:41.032530] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T22:59:41.205538] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-23T22:59:41.206746] [INFO ] [REMOTE ] NXC: Full fetch complete (5648 records). [2025-10-23T22:59:41.206834] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-23T22:59:41.563236] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-23T22:59:41.563346] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-23T22:59:41.563605] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-23T22:59:41.563720] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-23T22:59:41.564213] [DEBUG] [LOCAL ] NXC: Trimmed 5648 records to 4096 (keeping 200 days of data) [2025-10-23T22:59:41.590006] [DEBUG] [LOCAL ] NXC: Primary data saved (4096 records). [2025-10-23T22:59:41.590159] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-23T22:59:41.590296] [INFO ] [MAIN ] Update Progress: 1557/2367 symbols completed. NXC took 30.3s. Estimated remaining: 1h 43m 51s. Rate: 7.8 symbols/min [2025-10-23T22:59:41.599391] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-23T22:59:42.399474] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-23T22:59:42.496252] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-23T22:59:43.190722] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T22:59:43.199384] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-23T22:59:43.999435] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-23T22:59:44.143491] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T22:59:44.799441] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-23T22:59:45.551367] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-23T22:59:45.599410] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-23T22:59:45.861580] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T22:59:46.238736] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T22:59:46.399414] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-23T22:59:47.199415] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-23T22:59:47.283236] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T22:59:47.935736] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T22:59:47.999424] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-23T22:59:48.799486] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-23T22:59:48.902912] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T22:59:49.599465] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-23T22:59:49.612122] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T22:59:49.615186] [INFO ] [REMOTE ] NXDT: Full fetch complete (23909 records). [2025-10-23T22:59:49.615297] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-23T22:59:49.985631] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-23T22:59:49.985776] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-23T22:59:49.986333] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-23T22:59:49.986408] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-23T22:59:49.987078] [DEBUG] [LOCAL ] NXDT: Trimmed 23909 records to 14863 (keeping 200 days of data) [2025-10-23T22:59:50.070134] [DEBUG] [LOCAL ] NXDT: Primary data saved (14863 records). [2025-10-23T22:59:50.070311] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-23T22:59:50.070429] [INFO ] [MAIN ] Update Progress: 1558/2367 symbols completed. NXDT took 26.6s. Estimated remaining: 1h 43m 44s. Rate: 7.8 symbols/min [2025-10-23T22:59:50.399428] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-23T22:59:50.494979] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-23T22:59:51.199442] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-23T22:59:52.082603] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T22:59:52.085684] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-23T22:59:52.318409] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T22:59:52.799438] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-23T22:59:52.963521] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T22:59:52.966039] [INFO ] [REMOTE ] NXG: Full fetch complete (14759 records). [2025-10-23T22:59:52.966129] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-23T22:59:53.317433] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-23T22:59:53.317541] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-23T22:59:53.317967] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-23T22:59:53.318047] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-23T22:59:53.318580] [DEBUG] [LOCAL ] NXG: Trimmed 14759 records to 10567 (keeping 200 days of data) [2025-10-23T22:59:53.381571] [DEBUG] [LOCAL ] NXG: Primary data saved (10567 records). [2025-10-23T22:59:53.381731] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-23T22:59:53.381864] [INFO ] [MAIN ] Update Progress: 1559/2367 symbols completed. NXG took 18.7s. Estimated remaining: 1h 43m 34s. Rate: 7.8 symbols/min [2025-10-23T22:59:54.810629] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-23T22:59:54.822957] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-23T22:59:56.721055] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T22:59:56.738973] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-23T22:59:58.586902] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T22:59:58.599080] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-23T23:00:00.670534] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T23:00:00.682067] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-23T23:00:02.875596] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-23T23:00:02.885202] [INFO ] [REMOTE ] NXE: Full fetch complete (76948 records). [2025-10-23T23:00:02.885363] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-23T23:00:03.348205] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-23T23:00:03.348352] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-23T23:00:03.349875] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-23T23:00:03.349975] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-23T23:00:03.351937] [DEBUG] [LOCAL ] NXE: Trimmed 76948 records to 53454 (keeping 200 days of data) [2025-10-23T23:00:03.654257] [DEBUG] [LOCAL ] NXE: Primary data saved (53454 records). [2025-10-23T23:00:03.654420] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-23T23:00:03.654553] [INFO ] [MAIN ] Update Progress: 1560/2367 symbols completed. NXE took 34.2s. Estimated remaining: 1h 43m 27s. Rate: 7.8 symbols/min [2025-10-23T23:00:04.225379] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:04.288918] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:04.392744] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:04.391778] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:04.395158] [DEBUG] [LOCAL ] NXN: Loaded 2296 existing records from primary storage. [2025-10-23T23:00:04.396087] [INFO ] [MAIN ] NXN: Loaded 2296 existing records. [2025-10-23T23:00:04.511736] [DEBUG] [LOCAL ] NXP: Loaded 12233 existing records from primary storage. [2025-10-23T23:00:04.522881] [INFO ] [MAIN ] NXP: Loaded 12233 existing records. [2025-10-23T23:00:04.610848] [DEBUG] [LOCAL ] NXJ: Loaded 14830 existing records from primary storage. [2025-10-23T23:00:04.655076] [INFO ] [MAIN ] NXJ: Loaded 14830 existing records. [2025-10-23T23:00:04.594852] [DEBUG] [LOCAL ] NXRT: Loaded 18929 existing records from primary storage. [2025-10-23T23:00:04.739703] [INFO ] [MAIN ] NXRT: Loaded 18929 existing records. [2025-10-23T23:00:04.863189] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:04.982778] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-23T23:00:05.009854] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-23T23:00:05.081893] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:05.078837] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-23T23:00:05.097586] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-23T23:00:05.141067] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-23T23:00:05.190312] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-23T23:00:05.293135] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-23T23:00:05.340097] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-23T23:00:05.334772] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:05.313161] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:05.354955] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-23T23:00:05.411716] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-23T23:00:05.376589] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-23T23:00:05.474371] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-23T23:00:05.460476] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-23T23:00:05.560171] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-23T23:00:05.544125] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-23T23:00:05.560438] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-23T23:00:06.252043] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:06.368081] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-23T23:00:06.564270] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:06.591055] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-23T23:00:06.743844] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:06.758785] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-23T23:00:06.840061] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:06.840368] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-23T23:00:07.155074] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T23:00:07.156309] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-23T23:00:07.479139] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T23:00:07.481576] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-23T23:00:07.542408] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-23T23:00:07.545678] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-23T23:00:07.644224] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-23T23:00:07.645568] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-23T23:00:07.681298] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-23T23:00:07.684450] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-23T23:00:08.035560] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-23T23:00:08.036882] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-23T23:00:08.344176] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-23T23:00:08.346865] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-23T23:00:08.408756] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-23T23:00:08.410464] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-23T23:00:08.460387] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T23:00:08.463462] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-23T23:00:08.638217] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T23:00:08.641614] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-23T23:00:08.921343] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-23T23:00:08.922845] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-23T23:00:08.979497] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-23T23:00:08.982291] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-23T23:00:09.083774] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T23:00:09.305257] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-23T23:00:09.599424] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-23T23:00:09.671568] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T23:00:09.775514] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T23:00:10.399403] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-23T23:00:10.562066] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T23:00:10.834169] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-23T23:00:11.199437] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-23T23:00:11.999464] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-23T23:00:12.331554] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T23:00:12.514357] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-23T23:00:12.799491] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-23T23:00:13.432979] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T23:00:13.599477] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-23T23:00:14.399441] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-23T23:00:14.531825] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T23:00:14.854185] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-23T23:00:15.199444] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-23T23:00:16.007169] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-23T23:00:16.009010] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T23:00:16.537430] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-23T23:00:16.538508] [INFO ] [REMOTE ] NXN: Full fetch complete (3439 records). [2025-10-23T23:00:16.538601] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-23T23:00:16.804677] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-23T23:00:16.902492] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-23T23:00:16.902613] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-23T23:00:16.902843] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-23T23:00:16.902951] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-23T23:00:16.903375] [DEBUG] [LOCAL ] NXN: Trimmed 3439 records to 2313 (keeping 200 days of data) [2025-10-23T23:00:16.917793] [DEBUG] [LOCAL ] NXN: Primary data saved (2313 records). [2025-10-23T23:00:16.917899] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-23T23:00:16.917998] [INFO ] [MAIN ] Update Progress: 1561/2367 symbols completed. NXN took 13.3s. Estimated remaining: 1h 43m 23s. Rate: 7.8 symbols/min [2025-10-23T23:00:17.082931] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:17.083174] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-23T23:00:17.083247] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-23T23:00:17.083373] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-23T23:00:17.083456] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-23T23:00:17.083554] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-23T23:00:17.083625] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-23T23:00:17.436382] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:17.599408] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-23T23:00:17.727287] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T23:00:18.399424] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-23T23:00:18.631308] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T23:00:19.199401] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-23T23:00:19.312363] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T23:00:20.001722] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-23T23:00:20.252941] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T23:00:20.451177] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-23T23:00:20.799478] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-23T23:00:21.317572] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-23T23:00:21.599406] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-23T23:00:22.057567] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T23:00:22.399447] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-23T23:00:23.187167] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T23:00:23.199423] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-23T23:00:23.793873] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T23:00:23.999472] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-23T23:00:24.799432] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-23T23:00:24.822152] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-23T23:00:25.121907] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-23T23:00:25.599436] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-23T23:00:26.399431] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-23T23:00:26.530681] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-23T23:00:27.110330] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T23:00:27.113233] [INFO ] [REMOTE ] NXP: Full fetch complete (17013 records). [2025-10-23T23:00:27.113393] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-23T23:00:27.204584] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-23T23:00:27.591862] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-23T23:00:27.592062] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-23T23:00:27.593000] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-23T23:00:27.593104] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-23T23:00:27.594214] [DEBUG] [LOCAL ] NXP: Trimmed 17013 records to 12306 (keeping 200 days of data) [2025-10-23T23:00:27.703354] [DEBUG] [LOCAL ] NXP: Primary data saved (12306 records). [2025-10-23T23:00:27.703608] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-23T23:00:27.703791] [INFO ] [MAIN ] Update Progress: 1562/2367 symbols completed. NXP took 24.0s. Estimated remaining: 1h 43m 16s. Rate: 7.8 symbols/min [2025-10-23T23:00:27.921014] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:27.968026] [DEBUG] [LOCAL ] NYT: Loaded 49445 existing records from primary storage. [2025-10-23T23:00:27.968449] [INFO ] [MAIN ] NYT: Loaded 49445 existing records. [2025-10-23T23:00:28.004566] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-23T23:00:28.183116] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:28.183556] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-23T23:00:28.183634] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-23T23:00:28.183919] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-23T23:00:28.183995] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-23T23:00:28.394062] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T23:00:28.446314] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T23:00:28.590270] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:28.799454] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-23T23:00:29.599419] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-23T23:00:30.035047] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T23:00:30.399420] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-23T23:00:30.769050] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T23:00:30.798266] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-23T23:00:31.199456] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-23T23:00:31.588267] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-23T23:00:31.999435] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-23T23:00:32.799448] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-23T23:00:33.068920] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-23T23:00:33.599423] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-23T23:00:33.730692] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T23:00:34.399457] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-23T23:00:34.678280] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T23:00:34.682078] [INFO ] [REMOTE ] NXRT: Full fetch complete (26139 records). [2025-10-23T23:00:34.682253] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-23T23:00:35.059471] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-23T23:00:35.059706] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-23T23:00:35.060324] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-23T23:00:35.060464] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-23T23:00:35.071969] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T23:00:35.072107] [DEBUG] [LOCAL ] NXRT: Trimmed 26139 records to 19039 (keeping 200 days of data) [2025-10-23T23:00:35.187913] [DEBUG] [LOCAL ] NXRT: Primary data saved (19039 records). [2025-10-23T23:00:35.188086] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-23T23:00:35.188216] [INFO ] [MAIN ] Update Progress: 1563/2367 symbols completed. NXRT took 31.5s. Estimated remaining: 1h 43m 9s. Rate: 7.8 symbols/min [2025-10-23T23:00:35.204999] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-23T23:00:35.357577] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:35.386418] [DEBUG] [LOCAL ] NZF: Loaded 28713 existing records from primary storage. [2025-10-23T23:00:35.386791] [INFO ] [MAIN ] NZF: Loaded 28713 existing records. [2025-10-23T23:00:35.562943] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:35.563112] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-23T23:00:35.563185] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-23T23:00:35.563535] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-23T23:00:35.563613] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-23T23:00:35.909525] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:35.999403] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-23T23:00:36.454867] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-23T23:00:36.799428] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-23T23:00:37.101902] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T23:00:37.154158] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T23:00:37.154960] [INFO ] [REMOTE ] NYC: Full fetch complete (1846 records). [2025-10-23T23:00:37.155050] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-23T23:00:37.333507] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-23T23:00:37.333769] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:00:37.333842] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:00:37.333939] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-23T23:00:37.334060] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-23T23:00:37.334150] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-23T23:00:37.334261] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-23T23:00:37.334376] [INFO ] [MAIN ] Update Progress: 1564/2367 symbols completed. NYC took 20.4s. Estimated remaining: 1h 42m 58s. Rate: 7.8 symbols/min [2025-10-23T23:00:37.502155] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:37.502375] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-23T23:00:37.502463] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-23T23:00:37.502597] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-23T23:00:37.502709] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-23T23:00:37.502815] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-23T23:00:37.502904] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-23T23:00:37.605035] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-23T23:00:37.886019] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:38.177052] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T23:00:38.399422] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-23T23:00:39.199423] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-23T23:00:39.799613] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T23:00:39.999452] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-23T23:00:40.504425] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T23:00:40.719912] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T23:00:40.723359] [INFO ] [REMOTE ] NXJ: Full fetch complete (20118 records). [2025-10-23T23:00:40.723500] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-23T23:00:40.809557] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-23T23:00:41.113631] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-23T23:00:41.113806] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-23T23:00:41.114281] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-23T23:00:41.114375] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-23T23:00:41.115027] [DEBUG] [LOCAL ] NXJ: Trimmed 20118 records to 14866 (keeping 200 days of data) [2025-10-23T23:00:41.203749] [DEBUG] [LOCAL ] NXJ: Primary data saved (14866 records). [2025-10-23T23:00:41.203926] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-23T23:00:41.204058] [INFO ] [MAIN ] Update Progress: 1565/2367 symbols completed. NXJ took 37.5s. Estimated remaining: 1h 42m 48s. Rate: 7.8 symbols/min [2025-10-23T23:00:41.370621] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:41.422055] [DEBUG] [LOCAL ] OBDC: Loaded 51730 existing records from primary storage. [2025-10-23T23:00:41.422380] [INFO ] [MAIN ] OBDC: Loaded 51730 existing records. [2025-10-23T23:00:41.598390] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:41.598602] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-23T23:00:41.598709] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-23T23:00:41.598952] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-23T23:00:41.599026] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-23T23:00:41.610011] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-23T23:00:41.961278] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:00:42.399430] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-23T23:00:42.604820] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T23:00:42.950134] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T23:00:43.199473] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-23T23:00:43.999483] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-23T23:00:44.153731] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-23T23:00:44.219178] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T23:00:44.799440] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-23T23:00:45.599437] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-23T23:00:46.399615] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:00:46.399751] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-23T23:00:46.501576] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-23T23:00:46.690789] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T23:00:47.199471] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-23T23:00:47.797712] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T23:00:47.999476] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-23T23:00:48.354184] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T23:00:48.799448] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-23T23:00:49.471900] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T23:00:49.599438] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-23T23:00:50.399487] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-23T23:00:50.924619] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T23:00:51.204712] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-23T23:00:51.228750] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-23T23:00:51.999496] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-23T23:00:52.102384] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T23:00:52.751425] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T23:00:52.799394] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-23T23:00:53.599414] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-23T23:00:53.876936] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T23:00:53.967938] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T23:00:54.399432] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-23T23:00:55.199422] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-23T23:00:55.376761] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T23:00:55.999450] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-23T23:00:56.799413] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-23T23:00:56.992449] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-23T23:00:57.045388] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T23:00:57.442684] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T23:00:57.599418] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-23T23:00:58.399419] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-23T23:00:58.525246] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T23:00:58.760324] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T23:00:58.765465] [INFO ] [REMOTE ] NZF: Full fetch complete (42142 records). [2025-10-23T23:00:58.765585] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-23T23:00:59.133638] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-23T23:00:59.133768] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-23T23:00:59.134738] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-23T23:00:59.134821] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-23T23:00:59.135783] [DEBUG] [LOCAL ] NZF: Trimmed 42142 records to 28909 (keeping 200 days of data) [2025-10-23T23:00:59.222573] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-23T23:00:59.311784] [DEBUG] [LOCAL ] NZF: Primary data saved (28909 records). [2025-10-23T23:00:59.311932] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-23T23:00:59.312042] [INFO ] [MAIN ] Update Progress: 1566/2367 symbols completed. NZF took 24.1s. Estimated remaining: 1h 42m 46s. Rate: 7.8 symbols/min [2025-10-23T23:00:59.486077] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:00:59.501374] [DEBUG] [LOCAL ] OBK: Loaded 16363 existing records from primary storage. [2025-10-23T23:00:59.501700] [INFO ] [MAIN ] OBK: Loaded 16363 existing records. [2025-10-23T23:00:59.674538] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:00:59.674739] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-23T23:00:59.674818] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-23T23:00:59.675108] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-23T23:00:59.675184] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-23T23:01:00.000446] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-23T23:01:00.027412] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:00.133097] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T23:01:00.799413] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-23T23:01:00.951879] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T23:01:00.960123] [INFO ] [REMOTE ] NYT: Full fetch complete (72234 records). [2025-10-23T23:01:00.960292] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-23T23:01:01.339542] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-23T23:01:01.339687] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-23T23:01:01.340811] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-23T23:01:01.340892] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-23T23:01:01.342282] [DEBUG] [LOCAL ] NYT: Trimmed 72234 records to 49803 (keeping 200 days of data) [2025-10-23T23:01:01.612456] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-23T23:01:01.650761] [DEBUG] [LOCAL ] NYT: Primary data saved (49803 records). [2025-10-23T23:01:01.650925] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-23T23:01:01.651043] [INFO ] [MAIN ] Update Progress: 1567/2367 symbols completed. NYT took 33.9s. Estimated remaining: 1h 42m 36s. Rate: 7.8 symbols/min [2025-10-23T23:01:01.816777] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:01.860624] [DEBUG] [LOCAL ] OC: Loaded 44899 existing records from primary storage. [2025-10-23T23:01:01.860984] [INFO ] [MAIN ] OC: Loaded 44899 existing records. [2025-10-23T23:01:02.040233] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:02.040484] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-23T23:01:02.040564] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-23T23:01:02.041146] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-23T23:01:02.041221] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-23T23:01:02.402710] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:02.403085] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-23T23:01:02.441508] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T23:01:02.692954] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-23T23:01:02.779331] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-23T23:01:03.199426] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-23T23:01:04.002316] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-23T23:01:04.007058] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T23:01:04.799474] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-23T23:01:05.599519] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-23T23:01:05.858281] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T23:01:06.399466] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-23T23:01:07.016933] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T23:01:07.104243] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (3.90 seconds). [2025-10-23T23:01:07.199472] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-23T23:01:07.481369] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-23T23:01:07.999494] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-23T23:01:08.286183] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T23:01:08.799426] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-23T23:01:08.965531] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T23:01:09.599454] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-23T23:01:09.634147] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-23T23:01:10.399429] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-23T23:01:10.516476] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T23:01:10.657517] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T23:01:11.199431] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-23T23:01:11.999458] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-23T23:01:12.799423] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-23T23:01:12.936285] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-23T23:01:12.968568] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T23:01:12.989794] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T23:01:13.599476] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-23T23:01:14.399419] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-23T23:01:14.737886] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-23T23:01:14.748602] [INFO ] [REMOTE ] OBDC: Full fetch complete (75408 records). [2025-10-23T23:01:14.748804] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-23T23:01:15.146392] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-23T23:01:15.146536] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-23T23:01:15.147744] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-23T23:01:15.147858] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-23T23:01:15.149406] [DEBUG] [LOCAL ] OBDC: Trimmed 75408 records to 52109 (keeping 200 days of data) [2025-10-23T23:01:15.207753] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-23T23:01:15.501805] [DEBUG] [LOCAL ] OBDC: Primary data saved (52109 records). [2025-10-23T23:01:15.502011] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-23T23:01:15.503440] [INFO ] [MAIN ] Update Progress: 1568/2367 symbols completed. OBDC took 34.3s. Estimated remaining: 1h 42m 31s. Rate: 7.8 symbols/min [2025-10-23T23:01:15.707794] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:15.718630] [DEBUG] [LOCAL ] OCFT: Loaded 7090 existing records from primary storage. [2025-10-23T23:01:15.718932] [INFO ] [MAIN ] OCFT: Loaded 7090 existing records. [2025-10-23T23:01:15.900820] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:15.901026] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-23T23:01:15.901123] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-23T23:01:15.901338] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-23T23:01:15.901412] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-23T23:01:16.277587] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:16.278227] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-23T23:01:16.319603] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T23:01:16.370946] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-23T23:01:16.371992] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T23:01:16.799446] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-23T23:01:16.885463] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-23T23:01:17.599442] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-23T23:01:18.399434] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-23T23:01:18.444804] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:01:19.199414] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-23T23:01:19.318252] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-23T23:01:19.994190] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T23:01:20.007857] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-23T23:01:20.251253] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T23:01:20.430922] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-23T23:01:20.445308] [INFO ] [REMOTE ] O: Full fetch complete (77572 records). [2025-10-23T23:01:20.445561] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-23T23:01:20.658094] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:01:20.659077] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:01:20.659167] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:01:20.659279] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-23T23:01:20.659419] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-23T23:01:20.659530] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-23T23:01:20.659677] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-23T23:01:20.659824] [INFO ] [MAIN ] Update Progress: 1569/2367 symbols completed. O took 43.3s. Estimated remaining: 1h 42m 22s. Rate: 7.8 symbols/min [2025-10-23T23:01:20.808019] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-23T23:01:20.835729] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:20.846097] [DEBUG] [LOCAL ] ODC: Loaded 8681 existing records from primary storage. [2025-10-23T23:01:20.846376] [INFO ] [MAIN ] ODC: Loaded 8681 existing records. [2025-10-23T23:01:21.041971] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:21.042244] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-23T23:01:21.042322] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-23T23:01:21.042519] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-23T23:01:21.042598] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-23T23:01:21.402714] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:21.599414] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-23T23:01:22.278675] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-23T23:01:22.399456] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-23T23:01:23.178025] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:01:23.199395] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-23T23:01:23.520846] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-23T23:01:23.999476] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-23T23:01:24.008244] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T23:01:24.637328] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T23:01:24.799440] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-23T23:01:25.599492] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-23T23:01:25.642348] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T23:01:26.399446] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-23T23:01:26.612824] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-23T23:01:27.199448] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-23T23:01:27.955526] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T23:01:27.999409] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-23T23:01:28.155546] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T23:01:28.640311] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T23:01:28.799466] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-23T23:01:29.392763] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T23:01:29.599443] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-23T23:01:30.399454] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-23T23:01:30.620887] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T23:01:31.199460] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-23T23:01:31.999411] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-23T23:01:32.016184] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-23T23:01:32.106477] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-23T23:01:32.799418] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-23T23:01:33.026766] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-23T23:01:33.030210] [INFO ] [REMOTE ] OBK: Full fetch complete (23919 records). [2025-10-23T23:01:33.030314] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-23T23:01:33.398214] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-23T23:01:33.398327] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-23T23:01:33.398916] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-23T23:01:33.399006] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-23T23:01:33.399770] [DEBUG] [LOCAL ] OBK: Trimmed 23919 records to 16495 (keeping 200 days of data) [2025-10-23T23:01:33.497757] [DEBUG] [LOCAL ] OBK: Primary data saved (16495 records). [2025-10-23T23:01:33.497960] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-23T23:01:33.498086] [INFO ] [MAIN ] Update Progress: 1570/2367 symbols completed. OBK took 34.2s. Estimated remaining: 1h 42m 17s. Rate: 7.8 symbols/min [2025-10-23T23:01:33.604530] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-23T23:01:33.667525] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:33.700318] [DEBUG] [LOCAL ] ODV: Loaded 30003 existing records from primary storage. [2025-10-23T23:01:33.700793] [INFO ] [MAIN ] ODV: Loaded 30003 existing records. [2025-10-23T23:01:33.797286] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-23T23:01:33.897982] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:33.898200] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-23T23:01:33.898281] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-23T23:01:33.898503] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-23T23:01:33.898577] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-23T23:01:34.245408] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:34.399462] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-23T23:01:34.492529] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T23:01:35.022877] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-23T23:01:35.199435] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-23T23:01:35.928327] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T23:01:35.999469] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-23T23:01:36.667081] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-23T23:01:36.799425] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-23T23:01:37.593996] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T23:01:37.599388] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-23T23:01:38.145608] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-23T23:01:38.146825] [INFO ] [REMOTE ] OCFT: Full fetch complete (11680 records). [2025-10-23T23:01:38.146927] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-23T23:01:38.404696] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-23T23:01:38.500355] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-23T23:01:38.500464] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-23T23:01:38.500801] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-23T23:01:38.500880] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-23T23:01:38.501370] [DEBUG] [LOCAL ] OCFT: Trimmed 11680 records to 7130 (keeping 200 days of data) [2025-10-23T23:01:38.539720] [DEBUG] [LOCAL ] OCFT: Primary data saved (7130 records). [2025-10-23T23:01:38.539873] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-23T23:01:38.539986] [INFO ] [MAIN ] Update Progress: 1571/2367 symbols completed. OCFT took 23.0s. Estimated remaining: 1h 42m 8s. Rate: 7.8 symbols/min [2025-10-23T23:01:38.705589] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:38.741700] [DEBUG] [LOCAL ] OEC: Loaded 37142 existing records from primary storage. [2025-10-23T23:01:38.742020] [INFO ] [MAIN ] OEC: Loaded 37142 existing records. [2025-10-23T23:01:38.913581] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:38.913834] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-23T23:01:38.913910] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-23T23:01:38.914314] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-23T23:01:38.914402] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-23T23:01:39.204626] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-23T23:01:39.271364] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:39.420519] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T23:01:39.999439] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-23T23:01:40.075612] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T23:01:40.799692] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-23T23:01:41.359497] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T23:01:41.599459] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-23T23:01:42.399663] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-23T23:01:42.505232] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T23:01:42.514694] [INFO ] [REMOTE ] OC: Full fetch complete (64953 records). [2025-10-23T23:01:42.514863] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-23T23:01:42.904054] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T23:01:42.923915] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-23T23:01:42.929260] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-23T23:01:42.931318] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-23T23:01:42.931407] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-23T23:01:42.932610] [DEBUG] [LOCAL ] OC: Trimmed 64953 records to 45203 (keeping 200 days of data) [2025-10-23T23:01:43.202151] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-23T23:01:43.211943] [DEBUG] [LOCAL ] OC: Primary data saved (45203 records). [2025-10-23T23:01:43.212042] [INFO ] [MAIN ] OC: Full history saved. [2025-10-23T23:01:43.212148] [INFO ] [MAIN ] Update Progress: 1572/2367 symbols completed. OC took 41.6s. Estimated remaining: 1h 41m 59s. Rate: 7.8 symbols/min [2025-10-23T23:01:43.383855] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:43.404426] [DEBUG] [LOCAL ] OFG: Loaded 20595 existing records from primary storage. [2025-10-23T23:01:43.404720] [INFO ] [MAIN ] OFG: Loaded 20595 existing records. [2025-10-23T23:01:43.582268] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:43.582517] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-23T23:01:43.582592] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-23T23:01:43.582820] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-23T23:01:43.582904] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-23T23:01:43.967028] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:43.946759] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T23:01:43.999392] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-23T23:01:44.228706] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T23:01:44.799481] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-23T23:01:45.096122] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T23:01:45.599441] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-23T23:01:46.056482] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T23:01:46.399449] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-23T23:01:46.981020] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T23:01:47.199488] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-23T23:01:47.610674] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T23:01:47.838235] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T23:01:47.999434] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-23T23:01:48.799419] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-23T23:01:48.822700] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:01:49.599457] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-23T23:01:50.016350] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T23:01:50.399463] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-23T23:01:50.923791] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T23:01:50.960367] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T23:01:50.962628] [INFO ] [REMOTE ] ODC: Full fetch complete (11493 records). [2025-10-23T23:01:50.962748] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-23T23:01:51.204553] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-23T23:01:51.326838] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-23T23:01:51.326954] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-23T23:01:51.327504] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-23T23:01:51.327583] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-23T23:01:51.328145] [DEBUG] [LOCAL ] ODC: Trimmed 11493 records to 8741 (keeping 200 days of data) [2025-10-23T23:01:51.379689] [DEBUG] [LOCAL ] ODC: Primary data saved (8741 records). [2025-10-23T23:01:51.379852] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-23T23:01:51.379966] [INFO ] [MAIN ] Update Progress: 1573/2367 symbols completed. ODC took 30.7s. Estimated remaining: 1h 41m 51s. Rate: 7.8 symbols/min [2025-10-23T23:01:51.546010] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:01:51.585283] [DEBUG] [LOCAL ] OGE: Loaded 45782 existing records from primary storage. [2025-10-23T23:01:51.585607] [INFO ] [MAIN ] OGE: Loaded 45782 existing records. [2025-10-23T23:01:51.759057] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:01:51.759246] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-23T23:01:51.759319] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-23T23:01:51.759771] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-23T23:01:51.759848] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-23T23:01:52.004741] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-23T23:01:52.105329] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:01:52.783445] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T23:01:52.799402] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-23T23:01:53.492796] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-23T23:01:53.599501] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-23T23:01:54.316944] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T23:01:54.399483] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-23T23:01:54.851381] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T23:01:55.199484] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-23T23:01:55.425006] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T23:01:55.999447] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-23T23:01:56.707384] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T23:01:56.799458] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-23T23:01:57.073807] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T23:01:57.599436] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-23T23:01:58.328969] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T23:01:58.399427] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-23T23:01:59.199435] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-23T23:01:59.630881] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T23:01:59.999449] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-23T23:02:00.162481] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T23:02:00.653580] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T23:02:00.799441] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-23T23:02:01.427558] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-23T23:02:01.436176] [INFO ] [REMOTE ] ODV: Full fetch complete (36340 records). [2025-10-23T23:02:01.436461] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-23T23:02:01.610627] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-23T23:02:01.820872] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-23T23:02:01.820988] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-23T23:02:01.821761] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-23T23:02:01.821839] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-23T23:02:01.822769] [DEBUG] [LOCAL ] ODV: Trimmed 36340 records to 30299 (keeping 200 days of data) [2025-10-23T23:02:02.000552] [DEBUG] [LOCAL ] ODV: Primary data saved (30299 records). [2025-10-23T23:02:02.001003] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-23T23:02:02.001153] [INFO ] [MAIN ] Update Progress: 1574/2367 symbols completed. ODV took 28.5s. Estimated remaining: 1h 41m 45s. Rate: 7.8 symbols/min [2025-10-23T23:02:02.186701] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:02.235292] [DEBUG] [LOCAL ] OGN: Loaded 53117 existing records from primary storage. [2025-10-23T23:02:02.235765] [INFO ] [MAIN ] OGN: Loaded 53117 existing records. [2025-10-23T23:02:02.419710] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-23T23:02:02.419622] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:02.420694] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-23T23:02:02.420879] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-23T23:02:02.422086] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-10-23T23:02:02.422244] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-23T23:02:02.748795] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-23T23:02:02.856828] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:02.869338] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T23:02:03.199447] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-23T23:02:03.999479] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-23T23:02:04.128267] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T23:02:04.449566] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T23:02:04.799494] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-23T23:02:04.877625] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-23T23:02:05.599433] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-23T23:02:06.399406] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-23T23:02:06.534192] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T23:02:06.730802] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:02:07.199447] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-23T23:02:07.999463] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-23T23:02:08.223336] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T23:02:08.303124] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T23:02:08.799500] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-23T23:02:09.599400] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-23T23:02:09.876141] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T23:02:10.044193] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T23:02:10.399478] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-23T23:02:10.611475] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T23:02:10.615332] [INFO ] [REMOTE ] OFG: Full fetch complete (33683 records). [2025-10-23T23:02:10.615455] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-23T23:02:10.989860] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-23T23:02:10.990198] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-23T23:02:10.991046] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-23T23:02:10.991153] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-23T23:02:10.991972] [DEBUG] [LOCAL ] OFG: Trimmed 33683 records to 20730 (keeping 200 days of data) [2025-10-23T23:02:11.118783] [DEBUG] [LOCAL ] OFG: Primary data saved (20730 records). [2025-10-23T23:02:11.118953] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-23T23:02:11.119129] [INFO ] [MAIN ] Update Progress: 1575/2367 symbols completed. OFG took 27.9s. Estimated remaining: 1h 41m 38s. Rate: 7.8 symbols/min [2025-10-23T23:02:11.209530] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-23T23:02:11.293180] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:11.293359] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-23T23:02:11.293445] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-23T23:02:11.293572] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-23T23:02:11.293682] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-23T23:02:11.293794] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-23T23:02:11.293881] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-23T23:02:11.643188] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:11.999418] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-23T23:02:12.200908] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T23:02:12.691266] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T23:02:12.698288] [INFO ] [REMOTE ] OEC: Full fetch complete (53588 records). [2025-10-23T23:02:12.698433] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-23T23:02:12.804339] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-23T23:02:13.094132] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-23T23:02:13.094261] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-23T23:02:13.095291] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-23T23:02:13.095391] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-23T23:02:13.096533] [DEBUG] [LOCAL ] OEC: Trimmed 53588 records to 37414 (keeping 200 days of data) [2025-10-23T23:02:13.338255] [DEBUG] [LOCAL ] OEC: Primary data saved (37414 records). [2025-10-23T23:02:13.338439] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-23T23:02:13.338589] [INFO ] [MAIN ] Update Progress: 1576/2367 symbols completed. OEC took 34.8s. Estimated remaining: 1h 41m 28s. Rate: 7.8 symbols/min [2025-10-23T23:02:13.519853] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T23:02:13.604743] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-23T23:02:13.691747] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:13.766524] [DEBUG] [LOCAL ] OHI: Loaded 51841 existing records from primary storage. [2025-10-23T23:02:13.767088] [INFO ] [MAIN ] OHI: Loaded 51841 existing records. [2025-10-23T23:02:14.061979] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:14.062399] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-23T23:02:14.062499] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-23T23:02:14.062824] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-23T23:02:14.062921] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-23T23:02:14.403279] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-23T23:02:14.496285] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:14.499881] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T23:02:15.199436] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-23T23:02:15.276452] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T23:02:15.999447] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-23T23:02:16.688387] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-23T23:02:16.799449] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-23T23:02:16.928371] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T23:02:17.318382] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T23:02:17.599450] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-23T23:02:18.399438] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-23T23:02:18.700072] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T23:02:18.959787] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T23:02:19.199466] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-23T23:02:19.999463] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-23T23:02:20.173324] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T23:02:20.181224] [INFO ] [REMOTE ] OGE: Full fetch complete (66831 records). [2025-10-23T23:02:20.181411] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-23T23:02:20.593831] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-23T23:02:20.595257] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-23T23:02:20.594492] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-23T23:02:20.603417] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-23T23:02:20.603675] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-23T23:02:20.605309] [DEBUG] [LOCAL ] OGE: Trimmed 66831 records to 46128 (keeping 200 days of data) [2025-10-23T23:02:20.817925] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-23T23:02:20.890481] [DEBUG] [LOCAL ] OGE: Primary data saved (46128 records). [2025-10-23T23:02:20.890676] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-23T23:02:20.890811] [INFO ] [MAIN ] Update Progress: 1577/2367 symbols completed. OGE took 29.5s. Estimated remaining: 1h 41m 20s. Rate: 7.8 symbols/min [2025-10-23T23:02:21.072667] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:21.115209] [DEBUG] [LOCAL ] OI: Loaded 47048 existing records from primary storage. [2025-10-23T23:02:21.115592] [INFO ] [MAIN ] OI: Loaded 47048 existing records. [2025-10-23T23:02:21.287533] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:21.287770] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-23T23:02:21.287852] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-23T23:02:21.288121] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-23T23:02:21.288197] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-23T23:02:21.604570] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-23T23:02:21.667735] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:22.007947] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-23T23:02:22.399423] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-23T23:02:22.992860] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-23T23:02:23.199444] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-23T23:02:23.999420] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-23T23:02:24.135104] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T23:02:24.180997] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-23T23:02:24.799464] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-23T23:02:25.021359] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T23:02:25.599454] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-23T23:02:25.628590] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:02:25.775851] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T23:02:26.399447] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-23T23:02:27.159472] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T23:02:27.199406] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-23T23:02:27.799443] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T23:02:27.999462] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-23T23:02:28.729761] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T23:02:28.799439] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-23T23:02:29.599680] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-23T23:02:29.727403] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T23:02:30.399418] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-23T23:02:30.495613] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T23:02:30.972133] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T23:02:31.199453] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-23T23:02:31.999410] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-23T23:02:32.106878] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T23:02:32.686815] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T23:02:32.799410] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-23T23:02:33.599421] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-23T23:02:33.732747] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:02:33.783813] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T23:02:33.789813] [INFO ] [REMOTE ] OGS: Full fetch complete (47820 records). [2025-10-23T23:02:33.790059] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-23T23:02:34.168603] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-23T23:02:34.168737] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-23T23:02:34.169711] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-23T23:02:34.169798] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-23T23:02:34.170923] [DEBUG] [LOCAL ] OGS: Trimmed 47820 records to 34115 (keeping 200 days of data) [2025-10-23T23:02:34.372541] [DEBUG] [LOCAL ] OGS: Primary data saved (34115 records). [2025-10-23T23:02:34.372727] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-23T23:02:34.372862] [INFO ] [MAIN ] Update Progress: 1578/2367 symbols completed. OGS took 23.3s. Estimated remaining: 1h 41m 15s. Rate: 7.8 symbols/min [2025-10-23T23:02:34.404613] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-23T23:02:34.549930] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:34.564712] [DEBUG] [LOCAL ] OIA: Loaded 13047 existing records from primary storage. [2025-10-23T23:02:34.564992] [INFO ] [MAIN ] OIA: Loaded 13047 existing records. [2025-10-23T23:02:34.745098] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:34.745303] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-23T23:02:34.745380] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-23T23:02:34.745685] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-23T23:02:34.745762] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-23T23:02:35.096170] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:35.199406] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-23T23:02:35.444410] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T23:02:35.595604] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T23:02:35.999446] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-23T23:02:36.040617] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T23:02:36.799469] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-23T23:02:37.567735] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T23:02:37.599401] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-23T23:02:38.399439] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-23T23:02:38.590295] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T23:02:39.199551] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-23T23:02:39.385150] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T23:02:39.510433] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T23:02:39.999450] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-23T23:02:40.799460] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-23T23:02:41.005834] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T23:02:41.461540] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:02:41.599461] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-23T23:02:42.399412] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-23T23:02:42.512020] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T23:02:42.632698] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T23:02:43.199442] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-23T23:02:43.999430] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-23T23:02:44.140722] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T23:02:44.173520] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T23:02:44.182955] [INFO ] [REMOTE ] OGN: Full fetch complete (76936 records). [2025-10-23T23:02:44.183158] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-23T23:02:44.569852] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-23T23:02:44.569972] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-23T23:02:44.571085] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-23T23:02:44.571167] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-23T23:02:44.572585] [DEBUG] [LOCAL ] OGN: Trimmed 76936 records to 53494 (keeping 200 days of data) [2025-10-23T23:02:44.806355] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-23T23:02:44.895183] [DEBUG] [LOCAL ] OGN: Primary data saved (53494 records). [2025-10-23T23:02:44.895378] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-23T23:02:44.895497] [INFO ] [MAIN ] Update Progress: 1579/2367 symbols completed. OGN took 42.9s. Estimated remaining: 1h 41m 9s. Rate: 7.8 symbols/min [2025-10-23T23:02:45.064615] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:45.100868] [DEBUG] [LOCAL ] OII: Loaded 41819 existing records from primary storage. [2025-10-23T23:02:45.101219] [INFO ] [MAIN ] OII: Loaded 41819 existing records. [2025-10-23T23:02:45.274191] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:45.274425] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-23T23:02:45.274526] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-23T23:02:45.274977] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-23T23:02:45.275053] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-23T23:02:45.390605] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T23:02:45.613910] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-23T23:02:45.654476] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:45.747536] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:02:46.210282] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T23:02:46.399430] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-23T23:02:47.199447] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-23T23:02:47.999454] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-23T23:02:48.065707] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-23T23:02:48.731164] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T23:02:48.746784] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T23:02:48.799396] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-23T23:02:49.599472] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-23T23:02:50.268846] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:02:50.399433] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-23T23:02:51.191029] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T23:02:51.200297] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-23T23:02:51.467048] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-23T23:02:51.999430] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-23T23:02:52.726545] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T23:02:52.735454] [INFO ] [REMOTE ] OHI: Full fetch complete (75256 records). [2025-10-23T23:02:52.735600] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-23T23:02:52.804625] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-23T23:02:53.155263] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-23T23:02:53.155622] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-23T23:02:53.156837] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-23T23:02:53.156922] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-23T23:02:53.158468] [DEBUG] [LOCAL ] OHI: Trimmed 75256 records to 52179 (keeping 200 days of data) [2025-10-23T23:02:53.395579] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T23:02:53.513300] [DEBUG] [LOCAL ] OHI: Primary data saved (52179 records). [2025-10-23T23:02:53.513488] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-23T23:02:53.514754] [INFO ] [MAIN ] Update Progress: 1580/2367 symbols completed. OHI took 40.2s. Estimated remaining: 1h 41m 2s. Rate: 7.8 symbols/min [2025-10-23T23:02:53.605412] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-23T23:02:53.685460] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:53.726167] [DEBUG] [LOCAL ] OIS: Loaded 39794 existing records from primary storage. [2025-10-23T23:02:53.726492] [INFO ] [MAIN ] OIS: Loaded 39794 existing records. [2025-10-23T23:02:53.903483] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:53.903748] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-23T23:02:53.903823] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-23T23:02:53.904097] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-23T23:02:53.904172] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-23T23:02:54.266464] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:54.399413] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-23T23:02:54.465861] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T23:02:54.474492] [INFO ] [REMOTE ] OI: Full fetch complete (68262 records). [2025-10-23T23:02:54.474634] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-23T23:02:54.681465] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:02:54.882984] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-23T23:02:54.883104] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-23T23:02:54.884143] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-23T23:02:54.884224] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-23T23:02:54.885623] [DEBUG] [LOCAL ] OI: Trimmed 68262 records to 47371 (keeping 200 days of data) [2025-10-23T23:02:55.161580] [DEBUG] [LOCAL ] OI: Primary data saved (47371 records). [2025-10-23T23:02:55.161754] [INFO ] [MAIN ] OI: Full history saved. [2025-10-23T23:02:55.161868] [INFO ] [MAIN ] Update Progress: 1581/2367 symbols completed. OI took 34.3s. Estimated remaining: 1h 40m 51s. Rate: 7.8 symbols/min [2025-10-23T23:02:55.204732] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-23T23:02:55.351246] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:55.398516] [DEBUG] [LOCAL ] OKE: Loaded 53576 existing records from primary storage. [2025-10-23T23:02:55.398913] [INFO ] [MAIN ] OKE: Loaded 53576 existing records. [2025-10-23T23:02:55.579483] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:02:55.579885] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-23T23:02:55.580101] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-23T23:02:55.587178] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-10-23T23:02:55.598408] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-23T23:02:55.632101] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T23:02:55.955816] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:55.999411] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-23T23:02:56.799414] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-23T23:02:56.902370] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:02:57.573948] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T23:02:57.576222] [INFO ] [REMOTE ] OIA: Full fetch complete (20062 records). [2025-10-23T23:02:57.576345] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-23T23:02:57.607832] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-23T23:02:57.953878] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-23T23:02:57.954082] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-23T23:02:57.954746] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-23T23:02:57.954826] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-23T23:02:57.955521] [DEBUG] [LOCAL ] OIA: Trimmed 20062 records to 13127 (keeping 200 days of data) [2025-10-23T23:02:58.036615] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-23T23:02:58.068213] [DEBUG] [LOCAL ] OIA: Primary data saved (13127 records). [2025-10-23T23:02:58.068937] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-23T23:02:58.069059] [INFO ] [MAIN ] Update Progress: 1582/2367 symbols completed. OIA took 23.7s. Estimated remaining: 1h 40m 41s. Rate: 7.8 symbols/min [2025-10-23T23:02:58.238945] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:02:58.239137] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-23T23:02:58.239231] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-23T23:02:58.239344] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-23T23:02:58.239416] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-23T23:02:58.239477] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-23T23:02:58.239541] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-23T23:02:58.412210] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-23T23:02:58.602682] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:02:59.153471] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T23:02:59.199415] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-23T23:02:59.999444] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-23T23:03:00.265524] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T23:03:00.799443] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-23T23:03:01.599429] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-23T23:03:01.880580] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-23T23:03:01.966183] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-23T23:03:02.399452] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-23T23:03:02.774543] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T23:03:03.111146] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T23:03:03.199420] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-23T23:03:03.999423] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-23T23:03:04.803726] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-23T23:03:04.814246] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T23:03:04.974215] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-23T23:03:05.256256] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T23:03:05.599521] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-23T23:03:06.399508] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-23T23:03:06.867838] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T23:03:07.199460] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-23T23:03:07.284031] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T23:03:07.999464] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-23T23:03:08.799409] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-23T23:03:09.276635] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-23T23:03:09.325942] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-23T23:03:09.365500] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T23:03:09.599461] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-23T23:03:10.104723] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T23:03:10.399476] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-23T23:03:11.199457] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-23T23:03:11.391610] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T23:03:11.889809] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T23:03:11.999444] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-23T23:03:12.731691] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T23:03:12.799446] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-23T23:03:13.350897] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-23T23:03:13.358272] [INFO ] [REMOTE ] OII: Full fetch complete (61741 records). [2025-10-23T23:03:13.358435] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-23T23:03:13.604624] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-23T23:03:13.781083] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-23T23:03:13.781204] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-23T23:03:13.782431] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-23T23:03:13.782522] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-23T23:03:13.784115] [DEBUG] [LOCAL ] OII: Trimmed 61741 records to 42179 (keeping 200 days of data) [2025-10-23T23:03:14.051109] [DEBUG] [LOCAL ] OII: Primary data saved (42179 records). [2025-10-23T23:03:14.051277] [INFO ] [MAIN ] OII: Full history saved. [2025-10-23T23:03:14.051398] [INFO ] [MAIN ] Update Progress: 1583/2367 symbols completed. OII took 29.2s. Estimated remaining: 1h 40m 37s. Rate: 7.8 symbols/min [2025-10-23T23:03:14.226905] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:14.285369] [DEBUG] [LOCAL ] OLN: Loaded 52000 existing records from primary storage. [2025-10-23T23:03:14.285782] [INFO ] [MAIN ] OLN: Loaded 52000 existing records. [2025-10-23T23:03:14.404576] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-23T23:03:14.466326] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:14.466543] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-23T23:03:14.466619] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-23T23:03:14.466872] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-23T23:03:14.466942] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-23T23:03:14.814864] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:15.199463] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-23T23:03:15.242853] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T23:03:15.287166] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-23T23:03:15.999458] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-23T23:03:16.591012] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T23:03:16.804799] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-23T23:03:16.816759] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T23:03:17.599439] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-23T23:03:18.399469] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-23T23:03:18.489202] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-23T23:03:18.815505] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-23T23:03:18.866493] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-23T23:03:19.199488] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-23T23:03:19.846092] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T23:03:19.999481] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-23T23:03:20.799453] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-23T23:03:21.599557] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-23T23:03:21.706959] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-23T23:03:22.055521] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-23T23:03:22.399440] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-23T23:03:22.950568] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-23T23:03:23.010518] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T23:03:23.020579] [INFO ] [REMOTE ] OKE: Full fetch complete (77680 records). [2025-10-23T23:03:23.020866] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-23T23:03:23.205122] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-23T23:03:23.484440] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-23T23:03:23.480403] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T23:03:23.492433] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-23T23:03:23.496859] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-23T23:03:23.497144] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-23T23:03:23.498939] [DEBUG] [LOCAL ] OKE: Trimmed 77680 records to 53966 (keeping 200 days of data) [2025-10-23T23:03:23.820563] [DEBUG] [LOCAL ] OKE: Primary data saved (53966 records). [2025-10-23T23:03:23.820747] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-23T23:03:23.820860] [INFO ] [MAIN ] Update Progress: 1584/2367 symbols completed. OKE took 28.7s. Estimated remaining: 1h 40m 30s. Rate: 7.8 symbols/min [2025-10-23T23:03:23.990343] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:24.000716] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-23T23:03:24.002186] [DEBUG] [LOCAL ] OLP: Loaded 10043 existing records from primary storage. [2025-10-23T23:03:24.003695] [INFO ] [MAIN ] OLP: Loaded 10043 existing records. [2025-10-23T23:03:24.206320] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:24.206740] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-23T23:03:24.206821] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-23T23:03:24.207098] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-23T23:03:24.207175] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-23T23:03:24.604545] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:24.799439] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-23T23:03:25.599428] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-23T23:03:25.904344] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T23:03:26.165965] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-23T23:03:26.370682] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-23T23:03:26.377336] [INFO ] [REMOTE ] OIS: Full fetch complete (57386 records). [2025-10-23T23:03:26.377477] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-23T23:03:26.413344] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-23T23:03:26.493575] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T23:03:26.789274] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-23T23:03:26.789390] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-23T23:03:26.790390] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-23T23:03:26.790507] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-23T23:03:26.791777] [DEBUG] [LOCAL ] OIS: Trimmed 57386 records to 40115 (keeping 200 days of data) [2025-10-23T23:03:27.012290] [DEBUG] [LOCAL ] OIS: Primary data saved (40115 records). [2025-10-23T23:03:27.012441] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-23T23:03:27.013941] [INFO ] [MAIN ] Update Progress: 1585/2367 symbols completed. OIS took 33.5s. Estimated remaining: 1h 40m 21s. Rate: 7.8 symbols/min [2025-10-23T23:03:27.192483] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:27.199420] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-23T23:03:27.246948] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-10-23T23:03:27.247293] [INFO ] [MAIN ] OMC: Loaded 53292 existing records. [2025-10-23T23:03:27.433339] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:27.433578] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-23T23:03:27.433681] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-23T23:03:27.433937] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-10-23T23:03:27.434011] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-23T23:03:27.792925] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:27.943347] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T23:03:27.999406] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-23T23:03:28.227602] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T23:03:28.799451] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-23T23:03:28.871714] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-23T23:03:29.599466] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-23T23:03:30.316838] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T23:03:30.399454] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-23T23:03:30.604286] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T23:03:31.199437] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-23T23:03:31.999465] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-23T23:03:32.799468] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-23T23:03:32.936235] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T23:03:33.049823] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-23T23:03:33.401618] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T23:03:33.599403] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-23T23:03:33.769343] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-23T23:03:34.399439] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-23T23:03:35.175515] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-23T23:03:35.199405] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-23T23:03:35.591962] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T23:03:36.004941] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-23T23:03:36.005819] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T23:03:36.799427] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-23T23:03:37.599413] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-23T23:03:37.945391] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T23:03:38.080118] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-23T23:03:38.399416] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-23T23:03:38.631994] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T23:03:39.199549] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-23T23:03:39.999430] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-23T23:03:40.799418] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-23T23:03:40.949403] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T23:03:41.067354] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T23:03:41.127449] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-23T23:03:41.599501] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-23T23:03:42.399429] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-23T23:03:43.013015] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-23T23:03:43.199403] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-23T23:03:43.250151] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T23:03:43.252747] [INFO ] [REMOTE ] OLP: Full fetch complete (14286 records). [2025-10-23T23:03:43.252838] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-23T23:03:43.640371] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-23T23:03:43.642238] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-23T23:03:43.642301] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-23T23:03:43.652578] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-23T23:03:43.652901] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-23T23:03:43.653897] [DEBUG] [LOCAL ] OLP: Trimmed 14286 records to 10133 (keeping 200 days of data) [2025-10-23T23:03:43.713321] [DEBUG] [LOCAL ] OLP: Primary data saved (10133 records). [2025-10-23T23:03:43.713472] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-23T23:03:43.713582] [INFO ] [MAIN ] Update Progress: 1586/2367 symbols completed. OLP took 19.9s. Estimated remaining: 1h 40m 17s. Rate: 7.8 symbols/min [2025-10-23T23:03:43.876542] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:43.916302] [DEBUG] [LOCAL ] OMF: Loaded 46434 existing records from primary storage. [2025-10-23T23:03:43.916618] [INFO ] [MAIN ] OMF: Loaded 46434 existing records. [2025-10-23T23:03:44.004611] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-23T23:03:44.094402] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:44.094636] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-23T23:03:44.094732] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-23T23:03:44.094963] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-23T23:03:44.095054] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-23T23:03:44.436893] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:44.565225] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T23:03:44.799464] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-23T23:03:45.599422] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-23T23:03:46.399437] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-23T23:03:46.508838] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T23:03:46.664390] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-23T23:03:46.673920] [INFO ] [REMOTE ] OKLO: Full fetch complete (77999 records). [2025-10-23T23:03:46.674092] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-23T23:03:47.061621] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-10-23T23:03:47.061875] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-10-23T23:03:47.063098] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-10-23T23:03:47.063181] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-10-23T23:03:47.064794] [DEBUG] [LOCAL ] OKLO: Trimmed 77999 records to 54209 (keeping 200 days of data) [2025-10-23T23:03:47.231252] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-23T23:03:47.390531] [DEBUG] [LOCAL ] OKLO: Primary data saved (54209 records). [2025-10-23T23:03:47.390758] [INFO ] [MAIN ] OKLO: Full history saved. [2025-10-23T23:03:47.391059] [INFO ] [MAIN ] Update Progress: 1587/2367 symbols completed. OKLO took 49.3s. Estimated remaining: 1h 40m 8s. Rate: 7.8 symbols/min [2025-10-23T23:03:47.595741] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:47.601212] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T23:03:47.651884] [DEBUG] [LOCAL ] OMI: Loaded 46218 existing records from primary storage. [2025-10-23T23:03:47.652250] [INFO ] [MAIN ] OMI: Loaded 46218 existing records. [2025-10-23T23:03:47.826442] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:47.826670] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-23T23:03:47.826748] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-23T23:03:47.827107] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-23T23:03:47.827181] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-23T23:03:48.000144] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-23T23:03:48.184953] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:48.208927] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T23:03:48.218008] [INFO ] [REMOTE ] OLN: Full fetch complete (74765 records). [2025-10-23T23:03:48.218176] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-23T23:03:48.600106] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-23T23:03:48.600233] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-23T23:03:48.601426] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-23T23:03:48.601561] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-23T23:03:48.603057] [DEBUG] [LOCAL ] OLN: Trimmed 74765 records to 52381 (keeping 200 days of data) [2025-10-23T23:03:48.811364] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-23T23:03:48.922369] [DEBUG] [LOCAL ] OLN: Primary data saved (52381 records). [2025-10-23T23:03:48.922540] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-23T23:03:48.922686] [INFO ] [MAIN ] Update Progress: 1588/2367 symbols completed. OLN took 34.9s. Estimated remaining: 1h 39m 57s. Rate: 7.8 symbols/min [2025-10-23T23:03:49.096353] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:49.121508] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T23:03:49.137082] [DEBUG] [LOCAL ] ONIT: Loaded 7526 existing records from primary storage. [2025-10-23T23:03:49.137335] [INFO ] [MAIN ] ONIT: Loaded 7526 existing records. [2025-10-23T23:03:49.309150] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:49.309415] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-23T23:03:49.309491] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-23T23:03:49.309710] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-23T23:03:49.309786] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-23T23:03:49.657951] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:49.604557] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-23T23:03:49.993632] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T23:03:50.050459] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T23:03:50.399438] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-23T23:03:51.176478] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T23:03:51.199399] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-23T23:03:51.295350] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T23:03:51.846262] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T23:03:51.855782] [INFO ] [REMOTE ] OMC: Full fetch complete (77288 records). [2025-10-23T23:03:51.855971] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-23T23:03:52.004086] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-23T23:03:52.257386] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-23T23:03:52.257496] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-23T23:03:52.258634] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-23T23:03:52.258731] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-23T23:03:52.260127] [DEBUG] [LOCAL ] OMC: Trimmed 77288 records to 53682 (keeping 200 days of data) [2025-10-23T23:03:52.583915] [DEBUG] [LOCAL ] OMC: Primary data saved (53682 records). [2025-10-23T23:03:52.584081] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-23T23:03:52.585831] [INFO ] [MAIN ] Update Progress: 1589/2367 symbols completed. OMC took 25.6s. Estimated remaining: 1h 39m 47s. Rate: 7.8 symbols/min [2025-10-23T23:03:52.753511] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:03:52.761181] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T23:03:52.786315] [DEBUG] [LOCAL ] ONL: Loaded 28911 existing records from primary storage. [2025-10-23T23:03:52.786638] [INFO ] [MAIN ] ONL: Loaded 28911 existing records. [2025-10-23T23:03:52.806945] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-23T23:03:52.964986] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:03:52.965178] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-23T23:03:52.965252] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-23T23:03:52.965491] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-23T23:03:52.965565] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-23T23:03:53.320125] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:03:53.599458] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-23T23:03:54.402497] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-23T23:03:54.404014] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-23T23:03:54.748099] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-23T23:03:55.199434] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-23T23:03:55.999459] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-23T23:03:56.344913] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T23:03:56.392973] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T23:03:56.609587] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T23:03:56.799507] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-23T23:03:57.582779] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:03:57.599463] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-23T23:03:58.399405] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-23T23:03:59.204923] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-23T23:03:59.228798] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T23:03:59.235852] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T23:03:59.999439] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-23T23:04:00.267771] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T23:04:00.799500] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-23T23:04:01.566362] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-23T23:04:01.599455] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-23T23:04:01.780964] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T23:04:02.399494] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-23T23:04:02.416476] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T23:04:03.199456] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-23T23:04:03.985585] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T23:04:03.999415] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-23T23:04:04.175709] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T23:04:04.742462] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T23:04:04.799411] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-23T23:04:05.499138] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-23T23:04:05.500709] [INFO ] [REMOTE ] ONIT: Full fetch complete (10993 records). [2025-10-23T23:04:05.500798] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-23T23:04:05.603542] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-23T23:04:05.861291] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-23T23:04:05.861418] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-23T23:04:05.861778] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-23T23:04:05.861882] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-23T23:04:05.862379] [DEBUG] [LOCAL ] ONIT: Trimmed 10993 records to 7548 (keeping 200 days of data) [2025-10-23T23:04:05.904553] [DEBUG] [LOCAL ] ONIT: Primary data saved (7548 records). [2025-10-23T23:04:05.904733] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-23T23:04:05.904865] [INFO ] [MAIN ] Update Progress: 1590/2367 symbols completed. ONIT took 17.0s. Estimated remaining: 1h 39m 42s. Rate: 7.8 symbols/min [2025-10-23T23:04:06.072546] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:06.119401] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-23T23:04:06.119768] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-10-23T23:04:06.294872] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:06.295100] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-23T23:04:06.295172] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-23T23:04:06.295572] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-23T23:04:06.295677] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-23T23:04:06.404616] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-23T23:04:06.650205] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:07.161379] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T23:04:07.199418] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-23T23:04:07.999014] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-23T23:04:08.007084] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-23T23:04:08.745879] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T23:04:08.799409] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-23T23:04:09.599448] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-23T23:04:09.701546] [DEBUG] [REMOTE ] OMI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-23T23:04:09.701956] [WARN ] [REMOTE ] OMI: No data returned for month 2025-05 [2025-10-23T23:04:09.702050] [FATAL] [REMOTE ] OMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:04:09.702187] [FATAL] [MAIN ] OMI: Failed to fetch primary data. [2025-10-23T23:04:09.702264] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:04:09.702346] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-23T23:04:09.702447] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-23T23:04:09.702519] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-23T23:04:09.702738] [DEBUG] [LOCAL ] OMI: Deleted derivative data file. [2025-10-23T23:04:09.702843] [INFO ] [MAIN ] Update Progress: 1591/2367 symbols completed. OMI took 22.3s. Estimated remaining: 1h 39m 33s. Rate: 7.8 symbols/min [2025-10-23T23:04:09.901453] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:09.921476] [DEBUG] [LOCAL ] ONTF: Loaded 22531 existing records from primary storage. [2025-10-23T23:04:09.921850] [INFO ] [MAIN ] ONTF: Loaded 22531 existing records. [2025-10-23T23:04:10.111946] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:10.112340] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-23T23:04:10.112500] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-23T23:04:10.112923] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-23T23:04:10.113054] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-23T23:04:10.248174] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-23T23:04:10.401166] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-23T23:04:10.520163] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:10.547570] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T23:04:11.199447] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-23T23:04:11.999423] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-23T23:04:12.466439] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-23T23:04:12.690182] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T23:04:12.799414] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-23T23:04:13.599491] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-23T23:04:13.750706] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T23:04:14.116217] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T23:04:14.399430] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-23T23:04:14.636538] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T23:04:15.199421] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-23T23:04:15.664370] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T23:04:15.999482] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-23T23:04:16.800105] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T23:04:16.800213] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-23T23:04:17.599427] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-23T23:04:17.880717] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T23:04:18.111920] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T23:04:18.399469] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-23T23:04:19.005306] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T23:04:19.014325] [INFO ] [REMOTE ] OMF: Full fetch complete (67864 records). [2025-10-23T23:04:19.014497] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-23T23:04:19.209314] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-23T23:04:19.411733] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-23T23:04:19.411857] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-23T23:04:19.413038] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-23T23:04:19.413132] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-23T23:04:19.414540] [DEBUG] [LOCAL ] OMF: Trimmed 67864 records to 46802 (keeping 200 days of data) [2025-10-23T23:04:19.708523] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T23:04:19.723580] [DEBUG] [LOCAL ] OMF: Primary data saved (46802 records). [2025-10-23T23:04:19.724070] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-23T23:04:19.724203] [INFO ] [MAIN ] Update Progress: 1592/2367 symbols completed. OMF took 36.0s. Estimated remaining: 1h 39m 26s. Rate: 7.8 symbols/min [2025-10-23T23:04:19.898469] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:19.944593] [DEBUG] [LOCAL ] ONTO: Loaded 47210 existing records from primary storage. [2025-10-23T23:04:19.945077] [INFO ] [MAIN ] ONTO: Loaded 47210 existing records. [2025-10-23T23:04:20.008984] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-23T23:04:20.125138] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:20.125488] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-23T23:04:20.125677] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-23T23:04:20.125937] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-23T23:04:20.126068] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-23T23:04:20.385477] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T23:04:20.498107] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:20.799409] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-23T23:04:20.883295] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T23:04:21.599431] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-23T23:04:22.330589] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T23:04:22.399409] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-23T23:04:23.199484] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-23T23:04:23.731928] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T23:04:23.883042] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-23T23:04:23.999407] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-23T23:04:24.040823] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T23:04:24.799410] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-23T23:04:25.171346] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T23:04:25.599432] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-23T23:04:26.399428] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-23T23:04:26.481520] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T23:04:26.660183] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T23:04:27.199455] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-23T23:04:27.999423] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-23T23:04:28.267594] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T23:04:28.271857] [INFO ] [REMOTE ] ONL: Full fetch complete (42459 records). [2025-10-23T23:04:28.271975] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-23T23:04:28.652270] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-23T23:04:28.714210] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-23T23:04:28.714422] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-23T23:04:28.715394] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-23T23:04:28.715540] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-23T23:04:28.716589] [DEBUG] [LOCAL ] ONL: Trimmed 42459 records to 29013 (keeping 200 days of data) [2025-10-23T23:04:28.802967] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-23T23:04:28.850193] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-23T23:04:28.915185] [DEBUG] [LOCAL ] ONL: Primary data saved (29013 records). [2025-10-23T23:04:28.915349] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-23T23:04:28.915465] [INFO ] [MAIN ] Update Progress: 1593/2367 symbols completed. ONL took 36.3s. Estimated remaining: 1h 39m 19s. Rate: 7.8 symbols/min [2025-10-23T23:04:29.099419] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:29.116099] [DEBUG] [LOCAL ] OOMA: Loaded 18269 existing records from primary storage. [2025-10-23T23:04:29.116360] [INFO ] [MAIN ] OOMA: Loaded 18269 existing records. [2025-10-23T23:04:29.302513] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:29.302777] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-23T23:04:29.302876] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-23T23:04:29.303084] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-23T23:04:29.303156] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-23T23:04:29.603401] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-23T23:04:29.688888] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:30.407666] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-23T23:04:30.412736] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T23:04:30.463516] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T23:04:31.199496] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-23T23:04:31.999436] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-23T23:04:32.148853] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T23:04:32.148419] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T23:04:32.799479] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-23T23:04:33.599434] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-23T23:04:33.886266] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T23:04:34.399403] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-23T23:04:34.552126] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T23:04:34.623836] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T23:04:35.199434] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-23T23:04:35.888902] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T23:04:35.999404] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-23T23:04:36.394845] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T23:04:36.799442] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-23T23:04:37.599401] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-23T23:04:37.919555] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T23:04:37.955680] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T23:04:38.399425] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-23T23:04:38.579321] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T23:04:38.584887] [INFO ] [REMOTE ] ONTF: Full fetch complete (31591 records). [2025-10-23T23:04:38.585030] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-23T23:04:38.964808] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-23T23:04:38.964916] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-23T23:04:38.965567] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-23T23:04:38.965661] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-23T23:04:38.966404] [DEBUG] [LOCAL ] ONTF: Trimmed 31591 records to 22692 (keeping 200 days of data) [2025-10-23T23:04:39.090558] [DEBUG] [LOCAL ] ONTF: Primary data saved (22692 records). [2025-10-23T23:04:39.090750] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-23T23:04:39.090864] [INFO ] [MAIN ] Update Progress: 1594/2367 symbols completed. ONTF took 29.4s. Estimated remaining: 1h 39m 13s. Rate: 7.8 symbols/min [2025-10-23T23:04:39.204576] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-23T23:04:39.261120] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:39.285805] [DEBUG] [LOCAL ] OPAD: Loaded 26424 existing records from primary storage. [2025-10-23T23:04:39.286123] [INFO ] [MAIN ] OPAD: Loaded 26424 existing records. [2025-10-23T23:04:39.458136] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:39.458384] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-23T23:04:39.458487] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-23T23:04:39.458780] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-23T23:04:39.458871] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-23T23:04:39.810474] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:39.999428] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-23T23:04:40.560159] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-23T23:04:40.613661] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-23T23:04:40.799417] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-23T23:04:41.139322] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T23:04:41.599501] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-23T23:04:42.399430] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-23T23:04:42.639488] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-23T23:04:42.909962] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-23T23:04:43.199448] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-23T23:04:43.805472] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T23:04:43.999450] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-23T23:04:44.218909] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T23:04:44.799441] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-23T23:04:45.599433] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-23T23:04:46.044003] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T23:04:46.053434] [INFO ] [REMOTE ] ONON: Full fetch complete (77770 records). [2025-10-23T23:04:46.053611] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-23T23:04:46.324250] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T23:04:46.399447] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-23T23:04:46.506515] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-23T23:04:46.507256] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-23T23:04:46.509545] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-23T23:04:46.513610] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T23:04:46.513850] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-23T23:04:46.528514] [INFO ] [REMOTE ] ONTO: Full fetch complete (67346 records). [2025-10-23T23:04:46.528752] [DEBUG] [LOCAL ] ONON: Trimmed 77770 records to 54003 (keeping 200 days of data) [2025-10-23T23:04:46.529064] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-23T23:04:47.215340] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-23T23:04:47.215600] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-23T23:04:47.216934] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-23T23:04:47.217043] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-23T23:04:47.215018] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-23T23:04:47.250625] [DEBUG] [LOCAL ] ONTO: Trimmed 67346 records to 47505 (keeping 200 days of data) [2025-10-23T23:04:47.273538] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-23T23:04:47.283389] [DEBUG] [LOCAL ] ONON: Primary data saved (54003 records). [2025-10-23T23:04:47.284013] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-23T23:04:47.284221] [INFO ] [MAIN ] Update Progress: 1595/2367 symbols completed. ONON took 41.4s. Estimated remaining: 1h 39m 5s. Rate: 7.8 symbols/min [2025-10-23T23:04:47.716800] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:47.806897] [DEBUG] [LOCAL ] ONTO: Primary data saved (47505 records). [2025-10-23T23:04:47.807250] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-23T23:04:47.807395] [INFO ] [MAIN ] Update Progress: 1596/2367 symbols completed. ONTO took 28.1s. Estimated remaining: 1h 38m 54s. Rate: 7.8 symbols/min [2025-10-23T23:04:47.921376] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T23:04:47.991870] [DEBUG] [LOCAL ] OPFI: Loaded 46022 existing records from primary storage. [2025-10-23T23:04:48.015135] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-23T23:04:48.046058] [INFO ] [MAIN ] OPFI: Loaded 46022 existing records. [2025-10-23T23:04:48.045218] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:04:48.218557] [DEBUG] [LOCAL ] OPP: Loaded 12339 existing records from primary storage. [2025-10-23T23:04:48.220789] [INFO ] [MAIN ] OPP: Loaded 12339 existing records. [2025-10-23T23:04:48.240736] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:48.287530] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-23T23:04:48.315569] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-23T23:04:48.341448] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-23T23:04:48.353966] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-23T23:04:48.561900] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:04:48.597819] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-23T23:04:48.624788] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-23T23:04:48.696314] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-23T23:04:48.718308] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-23T23:04:48.832030] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-23T23:04:48.904146] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:49.168880] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T23:04:49.173030] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:04:49.567675] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T23:04:49.599410] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-23T23:04:50.399451] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-23T23:04:51.199416] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T23:04:51.199488] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-23T23:04:51.392572] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T23:04:52.003956] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T23:04:52.003013] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-23T23:04:52.799429] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-23T23:04:53.444394] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T23:04:53.599413] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-23T23:04:53.928719] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T23:04:54.399449] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-23T23:04:55.199432] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-23T23:04:55.513476] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T23:04:55.580735] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-23T23:04:55.999420] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-23T23:04:56.045202] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:04:56.799434] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-23T23:04:57.034502] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T23:04:57.599438] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-23T23:04:58.399418] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-23T23:04:58.493371] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T23:04:58.708542] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T23:04:59.199441] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-23T23:04:59.999442] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-23T23:05:00.218503] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T23:05:00.790148] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T23:05:00.799393] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-23T23:05:00.965701] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T23:05:01.599453] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-23T23:05:02.399489] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-23T23:05:02.545495] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-23T23:05:02.814338] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T23:05:03.199443] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-23T23:05:03.310372] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-23T23:05:03.313567] [INFO ] [REMOTE ] OOMA: Full fetch complete (25874 records). [2025-10-23T23:05:03.313721] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-23T23:05:03.679687] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-23T23:05:03.679810] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-23T23:05:03.680468] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-23T23:05:03.680554] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-23T23:05:03.681413] [DEBUG] [LOCAL ] OOMA: Trimmed 25874 records to 18375 (keeping 200 days of data) [2025-10-23T23:05:03.786317] [DEBUG] [LOCAL ] OOMA: Primary data saved (18375 records). [2025-10-23T23:05:03.786495] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-23T23:05:03.786626] [INFO ] [MAIN ] Update Progress: 1597/2367 symbols completed. OOMA took 34.9s. Estimated remaining: 1h 38m 50s. Rate: 7.8 symbols/min [2025-10-23T23:05:03.991730] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T23:05:03.999407] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-23T23:05:04.799446] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-23T23:05:05.599447] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-23T23:05:05.683241] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T23:05:06.179591] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T23:05:06.399515] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-23T23:05:06.751071] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T23:05:06.763725] [INFO ] [REMOTE ] OPAD: Full fetch complete (29192 records). [2025-10-23T23:05:06.763968] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-23T23:05:07.204637] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-23T23:05:07.268488] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-23T23:05:07.268604] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-23T23:05:07.269270] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-23T23:05:07.269348] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-23T23:05:07.270389] [DEBUG] [LOCAL ] OPAD: Trimmed 29192 records to 26687 (keeping 200 days of data) [2025-10-23T23:05:07.417240] [DEBUG] [LOCAL ] OPAD: Primary data saved (26687 records). [2025-10-23T23:05:07.417405] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-23T23:05:07.417520] [INFO ] [MAIN ] Update Progress: 1598/2367 symbols completed. OPAD took 28.3s. Estimated remaining: 1h 38m 41s. Rate: 7.8 symbols/min [2025-10-23T23:05:08.227211] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T23:05:08.230874] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-23T23:05:08.341824] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-23T23:05:08.785766] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T23:05:08.799397] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-23T23:05:09.599429] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-23T23:05:09.823681] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:05:09.827129] [INFO ] [REMOTE ] OPP: Full fetch complete (17426 records). [2025-10-23T23:05:09.827228] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-23T23:05:10.219355] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-23T23:05:10.219464] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-23T23:05:10.219881] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-23T23:05:10.219958] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-23T23:05:10.220496] [DEBUG] [LOCAL ] OPP: Trimmed 17426 records to 12463 (keeping 200 days of data) [2025-10-23T23:05:10.292364] [DEBUG] [LOCAL ] OPP: Primary data saved (12463 records). [2025-10-23T23:05:10.292530] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-23T23:05:10.292670] [INFO ] [MAIN ] Update Progress: 1599/2367 symbols completed. OPP took 22.5s. Estimated remaining: 1h 38m 31s. Rate: 7.8 symbols/min [2025-10-23T23:05:11.289756] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T23:05:11.301615] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-23T23:05:13.103749] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T23:05:13.114111] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-23T23:05:14.880945] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T23:05:14.894848] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-23T23:05:16.596333] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T23:05:16.604248] [INFO ] [REMOTE ] OPFI: Full fetch complete (68549 records). [2025-10-23T23:05:16.604474] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-23T23:05:16.993106] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-23T23:05:16.993223] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-23T23:05:16.994360] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-23T23:05:16.994443] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-23T23:05:16.995828] [DEBUG] [LOCAL ] OPFI: Trimmed 68549 records to 46281 (keeping 200 days of data) [2025-10-23T23:05:17.259412] [DEBUG] [LOCAL ] OPFI: Primary data saved (46281 records). [2025-10-23T23:05:17.259597] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-23T23:05:17.259741] [INFO ] [MAIN ] Update Progress: 1600/2367 symbols completed. OPFI took 30.0s. Estimated remaining: 1h 38m 23s. Rate: 7.8 symbols/min [2025-10-23T23:05:17.893061] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:17.944226] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:17.941083] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:17.962729] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:17.963750] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-23T23:05:17.964103] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-23T23:05:17.964280] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-23T23:05:17.964486] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-23T23:05:17.964717] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-23T23:05:17.964808] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-23T23:05:18.255802] [DEBUG] [LOCAL ] ORA: Loaded 33147 existing records from primary storage. [2025-10-23T23:05:18.304638] [INFO ] [MAIN ] ORA: Loaded 33147 existing records. [2025-10-23T23:05:18.433923] [DEBUG] [LOCAL ] OR: Loaded 46846 existing records from primary storage. [2025-10-23T23:05:18.465682] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:18.525918] [INFO ] [MAIN ] OR: Loaded 46846 existing records. [2025-10-23T23:05:18.486044] [DEBUG] [LOCAL ] ORC: Loaded 52479 existing records from primary storage. [2025-10-23T23:05:18.526863] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-23T23:05:18.557868] [INFO ] [MAIN ] ORC: Loaded 52479 existing records. [2025-10-23T23:05:18.775068] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:05:18.810865] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-23T23:05:18.833699] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-23T23:05:18.915833] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-23T23:05:19.003488] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-23T23:05:18.998627] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:05:19.003394] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:05:19.040444] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-23T23:05:19.035042] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-23T23:05:19.073686] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-23T23:05:19.096851] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-23T23:05:19.107691] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-23T23:05:19.085673] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-23T23:05:19.153495] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-23T23:05:19.153633] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-23T23:05:19.415832] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-23T23:05:19.557207] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-23T23:05:19.842142] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:19.876830] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-23T23:05:20.092285] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:20.111243] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-23T23:05:20.114697] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:20.115922] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-23T23:05:20.396446] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T23:05:20.398595] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-23T23:05:21.080977] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T23:05:21.082977] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-23T23:05:21.338900] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T23:05:21.346592] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-23T23:05:21.688359] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T23:05:21.690555] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-23T23:05:21.716004] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T23:05:21.724907] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-23T23:05:22.116160] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-23T23:05:22.128194] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-23T23:05:22.251686] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T23:05:22.254070] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-23T23:05:22.396443] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T23:05:22.403316] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-23T23:05:23.087985] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T23:05:23.199562] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-23T23:05:23.252172] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T23:05:23.776243] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T23:05:23.841854] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T23:05:23.957935] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-23T23:05:23.999483] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-23T23:05:24.592144] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T23:05:24.799440] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-23T23:05:25.599565] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-23T23:05:26.399487] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-23T23:05:26.452908] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T23:05:27.166304] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-23T23:05:27.199420] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-23T23:05:27.578264] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T23:05:27.944866] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T23:05:27.946758] [INFO ] [REMOTE ] OPY: Full fetch complete (10233 records). [2025-10-23T23:05:27.946861] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-23T23:05:28.008120] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-23T23:05:28.132210] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:05:28.132466] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:05:28.132536] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:05:28.132614] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-23T23:05:28.132729] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-23T23:05:28.132800] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-23T23:05:28.132884] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-23T23:05:28.132981] [INFO ] [MAIN ] Update Progress: 1601/2367 symbols completed. OPY took 10.9s. Estimated remaining: 1h 38m 16s. Rate: 7.8 symbols/min [2025-10-23T23:05:28.297715] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:28.297905] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-23T23:05:28.297983] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-23T23:05:28.298087] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-23T23:05:28.298137] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-23T23:05:28.298220] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-23T23:05:28.298296] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-23T23:05:28.650359] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:28.799419] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-23T23:05:29.599458] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-23T23:05:30.277876] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-23T23:05:30.399396] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-23T23:05:31.006526] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T23:05:31.095214] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T23:05:31.199408] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-23T23:05:31.999423] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-23T23:05:32.592343] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-23T23:05:32.799447] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-23T23:05:33.467899] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T23:05:33.599422] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-23T23:05:33.700559] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-23T23:05:33.779143] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-23T23:05:34.399436] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-23T23:05:34.984773] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T23:05:35.199434] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-23T23:05:35.999494] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-23T23:05:36.799423] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-23T23:05:36.962877] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T23:05:36.991429] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-23T23:05:37.486098] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T23:05:37.599437] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-23T23:05:38.399420] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-23T23:05:38.549017] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T23:05:39.083829] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T23:05:39.199497] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-23T23:05:39.936512] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T23:05:39.999407] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-23T23:05:40.799433] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-23T23:05:41.564028] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-23T23:05:41.599398] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-23T23:05:41.754013] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:05:42.399429] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-23T23:05:42.455596] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T23:05:43.199435] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-23T23:05:43.858858] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-23T23:05:43.933351] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T23:05:43.999451] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-23T23:05:44.486949] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T23:05:44.495901] [INFO ] [REMOTE ] OR: Full fetch complete (67001 records). [2025-10-23T23:05:44.496084] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-23T23:05:44.804507] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-23T23:05:44.891398] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-23T23:05:44.891516] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-23T23:05:44.892676] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-23T23:05:44.892758] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-23T23:05:44.894148] [DEBUG] [LOCAL ] OR: Trimmed 67001 records to 47206 (keeping 200 days of data) [2025-10-23T23:05:45.172067] [DEBUG] [LOCAL ] OR: Primary data saved (47206 records). [2025-10-23T23:05:45.172223] [INFO ] [MAIN ] OR: Full history saved. [2025-10-23T23:05:45.172336] [INFO ] [MAIN ] Update Progress: 1602/2367 symbols completed. OR took 27.9s. Estimated remaining: 1h 38m 13s. Rate: 7.8 symbols/min [2025-10-23T23:05:45.340743] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:45.340958] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-23T23:05:45.341030] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-23T23:05:45.341189] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-23T23:05:45.341267] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-23T23:05:45.341324] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-23T23:05:45.341433] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-23T23:05:45.604518] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-23T23:05:45.690254] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:46.079668] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-23T23:05:46.246811] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T23:05:46.399435] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-23T23:05:47.199422] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-23T23:05:47.999421] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-23T23:05:48.048172] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T23:05:48.214307] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-23T23:05:48.244214] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T23:05:48.799461] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-23T23:05:49.599451] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-23T23:05:50.148847] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-23T23:05:50.358268] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T23:05:50.364868] [INFO ] [REMOTE ] ORA: Full fetch complete (48969 records). [2025-10-23T23:05:50.364990] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-23T23:05:50.407337] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-23T23:05:50.742918] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-23T23:05:50.743031] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-23T23:05:50.743959] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-23T23:05:50.744040] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-23T23:05:50.745162] [DEBUG] [LOCAL ] ORA: Trimmed 48969 records to 33371 (keeping 200 days of data) [2025-10-23T23:05:50.941921] [DEBUG] [LOCAL ] ORA: Primary data saved (33371 records). [2025-10-23T23:05:50.942144] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-23T23:05:50.942283] [INFO ] [MAIN ] Update Progress: 1603/2367 symbols completed. ORA took 33.7s. Estimated remaining: 1h 38m 5s. Rate: 7.8 symbols/min [2025-10-23T23:05:51.131766] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:51.133498] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T23:05:51.168584] [DEBUG] [LOCAL ] ORN: Loaded 30727 existing records from primary storage. [2025-10-23T23:05:51.168995] [INFO ] [MAIN ] ORN: Loaded 30727 existing records. [2025-10-23T23:05:51.204545] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-23T23:05:51.352383] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:05:51.352583] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-23T23:05:51.352685] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-23T23:05:51.352911] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-23T23:05:51.352985] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-23T23:05:51.709549] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:51.999402] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-23T23:05:52.446537] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T23:05:52.455740] [INFO ] [REMOTE ] ORC: Full fetch complete (75603 records). [2025-10-23T23:05:52.455931] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-23T23:05:52.804694] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-23T23:05:52.876390] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-23T23:05:52.876662] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-23T23:05:52.877755] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-23T23:05:52.877851] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-23T23:05:52.879231] [DEBUG] [LOCAL ] ORC: Trimmed 75603 records to 52861 (keeping 200 days of data) [2025-10-23T23:05:53.182834] [DEBUG] [LOCAL ] ORC: Primary data saved (52861 records). [2025-10-23T23:05:53.182960] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-23T23:05:53.183072] [INFO ] [MAIN ] Update Progress: 1604/2367 symbols completed. ORC took 35.9s. Estimated remaining: 1h 37m 54s. Rate: 7.8 symbols/min [2025-10-23T23:05:53.355738] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:05:53.375393] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T23:05:53.428850] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-23T23:05:53.429172] [INFO ] [MAIN ] OSCR: Loaded 53769 existing records. [2025-10-23T23:05:53.612813] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:05:53.612947] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-23T23:05:53.614105] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-23T23:05:53.614244] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-23T23:05:53.614712] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-23T23:05:53.614789] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-23T23:05:53.995791] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:05:54.013224] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-23T23:05:54.399429] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-23T23:05:54.482947] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T23:05:54.508805] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T23:05:55.199444] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-23T23:05:55.999449] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-23T23:05:56.792004] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-23T23:05:56.802807] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-23T23:05:56.973296] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T23:05:57.308356] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T23:05:57.599443] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-23T23:05:58.399490] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-23T23:05:58.525710] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T23:05:59.199424] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-23T23:05:59.296545] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T23:05:59.739034] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T23:05:59.999462] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-23T23:06:00.799449] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-23T23:06:01.527932] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-23T23:06:01.599544] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-23T23:06:01.683176] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T23:06:02.247004] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:06:02.399482] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-23T23:06:03.199485] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-23T23:06:03.399717] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:06:03.660410] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-23T23:06:03.999494] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-23T23:06:04.799485] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-23T23:06:05.400453] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T23:06:05.599452] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-23T23:06:06.001925] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-23T23:06:06.399442] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-23T23:06:06.837183] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T23:06:07.199419] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-23T23:06:07.459269] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T23:06:07.528878] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:06:07.941326] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T23:06:07.951142] [INFO ] [REMOTE ] ORCL: Full fetch complete (77603 records). [2025-10-23T23:06:07.951366] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-23T23:06:08.005430] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-23T23:06:08.153766] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:06:08.154498] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:06:08.154569] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:06:08.154663] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-23T23:06:08.154758] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-23T23:06:08.154830] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-23T23:06:08.154910] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-23T23:06:08.155002] [INFO ] [MAIN ] Update Progress: 1605/2367 symbols completed. ORCL took 40.0s. Estimated remaining: 1h 37m 50s. Rate: 7.8 symbols/min [2025-10-23T23:06:08.320738] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:08.320922] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-23T23:06:08.320992] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-23T23:06:08.321099] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-23T23:06:08.321167] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-23T23:06:08.321247] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-23T23:06:08.321322] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-23T23:06:08.664276] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:08.799400] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-23T23:06:09.503513] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-23T23:06:09.599452] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-23T23:06:10.376930] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T23:06:10.399436] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-23T23:06:11.199468] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-23T23:06:11.390055] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T23:06:11.395173] [INFO ] [REMOTE ] ORN: Full fetch complete (45512 records). [2025-10-23T23:06:11.395302] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-23T23:06:11.767376] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-23T23:06:11.767486] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-23T23:06:11.768428] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-23T23:06:11.768517] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-23T23:06:11.769570] [DEBUG] [LOCAL ] ORN: Trimmed 45512 records to 30896 (keeping 200 days of data) [2025-10-23T23:06:11.944364] [DEBUG] [LOCAL ] ORN: Primary data saved (30896 records). [2025-10-23T23:06:11.944617] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-23T23:06:11.944774] [INFO ] [MAIN ] Update Progress: 1606/2367 symbols completed. ORN took 21.0s. Estimated remaining: 1h 37m 40s. Rate: 7.8 symbols/min [2025-10-23T23:06:12.008352] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-23T23:06:12.114744] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:12.114911] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-23T23:06:12.114980] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-23T23:06:12.115087] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-23T23:06:12.115188] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-23T23:06:12.115269] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-23T23:06:12.115335] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-23T23:06:12.471932] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:12.645955] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T23:06:12.785368] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-23T23:06:12.799412] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-10-23T23:06:13.008038] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:06:13.008445] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-10-23T23:06:13.008533] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:06:13.008605] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-23T23:06:13.008695] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:06:13.008768] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-23T23:06:13.008856] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-23T23:06:13.008928] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-23T23:06:13.009007] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-23T23:06:13.009088] [INFO ] [MAIN ] Update Progress: 1607/2367 symbols completed. OTF took 1.1s. Estimated remaining: 1h 37m 30s. Rate: 7.8 symbols/min [2025-10-23T23:06:13.177179] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:13.224853] [DEBUG] [LOCAL ] OTIS: Loaded 52700 existing records from primary storage. [2025-10-23T23:06:13.225249] [INFO ] [MAIN ] OTIS: Loaded 52700 existing records. [2025-10-23T23:06:13.406130] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:06:13.406442] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-23T23:06:13.406568] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-23T23:06:13.407123] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-10-23T23:06:13.407204] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-23T23:06:13.604149] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-23T23:06:13.605849] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T23:06:13.803025] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:14.399465] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-23T23:06:15.122364] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:06:15.199415] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-23T23:06:15.999439] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-23T23:06:16.799495] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-23T23:06:16.934343] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T23:06:17.041388] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-23T23:06:17.599455] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-23T23:06:17.890727] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-23T23:06:18.399497] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-23T23:06:18.539292] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:06:19.199501] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-23T23:06:19.999465] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-23T23:06:20.073122] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T23:06:20.081865] [INFO ] [REMOTE ] ORI: Full fetch complete (70498 records). [2025-10-23T23:06:20.082062] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-23T23:06:20.282464] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:06:20.283420] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:06:20.283516] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:06:20.283717] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-23T23:06:20.283857] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-23T23:06:20.284039] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-23T23:06:20.284128] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-23T23:06:20.284233] [INFO ] [MAIN ] Update Progress: 1608/2367 symbols completed. ORI took 35.1s. Estimated remaining: 1h 37m 22s. Rate: 7.8 symbols/min [2025-10-23T23:06:20.456039] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:20.488386] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-23T23:06:20.539734] [DEBUG] [LOCAL ] OUT: Loaded 47687 existing records from primary storage. [2025-10-23T23:06:20.540133] [INFO ] [MAIN ] OUT: Loaded 47687 existing records. [2025-10-23T23:06:20.735706] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:06:20.736205] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-23T23:06:20.736344] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-23T23:06:20.737003] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-23T23:06:20.737085] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-23T23:06:20.801278] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-23T23:06:20.942084] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:06:21.134410] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:21.599498] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-23T23:06:21.814523] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T23:06:22.399518] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-23T23:06:23.115007] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T23:06:23.199402] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-23T23:06:23.457582] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-23T23:06:23.967921] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:06:23.999401] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-23T23:06:24.753370] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T23:06:24.799480] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-23T23:06:25.599471] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-23T23:06:25.664395] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T23:06:26.247849] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T23:06:26.399408] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-23T23:06:27.199414] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-23T23:06:27.363865] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T23:06:27.999469] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-23T23:06:28.260875] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T23:06:28.762949] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T23:06:28.799409] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-23T23:06:29.599440] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-23T23:06:30.401413] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-23T23:06:30.482783] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T23:06:30.701972] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-23T23:06:31.199413] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-23T23:06:31.364355] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T23:06:31.829334] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T23:06:31.999431] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-23T23:06:32.277634] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:06:32.799434] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-23T23:06:33.599423] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-23T23:06:33.732221] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T23:06:34.399448] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-23T23:06:35.199480] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-23T23:06:35.350953] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-23T23:06:35.360189] [INFO ] [REMOTE ] OSCR: Full fetch complete (77761 records). [2025-10-23T23:06:35.360346] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-23T23:06:35.787835] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-23T23:06:35.790068] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T23:06:35.800618] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-23T23:06:35.802534] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-23T23:06:35.803064] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-23T23:06:35.805140] [DEBUG] [LOCAL ] OSCR: Trimmed 77761 records to 54159 (keeping 200 days of data) [2025-10-23T23:06:36.001810] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-23T23:06:36.033038] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T23:06:36.156638] [DEBUG] [LOCAL ] OSCR: Primary data saved (54159 records). [2025-10-23T23:06:36.156818] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-23T23:06:36.156929] [INFO ] [MAIN ] Update Progress: 1609/2367 symbols completed. OSCR took 43.0s. Estimated remaining: 1h 37m 18s. Rate: 7.8 symbols/min [2025-10-23T23:06:36.324746] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:36.371273] [DEBUG] [LOCAL ] OVV: Loaded 53493 existing records from primary storage. [2025-10-23T23:06:36.371619] [INFO ] [MAIN ] OVV: Loaded 53493 existing records. [2025-10-23T23:06:36.551612] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:06:36.551815] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-23T23:06:36.551887] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-23T23:06:36.552093] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-23T23:06:36.552160] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-23T23:06:36.806251] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-23T23:06:36.894016] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T23:06:36.935780] [INFO ] [REMOTE ] OSK: Full fetch complete (61365 records). [2025-10-23T23:06:36.940243] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:36.940689] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-23T23:06:37.129453] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:06:37.130147] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:06:37.130224] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:06:37.130299] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-23T23:06:37.130392] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-23T23:06:37.130466] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-23T23:06:37.130547] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-23T23:06:37.130680] [INFO ] [MAIN ] Update Progress: 1610/2367 symbols completed. OSK took 29.0s. Estimated remaining: 1h 37m 7s. Rate: 7.8 symbols/min [2025-10-23T23:06:37.300353] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:37.352005] [DEBUG] [LOCAL ] OWL: Loaded 53560 existing records from primary storage. [2025-10-23T23:06:37.352352] [INFO ] [MAIN ] OWL: Loaded 53560 existing records. [2025-10-23T23:06:37.533234] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:06:37.533458] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-23T23:06:37.533537] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-23T23:06:37.533801] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-23T23:06:37.533874] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-23T23:06:37.601626] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-23T23:06:37.884781] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:37.969514] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T23:06:38.399411] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-23T23:06:38.521310] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T23:06:39.199430] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-23T23:06:39.257467] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:06:39.999424] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-23T23:06:40.239489] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T23:06:40.799427] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-23T23:06:40.897994] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T23:06:41.356537] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T23:06:41.589399] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T23:06:41.598394] [INFO ] [REMOTE ] OTIS: Full fetch complete (76400 records). [2025-10-23T23:06:41.598545] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-23T23:06:41.604610] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-23T23:06:41.990513] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-23T23:06:41.990662] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-23T23:06:41.991820] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-23T23:06:41.991919] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-23T23:06:41.993383] [DEBUG] [LOCAL ] OTIS: Trimmed 76400 records to 53082 (keeping 200 days of data) [2025-10-23T23:06:42.304125] [DEBUG] [LOCAL ] OTIS: Primary data saved (53082 records). [2025-10-23T23:06:42.304290] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-23T23:06:42.304420] [INFO ] [MAIN ] Update Progress: 1611/2367 symbols completed. OTIS took 29.3s. Estimated remaining: 1h 36m 58s. Rate: 7.8 symbols/min [2025-10-23T23:06:42.403781] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-23T23:06:42.473607] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:42.483448] [DEBUG] [LOCAL ] OWLT: Loaded 9777 existing records from primary storage. [2025-10-23T23:06:42.483711] [INFO ] [MAIN ] OWLT: Loaded 9777 existing records. [2025-10-23T23:06:42.657098] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:06:42.657284] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-23T23:06:42.657356] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-23T23:06:42.657594] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-23T23:06:42.657698] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-23T23:06:43.007112] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:43.199402] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-23T23:06:43.296584] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T23:06:43.563921] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T23:06:43.876698] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-23T23:06:43.999421] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-23T23:06:44.601330] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T23:06:44.799427] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-23T23:06:45.532052] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-23T23:06:45.599422] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-23T23:06:46.399439] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-23T23:06:47.052631] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-23T23:06:47.082852] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T23:06:47.090966] [INFO ] [REMOTE ] OUT: Full fetch complete (69189 records). [2025-10-23T23:06:47.091109] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-23T23:06:47.204722] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-23T23:06:47.472002] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-23T23:06:47.472125] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-23T23:06:47.473194] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-23T23:06:47.473273] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-23T23:06:47.474579] [DEBUG] [LOCAL ] OUT: Trimmed 69189 records to 48059 (keeping 200 days of data) [2025-10-23T23:06:47.758745] [DEBUG] [LOCAL ] OUT: Primary data saved (48059 records). [2025-10-23T23:06:47.758911] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-23T23:06:47.759024] [INFO ] [MAIN ] Update Progress: 1612/2367 symbols completed. OUT took 27.5s. Estimated remaining: 1h 36m 49s. Rate: 7.8 symbols/min [2025-10-23T23:06:47.922764] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:47.951440] [DEBUG] [LOCAL ] OXM: Loaded 33140 existing records from primary storage. [2025-10-23T23:06:47.951775] [INFO ] [MAIN ] OXM: Loaded 33140 existing records. [2025-10-23T23:06:48.004839] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-23T23:06:48.127306] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:06:48.127533] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-23T23:06:48.127594] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-23T23:06:48.127891] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-23T23:06:48.127969] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-23T23:06:48.471828] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:48.699422] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T23:06:48.799409] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-23T23:06:49.137957] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T23:06:49.599429] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-23T23:06:49.978179] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-23T23:06:50.399442] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-23T23:06:51.199552] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-23T23:06:51.367878] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T23:06:51.516057] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-23T23:06:51.999458] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-23T23:06:52.104080] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T23:06:52.799470] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-23T23:06:53.599442] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-23T23:06:53.932475] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T23:06:54.319114] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:06:54.333322] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T23:06:54.399393] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-23T23:06:55.199431] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-23T23:06:55.225127] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T23:06:55.999445] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-23T23:06:56.799415] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-23T23:06:56.976955] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T23:06:57.540930] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T23:06:57.580321] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T23:06:57.599402] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-23T23:06:58.399426] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-23T23:06:58.580306] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T23:06:58.583340] [INFO ] [REMOTE ] OWLT: Full fetch complete (12611 records). [2025-10-23T23:06:58.583452] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-23T23:06:58.952369] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-23T23:06:58.952984] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-23T23:06:58.953221] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-23T23:06:58.953293] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-23T23:06:58.953986] [DEBUG] [LOCAL ] OWLT: Trimmed 12611 records to 9966 (keeping 200 days of data) [2025-10-23T23:06:59.008044] [DEBUG] [LOCAL ] OWLT: Primary data saved (9966 records). [2025-10-23T23:06:59.008169] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-23T23:06:59.008311] [INFO ] [MAIN ] Update Progress: 1613/2367 symbols completed. OWLT took 16.7s. Estimated remaining: 1h 36m 43s. Rate: 7.8 symbols/min [2025-10-23T23:06:59.171780] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:06:59.171958] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-23T23:06:59.172039] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-23T23:06:59.172154] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-23T23:06:59.172239] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-23T23:06:59.172324] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-23T23:06:59.172486] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-23T23:06:59.204569] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-23T23:06:59.556871] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:06:59.999414] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-23T23:07:00.293172] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T23:07:00.799431] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-23T23:07:01.331879] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T23:07:01.599498] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-23T23:07:02.408019] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-23T23:07:02.414504] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-23T23:07:02.621207] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T23:07:02.844255] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T23:07:03.199434] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-23T23:07:03.395554] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T23:07:03.999475] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-23T23:07:04.799438] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-23T23:07:05.253352] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-23T23:07:05.462421] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T23:07:05.599463] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-23T23:07:06.380717] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T23:07:06.399400] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-23T23:07:07.199448] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-23T23:07:07.906339] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T23:07:07.999412] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-23T23:07:08.064300] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-23T23:07:08.799462] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-23T23:07:09.040587] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-23T23:07:09.599420] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-23T23:07:09.828866] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T23:07:10.030381] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T23:07:10.399491] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-23T23:07:11.199437] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-23T23:07:11.999423] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-23T23:07:12.240239] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T23:07:12.335340] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-23T23:07:12.799485] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-23T23:07:13.098342] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T23:07:13.152770] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T23:07:13.599463] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-23T23:07:14.399425] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-23T23:07:14.731127] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-23T23:07:14.740503] [INFO ] [REMOTE ] OWL: Full fetch complete (77712 records). [2025-10-23T23:07:14.740711] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-23T23:07:15.057077] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:07:15.102673] [INFO ] [REMOTE ] OXM: Full fetch complete (46542 records). [2025-10-23T23:07:15.121019] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-23T23:07:15.192309] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-23T23:07:15.203737] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-23T23:07:15.224473] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-23T23:07:15.239229] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-23T23:07:15.244671] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-23T23:07:15.296265] [DEBUG] [LOCAL ] OWL: Trimmed 77712 records to 53950 (keeping 200 days of data) [2025-10-23T23:07:15.736503] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-23T23:07:15.736978] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-23T23:07:15.764267] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-23T23:07:15.774482] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-23T23:07:15.802906] [DEBUG] [LOCAL ] OXM: Trimmed 46542 records to 33367 (keeping 200 days of data) [2025-10-23T23:07:15.981822] [DEBUG] [LOCAL ] OWL: Primary data saved (53950 records). [2025-10-23T23:07:15.983751] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-23T23:07:16.007000] [INFO ] [MAIN ] Update Progress: 1614/2367 symbols completed. OWL took 38.9s. Estimated remaining: 1h 36m 40s. Rate: 7.8 symbols/min [2025-10-23T23:07:16.214966] [DEBUG] [LOCAL ] OXM: Primary data saved (33367 records). [2025-10-23T23:07:16.215176] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-23T23:07:16.215308] [INFO ] [MAIN ] Update Progress: 1615/2367 symbols completed. OXM took 28.5s. Estimated remaining: 1h 36m 29s. Rate: 7.8 symbols/min [2025-10-23T23:07:16.386488] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:16.475821] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:16.510813] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-23T23:07:16.533329] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-23T23:07:16.538413] [DEBUG] [LOCAL ] PAC: Loaded 11566 existing records from primary storage. [2025-10-23T23:07:16.539637] [INFO ] [MAIN ] PAC: Loaded 11566 existing records. [2025-10-23T23:07:16.703372] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-23T23:07:16.724222] [INFO ] [MAIN ] PAAS: Loaded 53625 existing records. [2025-10-23T23:07:16.886805] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:16.887117] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-23T23:07:16.892742] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-23T23:07:16.936181] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-23T23:07:16.938871] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-23T23:07:17.013255] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:17.052091] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-23T23:07:17.071437] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-23T23:07:17.083986] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-23T23:07:17.089461] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-23T23:07:17.622163] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:17.629623] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-23T23:07:17.721497] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:17.722048] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-23T23:07:17.950034] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-23T23:07:18.042265] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T23:07:18.399487] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-23T23:07:18.502141] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-23T23:07:19.199431] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-23T23:07:19.666289] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-23T23:07:19.821675] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T23:07:19.999444] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-23T23:07:20.153918] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T23:07:20.163351] [INFO ] [REMOTE ] OVV: Full fetch complete (77515 records). [2025-10-23T23:07:20.163534] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-23T23:07:20.548926] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-23T23:07:20.549055] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-23T23:07:20.550331] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-23T23:07:20.550413] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-23T23:07:20.551863] [DEBUG] [LOCAL ] OVV: Trimmed 77515 records to 53884 (keeping 200 days of data) [2025-10-23T23:07:20.826150] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-23T23:07:20.876845] [DEBUG] [LOCAL ] OVV: Primary data saved (53884 records). [2025-10-23T23:07:20.877011] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-23T23:07:20.877158] [INFO ] [MAIN ] Update Progress: 1616/2367 symbols completed. OVV took 44.7s. Estimated remaining: 1h 36m 20s. Rate: 7.8 symbols/min [2025-10-23T23:07:21.044699] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:21.072781] [DEBUG] [LOCAL ] PACK: Loaded 31862 existing records from primary storage. [2025-10-23T23:07:21.073143] [INFO ] [MAIN ] PACK: Loaded 31862 existing records. [2025-10-23T23:07:21.251499] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:21.251788] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-23T23:07:21.251887] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-23T23:07:21.252146] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-23T23:07:21.252230] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-23T23:07:21.608353] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:21.604253] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-23T23:07:21.776269] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T23:07:22.399423] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-23T23:07:22.572246] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-23T23:07:23.028274] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T23:07:23.199431] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-23T23:07:23.636841] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T23:07:23.999432] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-23T23:07:24.799429] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-23T23:07:25.244308] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T23:07:25.353585] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T23:07:25.599442] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-23T23:07:26.399488] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-23T23:07:27.199462] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-23T23:07:27.308277] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-23T23:07:27.416170] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T23:07:27.637752] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-23T23:07:27.999440] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-23T23:07:28.593309] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T23:07:28.799486] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-23T23:07:29.599422] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-23T23:07:29.697070] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T23:07:29.924230] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T23:07:30.399438] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-23T23:07:30.990635] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T23:07:31.199419] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-23T23:07:31.428345] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T23:07:31.999435] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-23T23:07:32.799411] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-23T23:07:33.202672] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T23:07:33.599495] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-23T23:07:34.109847] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-23T23:07:34.146075] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T23:07:34.399453] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-23T23:07:34.739278] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T23:07:35.199463] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-23T23:07:35.638372] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T23:07:35.999445] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-23T23:07:36.799451] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-23T23:07:37.544474] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-23T23:07:37.599410] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-23T23:07:37.877252] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T23:07:38.075899] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T23:07:38.326285] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T23:07:38.336315] [INFO ] [REMOTE ] OXY: Full fetch complete (77585 records). [2025-10-23T23:07:38.336500] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-23T23:07:38.407406] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-23T23:07:38.559464] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:07:38.560768] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:07:38.560857] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:07:38.560980] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-23T23:07:38.561104] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-23T23:07:38.561183] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-23T23:07:38.561273] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-23T23:07:38.561402] [INFO ] [MAIN ] Update Progress: 1617/2367 symbols completed. OXY took 39.6s. Estimated remaining: 1h 36m 17s. Rate: 7.8 symbols/min [2025-10-23T23:07:38.756031] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:38.791194] [DEBUG] [LOCAL ] PACS: Loaded 34769 existing records from primary storage. [2025-10-23T23:07:38.791515] [INFO ] [MAIN ] PACS: Loaded 34769 existing records. [2025-10-23T23:07:38.996443] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:38.996747] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-23T23:07:38.996828] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-23T23:07:38.997059] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-23T23:07:38.997132] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-23T23:07:39.204810] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-23T23:07:39.401103] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:39.999423] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-23T23:07:40.383781] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-23T23:07:40.599808] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T23:07:40.799424] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-23T23:07:41.217427] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T23:07:41.599526] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-23T23:07:42.197582] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-23T23:07:42.399441] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-23T23:07:43.199430] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-23T23:07:43.752851] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T23:07:43.813620] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-23T23:07:43.970138] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T23:07:43.999399] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-23T23:07:44.799471] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-23T23:07:45.599432] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-23T23:07:45.616401] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:07:46.286914] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-23T23:07:46.296383] [INFO ] [REMOTE ] PAAS: Full fetch complete (77660 records). [2025-10-23T23:07:46.296571] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-23T23:07:46.399676] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-23T23:07:46.704796] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-23T23:07:46.704921] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-23T23:07:46.706148] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-23T23:07:46.706229] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-23T23:07:46.707813] [DEBUG] [LOCAL ] PAAS: Trimmed 77660 records to 54015 (keeping 200 days of data) [2025-10-23T23:07:46.852482] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-23T23:07:46.946947] [INFO ] [REMOTE ] PACK: Full fetch complete (45435 records). [2025-10-23T23:07:46.968899] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-23T23:07:47.199427] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-23T23:07:47.386228] [DEBUG] [LOCAL ] PAAS: Primary data saved (54015 records). [2025-10-23T23:07:47.418409] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-23T23:07:47.435304] [INFO ] [MAIN ] Update Progress: 1618/2367 symbols completed. PAAS took 31.4s. Estimated remaining: 1h 36m 9s. Rate: 7.8 symbols/min [2025-10-23T23:07:47.461365] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-23T23:07:47.515017] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-23T23:07:47.526886] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-23T23:07:47.532204] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-23T23:07:47.583636] [DEBUG] [LOCAL ] PACK: Trimmed 45435 records to 32108 (keeping 200 days of data) [2025-10-23T23:07:47.676366] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:47.850082] [DEBUG] [LOCAL ] PACK: Primary data saved (32108 records). [2025-10-23T23:07:47.862146] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-23T23:07:47.864580] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T23:07:47.863857] [DEBUG] [LOCAL ] PAG: Loaded 21200 existing records from primary storage. [2025-10-23T23:07:47.864809] [INFO ] [MAIN ] Update Progress: 1619/2367 symbols completed. PACK took 27.0s. Estimated remaining: 1h 35m 58s. Rate: 7.8 symbols/min [2025-10-23T23:07:47.872099] [INFO ] [MAIN ] PAG: Loaded 21200 existing records. [2025-10-23T23:07:48.009221] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-23T23:07:48.193353] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:48.267279] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:48.269582] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-23T23:07:48.269296] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T23:07:48.272267] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-23T23:07:48.272722] [INFO ] [REMOTE ] PAC: Full fetch complete (16811 records). [2025-10-23T23:07:48.272805] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-23T23:07:48.273199] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-23T23:07:48.272867] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-23T23:07:48.856040] [DEBUG] [LOCAL ] PAGS: Loaded 52806 existing records from primary storage. [2025-10-23T23:07:48.899925] [INFO ] [MAIN ] PAGS: Loaded 52806 existing records. [2025-10-23T23:07:49.164684] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:49.203568] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-23T23:07:49.209006] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-23T23:07:49.225439] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-23T23:07:49.247249] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-23T23:07:49.286762] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:49.282627] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-23T23:07:49.288274] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-23T23:07:49.288836] [DEBUG] [LOCAL ] PAC: Trimmed 16811 records to 11602 (keeping 200 days of data) [2025-10-23T23:07:49.288931] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-23T23:07:49.289790] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-23T23:07:49.289889] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-23T23:07:49.484846] [DEBUG] [LOCAL ] PAC: Primary data saved (11602 records). [2025-10-23T23:07:49.514318] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-23T23:07:49.524984] [INFO ] [MAIN ] Update Progress: 1620/2367 symbols completed. PAC took 33.3s. Estimated remaining: 1h 35m 48s. Rate: 7.8 symbols/min [2025-10-23T23:07:49.909552] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:07:49.931413] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:49.932162] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-23T23:07:49.957967] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T23:07:49.971519] [DEBUG] [LOCAL ] PAI: Loaded 2830 existing records from primary storage. [2025-10-23T23:07:49.971952] [INFO ] [MAIN ] PAI: Loaded 2830 existing records. [2025-10-23T23:07:50.187165] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:07:50.187466] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-23T23:07:50.187558] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-23T23:07:50.187838] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-23T23:07:50.187927] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-23T23:07:50.368618] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-23T23:07:50.410915] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-23T23:07:50.597512] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:07:51.199439] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-23T23:07:51.460347] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T23:07:51.564734] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:07:51.999440] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-23T23:07:52.507006] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-23T23:07:52.799447] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-23T23:07:53.242593] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T23:07:53.599444] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-23T23:07:54.234317] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T23:07:54.399428] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-23T23:07:55.008406] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T23:07:55.199428] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-23T23:07:55.840819] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T23:07:55.999412] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-23T23:07:56.040966] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T23:07:56.799446] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-23T23:07:57.052551] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T23:07:57.599423] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-23T23:07:58.091377] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T23:07:58.399397] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-23T23:07:58.723889] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T23:07:59.199560] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-23T23:07:59.836009] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T23:07:59.999512] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-23T23:08:00.433380] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T23:08:00.799476] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-23T23:08:01.599436] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-23T23:08:01.684789] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T23:08:02.399470] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-23T23:08:02.562479] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T23:08:02.733070] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:08:02.882374] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T23:08:03.199442] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-23T23:08:03.999465] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-23T23:08:04.799451] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-23T23:08:05.078764] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T23:08:05.471464] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-23T23:08:05.477755] [INFO ] [REMOTE ] PACS: Full fetch complete (50371 records). [2025-10-23T23:08:05.477913] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-23T23:08:05.604602] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-23T23:08:05.878283] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-23T23:08:05.884332] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:08:05.883838] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-23T23:08:05.889714] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-23T23:08:05.890338] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-23T23:08:05.891466] [DEBUG] [LOCAL ] PACS: Trimmed 50371 records to 34973 (keeping 200 days of data) [2025-10-23T23:08:06.093786] [DEBUG] [LOCAL ] PACS: Primary data saved (34973 records). [2025-10-23T23:08:06.093964] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-23T23:08:06.094085] [INFO ] [MAIN ] Update Progress: 1621/2367 symbols completed. PACS took 27.5s. Estimated remaining: 1h 35m 44s. Rate: 7.8 symbols/min [2025-10-23T23:08:06.197350] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:08:06.268581] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:06.268793] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-23T23:08:06.268864] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-23T23:08:06.268951] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-23T23:08:06.269015] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-23T23:08:06.269073] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-23T23:08:06.269141] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-23T23:08:06.411340] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-23T23:08:06.638462] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:07.199477] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-10-23T23:08:07.415434] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:08:07.415819] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-10-23T23:08:07.415911] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:08:07.415992] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-23T23:08:07.416066] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:08:07.416138] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-23T23:08:07.416234] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-23T23:08:07.416305] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-23T23:08:07.416390] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-23T23:08:07.416471] [INFO ] [MAIN ] Update Progress: 1622/2367 symbols completed. PAII took 1.3s. Estimated remaining: 1h 35m 34s. Rate: 7.8 symbols/min [2025-10-23T23:08:07.588373] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:07.617260] [DEBUG] [LOCAL ] PAM: Loaded 29064 existing records from primary storage. [2025-10-23T23:08:07.617587] [INFO ] [MAIN ] PAM: Loaded 29064 existing records. [2025-10-23T23:08:07.795753] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:07.795973] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-23T23:08:07.796046] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-23T23:08:07.796276] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-23T23:08:07.796348] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-23T23:08:08.010899] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-23T23:08:08.151215] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:08.269987] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T23:08:08.799461] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-23T23:08:09.156918] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T23:08:09.161110] [INFO ] [REMOTE ] PAG: Full fetch complete (30937 records). [2025-10-23T23:08:09.161213] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-23T23:08:09.524566] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-23T23:08:09.524693] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-23T23:08:09.525297] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-23T23:08:09.525370] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-23T23:08:09.526141] [DEBUG] [LOCAL ] PAG: Trimmed 30937 records to 21424 (keeping 200 days of data) [2025-10-23T23:08:09.612584] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-23T23:08:09.657800] [DEBUG] [LOCAL ] PAG: Primary data saved (21424 records). [2025-10-23T23:08:09.657940] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-23T23:08:09.658047] [INFO ] [MAIN ] Update Progress: 1623/2367 symbols completed. PAG took 22.2s. Estimated remaining: 1h 35m 23s. Rate: 7.8 symbols/min [2025-10-23T23:08:09.827355] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:09.856702] [DEBUG] [LOCAL ] PAR: Loaded 34300 existing records from primary storage. [2025-10-23T23:08:09.857071] [INFO ] [MAIN ] PAR: Loaded 34300 existing records. [2025-10-23T23:08:10.033317] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:10.033541] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-23T23:08:10.033638] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-23T23:08:10.033979] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-23T23:08:10.034054] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-23T23:08:10.381415] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:10.399408] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-23T23:08:10.728716] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T23:08:10.804034] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-23T23:08:11.144035] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T23:08:11.199462] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-23T23:08:11.999447] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-23T23:08:12.614707] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T23:08:12.799444] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-23T23:08:13.269740] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T23:08:13.599433] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-23T23:08:13.832099] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T23:08:14.150708] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-23T23:08:14.399477] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-23T23:08:15.199469] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-23T23:08:15.771329] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T23:08:15.999521] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-23T23:08:16.495095] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-23T23:08:16.799430] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-23T23:08:17.052955] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T23:08:17.599456] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-23T23:08:18.098031] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T23:08:18.126294] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T23:08:18.399532] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-23T23:08:19.199512] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-23T23:08:19.769258] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-23T23:08:19.769429] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T23:08:19.999496] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-23T23:08:20.799414] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-23T23:08:20.940949] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-23T23:08:21.599414] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-23T23:08:22.399420] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-23T23:08:22.518967] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T23:08:23.046733] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T23:08:23.199433] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-23T23:08:23.781888] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-23T23:08:23.999468] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-23T23:08:24.537424] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T23:08:24.546695] [INFO ] [REMOTE ] PAGS: Full fetch complete (76510 records). [2025-10-23T23:08:24.546845] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-23T23:08:24.804814] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-23T23:08:24.937932] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-23T23:08:24.938125] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-23T23:08:24.939255] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-23T23:08:24.939359] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-23T23:08:24.941287] [DEBUG] [LOCAL ] PAGS: Trimmed 76510 records to 53193 (keeping 200 days of data) [2025-10-23T23:08:24.956968] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-23T23:08:25.268947] [DEBUG] [LOCAL ] PAGS: Primary data saved (53193 records). [2025-10-23T23:08:25.269107] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-23T23:08:25.269218] [INFO ] [MAIN ] Update Progress: 1624/2367 symbols completed. PAGS took 37.4s. Estimated remaining: 1h 35m 19s. Rate: 7.8 symbols/min [2025-10-23T23:08:25.433998] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:25.474580] [DEBUG] [LOCAL ] PARR: Loaded 47952 existing records from primary storage. [2025-10-23T23:08:25.474997] [INFO ] [MAIN ] PARR: Loaded 47952 existing records. [2025-10-23T23:08:25.611283] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-23T23:08:25.651167] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:25.651343] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-23T23:08:25.651418] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-23T23:08:25.651908] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-23T23:08:25.651982] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-23T23:08:26.000841] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:26.104505] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T23:08:26.105732] [INFO ] [REMOTE ] PAI: Full fetch complete (4142 records). [2025-10-23T23:08:26.105823] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-23T23:08:26.400827] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-23T23:08:26.477834] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T23:08:26.489349] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-23T23:08:26.489895] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-23T23:08:26.490074] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-23T23:08:26.490425] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-23T23:08:26.490857] [DEBUG] [LOCAL ] PAI: Trimmed 4142 records to 2872 (keeping 200 days of data) [2025-10-23T23:08:26.508046] [DEBUG] [LOCAL ] PAI: Primary data saved (2872 records). [2025-10-23T23:08:26.508130] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-23T23:08:26.508233] [INFO ] [MAIN ] Update Progress: 1625/2367 symbols completed. PAI took 37.0s. Estimated remaining: 1h 35m 9s. Rate: 7.8 symbols/min [2025-10-23T23:08:26.673513] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:26.725184] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-23T23:08:26.725517] [INFO ] [MAIN ] PATH: Loaded 53680 existing records. [2025-10-23T23:08:26.898927] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:26.899124] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-23T23:08:26.899196] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-23T23:08:26.899436] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-23T23:08:26.899511] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-23T23:08:27.211798] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-23T23:08:27.252349] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:27.999416] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-23T23:08:28.274399] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T23:08:28.538892] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T23:08:28.799414] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-23T23:08:29.599438] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-23T23:08:30.339910] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-23T23:08:30.399413] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-23T23:08:30.543369] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T23:08:30.960520] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T23:08:31.199434] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-23T23:08:31.999492] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-23T23:08:32.592402] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-23T23:08:32.687367] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T23:08:32.799454] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-23T23:08:33.065019] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-23T23:08:33.599423] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-23T23:08:34.399429] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-23T23:08:34.497109] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:08:34.937619] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T23:08:35.199462] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-23T23:08:35.999480] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-23T23:08:36.799461] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-23T23:08:37.153045] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-23T23:08:37.540510] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-23T23:08:37.599392] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-23T23:08:37.918494] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-23T23:08:37.971521] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T23:08:38.399445] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-23T23:08:39.061053] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T23:08:39.199419] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-23T23:08:39.999485] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-23T23:08:40.431340] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T23:08:40.799444] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-23T23:08:40.909553] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T23:08:41.247835] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T23:08:41.599488] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-23T23:08:41.877300] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:08:42.399488] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-23T23:08:43.199452] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-23T23:08:43.399955] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T23:08:43.769112] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-23T23:08:43.775298] [INFO ] [REMOTE ] PAM: Full fetch complete (42478 records). [2025-10-23T23:08:43.775464] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-23T23:08:44.008271] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-23T23:08:44.156190] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-23T23:08:44.156300] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-23T23:08:44.157157] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-23T23:08:44.157234] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-23T23:08:44.158186] [DEBUG] [LOCAL ] PAM: Trimmed 42478 records to 29368 (keeping 200 days of data) [2025-10-23T23:08:44.324463] [DEBUG] [LOCAL ] PAM: Primary data saved (29368 records). [2025-10-23T23:08:44.324615] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-23T23:08:44.324754] [INFO ] [MAIN ] Update Progress: 1626/2367 symbols completed. PAM took 36.9s. Estimated remaining: 1h 35m 6s. Rate: 7.8 symbols/min [2025-10-23T23:08:44.499441] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:44.520326] [DEBUG] [LOCAL ] PAXS: Loaded 20921 existing records from primary storage. [2025-10-23T23:08:44.520727] [INFO ] [MAIN ] PAXS: Loaded 20921 existing records. [2025-10-23T23:08:44.662843] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:08:44.723443] [INFO ] [REMOTE ] PAR: Full fetch complete (49394 records). [2025-10-23T23:08:44.728455] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:44.728610] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-23T23:08:44.728927] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-23T23:08:44.729185] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-23T23:08:44.761274] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-23T23:08:44.793615] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-23T23:08:44.799407] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-23T23:08:45.454160] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:45.486170] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-23T23:08:45.486275] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-23T23:08:45.487317] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-23T23:08:45.487403] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-23T23:08:45.488611] [DEBUG] [LOCAL ] PAR: Trimmed 49394 records to 34604 (keeping 200 days of data) [2025-10-23T23:08:45.600112] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-23T23:08:45.696957] [DEBUG] [LOCAL ] PAR: Primary data saved (34604 records). [2025-10-23T23:08:45.697121] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-23T23:08:45.697278] [INFO ] [MAIN ] Update Progress: 1627/2367 symbols completed. PAR took 36.0s. Estimated remaining: 1h 34m 55s. Rate: 7.8 symbols/min [2025-10-23T23:08:45.873086] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:45.903371] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-23T23:08:45.944686] [DEBUG] [LOCAL ] PAY: Loaded 38615 existing records from primary storage. [2025-10-23T23:08:45.945007] [INFO ] [MAIN ] PAY: Loaded 38615 existing records. [2025-10-23T23:08:46.120832] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:46.121082] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-23T23:08:46.121174] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-23T23:08:46.121534] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-23T23:08:46.121630] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-23T23:08:46.404552] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-23T23:08:46.477880] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:46.707274] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T23:08:47.191010] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-23T23:08:47.201373] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-23T23:08:47.983025] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:08:47.990805] [INFO ] [REMOTE ] PARR: Full fetch complete (69114 records). [2025-10-23T23:08:47.990942] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-23T23:08:48.004605] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-23T23:08:48.183085] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T23:08:48.402393] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-23T23:08:48.402521] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-23T23:08:48.403610] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-23T23:08:48.403732] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-23T23:08:48.405034] [DEBUG] [LOCAL ] PARR: Trimmed 69114 records to 48324 (keeping 200 days of data) [2025-10-23T23:08:48.673366] [DEBUG] [LOCAL ] PARR: Primary data saved (48324 records). [2025-10-23T23:08:48.673539] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-23T23:08:48.673692] [INFO ] [MAIN ] Update Progress: 1628/2367 symbols completed. PARR took 23.4s. Estimated remaining: 1h 34m 45s. Rate: 7.8 symbols/min [2025-10-23T23:08:48.810235] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-23T23:08:48.841465] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:08:48.875552] [DEBUG] [LOCAL ] PAYC: Loaded 36051 existing records from primary storage. [2025-10-23T23:08:48.875887] [INFO ] [MAIN ] PAYC: Loaded 36051 existing records. [2025-10-23T23:08:49.055281] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:08:49.055462] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-23T23:08:49.055537] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-23T23:08:49.055868] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-10-23T23:08:49.055956] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-23T23:08:49.400192] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:08:49.599444] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-23T23:08:49.888179] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T23:08:50.233530] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-23T23:08:50.399446] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-23T23:08:50.703753] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T23:08:51.199466] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-23T23:08:51.585495] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T23:08:51.999477] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-23T23:08:52.625519] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T23:08:52.799443] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-23T23:08:53.313933] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T23:08:53.599453] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-23T23:08:54.399406] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-23T23:08:54.713114] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T23:08:55.079212] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-23T23:08:55.199421] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-23T23:08:55.884280] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T23:08:55.999432] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-23T23:08:56.799456] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-23T23:08:57.564160] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-23T23:08:57.599420] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-23T23:08:57.644575] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T23:08:57.697780] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T23:08:58.399483] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-23T23:08:59.199481] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-23T23:08:59.495841] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-23T23:09:00.003265] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-23T23:09:00.009269] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-23T23:09:00.754357] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T23:09:00.799458] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-23T23:09:00.836751] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T23:09:01.599483] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-23T23:09:02.234742] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T23:09:02.399454] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-23T23:09:03.199574] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-23T23:09:03.907983] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T23:09:03.946712] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T23:09:03.999431] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-23T23:09:04.258363] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-23T23:09:04.268093] [INFO ] [REMOTE ] PATH: Full fetch complete (77852 records). [2025-10-23T23:09:04.268346] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-23T23:09:04.647830] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-23T23:09:04.647940] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-23T23:09:04.648897] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-23T23:09:04.648977] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-23T23:09:04.650379] [DEBUG] [LOCAL ] PATH: Trimmed 77852 records to 54070 (keeping 200 days of data) [2025-10-23T23:09:04.813078] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-23T23:09:04.965111] [DEBUG] [LOCAL ] PATH: Primary data saved (54070 records). [2025-10-23T23:09:04.965267] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-23T23:09:04.965378] [INFO ] [MAIN ] Update Progress: 1629/2367 symbols completed. PATH took 38.5s. Estimated remaining: 1h 34m 41s. Rate: 7.8 symbols/min [2025-10-23T23:09:05.135124] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:05.174183] [DEBUG] [LOCAL ] PB: Loaded 42332 existing records from primary storage. [2025-10-23T23:09:05.174543] [INFO ] [MAIN ] PB: Loaded 42332 existing records. [2025-10-23T23:09:05.354239] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:05.354453] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-23T23:09:05.354535] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-23T23:09:05.354816] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-10-23T23:09:05.354891] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-23T23:09:05.603744] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-23T23:09:05.720245] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:05.742090] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:09:06.310405] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T23:09:06.399436] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-23T23:09:06.650401] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T23:09:06.653984] [INFO ] [REMOTE ] PAXS: Full fetch complete (29402 records). [2025-10-23T23:09:06.654083] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-23T23:09:07.011214] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-23T23:09:07.011332] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-23T23:09:07.011947] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-23T23:09:07.012024] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-23T23:09:07.012782] [DEBUG] [LOCAL ] PAXS: Trimmed 29402 records to 21019 (keeping 200 days of data) [2025-10-23T23:09:07.135601] [DEBUG] [LOCAL ] PAXS: Primary data saved (21019 records). [2025-10-23T23:09:07.135769] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-23T23:09:07.135854] [INFO ] [MAIN ] Update Progress: 1630/2367 symbols completed. PAXS took 22.8s. Estimated remaining: 1h 34m 31s. Rate: 7.8 symbols/min [2025-10-23T23:09:07.208470] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-23T23:09:07.302439] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:07.344744] [DEBUG] [LOCAL ] PBA: Loaded 49189 existing records from primary storage. [2025-10-23T23:09:07.345072] [INFO ] [MAIN ] PBA: Loaded 49189 existing records. [2025-10-23T23:09:07.518510] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:07.518813] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-23T23:09:07.518888] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-23T23:09:07.519120] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-23T23:09:07.519193] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-23T23:09:07.898124] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:07.920135] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T23:09:07.999407] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-23T23:09:08.701313] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T23:09:08.799450] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-23T23:09:09.599461] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-23T23:09:09.660851] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T23:09:10.287559] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T23:09:10.399444] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-23T23:09:11.050672] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T23:09:11.199419] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-23T23:09:11.990606] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T23:09:11.999392] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-23T23:09:12.807978] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-23T23:09:12.825772] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T23:09:13.310703] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T23:09:13.599443] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-23T23:09:14.399444] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-23T23:09:14.480955] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:09:15.152467] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T23:09:15.159254] [INFO ] [REMOTE ] PAY: Full fetch complete (54049 records). [2025-10-23T23:09:15.159385] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-23T23:09:15.204562] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-23T23:09:15.560943] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-23T23:09:15.561055] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-23T23:09:15.562031] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-23T23:09:15.562109] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-23T23:09:15.563222] [DEBUG] [LOCAL ] PAY: Trimmed 54049 records to 38809 (keeping 200 days of data) [2025-10-23T23:09:15.781514] [DEBUG] [LOCAL ] PAY: Primary data saved (38809 records). [2025-10-23T23:09:15.781752] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-23T23:09:15.781866] [INFO ] [MAIN ] Update Progress: 1631/2367 symbols completed. PAY took 30.1s. Estimated remaining: 1h 34m 24s. Rate: 7.8 symbols/min [2025-10-23T23:09:15.954744] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:16.001279] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-23T23:09:16.003296] [DEBUG] [LOCAL ] PBF: Loaded 53104 existing records from primary storage. [2025-10-23T23:09:16.003825] [INFO ] [MAIN ] PBF: Loaded 53104 existing records. [2025-10-23T23:09:16.212062] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:16.215847] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-23T23:09:16.215703] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T23:09:16.228497] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-23T23:09:16.229619] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-23T23:09:16.229737] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-23T23:09:16.584100] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:16.799426] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-23T23:09:16.996503] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T23:09:17.599436] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-23T23:09:17.689773] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:09:18.399455] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-23T23:09:18.660261] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T23:09:19.199440] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-23T23:09:19.245291] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T23:09:19.872843] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T23:09:19.999406] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-23T23:09:20.799423] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-23T23:09:20.996178] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T23:09:21.537172] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T23:09:21.599407] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-23T23:09:22.399455] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-23T23:09:22.521703] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T23:09:23.171623] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T23:09:23.199416] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-23T23:09:23.999435] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-23T23:09:24.223082] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T23:09:24.799418] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-23T23:09:24.848444] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T23:09:25.445106] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T23:09:25.599454] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-23T23:09:26.399425] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-23T23:09:26.620238] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T23:09:27.040180] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T23:09:27.048081] [INFO ] [REMOTE ] PB: Full fetch complete (59889 records). [2025-10-23T23:09:27.048252] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-23T23:09:27.209715] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-23T23:09:27.437790] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-23T23:09:27.437901] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-23T23:09:27.438907] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-23T23:09:27.438998] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-23T23:09:27.440180] [DEBUG] [LOCAL ] PB: Trimmed 59889 records to 42660 (keeping 200 days of data) [2025-10-23T23:09:27.693779] [DEBUG] [LOCAL ] PB: Primary data saved (42660 records). [2025-10-23T23:09:27.693925] [INFO ] [MAIN ] PB: Full history saved. [2025-10-23T23:09:27.694029] [INFO ] [MAIN ] Update Progress: 1632/2367 symbols completed. PB took 22.7s. Estimated remaining: 1h 34m 18s. Rate: 7.8 symbols/min [2025-10-23T23:09:27.862803] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:27.892814] [DEBUG] [LOCAL ] PBH: Loaded 32424 existing records from primary storage. [2025-10-23T23:09:27.893110] [INFO ] [MAIN ] PBH: Loaded 32424 existing records. [2025-10-23T23:09:28.004541] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-23T23:09:28.072366] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:28.072708] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-23T23:09:28.072895] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-23T23:09:28.073191] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-23T23:09:28.073277] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-23T23:09:28.379911] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T23:09:28.465445] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:28.809578] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-23T23:09:28.812188] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:09:29.187349] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-23T23:09:29.599488] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-23T23:09:30.017736] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T23:09:30.399492] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-23T23:09:31.199427] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-23T23:09:31.333051] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T23:09:31.748496] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T23:09:31.999468] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-23T23:09:32.254089] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T23:09:32.799487] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-23T23:09:33.183030] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-23T23:09:33.189783] [INFO ] [REMOTE ] PAYC: Full fetch complete (53186 records). [2025-10-23T23:09:33.189922] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-23T23:09:33.601683] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-23T23:09:33.637357] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-23T23:09:33.637741] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-23T23:09:33.639141] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-23T23:09:33.639240] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-23T23:09:33.640779] [DEBUG] [LOCAL ] PAYC: Trimmed 53186 records to 36283 (keeping 200 days of data) [2025-10-23T23:09:33.837902] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T23:09:33.905728] [DEBUG] [LOCAL ] PAYC: Primary data saved (36283 records). [2025-10-23T23:09:33.905883] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-23T23:09:33.905992] [INFO ] [MAIN ] Update Progress: 1633/2367 symbols completed. PAYC took 45.2s. Estimated remaining: 1h 34m 10s. Rate: 7.8 symbols/min [2025-10-23T23:09:34.071737] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:34.113698] [DEBUG] [LOCAL ] PBI: Loaded 49986 existing records from primary storage. [2025-10-23T23:09:34.114014] [INFO ] [MAIN ] PBI: Loaded 49986 existing records. [2025-10-23T23:09:34.286480] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:34.286695] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-23T23:09:34.286769] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-23T23:09:34.287259] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-10-23T23:09:34.287332] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-23T23:09:34.404548] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-23T23:09:34.640246] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:35.199427] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-23T23:09:35.529782] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T23:09:35.999400] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-23T23:09:36.089850] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-23T23:09:36.294415] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T23:09:36.799444] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-23T23:09:37.599491] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-23T23:09:37.689926] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T23:09:38.122469] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T23:09:38.399454] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-23T23:09:39.199410] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-23T23:09:39.376293] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T23:09:39.805826] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T23:09:39.999505] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-23T23:09:40.644841] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T23:09:40.799427] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-23T23:09:41.599467] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-23T23:09:41.796092] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T23:09:42.399526] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-23T23:09:42.535112] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T23:09:42.924352] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-23T23:09:43.199481] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-23T23:09:43.999518] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-23T23:09:44.192468] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T23:09:44.204919] [INFO ] [REMOTE ] PBA: Full fetch complete (71677 records). [2025-10-23T23:09:44.205213] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-23T23:09:44.592918] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T23:09:44.780800] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-23T23:09:44.780946] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-23T23:09:44.782330] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-23T23:09:44.782456] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-23T23:09:44.784471] [DEBUG] [LOCAL ] PBA: Trimmed 71677 records to 49535 (keeping 200 days of data) [2025-10-23T23:09:44.866415] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-23T23:09:45.134022] [DEBUG] [LOCAL ] PBA: Primary data saved (49535 records). [2025-10-23T23:09:45.134229] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-23T23:09:45.134347] [INFO ] [MAIN ] Update Progress: 1634/2367 symbols completed. PBA took 38.0s. Estimated remaining: 1h 34m 4s. Rate: 7.8 symbols/min [2025-10-23T23:09:45.304781] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:45.355337] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-23T23:09:45.355696] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-10-23T23:09:45.534467] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:45.534869] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-23T23:09:45.534945] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-23T23:09:45.535184] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-23T23:09:45.535258] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-23T23:09:45.607933] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-23T23:09:45.892064] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:45.922882] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-23T23:09:46.399435] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-23T23:09:46.657587] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T23:09:46.667359] [INFO ] [REMOTE ] PBF: Full fetch complete (76750 records). [2025-10-23T23:09:46.667556] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-23T23:09:47.076638] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-23T23:09:47.076822] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-23T23:09:47.077978] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-23T23:09:47.078075] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-23T23:09:47.097964] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T23:09:47.105081] [DEBUG] [LOCAL ] PBF: Trimmed 76750 records to 53493 (keeping 200 days of data) [2025-10-23T23:09:47.204307] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-23T23:09:47.427729] [DEBUG] [LOCAL ] PBF: Primary data saved (53493 records). [2025-10-23T23:09:47.427930] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-23T23:09:47.429225] [INFO ] [MAIN ] Update Progress: 1635/2367 symbols completed. PBF took 31.6s. Estimated remaining: 1h 33m 54s. Rate: 7.8 symbols/min [2025-10-23T23:09:47.596033] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:47.613941] [DEBUG] [LOCAL ] PBT: Loaded 17314 existing records from primary storage. [2025-10-23T23:09:47.614213] [INFO ] [MAIN ] PBT: Loaded 17314 existing records. [2025-10-23T23:09:47.791218] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:47.791427] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-23T23:09:47.791505] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-23T23:09:47.791751] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-23T23:09:47.791825] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-23T23:09:48.006892] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-23T23:09:48.167828] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:48.210019] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T23:09:48.673038] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T23:09:48.799421] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-23T23:09:49.599471] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-23T23:09:49.814022] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T23:09:50.333556] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T23:09:50.399457] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-23T23:09:51.023127] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T23:09:51.199424] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-23T23:09:51.999449] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-23T23:09:52.402295] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-23T23:09:52.799437] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-23T23:09:52.868852] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T23:09:53.321066] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T23:09:53.327214] [INFO ] [REMOTE ] PBH: Full fetch complete (44836 records). [2025-10-23T23:09:53.327421] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-23T23:09:53.604601] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-23T23:09:53.721049] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-23T23:09:53.721173] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-23T23:09:53.722199] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-23T23:09:53.722279] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-23T23:09:53.723525] [DEBUG] [LOCAL ] PBH: Trimmed 44836 records to 32673 (keeping 200 days of data) [2025-10-23T23:09:53.915758] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T23:09:53.942135] [DEBUG] [LOCAL ] PBH: Primary data saved (32673 records). [2025-10-23T23:09:53.942342] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-23T23:09:53.942472] [INFO ] [MAIN ] Update Progress: 1636/2367 symbols completed. PBH took 26.2s. Estimated remaining: 1h 33m 45s. Rate: 7.8 symbols/min [2025-10-23T23:09:54.109881] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:09:54.120621] [DEBUG] [LOCAL ] PCF: Loaded 9086 existing records from primary storage. [2025-10-23T23:09:54.120897] [INFO ] [MAIN ] PCF: Loaded 9086 existing records. [2025-10-23T23:09:54.295685] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:09:54.295922] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-23T23:09:54.296000] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-23T23:09:54.296193] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-23T23:09:54.296265] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-23T23:09:54.404584] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-23T23:09:54.663046] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:09:55.199429] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-23T23:09:55.295102] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T23:09:55.339255] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T23:09:55.990291] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T23:09:55.999390] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-23T23:09:56.799437] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-23T23:09:56.966081] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T23:09:57.599431] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-23T23:09:58.330779] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T23:09:58.363437] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-23T23:09:58.399423] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-23T23:09:59.199469] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-23T23:09:59.248434] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T23:09:59.999493] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-23T23:10:00.017357] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T23:10:00.799444] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-23T23:10:01.145240] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T23:10:01.599470] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-23T23:10:02.399452] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-23T23:10:02.624455] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T23:10:03.199486] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-23T23:10:03.480162] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T23:10:03.838033] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-23T23:10:03.999441] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-23T23:10:04.649199] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T23:10:04.649501] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T23:10:04.661924] [INFO ] [REMOTE ] PBI: Full fetch complete (72462 records). [2025-10-23T23:10:04.662103] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-23T23:10:04.810950] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-23T23:10:05.090413] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-23T23:10:05.090534] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-23T23:10:05.091797] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-23T23:10:05.091883] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-23T23:10:05.093502] [DEBUG] [LOCAL ] PBI: Trimmed 72462 records to 50327 (keeping 200 days of data) [2025-10-23T23:10:05.403436] [DEBUG] [LOCAL ] PBI: Primary data saved (50327 records). [2025-10-23T23:10:05.403593] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-23T23:10:05.403738] [INFO ] [MAIN ] Update Progress: 1637/2367 symbols completed. PBI took 31.5s. Estimated remaining: 1h 33m 39s. Rate: 7.8 symbols/min [2025-10-23T23:10:05.599417] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-23T23:10:05.956273] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T23:10:06.399458] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-23T23:10:07.120738] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T23:10:07.199410] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-23T23:10:07.782858] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-23T23:10:07.960469] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T23:10:07.999397] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-23T23:10:08.799432] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-23T23:10:08.904171] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T23:10:08.907933] [INFO ] [REMOTE ] PBT: Full fetch complete (24474 records). [2025-10-23T23:10:08.908047] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-23T23:10:09.284549] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-23T23:10:09.284696] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-23T23:10:09.285275] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-23T23:10:09.285370] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-23T23:10:09.286042] [DEBUG] [LOCAL ] PBT: Trimmed 24474 records to 17415 (keeping 200 days of data) [2025-10-23T23:10:09.388518] [DEBUG] [LOCAL ] PBT: Primary data saved (17415 records). [2025-10-23T23:10:09.388689] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-23T23:10:09.388796] [INFO ] [MAIN ] Update Progress: 1638/2367 symbols completed. PBT took 22.0s. Estimated remaining: 1h 33m 30s. Rate: 7.8 symbols/min [2025-10-23T23:10:09.599410] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-23T23:10:09.626619] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-23T23:10:10.399488] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-23T23:10:11.252481] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T23:10:11.254999] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-23T23:10:11.888481] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-23T23:10:11.999393] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-23T23:10:12.058038] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T23:10:12.799486] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-23T23:10:13.637042] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-23T23:10:13.639483] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-23T23:10:14.112117] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-23T23:10:14.399430] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-23T23:10:14.486270] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T23:10:15.199444] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-23T23:10:16.004847] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T23:10:16.006940] [INFO ] [REMOTE ] PCF: Full fetch complete (13401 records). [2025-10-23T23:10:16.007064] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-23T23:10:16.374629] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-23T23:10:16.374785] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-23T23:10:16.375256] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-23T23:10:16.375331] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-23T23:10:16.375865] [DEBUG] [LOCAL ] PCF: Trimmed 13401 records to 9131 (keeping 200 days of data) [2025-10-23T23:10:16.429053] [DEBUG] [LOCAL ] PCF: Primary data saved (9131 records). [2025-10-23T23:10:16.429268] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-23T23:10:16.429394] [INFO ] [MAIN ] Update Progress: 1639/2367 symbols completed. PCF took 22.5s. Estimated remaining: 1h 33m 22s. Rate: 7.8 symbols/min [2025-10-23T23:10:16.661502] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T23:10:16.673091] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-23T23:10:18.888884] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-23T23:10:18.900385] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-23T23:10:20.966270] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T23:10:20.979034] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-23T23:10:23.249492] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-23T23:10:23.259124] [INFO ] [REMOTE ] PBR: Full fetch complete (77882 records). [2025-10-23T23:10:23.259305] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-23T23:10:23.684238] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-23T23:10:23.684366] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-23T23:10:23.685616] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-23T23:10:23.685750] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-23T23:10:23.687235] [DEBUG] [LOCAL ] PBR: Trimmed 77882 records to 54103 (keeping 200 days of data) [2025-10-23T23:10:24.046388] [DEBUG] [LOCAL ] PBR: Primary data saved (54103 records). [2025-10-23T23:10:24.046607] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-23T23:10:24.046782] [INFO ] [MAIN ] Update Progress: 1640/2367 symbols completed. PBR took 38.9s. Estimated remaining: 1h 33m 14s. Rate: 7.8 symbols/min [2025-10-23T23:10:24.789288] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:24.849544] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:24.831885] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:24.855395] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:24.866151] [DEBUG] [LOCAL ] PCM: Loaded 6875 existing records from primary storage. [2025-10-23T23:10:24.866536] [INFO ] [MAIN ] PCM: Loaded 6875 existing records. [2025-10-23T23:10:25.011409] [DEBUG] [LOCAL ] PCN: Loaded 25332 existing records from primary storage. [2025-10-23T23:10:25.029674] [INFO ] [MAIN ] PCN: Loaded 25332 existing records. [2025-10-23T23:10:25.105212] [DEBUG] [LOCAL ] PCOR: Loaded 47461 existing records from primary storage. [2025-10-23T23:10:25.151459] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:25.166327] [INFO ] [MAIN ] PCOR: Loaded 47461 existing records. [2025-10-23T23:10:25.183234] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-23T23:10:25.183554] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-23T23:10:25.318524] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-23T23:10:25.318428] [DEBUG] [LOCAL ] PCG: Loaded 53719 existing records from primary storage. [2025-10-23T23:10:25.363714] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-23T23:10:25.377560] [INFO ] [MAIN ] PCG: Loaded 53719 existing records. [2025-10-23T23:10:25.751426] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:25.796039] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:25.837842] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-23T23:10:25.821993] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-23T23:10:25.855831] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-23T23:10:25.909130] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-23T23:10:25.991203] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:25.991270] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-23T23:10:26.019858] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-23T23:10:26.025258] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-23T23:10:26.019585] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-23T23:10:26.035756] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-10-23T23:10:26.035838] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-23T23:10:26.051418] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-23T23:10:26.087598] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-23T23:10:26.343468] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:26.376756] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-23T23:10:27.199759] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:27.256846] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-23T23:10:27.254016] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:27.258184] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-23T23:10:27.288422] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T23:10:27.311759] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-23T23:10:27.354199] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:27.354569] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-23T23:10:28.012041] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T23:10:28.014071] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-23T23:10:28.454743] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T23:10:28.460491] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-23T23:10:28.905049] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T23:10:28.914067] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-23T23:10:28.946954] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T23:10:28.949285] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-23T23:10:29.128396] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T23:10:29.139861] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-23T23:10:29.293740] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-23T23:10:29.298225] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-23T23:10:29.679475] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T23:10:29.681728] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-23T23:10:30.531699] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T23:10:30.534149] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-23T23:10:30.563722] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T23:10:30.586729] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T23:10:30.591887] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-23T23:10:30.592815] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-23T23:10:30.706327] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:10:30.716615] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-23T23:10:31.043691] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-23T23:10:31.199442] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-23T23:10:31.849015] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-23T23:10:31.888837] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T23:10:31.999434] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-23T23:10:32.294009] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T23:10:32.703525] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T23:10:32.719419] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T23:10:32.799404] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-23T23:10:33.599499] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-23T23:10:34.399421] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-23T23:10:34.436406] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T23:10:34.817931] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-23T23:10:35.199452] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-23T23:10:35.999420] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-23T23:10:36.098781] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:10:36.549993] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T23:10:36.792388] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T23:10:36.795199] [INFO ] [REMOTE ] PCM: Full fetch complete (10252 records). [2025-10-23T23:10:36.795359] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-23T23:10:36.802675] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-23T23:10:37.348150] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-23T23:10:37.348278] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-23T23:10:37.348691] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-23T23:10:37.348773] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-23T23:10:37.349331] [DEBUG] [LOCAL ] PCM: Trimmed 10252 records to 6946 (keeping 200 days of data) [2025-10-23T23:10:37.390792] [DEBUG] [LOCAL ] PCM: Primary data saved (6946 records). [2025-10-23T23:10:37.390972] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-23T23:10:37.391095] [INFO ] [MAIN ] Update Progress: 1641/2367 symbols completed. PCM took 13.3s. Estimated remaining: 1h 33m 9s. Rate: 7.8 symbols/min [2025-10-23T23:10:37.579085] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:37.592158] [DEBUG] [LOCAL ] PCQ: Loaded 12114 existing records from primary storage. [2025-10-23T23:10:37.592479] [INFO ] [MAIN ] PCQ: Loaded 12114 existing records. [2025-10-23T23:10:37.607115] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-23T23:10:37.784472] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:37.784735] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-23T23:10:37.784812] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-23T23:10:37.785033] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-23T23:10:37.785108] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-23T23:10:38.177959] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:38.399429] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-23T23:10:38.716481] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T23:10:39.199417] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-23T23:10:39.271837] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T23:10:39.584465] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T23:10:39.999437] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-23T23:10:40.799410] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-23T23:10:41.035498] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T23:10:41.119728] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-23T23:10:41.599428] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-23T23:10:42.109675] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T23:10:42.399440] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-23T23:10:43.199437] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-23T23:10:43.212092] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-23T23:10:43.642992] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-23T23:10:43.999453] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-23T23:10:44.449067] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-23T23:10:44.748756] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T23:10:44.799450] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-23T23:10:45.599423] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-23T23:10:45.659050] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T23:10:46.399436] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-23T23:10:47.199448] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-23T23:10:47.360371] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-23T23:10:47.380431] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-23T23:10:47.999434] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-23T23:10:48.799401] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-23T23:10:49.165313] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-23T23:10:49.214496] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-23T23:10:49.599424] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-23T23:10:50.399442] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-23T23:10:50.447111] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T23:10:50.510019] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T23:10:51.199421] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-23T23:10:51.345544] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T23:10:51.351110] [INFO ] [REMOTE ] PCN: Full fetch complete (34908 records). [2025-10-23T23:10:51.351224] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-23T23:10:51.718448] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-23T23:10:51.718584] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-23T23:10:51.719393] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-23T23:10:51.719491] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-23T23:10:51.720510] [DEBUG] [LOCAL ] PCN: Trimmed 34908 records to 25543 (keeping 200 days of data) [2025-10-23T23:10:51.876306] [DEBUG] [LOCAL ] PCN: Primary data saved (25543 records). [2025-10-23T23:10:51.876465] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-23T23:10:51.876575] [INFO ] [MAIN ] Update Progress: 1642/2367 symbols completed. PCN took 27.8s. Estimated remaining: 1h 33m 4s. Rate: 7.8 symbols/min [2025-10-23T23:10:52.004524] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-23T23:10:52.051047] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:52.095222] [DEBUG] [LOCAL ] PD: Loaded 48330 existing records from primary storage. [2025-10-23T23:10:52.095563] [INFO ] [MAIN ] PD: Loaded 48330 existing records. [2025-10-23T23:10:52.272120] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:52.272317] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-23T23:10:52.272393] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-23T23:10:52.272613] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-23T23:10:52.272714] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-23T23:10:52.621903] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:52.799439] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-23T23:10:53.271235] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-23T23:10:53.312347] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T23:10:53.599416] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-23T23:10:53.636445] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T23:10:54.323941] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T23:10:54.333334] [INFO ] [REMOTE ] PCG: Full fetch complete (77898 records). [2025-10-23T23:10:54.333509] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-23T23:10:54.404611] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-23T23:10:54.744088] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-10-23T23:10:54.744210] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-10-23T23:10:54.746044] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-10-23T23:10:54.746145] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-10-23T23:10:54.747719] [DEBUG] [LOCAL ] PCG: Trimmed 77898 records to 54109 (keeping 200 days of data) [2025-10-23T23:10:55.077034] [DEBUG] [LOCAL ] PCG: Primary data saved (54109 records). [2025-10-23T23:10:55.077201] [INFO ] [MAIN ] PCG: Full history saved. [2025-10-23T23:10:55.077313] [INFO ] [MAIN ] Update Progress: 1643/2367 symbols completed. PCG took 31.0s. Estimated remaining: 1h 32m 55s. Rate: 7.8 symbols/min [2025-10-23T23:10:55.204609] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-23T23:10:55.256141] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:55.256285] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-23T23:10:55.256355] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-23T23:10:55.256464] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-23T23:10:55.256532] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-23T23:10:55.256612] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-23T23:10:55.256702] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-23T23:10:55.601712] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:55.975773] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T23:10:55.999402] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-23T23:10:56.799416] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-23T23:10:56.865374] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T23:10:56.873482] [INFO ] [REMOTE ] PCOR: Full fetch complete (69163 records). [2025-10-23T23:10:56.873741] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-23T23:10:57.281583] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-23T23:10:57.281900] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-23T23:10:57.283038] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-23T23:10:57.283133] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-23T23:10:57.284564] [DEBUG] [LOCAL ] PCOR: Trimmed 69163 records to 47684 (keeping 200 days of data) [2025-10-23T23:10:57.521983] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T23:10:57.593334] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T23:10:57.599542] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-23T23:10:57.610943] [DEBUG] [LOCAL ] PCOR: Primary data saved (47684 records). [2025-10-23T23:10:57.611069] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-23T23:10:57.611217] [INFO ] [MAIN ] Update Progress: 1644/2367 symbols completed. PCOR took 33.5s. Estimated remaining: 1h 32m 45s. Rate: 7.8 symbols/min [2025-10-23T23:10:57.780536] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:10:57.823445] [DEBUG] [LOCAL ] PDI: Loaded 50186 existing records from primary storage. [2025-10-23T23:10:57.823825] [INFO ] [MAIN ] PDI: Loaded 50186 existing records. [2025-10-23T23:10:58.001965] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:10:58.002223] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-23T23:10:58.002318] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-23T23:10:58.002672] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-23T23:10:58.002765] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-23T23:10:58.369838] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:10:58.399392] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-23T23:10:58.505547] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-23T23:10:59.199451] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-23T23:10:59.999420] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-23T23:11:00.066677] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T23:11:00.290885] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T23:11:00.799447] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-23T23:11:01.599420] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-23T23:11:01.753377] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T23:11:01.772133] [INFO ] [REMOTE ] PCQ: Full fetch complete (16907 records). [2025-10-23T23:11:01.790859] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-23T23:11:01.862532] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T23:11:02.195104] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-23T23:11:02.195262] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-23T23:11:02.195728] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-23T23:11:02.195809] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-23T23:11:02.196593] [DEBUG] [LOCAL ] PCQ: Trimmed 16907 records to 12163 (keeping 200 days of data) [2025-10-23T23:11:02.269793] [DEBUG] [LOCAL ] PCQ: Primary data saved (12163 records). [2025-10-23T23:11:02.269975] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-23T23:11:02.270094] [INFO ] [MAIN ] Update Progress: 1645/2367 symbols completed. PCQ took 24.9s. Estimated remaining: 1h 32m 36s. Rate: 7.8 symbols/min [2025-10-23T23:11:02.407932] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-23T23:11:02.442037] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:02.482180] [DEBUG] [LOCAL ] PDM: Loaded 39741 existing records from primary storage. [2025-10-23T23:11:02.482510] [INFO ] [MAIN ] PDM: Loaded 39741 existing records. [2025-10-23T23:11:02.664693] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:02.664969] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-23T23:11:02.665054] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-23T23:11:02.665298] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-23T23:11:02.665374] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-23T23:11:02.749415] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-23T23:11:03.032035] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:03.199415] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-23T23:11:03.246127] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T23:11:03.999452] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-23T23:11:04.611004] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T23:11:04.799478] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-23T23:11:05.229750] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T23:11:05.599534] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:11:05.599699] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-23T23:11:06.399474] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-23T23:11:06.877568] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T23:11:07.062372] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T23:11:07.199475] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-23T23:11:07.999493] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-23T23:11:08.799483] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-23T23:11:08.861504] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T23:11:09.368808] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T23:11:09.599464] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-23T23:11:10.215947] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T23:11:10.399427] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-23T23:11:11.199424] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-23T23:11:11.609373] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T23:11:11.999430] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-23T23:11:12.072369] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:11:12.661146] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T23:11:12.799432] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-23T23:11:13.599419] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-23T23:11:14.080312] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-23T23:11:14.236307] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T23:11:14.399499] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-23T23:11:15.199417] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-23T23:11:15.377559] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T23:11:15.808801] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T23:11:15.999448] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-23T23:11:16.799485] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-23T23:11:17.012994] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T23:11:17.148930] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-23T23:11:17.255111] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T23:11:17.599441] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-23T23:11:18.399499] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-23T23:11:18.863301] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T23:11:19.199439] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-23T23:11:19.553710] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T23:11:19.999440] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-23T23:11:20.153716] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T23:11:20.799446] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-23T23:11:21.151828] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-23T23:11:21.599427] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-23T23:11:21.868211] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T23:11:21.956367] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-23T23:11:22.399451] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-23T23:11:23.199456] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-23T23:11:23.999471] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-23T23:11:24.198406] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-23T23:11:24.207419] [INFO ] [REMOTE ] PD: Full fetch complete (68300 records). [2025-10-23T23:11:24.207624] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-23T23:11:24.595974] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-23T23:11:24.596098] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-23T23:11:24.597227] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-23T23:11:24.597309] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-23T23:11:24.599474] [DEBUG] [LOCAL ] PD: Trimmed 68300 records to 48648 (keeping 200 days of data) [2025-10-23T23:11:24.799721] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-23T23:11:24.884118] [DEBUG] [LOCAL ] PD: Primary data saved (48648 records). [2025-10-23T23:11:24.884290] [INFO ] [MAIN ] PD: Full history saved. [2025-10-23T23:11:24.884406] [INFO ] [MAIN ] Update Progress: 1646/2367 symbols completed. PD took 33.0s. Estimated remaining: 1h 32m 35s. Rate: 7.8 symbols/min [2025-10-23T23:11:25.055167] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:25.131076] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T23:11:25.134045] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-23T23:11:25.136594] [DEBUG] [LOCAL ] PDO: Loaded 31375 existing records from primary storage. [2025-10-23T23:11:25.153156] [INFO ] [MAIN ] PDO: Loaded 31375 existing records. [2025-10-23T23:11:25.364923] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:25.365360] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-23T23:11:25.365606] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-23T23:11:25.366027] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-23T23:11:25.366106] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-23T23:11:25.555423] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T23:11:25.600723] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-23T23:11:25.781270] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:26.399440] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-23T23:11:27.199430] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-23T23:11:27.565154] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-23T23:11:27.568975] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T23:11:27.858181] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T23:11:27.999472] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-23T23:11:28.275414] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-23T23:11:28.276264] [INFO ] [REMOTE ] PDCC: Full fetch complete (1393 records). [2025-10-23T23:11:28.276370] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-23T23:11:28.469775] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-23T23:11:28.469968] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:11:28.470036] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:11:28.470109] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-23T23:11:28.470200] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-23T23:11:28.470271] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-23T23:11:28.470349] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-23T23:11:28.470438] [INFO ] [MAIN ] Update Progress: 1647/2367 symbols completed. PDCC took 33.4s. Estimated remaining: 1h 32m 25s. Rate: 7.8 symbols/min [2025-10-23T23:11:28.636390] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:28.653280] [DEBUG] [LOCAL ] PDS: Loaded 16604 existing records from primary storage. [2025-10-23T23:11:28.653537] [INFO ] [MAIN ] PDS: Loaded 16604 existing records. [2025-10-23T23:11:28.806622] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-23T23:11:28.829671] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:28.830561] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-23T23:11:28.830676] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-23T23:11:28.830903] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-23T23:11:28.830975] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-23T23:11:29.194157] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:29.599464] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-23T23:11:30.211380] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T23:11:30.399425] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-23T23:11:30.621373] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T23:11:31.199455] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-23T23:11:31.591027] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T23:11:31.999554] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-23T23:11:32.729186] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T23:11:32.736020] [INFO ] [REMOTE ] PDM: Full fetch complete (57393 records). [2025-10-23T23:11:32.736169] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-23T23:11:32.804729] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-23T23:11:33.115529] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-23T23:11:33.115638] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-23T23:11:33.116599] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-23T23:11:33.116695] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-23T23:11:33.117827] [DEBUG] [LOCAL ] PDM: Trimmed 57393 records to 40001 (keeping 200 days of data) [2025-10-23T23:11:33.337883] [DEBUG] [LOCAL ] PDM: Primary data saved (40001 records). [2025-10-23T23:11:33.338033] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-23T23:11:33.339525] [INFO ] [MAIN ] Update Progress: 1648/2367 symbols completed. PDM took 31.1s. Estimated remaining: 1h 32m 16s. Rate: 7.8 symbols/min [2025-10-23T23:11:33.512604] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:33.537406] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T23:11:33.558190] [DEBUG] [LOCAL ] PDT: Loaded 17437 existing records from primary storage. [2025-10-23T23:11:33.558433] [INFO ] [MAIN ] PDT: Loaded 17437 existing records. [2025-10-23T23:11:33.604558] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-23T23:11:33.737024] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:33.737238] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-23T23:11:33.737334] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-23T23:11:33.737684] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-23T23:11:33.737796] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-23T23:11:34.084905] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:34.399418] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-23T23:11:34.692688] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-23T23:11:34.748310] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-23T23:11:35.199452] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-23T23:11:35.396976] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T23:11:35.999455] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-23T23:11:36.174406] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T23:11:36.799418] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-23T23:11:36.932348] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T23:11:37.599434] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-23T23:11:38.399467] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-23T23:11:38.577230] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T23:11:38.696585] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T23:11:38.705807] [INFO ] [REMOTE ] PDI: Full fetch complete (73147 records). [2025-10-23T23:11:38.705960] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-23T23:11:39.115397] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-23T23:11:39.115503] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-23T23:11:39.116622] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-23T23:11:39.116743] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-23T23:11:39.118224] [DEBUG] [LOCAL ] PDI: Trimmed 73147 records to 50572 (keeping 200 days of data) [2025-10-23T23:11:39.204351] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-23T23:11:39.432414] [DEBUG] [LOCAL ] PDI: Primary data saved (50572 records). [2025-10-23T23:11:39.446523] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-23T23:11:39.446708] [INFO ] [MAIN ] Update Progress: 1649/2367 symbols completed. PDI took 41.8s. Estimated remaining: 1h 32m 8s. Rate: 7.8 symbols/min [2025-10-23T23:11:39.491280] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T23:11:39.620699] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:39.635381] [DEBUG] [LOCAL ] PDX: Loaded 14138 existing records from primary storage. [2025-10-23T23:11:39.635624] [INFO ] [MAIN ] PDX: Loaded 14138 existing records. [2025-10-23T23:11:39.808394] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:39.808598] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-23T23:11:39.808698] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-23T23:11:39.808916] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-23T23:11:39.808989] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-23T23:11:40.004684] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-23T23:11:40.162107] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:40.524938] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T23:11:40.799415] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-23T23:11:41.111915] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T23:11:41.599427] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-23T23:11:42.123329] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-23T23:11:42.399438] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-23T23:11:42.941017] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T23:11:43.095838] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T23:11:43.199457] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-23T23:11:43.999423] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-23T23:11:44.062568] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T23:11:44.799426] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-23T23:11:44.895097] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-23T23:11:45.599438] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-23T23:11:45.774823] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T23:11:46.399521] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-23T23:11:46.614010] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T23:11:47.199420] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-23T23:11:47.503355] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T23:11:47.999448] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-23T23:11:48.252303] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T23:11:48.799452] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-23T23:11:49.185209] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T23:11:49.599402] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-23T23:11:49.848244] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T23:11:50.399454] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-23T23:11:50.514180] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-23T23:11:51.199472] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-23T23:11:51.371735] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T23:11:51.990146] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T23:11:51.999440] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-23T23:11:52.799429] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-23T23:11:53.089011] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T23:11:53.599405] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-23T23:11:53.824061] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:11:53.828780] [INFO ] [REMOTE ] PDT: Full fetch complete (25163 records). [2025-10-23T23:11:53.828885] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-23T23:11:54.215178] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-23T23:11:54.215293] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-23T23:11:54.215871] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-23T23:11:54.216056] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-23T23:11:54.216830] [DEBUG] [LOCAL ] PDT: Trimmed 25163 records to 17588 (keeping 200 days of data) [2025-10-23T23:11:54.341824] [DEBUG] [LOCAL ] PDT: Primary data saved (17588 records). [2025-10-23T23:11:54.342040] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-23T23:11:54.342186] [INFO ] [MAIN ] Update Progress: 1650/2367 symbols completed. PDT took 21.0s. Estimated remaining: 1h 32m 3s. Rate: 7.8 symbols/min [2025-10-23T23:11:54.404444] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-23T23:11:54.533281] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-23T23:11:54.536502] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:54.590109] [DEBUG] [LOCAL ] PEB: Loaded 50732 existing records from primary storage. [2025-10-23T23:11:54.590549] [INFO ] [MAIN ] PEB: Loaded 50732 existing records. [2025-10-23T23:11:54.766934] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:54.767147] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-23T23:11:54.767275] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-23T23:11:54.767709] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-23T23:11:54.767822] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-23T23:11:55.123232] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:55.199431] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-23T23:11:55.449578] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-23T23:11:55.999434] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-23T23:11:56.804583] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-23T23:11:56.819045] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T23:11:57.381498] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-23T23:11:57.396486] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T23:11:57.599430] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-23T23:11:58.240265] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T23:11:58.243216] [INFO ] [REMOTE ] PDS: Full fetch complete (25705 records). [2025-10-23T23:11:58.243312] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-23T23:11:58.416020] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-23T23:11:58.628313] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-23T23:11:58.628437] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-23T23:11:58.629085] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-23T23:11:58.629165] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-23T23:11:58.629908] [DEBUG] [LOCAL ] PDS: Trimmed 25705 records to 16766 (keeping 200 days of data) [2025-10-23T23:11:58.726978] [DEBUG] [LOCAL ] PDS: Primary data saved (16766 records). [2025-10-23T23:11:58.727162] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-23T23:11:58.727284] [INFO ] [MAIN ] Update Progress: 1651/2367 symbols completed. PDS took 30.3s. Estimated remaining: 1h 31m 54s. Rate: 7.8 symbols/min [2025-10-23T23:11:58.892754] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:11:58.938958] [DEBUG] [LOCAL ] PEG: Loaded 53124 existing records from primary storage. [2025-10-23T23:11:58.939293] [INFO ] [MAIN ] PEG: Loaded 53124 existing records. [2025-10-23T23:11:59.116470] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:11:59.116729] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-23T23:11:59.116813] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-23T23:11:59.117027] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-10-23T23:11:59.117105] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-23T23:11:59.205314] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-23T23:11:59.469777] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:11:59.812751] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T23:11:59.819109] [INFO ] [REMOTE ] PDO: Full fetch complete (46795 records). [2025-10-23T23:11:59.819228] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-23T23:12:00.008820] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-23T23:12:00.204953] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-23T23:12:00.213738] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-23T23:12:00.214023] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T23:12:00.215120] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-23T23:12:00.218696] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-23T23:12:00.220006] [DEBUG] [LOCAL ] PDO: Trimmed 46795 records to 31605 (keeping 200 days of data) [2025-10-23T23:12:00.410807] [DEBUG] [LOCAL ] PDO: Primary data saved (31605 records). [2025-10-23T23:12:00.411019] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-23T23:12:00.411182] [INFO ] [MAIN ] Update Progress: 1652/2367 symbols completed. PDO took 35.5s. Estimated remaining: 1h 31m 44s. Rate: 7.8 symbols/min [2025-10-23T23:12:00.576836] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:00.605719] [DEBUG] [LOCAL ] PEN: Loaded 29554 existing records from primary storage. [2025-10-23T23:12:00.606076] [INFO ] [MAIN ] PEN: Loaded 29554 existing records. [2025-10-23T23:12:00.779971] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:00.780199] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-23T23:12:00.780275] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-23T23:12:00.780471] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-23T23:12:00.780539] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-23T23:12:00.811688] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-23T23:12:01.166002] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:01.599406] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-23T23:12:01.829759] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T23:12:01.861405] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T23:12:02.399436] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-23T23:12:03.199494] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-23T23:12:03.512372] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-23T23:12:03.973164] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:12:03.999394] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-23T23:12:04.071474] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-23T23:12:04.799473] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-23T23:12:05.599444] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-23T23:12:05.737707] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:12:06.399475] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-23T23:12:06.449633] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T23:12:06.601319] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-23T23:12:07.199516] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-23T23:12:07.456950] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T23:12:07.999456] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-23T23:12:08.799444] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-23T23:12:09.040833] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T23:12:09.515630] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T23:12:09.599402] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-23T23:12:09.726264] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T23:12:09.729105] [INFO ] [REMOTE ] PDX: Full fetch complete (23657 records). [2025-10-23T23:12:09.729208] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-23T23:12:10.102817] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-23T23:12:10.102938] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-23T23:12:10.103511] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-23T23:12:10.103587] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-23T23:12:10.104235] [DEBUG] [LOCAL ] PDX: Trimmed 23657 records to 14236 (keeping 200 days of data) [2025-10-23T23:12:10.188990] [DEBUG] [LOCAL ] PDX: Primary data saved (14236 records). [2025-10-23T23:12:10.189150] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-23T23:12:10.189268] [INFO ] [MAIN ] Update Progress: 1653/2367 symbols completed. PDX took 30.7s. Estimated remaining: 1h 31m 37s. Rate: 7.8 symbols/min [2025-10-23T23:12:10.360913] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:10.373410] [DEBUG] [LOCAL ] PEO: Loaded 11042 existing records from primary storage. [2025-10-23T23:12:10.373699] [INFO ] [MAIN ] PEO: Loaded 11042 existing records. [2025-10-23T23:12:10.404778] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-23T23:12:10.554939] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:10.555180] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-23T23:12:10.555256] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-23T23:12:10.555450] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-23T23:12:10.555523] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-23T23:12:10.913676] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:11.126407] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T23:12:11.199416] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-23T23:12:11.999435] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-23T23:12:12.352405] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T23:12:12.695013] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T23:12:12.799440] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-23T23:12:13.599409] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-23T23:12:13.740489] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:12:14.092263] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T23:12:14.306171] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T23:12:14.399456] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-23T23:12:14.504634] [DEBUG] [REMOTE ] PEO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-23T23:12:14.505075] [WARN ] [REMOTE ] PEO: No data returned for month 2025-02 [2025-10-23T23:12:14.505190] [FATAL] [REMOTE ] PEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:12:14.505303] [FATAL] [MAIN ] PEO: Failed to fetch primary data. [2025-10-23T23:12:14.505384] [WARN ] [MAIN ] PEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:12:14.505471] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-23T23:12:14.505580] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-23T23:12:14.505690] [INFO ] [LOCAL ] PEO: Starting deletion of derivative data. [2025-10-23T23:12:14.505897] [DEBUG] [LOCAL ] PEO: Deleted derivative data file. [2025-10-23T23:12:14.506021] [INFO ] [MAIN ] Update Progress: 1654/2367 symbols completed. PEO took 4.3s. Estimated remaining: 1h 31m 28s. Rate: 7.8 symbols/min [2025-10-23T23:12:14.684869] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:14.699075] [DEBUG] [LOCAL ] PERF: Loaded 14512 existing records from primary storage. [2025-10-23T23:12:14.699346] [INFO ] [MAIN ] PERF: Loaded 14512 existing records. [2025-10-23T23:12:14.876429] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:14.876699] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-23T23:12:14.876775] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-23T23:12:14.876973] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-23T23:12:14.877052] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-23T23:12:15.203300] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-23T23:12:15.224506] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:15.999471] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-23T23:12:16.799456] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-23T23:12:17.043784] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T23:12:17.599409] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-23T23:12:17.664166] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T23:12:18.054314] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T23:12:18.399448] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-23T23:12:19.199424] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-23T23:12:19.227905] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T23:12:19.885806] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T23:12:19.999420] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-23T23:12:20.799411] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-23T23:12:21.055307] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T23:12:21.130470] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:12:21.599424] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-23T23:12:22.399413] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-23T23:12:22.633862] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T23:12:23.199426] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-23T23:12:23.289092] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T23:12:23.634706] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T23:12:23.999413] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-23T23:12:24.347839] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T23:12:24.799431] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-23T23:12:24.837614] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T23:12:24.842555] [INFO ] [REMOTE ] PEN: Full fetch complete (44160 records). [2025-10-23T23:12:24.842743] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-23T23:12:25.218558] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-23T23:12:25.218732] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-23T23:12:25.219726] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-23T23:12:25.219823] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-23T23:12:25.220990] [DEBUG] [LOCAL ] PEN: Trimmed 44160 records to 29706 (keeping 200 days of data) [2025-10-23T23:12:25.392154] [DEBUG] [LOCAL ] PEN: Primary data saved (29706 records). [2025-10-23T23:12:25.392325] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-23T23:12:25.392456] [INFO ] [MAIN ] Update Progress: 1655/2367 symbols completed. PEN took 25.0s. Estimated remaining: 1h 31m 21s. Rate: 7.8 symbols/min [2025-10-23T23:12:25.567440] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:25.567587] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-23T23:12:25.567697] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-23T23:12:25.567851] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-23T23:12:25.567941] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-23T23:12:25.568051] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-23T23:12:25.568136] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-23T23:12:25.604548] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-23T23:12:25.909708] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T23:12:25.956049] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:26.399442] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-10-23T23:12:26.617609] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:12:26.618027] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-10-23T23:12:26.618115] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:12:26.618191] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-23T23:12:26.618266] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:12:26.618344] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-23T23:12:26.618436] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-23T23:12:26.618513] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-23T23:12:26.618592] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-23T23:12:26.618704] [INFO ] [MAIN ] Update Progress: 1656/2367 symbols completed. PEW took 1.2s. Estimated remaining: 1h 31m 11s. Rate: 7.8 symbols/min [2025-10-23T23:12:26.789385] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:26.796166] [DEBUG] [LOCAL ] PFD: Loaded 5349 existing records from primary storage. [2025-10-23T23:12:26.796393] [INFO ] [MAIN ] PFD: Loaded 5349 existing records. [2025-10-23T23:12:26.969798] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:26.970020] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-23T23:12:26.970093] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-23T23:12:26.970322] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-23T23:12:26.970397] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-23T23:12:27.207931] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-23T23:12:27.329425] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:27.451926] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T23:12:27.824631] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-23T23:12:27.999437] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-23T23:12:28.799455] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-23T23:12:29.392152] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T23:12:29.599437] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-23T23:12:29.789585] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T23:12:30.399409] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-23T23:12:30.471054] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-23T23:12:31.199438] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-23T23:12:31.999420] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-23T23:12:32.089940] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T23:12:32.098979] [INFO ] [REMOTE ] PEB: Full fetch complete (73249 records). [2025-10-23T23:12:32.099153] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-23T23:12:32.494838] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-23T23:12:32.494973] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-23T23:12:32.496253] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-23T23:12:32.496355] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-23T23:12:32.497975] [DEBUG] [LOCAL ] PEB: Trimmed 73249 records to 51098 (keeping 200 days of data) [2025-10-23T23:12:32.800192] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-23T23:12:32.801032] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T23:12:32.826920] [DEBUG] [LOCAL ] PEB: Primary data saved (51098 records). [2025-10-23T23:12:32.827455] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-23T23:12:32.829128] [INFO ] [MAIN ] Update Progress: 1657/2367 symbols completed. PEB took 38.5s. Estimated remaining: 1h 31m 3s. Rate: 7.8 symbols/min [2025-10-23T23:12:33.018945] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:33.056183] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T23:12:33.116575] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-10-23T23:12:33.116971] [INFO ] [MAIN ] PFE: Loaded 53813 existing records. [2025-10-23T23:12:33.305130] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:33.305390] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-23T23:12:33.305470] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-23T23:12:33.305742] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-10-23T23:12:33.305819] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-23T23:12:33.574522] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T23:12:33.604553] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-23T23:12:33.677430] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:34.399472] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-23T23:12:34.717695] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T23:12:35.109756] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T23:12:35.119742] [INFO ] [REMOTE ] PEG: Full fetch complete (76977 records). [2025-10-23T23:12:35.119978] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-23T23:12:35.204564] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-23T23:12:35.529240] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-10-23T23:12:35.529398] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-10-23T23:12:35.531265] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-10-23T23:12:35.531362] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-10-23T23:12:35.533454] [DEBUG] [LOCAL ] PEG: Trimmed 76977 records to 53508 (keeping 200 days of data) [2025-10-23T23:12:35.901430] [DEBUG] [LOCAL ] PEG: Primary data saved (53508 records). [2025-10-23T23:12:35.901691] [INFO ] [MAIN ] PEG: Full history saved. [2025-10-23T23:12:35.901834] [INFO ] [MAIN ] Update Progress: 1658/2367 symbols completed. PEG took 37.2s. Estimated remaining: 1h 30m 53s. Rate: 7.8 symbols/min [2025-10-23T23:12:36.005761] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-23T23:12:36.095811] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:36.150899] [DEBUG] [LOCAL ] PFGC: Loaded 46794 existing records from primary storage. [2025-10-23T23:12:36.151375] [INFO ] [MAIN ] PFGC: Loaded 46794 existing records. [2025-10-23T23:12:36.338480] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:36.338825] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-23T23:12:36.338910] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-23T23:12:36.339283] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-23T23:12:36.339363] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-23T23:12:36.685602] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T23:12:36.740858] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:36.799503] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-23T23:12:37.408686] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T23:12:37.599400] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-23T23:12:37.735735] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-23T23:12:38.399521] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-23T23:12:39.199496] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-23T23:12:39.232574] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:12:39.853872] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-23T23:12:39.999409] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-23T23:12:40.652197] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T23:12:40.736839] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-23T23:12:40.799408] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-23T23:12:41.599442] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-23T23:12:42.369284] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T23:12:42.399400] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-23T23:12:43.199444] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-23T23:12:43.480779] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-23T23:12:43.518347] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T23:12:43.622162] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-23T23:12:43.999410] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-23T23:12:44.639396] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T23:12:44.799417] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-23T23:12:45.428587] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T23:12:45.430131] [INFO ] [REMOTE ] PFD: Full fetch complete (7489 records). [2025-10-23T23:12:45.430220] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-23T23:12:45.602894] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-23T23:12:45.785727] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-23T23:12:45.785833] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-23T23:12:45.786056] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-23T23:12:45.786129] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-23T23:12:45.786554] [DEBUG] [LOCAL ] PFD: Trimmed 7489 records to 5392 (keeping 200 days of data) [2025-10-23T23:12:45.819782] [DEBUG] [LOCAL ] PFD: Primary data saved (5392 records). [2025-10-23T23:12:45.819963] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-23T23:12:45.820087] [INFO ] [MAIN ] Update Progress: 1659/2367 symbols completed. PFD took 19.2s. Estimated remaining: 1h 30m 46s. Rate: 7.8 symbols/min [2025-10-23T23:12:45.992802] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:46.002638] [DEBUG] [LOCAL ] PFH: Loaded 6414 existing records from primary storage. [2025-10-23T23:12:46.002957] [INFO ] [MAIN ] PFH: Loaded 6414 existing records. [2025-10-23T23:12:46.183075] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:46.183383] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-23T23:12:46.183466] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-23T23:12:46.183847] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-23T23:12:46.184092] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-23T23:12:46.404695] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-23T23:12:46.536999] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:47.199427] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-23T23:12:47.288924] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T23:12:47.569818] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T23:12:47.999429] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-23T23:12:48.003920] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T23:12:48.799433] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-23T23:12:49.415899] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T23:12:49.599412] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-23T23:12:50.362448] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-23T23:12:50.399404] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-23T23:12:50.722603] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-23T23:12:51.199435] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-23T23:12:51.974509] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:12:51.999395] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-23T23:12:52.031918] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T23:12:52.799423] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-23T23:12:52.908665] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T23:12:53.599432] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-23T23:12:53.987400] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T23:12:54.399454] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-23T23:12:55.199435] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-23T23:12:55.351904] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T23:12:55.354945] [INFO ] [REMOTE ] PERF: Full fetch complete (21399 records). [2025-10-23T23:12:55.355040] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-23T23:12:55.741677] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-23T23:12:55.741798] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-23T23:12:55.742408] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-23T23:12:55.742500] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-23T23:12:55.743155] [DEBUG] [LOCAL ] PERF: Trimmed 21399 records to 14582 (keeping 200 days of data) [2025-10-23T23:12:55.823934] [DEBUG] [LOCAL ] PERF: Primary data saved (14582 records). [2025-10-23T23:12:55.824105] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-23T23:12:55.824221] [INFO ] [MAIN ] Update Progress: 1660/2367 symbols completed. PERF took 41.3s. Estimated remaining: 1h 30m 39s. Rate: 7.8 symbols/min [2025-10-23T23:12:56.001444] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-23T23:12:56.004020] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:12:56.019276] [DEBUG] [LOCAL ] PFL: Loaded 14446 existing records from primary storage. [2025-10-23T23:12:56.019614] [INFO ] [MAIN ] PFL: Loaded 14446 existing records. [2025-10-23T23:12:56.201185] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:12:56.201555] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-23T23:12:56.201631] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-23T23:12:56.201893] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-23T23:12:56.201975] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-23T23:12:56.394999] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-23T23:12:56.618487] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:12:56.799408] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-23T23:12:56.806569] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T23:12:56.899179] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:12:57.599424] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-23T23:12:57.640835] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T23:12:58.399450] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-23T23:12:59.133905] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T23:12:59.199397] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-23T23:12:59.935324] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T23:12:59.999412] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-23T23:13:00.232606] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-23T23:13:00.580736] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T23:13:00.799439] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-23T23:13:01.599533] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-23T23:13:02.399429] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-23T23:13:02.581664] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T23:13:02.980922] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T23:13:02.982241] [INFO ] [REMOTE ] PFH: Full fetch complete (9606 records). [2025-10-23T23:13:02.982329] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-23T23:13:03.206422] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-23T23:13:03.354002] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-23T23:13:03.354128] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-23T23:13:03.354418] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-23T23:13:03.354494] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-23T23:13:03.354977] [DEBUG] [LOCAL ] PFH: Trimmed 9606 records to 6448 (keeping 200 days of data) [2025-10-23T23:13:03.396026] [DEBUG] [LOCAL ] PFH: Primary data saved (6448 records). [2025-10-23T23:13:03.396211] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-23T23:13:03.396333] [INFO ] [MAIN ] Update Progress: 1661/2367 symbols completed. PFH took 17.6s. Estimated remaining: 1h 30m 32s. Rate: 7.8 symbols/min [2025-10-23T23:13:03.565985] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:03.606193] [DEBUG] [LOCAL ] PFLT: Loaded 44240 existing records from primary storage. [2025-10-23T23:13:03.606513] [INFO ] [MAIN ] PFLT: Loaded 44240 existing records. [2025-10-23T23:13:03.787106] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:03.787375] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-23T23:13:03.787449] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-23T23:13:03.787728] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-23T23:13:03.787828] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-23T23:13:04.002716] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-23T23:13:04.159309] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:04.475235] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-23T23:13:04.808593] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-23T23:13:04.813746] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:13:04.903555] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T23:13:05.599422] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-23T23:13:06.399424] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-23T23:13:06.543592] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T23:13:06.551423] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-23T23:13:07.199429] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-23T23:13:07.999434] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-23T23:13:08.229127] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T23:13:08.799467] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-23T23:13:09.397624] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (3.00 seconds). [2025-10-23T23:13:09.599520] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-23T23:13:09.640307] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T23:13:10.399469] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-23T23:13:10.519829] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T23:13:10.520268] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T23:13:11.199424] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-23T23:13:11.999406] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-23T23:13:12.183170] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T23:13:12.799465] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-23T23:13:12.844261] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T23:13:12.860302] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-23T23:13:13.599494] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-23T23:13:14.399440] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-23T23:13:14.543753] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-23T23:13:14.598519] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T23:13:15.199464] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-23T23:13:15.999480] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-23T23:13:16.172800] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T23:13:16.799435] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-23T23:13:17.122111] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-23T23:13:17.377080] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T23:13:17.599417] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-23T23:13:17.697519] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T23:13:18.399502] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-23T23:13:18.676235] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T23:13:18.680159] [INFO ] [REMOTE ] PFL: Full fetch complete (20755 records). [2025-10-23T23:13:18.680263] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-23T23:13:19.037195] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-23T23:13:19.037314] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-23T23:13:19.037912] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-23T23:13:19.037995] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-23T23:13:19.038718] [DEBUG] [LOCAL ] PFL: Trimmed 20755 records to 14547 (keeping 200 days of data) [2025-10-23T23:13:19.132558] [DEBUG] [LOCAL ] PFL: Primary data saved (14547 records). [2025-10-23T23:13:19.132788] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-23T23:13:19.132928] [INFO ] [MAIN ] Update Progress: 1662/2367 symbols completed. PFL took 23.3s. Estimated remaining: 1h 30m 27s. Rate: 7.8 symbols/min [2025-10-23T23:13:19.204628] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-23T23:13:19.328780] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:19.350516] [DEBUG] [LOCAL ] PFN: Loaded 22150 existing records from primary storage. [2025-10-23T23:13:19.350829] [INFO ] [MAIN ] PFN: Loaded 22150 existing records. [2025-10-23T23:13:19.529072] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:19.529332] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-23T23:13:19.529441] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-23T23:13:19.529693] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-23T23:13:19.529767] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-23T23:13:19.898931] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:19.925082] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T23:13:19.999441] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-23T23:13:20.799439] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-23T23:13:20.871697] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T23:13:21.051094] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T23:13:21.599496] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-23T23:13:22.261754] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T23:13:22.399447] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-23T23:13:23.112410] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T23:13:23.120066] [INFO ] [REMOTE ] PFGC: Full fetch complete (67686 records). [2025-10-23T23:13:23.120223] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-23T23:13:23.204695] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-23T23:13:23.508435] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-23T23:13:23.508571] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-23T23:13:23.509774] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-23T23:13:23.509878] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-23T23:13:23.511276] [DEBUG] [LOCAL ] PFGC: Trimmed 67686 records to 47021 (keeping 200 days of data) [2025-10-23T23:13:23.788324] [DEBUG] [LOCAL ] PFGC: Primary data saved (47021 records). [2025-10-23T23:13:23.788486] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-23T23:13:23.788614] [INFO ] [MAIN ] Update Progress: 1663/2367 symbols completed. PFGC took 47.9s. Estimated remaining: 1h 30m 18s. Rate: 7.8 symbols/min [2025-10-23T23:13:23.968446] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:23.976997] [DEBUG] [LOCAL ] PFO: Loaded 6073 existing records from primary storage. [2025-10-23T23:13:23.977254] [INFO ] [MAIN ] PFO: Loaded 6073 existing records. [2025-10-23T23:13:24.006432] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-23T23:13:24.181903] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:24.184907] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-23T23:13:24.206698] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T23:13:24.198687] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-23T23:13:24.218268] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-23T23:13:24.218463] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-23T23:13:24.252682] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T23:13:24.332825] [INFO ] [REMOTE ] PFE: Full fetch complete (77993 records). [2025-10-23T23:13:24.333258] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-23T23:13:24.847891] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-23T23:13:24.873875] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:24.991347] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-10-23T23:13:24.991486] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-10-23T23:13:24.992736] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-10-23T23:13:24.992838] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-10-23T23:13:24.994306] [DEBUG] [LOCAL ] PFE: Trimmed 77993 records to 54203 (keeping 200 days of data) [2025-10-23T23:13:25.109591] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-23T23:13:25.343726] [DEBUG] [LOCAL ] PFE: Primary data saved (54203 records). [2025-10-23T23:13:25.343883] [INFO ] [MAIN ] PFE: Full history saved. [2025-10-23T23:13:25.345591] [INFO ] [MAIN ] Update Progress: 1664/2367 symbols completed. PFE took 52.5s. Estimated remaining: 1h 30m 8s. Rate: 7.8 symbols/min [2025-10-23T23:13:25.515409] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:25.553982] [DEBUG] [LOCAL ] PFS: Loaded 35666 existing records from primary storage. [2025-10-23T23:13:25.554339] [INFO ] [MAIN ] PFS: Loaded 35666 existing records. [2025-10-23T23:13:25.609441] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-23T23:13:25.736271] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:25.736476] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-23T23:13:25.736573] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-23T23:13:25.736832] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-23T23:13:25.736912] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-23T23:13:26.096571] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:26.399405] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-23T23:13:26.598432] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:13:26.784538] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-23T23:13:27.019466] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-23T23:13:27.199414] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-23T23:13:27.867893] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-23T23:13:27.999427] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-23T23:13:28.799451] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-23T23:13:29.393901] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:13:29.469516] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T23:13:29.599449] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-23T23:13:30.272062] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-23T23:13:30.399461] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-23T23:13:31.199515] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-23T23:13:31.554868] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T23:13:31.999427] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-23T23:13:32.439387] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T23:13:32.799438] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-23T23:13:33.431852] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T23:13:33.599397] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-23T23:13:33.856008] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-23T23:13:33.864698] [INFO ] [REMOTE ] PFLT: Full fetch complete (64370 records). [2025-10-23T23:13:33.864857] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-23T23:13:34.262892] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-23T23:13:34.278493] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-23T23:13:34.279795] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-23T23:13:34.281550] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-23T23:13:34.281663] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-23T23:13:34.282914] [DEBUG] [LOCAL ] PFLT: Trimmed 64370 records to 44559 (keeping 200 days of data) [2025-10-23T23:13:34.400744] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-23T23:13:34.550073] [DEBUG] [LOCAL ] PFLT: Primary data saved (44559 records). [2025-10-23T23:13:34.550267] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-23T23:13:34.550409] [INFO ] [MAIN ] Update Progress: 1665/2367 symbols completed. PFLT took 31.2s. Estimated remaining: 1h 30m 1s. Rate: 7.8 symbols/min [2025-10-23T23:13:34.755792] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:34.787187] [DEBUG] [LOCAL ] PFSI: Loaded 29100 existing records from primary storage. [2025-10-23T23:13:34.787483] [INFO ] [MAIN ] PFSI: Loaded 29100 existing records. [2025-10-23T23:13:34.996048] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:34.996259] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-23T23:13:34.996332] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-23T23:13:34.997388] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-23T23:13:34.997465] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-23T23:13:35.199788] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-23T23:13:35.352153] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:35.494597] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T23:13:35.999450] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-23T23:13:36.678781] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T23:13:36.799431] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-23T23:13:37.056347] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T23:13:37.599420] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-23T23:13:38.316616] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-23T23:13:38.399419] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-23T23:13:38.807348] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-23T23:13:39.133103] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T23:13:39.199433] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-23T23:13:39.999470] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-23T23:13:40.577264] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T23:13:40.799506] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-23T23:13:41.166180] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T23:13:41.553820] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T23:13:41.599403] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-23T23:13:42.399457] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-23T23:13:42.788421] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T23:13:43.145324] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T23:13:43.199431] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-23T23:13:43.999408] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-23T23:13:44.665819] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T23:13:44.799451] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-23T23:13:45.063868] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-23T23:13:45.484858] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T23:13:45.486398] [INFO ] [REMOTE ] PFO: Full fetch complete (7921 records). [2025-10-23T23:13:45.486509] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-23T23:13:45.602906] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-23T23:13:45.874216] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-23T23:13:45.874334] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-23T23:13:45.874610] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-23T23:13:45.874729] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-23T23:13:45.875264] [DEBUG] [LOCAL ] PFO: Trimmed 7921 records to 6133 (keeping 200 days of data) [2025-10-23T23:13:45.910774] [DEBUG] [LOCAL ] PFO: Primary data saved (6133 records). [2025-10-23T23:13:45.910943] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-23T23:13:45.911087] [INFO ] [MAIN ] Update Progress: 1666/2367 symbols completed. PFO took 22.1s. Estimated remaining: 1h 29m 55s. Rate: 7.8 symbols/min [2025-10-23T23:13:46.088227] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:46.138461] [DEBUG] [LOCAL ] PG: Loaded 53753 existing records from primary storage. [2025-10-23T23:13:46.138822] [INFO ] [MAIN ] PG: Loaded 53753 existing records. [2025-10-23T23:13:46.312677] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:46.312908] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-23T23:13:46.312983] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-23T23:13:46.313345] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-10-23T23:13:46.313417] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-23T23:13:46.404676] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-23T23:13:46.716149] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:46.735778] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:13:47.199435] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-23T23:13:47.608885] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T23:13:47.999432] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-23T23:13:48.532288] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T23:13:48.799439] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-23T23:13:49.599428] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-23T23:13:50.029850] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-23T23:13:50.207686] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T23:13:50.214775] [INFO ] [REMOTE ] PFS: Full fetch complete (52316 records). [2025-10-23T23:13:50.214932] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-23T23:13:50.403634] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-23T23:13:50.618091] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-23T23:13:50.618260] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-23T23:13:50.619315] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-23T23:13:50.619418] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-23T23:13:50.635928] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T23:13:50.641576] [DEBUG] [LOCAL ] PFS: Trimmed 52316 records to 35957 (keeping 200 days of data) [2025-10-23T23:13:50.850934] [DEBUG] [LOCAL ] PFS: Primary data saved (35957 records). [2025-10-23T23:13:50.851088] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-23T23:13:50.851199] [INFO ] [MAIN ] Update Progress: 1667/2367 symbols completed. PFS took 25.5s. Estimated remaining: 1h 29m 46s. Rate: 7.8 symbols/min [2025-10-23T23:13:51.022520] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:51.029744] [DEBUG] [LOCAL ] PGP: Loaded 5642 existing records from primary storage. [2025-10-23T23:13:51.029933] [INFO ] [MAIN ] PGP: Loaded 5642 existing records. [2025-10-23T23:13:51.206918] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:51.207021] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-23T23:13:51.207483] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-23T23:13:51.207689] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-23T23:13:51.208038] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-23T23:13:51.208784] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-23T23:13:51.575358] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:51.999451] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-23T23:13:52.571019] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T23:13:52.603374] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-23T23:13:52.778318] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T23:13:52.783123] [INFO ] [REMOTE ] PFN: Full fetch complete (31401 records). [2025-10-23T23:13:52.783230] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-23T23:13:52.806780] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-23T23:13:53.158701] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-23T23:13:53.158809] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-23T23:13:53.159534] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-23T23:13:53.159611] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-23T23:13:53.160376] [DEBUG] [LOCAL ] PFN: Trimmed 31401 records to 22319 (keeping 200 days of data) [2025-10-23T23:13:53.289513] [DEBUG] [LOCAL ] PFN: Primary data saved (22319 records). [2025-10-23T23:13:53.289708] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-23T23:13:53.289822] [INFO ] [MAIN ] Update Progress: 1668/2367 symbols completed. PFN took 34.2s. Estimated remaining: 1h 29m 36s. Rate: 7.8 symbols/min [2025-10-23T23:13:53.460434] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:13:53.508437] [DEBUG] [LOCAL ] PGR: Loaded 52867 existing records from primary storage. [2025-10-23T23:13:53.508828] [INFO ] [MAIN ] PGR: Loaded 52867 existing records. [2025-10-23T23:13:53.605836] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-23T23:13:53.703504] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:13:53.703792] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-23T23:13:53.703870] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-23T23:13:53.704156] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-10-23T23:13:53.704227] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-23T23:13:54.052960] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:13:54.254159] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-23T23:13:54.399491] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-23T23:13:55.015279] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T23:13:55.016897] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-23T23:13:55.199446] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-23T23:13:55.999471] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-23T23:13:56.586482] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:13:56.799421] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-23T23:13:57.482580] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-23T23:13:57.599402] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-23T23:13:58.342246] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T23:13:58.342970] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T23:13:58.399389] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-23T23:13:59.199410] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-23T23:13:59.592939] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T23:13:59.812872] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T23:13:59.999541] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-23T23:14:00.799467] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-23T23:14:01.433222] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-23T23:14:01.599397] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-23T23:14:02.149778] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-23T23:14:02.399519] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-23T23:14:03.057553] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T23:14:03.199415] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-23T23:14:03.479522] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T23:14:03.999465] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-23T23:14:04.443202] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T23:14:04.799498] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-23T23:14:05.482108] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-23T23:14:05.599429] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-23T23:14:05.786755] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T23:14:06.399455] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-23T23:14:07.199450] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-23T23:14:07.709574] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T23:14:07.756115] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-23T23:14:07.975786] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T23:14:07.999433] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-23T23:14:08.654892] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T23:14:08.656598] [INFO ] [REMOTE ] PGP: Full fetch complete (7966 records). [2025-10-23T23:14:08.656706] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-23T23:14:08.807964] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-23T23:14:09.020064] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-23T23:14:09.020180] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-23T23:14:09.020441] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-23T23:14:09.020518] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-23T23:14:09.020993] [DEBUG] [LOCAL ] PGP: Trimmed 7966 records to 5713 (keeping 200 days of data) [2025-10-23T23:14:09.056388] [DEBUG] [LOCAL ] PGP: Primary data saved (5713 records). [2025-10-23T23:14:09.056564] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-23T23:14:09.056702] [INFO ] [MAIN ] Update Progress: 1669/2367 symbols completed. PGP took 18.2s. Estimated remaining: 1h 29m 32s. Rate: 7.8 symbols/min [2025-10-23T23:14:09.227071] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:09.268589] [DEBUG] [LOCAL ] PGRE: Loaded 46946 existing records from primary storage. [2025-10-23T23:14:09.268956] [INFO ] [MAIN ] PGRE: Loaded 46946 existing records. [2025-10-23T23:14:09.446665] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:09.446931] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-23T23:14:09.447031] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-23T23:14:09.447339] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-23T23:14:09.447436] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-23T23:14:09.606940] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-23T23:14:09.828027] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:10.399504] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-23T23:14:10.943306] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-23T23:14:10.970365] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T23:14:11.199460] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-23T23:14:11.999443] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-23T23:14:12.552136] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T23:14:12.811779] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-23T23:14:12.817582] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-23T23:14:13.015921] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T23:14:13.599453] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-23T23:14:14.045890] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T23:14:14.051518] [INFO ] [REMOTE ] PFSI: Full fetch complete (41847 records). [2025-10-23T23:14:14.051636] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-23T23:14:14.415459] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-23T23:14:14.431593] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-23T23:14:14.431723] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-23T23:14:14.432704] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-23T23:14:14.432846] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-23T23:14:14.434073] [DEBUG] [LOCAL ] PFSI: Trimmed 41847 records to 29349 (keeping 200 days of data) [2025-10-23T23:14:14.612509] [DEBUG] [LOCAL ] PFSI: Primary data saved (29349 records). [2025-10-23T23:14:14.612694] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-23T23:14:14.612811] [INFO ] [MAIN ] Update Progress: 1670/2367 symbols completed. PFSI took 40.1s. Estimated remaining: 1h 29m 23s. Rate: 7.8 symbols/min [2025-10-23T23:14:14.793014] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:14.800064] [DEBUG] [LOCAL ] PGZ: Loaded 5498 existing records from primary storage. [2025-10-23T23:14:14.800298] [INFO ] [MAIN ] PGZ: Loaded 5498 existing records. [2025-10-23T23:14:14.977157] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:14.977429] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-23T23:14:14.977513] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-23T23:14:14.977884] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-23T23:14:14.977972] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-23T23:14:15.207181] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-23T23:14:15.362553] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:15.861136] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T23:14:15.892867] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-23T23:14:15.999481] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-23T23:14:16.799449] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-23T23:14:17.524473] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-23T23:14:17.599440] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-23T23:14:17.937505] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T23:14:18.381489] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T23:14:18.399403] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-23T23:14:18.453002] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T23:14:19.199447] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-23T23:14:19.856297] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T23:14:19.865624] [INFO ] [REMOTE ] PG: Full fetch complete (77928 records). [2025-10-23T23:14:19.865798] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-23T23:14:19.999416] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-23T23:14:20.311201] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-23T23:14:20.343810] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-10-23T23:14:20.343923] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-10-23T23:14:20.345577] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-10-23T23:14:20.345975] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-10-23T23:14:20.347413] [DEBUG] [LOCAL ] PG: Trimmed 77928 records to 54143 (keeping 200 days of data) [2025-10-23T23:14:20.680324] [DEBUG] [LOCAL ] PG: Primary data saved (54143 records). [2025-10-23T23:14:20.680470] [INFO ] [MAIN ] PG: Full history saved. [2025-10-23T23:14:20.680619] [INFO ] [MAIN ] Update Progress: 1671/2367 symbols completed. PG took 34.8s. Estimated remaining: 1h 29m 15s. Rate: 7.8 symbols/min [2025-10-23T23:14:20.804696] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-23T23:14:20.855319] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:20.890926] [DEBUG] [LOCAL ] PH: Loaded 36514 existing records from primary storage. [2025-10-23T23:14:20.891274] [INFO ] [MAIN ] PH: Loaded 36514 existing records. [2025-10-23T23:14:21.072453] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:21.072834] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-23T23:14:21.072914] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-23T23:14:21.073155] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-10-23T23:14:21.073244] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-23T23:14:21.202692] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T23:14:21.441625] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:21.599446] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-23T23:14:22.249778] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:14:22.399450] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-23T23:14:23.199564] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-23T23:14:23.329488] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T23:14:23.914198] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T23:14:23.999497] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-23T23:14:24.799423] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-23T23:14:25.148948] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T23:14:25.599464] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-23T23:14:25.654715] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T23:14:25.916980] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-23T23:14:26.399541] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-23T23:14:27.199415] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-23T23:14:27.466513] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T23:14:27.675360] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T23:14:27.999452] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-23T23:14:28.799433] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-23T23:14:28.928977] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T23:14:29.423449] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T23:14:29.599420] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-23T23:14:29.649423] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T23:14:30.236728] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T23:14:30.399452] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-23T23:14:31.199496] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-23T23:14:31.999419] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-23T23:14:32.039583] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-23T23:14:32.618230] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-23T23:14:32.799405] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-23T23:14:33.124586] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T23:14:33.599446] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-23T23:14:34.206590] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-23T23:14:34.399420] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-23T23:14:34.512198] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T23:14:35.094071] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T23:14:35.199436] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-23T23:14:35.999446] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-23T23:14:36.799461] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-23T23:14:36.863343] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T23:14:36.871611] [INFO ] [REMOTE ] PGRE: Full fetch complete (64607 records). [2025-10-23T23:14:36.871859] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-23T23:14:37.270318] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-23T23:14:37.270595] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-23T23:14:37.271721] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-23T23:14:37.271826] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-23T23:14:37.273614] [DEBUG] [LOCAL ] PGRE: Trimmed 64607 records to 47324 (keeping 200 days of data) [2025-10-23T23:14:37.379380] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T23:14:37.601876] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-23T23:14:37.612218] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T23:14:37.638299] [DEBUG] [LOCAL ] PGRE: Primary data saved (47324 records). [2025-10-23T23:14:37.638820] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-23T23:14:37.640281] [INFO ] [MAIN ] Update Progress: 1672/2367 symbols completed. PGRE took 28.6s. Estimated remaining: 1h 29m 11s. Rate: 7.8 symbols/min [2025-10-23T23:14:37.640602] [INFO ] [REMOTE ] PGR: Full fetch complete (76791 records). [2025-10-23T23:14:37.708113] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-23T23:14:37.970665] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:38.309360] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T23:14:38.309597] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-23T23:14:38.310741] [DEBUG] [LOCAL ] PHG: Loaded 45475 existing records from primary storage. [2025-10-23T23:14:38.313364] [INFO ] [MAIN ] PHG: Loaded 45475 existing records. [2025-10-23T23:14:38.313079] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-23T23:14:38.347272] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-23T23:14:38.380184] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-23T23:14:38.404629] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-23T23:14:38.443805] [DEBUG] [LOCAL ] PGR: Trimmed 76791 records to 53254 (keeping 200 days of data) [2025-10-23T23:14:38.505910] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:38.506116] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-23T23:14:38.506205] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-23T23:14:38.506440] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-23T23:14:38.506526] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-23T23:14:39.109137] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:39.191379] [DEBUG] [LOCAL ] PGR: Primary data saved (53254 records). [2025-10-23T23:14:39.191531] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-23T23:14:39.192230] [INFO ] [MAIN ] Update Progress: 1673/2367 symbols completed. PGR took 45.9s. Estimated remaining: 1h 29m 1s. Rate: 7.8 symbols/min [2025-10-23T23:14:39.205092] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-23T23:14:39.359518] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:39.376604] [DEBUG] [LOCAL ] PHI: Loaded 15189 existing records from primary storage. [2025-10-23T23:14:39.376885] [INFO ] [MAIN ] PHI: Loaded 15189 existing records. [2025-10-23T23:14:39.550994] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:39.551179] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-23T23:14:39.551254] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-23T23:14:39.551448] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-23T23:14:39.551520] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-23T23:14:39.901992] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:39.924165] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T23:14:39.999395] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-23T23:14:40.799487] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-23T23:14:40.921079] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-23T23:14:41.432462] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T23:14:41.532431] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T23:14:41.599451] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-23T23:14:42.257065] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T23:14:42.399450] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-23T23:14:43.007343] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T23:14:43.008957] [INFO ] [REMOTE ] PGZ: Full fetch complete (8168 records). [2025-10-23T23:14:43.009079] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-23T23:14:43.204592] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-23T23:14:43.379047] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-23T23:14:43.379174] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-23T23:14:43.379405] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-23T23:14:43.379479] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-23T23:14:43.379990] [DEBUG] [LOCAL ] PGZ: Trimmed 8168 records to 5521 (keeping 200 days of data) [2025-10-23T23:14:43.413451] [DEBUG] [LOCAL ] PGZ: Primary data saved (5521 records). [2025-10-23T23:14:43.413629] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-23T23:14:43.413795] [INFO ] [MAIN ] Update Progress: 1674/2367 symbols completed. PGZ took 28.8s. Estimated remaining: 1h 28m 52s. Rate: 7.8 symbols/min [2025-10-23T23:14:43.583839] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:43.612448] [DEBUG] [LOCAL ] PHIN: Loaded 31408 existing records from primary storage. [2025-10-23T23:14:43.612814] [INFO ] [MAIN ] PHIN: Loaded 31408 existing records. [2025-10-23T23:14:43.791734] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:43.791938] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-23T23:14:43.792032] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-23T23:14:43.792261] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-23T23:14:43.792332] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-23T23:14:44.004734] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-23T23:14:44.155552] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:44.799432] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-23T23:14:44.903775] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T23:14:45.594119] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T23:14:45.606067] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-23T23:14:45.639355] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T23:14:46.399418] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-23T23:14:46.472716] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T23:14:47.199446] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-23T23:14:48.005103] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-23T23:14:48.017132] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T23:14:48.244811] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-23T23:14:48.799429] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-23T23:14:49.600537] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-23T23:14:49.604514] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T23:14:50.399420] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-23T23:14:50.522246] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T23:14:50.659433] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T23:14:51.063790] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T23:14:51.069508] [INFO ] [REMOTE ] PH: Full fetch complete (55702 records). [2025-10-23T23:14:51.069673] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-23T23:14:51.207733] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-23T23:14:51.453135] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-23T23:14:51.453254] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-23T23:14:51.454225] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-23T23:14:51.454303] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-23T23:14:51.455539] [DEBUG] [LOCAL ] PH: Trimmed 55702 records to 36710 (keeping 200 days of data) [2025-10-23T23:14:51.684210] [DEBUG] [LOCAL ] PH: Primary data saved (36710 records). [2025-10-23T23:14:51.684375] [INFO ] [MAIN ] PH: Full history saved. [2025-10-23T23:14:51.684486] [INFO ] [MAIN ] Update Progress: 1675/2367 symbols completed. PH took 31.0s. Estimated remaining: 1h 28m 44s. Rate: 7.8 symbols/min [2025-10-23T23:14:51.853339] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:14:51.878984] [DEBUG] [LOCAL ] PHK: Loaded 26760 existing records from primary storage. [2025-10-23T23:14:51.879274] [INFO ] [MAIN ] PHK: Loaded 26760 existing records. [2025-10-23T23:14:52.004632] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-23T23:14:52.054835] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:14:52.055007] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-23T23:14:52.055105] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-23T23:14:52.055319] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-23T23:14:52.055389] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-23T23:14:52.408941] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:14:52.799451] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-23T23:14:52.873124] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T23:14:53.066177] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T23:14:53.599407] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-23T23:14:54.175431] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T23:14:54.399473] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-23T23:14:54.900572] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T23:14:55.199459] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-23T23:14:55.318919] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-23T23:14:55.999492] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-23T23:14:56.709019] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T23:14:56.799426] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-23T23:14:57.378159] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T23:14:57.599405] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-23T23:14:57.669327] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T23:14:58.399422] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-23T23:14:58.756862] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T23:14:59.199440] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-23T23:14:59.866383] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T23:14:59.999411] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-23T23:15:00.714205] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T23:15:00.799491] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-23T23:15:01.542986] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T23:15:01.599462] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-23T23:15:01.894938] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T23:15:02.399466] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-23T23:15:02.853327] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T23:15:03.199420] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-23T23:15:03.555990] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T23:15:03.999476] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-23T23:15:04.486899] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-23T23:15:04.799476] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-23T23:15:05.599493] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-23T23:15:05.677580] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T23:15:06.179222] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T23:15:06.399479] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-23T23:15:06.604402] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T23:15:06.608051] [INFO ] [REMOTE ] PHI: Full fetch complete (21380 records). [2025-10-23T23:15:06.608202] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-23T23:15:07.027215] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-23T23:15:07.027336] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-23T23:15:07.027988] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-23T23:15:07.028092] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-23T23:15:07.028844] [DEBUG] [LOCAL ] PHI: Trimmed 21380 records to 15292 (keeping 200 days of data) [2025-10-23T23:15:07.136353] [DEBUG] [LOCAL ] PHI: Primary data saved (15292 records). [2025-10-23T23:15:07.136537] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-23T23:15:07.136713] [INFO ] [MAIN ] Update Progress: 1676/2367 symbols completed. PHI took 27.9s. Estimated remaining: 1h 28m 40s. Rate: 7.8 symbols/min [2025-10-23T23:15:07.204737] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-23T23:15:07.310493] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:07.361129] [DEBUG] [LOCAL ] PHM: Loaded 51691 existing records from primary storage. [2025-10-23T23:15:07.361466] [INFO ] [MAIN ] PHM: Loaded 51691 existing records. [2025-10-23T23:15:07.536969] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:07.537161] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-23T23:15:07.537235] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-23T23:15:07.537474] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-10-23T23:15:07.537548] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-23T23:15:07.848971] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:15:07.926608] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:07.999407] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-23T23:15:08.799434] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-23T23:15:08.930152] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T23:15:09.599445] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-23T23:15:09.686004] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-23T23:15:10.385038] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-23T23:15:10.399403] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-23T23:15:10.907361] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T23:15:11.199471] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-23T23:15:11.999417] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-23T23:15:12.170517] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T23:15:12.554550] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T23:15:12.799442] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-23T23:15:13.295205] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T23:15:13.302702] [INFO ] [REMOTE ] PHG: Full fetch complete (65773 records). [2025-10-23T23:15:13.302842] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-23T23:15:13.604531] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-23T23:15:13.689215] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-23T23:15:13.689330] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-23T23:15:13.690425] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-23T23:15:13.690503] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-23T23:15:13.691798] [DEBUG] [LOCAL ] PHG: Trimmed 65773 records to 45790 (keeping 200 days of data) [2025-10-23T23:15:13.974251] [DEBUG] [LOCAL ] PHG: Primary data saved (45790 records). [2025-10-23T23:15:13.974427] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-23T23:15:13.974559] [INFO ] [MAIN ] Update Progress: 1677/2367 symbols completed. PHG took 36.3s. Estimated remaining: 1h 28m 32s. Rate: 7.8 symbols/min [2025-10-23T23:15:14.399469] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-23T23:15:14.699985] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T23:15:14.828014] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T23:15:15.199456] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-23T23:15:15.901690] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T23:15:15.999474] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-23T23:15:16.106511] [DEBUG] [REMOTE ] PHK: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-23T23:15:16.106872] [WARN ] [REMOTE ] PHK: No data returned for month 2025-08 [2025-10-23T23:15:16.106962] [FATAL] [REMOTE ] PHK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:15:16.107073] [FATAL] [MAIN ] PHK: Failed to fetch primary data. [2025-10-23T23:15:16.107145] [WARN ] [MAIN ] PHK: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:15:16.107222] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-23T23:15:16.107316] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-23T23:15:16.107394] [INFO ] [LOCAL ] PHK: Starting deletion of derivative data. [2025-10-23T23:15:16.107579] [DEBUG] [LOCAL ] PHK: Deleted derivative data file. [2025-10-23T23:15:16.107706] [INFO ] [MAIN ] Update Progress: 1678/2367 symbols completed. PHK took 24.4s. Estimated remaining: 1h 28m 22s. Rate: 7.8 symbols/min [2025-10-23T23:15:16.799440] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-23T23:15:17.208932] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T23:15:17.599431] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-23T23:15:18.723798] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T23:15:18.734829] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-23T23:15:18.872711] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T23:15:18.877851] [INFO ] [REMOTE ] PHIN: Full fetch complete (47320 records). [2025-10-23T23:15:18.877987] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-23T23:15:19.256953] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-23T23:15:19.257090] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-23T23:15:19.258197] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-23T23:15:19.258303] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-23T23:15:19.259491] [DEBUG] [LOCAL ] PHIN: Trimmed 47320 records to 31596 (keeping 200 days of data) [2025-10-23T23:15:19.465033] [DEBUG] [LOCAL ] PHIN: Primary data saved (31596 records). [2025-10-23T23:15:19.465222] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-23T23:15:19.465341] [INFO ] [MAIN ] Update Progress: 1679/2367 symbols completed. PHIN took 36.1s. Estimated remaining: 1h 28m 12s. Rate: 7.8 symbols/min [2025-10-23T23:15:20.587102] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T23:15:20.599177] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-23T23:15:22.477706] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-23T23:15:22.488026] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-23T23:15:24.522538] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T23:15:24.534784] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-23T23:15:26.492514] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T23:15:26.503385] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-23T23:15:27.265146] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T23:15:27.276853] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-23T23:15:28.574331] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T23:15:28.583825] [INFO ] [REMOTE ] PHM: Full fetch complete (75255 records). [2025-10-23T23:15:28.584013] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-23T23:15:28.969785] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-10-23T23:15:28.969899] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-10-23T23:15:28.971023] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-10-23T23:15:28.971103] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-10-23T23:15:28.972543] [DEBUG] [LOCAL ] PHM: Trimmed 75255 records to 52071 (keeping 200 days of data) [2025-10-23T23:15:29.297863] [DEBUG] [LOCAL ] PHM: Primary data saved (52071 records). [2025-10-23T23:15:29.298040] [INFO ] [MAIN ] PHM: Full history saved. [2025-10-23T23:15:29.298173] [INFO ] [MAIN ] Update Progress: 1680/2367 symbols completed. PHM took 22.2s. Estimated remaining: 1h 28m 5s. Rate: 7.8 symbols/min [2025-10-23T23:15:29.902589] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:30.012632] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:30.017019] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:30.035956] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:30.047626] [DEBUG] [LOCAL ] PIM: Loaded 4846 existing records from primary storage. [2025-10-23T23:15:30.047995] [INFO ] [MAIN ] PIM: Loaded 4846 existing records. [2025-10-23T23:15:30.112000] [DEBUG] [LOCAL ] PINE: Loaded 14383 existing records from primary storage. [2025-10-23T23:15:30.159257] [INFO ] [MAIN ] PINE: Loaded 14383 existing records. [2025-10-23T23:15:30.383349] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:30.402354] [DEBUG] [LOCAL ] PHR: Loaded 37953 existing records from primary storage. [2025-10-23T23:15:30.413909] [DEBUG] [LOCAL ] PII: Loaded 48713 existing records from primary storage. [2025-10-23T23:15:30.430018] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-23T23:15:30.443033] [INFO ] [MAIN ] PHR: Loaded 37953 existing records. [2025-10-23T23:15:30.456278] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-23T23:15:30.460961] [INFO ] [MAIN ] PII: Loaded 48713 existing records. [2025-10-23T23:15:30.468743] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-23T23:15:30.569239] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-23T23:15:30.564013] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:30.648174] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-23T23:15:30.676873] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-23T23:15:30.703073] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-23T23:15:30.751149] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-23T23:15:31.064577] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:31.146337] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:31.149851] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-23T23:15:31.161529] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-23T23:15:31.162146] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-23T23:15:31.259100] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-23T23:15:31.259203] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-23T23:15:31.368076] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-23T23:15:31.385234] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-23T23:15:31.518747] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-23T23:15:31.932357] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:32.089876] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-23T23:15:32.215315] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:32.262236] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-23T23:15:32.750013] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:32.805097] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-23T23:15:32.804485] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:32.805797] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-23T23:15:32.871692] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T23:15:32.873076] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-23T23:15:33.310523] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T23:15:33.312011] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-23T23:15:33.493508] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-23T23:15:33.497216] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-23T23:15:33.691882] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-23T23:15:33.693446] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-23T23:15:34.145989] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T23:15:34.152878] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-23T23:15:34.286989] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T23:15:34.288631] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-23T23:15:34.363380] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-23T23:15:34.366885] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-23T23:15:34.608871] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T23:15:34.618775] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-23T23:15:34.668222] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-23T23:15:34.670204] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-23T23:15:34.920407] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-23T23:15:34.924193] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-23T23:15:35.281102] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T23:15:35.283197] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-23T23:15:35.397173] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T23:15:35.403836] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-23T23:15:35.698605] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T23:15:35.972180] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-23T23:15:35.999395] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-23T23:15:36.367949] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T23:15:36.800625] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-23T23:15:36.802880] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T23:15:37.599414] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-23T23:15:37.666354] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-23T23:15:38.399458] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-23T23:15:39.038349] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T23:15:39.202086] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-23T23:15:39.203909] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (3.20 seconds). [2025-10-23T23:15:39.740176] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T23:15:39.999432] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-23T23:15:40.799429] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-23T23:15:41.022576] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T23:15:41.055063] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T23:15:41.599429] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-23T23:15:41.617409] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:15:42.399444] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-23T23:15:43.051110] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:15:43.199446] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-23T23:15:43.996969] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T23:15:43.998467] [INFO ] [REMOTE ] PIM: Full fetch complete (6464 records). [2025-10-23T23:15:43.998584] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-23T23:15:44.010607] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-23T23:15:44.415239] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-23T23:15:44.415411] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-23T23:15:44.416018] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-23T23:15:44.431773] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-23T23:15:44.447209] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-23T23:15:44.448097] [DEBUG] [LOCAL ] PIM: Trimmed 6464 records to 4876 (keeping 200 days of data) [2025-10-23T23:15:44.487906] [DEBUG] [LOCAL ] PIM: Primary data saved (4876 records). [2025-10-23T23:15:44.488073] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-23T23:15:44.488215] [INFO ] [MAIN ] Update Progress: 1681/2367 symbols completed. PIM took 15.2s. Estimated remaining: 1h 28m 1s. Rate: 7.8 symbols/min [2025-10-23T23:15:44.657327] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:44.705722] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-23T23:15:44.706129] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-10-23T23:15:44.805432] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-23T23:15:44.898360] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:44.898531] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-23T23:15:44.898608] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-23T23:15:44.899177] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-23T23:15:44.899252] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-23T23:15:45.266103] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:45.378923] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T23:15:45.599445] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-23T23:15:46.399415] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-23T23:15:46.676760] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T23:15:46.924773] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-23T23:15:47.199450] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-23T23:15:47.445765] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T23:15:47.999423] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-23T23:15:48.799479] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-23T23:15:48.817450] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:15:48.953055] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T23:15:49.599440] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-23T23:15:50.399431] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-23T23:15:50.751366] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T23:15:50.997266] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T23:15:51.199434] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-23T23:15:51.355696] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T23:15:51.358880] [INFO ] [REMOTE ] PINE: Full fetch complete (21006 records). [2025-10-23T23:15:51.358992] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-23T23:15:51.731842] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-23T23:15:51.732022] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-23T23:15:51.732524] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-23T23:15:51.732600] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-23T23:15:51.733297] [DEBUG] [LOCAL ] PINE: Trimmed 21006 records to 14507 (keeping 200 days of data) [2025-10-23T23:15:51.824852] [DEBUG] [LOCAL ] PINE: Primary data saved (14507 records). [2025-10-23T23:15:51.825015] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-23T23:15:51.825126] [INFO ] [MAIN ] Update Progress: 1682/2367 symbols completed. PINE took 22.5s. Estimated remaining: 1h 27m 53s. Rate: 7.8 symbols/min [2025-10-23T23:15:51.993470] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:15:52.003089] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-23T23:15:52.011337] [DEBUG] [LOCAL ] PIPR: Loaded 14992 existing records from primary storage. [2025-10-23T23:15:52.011675] [INFO ] [MAIN ] PIPR: Loaded 14992 existing records. [2025-10-23T23:15:52.191415] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:15:52.191696] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-23T23:15:52.191773] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-23T23:15:52.192014] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-23T23:15:52.192089] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-23T23:15:52.547906] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:15:52.799439] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-23T23:15:52.978412] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T23:15:53.388430] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T23:15:53.599437] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-23T23:15:53.717495] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T23:15:54.399492] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-23T23:15:54.916755] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T23:15:55.199475] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-23T23:15:55.957332] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T23:15:55.999466] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-23T23:15:56.052890] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:15:56.799483] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-23T23:15:57.599430] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-23T23:15:57.634214] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T23:15:57.679800] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T23:15:58.399490] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-23T23:15:59.199450] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-23T23:15:59.793872] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-23T23:15:59.855151] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:15:59.863124] [INFO ] [REMOTE ] PHR: Full fetch complete (53513 records). [2025-10-23T23:15:59.863320] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-23T23:16:00.008734] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-23T23:16:00.295968] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-23T23:16:00.296134] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-23T23:16:00.297120] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-23T23:16:00.297201] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-23T23:16:00.298633] [DEBUG] [LOCAL ] PHR: Trimmed 53513 records to 38203 (keeping 200 days of data) [2025-10-23T23:16:00.527469] [DEBUG] [LOCAL ] PHR: Primary data saved (38203 records). [2025-10-23T23:16:00.527737] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-23T23:16:00.527882] [INFO ] [MAIN ] Update Progress: 1683/2367 symbols completed. PHR took 31.2s. Estimated remaining: 1h 27m 46s. Rate: 7.8 symbols/min [2025-10-23T23:16:00.698146] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:00.719459] [DEBUG] [LOCAL ] PJT: Loaded 21211 existing records from primary storage. [2025-10-23T23:16:00.719777] [INFO ] [MAIN ] PJT: Loaded 21211 existing records. [2025-10-23T23:16:00.804348] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-23T23:16:00.910210] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:00.910445] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-23T23:16:00.910522] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-23T23:16:00.910765] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-23T23:16:00.910839] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-23T23:16:01.195326] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T23:16:01.280415] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:01.599440] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-23T23:16:02.291333] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-23T23:16:02.399408] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-23T23:16:02.507704] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T23:16:02.706304] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T23:16:03.199475] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-23T23:16:03.999435] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-23T23:16:04.377495] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T23:16:04.799415] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-23T23:16:04.859958] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T23:16:04.868357] [INFO ] [REMOTE ] PII: Full fetch complete (71272 records). [2025-10-23T23:16:04.868568] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-23T23:16:05.287723] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-23T23:16:05.299535] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-23T23:16:05.302358] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T23:16:05.301505] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-23T23:16:05.306771] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-23T23:16:05.308849] [DEBUG] [LOCAL ] PII: Trimmed 71272 records to 49002 (keeping 200 days of data) [2025-10-23T23:16:05.599999] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-23T23:16:05.619470] [DEBUG] [LOCAL ] PII: Primary data saved (49002 records). [2025-10-23T23:16:05.619729] [INFO ] [MAIN ] PII: Full history saved. [2025-10-23T23:16:05.619872] [INFO ] [MAIN ] Update Progress: 1684/2367 symbols completed. PII took 36.3s. Estimated remaining: 1h 27m 37s. Rate: 7.8 symbols/min [2025-10-23T23:16:05.789231] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:05.836705] [DEBUG] [LOCAL ] PK: Loaded 52755 existing records from primary storage. [2025-10-23T23:16:05.837106] [INFO ] [MAIN ] PK: Loaded 52755 existing records. [2025-10-23T23:16:06.015388] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:06.015593] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-23T23:16:06.015713] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-23T23:16:06.016366] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-23T23:16:06.016453] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-23T23:16:06.386342] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:06.399424] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-23T23:16:06.887842] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-23T23:16:07.199420] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-23T23:16:07.742467] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-23T23:16:07.999442] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-23T23:16:08.211963] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T23:16:08.799467] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-23T23:16:08.970808] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-23T23:16:09.064397] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T23:16:09.599427] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-23T23:16:10.399431] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-23T23:16:10.466636] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T23:16:10.631949] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T23:16:11.199522] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-23T23:16:11.999491] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-23T23:16:12.216827] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T23:16:12.397613] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T23:16:12.799482] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-23T23:16:13.599440] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-23T23:16:13.889382] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T23:16:14.399450] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-23T23:16:14.951249] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-23T23:16:14.960540] [INFO ] [REMOTE ] PINS: Full fetch complete (77871 records). [2025-10-23T23:16:14.960735] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-23T23:16:15.206213] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-23T23:16:15.322965] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T23:16:15.387301] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-23T23:16:15.387416] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-23T23:16:15.388628] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-23T23:16:15.388730] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-23T23:16:15.390199] [DEBUG] [LOCAL ] PINS: Trimmed 77871 records to 54083 (keeping 200 days of data) [2025-10-23T23:16:15.711683] [DEBUG] [LOCAL ] PINS: Primary data saved (54083 records). [2025-10-23T23:16:15.711848] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-23T23:16:15.711964] [INFO ] [MAIN ] Update Progress: 1685/2367 symbols completed. PINS took 31.2s. Estimated remaining: 1h 27m 30s. Rate: 7.8 symbols/min [2025-10-23T23:16:15.893089] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:15.909907] [DEBUG] [LOCAL ] PKE: Loaded 14290 existing records from primary storage. [2025-10-23T23:16:15.910372] [INFO ] [MAIN ] PKE: Loaded 14290 existing records. [2025-10-23T23:16:16.015373] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-23T23:16:16.106781] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:16.107233] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-23T23:16:16.107434] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-23T23:16:16.107704] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-23T23:16:16.107796] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-23T23:16:16.247692] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T23:16:16.498737] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-23T23:16:16.519143] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:16.799459] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-23T23:16:17.099307] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T23:16:17.599450] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-23T23:16:18.399456] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-23T23:16:18.619050] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T23:16:18.686897] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T23:16:19.199453] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-23T23:16:19.297494] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-23T23:16:19.300466] [INFO ] [REMOTE ] PIPR: Full fetch complete (21043 records). [2025-10-23T23:16:19.300563] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-23T23:16:19.662717] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-23T23:16:19.662841] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-23T23:16:19.663323] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-23T23:16:19.663396] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-23T23:16:19.664157] [DEBUG] [LOCAL ] PIPR: Trimmed 21043 records to 15051 (keeping 200 days of data) [2025-10-23T23:16:19.756848] [DEBUG] [LOCAL ] PIPR: Primary data saved (15051 records). [2025-10-23T23:16:19.757016] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-23T23:16:19.757128] [INFO ] [MAIN ] Update Progress: 1686/2367 symbols completed. PIPR took 27.9s. Estimated remaining: 1h 27m 21s. Rate: 7.8 symbols/min [2025-10-23T23:16:19.922042] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:19.957919] [DEBUG] [LOCAL ] PKG: Loaded 38565 existing records from primary storage. [2025-10-23T23:16:19.958222] [INFO ] [MAIN ] PKG: Loaded 38565 existing records. [2025-10-23T23:16:20.004595] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-23T23:16:20.138984] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:20.139215] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-23T23:16:20.139293] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-23T23:16:20.139523] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-10-23T23:16:20.139597] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-23T23:16:20.400515] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T23:16:20.520895] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:20.799443] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-23T23:16:20.881787] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T23:16:21.599419] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-23T23:16:21.967259] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-23T23:16:22.399448] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-23T23:16:23.199431] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-23T23:16:23.999435] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-23T23:16:24.024556] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:16:24.799557] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-23T23:16:25.619271] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (4.02 seconds). [2025-10-23T23:16:25.631373] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-23T23:16:26.309467] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T23:16:26.399415] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-23T23:16:27.314308] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (4.11 seconds). [2025-10-23T23:16:27.319543] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-23T23:16:27.435718] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T23:16:27.691786] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (3.69 seconds). [2025-10-23T23:16:27.759435] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T23:16:27.956350] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T23:16:27.999471] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-23T23:16:28.799483] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-23T23:16:29.599443] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-23T23:16:30.399422] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-23T23:16:31.002275] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-23T23:16:31.199438] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-23T23:16:31.213430] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-23T23:16:31.398468] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T23:16:31.401319] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T23:16:31.415753] [INFO ] [REMOTE ] PJT: Full fetch complete (32118 records). [2025-10-23T23:16:31.416276] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-23T23:16:31.794720] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-23T23:16:31.794848] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-23T23:16:31.795541] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-23T23:16:31.795618] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-23T23:16:31.796712] [DEBUG] [LOCAL ] PJT: Trimmed 32118 records to 21297 (keeping 200 days of data) [2025-10-23T23:16:31.928516] [DEBUG] [LOCAL ] PJT: Primary data saved (21297 records). [2025-10-23T23:16:31.928692] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-23T23:16:31.928807] [INFO ] [MAIN ] Update Progress: 1687/2367 symbols completed. PJT took 31.4s. Estimated remaining: 1h 27m 15s. Rate: 7.8 symbols/min [2025-10-23T23:16:32.009291] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-23T23:16:32.114019] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:32.133050] [DEBUG] [LOCAL ] PKST: Loaded 18133 existing records from primary storage. [2025-10-23T23:16:32.133325] [INFO ] [MAIN ] PKST: Loaded 18133 existing records. [2025-10-23T23:16:32.329412] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:32.329881] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-23T23:16:32.330039] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-23T23:16:32.330260] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-23T23:16:32.330333] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-23T23:16:32.717977] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:32.739778] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T23:16:32.799417] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-23T23:16:32.955698] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T23:16:33.599426] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-23T23:16:34.179925] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T23:16:34.213189] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T23:16:34.399468] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-23T23:16:35.199430] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-23T23:16:35.999419] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-23T23:16:36.191403] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T23:16:36.282927] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T23:16:36.799421] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-23T23:16:36.847588] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T23:16:37.599446] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-23T23:16:37.864596] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T23:16:38.399459] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-23T23:16:39.199444] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-23T23:16:39.999412] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-23T23:16:40.000939] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T23:16:40.524198] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T23:16:40.799433] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-23T23:16:41.445544] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T23:16:41.599440] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-23T23:16:42.157712] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T23:16:42.399421] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-23T23:16:42.613835] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-23T23:16:43.085734] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T23:16:43.199406] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-23T23:16:43.999437] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-23T23:16:44.175679] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (6.58 seconds). [2025-10-23T23:16:44.184787] [INFO ] [REMOTE ] PK: Full fetch complete (76533 records). [2025-10-23T23:16:44.184954] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-23T23:16:44.575518] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-23T23:16:44.575663] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-23T23:16:44.576801] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-23T23:16:44.576883] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-23T23:16:44.578308] [DEBUG] [LOCAL ] PK: Trimmed 76533 records to 53137 (keeping 200 days of data) [2025-10-23T23:16:44.801902] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-23T23:16:44.896288] [DEBUG] [LOCAL ] PK: Primary data saved (53137 records). [2025-10-23T23:16:44.896473] [INFO ] [MAIN ] PK: Full history saved. [2025-10-23T23:16:44.896565] [INFO ] [MAIN ] Update Progress: 1688/2367 symbols completed. PK took 39.3s. Estimated remaining: 1h 27m 10s. Rate: 7.8 symbols/min [2025-10-23T23:16:45.064744] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:45.080847] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T23:16:45.101460] [DEBUG] [LOCAL ] PKX: Loaded 22626 existing records from primary storage. [2025-10-23T23:16:45.101759] [INFO ] [MAIN ] PKX: Loaded 22626 existing records. [2025-10-23T23:16:45.272769] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:45.272987] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-23T23:16:45.273063] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-23T23:16:45.273285] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-23T23:16:45.273355] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-23T23:16:45.611805] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-23T23:16:45.621560] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:45.928212] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T23:16:46.399443] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-23T23:16:47.199464] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-23T23:16:48.399353] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-23T23:16:48.403915] [INFO ] [REMOTE ] PKE: Full fetch complete (18476 records). [2025-10-23T23:16:48.404056] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-23T23:16:48.833886] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-23T23:16:48.833998] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-23T23:16:48.834465] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-23T23:16:48.834542] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-23T23:16:48.835190] [DEBUG] [LOCAL ] PKE: Trimmed 18476 records to 14380 (keeping 200 days of data) [2025-10-23T23:16:48.930843] [DEBUG] [LOCAL ] PKE: Primary data saved (14380 records). [2025-10-23T23:16:48.931011] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-23T23:16:48.931129] [INFO ] [MAIN ] Update Progress: 1689/2367 symbols completed. PKE took 33.2s. Estimated remaining: 1h 27m 0s. Rate: 7.8 symbols/min [2025-10-23T23:16:49.133820] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:49.184208] [DEBUG] [LOCAL ] PL: Loaded 53212 existing records from primary storage. [2025-10-23T23:16:49.184566] [INFO ] [MAIN ] PL: Loaded 53212 existing records. [2025-10-23T23:16:49.393394] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:49.393705] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-23T23:16:49.393787] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-23T23:16:49.394007] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-23T23:16:49.394086] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-23T23:16:49.808800] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:49.809140] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-23T23:16:50.181616] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (6.98 seconds). [2025-10-23T23:16:50.188705] [INFO ] [REMOTE ] PKG: Full fetch complete (57756 records). [2025-10-23T23:16:50.188852] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-23T23:16:50.596831] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-23T23:16:50.596953] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-23T23:16:50.598180] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-23T23:16:50.598264] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-23T23:16:50.599729] [DEBUG] [LOCAL ] PKG: Trimmed 57756 records to 38951 (keeping 200 days of data) [2025-10-23T23:16:50.711590] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (5.10 seconds). [2025-10-23T23:16:50.728143] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-23T23:16:50.874079] [DEBUG] [LOCAL ] PKG: Primary data saved (38951 records). [2025-10-23T23:16:50.874259] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-23T23:16:50.874376] [INFO ] [MAIN ] Update Progress: 1690/2367 symbols completed. PKG took 31.1s. Estimated remaining: 1h 26m 50s. Rate: 7.8 symbols/min [2025-10-23T23:16:51.052691] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:16:51.107577] [DEBUG] [LOCAL ] PLD: Loaded 53416 existing records from primary storage. [2025-10-23T23:16:51.107971] [INFO ] [MAIN ] PLD: Loaded 53416 existing records. [2025-10-23T23:16:51.289781] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:16:51.290106] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-23T23:16:51.290183] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-23T23:16:51.290406] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-10-23T23:16:51.290477] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-23T23:16:51.556110] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (5.16 seconds). [2025-10-23T23:16:51.581543] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-23T23:16:51.678871] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:16:51.679205] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-23T23:16:51.733612] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T23:16:51.738118] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-23T23:16:51.958931] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-23T23:16:51.999398] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-23T23:16:52.663558] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T23:16:52.767943] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T23:16:52.799396] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-23T23:16:53.599407] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-23T23:16:53.639867] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-23T23:16:53.741174] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T23:16:53.833259] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T23:16:54.399474] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-23T23:16:55.199493] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-23T23:16:55.235598] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T23:16:55.412939] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T23:16:55.999532] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-23T23:16:56.799446] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-23T23:16:57.247041] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T23:16:57.599440] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-23T23:16:57.726985] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T23:16:57.973993] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T23:16:58.399491] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-23T23:16:59.199440] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-23T23:16:59.408522] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T23:16:59.999448] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-23T23:17:00.172326] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T23:17:00.799454] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-23T23:17:01.386580] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-23T23:17:01.599479] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-23T23:17:01.923677] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T23:17:01.927578] [INFO ] [REMOTE ] PKST: Full fetch complete (28934 records). [2025-10-23T23:17:01.927695] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-23T23:17:02.271893] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-23T23:17:02.354481] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-23T23:17:02.354604] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-23T23:17:02.355305] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-23T23:17:02.355381] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-23T23:17:02.356133] [DEBUG] [LOCAL ] PKST: Trimmed 28934 records to 18267 (keeping 200 days of data) [2025-10-23T23:17:02.401913] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-23T23:17:02.466508] [DEBUG] [LOCAL ] PKST: Primary data saved (18267 records). [2025-10-23T23:17:02.466673] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-23T23:17:02.466797] [INFO ] [MAIN ] Update Progress: 1691/2367 symbols completed. PKST took 30.5s. Estimated remaining: 1h 26m 44s. Rate: 7.8 symbols/min [2025-10-23T23:17:02.640477] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:02.685666] [DEBUG] [LOCAL ] PLNT: Loaded 48026 existing records from primary storage. [2025-10-23T23:17:02.685996] [INFO ] [MAIN ] PLNT: Loaded 48026 existing records. [2025-10-23T23:17:02.877353] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:17:02.877626] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-23T23:17:02.878780] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-23T23:17:02.879957] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T23:17:02.885980] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-23T23:17:02.886766] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-23T23:17:03.207075] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-23T23:17:03.237908] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:03.999454] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-23T23:17:04.199405] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T23:17:04.799432] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-23T23:17:05.238325] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-23T23:17:05.573021] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-23T23:17:05.599398] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-23T23:17:06.399410] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-23T23:17:06.479207] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T23:17:07.199455] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-23T23:17:07.778848] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-23T23:17:07.999428] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-23T23:17:08.078601] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T23:17:08.722428] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T23:17:08.744195] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T23:17:08.799487] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-23T23:17:09.599455] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-23T23:17:10.399435] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-23T23:17:11.069398] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-23T23:17:11.199420] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-23T23:17:11.994618] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:17:12.003713] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-23T23:17:12.344997] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T23:17:12.447707] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-23T23:17:12.799464] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-23T23:17:13.599456] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-23T23:17:14.399426] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-23T23:17:14.482857] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-23T23:17:14.561557] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T23:17:15.199408] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-23T23:17:15.496133] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-23T23:17:15.577919] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T23:17:15.581780] [INFO ] [REMOTE ] PKX: Full fetch complete (35879 records). [2025-10-23T23:17:15.581899] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-23T23:17:15.957857] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-23T23:17:15.957980] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-23T23:17:15.958748] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-23T23:17:15.958828] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-23T23:17:15.959620] [DEBUG] [LOCAL ] PKX: Trimmed 35879 records to 22749 (keeping 200 days of data) [2025-10-23T23:17:16.009595] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-23T23:17:16.095536] [DEBUG] [LOCAL ] PKX: Primary data saved (22749 records). [2025-10-23T23:17:16.095713] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-23T23:17:16.095826] [INFO ] [MAIN ] Update Progress: 1692/2367 symbols completed. PKX took 31.2s. Estimated remaining: 1h 26m 39s. Rate: 7.8 symbols/min [2025-10-23T23:17:16.260995] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:16.261168] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-23T23:17:16.261257] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-23T23:17:16.261361] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-23T23:17:16.261428] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-23T23:17:16.261486] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-23T23:17:16.261526] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-23T23:17:16.622234] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:16.799417] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-23T23:17:17.021055] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T23:17:17.599542] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-23T23:17:17.934544] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T23:17:18.399428] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-23T23:17:18.680406] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.67 seconds). [2025-10-23T23:17:18.692628] [INFO ] [REMOTE ] PL: Full fetch complete (77125 records). [2025-10-23T23:17:18.692861] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-23T23:17:19.167272] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-23T23:17:19.167693] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-23T23:17:19.169047] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-23T23:17:19.169138] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-23T23:17:19.170703] [DEBUG] [LOCAL ] PL: Trimmed 77125 records to 53602 (keeping 200 days of data) [2025-10-23T23:17:19.215110] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-23T23:17:19.400709] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T23:17:19.457084] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T23:17:19.554858] [DEBUG] [LOCAL ] PL: Primary data saved (53602 records). [2025-10-23T23:17:19.555040] [INFO ] [MAIN ] PL: Full history saved. [2025-10-23T23:17:19.555165] [INFO ] [MAIN ] Update Progress: 1693/2367 symbols completed. PL took 30.6s. Estimated remaining: 1h 26m 30s. Rate: 7.8 symbols/min [2025-10-23T23:17:19.727426] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:19.761457] [DEBUG] [LOCAL ] PLYM: Loaded 34435 existing records from primary storage. [2025-10-23T23:17:19.761797] [INFO ] [MAIN ] PLYM: Loaded 34435 existing records. [2025-10-23T23:17:19.947692] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:17:19.947962] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-23T23:17:19.948044] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-23T23:17:19.948262] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-23T23:17:19.948336] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-23T23:17:20.010284] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-23T23:17:20.299764] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:20.799413] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-23T23:17:21.072949] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T23:17:21.208792] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T23:17:21.599459] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-23T23:17:22.150288] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T23:17:22.399467] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-23T23:17:22.890718] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T23:17:23.121894] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T23:17:23.131213] [INFO ] [REMOTE ] PLD: Full fetch complete (77509 records). [2025-10-23T23:17:23.131432] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-23T23:17:23.204556] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-23T23:17:23.548945] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-23T23:17:23.549083] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-23T23:17:23.550451] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-23T23:17:23.550537] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-23T23:17:23.552319] [DEBUG] [LOCAL ] PLD: Trimmed 77509 records to 53803 (keeping 200 days of data) [2025-10-23T23:17:23.902452] [DEBUG] [LOCAL ] PLD: Primary data saved (53803 records). [2025-10-23T23:17:23.902667] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-23T23:17:23.902814] [INFO ] [MAIN ] Update Progress: 1694/2367 symbols completed. PLD took 33.0s. Estimated remaining: 1h 26m 20s. Rate: 7.8 symbols/min [2025-10-23T23:17:24.008546] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-23T23:17:24.089746] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:24.142624] [DEBUG] [LOCAL ] PM: Loaded 53674 existing records from primary storage. [2025-10-23T23:17:24.143049] [INFO ] [MAIN ] PM: Loaded 53674 existing records. [2025-10-23T23:17:24.314789] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:17:24.315001] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-23T23:17:24.315084] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-23T23:17:24.315322] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-10-23T23:17:24.315393] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-23T23:17:24.661981] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:24.799460] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-23T23:17:24.985528] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T23:17:25.026021] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T23:17:25.599483] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-23T23:17:25.646140] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:17:26.399457] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-23T23:17:27.199451] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-23T23:17:27.258925] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T23:17:27.795990] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-23T23:17:27.999421] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-23T23:17:28.800265] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-23T23:17:28.806414] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T23:17:29.371875] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T23:17:29.599446] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-23T23:17:30.399414] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-23T23:17:30.489681] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T23:17:30.885310] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T23:17:31.154691] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-23T23:17:31.199398] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-23T23:17:31.999448] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-23T23:17:32.295373] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T23:17:32.799440] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-23T23:17:33.599529] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-23T23:17:33.667721] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T23:17:34.035778] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-23T23:17:34.399519] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-23T23:17:34.867973] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T23:17:34.875979] [INFO ] [REMOTE ] PLNT: Full fetch complete (70600 records). [2025-10-23T23:17:34.876110] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-23T23:17:35.204604] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-23T23:17:35.257434] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-23T23:17:35.257539] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-23T23:17:35.258783] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-23T23:17:35.258862] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-23T23:17:35.262247] [DEBUG] [LOCAL ] PLNT: Trimmed 70600 records to 48347 (keeping 200 days of data) [2025-10-23T23:17:35.543042] [DEBUG] [LOCAL ] PLNT: Primary data saved (48347 records). [2025-10-23T23:17:35.543237] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-23T23:17:35.544725] [INFO ] [MAIN ] Update Progress: 1695/2367 symbols completed. PLNT took 33.1s. Estimated remaining: 1h 26m 14s. Rate: 7.8 symbols/min [2025-10-23T23:17:35.714013] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:35.736338] [DEBUG] [LOCAL ] PML: Loaded 21888 existing records from primary storage. [2025-10-23T23:17:35.736603] [INFO ] [MAIN ] PML: Loaded 21888 existing records. [2025-10-23T23:17:35.854486] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T23:17:35.937508] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:17:35.937708] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-23T23:17:35.937803] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-23T23:17:35.938031] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-23T23:17:35.938107] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-23T23:17:36.004536] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-23T23:17:36.295818] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:36.799409] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-23T23:17:37.050823] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T23:17:37.239785] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T23:17:37.599518] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-23T23:17:37.871711] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T23:17:38.399491] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-23T23:17:39.199407] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-23T23:17:39.437459] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T23:17:39.999434] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-23T23:17:40.678887] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T23:17:40.799406] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-23T23:17:41.599415] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-23T23:17:42.575441] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T23:17:42.579464] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-23T23:17:43.422820] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (5.82 seconds). [2025-10-23T23:17:43.434352] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-23T23:17:43.462414] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T23:17:43.935330] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (3.94 seconds). [2025-10-23T23:17:43.999451] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-23T23:17:44.799477] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-23T23:17:44.931389] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T23:17:44.934300] [INFO ] [REMOTE ] PLOW: Full fetch complete (28159 records). [2025-10-23T23:17:44.934395] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-23T23:17:45.327138] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-23T23:17:45.327246] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-23T23:17:45.327864] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-23T23:17:45.327941] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-23T23:17:45.328638] [DEBUG] [LOCAL ] PLOW: Trimmed 28159 records to 19740 (keeping 200 days of data) [2025-10-23T23:17:45.456964] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (4.66 seconds). [2025-10-23T23:17:45.478574] [DEBUG] [LOCAL ] PLOW: Primary data saved (19740 records). [2025-10-23T23:17:45.478745] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-23T23:17:45.478846] [INFO ] [MAIN ] Update Progress: 1696/2367 symbols completed. PLOW took 29.4s. Estimated remaining: 1h 26m 8s. Rate: 7.8 symbols/min [2025-10-23T23:17:45.604563] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-23T23:17:45.647900] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:45.659242] [DEBUG] [LOCAL ] PMM: Loaded 10032 existing records from primary storage. [2025-10-23T23:17:45.659486] [INFO ] [MAIN ] PMM: Loaded 10032 existing records. [2025-10-23T23:17:45.774731] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-23T23:17:45.855048] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:17:45.855241] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-23T23:17:45.855316] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-23T23:17:45.855497] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-23T23:17:45.855567] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-23T23:17:46.202716] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:46.399393] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-23T23:17:47.199423] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-23T23:17:47.456328] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T23:17:47.999415] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-23T23:17:48.851928] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (5.42 seconds). [2025-10-23T23:17:48.863500] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-23T23:17:49.670351] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (4.07 seconds). [2025-10-23T23:17:49.677199] [INFO ] [REMOTE ] PLYM: Full fetch complete (48041 records). [2025-10-23T23:17:49.677369] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-23T23:17:50.056690] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-23T23:17:50.056881] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-23T23:17:50.057831] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-23T23:17:50.057909] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-23T23:17:50.058949] [DEBUG] [LOCAL ] PLYM: Trimmed 48041 records to 34660 (keeping 200 days of data) [2025-10-23T23:17:50.173592] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-23T23:17:50.244553] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-23T23:17:50.300199] [DEBUG] [LOCAL ] PLYM: Primary data saved (34660 records). [2025-10-23T23:17:50.300427] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-23T23:17:50.300576] [INFO ] [MAIN ] Update Progress: 1697/2367 symbols completed. PLYM took 30.7s. Estimated remaining: 1h 25m 59s. Rate: 7.8 symbols/min [2025-10-23T23:17:50.469750] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:17:50.483627] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-23T23:17:50.489082] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-23T23:17:50.499761] [DEBUG] [LOCAL ] PMO: Loaded 9459 existing records from primary storage. [2025-10-23T23:17:50.500064] [INFO ] [MAIN ] PMO: Loaded 9459 existing records. [2025-10-23T23:17:50.674542] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:17:50.674785] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-23T23:17:50.674866] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-23T23:17:50.675060] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-23T23:17:50.675134] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-23T23:17:51.044319] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:17:51.199431] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-23T23:17:51.455959] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T23:17:51.478947] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T23:17:51.751241] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-10-23T23:17:51.999448] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-23T23:17:52.298313] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T23:17:52.799496] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-23T23:17:53.599500] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-23T23:17:53.645932] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:17:54.103594] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-23T23:17:54.399429] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-23T23:17:54.692592] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-23T23:17:54.933541] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-23T23:17:55.201018] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-23T23:17:55.999432] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-23T23:17:56.148688] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T23:17:56.799454] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-23T23:17:57.582437] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T23:17:57.599391] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-23T23:17:58.197849] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T23:17:58.399433] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-23T23:17:58.440610] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T23:17:59.199460] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-23T23:17:59.711037] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T23:17:59.999489] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-23T23:18:00.295128] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-23T23:18:00.799469] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-23T23:18:01.599473] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-23T23:18:01.688533] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T23:18:01.732810] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-23T23:18:02.399533] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-23T23:18:02.927469] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T23:18:03.092334] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T23:18:03.102738] [INFO ] [REMOTE ] PM: Full fetch complete (77834 records). [2025-10-23T23:18:03.102966] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-23T23:18:03.204693] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-23T23:18:03.514675] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-23T23:18:03.514806] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-23T23:18:03.515964] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-23T23:18:03.516046] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-23T23:18:03.517594] [DEBUG] [LOCAL ] PM: Trimmed 77834 records to 54064 (keeping 200 days of data) [2025-10-23T23:18:03.862409] [DEBUG] [LOCAL ] PM: Primary data saved (54064 records). [2025-10-23T23:18:03.862796] [INFO ] [MAIN ] PM: Full history saved. [2025-10-23T23:18:03.863007] [INFO ] [MAIN ] Update Progress: 1698/2367 symbols completed. PM took 40.0s. Estimated remaining: 1h 25m 53s. Rate: 7.8 symbols/min [2025-10-23T23:18:04.009103] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-23T23:18:04.036041] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:04.045735] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T23:18:04.085234] [DEBUG] [LOCAL ] PMT: Loaded 40705 existing records from primary storage. [2025-10-23T23:18:04.085554] [INFO ] [MAIN ] PMT: Loaded 40705 existing records. [2025-10-23T23:18:04.267215] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:04.267436] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-23T23:18:04.267512] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-23T23:18:04.267994] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-23T23:18:04.268073] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-23T23:18:04.617531] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:04.745924] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T23:18:04.799399] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-23T23:18:05.599433] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-23T23:18:05.620172] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:18:06.189927] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T23:18:06.399468] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-23T23:18:07.199438] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-23T23:18:07.234739] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T23:18:07.237147] [INFO ] [REMOTE ] PMM: Full fetch complete (17556 records). [2025-10-23T23:18:07.237240] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-23T23:18:07.603528] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-23T23:18:07.603709] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-23T23:18:07.604119] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-23T23:18:07.604193] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-23T23:18:07.604780] [DEBUG] [LOCAL ] PMM: Trimmed 17556 records to 10151 (keeping 200 days of data) [2025-10-23T23:18:07.663556] [DEBUG] [LOCAL ] PMM: Primary data saved (10151 records). [2025-10-23T23:18:07.663740] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-23T23:18:07.663870] [INFO ] [MAIN ] Update Progress: 1699/2367 symbols completed. PMM took 22.2s. Estimated remaining: 1h 25m 44s. Rate: 7.8 symbols/min [2025-10-23T23:18:07.840019] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:07.840205] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-23T23:18:07.840278] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-23T23:18:07.840393] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-23T23:18:07.840465] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-23T23:18:07.840549] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-23T23:18:07.840618] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-23T23:18:08.001879] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-23T23:18:08.212833] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:08.220408] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:18:08.225049] [INFO ] [REMOTE ] PML: Full fetch complete (29874 records). [2025-10-23T23:18:08.225151] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-23T23:18:08.588583] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-23T23:18:08.588742] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-23T23:18:08.589409] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-23T23:18:08.589485] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-23T23:18:08.590426] [DEBUG] [LOCAL ] PML: Trimmed 29874 records to 22040 (keeping 200 days of data) [2025-10-23T23:18:08.719201] [DEBUG] [LOCAL ] PML: Primary data saved (22040 records). [2025-10-23T23:18:08.719350] [INFO ] [MAIN ] PML: Full history saved. [2025-10-23T23:18:08.719461] [INFO ] [MAIN ] Update Progress: 1700/2367 symbols completed. PML took 33.2s. Estimated remaining: 1h 25m 34s. Rate: 7.8 symbols/min [2025-10-23T23:18:08.804545] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-23T23:18:08.891358] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:08.891551] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-23T23:18:08.891623] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-23T23:18:08.891763] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-23T23:18:08.891833] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-23T23:18:08.891918] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-23T23:18:08.891991] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-23T23:18:09.244624] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:09.553836] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T23:18:09.605091] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-23T23:18:09.629384] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:18:10.396291] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T23:18:10.399433] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-10-23T23:18:10.617918] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:18:10.618299] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-10-23T23:18:10.618390] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:18:10.618477] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-23T23:18:10.618548] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:18:10.618623] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-23T23:18:10.618772] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-23T23:18:10.618851] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-23T23:18:10.618944] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-23T23:18:10.619044] [INFO ] [MAIN ] Update Progress: 1701/2367 symbols completed. PMTV took 1.9s. Estimated remaining: 1h 25m 24s. Rate: 7.8 symbols/min [2025-10-23T23:18:10.799918] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:10.800144] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-23T23:18:10.800216] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-23T23:18:10.800338] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-23T23:18:10.800409] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-23T23:18:10.800494] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-23T23:18:10.800585] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-23T23:18:11.205268] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-23T23:18:11.207954] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:11.999419] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-10-23T23:18:12.009376] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T23:18:12.246582] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:18:12.246953] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-10-23T23:18:12.247057] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:18:12.247128] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-23T23:18:12.247194] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:18:12.247267] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-23T23:18:12.247356] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-23T23:18:12.247427] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-23T23:18:12.247505] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-23T23:18:12.247584] [INFO ] [MAIN ] Update Progress: 1702/2367 symbols completed. PMTW took 1.6s. Estimated remaining: 1h 25m 14s. Rate: 7.8 symbols/min [2025-10-23T23:18:12.432564] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:12.488375] [DEBUG] [LOCAL ] PNC: Loaded 52065 existing records from primary storage. [2025-10-23T23:18:12.488788] [INFO ] [MAIN ] PNC: Loaded 52065 existing records. [2025-10-23T23:18:12.670068] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:12.670336] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-23T23:18:12.670411] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-23T23:18:12.670712] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-10-23T23:18:12.670783] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-23T23:18:12.807776] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-23T23:18:13.028137] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:13.558304] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T23:18:13.560000] [INFO ] [REMOTE ] PMO: Full fetch complete (15915 records). [2025-10-23T23:18:13.560088] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-23T23:18:13.604726] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-23T23:18:13.920380] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-23T23:18:13.920512] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-23T23:18:13.921020] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-23T23:18:13.921114] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-23T23:18:13.921771] [DEBUG] [LOCAL ] PMO: Trimmed 15915 records to 9477 (keeping 200 days of data) [2025-10-23T23:18:13.977051] [DEBUG] [LOCAL ] PMO: Primary data saved (9477 records). [2025-10-23T23:18:13.977220] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-23T23:18:13.977363] [INFO ] [MAIN ] Update Progress: 1703/2367 symbols completed. PMO took 23.7s. Estimated remaining: 1h 25m 4s. Rate: 7.8 symbols/min [2025-10-23T23:18:14.142378] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:14.151406] [DEBUG] [LOCAL ] PNI: Loaded 6901 existing records from primary storage. [2025-10-23T23:18:14.151678] [INFO ] [MAIN ] PNI: Loaded 6901 existing records. [2025-10-23T23:18:14.323572] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:14.323817] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-23T23:18:14.323908] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-23T23:18:14.324146] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-23T23:18:14.324244] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-23T23:18:14.404563] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-23T23:18:14.673189] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:15.199441] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-23T23:18:15.484256] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T23:18:15.560409] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T23:18:15.591718] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-23T23:18:15.999467] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-23T23:18:16.430114] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T23:18:16.799450] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-23T23:18:17.203045] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-23T23:18:17.599509] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-23T23:18:18.026580] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-23T23:18:18.399468] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-23T23:18:19.199498] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-23T23:18:19.836318] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-23T23:18:19.927233] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T23:18:19.999447] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-23T23:18:20.350261] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T23:18:20.799461] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-23T23:18:21.599435] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-23T23:18:21.936149] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-23T23:18:22.399421] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-23T23:18:22.616001] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T23:18:23.199505] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-23T23:18:23.999460] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-23T23:18:24.042074] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T23:18:24.350461] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-23T23:18:24.799504] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-23T23:18:25.159305] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-23T23:18:25.485889] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T23:18:25.599457] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-23T23:18:26.080553] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T23:18:26.399489] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-23T23:18:27.199436] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-23T23:18:27.999403] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-23T23:18:28.165208] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T23:18:28.474867] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-23T23:18:28.799425] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-23T23:18:29.331274] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T23:18:29.599442] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-23T23:18:29.940634] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-23T23:18:30.399454] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-23T23:18:30.684284] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T23:18:31.199435] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-23T23:18:31.842979] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T23:18:31.867679] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T23:18:31.999438] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-23T23:18:32.799471] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-23T23:18:33.405358] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T23:18:33.599447] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-23T23:18:33.676518] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T23:18:34.212981] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T23:18:34.399448] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-23T23:18:35.199443] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-23T23:18:35.565567] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-23T23:18:36.008872] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-23T23:18:36.015166] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:18:36.373053] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-23T23:18:36.373853] [INFO ] [REMOTE ] PMTU: Full fetch complete (1181 records). [2025-10-23T23:18:36.373957] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-23T23:18:36.554512] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-23T23:18:36.554735] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:18:36.554805] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:18:36.554854] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-23T23:18:36.554963] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-23T23:18:36.555036] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-23T23:18:36.555092] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-23T23:18:36.555176] [INFO ] [MAIN ] Update Progress: 1704/2367 symbols completed. PMTU took 28.9s. Estimated remaining: 1h 25m 2s. Rate: 7.8 symbols/min [2025-10-23T23:18:36.720914] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:36.751666] [DEBUG] [LOCAL ] PNNT: Loaded 33331 existing records from primary storage. [2025-10-23T23:18:36.751967] [INFO ] [MAIN ] PNNT: Loaded 33331 existing records. [2025-10-23T23:18:36.804725] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-23T23:18:36.927420] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:36.927602] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-23T23:18:36.927694] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-23T23:18:36.928089] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-23T23:18:36.928163] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-23T23:18:37.276835] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:37.599420] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-23T23:18:38.331072] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T23:18:38.332052] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T23:18:38.399446] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-23T23:18:39.199450] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-23T23:18:39.220449] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:18:39.999454] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-23T23:18:40.799440] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-23T23:18:40.821866] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T23:18:41.382351] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T23:18:41.599452] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-23T23:18:42.399443] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-23T23:18:42.745440] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-23T23:18:43.092859] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T23:18:43.102557] [INFO ] [REMOTE ] PMT: Full fetch complete (58771 records). [2025-10-23T23:18:43.102771] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-23T23:18:43.204585] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-23T23:18:43.509734] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-23T23:18:43.512312] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-23T23:18:43.512900] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T23:18:43.513906] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-23T23:18:43.519583] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-23T23:18:43.521146] [DEBUG] [LOCAL ] PMT: Trimmed 58771 records to 41066 (keeping 200 days of data) [2025-10-23T23:18:43.763966] [DEBUG] [LOCAL ] PMT: Primary data saved (41066 records). [2025-10-23T23:18:43.764118] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-23T23:18:43.764230] [INFO ] [MAIN ] Update Progress: 1705/2367 symbols completed. PMT took 39.9s. Estimated remaining: 1h 24m 54s. Rate: 7.8 symbols/min [2025-10-23T23:18:43.933946] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:43.977125] [DEBUG] [LOCAL ] PNR: Loaded 47486 existing records from primary storage. [2025-10-23T23:18:43.977448] [INFO ] [MAIN ] PNR: Loaded 47486 existing records. [2025-10-23T23:18:44.008006] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-23T23:18:44.158465] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:44.158711] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-23T23:18:44.158789] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-23T23:18:44.159049] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-10-23T23:18:44.159136] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-23T23:18:44.513819] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:44.799410] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-23T23:18:44.982465] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T23:18:45.560310] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T23:18:45.599399] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-23T23:18:46.399421] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-23T23:18:46.622015] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-23T23:18:47.169720] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T23:18:47.199434] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-23T23:18:47.999426] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-23T23:18:48.149822] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:18:48.411068] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-23T23:18:48.652244] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T23:18:48.653723] [INFO ] [REMOTE ] PNI: Full fetch complete (9638 records). [2025-10-23T23:18:48.653812] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-23T23:18:48.804680] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-23T23:18:49.015542] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-23T23:18:49.015686] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-23T23:18:49.016008] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-23T23:18:49.016085] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-23T23:18:49.016529] [DEBUG] [LOCAL ] PNI: Trimmed 9638 records to 6914 (keeping 200 days of data) [2025-10-23T23:18:49.056800] [DEBUG] [LOCAL ] PNI: Primary data saved (6914 records). [2025-10-23T23:18:49.056949] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-23T23:18:49.057063] [INFO ] [MAIN ] Update Progress: 1706/2367 symbols completed. PNI took 35.1s. Estimated remaining: 1h 24m 45s. Rate: 7.8 symbols/min [2025-10-23T23:18:49.223564] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:49.266144] [DEBUG] [LOCAL ] PNW: Loaded 45501 existing records from primary storage. [2025-10-23T23:18:49.266472] [INFO ] [MAIN ] PNW: Loaded 45501 existing records. [2025-10-23T23:18:49.440563] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:49.440789] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-23T23:18:49.440863] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-23T23:18:49.441083] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-10-23T23:18:49.441154] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-23T23:18:49.610805] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-23T23:18:49.792213] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:50.164862] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T23:18:50.195277] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T23:18:50.204483] [INFO ] [REMOTE ] PNC: Full fetch complete (75773 records). [2025-10-23T23:18:50.204668] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-23T23:18:50.408292] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-23T23:18:50.592118] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-10-23T23:18:50.592245] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-10-23T23:18:50.593523] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-10-23T23:18:50.593666] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-10-23T23:18:50.595205] [DEBUG] [LOCAL ] PNC: Trimmed 75773 records to 52438 (keeping 200 days of data) [2025-10-23T23:18:50.952739] [DEBUG] [LOCAL ] PNC: Primary data saved (52438 records). [2025-10-23T23:18:50.952927] [INFO ] [MAIN ] PNC: Full history saved. [2025-10-23T23:18:50.954856] [INFO ] [MAIN ] Update Progress: 1707/2367 symbols completed. PNC took 38.7s. Estimated remaining: 1h 24m 35s. Rate: 7.8 symbols/min [2025-10-23T23:18:51.122394] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:18:51.166616] [DEBUG] [LOCAL ] POR: Loaded 46735 existing records from primary storage. [2025-10-23T23:18:51.167041] [INFO ] [MAIN ] POR: Loaded 46735 existing records. [2025-10-23T23:18:51.208607] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-23T23:18:51.372942] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:18:51.373158] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-23T23:18:51.373251] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-23T23:18:51.373693] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-23T23:18:51.373768] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-23T23:18:51.810373] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:18:51.971397] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T23:18:51.999410] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-23T23:18:52.799471] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-23T23:18:52.928973] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T23:18:53.228483] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T23:18:53.599458] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-23T23:18:54.215149] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T23:18:54.399502] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-23T23:18:55.100975] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T23:18:55.199457] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-23T23:18:55.918725] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:18:55.999406] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-23T23:18:56.516417] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T23:18:56.799421] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-23T23:18:57.441081] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T23:18:57.599445] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-23T23:18:58.399439] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-23T23:18:58.591017] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T23:18:59.127109] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T23:18:59.199436] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-23T23:19:00.004169] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-23T23:19:00.018204] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T23:19:00.807052] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-23T23:19:00.811466] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:19:01.577941] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T23:19:01.599402] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-23T23:19:02.399469] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-23T23:19:02.468911] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T23:19:03.199413] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-23T23:19:03.404096] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T23:19:03.840866] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-23T23:19:03.847242] [INFO ] [REMOTE ] PNNT: Full fetch complete (47846 records). [2025-10-23T23:19:03.847373] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-23T23:19:04.001128] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-23T23:19:04.227348] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-23T23:19:04.227457] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-23T23:19:04.228367] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-23T23:19:04.228446] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-23T23:19:04.229443] [DEBUG] [LOCAL ] PNNT: Trimmed 47846 records to 33582 (keeping 200 days of data) [2025-10-23T23:19:04.424824] [DEBUG] [LOCAL ] PNNT: Primary data saved (33582 records). [2025-10-23T23:19:04.424971] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-23T23:19:04.425087] [INFO ] [MAIN ] Update Progress: 1708/2367 symbols completed. PNNT took 27.9s. Estimated remaining: 1h 24m 30s. Rate: 7.8 symbols/min [2025-10-23T23:19:04.601088] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:04.636107] [DEBUG] [LOCAL ] POST: Loaded 38443 existing records from primary storage. [2025-10-23T23:19:04.636433] [INFO ] [MAIN ] POST: Loaded 38443 existing records. [2025-10-23T23:19:04.815173] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:04.815461] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-23T23:19:04.815567] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-23T23:19:04.810402] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-23T23:19:04.816397] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-23T23:19:04.816477] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-23T23:19:04.946059] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T23:19:05.213570] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:05.599461] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-23T23:19:05.820020] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T23:19:05.989410] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-23T23:19:06.399450] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-23T23:19:07.199410] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-23T23:19:07.363283] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-23T23:19:07.746409] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T23:19:07.999432] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-23T23:19:08.745360] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T23:19:08.799406] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-23T23:19:09.455743] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T23:19:09.599425] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-23T23:19:10.017563] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T23:19:10.399433] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-23T23:19:11.199414] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-23T23:19:11.469736] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-23T23:19:11.999402] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-23T23:19:12.282952] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T23:19:12.799415] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-23T23:19:13.052394] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T23:19:13.599421] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-23T23:19:13.624424] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T23:19:14.399449] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-23T23:19:15.201912] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-23T23:19:15.205497] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T23:19:15.243240] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T23:19:15.999447] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-23T23:19:16.805560] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-23T23:19:16.807638] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T23:19:16.815985] [INFO ] [REMOTE ] PNW: Full fetch complete (66045 records). [2025-10-23T23:19:16.816221] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-23T23:19:17.076410] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T23:19:17.245494] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-23T23:19:17.245608] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-23T23:19:17.246823] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-23T23:19:17.246904] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-23T23:19:17.248294] [DEBUG] [LOCAL ] PNW: Trimmed 66045 records to 45849 (keeping 200 days of data) [2025-10-23T23:19:17.542674] [DEBUG] [LOCAL ] PNW: Primary data saved (45849 records). [2025-10-23T23:19:17.542880] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-23T23:19:17.543026] [INFO ] [MAIN ] Update Progress: 1709/2367 symbols completed. PNW took 28.5s. Estimated remaining: 1h 24m 24s. Rate: 7.8 symbols/min [2025-10-23T23:19:17.602211] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-23T23:19:17.691082] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T23:19:17.787369] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:17.853534] [DEBUG] [LOCAL ] PPG: Loaded 50502 existing records from primary storage. [2025-10-23T23:19:17.854017] [INFO ] [MAIN ] PPG: Loaded 50502 existing records. [2025-10-23T23:19:18.098589] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:18.098929] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-23T23:19:18.099021] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-23T23:19:18.099301] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-10-23T23:19:18.099391] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-23T23:19:18.407227] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-23T23:19:18.566291] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:19.129884] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T23:19:19.138210] [INFO ] [REMOTE ] PNR: Full fetch complete (69785 records). [2025-10-23T23:19:19.138350] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-23T23:19:19.203092] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-23T23:19:19.567605] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-10-23T23:19:19.568441] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-10-23T23:19:19.569609] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T23:19:19.570994] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-10-23T23:19:19.578438] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-10-23T23:19:19.580441] [DEBUG] [LOCAL ] PNR: Trimmed 69785 records to 47863 (keeping 200 days of data) [2025-10-23T23:19:19.871397] [DEBUG] [LOCAL ] PNR: Primary data saved (47863 records). [2025-10-23T23:19:19.871557] [INFO ] [MAIN ] PNR: Full history saved. [2025-10-23T23:19:19.871696] [INFO ] [MAIN ] Update Progress: 1710/2367 symbols completed. PNR took 36.1s. Estimated remaining: 1h 24m 15s. Rate: 7.8 symbols/min [2025-10-23T23:19:20.004775] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-23T23:19:20.057962] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:20.114298] [DEBUG] [LOCAL ] PPL: Loaded 53505 existing records from primary storage. [2025-10-23T23:19:20.114729] [INFO ] [MAIN ] PPL: Loaded 53505 existing records. [2025-10-23T23:19:20.300029] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:20.300249] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-23T23:19:20.300322] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-23T23:19:20.300981] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-10-23T23:19:20.301056] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-23T23:19:20.609282] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (7.81 seconds). [2025-10-23T23:19:20.697900] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:20.799454] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-23T23:19:21.078899] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T23:19:21.385670] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T23:19:21.599417] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-23T23:19:22.339499] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T23:19:22.399401] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-23T23:19:23.160973] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T23:19:23.199406] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-23T23:19:23.999475] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-23T23:19:24.158444] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T23:19:24.309514] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T23:19:24.799479] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-23T23:19:25.599416] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-23T23:19:25.820347] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T23:19:26.399423] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-23T23:19:26.458875] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T23:19:27.179081] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T23:19:27.199394] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-23T23:19:27.958409] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T23:19:27.966389] [INFO ] [REMOTE ] POR: Full fetch complete (68300 records). [2025-10-23T23:19:27.966537] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-23T23:19:28.009157] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-23T23:19:28.350322] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-23T23:19:28.350430] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-23T23:19:28.351490] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-23T23:19:28.351568] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-23T23:19:28.352928] [DEBUG] [LOCAL ] POR: Trimmed 68300 records to 47087 (keeping 200 days of data) [2025-10-23T23:19:28.631031] [DEBUG] [LOCAL ] POR: Primary data saved (47087 records). [2025-10-23T23:19:28.631178] [INFO ] [MAIN ] POR: Full history saved. [2025-10-23T23:19:28.632716] [INFO ] [MAIN ] Update Progress: 1711/2367 symbols completed. POR took 37.7s. Estimated remaining: 1h 24m 7s. Rate: 7.8 symbols/min [2025-10-23T23:19:28.819710] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-23T23:19:28.822582] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:28.841734] [DEBUG] [LOCAL ] PPT: Loaded 19701 existing records from primary storage. [2025-10-23T23:19:28.841988] [INFO ] [MAIN ] PPT: Loaded 19701 existing records. [2025-10-23T23:19:29.022835] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:29.023125] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-23T23:19:29.023201] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-23T23:19:29.023521] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-23T23:19:29.023594] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-23T23:19:29.395043] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-23T23:19:29.421568] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:29.459995] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T23:19:29.466154] [INFO ] [REMOTE ] POST: Full fetch complete (55566 records). [2025-10-23T23:19:29.466262] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-23T23:19:29.604593] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-23T23:19:29.841561] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-23T23:19:29.841692] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-23T23:19:29.842613] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-23T23:19:29.842706] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-23T23:19:29.843761] [DEBUG] [LOCAL ] POST: Trimmed 55566 records to 38731 (keeping 200 days of data) [2025-10-23T23:19:30.071420] [DEBUG] [LOCAL ] POST: Primary data saved (38731 records). [2025-10-23T23:19:30.071588] [INFO ] [MAIN ] POST: Full history saved. [2025-10-23T23:19:30.071727] [INFO ] [MAIN ] Update Progress: 1712/2367 symbols completed. POST took 25.6s. Estimated remaining: 1h 23m 57s. Rate: 7.8 symbols/min [2025-10-23T23:19:30.239743] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:30.289591] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-23T23:19:30.289940] [INFO ] [MAIN ] PR: Loaded 53611 existing records. [2025-10-23T23:19:30.402064] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-23T23:19:30.469833] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:30.470334] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-23T23:19:30.470532] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-23T23:19:30.470943] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-23T23:19:30.471018] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-23T23:19:30.812261] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-23T23:19:30.860271] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:31.199474] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-23T23:19:31.440459] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T23:19:31.492789] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T23:19:31.999462] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-23T23:19:32.799444] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-23T23:19:32.928628] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T23:19:33.076850] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T23:19:33.599452] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-23T23:19:34.399465] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-23T23:19:34.670421] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T23:19:35.199407] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-23T23:19:35.380775] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T23:19:35.553255] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-23T23:19:35.999441] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-23T23:19:36.799450] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-23T23:19:37.031494] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T23:19:37.448062] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T23:19:37.599412] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-23T23:19:38.399484] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-23T23:19:38.601501] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T23:19:39.199480] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-23T23:19:39.276194] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-23T23:19:39.340942] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:19:39.999495] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-23T23:19:40.799434] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-23T23:19:40.934700] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:19:41.599413] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-23T23:19:41.970927] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-23T23:19:42.304116] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T23:19:42.399415] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-23T23:19:43.199431] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-23T23:19:43.999464] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-23T23:19:44.109735] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T23:19:44.173814] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-23T23:19:44.804471] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-23T23:19:44.809800] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:19:44.837099] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T23:19:45.599435] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-23T23:19:46.399451] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-23T23:19:46.603511] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T23:19:46.741219] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T23:19:47.199427] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-23T23:19:47.934189] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-23T23:19:47.943758] [INFO ] [REMOTE ] PPL: Full fetch complete (77629 records). [2025-10-23T23:19:47.943909] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-23T23:19:48.006074] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-23T23:19:48.337627] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-10-23T23:19:48.353526] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-10-23T23:19:48.365129] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-10-23T23:19:48.365850] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-10-23T23:19:48.366944] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-23T23:19:48.379045] [DEBUG] [LOCAL ] PPL: Trimmed 77629 records to 53894 (keeping 200 days of data) [2025-10-23T23:19:48.695682] [DEBUG] [LOCAL ] PPL: Primary data saved (53894 records). [2025-10-23T23:19:48.695846] [INFO ] [MAIN ] PPL: Full history saved. [2025-10-23T23:19:48.695958] [INFO ] [MAIN ] Update Progress: 1713/2367 symbols completed. PPL took 28.8s. Estimated remaining: 1h 23m 54s. Rate: 7.8 symbols/min [2025-10-23T23:19:48.804550] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-23T23:19:48.864189] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:48.895474] [DEBUG] [LOCAL ] PRA: Loaded 34389 existing records from primary storage. [2025-10-23T23:19:48.895839] [INFO ] [MAIN ] PRA: Loaded 34389 existing records. [2025-10-23T23:19:49.068978] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:49.069188] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-23T23:19:49.069281] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-23T23:19:49.069572] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-23T23:19:49.069680] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-23T23:19:49.432042] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:49.599410] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-23T23:19:49.963269] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T23:19:50.399425] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-23T23:19:50.630514] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T23:19:50.666107] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-23T23:19:51.199409] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-23T23:19:51.999150] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T23:19:52.009025] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-23T23:19:52.630916] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-23T23:19:52.799424] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-23T23:19:52.982158] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T23:19:53.464851] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T23:19:53.474795] [INFO ] [REMOTE ] PPG: Full fetch complete (73922 records). [2025-10-23T23:19:53.475037] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-23T23:19:53.604563] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-23T23:19:53.897150] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-23T23:19:53.897270] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-23T23:19:53.898528] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-23T23:19:53.898615] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-23T23:19:53.900126] [DEBUG] [LOCAL ] PPG: Trimmed 73922 records to 50853 (keeping 200 days of data) [2025-10-23T23:19:54.206722] [DEBUG] [LOCAL ] PPG: Primary data saved (50853 records). [2025-10-23T23:19:54.206889] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-23T23:19:54.207002] [INFO ] [MAIN ] Update Progress: 1714/2367 symbols completed. PPG took 36.7s. Estimated remaining: 1h 23m 45s. Rate: 7.8 symbols/min [2025-10-23T23:19:54.371422] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:54.376238] [DEBUG] [LOCAL ] PRCS: Loaded 2782 existing records from primary storage. [2025-10-23T23:19:54.376410] [INFO ] [MAIN ] PRCS: Loaded 2782 existing records. [2025-10-23T23:19:54.406377] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-23T23:19:54.554050] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:54.554274] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-23T23:19:54.554432] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-23T23:19:54.554597] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-23T23:19:54.554695] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-23T23:19:54.685949] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:19:54.918486] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:55.199454] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-23T23:19:55.999479] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-23T23:19:56.300473] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-23T23:19:56.298552] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-23T23:19:56.799423] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-23T23:19:56.924725] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-23T23:19:56.927670] [INFO ] [REMOTE ] PPT: Full fetch complete (28460 records). [2025-10-23T23:19:56.927788] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-23T23:19:57.282353] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-23T23:19:57.282462] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-23T23:19:57.283108] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-23T23:19:57.283186] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-23T23:19:57.283934] [DEBUG] [LOCAL ] PPT: Trimmed 28460 records to 19765 (keeping 200 days of data) [2025-10-23T23:19:57.394034] [DEBUG] [LOCAL ] PPT: Primary data saved (19765 records). [2025-10-23T23:19:57.394202] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-23T23:19:57.394315] [INFO ] [MAIN ] Update Progress: 1715/2367 symbols completed. PPT took 28.8s. Estimated remaining: 1h 23m 36s. Rate: 7.8 symbols/min [2025-10-23T23:19:57.561627] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:57.591854] [DEBUG] [LOCAL ] PRG: Loaded 29701 existing records from primary storage. [2025-10-23T23:19:57.592249] [INFO ] [MAIN ] PRG: Loaded 29701 existing records. [2025-10-23T23:19:57.604737] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-23T23:19:57.766324] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:57.766548] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-23T23:19:57.766622] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-23T23:19:57.766959] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-23T23:19:57.767032] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-23T23:19:58.107414] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:19:58.130423] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T23:19:58.399410] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-23T23:19:58.721964] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-23T23:19:58.731594] [INFO ] [REMOTE ] PR: Full fetch complete (77763 records). [2025-10-23T23:19:58.731796] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-23T23:19:59.151532] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T23:19:59.155305] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-23T23:19:59.159435] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-23T23:19:59.160601] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-23T23:19:59.161032] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-23T23:19:59.162360] [DEBUG] [LOCAL ] PR: Trimmed 77763 records to 54001 (keeping 200 days of data) [2025-10-23T23:19:59.214047] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-23T23:19:59.487809] [DEBUG] [LOCAL ] PR: Primary data saved (54001 records). [2025-10-23T23:19:59.487993] [INFO ] [MAIN ] PR: Full history saved. [2025-10-23T23:19:59.488106] [INFO ] [MAIN ] Update Progress: 1716/2367 symbols completed. PR took 29.4s. Estimated remaining: 1h 23m 26s. Rate: 7.8 symbols/min [2025-10-23T23:19:59.652909] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:19:59.693171] [DEBUG] [LOCAL ] PRGO: Loaded 47131 existing records from primary storage. [2025-10-23T23:19:59.693493] [INFO ] [MAIN ] PRGO: Loaded 47131 existing records. [2025-10-23T23:19:59.864889] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:19:59.865110] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-23T23:19:59.865183] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-23T23:19:59.865697] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-10-23T23:19:59.865770] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-23T23:20:00.005704] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-23T23:20:00.244114] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:20:00.669153] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T23:20:00.799407] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-23T23:20:01.330177] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T23:20:01.599439] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-23T23:20:02.096590] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-23T23:20:02.399424] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-23T23:20:02.506420] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T23:20:02.791658] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-23T23:20:03.199518] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-23T23:20:03.999450] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-23T23:20:04.799417] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-23T23:20:04.865425] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T23:20:05.354301] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-23T23:20:05.402969] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T23:20:05.599448] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-23T23:20:06.399457] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-23T23:20:06.927307] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-23T23:20:07.164887] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:20:07.199429] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-23T23:20:07.738087] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T23:20:07.999424] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-23T23:20:08.799497] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-23T23:20:09.599469] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-23T23:20:09.754339] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T23:20:10.227146] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T23:20:10.399517] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-23T23:20:11.150748] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T23:20:11.182803] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T23:20:11.199408] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-23T23:20:11.999464] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-23T23:20:12.473735] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-23T23:20:12.506579] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T23:20:12.799475] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-23T23:20:13.599416] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-23T23:20:14.073472] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T23:20:14.399455] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-23T23:20:14.924626] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-23T23:20:15.199431] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-23T23:20:15.333966] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T23:20:15.999434] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-23T23:20:16.302926] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T23:20:16.799409] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-23T23:20:17.277797] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-23T23:20:17.278956] [INFO ] [REMOTE ] PRCS: Full fetch complete (3901 records). [2025-10-23T23:20:17.279045] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-23T23:20:17.604874] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-23T23:20:17.646988] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-23T23:20:17.647266] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-23T23:20:17.647601] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-23T23:20:17.647904] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-23T23:20:17.648299] [DEBUG] [LOCAL ] PRCS: Trimmed 3901 records to 2802 (keeping 200 days of data) [2025-10-23T23:20:17.665284] [DEBUG] [LOCAL ] PRCS: Primary data saved (2802 records). [2025-10-23T23:20:17.665574] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-23T23:20:17.665788] [INFO ] [MAIN ] Update Progress: 1717/2367 symbols completed. PRCS took 23.5s. Estimated remaining: 1h 23m 22s. Rate: 7.8 symbols/min [2025-10-23T23:20:17.699440] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:20:18.399445] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-23T23:20:19.007775] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T23:20:19.199430] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-23T23:20:19.945876] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T23:20:19.999432] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-23T23:20:20.482759] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-23T23:20:20.799489] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-23T23:20:21.599516] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-23T23:20:21.741325] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:20:22.107880] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-23T23:20:22.399421] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-23T23:20:22.449208] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T23:20:23.199482] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-23T23:20:23.756704] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T23:20:23.999437] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-23T23:20:24.503268] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T23:20:24.509280] [INFO ] [REMOTE ] PRG: Full fetch complete (44577 records). [2025-10-23T23:20:24.509419] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-23T23:20:24.804694] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-23T23:20:24.886354] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-23T23:20:24.886470] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-23T23:20:24.887386] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-23T23:20:24.887464] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-23T23:20:24.888401] [DEBUG] [LOCAL ] PRG: Trimmed 44577 records to 29965 (keeping 200 days of data) [2025-10-23T23:20:25.063553] [DEBUG] [LOCAL ] PRG: Primary data saved (29965 records). [2025-10-23T23:20:25.063733] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-23T23:20:25.063847] [INFO ] [MAIN ] Update Progress: 1718/2367 symbols completed. PRG took 27.7s. Estimated remaining: 1h 23m 14s. Rate: 7.8 symbols/min [2025-10-23T23:20:25.654094] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T23:20:25.664199] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-23T23:20:26.046440] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T23:20:26.399434] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-23T23:20:27.454494] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T23:20:27.464958] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-23T23:20:27.741104] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T23:20:27.747000] [INFO ] [REMOTE ] PRA: Full fetch complete (45314 records). [2025-10-23T23:20:27.747122] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-23T23:20:28.131665] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-23T23:20:28.131821] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-23T23:20:28.132824] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-23T23:20:28.132905] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-23T23:20:28.134010] [DEBUG] [LOCAL ] PRA: Trimmed 45314 records to 34625 (keeping 200 days of data) [2025-10-23T23:20:28.349149] [DEBUG] [LOCAL ] PRA: Primary data saved (34625 records). [2025-10-23T23:20:28.349338] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-23T23:20:28.349467] [INFO ] [MAIN ] Update Progress: 1719/2367 symbols completed. PRA took 39.7s. Estimated remaining: 1h 23m 5s. Rate: 7.8 symbols/min [2025-10-23T23:20:29.079015] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:20:29.089614] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-23T23:20:30.771155] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T23:20:30.779967] [INFO ] [REMOTE ] PRGO: Full fetch complete (68897 records). [2025-10-23T23:20:30.780114] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-23T23:20:31.177099] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-23T23:20:31.177227] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-23T23:20:31.178458] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-23T23:20:31.178542] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-23T23:20:31.180067] [DEBUG] [LOCAL ] PRGO: Trimmed 68897 records to 47472 (keeping 200 days of data) [2025-10-23T23:20:31.459404] [DEBUG] [LOCAL ] PRGO: Primary data saved (47472 records). [2025-10-23T23:20:31.459563] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-23T23:20:31.459696] [INFO ] [MAIN ] Update Progress: 1720/2367 symbols completed. PRGO took 32.0s. Estimated remaining: 1h 22m 56s. Rate: 7.8 symbols/min [2025-10-23T23:20:32.006166] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:20:32.175560] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:20:32.179952] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:20:32.209690] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:20:32.214274] [DEBUG] [LOCAL ] PRH: Loaded 4687 existing records from primary storage. [2025-10-23T23:20:32.214971] [INFO ] [MAIN ] PRH: Loaded 4687 existing records. [2025-10-23T23:20:32.372244] [DEBUG] [LOCAL ] PRI: Loaded 17709 existing records from primary storage. [2025-10-23T23:20:32.406854] [INFO ] [MAIN ] PRI: Loaded 17709 existing records. [2025-10-23T23:20:32.486087] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:20:32.550474] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-23T23:20:32.576259] [DEBUG] [LOCAL ] PRKS: Loaded 42224 existing records from primary storage. [2025-10-23T23:20:32.609486] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-23T23:20:32.641973] [INFO ] [MAIN ] PRKS: Loaded 42224 existing records. [2025-10-23T23:20:32.670327] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:20:32.671332] [DEBUG] [LOCAL ] PRIM: Loaded 44097 existing records from primary storage. [2025-10-23T23:20:32.671377] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-23T23:20:32.671773] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-23T23:20:32.677121] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-23T23:20:32.677270] [INFO ] [MAIN ] PRIM: Loaded 44097 existing records. [2025-10-23T23:20:32.677427] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-23T23:20:32.861507] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-23T23:20:32.915629] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-23T23:20:33.294370] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:20:33.377803] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-23T23:20:33.374031] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:20:33.419792] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-23T23:20:33.414384] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-23T23:20:33.446376] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-23T23:20:33.435941] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-23T23:20:33.462181] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-23T23:20:33.492263] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-23T23:20:33.546527] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-23T23:20:33.790526] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:20:33.892480] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-23T23:20:34.358011] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:20:34.422629] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-23T23:20:34.594224] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:20:34.611366] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-23T23:20:34.636590] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:20:34.638403] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-23T23:20:34.639154] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T23:20:34.642250] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-23T23:20:35.363963] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T23:20:35.366161] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-23T23:20:35.698842] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T23:20:35.702916] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-23T23:20:35.992988] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T23:20:35.995189] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-23T23:20:36.022492] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T23:20:36.034540] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-23T23:20:36.277935] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T23:20:36.285983] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-23T23:20:36.757024] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T23:20:36.756543] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-23T23:20:36.799397] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-23T23:20:37.272537] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T23:20:37.540369] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T23:20:37.599397] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-23T23:20:37.632574] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:20:38.399417] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-23T23:20:39.199446] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-23T23:20:39.330440] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T23:20:39.443187] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T23:20:39.790978] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T23:20:39.999432] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-23T23:20:40.564994] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-23T23:20:40.799429] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-23T23:20:41.599452] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-23T23:20:42.006988] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T23:20:42.399434] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-23T23:20:43.183821] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T23:20:43.199414] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-23T23:20:43.492818] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T23:20:43.871040] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T23:20:43.999426] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-23T23:20:44.799446] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-23T23:20:45.268611] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T23:20:45.579336] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T23:20:45.599406] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-23T23:20:46.399468] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-23T23:20:47.199444] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-23T23:20:47.404509] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T23:20:47.451509] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T23:20:47.999483] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-23T23:20:48.531505] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T23:20:48.799433] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-23T23:20:49.558943] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T23:20:49.599400] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-23T23:20:50.299211] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-23T23:20:50.399405] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-23T23:20:51.199494] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-23T23:20:51.241901] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T23:20:51.772189] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T23:20:51.773553] [INFO ] [REMOTE ] PRH: Full fetch complete (7443 records). [2025-10-23T23:20:51.773710] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-23T23:20:51.984244] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:20:52.004505] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-23T23:20:52.188718] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-23T23:20:52.188830] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-23T23:20:52.189056] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-23T23:20:52.189130] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-23T23:20:52.189569] [DEBUG] [LOCAL ] PRH: Trimmed 7443 records to 4702 (keeping 200 days of data) [2025-10-23T23:20:52.216982] [DEBUG] [LOCAL ] PRH: Primary data saved (4702 records). [2025-10-23T23:20:52.217112] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-23T23:20:52.217222] [INFO ] [MAIN ] Update Progress: 1721/2367 symbols completed. PRH took 20.8s. Estimated remaining: 1h 22m 53s. Rate: 7.8 symbols/min [2025-10-23T23:20:52.391128] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:20:52.410743] [DEBUG] [LOCAL ] PRLB: Loaded 20243 existing records from primary storage. [2025-10-23T23:20:52.411025] [INFO ] [MAIN ] PRLB: Loaded 20243 existing records. [2025-10-23T23:20:52.585937] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:20:52.586168] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-23T23:20:52.586245] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-23T23:20:52.586474] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-23T23:20:52.586550] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-23T23:20:52.804691] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-23T23:20:52.950803] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:20:53.147511] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T23:20:53.599435] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-23T23:20:54.339547] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T23:20:54.399480] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-23T23:20:54.614867] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T23:20:55.199420] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-23T23:20:55.505835] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T23:20:55.999502] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-23T23:20:56.683079] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T23:20:56.799438] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-23T23:20:57.124856] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T23:20:57.599474] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-23T23:20:58.335478] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T23:20:58.399481] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-23T23:20:58.944372] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-23T23:20:59.199405] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-23T23:20:59.443244] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T23:20:59.999436] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-23T23:21:00.659772] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:21:00.667282] [INFO ] [REMOTE ] PRKS: Full fetch complete (61536 records). [2025-10-23T23:21:00.667475] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-23T23:21:00.805894] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-23T23:21:01.053497] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-23T23:21:01.053613] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-23T23:21:01.054699] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-23T23:21:01.054779] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-23T23:21:01.056051] [DEBUG] [LOCAL ] PRKS: Trimmed 61536 records to 42500 (keeping 200 days of data) [2025-10-23T23:21:01.300940] [DEBUG] [LOCAL ] PRKS: Primary data saved (42500 records). [2025-10-23T23:21:01.301167] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-23T23:21:01.301576] [INFO ] [MAIN ] Update Progress: 1722/2367 symbols completed. PRKS took 29.8s. Estimated remaining: 1h 22m 46s. Rate: 7.8 symbols/min [2025-10-23T23:21:01.496516] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:01.493392] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T23:21:01.543044] [DEBUG] [LOCAL ] PRM: Loaded 44368 existing records from primary storage. [2025-10-23T23:21:01.543379] [INFO ] [MAIN ] PRM: Loaded 44368 existing records. [2025-10-23T23:21:01.605210] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-23T23:21:01.729620] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T23:21:01.761551] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:01.764613] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-23T23:21:01.765014] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-23T23:21:01.765375] [INFO ] [REMOTE ] PRI: Full fetch complete (25600 records). [2025-10-23T23:21:01.765420] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-23T23:21:01.765674] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-23T23:21:01.765580] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-23T23:21:02.453848] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:02.406954] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-23T23:21:02.542371] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-23T23:21:02.542485] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-23T23:21:02.543051] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-23T23:21:02.543129] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-23T23:21:02.543887] [DEBUG] [LOCAL ] PRI: Trimmed 25600 records to 17835 (keeping 200 days of data) [2025-10-23T23:21:02.650206] [DEBUG] [LOCAL ] PRI: Primary data saved (17835 records). [2025-10-23T23:21:02.650358] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-23T23:21:02.650469] [INFO ] [MAIN ] Update Progress: 1723/2367 symbols completed. PRI took 31.2s. Estimated remaining: 1h 22m 36s. Rate: 7.8 symbols/min [2025-10-23T23:21:02.821463] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:02.874032] [DEBUG] [LOCAL ] PRMB: Loaded 53101 existing records from primary storage. [2025-10-23T23:21:02.874418] [INFO ] [MAIN ] PRMB: Loaded 53101 existing records. [2025-10-23T23:21:03.062047] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:03.062274] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-23T23:21:03.062398] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-23T23:21:03.062686] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-23T23:21:03.062762] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-23T23:21:03.201436] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-23T23:21:03.519535] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T23:21:03.617340] [INFO ] [REMOTE ] PRIM: Full fetch complete (63865 records). [2025-10-23T23:21:03.658070] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-23T23:21:03.662873] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:03.748143] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T23:21:04.008964] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-23T23:21:04.193430] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-23T23:21:04.193547] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-23T23:21:04.194624] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-23T23:21:04.194730] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-23T23:21:04.196049] [DEBUG] [LOCAL ] PRIM: Trimmed 63865 records to 44369 (keeping 200 days of data) [2025-10-23T23:21:04.477290] [DEBUG] [LOCAL ] PRIM: Primary data saved (44369 records). [2025-10-23T23:21:04.477553] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-23T23:21:04.477872] [INFO ] [MAIN ] Update Progress: 1724/2367 symbols completed. PRIM took 33.0s. Estimated remaining: 1h 22m 26s. Rate: 7.8 symbols/min [2025-10-23T23:21:04.659222] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:04.697690] [DEBUG] [LOCAL ] PRO: Loaded 40143 existing records from primary storage. [2025-10-23T23:21:04.698087] [INFO ] [MAIN ] PRO: Loaded 40143 existing records. [2025-10-23T23:21:04.800941] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-23T23:21:04.883772] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:04.884298] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-23T23:21:04.884576] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-23T23:21:04.903415] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-23T23:21:04.916245] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-23T23:21:04.988710] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T23:21:05.299864] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:05.318382] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T23:21:05.599432] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-23T23:21:06.399396] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-23T23:21:06.604578] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T23:21:06.869595] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T23:21:07.199485] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-23T23:21:07.879817] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T23:21:07.999422] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-23T23:21:08.255556] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T23:21:08.799478] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-23T23:21:09.327198] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T23:21:09.599508] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-23T23:21:09.923375] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T23:21:10.399461] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-23T23:21:11.188687] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T23:21:11.199401] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-23T23:21:11.999536] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-23T23:21:12.083047] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T23:21:12.799425] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-23T23:21:12.867231] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:21:13.276400] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T23:21:13.599456] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-23T23:21:14.399403] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-23T23:21:14.809925] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T23:21:14.870904] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T23:21:15.199447] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-23T23:21:15.886884] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T23:21:15.999446] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-23T23:21:16.277432] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T23:21:16.799464] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-23T23:21:17.133986] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:21:17.599425] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-23T23:21:18.156614] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T23:21:18.399459] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-23T23:21:19.199457] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-23T23:21:19.370038] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T23:21:19.527774] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T23:21:19.999486] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-23T23:21:20.695251] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T23:21:20.799411] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-23T23:21:21.599423] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-23T23:21:21.915132] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-23T23:21:22.408349] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-23T23:21:22.413502] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T23:21:23.119095] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T23:21:23.199442] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-23T23:21:23.999503] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-23T23:21:24.040829] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T23:21:24.778754] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T23:21:24.799405] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-23T23:21:25.013842] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T23:21:25.599461] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-23T23:21:26.242800] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T23:21:26.260908] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T23:21:26.264584] [INFO ] [REMOTE ] PRLB: Full fetch complete (30519 records). [2025-10-23T23:21:26.264722] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-23T23:21:26.405123] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-23T23:21:26.658496] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-23T23:21:26.658598] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-23T23:21:26.659385] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-23T23:21:26.659464] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-23T23:21:26.660408] [DEBUG] [LOCAL ] PRLB: Trimmed 30519 records to 20478 (keeping 200 days of data) [2025-10-23T23:21:26.779225] [DEBUG] [LOCAL ] PRLB: Primary data saved (20478 records). [2025-10-23T23:21:26.779378] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-23T23:21:26.779488] [INFO ] [MAIN ] Update Progress: 1725/2367 symbols completed. PRLB took 34.6s. Estimated remaining: 1h 22m 23s. Rate: 7.8 symbols/min [2025-10-23T23:21:26.950247] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:26.972370] [DEBUG] [LOCAL ] PRSU: Loaded 23124 existing records from primary storage. [2025-10-23T23:21:26.972678] [INFO ] [MAIN ] PRSU: Loaded 23124 existing records. [2025-10-23T23:21:27.147838] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:27.148073] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-23T23:21:27.148148] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-23T23:21:27.148365] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-10-23T23:21:27.148437] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-23T23:21:27.210345] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-23T23:21:27.502586] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:27.999435] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-23T23:21:28.037054] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T23:21:28.799415] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-23T23:21:28.869869] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T23:21:29.599411] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-23T23:21:29.672930] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T23:21:30.399432] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-10-23T23:21:30.499873] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T23:21:31.179709] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:21:31.189038] [INFO ] [REMOTE ] PRO: Full fetch complete (54003 records). [2025-10-23T23:21:31.189189] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-23T23:21:31.204637] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-23T23:21:31.352996] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T23:21:31.648534] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-23T23:21:31.648818] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-23T23:21:31.649828] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-23T23:21:31.649910] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-23T23:21:31.651072] [DEBUG] [LOCAL ] PRO: Trimmed 54003 records to 40426 (keeping 200 days of data) [2025-10-23T23:21:31.878942] [DEBUG] [LOCAL ] PRO: Primary data saved (40426 records). [2025-10-23T23:21:31.879090] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-23T23:21:31.879198] [INFO ] [MAIN ] Update Progress: 1726/2367 symbols completed. PRO took 27.4s. Estimated remaining: 1h 22m 15s. Rate: 7.8 symbols/min [2025-10-23T23:21:32.004576] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-10-23T23:21:32.050386] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:32.057375] [DEBUG] [LOCAL ] PRT: Loaded 5061 existing records from primary storage. [2025-10-23T23:21:32.057602] [INFO ] [MAIN ] PRT: Loaded 5061 existing records. [2025-10-23T23:21:32.231423] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:32.231672] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-23T23:21:32.231748] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-23T23:21:32.231927] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-23T23:21:32.232001] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-23T23:21:32.581701] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:32.799438] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-23T23:21:32.961828] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-23T23:21:33.135040] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T23:21:33.325336] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-23T23:21:33.599469] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-10-23T23:21:34.399410] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-23T23:21:34.858997] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T23:21:35.199456] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-23T23:21:35.926931] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T23:21:35.934957] [INFO ] [REMOTE ] PRM: Full fetch complete (64898 records). [2025-10-23T23:21:35.935152] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-23T23:21:36.004607] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-10-23T23:21:36.324972] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-23T23:21:36.325144] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-23T23:21:36.326381] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-23T23:21:36.326482] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-23T23:21:36.327880] [DEBUG] [LOCAL ] PRM: Trimmed 64898 records to 44667 (keeping 200 days of data) [2025-10-23T23:21:36.582606] [DEBUG] [LOCAL ] PRM: Primary data saved (44667 records). [2025-10-23T23:21:36.582790] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-23T23:21:36.582926] [INFO ] [MAIN ] Update Progress: 1727/2367 symbols completed. PRM took 35.3s. Estimated remaining: 1h 22m 6s. Rate: 7.8 symbols/min [2025-10-23T23:21:36.755104] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:36.803030] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-23T23:21:36.803827] [DEBUG] [LOCAL ] PRU: Loaded 51171 existing records from primary storage. [2025-10-23T23:21:36.805131] [INFO ] [MAIN ] PRU: Loaded 51171 existing records. [2025-10-23T23:21:36.988432] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:36.988817] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-23T23:21:36.988911] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-23T23:21:36.989185] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-10-23T23:21:36.989258] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-23T23:21:37.182447] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T23:21:37.264580] [INFO ] [REMOTE ] PRMB: Full fetch complete (76317 records). [2025-10-23T23:21:37.281683] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-23T23:21:37.398616] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T23:21:37.578385] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:37.604560] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-10-23T23:21:37.737293] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-23T23:21:37.935848] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-23T23:21:37.936011] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-23T23:21:37.937498] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-23T23:21:37.937589] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-23T23:21:37.939329] [DEBUG] [LOCAL ] PRMB: Trimmed 76317 records to 53483 (keeping 200 days of data) [2025-10-23T23:21:38.268137] [DEBUG] [LOCAL ] PRMB: Primary data saved (53483 records). [2025-10-23T23:21:38.268293] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-23T23:21:38.269731] [INFO ] [MAIN ] Update Progress: 1728/2367 symbols completed. PRMB took 35.6s. Estimated remaining: 1h 21m 56s. Rate: 7.8 symbols/min [2025-10-23T23:21:38.407776] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-23T23:21:38.445779] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:38.446173] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-23T23:21:38.446248] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-23T23:21:38.446364] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-23T23:21:38.446436] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-23T23:21:38.446519] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-23T23:21:38.446591] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-23T23:21:38.870786] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:38.872245] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T23:21:39.199434] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-10-23T23:21:39.999404] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-23T23:21:40.288670] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T23:21:40.314306] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T23:21:40.799427] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-10-23T23:21:40.817341] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T23:21:41.599405] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-23T23:21:41.916984] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T23:21:42.109044] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-23T23:21:42.399442] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-23T23:21:43.006870] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T23:21:43.199444] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-23T23:21:43.999434] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-23T23:21:44.339395] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-23T23:21:44.799436] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-23T23:21:44.965781] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T23:21:45.147287] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-23T23:21:45.599443] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-23T23:21:46.399502] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-10-23T23:21:47.199452] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-23T23:21:47.510968] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-23T23:21:47.529220] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T23:21:47.790869] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-23T23:21:47.999472] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-23T23:21:48.799500] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-23T23:21:49.145511] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-23T23:21:49.599424] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-10-23T23:21:49.945589] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T23:21:50.399416] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-23T23:21:50.598795] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-23T23:21:51.199431] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-23T23:21:51.806936] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T23:21:51.999410] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-10. [2025-10-23T23:21:52.135170] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:21:52.799479] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-23T23:21:53.016980] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:21:53.020852] [INFO ] [REMOTE ] PRSU: Full fetch complete (34232 records). [2025-10-23T23:21:53.020953] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-10-23T23:21:53.386109] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-10-23T23:21:53.386221] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-10-23T23:21:53.386945] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-10-23T23:21:53.387022] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-10-23T23:21:53.387870] [DEBUG] [LOCAL ] PRSU: Trimmed 34232 records to 23223 (keeping 200 days of data) [2025-10-23T23:21:53.516238] [DEBUG] [LOCAL ] PRSU: Primary data saved (23223 records). [2025-10-23T23:21:53.516393] [INFO ] [MAIN ] PRSU: Full history saved. [2025-10-23T23:21:53.516501] [INFO ] [MAIN ] Update Progress: 1729/2367 symbols completed. PRSU took 26.7s. Estimated remaining: 1h 21m 51s. Rate: 7.8 symbols/min [2025-10-23T23:21:53.605148] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-23T23:21:53.685537] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:21:53.723634] [DEBUG] [LOCAL ] PSA: Loaded 42093 existing records from primary storage. [2025-10-23T23:21:53.723971] [INFO ] [MAIN ] PSA: Loaded 42093 existing records. [2025-10-23T23:21:53.902204] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:21:53.902469] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-23T23:21:53.902544] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-23T23:21:53.902782] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-10-23T23:21:53.902855] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-23T23:21:54.105259] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-23T23:21:54.271735] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:21:54.399432] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-23T23:21:54.533684] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T23:21:54.720223] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-23T23:21:55.199444] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-23T23:21:55.999516] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-23T23:21:56.544322] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-23T23:21:56.804691] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-23T23:21:56.820749] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T23:21:57.599443] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-23T23:21:57.920039] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-23T23:21:58.349845] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T23:21:58.399476] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-23T23:21:58.707003] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-23T23:21:59.199453] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-23T23:21:59.999466] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-23T23:22:00.655191] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T23:22:00.799467] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-23T23:22:01.599481] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-23T23:22:01.887374] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T23:22:02.266566] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T23:22:02.394522] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T23:22:02.402824] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-23T23:22:03.199465] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-23T23:22:03.999440] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-23T23:22:04.313909] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T23:22:04.333190] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-23T23:22:04.799463] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-23T23:22:04.954084] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T23:22:05.137308] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-23T23:22:05.138177] [INFO ] [REMOTE ] PRVS: Full fetch complete (1227 records). [2025-10-23T23:22:05.138266] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-23T23:22:05.341471] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-23T23:22:05.341695] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:22:05.341771] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:22:05.341871] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-23T23:22:05.341978] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-23T23:22:05.342053] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-23T23:22:05.342135] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-23T23:22:05.342243] [INFO ] [MAIN ] Update Progress: 1730/2367 symbols completed. PRVS took 27.1s. Estimated remaining: 1h 21m 45s. Rate: 7.8 symbols/min [2025-10-23T23:22:05.526470] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:05.537615] [DEBUG] [LOCAL ] PSBD: Loaded 8246 existing records from primary storage. [2025-10-23T23:22:05.537946] [INFO ] [MAIN ] PSBD: Loaded 8246 existing records. [2025-10-23T23:22:05.604710] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-23T23:22:05.725236] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:05.725454] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-23T23:22:05.725530] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-23T23:22:05.725740] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-23T23:22:05.725816] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-23T23:22:06.102751] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:06.399435] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-23T23:22:07.102732] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-23T23:22:07.199458] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-23T23:22:07.255202] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-23T23:22:07.999466] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-23T23:22:08.799442] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-23T23:22:08.871161] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T23:22:08.880436] [INFO ] [REMOTE ] PRU: Full fetch complete (74574 records). [2025-10-23T23:22:08.880618] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-23T23:22:09.300153] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-23T23:22:09.300337] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-23T23:22:09.301541] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-23T23:22:09.301630] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-23T23:22:09.303119] [DEBUG] [LOCAL ] PRU: Trimmed 74574 records to 51504 (keeping 200 days of data) [2025-10-23T23:22:09.540162] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T23:22:09.602988] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-23T23:22:09.653233] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T23:22:09.676553] [DEBUG] [LOCAL ] PRU: Primary data saved (51504 records). [2025-10-23T23:22:09.676724] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-23T23:22:09.676881] [INFO ] [MAIN ] Update Progress: 1731/2367 symbols completed. PRU took 33.1s. Estimated remaining: 1h 21m 36s. Rate: 7.8 symbols/min [2025-10-23T23:22:09.842302] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:09.850423] [DEBUG] [LOCAL ] PSF: Loaded 6947 existing records from primary storage. [2025-10-23T23:22:09.850696] [INFO ] [MAIN ] PSF: Loaded 6947 existing records. [2025-10-23T23:22:10.025294] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:10.025522] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-23T23:22:10.025596] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-23T23:22:10.025829] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-23T23:22:10.025905] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-23T23:22:10.279526] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T23:22:10.311778] [INFO ] [REMOTE ] PRT: Full fetch complete (8502 records). [2025-10-23T23:22:10.314414] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-23T23:22:10.404728] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-23T23:22:10.485435] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:10.779908] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-23T23:22:10.780025] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-23T23:22:10.780274] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-23T23:22:10.780365] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-23T23:22:10.780859] [DEBUG] [LOCAL ] PRT: Trimmed 8502 records to 5085 (keeping 200 days of data) [2025-10-23T23:22:10.814201] [DEBUG] [LOCAL ] PRT: Primary data saved (5085 records). [2025-10-23T23:22:10.814393] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-23T23:22:10.814557] [INFO ] [MAIN ] Update Progress: 1732/2367 symbols completed. PRT took 38.9s. Estimated remaining: 1h 21m 26s. Rate: 7.8 symbols/min [2025-10-23T23:22:11.003111] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:11.030440] [DEBUG] [LOCAL ] PSFE: Loaded 29574 existing records from primary storage. [2025-10-23T23:22:11.030777] [INFO ] [MAIN ] PSFE: Loaded 29574 existing records. [2025-10-23T23:22:11.185157] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T23:22:11.209171] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-23T23:22:11.214126] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:11.214309] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-23T23:22:11.214405] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-23T23:22:11.215445] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-23T23:22:11.215519] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-23T23:22:11.586358] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:11.900931] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-23T23:22:11.999474] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-23T23:22:12.799449] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-23T23:22:13.140050] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T23:22:13.482201] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-23T23:22:13.599482] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-23T23:22:14.253903] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-23T23:22:14.399479] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-23T23:22:15.199492] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-23T23:22:15.620477] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T23:22:15.859328] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-23T23:22:15.999473] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-23T23:22:16.597391] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T23:22:16.799522] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-23T23:22:17.599480] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-23T23:22:18.383633] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T23:22:18.399407] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-23T23:22:18.986002] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T23:22:19.103974] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T23:22:19.199422] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-23T23:22:19.857695] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-23T23:22:19.999424] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-23T23:22:20.705923] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-23T23:22:20.799422] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-23T23:22:21.599448] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-23T23:22:22.351042] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T23:22:22.375836] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T23:22:22.399418] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-23T23:22:23.127115] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T23:22:23.199409] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-23T23:22:23.939294] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T23:22:23.999439] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-23T23:22:24.799432] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-23T23:22:24.819407] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:22:25.414677] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T23:22:25.599463] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-23T23:22:26.399409] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-23T23:22:26.865003] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T23:22:27.025385] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-23T23:22:27.199479] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-23T23:22:27.999509] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-23T23:22:28.763335] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T23:22:28.796780] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T23:22:28.805476] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-23T23:22:29.599411] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-23T23:22:30.014349] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T23:22:30.399419] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-23T23:22:30.543748] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T23:22:30.547036] [INFO ] [REMOTE ] PSBD: Full fetch complete (10984 records). [2025-10-23T23:22:30.547150] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-23T23:22:30.914853] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-23T23:22:30.915013] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-23T23:22:30.915335] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-23T23:22:30.915414] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-23T23:22:30.915927] [DEBUG] [LOCAL ] PSBD: Trimmed 10984 records to 8310 (keeping 200 days of data) [2025-10-23T23:22:30.968254] [DEBUG] [LOCAL ] PSBD: Primary data saved (8310 records). [2025-10-23T23:22:30.968846] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-23T23:22:30.968962] [INFO ] [MAIN ] Update Progress: 1733/2367 symbols completed. PSBD took 25.6s. Estimated remaining: 1h 21m 23s. Rate: 7.8 symbols/min [2025-10-23T23:22:31.086969] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T23:22:31.104389] [INFO ] [REMOTE ] PSF: Full fetch complete (9672 records). [2025-10-23T23:22:31.132913] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-23T23:22:31.152689] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:31.204612] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-23T23:22:31.471407] [DEBUG] [LOCAL ] PSN: Loaded 45180 existing records from primary storage. [2025-10-23T23:22:31.499360] [INFO ] [MAIN ] PSN: Loaded 45180 existing records. [2025-10-23T23:22:31.693005] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-23T23:22:31.693434] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-23T23:22:31.709304] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-23T23:22:31.719632] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-23T23:22:31.784078] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:31.780543] [DEBUG] [LOCAL ] PSF: Trimmed 9672 records to 6972 (keeping 200 days of data) [2025-10-23T23:22:31.784522] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-23T23:22:31.784604] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-23T23:22:31.802270] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-23T23:22:31.805876] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-23T23:22:31.931209] [DEBUG] [LOCAL ] PSF: Primary data saved (6972 records). [2025-10-23T23:22:31.936973] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-23T23:22:31.942215] [INFO ] [MAIN ] Update Progress: 1734/2367 symbols completed. PSF took 22.3s. Estimated remaining: 1h 21m 13s. Rate: 7.8 symbols/min [2025-10-23T23:22:32.001115] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-23T23:22:32.340298] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:32.363930] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:32.396597] [DEBUG] [LOCAL ] PSO: Loaded 36655 existing records from primary storage. [2025-10-23T23:22:32.396908] [INFO ] [MAIN ] PSO: Loaded 36655 existing records. [2025-10-23T23:22:32.575756] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:32.575992] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-23T23:22:32.576063] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-23T23:22:32.576329] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-23T23:22:32.576401] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-23T23:22:32.814847] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-23T23:22:32.947577] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:32.967354] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T23:22:32.974997] [INFO ] [REMOTE ] PSA: Full fetch complete (59701 records). [2025-10-23T23:22:32.975190] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-23T23:22:33.366127] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-23T23:22:33.366288] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-23T23:22:33.367336] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-23T23:22:33.367414] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-23T23:22:33.368752] [DEBUG] [LOCAL ] PSA: Trimmed 59701 records to 42392 (keeping 200 days of data) [2025-10-23T23:22:33.612695] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-23T23:22:33.645462] [DEBUG] [LOCAL ] PSA: Primary data saved (42392 records). [2025-10-23T23:22:33.645814] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-23T23:22:33.646011] [INFO ] [MAIN ] Update Progress: 1735/2367 symbols completed. PSA took 40.1s. Estimated remaining: 1h 21m 3s. Rate: 7.8 symbols/min [2025-10-23T23:22:33.749964] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T23:22:33.853234] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:33.886546] [DEBUG] [LOCAL ] PSQH: Loaded 35401 existing records from primary storage. [2025-10-23T23:22:33.886910] [INFO ] [MAIN ] PSQH: Loaded 35401 existing records. [2025-10-23T23:22:34.063300] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:34.063499] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-23T23:22:34.063572] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-23T23:22:34.063826] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-23T23:22:34.063899] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-23T23:22:34.402499] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-23T23:22:34.427047] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:34.458595] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T23:22:34.996051] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T23:22:35.199462] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-23T23:22:35.873943] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T23:22:35.999474] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-23T23:22:36.799421] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-23T23:22:36.966151] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T23:22:37.299421] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T23:22:37.599419] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-23T23:22:38.045617] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T23:22:38.399451] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-23T23:22:39.088752] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T23:22:39.199430] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-23T23:22:39.743679] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-23T23:22:39.999420] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-23T23:22:40.698062] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T23:22:40.799434] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-23T23:22:41.354621] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T23:22:41.599448] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-23T23:22:41.940442] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T23:22:42.399504] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-23T23:22:42.948884] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-23T23:22:43.199441] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-23T23:22:43.698293] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T23:22:43.999471] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-23T23:22:44.799464] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-23T23:22:44.947292] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T23:22:44.982368] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T23:22:45.599428] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-23T23:22:46.399421] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-23T23:22:47.199422] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-23T23:22:47.323339] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-23T23:22:47.892937] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T23:22:47.999403] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-23T23:22:48.386066] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T23:22:48.390960] [INFO ] [REMOTE ] PSFE: Full fetch complete (43070 records). [2025-10-23T23:22:48.391099] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-23T23:22:48.756343] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-23T23:22:48.756451] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-23T23:22:48.757351] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-23T23:22:48.757434] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-23T23:22:48.758506] [DEBUG] [LOCAL ] PSFE: Trimmed 43070 records to 29746 (keeping 200 days of data) [2025-10-23T23:22:48.804887] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-23T23:22:48.949066] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (4.15 seconds). [2025-10-23T23:22:48.965088] [DEBUG] [LOCAL ] PSFE: Primary data saved (29746 records). [2025-10-23T23:22:48.965233] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-23T23:22:48.965342] [INFO ] [MAIN ] Update Progress: 1736/2367 symbols completed. PSFE took 38.2s. Estimated remaining: 1h 20m 58s. Rate: 7.8 symbols/min [2025-10-23T23:22:49.140712] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:22:49.188842] [DEBUG] [LOCAL ] PSTG: Loaded 52833 existing records from primary storage. [2025-10-23T23:22:49.189192] [INFO ] [MAIN ] PSTG: Loaded 52833 existing records. [2025-10-23T23:22:49.374788] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:22:49.375052] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-23T23:22:49.375128] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-23T23:22:49.375427] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-23T23:22:49.375502] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-23T23:22:49.606412] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-23T23:22:49.777043] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T23:22:49.782581] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:22:50.045992] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-23T23:22:50.399450] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-23T23:22:51.070611] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T23:22:51.199450] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-23T23:22:51.999412] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-23T23:22:52.269864] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T23:22:52.799426] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-23T23:22:52.870300] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T23:22:53.083839] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T23:22:53.599423] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-23T23:22:54.129352] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T23:22:54.399441] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-23T23:22:55.190936] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T23:22:55.199843] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-23T23:22:55.999425] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-23T23:22:56.155200] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T23:22:56.727592] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T23:22:56.799399] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-23T23:22:57.599460] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-23T23:22:57.681555] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T23:22:57.767224] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T23:22:58.399444] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-23T23:22:59.199447] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-23T23:22:59.999435] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-23T23:23:05.087296] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (7.49 seconds). [2025-10-23T23:23:05.100546] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-23T23:23:05.133677] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (5.13 seconds). [2025-10-23T23:23:05.141414] [INFO ] [REMOTE ] PSO: Full fetch complete (52898 records). [2025-10-23T23:23:05.141714] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-23T23:23:05.384622] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (6.19 seconds). [2025-10-23T23:23:05.466987] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-23T23:23:05.596916] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-23T23:23:05.597186] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-23T23:23:05.598212] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-23T23:23:05.612437] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-23T23:23:05.625134] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (7.23 seconds). [2025-10-23T23:23:05.635480] [DEBUG] [LOCAL ] PSO: Trimmed 52898 records to 36855 (keeping 200 days of data) [2025-10-23T23:23:05.636173] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-23T23:23:05.863597] [DEBUG] [LOCAL ] PSO: Primary data saved (36855 records). [2025-10-23T23:23:05.863790] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-23T23:23:05.863905] [INFO ] [MAIN ] Update Progress: 1737/2367 symbols completed. PSO took 33.9s. Estimated remaining: 1h 20m 53s. Rate: 7.8 symbols/min [2025-10-23T23:23:06.028914] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:06.049098] [DEBUG] [LOCAL ] PSTL: Loaded 19894 existing records from primary storage. [2025-10-23T23:23:06.049381] [INFO ] [MAIN ] PSTL: Loaded 19894 existing records. [2025-10-23T23:23:06.222924] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:06.223138] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-23T23:23:06.223223] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-23T23:23:06.223476] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-23T23:23:06.223549] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-23T23:23:06.576192] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:06.576558] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-23T23:23:07.226961] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T23:23:07.234121] [INFO ] [REMOTE ] PSN: Full fetch complete (66781 records). [2025-10-23T23:23:07.234263] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-23T23:23:07.630741] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-23T23:23:07.630948] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-23T23:23:07.632113] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-23T23:23:07.632409] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-23T23:23:07.634041] [DEBUG] [LOCAL ] PSN: Trimmed 66781 records to 45425 (keeping 200 days of data) [2025-10-23T23:23:07.759607] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-23T23:23:07.774571] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-23T23:23:07.790071] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T23:23:07.796443] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-23T23:23:07.835067] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-23T23:23:07.849394] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-23T23:23:07.995733] [DEBUG] [LOCAL ] PSN: Primary data saved (45425 records). [2025-10-23T23:23:07.995918] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-23T23:23:07.996051] [INFO ] [MAIN ] Update Progress: 1738/2367 symbols completed. PSN took 37.0s. Estimated remaining: 1h 20m 44s. Rate: 7.8 symbols/min [2025-10-23T23:23:08.165613] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:08.214132] [DEBUG] [LOCAL ] PSX: Loaded 53124 existing records from primary storage. [2025-10-23T23:23:08.214479] [INFO ] [MAIN ] PSX: Loaded 53124 existing records. [2025-10-23T23:23:08.389099] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:08.389311] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-23T23:23:08.389416] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-23T23:23:08.390027] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-10-23T23:23:08.390101] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-23T23:23:08.742423] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:08.742834] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-23T23:23:08.867856] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T23:23:08.872332] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-23T23:23:09.598251] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T23:23:09.606322] [INFO ] [REMOTE ] PSQH: Full fetch complete (53297 records). [2025-10-23T23:23:09.606524] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-23T23:23:10.065325] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-23T23:23:10.078362] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-23T23:23:10.079254] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-23T23:23:10.080983] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-23T23:23:10.092480] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-23T23:23:10.095307] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-23T23:23:10.097099] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T23:23:10.103825] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-23T23:23:10.104823] [DEBUG] [LOCAL ] PSQH: Trimmed 53297 records to 35712 (keeping 200 days of data) [2025-10-23T23:23:10.251670] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T23:23:10.304082] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-23T23:23:10.354164] [DEBUG] [LOCAL ] PSQH: Primary data saved (35712 records). [2025-10-23T23:23:10.354328] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-23T23:23:10.354456] [INFO ] [MAIN ] Update Progress: 1739/2367 symbols completed. PSQH took 36.7s. Estimated remaining: 1h 20m 34s. Rate: 7.8 symbols/min [2025-10-23T23:23:10.518874] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:10.535457] [DEBUG] [LOCAL ] PTA: Loaded 15444 existing records from primary storage. [2025-10-23T23:23:10.535761] [INFO ] [MAIN ] PTA: Loaded 15444 existing records. [2025-10-23T23:23:10.709347] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:10.709584] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-23T23:23:10.709686] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-23T23:23:10.709919] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-23T23:23:10.709993] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-23T23:23:11.068941] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:11.069443] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-23T23:23:11.230953] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-23T23:23:11.236033] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-23T23:23:12.276807] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T23:23:12.286979] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-23T23:23:12.412387] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T23:23:12.498388] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T23:23:12.799441] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-23T23:23:13.393717] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T23:23:13.599465] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-23T23:23:13.728428] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (3.64 seconds). [2025-10-23T23:23:14.160363] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T23:23:14.399480] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-23T23:23:14.654521] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T23:23:15.199433] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-23T23:23:15.999471] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-23T23:23:16.212384] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-23T23:23:16.408399] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T23:23:16.665752] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-23T23:23:16.799404] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-23T23:23:17.599465] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-23T23:23:17.821292] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T23:23:18.399409] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-23T23:23:19.199443] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-23T23:23:19.275420] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T23:23:19.274787] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T23:23:19.999420] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-23T23:23:20.103053] [DEBUG] [REMOTE ] PTA: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-23T23:23:20.103498] [WARN ] [REMOTE ] PTA: No data returned for month 2025-06 [2025-10-23T23:23:20.103601] [FATAL] [REMOTE ] PTA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:23:20.103750] [FATAL] [MAIN ] PTA: Failed to fetch primary data. [2025-10-23T23:23:20.103838] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:23:20.103935] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-23T23:23:20.104054] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-23T23:23:20.104142] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-23T23:23:20.104331] [DEBUG] [LOCAL ] PTA: Deleted derivative data file. [2025-10-23T23:23:20.104453] [INFO ] [MAIN ] Update Progress: 1740/2367 symbols completed. PTA took 9.7s. Estimated remaining: 1h 20m 27s. Rate: 7.8 symbols/min [2025-10-23T23:23:20.272573] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:20.307821] [DEBUG] [LOCAL ] PTY: Loaded 37908 existing records from primary storage. [2025-10-23T23:23:20.308173] [INFO ] [MAIN ] PTY: Loaded 37908 existing records. [2025-10-23T23:23:20.484240] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:20.484473] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-23T23:23:20.484550] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-23T23:23:20.484791] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-23T23:23:20.484865] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-23T23:23:20.613522] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T23:23:20.804628] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-23T23:23:20.862637] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:21.599488] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-23T23:23:22.399452] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-23T23:23:22.725886] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-23T23:23:22.961919] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T23:23:23.199442] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-23T23:23:23.417527] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T23:23:23.999425] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-23T23:23:24.195454] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T23:23:24.199170] [INFO ] [REMOTE ] PSTL: Full fetch complete (29388 records). [2025-10-23T23:23:24.199278] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-23T23:23:24.567856] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-23T23:23:24.567997] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-23T23:23:24.568744] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-23T23:23:24.568828] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-23T23:23:24.569784] [DEBUG] [LOCAL ] PSTL: Trimmed 29388 records to 20000 (keeping 200 days of data) [2025-10-23T23:23:24.692356] [DEBUG] [LOCAL ] PSTL: Primary data saved (20000 records). [2025-10-23T23:23:24.692537] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-23T23:23:24.692674] [INFO ] [MAIN ] Update Progress: 1741/2367 symbols completed. PSTL took 18.8s. Estimated remaining: 1h 20m 18s. Rate: 7.8 symbols/min [2025-10-23T23:23:24.804560] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-23T23:23:24.864737] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:24.903599] [DEBUG] [LOCAL ] PUK: Loaded 44333 existing records from primary storage. [2025-10-23T23:23:24.903955] [INFO ] [MAIN ] PUK: Loaded 44333 existing records. [2025-10-23T23:23:25.080279] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:25.080509] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-23T23:23:25.080583] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-23T23:23:25.080823] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-23T23:23:25.080895] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-23T23:23:25.431203] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:25.599428] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-23T23:23:25.887671] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T23:23:26.265364] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T23:23:26.399403] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-23T23:23:27.167125] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T23:23:27.199400] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-23T23:23:27.840111] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T23:23:27.999441] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-23T23:23:28.772455] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:23:28.799405] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-23T23:23:29.224156] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-23T23:23:29.599428] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-23T23:23:30.399409] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-23T23:23:30.569499] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T23:23:31.199421] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-23T23:23:31.590958] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T23:23:31.814797] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-23T23:23:31.999440] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-23T23:23:32.799417] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-23T23:23:32.846488] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T23:23:33.599430] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-23T23:23:34.194016] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T23:23:34.399409] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-23T23:23:34.503438] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-23T23:23:35.199422] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-23T23:23:35.333682] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T23:23:35.895309] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T23:23:35.999447] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-23T23:23:36.750235] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T23:23:36.759346] [INFO ] [REMOTE ] PSTG: Full fetch complete (76692 records). [2025-10-23T23:23:36.759511] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-23T23:23:36.804549] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-23T23:23:37.175398] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-23T23:23:37.175532] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-23T23:23:37.176716] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-23T23:23:37.176938] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-23T23:23:37.178557] [DEBUG] [LOCAL ] PSTG: Trimmed 76692 records to 53212 (keeping 200 days of data) [2025-10-23T23:23:37.312934] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-23T23:23:37.519480] [DEBUG] [LOCAL ] PSTG: Primary data saved (53212 records). [2025-10-23T23:23:37.519694] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-23T23:23:37.519842] [INFO ] [MAIN ] Update Progress: 1742/2367 symbols completed. PSTG took 48.6s. Estimated remaining: 1h 20m 12s. Rate: 7.8 symbols/min [2025-10-23T23:23:37.604614] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-23T23:23:37.694669] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:37.735952] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-10-23T23:23:37.736324] [INFO ] [MAIN ] PUMP: Loaded 49434 existing records. [2025-10-23T23:23:37.912211] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:37.912437] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-23T23:23:37.912533] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-23T23:23:37.912842] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-10-23T23:23:37.912930] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-23T23:23:38.271539] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:38.346697] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T23:23:38.399392] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-23T23:23:39.199427] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-23T23:23:39.333790] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T23:23:39.860275] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:23:39.999406] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-23T23:23:40.799409] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-23T23:23:40.876847] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T23:23:41.560902] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T23:23:41.568373] [INFO ] [REMOTE ] PTY: Full fetch complete (54574 records). [2025-10-23T23:23:41.568534] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-23T23:23:41.604683] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-23T23:23:41.951128] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-23T23:23:41.951374] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-23T23:23:41.952513] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-23T23:23:41.952725] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-23T23:23:41.953907] [DEBUG] [LOCAL ] PTY: Trimmed 54574 records to 38196 (keeping 200 days of data) [2025-10-23T23:23:42.180920] [DEBUG] [LOCAL ] PTY: Primary data saved (38196 records). [2025-10-23T23:23:42.181090] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-23T23:23:42.181200] [INFO ] [MAIN ] Update Progress: 1743/2367 symbols completed. PTY took 22.1s. Estimated remaining: 1h 20m 4s. Rate: 7.8 symbols/min [2025-10-23T23:23:42.358507] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:42.384364] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T23:23:42.399406] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-23T23:23:42.432860] [DEBUG] [LOCAL ] PVH: Loaded 49508 existing records from primary storage. [2025-10-23T23:23:42.433188] [INFO ] [MAIN ] PVH: Loaded 49508 existing records. [2025-10-23T23:23:42.630256] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:42.630442] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-23T23:23:42.630514] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-23T23:23:42.630769] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-23T23:23:42.630843] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-23T23:23:42.977976] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:43.199408] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-23T23:23:43.570078] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-23T23:23:43.999415] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-23T23:23:44.097392] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T23:23:44.799056] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T23:23:44.807604] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-23T23:23:45.474359] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T23:23:45.599412] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-23T23:23:46.399422] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-23T23:23:46.440139] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:23:46.720907] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T23:23:46.728871] [INFO ] [REMOTE ] PUK: Full fetch complete (65303 records). [2025-10-23T23:23:46.729008] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-23T23:23:47.117828] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-23T23:23:47.117964] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-23T23:23:47.119127] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-23T23:23:47.119209] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-23T23:23:47.120518] [DEBUG] [LOCAL ] PUK: Trimmed 65303 records to 44662 (keeping 200 days of data) [2025-10-23T23:23:47.209898] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-23T23:23:47.415051] [DEBUG] [LOCAL ] PUK: Primary data saved (44662 records). [2025-10-23T23:23:47.415321] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-23T23:23:47.415468] [INFO ] [MAIN ] Update Progress: 1744/2367 symbols completed. PUK took 22.7s. Estimated remaining: 1h 19m 55s. Rate: 7.8 symbols/min [2025-10-23T23:23:47.594371] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:47.609986] [DEBUG] [LOCAL ] PVL: Loaded 4737 existing records from primary storage. [2025-10-23T23:23:47.610291] [INFO ] [MAIN ] PVL: Loaded 4737 existing records. [2025-10-23T23:23:47.788293] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:47.788607] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-23T23:23:47.788715] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-23T23:23:47.788909] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-23T23:23:47.788983] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-23T23:23:48.004601] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-23T23:23:48.172497] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:48.178411] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T23:23:48.799443] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-23T23:23:49.039066] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T23:23:49.048533] [INFO ] [REMOTE ] PSX: Full fetch complete (77134 records). [2025-10-23T23:23:49.048779] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-23T23:23:49.457897] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-23T23:23:49.458039] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-23T23:23:49.459341] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-23T23:23:49.459442] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-23T23:23:49.460933] [DEBUG] [LOCAL ] PSX: Trimmed 77134 records to 53511 (keeping 200 days of data) [2025-10-23T23:23:49.640375] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-23T23:23:49.826072] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-23T23:23:49.829694] [DEBUG] [LOCAL ] PSX: Primary data saved (53511 records). [2025-10-23T23:23:49.838624] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-23T23:23:49.840757] [INFO ] [MAIN ] Update Progress: 1745/2367 symbols completed. PSX took 41.8s. Estimated remaining: 1h 19m 46s. Rate: 7.8 symbols/min [2025-10-23T23:23:50.030247] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:23:50.076930] [DEBUG] [LOCAL ] PWR: Loaded 46492 existing records from primary storage. [2025-10-23T23:23:50.077274] [INFO ] [MAIN ] PWR: Loaded 46492 existing records. [2025-10-23T23:23:50.269146] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:23:50.269734] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-23T23:23:50.269825] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-23T23:23:50.270145] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-10-23T23:23:50.270218] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-23T23:23:50.377064] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-23T23:23:50.403688] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-23T23:23:50.680706] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:23:50.683922] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T23:23:51.199498] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-23T23:23:51.999432] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-23T23:23:52.226489] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T23:23:52.591821] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T23:23:52.799410] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-23T23:23:52.976088] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T23:23:53.170249] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-23T23:23:53.599490] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-23T23:23:54.399445] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-23T23:23:55.199457] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-23T23:23:55.502339] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T23:23:55.999497] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-23T23:23:56.252635] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T23:23:56.799514] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-23T23:23:56.885982] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:23:57.599419] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-23T23:23:57.874833] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T23:23:58.399428] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-23T23:23:58.574299] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T23:23:58.968094] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-23T23:23:59.114061] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T23:23:59.199420] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-23T23:23:59.999446] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-23T23:24:00.615443] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-23T23:24:00.799420] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-23T23:24:00.874758] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T23:24:01.487815] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T23:24:01.599486] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-23T23:24:02.214254] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T23:24:02.399440] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-23T23:24:03.199446] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-23T23:24:03.760770] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-23T23:24:03.970832] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T23:24:03.999404] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-23T23:24:04.609325] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T23:24:04.799418] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-23T23:24:05.599476] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-23T23:24:06.276861] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T23:24:06.278220] [INFO ] [REMOTE ] PVL: Full fetch complete (7084 records). [2025-10-23T23:24:06.278308] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-23T23:24:06.404571] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-23T23:24:06.641107] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-23T23:24:06.641394] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-23T23:24:06.641674] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-23T23:24:06.641763] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-23T23:24:06.642176] [DEBUG] [LOCAL ] PVL: Trimmed 7084 records to 4774 (keeping 200 days of data) [2025-10-23T23:24:06.669003] [DEBUG] [LOCAL ] PVL: Primary data saved (4774 records). [2025-10-23T23:24:06.669089] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-23T23:24:06.669191] [INFO ] [MAIN ] Update Progress: 1746/2367 symbols completed. PVL took 19.3s. Estimated remaining: 1h 19m 41s. Rate: 7.8 symbols/min [2025-10-23T23:24:06.841504] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:06.871879] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T23:24:06.912198] [DEBUG] [LOCAL ] PX: Loaded 33950 existing records from primary storage. [2025-10-23T23:24:06.912555] [INFO ] [MAIN ] PX: Loaded 33950 existing records. [2025-10-23T23:24:07.092155] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:24:07.092404] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-23T23:24:07.092480] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-23T23:24:07.092711] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-23T23:24:07.092789] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-23T23:24:07.204852] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-23T23:24:07.457551] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:07.999429] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-23T23:24:08.433795] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T23:24:08.799430] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-23T23:24:08.994672] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T23:24:09.428275] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-23T23:24:09.599417] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-23T23:24:10.272442] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T23:24:10.399430] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-23T23:24:11.005927] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T23:24:11.199453] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-23T23:24:11.999474] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-23T23:24:12.148452] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T23:24:12.545208] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T23:24:12.799442] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-23T23:24:13.599447] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-23T23:24:13.774355] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T23:24:14.361153] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T23:24:14.399410] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-23T23:24:15.199443] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-23T23:24:15.285342] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T23:24:15.294233] [INFO ] [REMOTE ] PUMP: Full fetch complete (71797 records). [2025-10-23T23:24:15.294481] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-23T23:24:15.689789] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-23T23:24:15.689921] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-23T23:24:15.691107] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-23T23:24:15.691224] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-23T23:24:15.693008] [DEBUG] [LOCAL ] PUMP: Trimmed 71797 records to 49808 (keeping 200 days of data) [2025-10-23T23:24:15.809786] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T23:24:16.010474] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-23T23:24:16.011925] [DEBUG] [LOCAL ] PUMP: Primary data saved (49808 records). [2025-10-23T23:24:16.012202] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-23T23:24:16.013194] [INFO ] [MAIN ] Update Progress: 1747/2367 symbols completed. PUMP took 38.5s. Estimated remaining: 1h 19m 34s. Rate: 7.8 symbols/min [2025-10-23T23:24:16.197904] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:16.198110] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-23T23:24:16.198181] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-23T23:24:16.198287] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-23T23:24:16.198357] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-23T23:24:16.198436] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-23T23:24:16.198505] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-23T23:24:16.573472] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:16.799442] [INFO ] [REMOTE ] PXED: Fetching primary data for 2025-01. [2025-10-23T23:24:17.003572] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T23:24:17.013914] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:24:17.014705] [WARN ] [REMOTE ] PXED: No data returned for month 2025-01 [2025-10-23T23:24:17.015094] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:24:17.015181] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-23T23:24:17.015277] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:24:17.015380] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-23T23:24:17.015511] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-23T23:24:17.015611] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-23T23:24:17.015802] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-23T23:24:17.015918] [INFO ] [MAIN ] Update Progress: 1748/2367 symbols completed. PXED took 1.0s. Estimated remaining: 1h 19m 24s. Rate: 7.8 symbols/min [2025-10-23T23:24:17.196257] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:17.196456] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-23T23:24:17.196544] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-23T23:24:17.196729] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-23T23:24:17.196836] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-23T23:24:17.196949] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-23T23:24:17.197033] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-23T23:24:17.600606] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-23T23:24:17.604071] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:17.607347] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:24:18.399458] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-23T23:24:19.092110] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-23T23:24:19.099603] [INFO ] [REMOTE ] PVH: Full fetch complete (70851 records). [2025-10-23T23:24:19.099802] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-23T23:24:19.201033] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-23T23:24:19.515370] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-23T23:24:19.515495] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-23T23:24:19.516754] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-23T23:24:19.516840] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-23T23:24:19.518307] [DEBUG] [LOCAL ] PVH: Trimmed 70851 records to 49778 (keeping 200 days of data) [2025-10-23T23:24:19.848959] [DEBUG] [LOCAL ] PVH: Primary data saved (49778 records). [2025-10-23T23:24:19.849252] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-23T23:24:19.849470] [INFO ] [MAIN ] Update Progress: 1749/2367 symbols completed. PVH took 37.7s. Estimated remaining: 1h 19m 14s. Rate: 7.8 symbols/min [2025-10-23T23:24:20.000857] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-23T23:24:20.054730] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:20.056357] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-23T23:24:20.089964] [DEBUG] [LOCAL ] QD: Loaded 27517 existing records from primary storage. [2025-10-23T23:24:20.090271] [INFO ] [MAIN ] QD: Loaded 27517 existing records. [2025-10-23T23:24:20.274758] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:24:20.275012] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-23T23:24:20.275104] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-23T23:24:20.275390] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-23T23:24:20.275478] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-23T23:24:20.642407] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:20.766774] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T23:24:20.799402] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-23T23:24:21.599458] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-23T23:24:22.145471] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T23:24:22.399404] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-23T23:24:22.662183] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-23T23:24:22.720372] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T23:24:23.199445] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-23T23:24:23.999411] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-23T23:24:24.197468] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-23T23:24:24.250493] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T23:24:24.799472] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-23T23:24:25.599532] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-23T23:24:26.247842] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T23:24:26.399420] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-23T23:24:26.486094] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-23T23:24:27.199461] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-23T23:24:27.346059] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T23:24:27.665175] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T23:24:27.999434] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-23T23:24:28.799482] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-23T23:24:29.321378] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-23T23:24:29.599492] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-23T23:24:29.733993] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-23T23:24:30.107551] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T23:24:30.399528] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-23T23:24:30.484156] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T23:24:31.199404] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-23T23:24:31.506879] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T23:24:31.999406] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-23T23:24:32.305828] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-23T23:24:32.310873] [INFO ] [REMOTE ] PX: Full fetch complete (49732 records). [2025-10-23T23:24:32.311008] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-23T23:24:32.694193] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-23T23:24:32.694314] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-23T23:24:32.695374] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-23T23:24:32.695463] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-23T23:24:32.696589] [DEBUG] [LOCAL ] PX: Trimmed 49732 records to 34132 (keeping 200 days of data) [2025-10-23T23:24:32.803684] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-23T23:24:32.898700] [DEBUG] [LOCAL ] PX: Primary data saved (34132 records). [2025-10-23T23:24:32.898862] [INFO ] [MAIN ] PX: Full history saved. [2025-10-23T23:24:32.898996] [INFO ] [MAIN ] Update Progress: 1750/2367 symbols completed. PX took 26.2s. Estimated remaining: 1h 19m 9s. Rate: 7.8 symbols/min [2025-10-23T23:24:33.065619] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:33.106840] [DEBUG] [LOCAL ] QGEN: Loaded 49044 existing records from primary storage. [2025-10-23T23:24:33.107186] [INFO ] [MAIN ] QGEN: Loaded 49044 existing records. [2025-10-23T23:24:33.303330] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:24:33.303566] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-23T23:24:33.303682] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-23T23:24:33.303920] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-23T23:24:33.303993] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-23T23:24:33.622071] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-23T23:24:33.665330] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:33.713624] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T23:24:33.721673] [INFO ] [REMOTE ] PWR: Full fetch complete (69133 records). [2025-10-23T23:24:33.721822] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-23T23:24:34.103147] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-23T23:24:34.103258] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-23T23:24:34.104343] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-23T23:24:34.104422] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-23T23:24:34.105720] [DEBUG] [LOCAL ] PWR: Trimmed 69133 records to 46797 (keeping 200 days of data) [2025-10-23T23:24:34.392394] [DEBUG] [LOCAL ] PWR: Primary data saved (46797 records). [2025-10-23T23:24:34.392547] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-23T23:24:34.393923] [INFO ] [MAIN ] Update Progress: 1751/2367 symbols completed. PWR took 44.6s. Estimated remaining: 1h 18m 59s. Rate: 7.8 symbols/min [2025-10-23T23:24:34.404988] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-23T23:24:34.568050] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:34.622565] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-23T23:24:34.622924] [INFO ] [MAIN ] QS: Loaded 53760 existing records. [2025-10-23T23:24:34.819239] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:24:34.814056] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T23:24:34.823880] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-23T23:24:34.824284] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-23T23:24:34.824876] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-23T23:24:34.824959] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-23T23:24:35.190586] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:35.199391] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-23T23:24:35.380611] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-23T23:24:35.999413] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-23T23:24:36.113693] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T23:24:36.799457] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-23T23:24:37.608536] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-23T23:24:37.631746] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-23T23:24:38.311862] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T23:24:38.399405] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-23T23:24:38.443213] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-23T23:24:38.643606] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T23:24:39.199431] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-23T23:24:39.937816] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T23:24:39.999432] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-23T23:24:40.437831] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T23:24:40.799453] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-23T23:24:41.599415] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-23T23:24:42.053530] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-23T23:24:42.399417] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-23T23:24:42.444294] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-23T23:24:43.199437] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-23T23:24:43.377796] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T23:24:43.552156] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T23:24:43.556936] [INFO ] [REMOTE ] QD: Full fetch complete (39823 records). [2025-10-23T23:24:43.557065] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-23T23:24:43.930327] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-23T23:24:43.930440] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-23T23:24:43.931257] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-23T23:24:43.931346] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-23T23:24:43.932298] [DEBUG] [LOCAL ] QD: Trimmed 39823 records to 27628 (keeping 200 days of data) [2025-10-23T23:24:44.010276] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-23T23:24:44.093062] [DEBUG] [LOCAL ] QD: Primary data saved (27628 records). [2025-10-23T23:24:44.093242] [INFO ] [MAIN ] QD: Full history saved. [2025-10-23T23:24:44.093368] [INFO ] [MAIN ] Update Progress: 1752/2367 symbols completed. QD took 24.2s. Estimated remaining: 1h 18m 52s. Rate: 7.8 symbols/min [2025-10-23T23:24:44.259269] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:44.306464] [DEBUG] [LOCAL ] QSR: Loaded 52450 existing records from primary storage. [2025-10-23T23:24:44.306846] [INFO ] [MAIN ] QSR: Loaded 52450 existing records. [2025-10-23T23:24:44.490767] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:24:44.491027] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-23T23:24:44.491119] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-23T23:24:44.491358] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-23T23:24:44.491451] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-23T23:24:44.804827] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-23T23:24:44.873074] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:45.466114] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T23:24:45.533496] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-23T23:24:45.599421] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-23T23:24:46.399473] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-23T23:24:47.199451] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-23T23:24:47.352876] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-23T23:24:47.673319] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-23T23:24:48.007511] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-23T23:24:48.029223] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:24:48.799496] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-23T23:24:49.192957] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-23T23:24:49.599505] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-23T23:24:49.942219] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-23T23:24:50.399487] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-23T23:24:51.199423] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-23T23:24:51.255341] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T23:24:51.613591] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-23T23:24:51.999414] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-23T23:24:52.331883] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T23:24:52.799418] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-23T23:24:52.926280] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T23:24:53.599457] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-23T23:24:54.399436] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-23T23:24:54.715891] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-23T23:24:55.124321] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-23T23:24:55.199582] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-23T23:24:55.287521] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T23:24:55.847589] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T23:24:55.999480] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-23T23:24:56.799433] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-23T23:24:57.069385] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T23:24:57.599420] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-23T23:24:57.725436] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T23:24:57.733958] [INFO ] [REMOTE ] QGEN: Full fetch complete (70658 records). [2025-10-23T23:24:57.734109] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-23T23:24:58.126271] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-23T23:24:58.126441] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-23T23:24:58.127561] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-23T23:24:58.127733] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-23T23:24:58.129209] [DEBUG] [LOCAL ] QGEN: Trimmed 70658 records to 49391 (keeping 200 days of data) [2025-10-23T23:24:58.419566] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-23T23:24:58.420824] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T23:24:58.468132] [DEBUG] [LOCAL ] QGEN: Primary data saved (49391 records). [2025-10-23T23:24:58.468568] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-23T23:24:58.468735] [INFO ] [MAIN ] Update Progress: 1753/2367 symbols completed. QGEN took 25.6s. Estimated remaining: 1h 18m 46s. Rate: 7.8 symbols/min [2025-10-23T23:24:58.640201] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:24:58.674827] [DEBUG] [LOCAL ] QTWO: Loaded 39446 existing records from primary storage. [2025-10-23T23:24:58.675233] [INFO ] [MAIN ] QTWO: Loaded 39446 existing records. [2025-10-23T23:24:58.852135] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:24:58.852387] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-23T23:24:58.852488] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-23T23:24:58.853079] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-23T23:24:58.853164] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-23T23:24:59.203235] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-23T23:24:59.206939] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:24:59.999411] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-23T23:25:00.069892] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-23T23:25:00.079335] [INFO ] [REMOTE ] QBTS: Full fetch complete (77923 records). [2025-10-23T23:25:00.079540] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-23T23:25:00.466004] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-10-23T23:25:00.466134] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-10-23T23:25:00.467331] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-10-23T23:25:00.467414] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-10-23T23:25:00.468958] [DEBUG] [LOCAL ] QBTS: Trimmed 77923 records to 54210 (keeping 200 days of data) [2025-10-23T23:25:00.798165] [DEBUG] [LOCAL ] QBTS: Primary data saved (54210 records). [2025-10-23T23:25:00.798595] [INFO ] [MAIN ] QBTS: Full history saved. [2025-10-23T23:25:00.798729] [INFO ] [MAIN ] Update Progress: 1754/2367 symbols completed. QBTS took 43.8s. Estimated remaining: 1h 18m 37s. Rate: 7.8 symbols/min [2025-10-23T23:25:00.970301] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:00.992518] [DEBUG] [LOCAL ] QUAD: Loaded 22988 existing records from primary storage. [2025-10-23T23:25:00.992830] [INFO ] [MAIN ] QUAD: Loaded 22988 existing records. [2025-10-23T23:25:01.192972] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:01.209826] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-23T23:25:01.230416] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-23T23:25:01.261094] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-23T23:25:01.269105] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-23T23:25:01.278680] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-23T23:25:01.278967] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-23T23:25:01.302993] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-23T23:25:01.423279] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T23:25:01.604595] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-23T23:25:01.727977] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:02.399438] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-23T23:25:03.199419] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-23T23:25:03.312949] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T23:25:03.349239] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-23T23:25:03.995926] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T23:25:04.000704] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-23T23:25:04.799435] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-23T23:25:05.070957] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-23T23:25:05.599397] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-23T23:25:05.779331] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T23:25:06.000425] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T23:25:06.399427] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-23T23:25:07.197371] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T23:25:07.206044] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-23T23:25:07.999410] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-23T23:25:08.350733] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T23:25:08.377339] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T23:25:08.799478] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-23T23:25:09.438920] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T23:25:09.599440] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-23T23:25:09.974429] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-23T23:25:10.399437] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-23T23:25:11.199423] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-23T23:25:11.280201] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T23:25:11.505839] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-23T23:25:11.999438] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-23T23:25:12.799442] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-23T23:25:13.514694] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-23T23:25:13.607929] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-23T23:25:13.636007] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-23T23:25:13.815088] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T23:25:14.399451] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-23T23:25:15.199434] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-23T23:25:15.388227] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T23:25:15.397951] [INFO ] [REMOTE ] QSR: Full fetch complete (76058 records). [2025-10-23T23:25:15.398148] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-23T23:25:15.867569] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-23T23:25:15.867764] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-23T23:25:15.869352] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-23T23:25:15.869500] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-23T23:25:15.871812] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T23:25:15.882135] [DEBUG] [LOCAL ] QSR: Trimmed 76058 records to 52811 (keeping 200 days of data) [2025-10-23T23:25:15.988963] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T23:25:15.999683] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-23T23:25:16.252934] [DEBUG] [LOCAL ] QSR: Primary data saved (52811 records). [2025-10-23T23:25:16.253087] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-23T23:25:16.253203] [INFO ] [MAIN ] Update Progress: 1755/2367 symbols completed. QSR took 32.2s. Estimated remaining: 1h 18m 32s. Rate: 7.8 symbols/min [2025-10-23T23:25:16.452621] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:16.464198] [DEBUG] [LOCAL ] QVCC: Loaded 8694 existing records from primary storage. [2025-10-23T23:25:16.464445] [INFO ] [MAIN ] QVCC: Loaded 8694 existing records. [2025-10-23T23:25:16.663152] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:16.663377] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-23T23:25:16.663454] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-23T23:25:16.663700] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-23T23:25:16.663774] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-23T23:25:16.804614] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-23T23:25:17.072570] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:17.599492] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-23T23:25:18.176059] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T23:25:18.237925] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-23T23:25:18.399413] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-23T23:25:18.604589] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-23T23:25:18.617183] [INFO ] [REMOTE ] QS: Full fetch complete (77920 records). [2025-10-23T23:25:18.617398] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-23T23:25:18.998603] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-23T23:25:18.998753] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-23T23:25:18.999965] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-23T23:25:19.000066] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-23T23:25:19.001505] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 54150 (keeping 200 days of data) [2025-10-23T23:25:19.204975] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-23T23:25:19.322953] [DEBUG] [LOCAL ] QS: Primary data saved (54150 records). [2025-10-23T23:25:19.323106] [INFO ] [MAIN ] QS: Full history saved. [2025-10-23T23:25:19.324464] [INFO ] [MAIN ] Update Progress: 1756/2367 symbols completed. QS took 44.9s. Estimated remaining: 1h 18m 23s. Rate: 7.8 symbols/min [2025-10-23T23:25:19.498440] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:19.505526] [DEBUG] [LOCAL ] QVCD: Loaded 4565 existing records from primary storage. [2025-10-23T23:25:19.505806] [INFO ] [MAIN ] QVCD: Loaded 4565 existing records. [2025-10-23T23:25:19.687572] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:19.688001] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-23T23:25:19.688091] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-23T23:25:19.688314] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-23T23:25:19.688404] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-23T23:25:20.003011] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-23T23:25:20.016604] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T23:25:20.083175] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:20.091673] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T23:25:20.667783] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T23:25:20.799469] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-23T23:25:21.599494] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-23T23:25:22.388989] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T23:25:22.389803] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T23:25:22.400689] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-23T23:25:23.199460] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-23T23:25:23.413380] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T23:25:23.417191] [INFO ] [REMOTE ] QUAD: Full fetch complete (33914 records). [2025-10-23T23:25:23.417291] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-23T23:25:23.792340] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-23T23:25:23.792452] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-23T23:25:23.793239] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-23T23:25:23.793324] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-23T23:25:23.794186] [DEBUG] [LOCAL ] QUAD: Trimmed 33914 records to 23146 (keeping 200 days of data) [2025-10-23T23:25:23.932611] [DEBUG] [LOCAL ] QUAD: Primary data saved (23146 records). [2025-10-23T23:25:23.932783] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-23T23:25:23.932898] [INFO ] [MAIN ] Update Progress: 1757/2367 symbols completed. QUAD took 23.1s. Estimated remaining: 1h 18m 14s. Rate: 7.8 symbols/min [2025-10-23T23:25:23.999432] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-23T23:25:24.782845] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:25:24.799410] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-23T23:25:24.829706] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T23:25:25.599412] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-23T23:25:25.689022] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T23:25:26.186171] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T23:25:26.399473] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-23T23:25:26.852508] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T23:25:27.199450] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-23T23:25:27.999481] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-23T23:25:28.651325] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-23T23:25:28.720011] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T23:25:28.727403] [INFO ] [REMOTE ] QTWO: Full fetch complete (58181 records). [2025-10-23T23:25:28.727517] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-23T23:25:28.804578] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-23T23:25:29.103164] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-23T23:25:29.103273] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-23T23:25:29.104247] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-23T23:25:29.104324] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-23T23:25:29.105433] [DEBUG] [LOCAL ] QTWO: Trimmed 58181 records to 39712 (keeping 200 days of data) [2025-10-23T23:25:29.326846] [DEBUG] [LOCAL ] QTWO: Primary data saved (39712 records). [2025-10-23T23:25:29.327006] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-23T23:25:29.327115] [INFO ] [MAIN ] Update Progress: 1758/2367 symbols completed. QTWO took 30.9s. Estimated remaining: 1h 18m 5s. Rate: 7.8 symbols/min [2025-10-23T23:25:29.476742] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-23T23:25:29.599460] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-23T23:25:30.399448] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-23T23:25:30.443123] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T23:25:31.204285] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-23T23:25:31.205122] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T23:25:31.855978] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T23:25:31.999449] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-23T23:25:32.480831] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T23:25:32.799431] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-23T23:25:33.471825] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-23T23:25:33.599451] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-23T23:25:34.159316] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-23T23:25:34.399423] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-23T23:25:35.024982] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-23T23:25:35.026467] [INFO ] [REMOTE ] QVCD: Full fetch complete (6184 records). [2025-10-23T23:25:35.026561] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-23T23:25:35.202105] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-23T23:25:35.430289] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-23T23:25:35.430406] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-23T23:25:35.430734] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-23T23:25:35.430814] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-23T23:25:35.431270] [DEBUG] [LOCAL ] QVCD: Trimmed 6184 records to 4583 (keeping 200 days of data) [2025-10-23T23:25:35.463713] [DEBUG] [LOCAL ] QVCD: Primary data saved (4583 records). [2025-10-23T23:25:35.463887] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-23T23:25:35.464003] [INFO ] [MAIN ] Update Progress: 1759/2367 symbols completed. QVCD took 16.1s. Estimated remaining: 1h 17m 57s. Rate: 7.8 symbols/min [2025-10-23T23:25:35.870637] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-23T23:25:35.999428] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-23T23:25:36.640257] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-23T23:25:36.799440] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-23T23:25:37.509928] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T23:25:37.599423] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-23T23:25:38.334898] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-23T23:25:38.337403] [INFO ] [REMOTE ] QVCC: Full fetch complete (11885 records). [2025-10-23T23:25:38.337550] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-23T23:25:38.700039] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-23T23:25:38.700167] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-23T23:25:38.700473] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-23T23:25:38.700547] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-23T23:25:38.701165] [DEBUG] [LOCAL ] QVCC: Trimmed 11885 records to 8745 (keeping 200 days of data) [2025-10-23T23:25:38.753492] [DEBUG] [LOCAL ] QVCC: Primary data saved (8745 records). [2025-10-23T23:25:38.753697] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-23T23:25:38.753816] [INFO ] [MAIN ] Update Progress: 1760/2367 symbols completed. QVCC took 22.5s. Estimated remaining: 1h 17m 48s. Rate: 7.8 symbols/min [2025-10-23T23:25:39.414031] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:39.361385] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:39.437515] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:39.439430] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:25:39.485899] [DEBUG] [LOCAL ] R: Loaded 27881 existing records from primary storage. [2025-10-23T23:25:39.486400] [INFO ] [MAIN ] R: Loaded 27881 existing records. [2025-10-23T23:25:39.483799] [DEBUG] [LOCAL ] RA: Loaded 21871 existing records from primary storage. [2025-10-23T23:25:39.520156] [INFO ] [MAIN ] RA: Loaded 21871 existing records. [2025-10-23T23:25:39.520868] [DEBUG] [LOCAL ] RACE: Loaded 32943 existing records from primary storage. [2025-10-23T23:25:39.617142] [INFO ] [MAIN ] RACE: Loaded 32943 existing records. [2025-10-23T23:25:39.777483] [DEBUG] [LOCAL ] QXO: Loaded 53475 existing records from primary storage. [2025-10-23T23:25:39.832415] [INFO ] [MAIN ] QXO: Loaded 53475 existing records. [2025-10-23T23:25:40.008377] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:40.107432] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-23T23:25:40.179057] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-23T23:25:40.155799] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:40.199945] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:40.196621] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-23T23:25:40.216786] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-23T23:25:40.200020] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-23T23:25:40.222056] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-23T23:25:40.227356] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-23T23:25:40.232590] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-23T23:25:40.299596] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-23T23:25:40.347851] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-23T23:25:40.340677] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-23T23:25:40.383156] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:25:40.379731] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-23T23:25:40.383343] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-23T23:25:40.476358] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-23T23:25:40.587570] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-23T23:25:40.601440] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-23T23:25:41.217911] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:41.299014] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-23T23:25:41.724167] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:41.716123] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:41.777474] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:25:41.778331] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-23T23:25:41.778636] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-23T23:25:41.778074] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-23T23:25:42.886532] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T23:25:42.892093] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-23T23:25:42.932186] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:25:42.938804] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-23T23:25:42.988314] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T23:25:43.199421] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-23T23:25:43.582914] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T23:25:43.999427] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-23T23:25:44.046159] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-23T23:25:44.162980] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T23:25:44.775629] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T23:25:44.799394] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-23T23:25:45.432131] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-23T23:25:45.599449] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-23T23:25:46.399408] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-23T23:25:46.526904] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T23:25:47.028576] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T23:25:47.199428] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-23T23:25:47.494722] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-23T23:25:47.999432] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-23T23:25:48.799431] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-23T23:25:48.862783] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T23:25:49.600299] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-23T23:25:49.602863] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T23:25:50.399435] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-23T23:25:50.595780] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:25:51.207159] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-23T23:25:51.209400] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T23:25:51.486522] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-23T23:25:51.999501] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-23T23:25:52.799425] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-23T23:25:53.105549] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T23:25:53.380999] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-23T23:25:53.442682] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T23:25:53.599454] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-23T23:25:54.399491] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-23T23:25:55.199434] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-23T23:25:55.385145] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T23:25:56.004521] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-23T23:25:56.014513] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T23:25:56.417267] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-23T23:25:56.799443] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-23T23:25:57.599461] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-23T23:25:57.878511] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-23T23:25:57.931855] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T23:25:58.399452] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-23T23:25:58.825556] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T23:25:59.199459] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-23T23:25:59.999468] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-23T23:26:00.379787] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T23:26:00.502428] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-23T23:26:00.799458] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-23T23:26:01.047095] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-23T23:26:01.599491] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-23T23:26:01.963932] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-23T23:26:02.399461] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-23T23:26:03.199462] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-23T23:26:03.507255] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T23:26:03.854875] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:26:03.876068] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T23:26:03.999526] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-23T23:26:04.799412] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-23T23:26:05.098364] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T23:26:05.102700] [INFO ] [REMOTE ] RA: Full fetch complete (31934 records). [2025-10-23T23:26:05.102797] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-23T23:26:05.505604] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-23T23:26:05.505776] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-23T23:26:05.506449] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-23T23:26:05.506525] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-23T23:26:05.507473] [DEBUG] [LOCAL ] RA: Trimmed 31934 records to 22073 (keeping 200 days of data) [2025-10-23T23:26:05.599561] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-23T23:26:05.642623] [DEBUG] [LOCAL ] RA: Primary data saved (22073 records). [2025-10-23T23:26:05.642801] [INFO ] [MAIN ] RA: Full history saved. [2025-10-23T23:26:05.642914] [INFO ] [MAIN ] Update Progress: 1761/2367 symbols completed. RA took 26.9s. Estimated remaining: 1h 17m 47s. Rate: 7.8 symbols/min [2025-10-23T23:26:05.820954] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:05.855749] [DEBUG] [LOCAL ] RAMP: Loaded 37664 existing records from primary storage. [2025-10-23T23:26:05.856072] [INFO ] [MAIN ] RAMP: Loaded 37664 existing records. [2025-10-23T23:26:06.038809] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:06.039126] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-23T23:26:06.039232] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-23T23:26:06.039622] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-23T23:26:06.039789] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-23T23:26:06.160968] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T23:26:06.399780] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-23T23:26:06.425339] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:07.199437] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-23T23:26:07.821998] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-23T23:26:07.999429] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-23T23:26:08.315445] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-23T23:26:08.323316] [INFO ] [REMOTE ] RACE: Full fetch complete (49603 records). [2025-10-23T23:26:08.323450] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-23T23:26:08.704201] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T23:26:08.794580] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-23T23:26:08.794712] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-23T23:26:08.795854] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-23T23:26:08.795934] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-23T23:26:08.797060] [DEBUG] [LOCAL ] RACE: Trimmed 49603 records to 33262 (keeping 200 days of data) [2025-10-23T23:26:08.846772] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-23T23:26:08.996837] [DEBUG] [LOCAL ] RACE: Primary data saved (33262 records). [2025-10-23T23:26:08.997008] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-23T23:26:08.997161] [INFO ] [MAIN ] Update Progress: 1762/2367 symbols completed. RACE took 30.2s. Estimated remaining: 1h 17m 38s. Rate: 7.8 symbols/min [2025-10-23T23:26:09.167548] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:09.188104] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-23T23:26:09.230494] [DEBUG] [LOCAL ] RBA: Loaded 46060 existing records from primary storage. [2025-10-23T23:26:09.230835] [INFO ] [MAIN ] RBA: Loaded 46060 existing records. [2025-10-23T23:26:09.403229] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:09.403442] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-23T23:26:09.403517] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-23T23:26:09.403777] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-10-23T23:26:09.403851] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-23T23:26:09.607919] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-23T23:26:09.755313] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:10.399443] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-23T23:26:10.606357] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T23:26:10.611555] [INFO ] [REMOTE ] R: Full fetch complete (42483 records). [2025-10-23T23:26:10.611700] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-23T23:26:11.017952] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-23T23:26:11.018075] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-23T23:26:11.019117] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-23T23:26:11.019221] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-23T23:26:11.030773] [DEBUG] [LOCAL ] R: Trimmed 42483 records to 28186 (keeping 200 days of data) [2025-10-23T23:26:11.051507] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T23:26:11.202962] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-23T23:26:11.232504] [DEBUG] [LOCAL ] R: Primary data saved (28186 records). [2025-10-23T23:26:11.232665] [INFO ] [MAIN ] R: Full history saved. [2025-10-23T23:26:11.232797] [INFO ] [MAIN ] Update Progress: 1763/2367 symbols completed. R took 32.5s. Estimated remaining: 1h 17m 28s. Rate: 7.8 symbols/min [2025-10-23T23:26:11.400698] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:11.415583] [DEBUG] [LOCAL ] RBC: Loaded 15288 existing records from primary storage. [2025-10-23T23:26:11.415866] [INFO ] [MAIN ] RBC: Loaded 15288 existing records. [2025-10-23T23:26:11.592066] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:11.592492] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-23T23:26:11.592717] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-23T23:26:11.593167] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-23T23:26:11.593338] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-23T23:26:11.994828] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:11.996090] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:26:11.999578] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-23T23:26:12.799448] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-23T23:26:12.930360] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T23:26:13.242243] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T23:26:13.251820] [INFO ] [REMOTE ] QXO: Full fetch complete (76304 records). [2025-10-23T23:26:13.252007] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-23T23:26:13.618878] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-23T23:26:13.648424] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-23T23:26:13.648553] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-23T23:26:13.649753] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-23T23:26:13.649845] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-23T23:26:13.651354] [DEBUG] [LOCAL ] QXO: Trimmed 76304 records to 53865 (keeping 200 days of data) [2025-10-23T23:26:13.965798] [DEBUG] [LOCAL ] QXO: Primary data saved (53865 records). [2025-10-23T23:26:13.965980] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-23T23:26:13.966095] [INFO ] [MAIN ] Update Progress: 1764/2367 symbols completed. QXO took 35.2s. Estimated remaining: 1h 17m 19s. Rate: 7.8 symbols/min [2025-10-23T23:26:14.143487] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:14.194047] [DEBUG] [LOCAL ] RBLX: Loaded 53718 existing records from primary storage. [2025-10-23T23:26:14.194406] [INFO ] [MAIN ] RBLX: Loaded 53718 existing records. [2025-10-23T23:26:14.407507] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:14.403557] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-23T23:26:14.409392] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T23:26:14.419583] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-23T23:26:14.420122] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-23T23:26:14.420744] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-23T23:26:14.420821] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-23T23:26:14.775780] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:15.199404] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-23T23:26:15.266466] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T23:26:15.513538] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T23:26:15.999435] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-23T23:26:16.799480] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-23T23:26:17.357323] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-23T23:26:17.484152] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T23:26:17.599417] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-23T23:26:18.308812] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T23:26:18.399466] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-23T23:26:18.963052] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T23:26:19.199479] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-23T23:26:19.999443] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-23T23:26:20.092859] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T23:26:20.218640] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-23T23:26:20.799448] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-23T23:26:21.351632] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-23T23:26:21.599488] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-23T23:26:22.399437] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-23T23:26:23.090584] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-23T23:26:23.207709] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-23T23:26:23.226802] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T23:26:23.424458] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T23:26:23.999480] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-23T23:26:24.799433] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-23T23:26:25.375236] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-23T23:26:25.376321] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-23T23:26:25.599430] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-23T23:26:26.067229] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T23:26:26.399440] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-23T23:26:27.111818] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-23T23:26:27.199436] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-23T23:26:27.999414] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-23T23:26:28.429723] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-23T23:26:28.662029] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:26:28.799419] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-23T23:26:29.017021] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T23:26:29.599453] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-23T23:26:30.399446] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-23T23:26:31.143252] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-23T23:26:31.199157] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T23:26:31.207901] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-23T23:26:31.246314] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-23T23:26:31.999458] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-23T23:26:32.799437] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-23T23:26:33.558102] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-23T23:26:33.605018] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-23T23:26:33.610520] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-23T23:26:34.378149] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:26:34.385578] [INFO ] [REMOTE ] RAMP: Full fetch complete (54898 records). [2025-10-23T23:26:34.385767] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-23T23:26:34.407082] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-23T23:26:34.779998] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-23T23:26:34.780133] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-23T23:26:34.781184] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-23T23:26:34.781265] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-23T23:26:34.782511] [DEBUG] [LOCAL ] RAMP: Trimmed 54898 records to 37923 (keeping 200 days of data) [2025-10-23T23:26:35.016549] [DEBUG] [LOCAL ] RAMP: Primary data saved (37923 records). [2025-10-23T23:26:35.016753] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-23T23:26:35.016872] [INFO ] [MAIN ] Update Progress: 1765/2367 symbols completed. RAMP took 29.4s. Estimated remaining: 1h 17m 16s. Rate: 7.8 symbols/min [2025-10-23T23:26:35.188353] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:35.196630] [DEBUG] [LOCAL ] RBOT: Loaded 6236 existing records from primary storage. [2025-10-23T23:26:35.196882] [INFO ] [MAIN ] RBOT: Loaded 6236 existing records. [2025-10-23T23:26:35.227544] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-23T23:26:35.375904] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:35.376250] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-23T23:26:35.391039] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-23T23:26:35.400458] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-23T23:26:35.401026] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-23T23:26:35.401846] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T23:26:35.762141] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:35.999407] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-23T23:26:36.310071] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T23:26:36.799422] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-23T23:26:37.019783] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-23T23:26:37.604278] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-23T23:26:37.611771] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:26:37.763514] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T23:26:38.399429] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-23T23:26:39.199481] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-23T23:26:39.997464] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T23:26:40.005397] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-23T23:26:40.007496] [INFO ] [REMOTE ] RBA: Full fetch complete (66620 records). [2025-10-23T23:26:40.007928] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-23T23:26:40.161916] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T23:26:40.404564] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-23T23:26:40.459515] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-23T23:26:40.459636] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-23T23:26:40.460935] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-23T23:26:40.461346] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-23T23:26:40.462689] [DEBUG] [LOCAL ] RBA: Trimmed 66620 records to 46387 (keeping 200 days of data) [2025-10-23T23:26:40.747847] [DEBUG] [LOCAL ] RBA: Primary data saved (46387 records). [2025-10-23T23:26:40.748003] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-23T23:26:40.748117] [INFO ] [MAIN ] Update Progress: 1766/2367 symbols completed. RBA took 31.8s. Estimated remaining: 1h 17m 7s. Rate: 7.8 symbols/min [2025-10-23T23:26:40.804599] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-23T23:26:40.857261] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T23:26:40.927228] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:40.975565] [DEBUG] [LOCAL ] RBRK: Loaded 53165 existing records from primary storage. [2025-10-23T23:26:40.975938] [INFO ] [MAIN ] RBRK: Loaded 53165 existing records. [2025-10-23T23:26:41.152943] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:41.153155] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-23T23:26:41.153232] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-23T23:26:41.153487] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-23T23:26:41.153564] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-23T23:26:41.499439] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:41.599429] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-23T23:26:42.399475] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-23T23:26:43.199422] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-23T23:26:43.309347] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-23T23:26:43.454201] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T23:26:43.457013] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T23:26:43.470302] [INFO ] [REMOTE ] RBC: Full fetch complete (21925 records). [2025-10-23T23:26:43.470409] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-23T23:26:43.762600] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-23T23:26:43.847368] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-23T23:26:43.847509] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-23T23:26:43.848057] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-23T23:26:43.848134] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-23T23:26:43.848772] [DEBUG] [LOCAL ] RBC: Trimmed 21925 records to 15417 (keeping 200 days of data) [2025-10-23T23:26:43.942149] [DEBUG] [LOCAL ] RBC: Primary data saved (15417 records). [2025-10-23T23:26:43.942300] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-23T23:26:43.942428] [INFO ] [MAIN ] Update Progress: 1767/2367 symbols completed. RBC took 32.7s. Estimated remaining: 1h 16m 58s. Rate: 7.8 symbols/min [2025-10-23T23:26:44.004545] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-23T23:26:44.112150] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:44.153769] [DEBUG] [LOCAL ] RC: Loaded 48871 existing records from primary storage. [2025-10-23T23:26:44.154097] [INFO ] [MAIN ] RC: Loaded 48871 existing records. [2025-10-23T23:26:44.331131] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:26:44.331356] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-23T23:26:44.331434] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-23T23:26:44.331688] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-23T23:26:44.331762] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-23T23:26:44.681958] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:44.799421] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-23T23:26:45.599478] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-23T23:26:46.388159] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T23:26:46.399389] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-23T23:26:46.477499] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-23T23:26:46.486810] [INFO ] [REMOTE ] RBLX: Full fetch complete (77886 records). [2025-10-23T23:26:46.486973] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-23T23:26:46.874812] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-23T23:26:46.874970] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-23T23:26:46.876345] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-23T23:26:46.876549] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-23T23:26:46.878180] [DEBUG] [LOCAL ] RBLX: Trimmed 77886 records to 54107 (keeping 200 days of data) [2025-10-23T23:26:47.112530] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-23T23:26:47.213162] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-23T23:26:47.241848] [DEBUG] [LOCAL ] RBLX: Primary data saved (54107 records). [2025-10-23T23:26:47.242000] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-23T23:26:47.242135] [INFO ] [MAIN ] Update Progress: 1768/2367 symbols completed. RBLX took 33.3s. Estimated remaining: 1h 16m 49s. Rate: 7.8 symbols/min [2025-10-23T23:26:47.431578] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:26:47.431776] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-23T23:26:47.431845] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-23T23:26:47.431952] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-23T23:26:47.432020] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-23T23:26:47.432097] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-23T23:26:47.432207] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-23T23:26:47.776485] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:26:47.881539] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-23T23:26:47.999402] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-23T23:26:48.119714] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-23T23:26:48.429906] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-23T23:26:48.799432] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-23T23:26:49.599503] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-23T23:26:50.399503] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-23T23:26:50.622518] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-23T23:26:50.968247] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T23:26:51.199440] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-23T23:26:51.492856] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-23T23:26:51.809100] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-23T23:26:51.999441] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-23T23:26:52.411358] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-23T23:26:52.799418] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-23T23:26:53.599487] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-23T23:26:54.399421] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-23T23:26:54.660766] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T23:26:54.970521] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-23T23:26:55.200634] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-23T23:26:55.206054] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T23:26:55.999434] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-23T23:26:56.577017] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T23:26:56.799424] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-23T23:26:56.946786] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T23:26:57.399710] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-23T23:26:57.599453] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-23T23:26:58.399457] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-23T23:26:59.124540] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T23:26:59.199433] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-23T23:26:59.295505] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T23:26:59.649508] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-23T23:26:59.999482] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-23T23:27:00.777875] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T23:27:00.799401] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-23T23:27:01.599424] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-23T23:27:01.670780] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T23:27:01.673495] [INFO ] [REMOTE ] RBOT: Full fetch complete (9191 records). [2025-10-23T23:27:01.673604] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-23T23:27:02.030774] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-23T23:27:02.030889] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-23T23:27:02.031123] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-23T23:27:02.031193] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-23T23:27:02.031703] [DEBUG] [LOCAL ] RBOT: Trimmed 9191 records to 6293 (keeping 200 days of data) [2025-10-23T23:27:02.066600] [DEBUG] [LOCAL ] RBOT: Primary data saved (6293 records). [2025-10-23T23:27:02.066783] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-23T23:27:02.066897] [INFO ] [MAIN ] Update Progress: 1769/2367 symbols completed. RBOT took 27.0s. Estimated remaining: 1h 16m 43s. Rate: 7.8 symbols/min [2025-10-23T23:27:02.233355] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:02.239005] [DEBUG] [LOCAL ] RCD: Loaded 3332 existing records from primary storage. [2025-10-23T23:27:02.239211] [INFO ] [MAIN ] RCD: Loaded 3332 existing records. [2025-10-23T23:27:02.413322] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-23T23:27:02.418522] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:02.419430] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-23T23:27:02.419530] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-23T23:27:02.419805] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-10-23T23:27:02.419905] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-23T23:27:02.772870] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:03.056401] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T23:27:03.199450] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-23T23:27:03.772495] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-23T23:27:03.870340] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T23:27:03.999441] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-23T23:27:04.438000] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T23:27:04.799432] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-23T23:27:05.585865] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T23:27:05.599392] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-23T23:27:06.173270] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-23T23:27:06.399483] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-23T23:27:07.199452] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-23T23:27:07.999432] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-23T23:27:08.088147] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T23:27:08.557936] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T23:27:08.799448] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-23T23:27:09.227847] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-23T23:27:09.599442] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-23T23:27:10.028276] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-23T23:27:10.399421] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-23T23:27:10.544558] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-23T23:27:10.736669] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-23T23:27:11.199457] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-23T23:27:11.540912] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-23T23:27:11.999434] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-23T23:27:12.799449] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-23T23:27:13.241101] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T23:27:13.599403] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-23T23:27:13.703205] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T23:27:14.399446] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-23T23:27:15.199427] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-23T23:27:15.670885] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-23T23:27:15.703696] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T23:27:15.774114] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T23:27:15.999415] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-23T23:27:16.799434] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-23T23:27:17.342626] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-23T23:27:17.599435] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-23T23:27:18.260470] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-23T23:27:18.399407] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-23T23:27:19.199427] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-23T23:27:19.331420] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-23T23:27:19.339997] [INFO ] [REMOTE ] RC: Full fetch complete (71082 records). [2025-10-23T23:27:19.340140] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-23T23:27:19.581334] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-23T23:27:19.630795] [INFO ] [REMOTE ] RCB: Full fetch complete (3711 records). [2025-10-23T23:27:19.641440] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-23T23:27:19.896738] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-23T23:27:19.925491] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T23:27:19.925700] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:27:19.920950] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-23T23:27:19.927188] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-23T23:27:19.925827] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:27:19.927319] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-23T23:27:19.927592] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-23T23:27:19.927713] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-23T23:27:19.927815] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-23T23:27:19.927898] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-23T23:27:19.928240] [INFO ] [MAIN ] Update Progress: 1770/2367 symbols completed. RCB took 32.7s. Estimated remaining: 1h 16m 39s. Rate: 7.8 symbols/min [2025-10-23T23:27:20.002621] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-23T23:27:20.008259] [DEBUG] [LOCAL ] RC: Trimmed 71082 records to 49201 (keeping 200 days of data) [2025-10-23T23:27:20.188016] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:20.418081] [DEBUG] [LOCAL ] RCI: Loaded 48578 existing records from primary storage. [2025-10-23T23:27:20.426306] [DEBUG] [LOCAL ] RC: Primary data saved (49201 records). [2025-10-23T23:27:20.426853] [INFO ] [MAIN ] RC: Full history saved. [2025-10-23T23:27:20.426417] [INFO ] [MAIN ] RCI: Loaded 48578 existing records. [2025-10-23T23:27:20.426994] [INFO ] [MAIN ] Update Progress: 1771/2367 symbols completed. RC took 36.5s. Estimated remaining: 1h 16m 29s. Rate: 7.8 symbols/min [2025-10-23T23:27:20.743267] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T23:27:20.762553] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:20.807196] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:20.801424] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-23T23:27:20.807543] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-23T23:27:20.807910] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-23T23:27:20.809170] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-23T23:27:20.809469] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-23T23:27:20.809368] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-23T23:27:20.809595] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-23T23:27:20.809931] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-23T23:27:20.810247] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-23T23:27:20.818575] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-23T23:27:20.876821] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-23T23:27:20.955325] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-23T23:27:21.079928] [INFO ] [REMOTE ] RBRK: Full fetch complete (76707 records). [2025-10-23T23:27:21.140294] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-23T23:27:21.697581] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T23:27:21.779501] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:21.749184] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-23T23:27:22.089911] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:22.144924] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-23T23:27:22.145055] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-23T23:27:22.146236] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-23T23:27:22.146323] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-23T23:27:22.147911] [DEBUG] [LOCAL ] RBRK: Trimmed 76707 records to 53553 (keeping 200 days of data) [2025-10-23T23:27:22.415417] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-23T23:27:22.468564] [DEBUG] [LOCAL ] RBRK: Primary data saved (53553 records). [2025-10-23T23:27:22.468735] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-23T23:27:22.468845] [INFO ] [MAIN ] Update Progress: 1772/2367 symbols completed. RBRK took 41.7s. Estimated remaining: 1h 16m 19s. Rate: 7.8 symbols/min [2025-10-23T23:27:22.541379] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T23:27:22.575038] [INFO ] [REMOTE ] RCD: Full fetch complete (5825 records). [2025-10-23T23:27:22.575206] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-23T23:27:22.751158] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:22.883341] [DEBUG] [LOCAL ] RCS: Loaded 12437 existing records from primary storage. [2025-10-23T23:27:22.920754] [INFO ] [MAIN ] RCS: Loaded 12437 existing records. [2025-10-23T23:27:23.178703] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-23T23:27:23.181428] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-23T23:27:23.182040] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-23T23:27:23.182145] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-23T23:27:23.204548] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:23.204668] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-23T23:27:23.204890] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-23T23:27:23.205180] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-23T23:27:23.206349] [DEBUG] [LOCAL ] RCD: Trimmed 5825 records to 3372 (keeping 200 days of data) [2025-10-23T23:27:23.206685] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-23T23:27:23.206946] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-23T23:27:23.241513] [DEBUG] [LOCAL ] RCD: Primary data saved (3372 records). [2025-10-23T23:27:23.286731] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-23T23:27:23.309074] [INFO ] [MAIN ] Update Progress: 1773/2367 symbols completed. RCD took 21.2s. Estimated remaining: 1h 16m 9s. Rate: 7.8 symbols/min [2025-10-23T23:27:23.693448] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:23.824594] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:23.853706] [DEBUG] [LOCAL ] RCUS: Loaded 42963 existing records from primary storage. [2025-10-23T23:27:23.854061] [INFO ] [MAIN ] RCUS: Loaded 42963 existing records. [2025-10-23T23:27:23.999780] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-23T23:27:24.034990] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:24.035222] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-23T23:27:24.035404] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-23T23:27:24.035629] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-10-23T23:27:24.035742] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-23T23:27:24.183484] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-23T23:27:24.420662] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:24.799497] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-23T23:27:25.134887] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T23:27:25.263101] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T23:27:25.599461] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-23T23:27:26.161947] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T23:27:26.399518] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-23T23:27:27.199533] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-23T23:27:27.287228] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T23:27:27.309883] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T23:27:27.999494] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-23T23:27:28.673207] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:27:28.795977] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T23:27:28.799391] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-23T23:27:29.599434] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-23T23:27:29.726785] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T23:27:30.399432] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-23T23:27:31.199442] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-23T23:27:31.453106] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T23:27:31.999401] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-23T23:27:32.083902] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T23:27:32.366630] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T23:27:32.799426] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-23T23:27:33.599412] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-23T23:27:33.677333] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T23:27:33.946828] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-23T23:27:34.399472] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-23T23:27:34.857508] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-23T23:27:35.199424] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-23T23:27:35.999439] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-23T23:27:36.455753] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T23:27:36.799487] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-23T23:27:36.870613] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:27:36.962503] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T23:27:37.599445] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-23T23:27:38.381477] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T23:27:38.399393] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-23T23:27:38.793898] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-23T23:27:39.199440] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-23T23:27:39.999425] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-23T23:27:40.088476] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:27:40.799438] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-23T23:27:41.161046] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T23:27:41.501132] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-23T23:27:41.532206] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T23:27:41.599405] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-23T23:27:42.399484] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-23T23:27:43.165018] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T23:27:43.199474] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-23T23:27:43.952103] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T23:27:43.999401] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-23T23:27:44.799449] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-23T23:27:45.432120] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T23:27:45.517677] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T23:27:45.599410] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-23T23:27:46.399404] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-23T23:27:46.592184] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T23:27:46.969414] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T23:27:47.199446] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-23T23:27:47.559664] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T23:27:47.999508] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-23T23:27:48.765051] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T23:27:48.799405] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-23T23:27:49.074572] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T23:27:49.078108] [INFO ] [REMOTE ] RCS: Full fetch complete (18900 records). [2025-10-23T23:27:49.078204] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-23T23:27:49.439039] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-23T23:27:49.439157] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-23T23:27:49.439608] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-23T23:27:49.439701] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-23T23:27:49.440310] [DEBUG] [LOCAL ] RCS: Trimmed 18900 records to 12530 (keeping 200 days of data) [2025-10-23T23:27:49.511116] [DEBUG] [LOCAL ] RCS: Primary data saved (12530 records). [2025-10-23T23:27:49.511285] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-23T23:27:49.511394] [INFO ] [MAIN ] Update Progress: 1774/2367 symbols completed. RCS took 27.0s. Estimated remaining: 1h 16m 8s. Rate: 7.8 symbols/min [2025-10-23T23:27:49.606857] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-23T23:27:49.683611] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:49.733956] [DEBUG] [LOCAL ] RDDT: Loaded 53772 existing records from primary storage. [2025-10-23T23:27:49.734317] [INFO ] [MAIN ] RDDT: Loaded 53772 existing records. [2025-10-23T23:27:49.919290] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:49.919580] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-23T23:27:49.919696] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-23T23:27:49.919965] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-10-23T23:27:49.920054] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-23T23:27:50.284974] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:50.320232] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T23:27:50.399403] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-23T23:27:51.199469] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-23T23:27:51.652447] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-23T23:27:51.999424] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-23T23:27:52.765298] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-23T23:27:52.801418] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-23T23:27:52.806706] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-23T23:27:53.192258] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T23:27:53.200174] [INFO ] [REMOTE ] RCUS: Full fetch complete (61268 records). [2025-10-23T23:27:53.200300] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-23T23:27:53.580854] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-23T23:27:53.580980] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-23T23:27:53.581981] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-23T23:27:53.582057] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-23T23:27:53.583242] [DEBUG] [LOCAL ] RCUS: Trimmed 61268 records to 43277 (keeping 200 days of data) [2025-10-23T23:27:53.631069] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-23T23:27:53.829061] [DEBUG] [LOCAL ] RCUS: Primary data saved (43277 records). [2025-10-23T23:27:53.829216] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-23T23:27:53.829324] [INFO ] [MAIN ] Update Progress: 1775/2367 symbols completed. RCUS took 30.5s. Estimated remaining: 1h 15m 59s. Rate: 7.8 symbols/min [2025-10-23T23:27:53.999603] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:54.037676] [DEBUG] [LOCAL ] RDN: Loaded 44108 existing records from primary storage. [2025-10-23T23:27:54.038023] [INFO ] [MAIN ] RDN: Loaded 44108 existing records. [2025-10-23T23:27:54.215576] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:54.215904] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-23T23:27:54.216046] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-23T23:27:54.216351] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-23T23:27:54.216435] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-23T23:27:54.343180] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-23T23:27:54.405030] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-23T23:27:54.634882] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:55.199465] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-23T23:27:55.618893] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T23:27:55.627461] [INFO ] [REMOTE ] RCL: Full fetch complete (75397 records). [2025-10-23T23:27:55.627611] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-23T23:27:56.003040] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-23T23:27:56.054608] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-10-23T23:27:56.055583] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T23:27:56.055809] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-10-23T23:27:56.057128] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-10-23T23:27:56.065846] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-10-23T23:27:56.066198] [INFO ] [REMOTE ] RCI: Full fetch complete (70713 records). [2025-10-23T23:27:56.066306] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-23T23:27:56.080875] [DEBUG] [LOCAL ] RCL: Trimmed 75397 records to 52040 (keeping 200 days of data) [2025-10-23T23:27:56.720339] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-23T23:27:56.721873] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-23T23:27:56.723900] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-23T23:27:56.724269] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-23T23:27:56.759385] [DEBUG] [LOCAL ] RCI: Trimmed 70713 records to 48956 (keeping 200 days of data) [2025-10-23T23:27:56.908623] [DEBUG] [LOCAL ] RCL: Primary data saved (52040 records). [2025-10-23T23:27:56.910871] [INFO ] [MAIN ] RCL: Full history saved. [2025-10-23T23:27:56.912945] [INFO ] [MAIN ] Update Progress: 1776/2367 symbols completed. RCL took 36.5s. Estimated remaining: 1h 15m 50s. Rate: 7.8 symbols/min [2025-10-23T23:27:57.188328] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:57.284975] [DEBUG] [LOCAL ] RCI: Primary data saved (48956 records). [2025-10-23T23:27:57.285169] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-23T23:27:57.285321] [INFO ] [MAIN ] Update Progress: 1777/2367 symbols completed. RCI took 37.4s. Estimated remaining: 1h 15m 40s. Rate: 7.8 symbols/min [2025-10-23T23:27:57.407848] [DEBUG] [LOCAL ] RDW: Loaded 52288 existing records from primary storage. [2025-10-23T23:27:57.447399] [INFO ] [MAIN ] RDW: Loaded 52288 existing records. [2025-10-23T23:27:57.479239] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:27:57.664138] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:57.664841] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-23T23:27:57.665012] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-23T23:27:57.679072] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-23T23:27:57.690740] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T23:27:57.690804] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-23T23:27:57.740957] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-23T23:27:57.858638] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-23T23:27:57.979056] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-23T23:27:57.986335] [DEBUG] [LOCAL ] RDY: Loaded 46215 existing records from primary storage. [2025-10-23T23:27:58.033786] [INFO ] [MAIN ] RDY: Loaded 46215 existing records. [2025-10-23T23:27:58.303241] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:58.324966] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:27:58.325170] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-23T23:27:58.325244] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-23T23:27:58.325491] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-23T23:27:58.325562] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-23T23:27:58.404565] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-23T23:27:58.681511] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:27:59.199424] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-23T23:27:59.510816] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T23:27:59.999464] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-23T23:28:00.532739] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-23T23:28:00.631971] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-23T23:28:00.704495] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T23:28:00.799412] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-23T23:28:01.599440] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-23T23:28:01.799156] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:28:02.399450] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-23T23:28:02.921000] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-23T23:28:03.199438] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-23T23:28:03.996775] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:28:04.003256] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-23T23:28:04.193631] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-23T23:28:04.799438] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-23T23:28:05.000549] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:28:05.599477] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-23T23:28:05.743934] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:28:06.399429] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-23T23:28:06.557853] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T23:28:07.199496] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-23T23:28:07.999514] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-23T23:28:08.247107] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-23T23:28:08.367930] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-23T23:28:08.799470] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-23T23:28:09.001279] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-23T23:28:09.085534] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T23:28:09.599447] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-23T23:28:10.399450] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-23T23:28:11.208100] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-23T23:28:11.214115] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-23T23:28:11.249761] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T23:28:11.999403] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-23T23:28:12.495094] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-23T23:28:12.799408] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-23T23:28:12.902124] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:28:13.599488] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-23T23:28:14.399407] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-23T23:28:14.627686] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-23T23:28:15.158613] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-23T23:28:15.199413] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-23T23:28:15.270714] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-23T23:28:15.999413] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-23T23:28:16.079226] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T23:28:16.799475] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-23T23:28:17.426266] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T23:28:17.599606] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-23T23:28:17.605406] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-23T23:28:18.399426] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-23T23:28:18.430902] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T23:28:18.683279] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:28:19.199446] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-23T23:28:19.999436] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-23T23:28:20.756565] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-23T23:28:20.799433] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-23T23:28:21.390490] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-23T23:28:21.599419] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-23T23:28:21.663605] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T23:28:22.399447] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-23T23:28:23.082745] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T23:28:23.090357] [INFO ] [REMOTE ] RDN: Full fetch complete (65777 records). [2025-10-23T23:28:23.090693] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-23T23:28:23.201173] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-23T23:28:23.203017] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-23T23:28:23.518846] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-23T23:28:23.518950] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-23T23:28:23.520066] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-23T23:28:23.520147] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-23T23:28:23.521412] [DEBUG] [LOCAL ] RDN: Trimmed 65777 records to 44353 (keeping 200 days of data) [2025-10-23T23:28:23.768072] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T23:28:23.829357] [DEBUG] [LOCAL ] RDN: Primary data saved (44353 records). [2025-10-23T23:28:23.829527] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-23T23:28:23.830790] [INFO ] [MAIN ] Update Progress: 1778/2367 symbols completed. RDN took 30.0s. Estimated remaining: 1h 15m 38s. Rate: 7.8 symbols/min [2025-10-23T23:28:24.023294] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:24.018942] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-23T23:28:24.073837] [DEBUG] [LOCAL ] RELX: Loaded 48581 existing records from primary storage. [2025-10-23T23:28:24.074181] [INFO ] [MAIN ] RELX: Loaded 48581 existing records. [2025-10-23T23:28:24.278532] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:24.278788] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-23T23:28:24.278883] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-23T23:28:24.279377] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-23T23:28:24.279452] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-23T23:28:24.683202] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:24.799411] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-23T23:28:25.598312] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:28:25.605778] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-23T23:28:25.607676] [INFO ] [REMOTE ] RDY: Full fetch complete (68458 records). [2025-10-23T23:28:25.607844] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-23T23:28:26.001967] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-23T23:28:26.002174] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-23T23:28:26.003413] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-23T23:28:26.003555] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-23T23:28:26.037869] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-23T23:28:26.035872] [DEBUG] [LOCAL ] RDY: Trimmed 68458 records to 46507 (keeping 200 days of data) [2025-10-23T23:28:26.327882] [DEBUG] [LOCAL ] RDY: Primary data saved (46507 records). [2025-10-23T23:28:26.328044] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-23T23:28:26.328160] [INFO ] [MAIN ] Update Progress: 1779/2367 symbols completed. RDY took 29.0s. Estimated remaining: 1h 15m 29s. Rate: 7.8 symbols/min [2025-10-23T23:28:26.403064] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-23T23:28:26.540241] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-23T23:28:26.541936] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:26.590509] [DEBUG] [LOCAL ] RERE: Loaded 41799 existing records from primary storage. [2025-10-23T23:28:26.590870] [INFO ] [MAIN ] RERE: Loaded 41799 existing records. [2025-10-23T23:28:26.786860] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:26.787087] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-23T23:28:26.787164] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-23T23:28:26.787405] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-23T23:28:26.787480] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-23T23:28:27.190569] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:27.199391] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-23T23:28:27.999400] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-23T23:28:28.122207] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-23T23:28:28.131506] [INFO ] [REMOTE ] RDW: Full fetch complete (75565 records). [2025-10-23T23:28:28.131676] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-23T23:28:28.544196] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T23:28:28.544388] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-23T23:28:28.550782] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-23T23:28:28.552633] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-23T23:28:28.552754] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-23T23:28:28.554253] [DEBUG] [LOCAL ] RDW: Trimmed 75565 records to 52676 (keeping 200 days of data) [2025-10-23T23:28:28.809636] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-23T23:28:28.815952] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-23T23:28:28.882177] [INFO ] [REMOTE ] RDDT: Full fetch complete (77926 records). [2025-10-23T23:28:28.888394] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-23T23:28:29.009351] [DEBUG] [LOCAL ] RDW: Primary data saved (52676 records). [2025-10-23T23:28:29.015429] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-23T23:28:29.025820] [INFO ] [MAIN ] Update Progress: 1780/2367 symbols completed. RDW took 32.1s. Estimated remaining: 1h 15m 20s. Rate: 7.8 symbols/min [2025-10-23T23:28:29.392430] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:29.509501] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-23T23:28:29.509772] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-23T23:28:29.511249] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-23T23:28:29.511796] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-23T23:28:29.537366] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T23:28:29.556196] [DEBUG] [LOCAL ] RDDT: Trimmed 77926 records to 54159 (keeping 200 days of data) [2025-10-23T23:28:29.622672] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-23T23:28:29.635254] [DEBUG] [LOCAL ] RES: Loaded 46858 existing records from primary storage. [2025-10-23T23:28:29.662742] [INFO ] [MAIN ] RES: Loaded 46858 existing records. [2025-10-23T23:28:29.935985] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:29.945629] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-23T23:28:29.946020] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-23T23:28:29.973296] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-23T23:28:29.973932] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-23T23:28:30.472500] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:30.478540] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-23T23:28:30.479843] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-23T23:28:30.491800] [DEBUG] [LOCAL ] RDDT: Primary data saved (54159 records). [2025-10-23T23:28:30.499543] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-23T23:28:30.500081] [INFO ] [MAIN ] Update Progress: 1781/2367 symbols completed. RDDT took 41.0s. Estimated remaining: 1h 15m 10s. Rate: 7.8 symbols/min [2025-10-23T23:28:30.668254] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:30.704041] [DEBUG] [LOCAL ] REVG: Loaded 40157 existing records from primary storage. [2025-10-23T23:28:30.704375] [INFO ] [MAIN ] REVG: Loaded 40157 existing records. [2025-10-23T23:28:30.892286] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:30.892578] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-23T23:28:30.892744] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-23T23:28:30.892986] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-23T23:28:30.893059] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-23T23:28:31.220607] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-23T23:28:31.286040] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:31.290872] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T23:28:31.999449] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-23T23:28:32.065922] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T23:28:32.696814] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T23:28:32.799420] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-23T23:28:33.085420] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T23:28:33.599448] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-23T23:28:34.339235] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T23:28:34.399448] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-23T23:28:35.199532] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-23T23:28:35.267490] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:28:35.837953] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T23:28:35.999440] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-23T23:28:36.530563] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T23:28:36.799438] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-23T23:28:37.563201] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T23:28:37.599406] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-23T23:28:37.628231] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T23:28:38.399456] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-23T23:28:39.199427] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-23T23:28:39.263917] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T23:28:39.999415] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-23T23:28:40.115512] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T23:28:40.800277] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-23T23:28:40.803361] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:28:41.469181] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:28:41.599435] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-23T23:28:42.284738] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T23:28:42.399447] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-23T23:28:43.205138] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-23T23:28:43.222551] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:28:44.000039] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T23:28:44.000172] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-23T23:28:44.748175] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T23:28:44.799400] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-23T23:28:45.599461] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-23T23:28:45.727038] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-23T23:28:46.318629] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T23:28:46.399403] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-23T23:28:47.199433] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-23T23:28:47.378340] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T23:28:47.822253] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T23:28:47.999466] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-23T23:28:48.799417] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-23T23:28:48.958886] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T23:28:49.599418] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-23T23:28:49.768402] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T23:28:50.116777] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-23T23:28:50.399427] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-23T23:28:50.880034] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T23:28:51.199463] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-23T23:28:51.999429] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-23T23:28:52.142957] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-23T23:28:52.736049] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T23:28:52.743335] [INFO ] [REMOTE ] RERE: Full fetch complete (58076 records). [2025-10-23T23:28:52.743510] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-23T23:28:52.810760] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-23T23:28:53.134002] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-23T23:28:53.134119] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-23T23:28:53.135465] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-23T23:28:53.135578] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-23T23:28:53.136950] [DEBUG] [LOCAL ] RERE: Trimmed 58076 records to 42083 (keeping 200 days of data) [2025-10-23T23:28:53.368095] [DEBUG] [LOCAL ] RERE: Primary data saved (42083 records). [2025-10-23T23:28:53.368255] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-23T23:28:53.368382] [INFO ] [MAIN ] Update Progress: 1782/2367 symbols completed. RERE took 27.0s. Estimated remaining: 1h 15m 7s. Rate: 7.8 symbols/min [2025-10-23T23:28:53.539692] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:53.555460] [DEBUG] [LOCAL ] REX: Loaded 14324 existing records from primary storage. [2025-10-23T23:28:53.555750] [INFO ] [MAIN ] REX: Loaded 14324 existing records. [2025-10-23T23:28:53.611366] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-23T23:28:53.748969] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:53.749320] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-23T23:28:53.749520] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-23T23:28:53.763884] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-23T23:28:53.764019] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-23T23:28:53.851415] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T23:28:54.163363] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:54.399422] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-23T23:28:54.510237] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T23:28:54.518860] [INFO ] [REMOTE ] RELX: Full fetch complete (68509 records). [2025-10-23T23:28:54.519031] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-23T23:28:54.905567] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-23T23:28:54.905760] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-23T23:28:54.907045] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-23T23:28:54.907149] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-23T23:28:54.908637] [DEBUG] [LOCAL ] RELX: Trimmed 68509 records to 48903 (keeping 200 days of data) [2025-10-23T23:28:55.148209] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T23:28:55.176253] [INFO ] [REMOTE ] REVG: Full fetch complete (57860 records). [2025-10-23T23:28:55.184307] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-23T23:28:55.236204] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-23T23:28:55.290167] [DEBUG] [LOCAL ] RELX: Primary data saved (48903 records). [2025-10-23T23:28:55.329742] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-23T23:28:55.336263] [INFO ] [MAIN ] Update Progress: 1783/2367 symbols completed. RELX took 31.5s. Estimated remaining: 1h 14m 57s. Rate: 7.8 symbols/min [2025-10-23T23:28:55.746961] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:55.880314] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-23T23:28:55.880713] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-23T23:28:55.882119] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-23T23:28:55.882302] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-23T23:28:55.885184] [DEBUG] [LOCAL ] REVG: Trimmed 57860 records to 40460 (keeping 200 days of data) [2025-10-23T23:28:56.132543] [DEBUG] [LOCAL ] REXR: Loaded 52193 existing records from primary storage. [2025-10-23T23:28:56.131544] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-23T23:28:56.193826] [INFO ] [MAIN ] REXR: Loaded 52193 existing records. [2025-10-23T23:28:56.242524] [DEBUG] [LOCAL ] REVG: Primary data saved (40460 records). [2025-10-23T23:28:56.242398] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-23T23:28:56.262778] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-23T23:28:56.305387] [INFO ] [MAIN ] Update Progress: 1784/2367 symbols completed. REVG took 25.8s. Estimated remaining: 1h 14m 48s. Rate: 7.8 symbols/min [2025-10-23T23:28:56.479514] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T23:28:56.575159] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:56.622983] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-23T23:28:56.624508] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:28:56.624733] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-23T23:28:56.625740] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-23T23:28:56.625821] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-23T23:28:56.809059] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-23T23:28:56.951820] [DEBUG] [LOCAL ] REZI: Loaded 47098 existing records from primary storage. [2025-10-23T23:28:56.990519] [INFO ] [MAIN ] REZI: Loaded 47098 existing records. [2025-10-23T23:28:57.095444] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:57.206539] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:28:57.206790] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-23T23:28:57.206868] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-23T23:28:57.207121] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-23T23:28:57.207196] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-23T23:28:57.549594] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:28:57.599402] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-23T23:28:57.803128] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T23:28:58.387682] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-23T23:28:58.399393] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-23T23:28:58.721949] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T23:28:59.199512] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-23T23:29:00.004577] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-23T23:29:00.016463] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T23:29:00.799504] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-23T23:29:00.854981] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:29:01.579341] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:29:01.599412] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-23T23:29:01.771917] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-23T23:29:02.399558] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-23T23:29:03.199438] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-23T23:29:03.256266] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T23:29:03.999526] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-23T23:29:04.064527] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-23T23:29:04.804331] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-23T23:29:04.810181] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-23T23:29:05.599482] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-23T23:29:05.730713] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-23T23:29:06.385308] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:29:06.393097] [INFO ] [REMOTE ] RES: Full fetch complete (68718 records). [2025-10-23T23:29:06.393236] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-23T23:29:06.405371] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-23T23:29:06.785227] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-23T23:29:06.785361] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-23T23:29:06.786543] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-23T23:29:06.786627] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-23T23:29:06.788114] [DEBUG] [LOCAL ] RES: Trimmed 68718 records to 47208 (keeping 200 days of data) [2025-10-23T23:29:07.064295] [DEBUG] [LOCAL ] RES: Primary data saved (47208 records). [2025-10-23T23:29:07.064638] [INFO ] [MAIN ] RES: Full history saved. [2025-10-23T23:29:07.064907] [INFO ] [MAIN ] Update Progress: 1785/2367 symbols completed. RES took 38.0s. Estimated remaining: 1h 14m 41s. Rate: 7.8 symbols/min [2025-10-23T23:29:07.213288] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-23T23:29:07.244726] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:07.279201] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T23:29:07.337133] [DEBUG] [LOCAL ] RF: Loaded 53633 existing records from primary storage. [2025-10-23T23:29:07.337574] [INFO ] [MAIN ] RF: Loaded 53633 existing records. [2025-10-23T23:29:07.531239] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:07.531637] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-23T23:29:07.531735] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-23T23:29:07.531993] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-10-23T23:29:07.532067] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-23T23:29:07.684532] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T23:29:07.918871] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:07.999414] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-23T23:29:08.799411] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-23T23:29:09.078031] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T23:29:09.599417] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-23T23:29:09.665886] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T23:29:09.903105] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T23:29:10.399431] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-23T23:29:11.170484] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-23T23:29:11.199411] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-23T23:29:11.868971] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-23T23:29:11.901211] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T23:29:11.999407] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-23T23:29:12.799423] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-23T23:29:13.549896] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-23T23:29:13.599410] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-23T23:29:14.060248] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T23:29:14.399437] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-23T23:29:15.178321] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:29:15.199397] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-23T23:29:15.999427] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-23T23:29:16.383293] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T23:29:16.549119] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T23:29:16.742191] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T23:29:16.799408] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-23T23:29:17.599434] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-23T23:29:17.671893] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T23:29:18.399432] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-23T23:29:19.121931] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T23:29:19.199495] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-23T23:29:19.247183] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T23:29:19.999495] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-23T23:29:20.799424] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-23T23:29:21.091478] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T23:29:21.291167] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T23:29:21.432533] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-23T23:29:21.599430] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-23T23:29:22.399497] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-23T23:29:22.646753] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T23:29:22.650533] [INFO ] [REMOTE ] REX: Full fetch complete (21178 records). [2025-10-23T23:29:22.650663] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-23T23:29:23.013419] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-23T23:29:23.013533] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-23T23:29:23.014105] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-23T23:29:23.014219] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-23T23:29:23.014900] [DEBUG] [LOCAL ] REX: Trimmed 21178 records to 14444 (keeping 200 days of data) [2025-10-23T23:29:23.101819] [DEBUG] [LOCAL ] REX: Primary data saved (14444 records). [2025-10-23T23:29:23.102014] [INFO ] [MAIN ] REX: Full history saved. [2025-10-23T23:29:23.102145] [INFO ] [MAIN ] Update Progress: 1786/2367 symbols completed. REX took 29.7s. Estimated remaining: 1h 14m 36s. Rate: 7.8 symbols/min [2025-10-23T23:29:23.203608] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-23T23:29:23.273713] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:23.284466] [DEBUG] [LOCAL ] RFI: Loaded 10230 existing records from primary storage. [2025-10-23T23:29:23.284723] [INFO ] [MAIN ] RFI: Loaded 10230 existing records. [2025-10-23T23:29:23.462824] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:23.463081] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-23T23:29:23.463156] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-23T23:29:23.463431] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-23T23:29:23.463506] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-23T23:29:23.824950] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:23.999414] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-23T23:29:24.257544] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-23T23:29:24.799428] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-23T23:29:24.909693] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T23:29:25.338945] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T23:29:25.347253] [INFO ] [REMOTE ] REZI: Full fetch complete (66276 records). [2025-10-23T23:29:25.347397] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-23T23:29:25.604582] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-23T23:29:25.736977] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-23T23:29:25.737086] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-23T23:29:25.738214] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-23T23:29:25.738293] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-23T23:29:25.740465] [DEBUG] [LOCAL ] REZI: Trimmed 66276 records to 47445 (keeping 200 days of data) [2025-10-23T23:29:26.010672] [DEBUG] [LOCAL ] REZI: Primary data saved (47445 records). [2025-10-23T23:29:26.010822] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-23T23:29:26.010943] [INFO ] [MAIN ] Update Progress: 1787/2367 symbols completed. REZI took 29.7s. Estimated remaining: 1h 14m 27s. Rate: 7.8 symbols/min [2025-10-23T23:29:26.183875] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:26.196827] [DEBUG] [LOCAL ] RFL: Loaded 11419 existing records from primary storage. [2025-10-23T23:29:26.197074] [INFO ] [MAIN ] RFL: Loaded 11419 existing records. [2025-10-23T23:29:26.378639] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:26.378889] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-23T23:29:26.379085] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-23T23:29:26.379410] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-23T23:29:26.379485] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-23T23:29:26.415839] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-23T23:29:26.698333] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T23:29:26.811855] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:26.815487] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-23T23:29:27.199498] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-23T23:29:27.999509] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-23T23:29:28.289594] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T23:29:28.799436] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-23T23:29:28.814771] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-23T23:29:29.313579] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-23T23:29:29.599442] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-23T23:29:30.257923] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T23:29:30.399455] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-23T23:29:30.464913] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T23:29:30.473889] [INFO ] [REMOTE ] REXR: Full fetch complete (75352 records). [2025-10-23T23:29:30.474037] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-23T23:29:30.859268] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-23T23:29:30.859387] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-23T23:29:30.860537] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-23T23:29:30.860616] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-23T23:29:30.862097] [DEBUG] [LOCAL ] REXR: Trimmed 75352 records to 52569 (keeping 200 days of data) [2025-10-23T23:29:31.178141] [DEBUG] [LOCAL ] REXR: Primary data saved (52569 records). [2025-10-23T23:29:31.178350] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-23T23:29:31.178479] [INFO ] [MAIN ] Update Progress: 1788/2367 symbols completed. REXR took 35.8s. Estimated remaining: 1h 14m 18s. Rate: 7.8 symbols/min [2025-10-23T23:29:31.208119] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-23T23:29:31.347675] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:31.354334] [DEBUG] [LOCAL ] RFM: Loaded 4209 existing records from primary storage. [2025-10-23T23:29:31.354552] [INFO ] [MAIN ] RFM: Loaded 4209 existing records. [2025-10-23T23:29:31.527221] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:31.527426] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-23T23:29:31.527500] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-23T23:29:31.527710] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-23T23:29:31.527819] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-23T23:29:31.854731] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T23:29:31.883712] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:31.999402] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-23T23:29:32.186920] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T23:29:32.571093] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-23T23:29:32.799440] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-23T23:29:33.199805] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-23T23:29:33.599442] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-23T23:29:34.192260] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:29:34.399443] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-23T23:29:34.976402] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T23:29:35.199441] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-23T23:29:35.778220] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-23T23:29:35.999422] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-23T23:29:36.778725] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-23T23:29:36.799405] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-23T23:29:37.599437] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-23T23:29:38.080548] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-23T23:29:38.399442] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-23T23:29:38.655836] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T23:29:39.199436] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-23T23:29:39.315283] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T23:29:39.999448] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-23T23:29:40.782935] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-23T23:29:40.799392] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-23T23:29:41.039090] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T23:29:41.048237] [INFO ] [REMOTE ] RF: Full fetch complete (77798 records). [2025-10-23T23:29:41.048382] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-23T23:29:41.435371] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-23T23:29:41.435511] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-23T23:29:41.437062] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-23T23:29:41.437151] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-23T23:29:41.438945] [DEBUG] [LOCAL ] RF: Trimmed 77798 records to 54023 (keeping 200 days of data) [2025-10-23T23:29:41.630150] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-23T23:29:41.640210] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T23:29:41.795493] [DEBUG] [LOCAL ] RF: Primary data saved (54023 records). [2025-10-23T23:29:41.795689] [INFO ] [MAIN ] RF: Full history saved. [2025-10-23T23:29:41.795804] [INFO ] [MAIN ] Update Progress: 1789/2367 symbols completed. RF took 34.7s. Estimated remaining: 1h 14m 11s. Rate: 7.8 symbols/min [2025-10-23T23:29:41.967235] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:41.978229] [DEBUG] [LOCAL ] RFMZ: Loaded 9010 existing records from primary storage. [2025-10-23T23:29:41.978474] [INFO ] [MAIN ] RFMZ: Loaded 9010 existing records. [2025-10-23T23:29:42.158111] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:42.158321] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-23T23:29:42.158415] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-23T23:29:42.158617] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-23T23:29:42.158721] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-23T23:29:42.264488] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-23T23:29:42.404606] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-23T23:29:42.525436] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:43.199424] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-23T23:29:43.265485] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T23:29:43.795200] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T23:29:43.999469] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-23T23:29:44.783477] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:29:44.799388] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-23T23:29:45.599402] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-23T23:29:45.684360] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T23:29:46.362034] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T23:29:46.399436] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-23T23:29:47.004975] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T23:29:47.199490] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-23T23:29:47.999404] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-23T23:29:48.244704] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T23:29:48.619839] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-23T23:29:48.799423] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-23T23:29:49.599428] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-23T23:29:49.706839] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-23T23:29:50.256609] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T23:29:50.399418] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-23T23:29:51.199417] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-23T23:29:51.286937] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-23T23:29:51.775089] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T23:29:51.999439] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-23T23:29:52.748812] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-23T23:29:52.799403] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-23T23:29:53.599415] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-23T23:29:53.620667] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-23T23:29:54.399441] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-23T23:29:54.615544] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T23:29:54.961783] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-23T23:29:54.963041] [INFO ] [REMOTE ] RFM: Full fetch complete (5631 records). [2025-10-23T23:29:54.963131] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-23T23:29:55.204567] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-23T23:29:55.320808] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-23T23:29:55.320931] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-23T23:29:55.321125] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-23T23:29:55.321200] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-23T23:29:55.321605] [DEBUG] [LOCAL ] RFM: Trimmed 5631 records to 4225 (keeping 200 days of data) [2025-10-23T23:29:55.346456] [DEBUG] [LOCAL ] RFM: Primary data saved (4225 records). [2025-10-23T23:29:55.346568] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-23T23:29:55.346693] [INFO ] [MAIN ] Update Progress: 1790/2367 symbols completed. RFM took 24.2s. Estimated remaining: 1h 14m 6s. Rate: 7.8 symbols/min [2025-10-23T23:29:55.521005] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:55.549591] [DEBUG] [LOCAL ] RGA: Loaded 29198 existing records from primary storage. [2025-10-23T23:29:55.549909] [INFO ] [MAIN ] RGA: Loaded 29198 existing records. [2025-10-23T23:29:55.726442] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:55.726671] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-23T23:29:55.726743] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-23T23:29:55.727068] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-23T23:29:55.727142] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-23T23:29:56.004597] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-23T23:29:56.081915] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T23:29:56.116129] [INFO ] [REMOTE ] RFI: Full fetch complete (15037 records). [2025-10-23T23:29:56.116278] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-23T23:29:56.115434] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:56.494467] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-23T23:29:56.494579] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-23T23:29:56.495002] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-23T23:29:56.495080] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-23T23:29:56.495618] [DEBUG] [LOCAL ] RFI: Trimmed 15037 records to 10283 (keeping 200 days of data) [2025-10-23T23:29:56.557305] [DEBUG] [LOCAL ] RFI: Primary data saved (10283 records). [2025-10-23T23:29:56.557459] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-23T23:29:56.557586] [INFO ] [MAIN ] Update Progress: 1791/2367 symbols completed. RFI took 33.5s. Estimated remaining: 1h 13m 56s. Rate: 7.8 symbols/min [2025-10-23T23:29:56.727926] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:56.746853] [DEBUG] [LOCAL ] RGR: Loaded 20982 existing records from primary storage. [2025-10-23T23:29:56.747181] [INFO ] [MAIN ] RGR: Loaded 20982 existing records. [2025-10-23T23:29:56.804670] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-23T23:29:56.890553] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-23T23:29:56.967026] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:56.967270] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-23T23:29:56.967347] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-23T23:29:56.967578] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-23T23:29:56.967680] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-23T23:29:57.355743] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:57.521838] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T23:29:57.523629] [INFO ] [REMOTE ] RFL: Full fetch complete (13237 records). [2025-10-23T23:29:57.523751] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-23T23:29:57.604754] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-23T23:29:57.875590] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-23T23:29:57.875719] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-23T23:29:57.876050] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-23T23:29:57.876124] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-23T23:29:57.876627] [DEBUG] [LOCAL ] RFL: Trimmed 13237 records to 11436 (keeping 200 days of data) [2025-10-23T23:29:57.939114] [DEBUG] [LOCAL ] RFL: Primary data saved (11436 records). [2025-10-23T23:29:57.939261] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-23T23:29:57.939368] [INFO ] [MAIN ] Update Progress: 1792/2367 symbols completed. RFL took 31.9s. Estimated remaining: 1h 13m 46s. Rate: 7.8 symbols/min [2025-10-23T23:29:58.105334] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:29:58.109422] [DEBUG] [LOCAL ] RGT: Loaded 2685 existing records from primary storage. [2025-10-23T23:29:58.109597] [INFO ] [MAIN ] RGT: Loaded 2685 existing records. [2025-10-23T23:29:58.285990] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:29:58.286202] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-23T23:29:58.286275] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-23T23:29:58.286488] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-23T23:29:58.286563] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-23T23:29:58.404591] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-23T23:29:58.481309] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-23T23:29:58.648345] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:29:59.199508] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-23T23:29:59.655982] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-23T23:29:59.978548] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T23:29:59.999393] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-23T23:30:00.509520] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-23T23:30:00.799439] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-23T23:30:01.599452] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-23T23:30:01.842622] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T23:30:02.399494] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-23T23:30:02.988317] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:30:03.156426] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T23:30:03.199432] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-23T23:30:03.790697] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T23:30:03.999467] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-23T23:30:04.799478] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-23T23:30:05.291145] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-23T23:30:05.557974] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T23:30:05.599492] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-23T23:30:06.234442] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-23T23:30:06.399439] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-23T23:30:07.199452] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-23T23:30:07.556546] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T23:30:07.999451] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-23T23:30:08.383195] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-23T23:30:08.586808] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T23:30:08.799463] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-23T23:30:09.599473] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-23T23:30:09.854520] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T23:30:10.191269] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T23:30:10.399432] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-23T23:30:10.850467] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-23T23:30:11.199474] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-23T23:30:11.999453] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-23T23:30:12.147186] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T23:30:12.476914] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-23T23:30:12.799536] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-23T23:30:13.381492] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T23:30:13.382518] [INFO ] [REMOTE ] RGT: Full fetch complete (3941 records). [2025-10-23T23:30:13.382605] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-23T23:30:13.604617] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-23T23:30:13.827063] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-23T23:30:13.827192] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-23T23:30:13.827374] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-23T23:30:13.827449] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-23T23:30:13.827900] [DEBUG] [LOCAL ] RGT: Trimmed 3941 records to 2721 (keeping 200 days of data) [2025-10-23T23:30:13.844100] [DEBUG] [LOCAL ] RGT: Primary data saved (2721 records). [2025-10-23T23:30:13.844190] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-23T23:30:13.844270] [INFO ] [MAIN ] Update Progress: 1793/2367 symbols completed. RGT took 15.9s. Estimated remaining: 1h 13m 41s. Rate: 7.8 symbols/min [2025-10-23T23:30:14.009921] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:14.053845] [DEBUG] [LOCAL ] RH: Loaded 47133 existing records from primary storage. [2025-10-23T23:30:14.054215] [INFO ] [MAIN ] RH: Loaded 47133 existing records. [2025-10-23T23:30:14.227097] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:14.227325] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-23T23:30:14.227415] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-23T23:30:14.227722] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-23T23:30:14.227834] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-23T23:30:14.404573] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-23T23:30:14.587374] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:14.700344] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T23:30:15.199419] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-23T23:30:15.216828] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T23:30:15.999412] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-23T23:30:16.385914] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T23:30:16.799437] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-23T23:30:17.604503] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-23T23:30:17.616802] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T23:30:17.931972] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T23:30:18.399472] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-23T23:30:18.941124] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-23T23:30:19.199444] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-23T23:30:19.819381] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T23:30:19.841421] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T23:30:19.999457] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-23T23:30:20.799458] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-23T23:30:21.146068] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T23:30:21.599449] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-23T23:30:22.399406] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-23T23:30:22.489424] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T23:30:22.795040] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-23T23:30:23.186608] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T23:30:23.199416] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-23T23:30:23.999450] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-23T23:30:24.040248] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-23T23:30:24.042802] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12429 records). [2025-10-23T23:30:24.042909] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-23T23:30:24.118544] [DEBUG] [REMOTE ] RGA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-23T23:30:24.145912] [WARN ] [REMOTE ] RGA: No data returned for month 2025-07 [2025-10-23T23:30:24.146254] [FATAL] [REMOTE ] RGA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:30:24.152020] [FATAL] [MAIN ] RGA: Failed to fetch primary data. [2025-10-23T23:30:24.167534] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:30:24.205686] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-23T23:30:24.298519] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-23T23:30:24.330983] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-23T23:30:24.350903] [DEBUG] [LOCAL ] RGA: Deleted derivative data file. [2025-10-23T23:30:24.361615] [INFO ] [MAIN ] Update Progress: 1794/2367 symbols completed. RGA took 29.0s. Estimated remaining: 1h 13m 34s. Rate: 7.8 symbols/min [2025-10-23T23:30:24.544372] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-23T23:30:24.544549] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-23T23:30:24.545324] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-23T23:30:24.561193] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-23T23:30:24.619858] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:24.600410] [DEBUG] [LOCAL ] RFMZ: Trimmed 12429 records to 9143 (keeping 200 days of data) [2025-10-23T23:30:24.685605] [DEBUG] [LOCAL ] RFMZ: Primary data saved (9143 records). [2025-10-23T23:30:24.685912] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-23T23:30:24.686052] [INFO ] [MAIN ] Update Progress: 1795/2367 symbols completed. RFMZ took 42.9s. Estimated remaining: 1h 13m 24s. Rate: 7.8 symbols/min [2025-10-23T23:30:24.800696] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-23T23:30:24.870935] [DEBUG] [LOCAL ] RHI: Loaded 49689 existing records from primary storage. [2025-10-23T23:30:24.888620] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:24.888938] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-23T23:30:24.888885] [INFO ] [MAIN ] RHI: Loaded 49689 existing records. [2025-10-23T23:30:24.889028] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-23T23:30:24.931293] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-23T23:30:24.931379] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-23T23:30:24.957499] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-23T23:30:24.968478] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-23T23:30:25.212043] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:25.231838] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-23T23:30:25.231935] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-23T23:30:25.247255] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-10-23T23:30:25.283466] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-23T23:30:25.585683] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:25.610401] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-10-23T23:30:25.802814] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:25.940392] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:30:25.940782] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-10-23T23:30:25.940869] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:30:25.940945] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-23T23:30:25.941011] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:30:25.941085] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-23T23:30:25.941174] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-23T23:30:25.941247] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-23T23:30:25.941367] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-23T23:30:25.941452] [INFO ] [MAIN ] Update Progress: 1796/2367 symbols completed. RHLD took 1.3s. Estimated remaining: 1h 13m 14s. Rate: 7.8 symbols/min [2025-10-23T23:30:26.119846] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:26.135146] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T23:30:26.178571] [DEBUG] [LOCAL ] RHP: Loaded 40303 existing records from primary storage. [2025-10-23T23:30:26.178944] [INFO ] [MAIN ] RHP: Loaded 40303 existing records. [2025-10-23T23:30:26.356234] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:26.356499] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-23T23:30:26.356576] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-23T23:30:26.356807] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-23T23:30:26.356880] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-23T23:30:26.408196] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-23T23:30:26.706426] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:27.199466] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-23T23:30:27.503241] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T23:30:27.506896] [INFO ] [REMOTE ] RGR: Full fetch complete (28787 records). [2025-10-23T23:30:27.506985] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-23T23:30:27.861181] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-23T23:30:27.861288] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-23T23:30:27.861911] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-23T23:30:27.861987] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-23T23:30:27.862732] [DEBUG] [LOCAL ] RGR: Trimmed 28787 records to 21085 (keeping 200 days of data) [2025-10-23T23:30:27.988134] [DEBUG] [LOCAL ] RGR: Primary data saved (21085 records). [2025-10-23T23:30:27.988322] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-23T23:30:27.988443] [INFO ] [MAIN ] Update Progress: 1797/2367 symbols completed. RGR took 31.4s. Estimated remaining: 1h 13m 5s. Rate: 7.8 symbols/min [2025-10-23T23:30:27.999406] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-23T23:30:28.799488] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-23T23:30:29.423037] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-23T23:30:29.599410] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-23T23:30:29.637920] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T23:30:30.187368] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T23:30:30.399419] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-23T23:30:31.199433] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-23T23:30:31.569271] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T23:30:31.928878] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-23T23:30:31.999392] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-23T23:30:32.385765] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T23:30:32.799444] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-23T23:30:33.599439] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-23T23:30:33.644381] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T23:30:34.399418] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-23T23:30:34.586560] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T23:30:35.199420] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-23T23:30:35.531230] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-23T23:30:35.703466] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T23:30:35.999437] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-23T23:30:36.799482] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-23T23:30:36.865686] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:30:37.605286] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-23T23:30:37.630672] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T23:30:38.399428] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-23T23:30:38.458222] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T23:30:39.199475] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-23T23:30:39.271092] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-23T23:30:39.999439] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-23T23:30:40.217440] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T23:30:40.470547] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-23T23:30:40.799427] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-23T23:30:41.061005] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T23:30:41.599507] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-23T23:30:42.406025] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-23T23:30:42.410719] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:30:43.199516] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-23T23:30:43.433123] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T23:30:43.935590] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T23:30:43.999461] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-23T23:30:44.799475] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-23T23:30:44.935632] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T23:30:44.944274] [INFO ] [REMOTE ] RH: Full fetch complete (66322 records). [2025-10-23T23:30:44.944458] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-23T23:30:45.335993] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-23T23:30:45.336144] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-23T23:30:45.337800] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-23T23:30:45.338009] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-23T23:30:45.339815] [DEBUG] [LOCAL ] RH: Trimmed 66322 records to 47408 (keeping 200 days of data) [2025-10-23T23:30:45.485815] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T23:30:45.600843] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-23T23:30:45.659890] [DEBUG] [LOCAL ] RH: Primary data saved (47408 records). [2025-10-23T23:30:45.660055] [INFO ] [MAIN ] RH: Full history saved. [2025-10-23T23:30:45.660168] [INFO ] [MAIN ] Update Progress: 1798/2367 symbols completed. RH took 31.8s. Estimated remaining: 1h 13m 0s. Rate: 7.8 symbols/min [2025-10-23T23:30:46.552358] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T23:30:46.563450] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-23T23:30:47.023682] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T23:30:47.199498] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-23T23:30:48.356316] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-23T23:30:48.367045] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-23T23:30:48.658623] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:30:48.665530] [INFO ] [REMOTE ] RHP: Full fetch complete (58230 records). [2025-10-23T23:30:48.665702] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-23T23:30:49.043038] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-23T23:30:49.043154] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-23T23:30:49.044223] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-23T23:30:49.044304] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-23T23:30:49.045568] [DEBUG] [LOCAL ] RHP: Trimmed 58230 records to 40539 (keeping 200 days of data) [2025-10-23T23:30:49.289242] [DEBUG] [LOCAL ] RHP: Primary data saved (40539 records). [2025-10-23T23:30:49.289389] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-23T23:30:49.289496] [INFO ] [MAIN ] Update Progress: 1799/2367 symbols completed. RHP took 23.3s. Estimated remaining: 1h 12m 51s. Rate: 7.8 symbols/min [2025-10-23T23:30:50.033529] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T23:30:50.042853] [INFO ] [REMOTE ] RHI: Full fetch complete (70997 records). [2025-10-23T23:30:50.043028] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-23T23:30:50.419994] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-23T23:30:50.420106] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-23T23:30:50.421211] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-23T23:30:50.421289] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-23T23:30:50.422608] [DEBUG] [LOCAL ] RHI: Trimmed 70997 records to 50078 (keeping 200 days of data) [2025-10-23T23:30:50.712138] [DEBUG] [LOCAL ] RHI: Primary data saved (50078 records). [2025-10-23T23:30:50.712289] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-23T23:30:50.713636] [INFO ] [MAIN ] Update Progress: 1800/2367 symbols completed. RHI took 26.3s. Estimated remaining: 1h 12m 42s. Rate: 7.8 symbols/min [2025-10-23T23:30:51.199549] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:51.421187] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:51.425836] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:51.427556] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:30:51.443929] [DEBUG] [LOCAL ] RIV: Loaded 12627 existing records from primary storage. [2025-10-23T23:30:51.445493] [INFO ] [MAIN ] RIV: Loaded 12627 existing records. [2025-10-23T23:30:51.585098] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-23T23:30:51.598277] [INFO ] [MAIN ] RIG: Loaded 53675 existing records. [2025-10-23T23:30:51.750811] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:51.800775] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-23T23:30:51.838553] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-23T23:30:51.838455] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-10-23T23:30:51.827029] [DEBUG] [LOCAL ] RITM: Loaded 52945 existing records from primary storage. [2025-10-23T23:30:51.844328] [INFO ] [MAIN ] RITM: Loaded 52945 existing records. [2025-10-23T23:30:51.850223] [INFO ] [MAIN ] RIO: Loaded 53402 existing records. [2025-10-23T23:30:51.871601] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-23T23:30:51.960889] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-23T23:30:52.124287] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:52.228537] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-23T23:30:52.281233] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-23T23:30:52.350934] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-23T23:30:52.426815] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-23T23:30:52.487305] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:52.513431] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:30:52.530058] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-23T23:30:52.560888] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-23T23:30:52.582472] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-23T23:30:52.671295] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-23T23:30:52.703557] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-23T23:30:52.689710] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-23T23:30:52.836033] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-23T23:30:52.966480] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-23T23:30:53.257815] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:53.317080] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-23T23:30:53.459627] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:53.518147] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-23T23:30:53.810820] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:53.841823] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-23T23:30:53.860781] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:30:53.861793] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-23T23:30:54.271296] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T23:30:54.274546] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-23T23:30:55.044269] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T23:30:55.046832] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-23T23:30:55.329550] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T23:30:55.340095] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-23T23:30:55.534156] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-23T23:30:55.537013] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-23T23:30:55.787133] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T23:30:55.797906] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-23T23:30:55.912979] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-23T23:30:55.999420] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-23T23:30:56.282388] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-23T23:30:56.799499] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-23T23:30:57.231759] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T23:30:57.438318] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T23:30:57.481179] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-23T23:30:57.599457] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-23T23:30:57.910552] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-23T23:30:58.399463] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-23T23:30:59.199457] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-23T23:30:59.443209] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T23:30:59.903504] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T23:30:59.999487] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-23T23:31:00.165221] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T23:31:00.799531] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-23T23:31:01.599486] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-23T23:31:01.976370] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-23T23:31:02.399419] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-23T23:31:02.550296] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T23:31:02.982576] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-23T23:31:03.199497] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-23T23:31:03.999548] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-23T23:31:04.233318] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T23:31:04.799501] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-23T23:31:05.274892] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-23T23:31:05.599538] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-23T23:31:06.133439] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T23:31:06.399412] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-23T23:31:06.513875] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T23:31:06.556783] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T23:31:07.199529] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-23T23:31:07.999563] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-23T23:31:08.282764] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-23T23:31:08.464901] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-23T23:31:08.799460] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-23T23:31:09.599110] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T23:31:09.601949] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-23T23:31:09.603904] [INFO ] [REMOTE ] RIV: Full fetch complete (17554 records). [2025-10-23T23:31:09.604031] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-23T23:31:10.025203] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-23T23:31:10.025503] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-23T23:31:10.026031] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-23T23:31:10.026273] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-23T23:31:10.027182] [DEBUG] [LOCAL ] RIV: Trimmed 17554 records to 12714 (keeping 200 days of data) [2025-10-23T23:31:10.120270] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-23T23:31:10.149004] [DEBUG] [LOCAL ] RIV: Primary data saved (12714 records). [2025-10-23T23:31:10.149184] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-23T23:31:10.149307] [INFO ] [MAIN ] Update Progress: 1801/2367 symbols completed. RIV took 19.4s. Estimated remaining: 1h 12m 38s. Rate: 7.8 symbols/min [2025-10-23T23:31:10.316141] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:10.362082] [DEBUG] [LOCAL ] RJF: Loaded 46546 existing records from primary storage. [2025-10-23T23:31:10.362447] [INFO ] [MAIN ] RJF: Loaded 46546 existing records. [2025-10-23T23:31:10.404502] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-23T23:31:10.544681] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:10.544907] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-23T23:31:10.544981] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-23T23:31:10.545211] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-10-23T23:31:10.545283] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-23T23:31:10.898285] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:11.199424] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-23T23:31:11.560897] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-23T23:31:11.993353] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T23:31:12.004177] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-23T23:31:12.247635] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T23:31:12.799524] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-23T23:31:13.599443] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-23T23:31:14.051978] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-23T23:31:14.399474] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-23T23:31:14.725282] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-23T23:31:14.957714] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-23T23:31:15.199470] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-23T23:31:15.999428] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-23T23:31:16.161904] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-23T23:31:16.799430] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-23T23:31:16.969839] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T23:31:17.599422] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-23T23:31:18.067282] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-23T23:31:18.399486] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-23T23:31:18.749259] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T23:31:19.199457] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-23T23:31:19.305775] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T23:31:19.315242] [INFO ] [REMOTE ] RITM: Full fetch complete (76746 records). [2025-10-23T23:31:19.315458] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-23T23:31:19.706362] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-23T23:31:19.706475] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-23T23:31:19.707670] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-23T23:31:19.707766] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-23T23:31:19.709228] [DEBUG] [LOCAL ] RITM: Trimmed 76746 records to 53334 (keeping 200 days of data) [2025-10-23T23:31:20.008368] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-23T23:31:20.033132] [DEBUG] [LOCAL ] RITM: Primary data saved (53334 records). [2025-10-23T23:31:20.033276] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-23T23:31:20.033386] [INFO ] [MAIN ] Update Progress: 1802/2367 symbols completed. RITM took 29.3s. Estimated remaining: 1h 12m 31s. Rate: 7.8 symbols/min [2025-10-23T23:31:20.204698] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:20.259945] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-23T23:31:20.260331] [INFO ] [MAIN ] RKT: Loaded 53729 existing records. [2025-10-23T23:31:20.443710] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:20.444281] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-23T23:31:20.444462] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-23T23:31:20.472408] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-23T23:31:20.472733] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-23T23:31:20.506609] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-23T23:31:20.800901] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-23T23:31:20.858973] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:20.888441] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T23:31:21.599423] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-23T23:31:22.016724] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-23T23:31:22.399496] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-23T23:31:22.802916] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T23:31:23.199484] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-23T23:31:23.252865] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T23:31:23.999503] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-23T23:31:24.133323] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:31:24.799429] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-23T23:31:25.219875] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-23T23:31:25.229381] [INFO ] [REMOTE ] RIG: Full fetch complete (77845 records). [2025-10-23T23:31:25.229614] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-23T23:31:25.618172] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-23T23:31:25.644796] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-23T23:31:25.644993] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-23T23:31:25.646336] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-23T23:31:25.646701] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-23T23:31:25.648330] [DEBUG] [LOCAL ] RIG: Trimmed 77845 records to 54065 (keeping 200 days of data) [2025-10-23T23:31:25.964928] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-23T23:31:25.997616] [DEBUG] [LOCAL ] RIG: Primary data saved (54065 records). [2025-10-23T23:31:25.997833] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-23T23:31:25.997953] [INFO ] [MAIN ] Update Progress: 1803/2367 symbols completed. RIG took 35.3s. Estimated remaining: 1h 12m 22s. Rate: 7.8 symbols/min [2025-10-23T23:31:26.173016] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:26.208521] [DEBUG] [LOCAL ] RL: Loaded 39350 existing records from primary storage. [2025-10-23T23:31:26.208891] [INFO ] [MAIN ] RL: Loaded 39350 existing records. [2025-10-23T23:31:26.384794] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:26.385063] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-23T23:31:26.385140] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-23T23:31:26.385499] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-10-23T23:31:26.385572] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-23T23:31:26.416723] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-23T23:31:26.740219] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:26.930384] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-23T23:31:26.939758] [INFO ] [REMOTE ] RIO: Full fetch complete (77513 records). [2025-10-23T23:31:26.939934] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-23T23:31:27.202082] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-23T23:31:27.359470] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-23T23:31:27.359603] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-23T23:31:27.361349] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-23T23:31:27.362379] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:31:27.362526] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-23T23:31:27.373108] [DEBUG] [LOCAL ] RIO: Trimmed 77513 records to 53792 (keeping 200 days of data) [2025-10-23T23:31:27.686869] [DEBUG] [LOCAL ] RIO: Primary data saved (53792 records). [2025-10-23T23:31:27.687021] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-23T23:31:27.687131] [INFO ] [MAIN ] Update Progress: 1804/2367 symbols completed. RIO took 37.0s. Estimated remaining: 1h 12m 13s. Rate: 7.8 symbols/min [2025-10-23T23:31:27.853205] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:27.885131] [DEBUG] [LOCAL ] RLI: Loaded 34703 existing records from primary storage. [2025-10-23T23:31:27.885413] [INFO ] [MAIN ] RLI: Loaded 34703 existing records. [2025-10-23T23:31:28.004539] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-23T23:31:28.065406] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:28.065631] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-23T23:31:28.065727] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-23T23:31:28.065974] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-23T23:31:28.066055] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-23T23:31:28.424385] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:28.568157] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-23T23:31:28.799460] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-23T23:31:28.979630] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T23:31:29.599511] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-23T23:31:29.671125] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-23T23:31:29.942509] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T23:31:30.399461] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-23T23:31:31.199416] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-23T23:31:31.275457] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T23:31:31.999434] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-23T23:31:32.097388] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T23:31:32.172117] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-23T23:31:32.799440] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-23T23:31:33.599428] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-23T23:31:33.935823] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T23:31:34.258680] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T23:31:34.399433] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-23T23:31:34.908634] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-23T23:31:35.199428] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-23T23:31:35.914508] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T23:31:35.999599] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-23T23:31:36.543324] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T23:31:36.799451] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-23T23:31:37.599499] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-23T23:31:37.892804] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T23:31:38.084585] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T23:31:38.399450] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-23T23:31:38.986084] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T23:31:39.199458] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-23T23:31:39.999447] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-23T23:31:40.449008] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-23T23:31:40.710008] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T23:31:40.721010] [INFO ] [REMOTE ] RJF: Full fetch complete (68910 records). [2025-10-23T23:31:40.721207] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-23T23:31:40.804539] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-23T23:31:41.105854] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-23T23:31:41.105972] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-23T23:31:41.107213] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-23T23:31:41.107303] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-23T23:31:41.125871] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T23:31:41.132429] [DEBUG] [LOCAL ] RJF: Trimmed 68910 records to 46930 (keeping 200 days of data) [2025-10-23T23:31:41.455237] [DEBUG] [LOCAL ] RJF: Primary data saved (46930 records). [2025-10-23T23:31:41.455434] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-23T23:31:41.457573] [INFO ] [MAIN ] Update Progress: 1805/2367 symbols completed. RJF took 31.3s. Estimated remaining: 1h 12m 7s. Rate: 7.8 symbols/min [2025-10-23T23:31:41.604615] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-23T23:31:41.664237] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:41.714454] [DEBUG] [LOCAL ] RLJ: Loaded 47956 existing records from primary storage. [2025-10-23T23:31:41.714916] [INFO ] [MAIN ] RLJ: Loaded 47956 existing records. [2025-10-23T23:31:41.919211] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:41.919461] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-23T23:31:41.919561] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-23T23:31:41.919881] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-23T23:31:41.919957] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-23T23:31:42.339592] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:42.399423] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-23T23:31:42.449590] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T23:31:42.869116] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T23:31:43.199480] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-23T23:31:43.420211] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T23:31:43.999444] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-23T23:31:44.799491] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-23T23:31:44.997932] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T23:31:45.044522] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T23:31:45.599478] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-23T23:31:46.399403] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-23T23:31:46.750502] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T23:31:46.844260] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T23:31:47.199475] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-23T23:31:47.999482] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-23T23:31:48.723024] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-23T23:31:48.799419] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-23T23:31:48.949464] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T23:31:49.447388] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T23:31:49.599473] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-23T23:31:49.888175] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T23:31:49.895410] [INFO ] [REMOTE ] RLI: Full fetch complete (49512 records). [2025-10-23T23:31:49.895602] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-23T23:31:50.274590] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-23T23:31:50.274729] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-23T23:31:50.275712] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-23T23:31:50.275790] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-23T23:31:50.276922] [DEBUG] [LOCAL ] RLI: Trimmed 49512 records to 34958 (keeping 200 days of data) [2025-10-23T23:31:50.434304] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-23T23:31:50.489862] [DEBUG] [LOCAL ] RLI: Primary data saved (34958 records). [2025-10-23T23:31:50.490007] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-23T23:31:50.490117] [INFO ] [MAIN ] Update Progress: 1806/2367 symbols completed. RLI took 22.8s. Estimated remaining: 1h 11m 60s. Rate: 7.8 symbols/min [2025-10-23T23:31:50.680216] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:50.693234] [DEBUG] [LOCAL ] RLTY: Loaded 10963 existing records from primary storage. [2025-10-23T23:31:50.693679] [INFO ] [MAIN ] RLTY: Loaded 10963 existing records. [2025-10-23T23:31:50.879421] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:50.879837] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-23T23:31:50.879966] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-23T23:31:50.880546] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-23T23:31:50.880712] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-23T23:31:51.012489] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-23T23:31:51.204554] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-23T23:31:51.275211] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:51.999421] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-23T23:31:52.618295] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-23T23:31:52.627975] [INFO ] [REMOTE ] RKT: Full fetch complete (77608 records). [2025-10-23T23:31:52.628141] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-23T23:31:52.806068] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-23T23:31:53.039886] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-23T23:31:53.040966] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T23:31:53.065788] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-23T23:31:53.068549] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-23T23:31:53.070059] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T23:31:53.078587] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-23T23:31:53.080714] [DEBUG] [LOCAL ] RKT: Trimmed 77608 records to 54119 (keeping 200 days of data) [2025-10-23T23:31:53.409579] [DEBUG] [LOCAL ] RKT: Primary data saved (54119 records). [2025-10-23T23:31:53.409776] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-23T23:31:53.409903] [INFO ] [MAIN ] Update Progress: 1807/2367 symbols completed. RKT took 33.4s. Estimated remaining: 1h 11m 51s. Rate: 7.8 symbols/min [2025-10-23T23:31:53.575510] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:31:53.599447] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-23T23:31:53.618506] [DEBUG] [LOCAL ] RLX: Loaded 48165 existing records from primary storage. [2025-10-23T23:31:53.618917] [INFO ] [MAIN ] RLX: Loaded 48165 existing records. [2025-10-23T23:31:53.823052] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:31:53.823321] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-23T23:31:53.823446] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-23T23:31:53.824107] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-23T23:31:53.824201] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-23T23:31:54.221170] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:31:54.399421] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-23T23:31:54.447136] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T23:31:54.575004] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T23:31:55.199454] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-23T23:31:55.999505] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-23T23:31:56.047200] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-23T23:31:56.523840] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-23T23:31:56.799435] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-23T23:31:57.591974] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T23:31:57.599386] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-23T23:31:57.627068] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T23:31:58.388435] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T23:31:58.399404] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-23T23:31:59.199480] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-23T23:31:59.979963] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T23:31:59.999423] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-23T23:32:00.382670] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-23T23:32:00.799441] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-23T23:32:01.599497] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-23T23:32:01.703574] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-23T23:32:01.964478] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T23:32:02.399455] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-23T23:32:03.199474] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-23T23:32:03.289912] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-23T23:32:03.766173] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T23:32:03.999419] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-23T23:32:04.686908] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T23:32:04.799470] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-23T23:32:05.488257] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T23:32:05.533080] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T23:32:05.599406] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-23T23:32:06.399484] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-23T23:32:06.757133] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T23:32:07.199443] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-23T23:32:07.757776] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T23:32:07.999486] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-23T23:32:08.806466] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-23T23:32:08.824791] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-23T23:32:09.476131] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T23:32:09.599442] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-23T23:32:10.170877] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-23T23:32:10.176670] [INFO ] [REMOTE ] RL: Full fetch complete (59106 records). [2025-10-23T23:32:10.176844] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-23T23:32:10.404849] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-23T23:32:10.586784] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-23T23:32:10.586893] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-23T23:32:10.587939] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-23T23:32:10.588017] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-23T23:32:10.589260] [DEBUG] [LOCAL ] RL: Trimmed 59106 records to 39534 (keeping 200 days of data) [2025-10-23T23:32:10.837937] [DEBUG] [LOCAL ] RL: Primary data saved (39534 records). [2025-10-23T23:32:10.838157] [INFO ] [MAIN ] RL: Full history saved. [2025-10-23T23:32:10.838289] [INFO ] [MAIN ] Update Progress: 1808/2367 symbols completed. RL took 44.8s. Estimated remaining: 1h 11m 46s. Rate: 7.8 symbols/min [2025-10-23T23:32:11.013981] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:11.024086] [DEBUG] [LOCAL ] RM: Loaded 7508 existing records from primary storage. [2025-10-23T23:32:11.024383] [INFO ] [MAIN ] RM: Loaded 7508 existing records. [2025-10-23T23:32:11.176776] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T23:32:11.221062] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-23T23:32:11.289389] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:11.289687] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-23T23:32:11.289785] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-23T23:32:11.290044] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-23T23:32:11.290140] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-23T23:32:11.645824] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:11.999474] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-23T23:32:12.043467] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T23:32:12.044549] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-23T23:32:12.799500] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-23T23:32:12.859268] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T23:32:13.599478] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-23T23:32:14.394069] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-23T23:32:14.399384] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-23T23:32:14.539315] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T23:32:15.199494] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-23T23:32:15.217162] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-23T23:32:15.999482] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-23T23:32:16.655436] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-23T23:32:16.799505] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-23T23:32:16.919395] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T23:32:16.931231] [INFO ] [REMOTE ] RLJ: Full fetch complete (69403 records). [2025-10-23T23:32:16.931457] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-23T23:32:17.316979] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-23T23:32:17.317097] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-23T23:32:17.318279] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-23T23:32:17.318361] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-23T23:32:17.319802] [DEBUG] [LOCAL ] RLJ: Trimmed 69403 records to 48283 (keeping 200 days of data) [2025-10-23T23:32:17.601871] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-23T23:32:17.605549] [DEBUG] [LOCAL ] RLJ: Primary data saved (48283 records). [2025-10-23T23:32:17.606746] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-23T23:32:17.608177] [INFO ] [MAIN ] Update Progress: 1809/2367 symbols completed. RLJ took 36.2s. Estimated remaining: 1h 11m 38s. Rate: 7.8 symbols/min [2025-10-23T23:32:17.727628] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T23:32:17.798942] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:17.820414] [DEBUG] [LOCAL ] RMAX: Loaded 21614 existing records from primary storage. [2025-10-23T23:32:17.820746] [INFO ] [MAIN ] RMAX: Loaded 21614 existing records. [2025-10-23T23:32:18.000416] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:18.000662] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-23T23:32:18.000743] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-23T23:32:18.001031] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-23T23:32:18.001117] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-23T23:32:18.351972] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:18.399417] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-23T23:32:19.167290] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T23:32:19.199434] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-23T23:32:19.381476] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-23T23:32:19.974688] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T23:32:19.978079] [INFO ] [REMOTE ] RLTY: Full fetch complete (17226 records). [2025-10-23T23:32:19.978208] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-23T23:32:20.006132] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-23T23:32:20.348106] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-23T23:32:20.348211] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-23T23:32:20.348574] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-23T23:32:20.348668] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-23T23:32:20.349206] [DEBUG] [LOCAL ] RLTY: Trimmed 17226 records to 11046 (keeping 200 days of data) [2025-10-23T23:32:20.414726] [DEBUG] [LOCAL ] RLTY: Primary data saved (11046 records). [2025-10-23T23:32:20.414882] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-23T23:32:20.414990] [INFO ] [MAIN ] Update Progress: 1810/2367 symbols completed. RLTY took 29.9s. Estimated remaining: 1h 11m 29s. Rate: 7.8 symbols/min [2025-10-23T23:32:20.580813] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:20.619636] [DEBUG] [LOCAL ] RMD: Loaded 41879 existing records from primary storage. [2025-10-23T23:32:20.620084] [INFO ] [MAIN ] RMD: Loaded 41879 existing records. [2025-10-23T23:32:20.795809] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:20.796039] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-23T23:32:20.796117] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-23T23:32:20.796378] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-10-23T23:32:20.796451] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-23T23:32:20.807609] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-23T23:32:20.923606] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T23:32:21.185452] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:21.599510] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-23T23:32:22.399430] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-23T23:32:22.511710] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T23:32:22.521175] [INFO ] [REMOTE ] RLX: Full fetch complete (70068 records). [2025-10-23T23:32:22.521439] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-23T23:32:22.944041] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-23T23:32:22.944218] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-23T23:32:22.946324] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-23T23:32:22.946615] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-23T23:32:22.949217] [DEBUG] [LOCAL ] RLX: Trimmed 70068 records to 48484 (keeping 200 days of data) [2025-10-23T23:32:23.048300] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-23T23:32:23.199564] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-23T23:32:23.274455] [DEBUG] [LOCAL ] RLX: Primary data saved (48484 records). [2025-10-23T23:32:23.274773] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-23T23:32:23.274925] [INFO ] [MAIN ] Update Progress: 1811/2367 symbols completed. RLX took 29.9s. Estimated remaining: 1h 11m 19s. Rate: 7.8 symbols/min [2025-10-23T23:32:23.470602] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T23:32:23.493089] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:23.511690] [DEBUG] [LOCAL ] RMI: Loaded 4769 existing records from primary storage. [2025-10-23T23:32:23.512004] [INFO ] [MAIN ] RMI: Loaded 4769 existing records. [2025-10-23T23:32:23.696449] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:23.696694] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-23T23:32:23.696782] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-23T23:32:23.696992] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-23T23:32:23.697072] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-23T23:32:24.004637] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-23T23:32:24.063460] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:24.196422] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T23:32:24.488821] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T23:32:24.799463] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-23T23:32:25.301631] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-23T23:32:25.599458] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-23T23:32:26.345507] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T23:32:26.399440] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-23T23:32:27.199515] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-23T23:32:27.653224] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T23:32:27.900537] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T23:32:27.999446] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-23T23:32:28.799455] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-23T23:32:29.139240] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T23:32:29.599477] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-23T23:32:30.399458] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-23T23:32:30.445599] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T23:32:30.625988] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T23:32:31.101717] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-23T23:32:31.199460] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-23T23:32:31.999475] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-23T23:32:32.550193] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-23T23:32:32.799476] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-23T23:32:33.061446] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T23:32:33.413518] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T23:32:33.415543] [INFO ] [REMOTE ] RM: Full fetch complete (11446 records). [2025-10-23T23:32:33.415692] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-23T23:32:33.612156] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-23T23:32:33.857314] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-23T23:32:33.857476] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-23T23:32:33.858231] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-23T23:32:33.858321] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-23T23:32:33.859186] [DEBUG] [LOCAL ] RM: Trimmed 11446 records to 7531 (keeping 200 days of data) [2025-10-23T23:32:33.916246] [DEBUG] [LOCAL ] RM: Primary data saved (7531 records). [2025-10-23T23:32:33.916535] [INFO ] [MAIN ] RM: Full history saved. [2025-10-23T23:32:33.916744] [INFO ] [MAIN ] Update Progress: 1812/2367 symbols completed. RM took 23.1s. Estimated remaining: 1h 11m 13s. Rate: 7.8 symbols/min [2025-10-23T23:32:34.137517] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:34.152663] [DEBUG] [LOCAL ] RMM: Loaded 10866 existing records from primary storage. [2025-10-23T23:32:34.153091] [INFO ] [MAIN ] RMM: Loaded 10866 existing records. [2025-10-23T23:32:34.369940] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:34.361633] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-23T23:32:34.370413] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-23T23:32:34.372000] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-23T23:32:34.373172] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-23T23:32:34.373252] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-23T23:32:34.404923] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-23T23:32:34.758296] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:35.199555] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-23T23:32:35.999473] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-23T23:32:36.259416] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-23T23:32:36.273899] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-23T23:32:36.709875] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-23T23:32:36.799463] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-23T23:32:37.599408] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-23T23:32:37.913918] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T23:32:38.346348] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T23:32:38.399467] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-23T23:32:39.118422] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T23:32:39.199459] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-23T23:32:39.776410] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T23:32:39.999470] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-23T23:32:40.376726] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-23T23:32:40.799536] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-23T23:32:41.362311] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-23T23:32:41.599457] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-23T23:32:42.399435] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-23T23:32:43.116696] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T23:32:43.116869] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T23:32:43.199397] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-23T23:32:43.883322] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-23T23:32:43.999440] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-23T23:32:44.799438] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-23T23:32:45.443675] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T23:32:45.445128] [INFO ] [REMOTE ] RMI: Full fetch complete (6122 records). [2025-10-23T23:32:45.445224] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-23T23:32:45.629178] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-23T23:32:45.767941] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T23:32:45.857765] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-23T23:32:45.857897] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-23T23:32:45.858109] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-23T23:32:45.858182] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-23T23:32:45.858595] [DEBUG] [LOCAL ] RMI: Trimmed 6122 records to 4826 (keeping 200 days of data) [2025-10-23T23:32:45.887332] [DEBUG] [LOCAL ] RMI: Primary data saved (4826 records). [2025-10-23T23:32:45.887482] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-23T23:32:45.887595] [INFO ] [MAIN ] Update Progress: 1813/2367 symbols completed. RMI took 22.6s. Estimated remaining: 1h 11m 6s. Rate: 7.8 symbols/min [2025-10-23T23:32:46.054268] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:46.061794] [DEBUG] [LOCAL ] RMMZ: Loaded 4798 existing records from primary storage. [2025-10-23T23:32:46.062052] [INFO ] [MAIN ] RMMZ: Loaded 4798 existing records. [2025-10-23T23:32:46.239345] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:46.239555] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-23T23:32:46.239633] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-23T23:32:46.239823] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-23T23:32:46.239898] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-23T23:32:46.399710] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-23T23:32:46.588436] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-23T23:32:46.634871] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:47.199448] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-23T23:32:47.520780] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T23:32:47.999458] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-23T23:32:48.472792] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-23T23:32:48.505192] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-23T23:32:48.799505] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-23T23:32:49.599448] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-23T23:32:50.406464] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-23T23:32:50.406383] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T23:32:50.427118] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T23:32:51.199484] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-23T23:32:51.536270] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:32:51.999488] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-23T23:32:52.782784] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:32:52.800353] [INFO ] [REMOTE ] RMD: Full fetch complete (61647 records). [2025-10-23T23:32:52.799471] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-23T23:32:52.799855] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-23T23:32:52.800848] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-23T23:32:53.186445] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-23T23:32:53.186561] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-23T23:32:53.187684] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-23T23:32:53.187809] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-23T23:32:53.189056] [DEBUG] [LOCAL ] RMD: Trimmed 61647 records to 42165 (keeping 200 days of data) [2025-10-23T23:32:53.448292] [DEBUG] [LOCAL ] RMD: Primary data saved (42165 records). [2025-10-23T23:32:53.452944] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-23T23:32:53.454828] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-23T23:32:53.454933] [INFO ] [MAIN ] Update Progress: 1814/2367 symbols completed. RMD took 33.0s. Estimated remaining: 1h 10m 59s. Rate: 7.8 symbols/min [2025-10-23T23:32:53.601596] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-23T23:32:53.621436] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:32:53.639519] [DEBUG] [LOCAL ] RMT: Loaded 17151 existing records from primary storage. [2025-10-23T23:32:53.639818] [INFO ] [MAIN ] RMT: Loaded 17151 existing records. [2025-10-23T23:32:53.812075] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:32:53.812332] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-23T23:32:53.812408] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-23T23:32:53.812627] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-23T23:32:53.812738] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-23T23:32:54.142110] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-23T23:32:54.188093] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:32:54.399467] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-23T23:32:54.958059] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-23T23:32:55.199467] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-23T23:32:55.992421] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T23:32:55.999397] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-23T23:32:56.799476] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-23T23:32:56.987440] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-23T23:32:57.599454] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-23T23:32:57.818444] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-23T23:32:58.188683] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T23:32:58.399504] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-23T23:32:58.983456] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-23T23:32:59.199496] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-23T23:32:59.999405] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-23T23:33:00.240931] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T23:33:00.799444] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-23T23:33:00.936324] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T23:33:01.599399] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-23T23:33:01.608048] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T23:33:01.610493] [INFO ] [REMOTE ] RMM: Full fetch complete (14882 records). [2025-10-23T23:33:01.610597] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-23T23:33:01.968488] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-23T23:33:01.968609] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-23T23:33:01.968998] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-23T23:33:01.969078] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-23T23:33:01.969591] [DEBUG] [LOCAL ] RMM: Trimmed 14882 records to 11008 (keeping 200 days of data) [2025-10-23T23:33:02.034805] [DEBUG] [LOCAL ] RMM: Primary data saved (11008 records). [2025-10-23T23:33:02.034961] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-23T23:33:02.035076] [INFO ] [MAIN ] Update Progress: 1815/2367 symbols completed. RMM took 28.1s. Estimated remaining: 1h 10m 51s. Rate: 7.8 symbols/min [2025-10-23T23:33:02.201963] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:02.214636] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-23T23:33:02.247439] [DEBUG] [LOCAL ] RNG: Loaded 47979 existing records from primary storage. [2025-10-23T23:33:02.247844] [INFO ] [MAIN ] RNG: Loaded 47979 existing records. [2025-10-23T23:33:02.399624] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-23T23:33:02.423530] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:02.423769] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-23T23:33:02.423845] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-23T23:33:02.424154] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-23T23:33:02.424228] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-23T23:33:02.773680] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:03.199415] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-23T23:33:03.504062] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T23:33:03.508207] [INFO ] [REMOTE ] RMAX: Full fetch complete (29901 records). [2025-10-23T23:33:03.508387] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-23T23:33:03.923506] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-23T23:33:03.923628] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-23T23:33:03.924334] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-23T23:33:03.924411] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-23T23:33:03.925140] [DEBUG] [LOCAL ] RMAX: Trimmed 29901 records to 21748 (keeping 200 days of data) [2025-10-23T23:33:04.006158] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-23T23:33:04.030392] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T23:33:04.072292] [DEBUG] [LOCAL ] RMAX: Primary data saved (21748 records). [2025-10-23T23:33:04.072494] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-23T23:33:04.072675] [INFO ] [MAIN ] Update Progress: 1816/2367 symbols completed. RMAX took 46.5s. Estimated remaining: 1h 10m 42s. Rate: 7.8 symbols/min [2025-10-23T23:33:04.242418] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:04.263453] [DEBUG] [LOCAL ] RNGR: Loaded 20718 existing records from primary storage. [2025-10-23T23:33:04.263751] [INFO ] [MAIN ] RNGR: Loaded 20718 existing records. [2025-10-23T23:33:04.440550] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:04.440788] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-23T23:33:04.440861] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-23T23:33:04.441071] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-23T23:33:04.441143] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-23T23:33:04.720095] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T23:33:04.799609] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-23T23:33:04.799545] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:05.392438] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T23:33:05.599444] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-23T23:33:06.399446] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-23T23:33:06.641881] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-23T23:33:07.199471] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-23T23:33:08.009389] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-23T23:33:08.012391] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-23T23:33:08.104161] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-23T23:33:08.799510] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-23T23:33:09.089781] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-23T23:33:09.368096] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T23:33:09.599435] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-23T23:33:10.399412] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-23T23:33:11.013019] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T23:33:11.014399] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6582 records). [2025-10-23T23:33:11.014503] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-23T23:33:11.203712] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-23T23:33:11.351900] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T23:33:11.452984] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-23T23:33:11.453177] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-23T23:33:11.453501] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-23T23:33:11.453595] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-23T23:33:11.454214] [DEBUG] [LOCAL ] RMMZ: Trimmed 6582 records to 4821 (keeping 200 days of data) [2025-10-23T23:33:11.486056] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4821 records). [2025-10-23T23:33:11.486304] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-23T23:33:11.486462] [INFO ] [MAIN ] Update Progress: 1817/2367 symbols completed. RMMZ took 25.6s. Estimated remaining: 1h 10m 34s. Rate: 7.8 symbols/min [2025-10-23T23:33:11.683264] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:11.703030] [DEBUG] [LOCAL ] RNP: Loaded 15933 existing records from primary storage. [2025-10-23T23:33:11.703534] [INFO ] [MAIN ] RNP: Loaded 15933 existing records. [2025-10-23T23:33:11.917978] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:11.918755] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-23T23:33:11.918831] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-23T23:33:11.919035] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-23T23:33:11.919107] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-23T23:33:12.004695] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-23T23:33:12.281493] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:12.309105] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-23T23:33:12.799430] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-23T23:33:13.599475] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-23T23:33:13.747152] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-23T23:33:13.753996] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T23:33:14.303166] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T23:33:14.399516] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-23T23:33:15.199425] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-23T23:33:15.262053] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T23:33:15.999480] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-23T23:33:16.358621] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-23T23:33:16.799441] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-23T23:33:17.604591] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-23T23:33:17.621682] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T23:33:17.847449] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T23:33:18.399493] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-23T23:33:18.752950] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T23:33:19.181882] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T23:33:19.199401] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-23T23:33:19.999450] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-23T23:33:20.279105] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T23:33:20.799422] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-23T23:33:20.993872] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-23T23:33:21.599428] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-23T23:33:21.955000] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T23:33:22.399410] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-23T23:33:22.639395] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-23T23:33:23.199419] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-23T23:33:23.355088] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-23T23:33:23.925403] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-23T23:33:23.999507] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-23T23:33:24.799454] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-23T23:33:25.604603] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-23T23:33:25.622227] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T23:33:25.767010] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T23:33:26.399453] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-23T23:33:27.152997] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-23T23:33:27.199434] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-23T23:33:27.916442] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T23:33:27.920157] [INFO ] [REMOTE ] RMT: Full fetch complete (25465 records). [2025-10-23T23:33:27.920262] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-23T23:33:28.009729] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-23T23:33:28.217192] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T23:33:28.301706] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-23T23:33:28.301813] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-23T23:33:28.302364] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-23T23:33:28.302439] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-23T23:33:28.303157] [DEBUG] [LOCAL ] RMT: Trimmed 25465 records to 17211 (keeping 200 days of data) [2025-10-23T23:33:28.402404] [DEBUG] [LOCAL ] RMT: Primary data saved (17211 records). [2025-10-23T23:33:28.402556] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-23T23:33:28.402697] [INFO ] [MAIN ] Update Progress: 1818/2367 symbols completed. RMT took 34.9s. Estimated remaining: 1h 10m 29s. Rate: 7.8 symbols/min [2025-10-23T23:33:28.567315] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:28.600073] [DEBUG] [LOCAL ] RNR: Loaded 33518 existing records from primary storage. [2025-10-23T23:33:28.600368] [INFO ] [MAIN ] RNR: Loaded 33518 existing records. [2025-10-23T23:33:28.778310] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:28.778510] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-23T23:33:28.778583] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-23T23:33:28.778870] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-23T23:33:28.778943] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-23T23:33:28.808772] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-23T23:33:29.143826] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-23T23:33:29.148063] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:29.599442] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-23T23:33:30.206995] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T23:33:30.399409] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-23T23:33:30.523055] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T23:33:30.526964] [INFO ] [REMOTE ] RNGR: Full fetch complete (28392 records). [2025-10-23T23:33:30.527078] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-23T23:33:30.885958] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-23T23:33:30.886089] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-23T23:33:30.886788] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-23T23:33:30.886884] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-23T23:33:30.887667] [DEBUG] [LOCAL ] RNGR: Trimmed 28392 records to 20837 (keeping 200 days of data) [2025-10-23T23:33:31.013621] [DEBUG] [LOCAL ] RNGR: Primary data saved (20837 records). [2025-10-23T23:33:31.013820] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-23T23:33:31.013948] [INFO ] [MAIN ] Update Progress: 1819/2367 symbols completed. RNGR took 26.9s. Estimated remaining: 1h 10m 20s. Rate: 7.8 symbols/min [2025-10-23T23:33:31.180104] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:31.200074] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-23T23:33:31.215241] [DEBUG] [LOCAL ] RNST: Loaded 35883 existing records from primary storage. [2025-10-23T23:33:31.215536] [INFO ] [MAIN ] RNST: Loaded 35883 existing records. [2025-10-23T23:33:31.387031] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:31.387254] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-23T23:33:31.387329] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-23T23:33:31.387688] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-23T23:33:31.387784] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-23T23:33:31.739430] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:31.999454] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-23T23:33:32.680879] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T23:33:32.799401] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-23T23:33:32.828280] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-23T23:33:33.549044] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-10-23T23:33:33.599393] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-23T23:33:34.365409] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:33:34.399434] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-23T23:33:35.199459] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-23T23:33:35.284770] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T23:33:35.334408] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-23T23:33:35.999478] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-23T23:33:36.773545] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:33:36.790841] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T23:33:36.799388] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-23T23:33:37.599435] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-23T23:33:37.866922] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-23T23:33:37.870548] [INFO ] [REMOTE ] RNP: Full fetch complete (23337 records). [2025-10-23T23:33:37.870675] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-23T23:33:38.228697] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-23T23:33:38.228825] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-23T23:33:38.229274] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-23T23:33:38.229342] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-23T23:33:38.230014] [DEBUG] [LOCAL ] RNP: Trimmed 23337 records to 16013 (keeping 200 days of data) [2025-10-23T23:33:38.324538] [DEBUG] [LOCAL ] RNP: Primary data saved (16013 records). [2025-10-23T23:33:38.324709] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-23T23:33:38.324805] [INFO ] [MAIN ] Update Progress: 1820/2367 symbols completed. RNP took 26.8s. Estimated remaining: 1h 10m 12s. Rate: 7.8 symbols/min [2025-10-23T23:33:38.404721] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-23T23:33:38.493588] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:38.512827] [DEBUG] [LOCAL ] ROG: Loaded 21642 existing records from primary storage. [2025-10-23T23:33:38.513121] [INFO ] [MAIN ] ROG: Loaded 21642 existing records. [2025-10-23T23:33:38.686914] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:38.687105] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-23T23:33:38.687177] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-23T23:33:38.687433] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-23T23:33:38.687506] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-23T23:33:39.048799] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:39.062118] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T23:33:39.199417] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-23T23:33:39.978150] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-23T23:33:39.999423] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-23T23:33:40.557606] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T23:33:40.799452] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-23T23:33:41.599506] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-23T23:33:41.640836] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T23:33:41.650171] [INFO ] [REMOTE ] RNG: Full fetch complete (69958 records). [2025-10-23T23:33:41.650382] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-23T23:33:41.771167] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T23:33:42.057717] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-23T23:33:42.058311] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-23T23:33:42.059502] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-23T23:33:42.059581] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-23T23:33:42.061064] [DEBUG] [LOCAL ] RNG: Trimmed 69958 records to 48318 (keeping 200 days of data) [2025-10-23T23:33:42.335304] [DEBUG] [LOCAL ] RNG: Primary data saved (48318 records). [2025-10-23T23:33:42.335468] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-23T23:33:42.335580] [INFO ] [MAIN ] Update Progress: 1821/2367 symbols completed. RNG took 40.3s. Estimated remaining: 1h 10m 3s. Rate: 7.8 symbols/min [2025-10-23T23:33:42.404521] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-23T23:33:42.505298] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:42.545496] [DEBUG] [LOCAL ] ROK: Loaded 42806 existing records from primary storage. [2025-10-23T23:33:42.545843] [INFO ] [MAIN ] ROK: Loaded 42806 existing records. [2025-10-23T23:33:42.724194] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:42.724436] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-23T23:33:42.724580] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-23T23:33:42.725121] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-10-23T23:33:42.725195] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-23T23:33:43.115162] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:33:43.140898] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-23T23:33:43.199439] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-23T23:33:43.563945] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-23T23:33:43.999478] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-23T23:33:44.678746] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T23:33:44.799394] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-23T23:33:45.172468] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-23T23:33:45.599434] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-23T23:33:45.969197] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T23:33:46.399472] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-23T23:33:47.083241] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T23:33:47.199491] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-23T23:33:47.999411] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-23T23:33:48.030583] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:33:48.799429] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-23T23:33:48.926945] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:33:49.529279] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-23T23:33:49.599450] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-23T23:33:50.399437] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-23T23:33:50.436539] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T23:33:50.832608] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T23:33:51.199541] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-23T23:33:51.791202] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T23:33:51.999484] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-23T23:33:52.799455] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-23T23:33:52.947895] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T23:33:53.238367] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T23:33:53.599451] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-23T23:33:53.825633] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T23:33:54.399442] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-23T23:33:54.928947] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-23T23:33:55.199463] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-23T23:33:55.837055] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T23:33:55.929913] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T23:33:55.999551] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-23T23:33:56.799433] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-23T23:33:57.574585] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T23:33:57.599421] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-23T23:33:57.861311] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T23:33:58.399434] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-23T23:33:58.865018] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-23T23:33:58.871145] [INFO ] [REMOTE ] RNR: Full fetch complete (50941 records). [2025-10-23T23:33:58.871279] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-23T23:33:59.206141] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-23T23:33:59.250481] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-23T23:33:59.250588] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-23T23:33:59.251692] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-23T23:33:59.251861] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-23T23:33:59.266339] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-23T23:33:59.271864] [DEBUG] [LOCAL ] RNR: Trimmed 50941 records to 33749 (keeping 200 days of data) [2025-10-23T23:33:59.482323] [DEBUG] [LOCAL ] RNR: Primary data saved (33749 records). [2025-10-23T23:33:59.482520] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-23T23:33:59.482658] [INFO ] [MAIN ] Update Progress: 1822/2367 symbols completed. RNR took 31.1s. Estimated remaining: 1h 9m 58s. Rate: 7.8 symbols/min [2025-10-23T23:33:59.650678] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:33:59.694713] [DEBUG] [LOCAL ] ROL: Loaded 50245 existing records from primary storage. [2025-10-23T23:33:59.695040] [INFO ] [MAIN ] ROL: Loaded 50245 existing records. [2025-10-23T23:33:59.869700] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:33:59.869908] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-23T23:33:59.869982] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-23T23:33:59.870209] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-10-23T23:33:59.870285] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-23T23:34:00.015420] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-23T23:34:00.229153] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:00.799413] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-23T23:34:01.041538] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T23:34:01.467488] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T23:34:01.599424] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-23T23:34:01.716884] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-23T23:34:02.399492] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-23T23:34:03.199430] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-23T23:34:03.385469] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T23:34:03.955749] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T23:34:03.999426] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-23T23:34:04.560516] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T23:34:04.799449] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-23T23:34:05.599441] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-23T23:34:06.239294] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-23T23:34:06.310674] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-23T23:34:06.313718] [INFO ] [REMOTE ] ROG: Full fetch complete (30713 records). [2025-10-23T23:34:06.313824] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-23T23:34:06.404512] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-23T23:34:06.685128] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-23T23:34:06.685319] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-23T23:34:06.708391] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-23T23:34:06.708562] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-23T23:34:06.710472] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-23T23:34:06.719671] [DEBUG] [LOCAL ] ROG: Trimmed 30713 records to 21699 (keeping 200 days of data) [2025-10-23T23:34:06.844485] [DEBUG] [LOCAL ] ROG: Primary data saved (21699 records). [2025-10-23T23:34:06.844664] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-23T23:34:06.844783] [INFO ] [MAIN ] Update Progress: 1823/2367 symbols completed. ROG took 28.5s. Estimated remaining: 1h 9m 50s. Rate: 7.8 symbols/min [2025-10-23T23:34:07.009865] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:07.048639] [DEBUG] [LOCAL ] RPM: Loaded 42049 existing records from primary storage. [2025-10-23T23:34:07.049014] [INFO ] [MAIN ] RPM: Loaded 42049 existing records. [2025-10-23T23:34:07.202783] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-23T23:34:07.225398] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:07.225624] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-23T23:34:07.225737] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-23T23:34:07.225982] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-23T23:34:07.226067] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-23T23:34:07.584253] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:07.721143] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-23T23:34:07.727102] [INFO ] [REMOTE ] RNST: Full fetch complete (52721 records). [2025-10-23T23:34:07.727228] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-23T23:34:08.006739] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-23T23:34:08.126573] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-23T23:34:08.126716] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-23T23:34:08.127718] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-23T23:34:08.127819] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-23T23:34:08.128965] [DEBUG] [LOCAL ] RNST: Trimmed 52721 records to 36124 (keeping 200 days of data) [2025-10-23T23:34:08.350571] [DEBUG] [LOCAL ] RNST: Primary data saved (36124 records). [2025-10-23T23:34:08.350788] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-23T23:34:08.350931] [INFO ] [MAIN ] Update Progress: 1824/2367 symbols completed. RNST took 37.3s. Estimated remaining: 1h 9m 41s. Rate: 7.8 symbols/min [2025-10-23T23:34:08.570829] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:08.588793] [DEBUG] [LOCAL ] RPT: Loaded 18982 existing records from primary storage. [2025-10-23T23:34:08.589085] [INFO ] [MAIN ] RPT: Loaded 18982 existing records. [2025-10-23T23:34:08.763228] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:08.763625] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-23T23:34:08.763784] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-23T23:34:08.764068] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-23T23:34:08.764140] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-23T23:34:08.818203] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-23T23:34:09.120991] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:09.151886] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T23:34:09.576691] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T23:34:09.599428] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-23T23:34:10.399433] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-23T23:34:10.524591] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T23:34:11.074059] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:34:11.199466] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-23T23:34:11.999462] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-23T23:34:12.181341] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T23:34:12.503852] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T23:34:12.799435] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-23T23:34:13.585505] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T23:34:13.599418] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-23T23:34:13.804896] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-23T23:34:14.399469] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-23T23:34:15.127174] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T23:34:15.199436] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-23T23:34:15.479421] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T23:34:15.999448] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-23T23:34:16.534957] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-23T23:34:16.799446] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-23T23:34:17.599423] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-23T23:34:17.634349] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T23:34:18.009483] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-23T23:34:18.016638] [INFO ] [REMOTE ] ROK: Full fetch complete (62626 records). [2025-10-23T23:34:18.016818] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-23T23:34:18.396466] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-23T23:34:18.396595] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-23T23:34:18.397683] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-23T23:34:18.397820] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-23T23:34:18.399345] [DEBUG] [LOCAL ] ROK: Trimmed 62626 records to 43027 (keeping 200 days of data) [2025-10-23T23:34:18.399412] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-23T23:34:18.671531] [DEBUG] [LOCAL ] ROK: Primary data saved (43027 records). [2025-10-23T23:34:18.671781] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-23T23:34:18.671892] [INFO ] [MAIN ] Update Progress: 1825/2367 symbols completed. ROK took 36.3s. Estimated remaining: 1h 9m 34s. Rate: 7.8 symbols/min [2025-10-23T23:34:18.839395] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:18.868392] [DEBUG] [LOCAL ] RQI: Loaded 28772 existing records from primary storage. [2025-10-23T23:34:18.868734] [INFO ] [MAIN ] RQI: Loaded 28772 existing records. [2025-10-23T23:34:19.045117] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-23T23:34:19.063786] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:19.069019] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-23T23:34:19.069098] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-23T23:34:19.069340] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-23T23:34:19.069413] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-23T23:34:19.206464] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-23T23:34:19.420700] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:19.999429] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-23T23:34:20.236940] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-23T23:34:20.238104] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-23T23:34:20.799443] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-23T23:34:21.105501] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-23T23:34:21.599463] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-23T23:34:21.904094] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T23:34:22.399507] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-23T23:34:22.546325] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-23T23:34:23.199430] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-23T23:34:23.860207] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T23:34:23.999401] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-23T23:34:24.123589] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T23:34:24.799438] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-23T23:34:25.599412] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-23T23:34:25.689837] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-23T23:34:26.399414] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-23T23:34:26.531357] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T23:34:26.606055] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T23:34:27.199458] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-23T23:34:27.828483] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T23:34:27.999444] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-23T23:34:28.539571] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-23T23:34:28.799445] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-23T23:34:29.010121] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T23:34:29.599467] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-23T23:34:30.131264] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-23T23:34:30.399456] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-23T23:34:31.199500] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-23T23:34:31.500110] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-23T23:34:31.508088] [INFO ] [REMOTE ] RPM: Full fetch complete (59803 records). [2025-10-23T23:34:31.508284] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-23T23:34:31.933608] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T23:34:31.933864] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-23T23:34:31.940481] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-23T23:34:31.941793] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-23T23:34:31.942196] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-23T23:34:31.943450] [DEBUG] [LOCAL ] RPM: Trimmed 59803 records to 42318 (keeping 200 days of data) [2025-10-23T23:34:32.006770] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-23T23:34:32.225151] [DEBUG] [LOCAL ] RPM: Primary data saved (42318 records). [2025-10-23T23:34:32.225329] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-23T23:34:32.225941] [INFO ] [MAIN ] Update Progress: 1826/2367 symbols completed. RPM took 25.4s. Estimated remaining: 1h 9m 28s. Rate: 7.8 symbols/min [2025-10-23T23:34:32.226319] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T23:34:32.397383] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:32.444309] [DEBUG] [LOCAL ] RRC: Loaded 52917 existing records from primary storage. [2025-10-23T23:34:32.444806] [INFO ] [MAIN ] RRC: Loaded 52917 existing records. [2025-10-23T23:34:32.626440] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:32.626736] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-23T23:34:32.626813] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-23T23:34:32.627045] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-23T23:34:32.627117] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-23T23:34:32.800388] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-23T23:34:32.993922] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:33.026321] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T23:34:33.599447] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-23T23:34:34.399436] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-23T23:34:34.788626] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-23T23:34:35.199407] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-23T23:34:35.327378] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T23:34:35.498833] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T23:34:35.999446] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-23T23:34:36.171030] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T23:34:36.799438] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-23T23:34:37.599430] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-23T23:34:37.793178] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-23T23:34:38.073358] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-23T23:34:38.399433] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-23T23:34:39.086080] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-23T23:34:39.199431] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-23T23:34:39.999482] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-23T23:34:40.145169] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T23:34:40.799456] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-23T23:34:40.962410] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T23:34:40.971889] [INFO ] [REMOTE ] ROL: Full fetch complete (73243 records). [2025-10-23T23:34:40.972080] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-23T23:34:41.334138] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-23T23:34:41.402721] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-23T23:34:41.402856] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-23T23:34:41.404185] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-23T23:34:41.404285] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-23T23:34:41.405759] [DEBUG] [LOCAL ] ROL: Trimmed 73243 records to 50634 (keeping 200 days of data) [2025-10-23T23:34:41.613526] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-23T23:34:41.711199] [DEBUG] [LOCAL ] ROL: Primary data saved (50634 records). [2025-10-23T23:34:41.711375] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-23T23:34:41.711524] [INFO ] [MAIN ] Update Progress: 1827/2367 symbols completed. ROL took 42.2s. Estimated remaining: 1h 9m 21s. Rate: 7.8 symbols/min [2025-10-23T23:34:41.879855] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:41.917834] [DEBUG] [LOCAL ] RRX: Loaded 40772 existing records from primary storage. [2025-10-23T23:34:41.918236] [INFO ] [MAIN ] RRX: Loaded 40772 existing records. [2025-10-23T23:34:42.093487] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:42.093844] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-23T23:34:42.093943] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-23T23:34:42.094843] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-23T23:34:42.094927] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-23T23:34:42.404563] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-23T23:34:42.459073] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:42.612948] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T23:34:42.890919] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T23:34:43.199424] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-23T23:34:43.344364] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T23:34:43.347663] [INFO ] [REMOTE ] RPT: Full fetch complete (28232 records). [2025-10-23T23:34:43.347802] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-23T23:34:43.709163] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-23T23:34:43.709275] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-23T23:34:43.709942] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-23T23:34:43.710021] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-23T23:34:43.710779] [DEBUG] [LOCAL ] RPT: Trimmed 28232 records to 19086 (keeping 200 days of data) [2025-10-23T23:34:43.816824] [DEBUG] [LOCAL ] RPT: Primary data saved (19086 records). [2025-10-23T23:34:43.816994] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-23T23:34:43.817132] [INFO ] [MAIN ] Update Progress: 1828/2367 symbols completed. RPT took 35.5s. Estimated remaining: 1h 9m 11s. Rate: 7.8 symbols/min [2025-10-23T23:34:43.982256] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:44.003396] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-23T23:34:44.003912] [DEBUG] [LOCAL ] RS: Loaded 24518 existing records from primary storage. [2025-10-23T23:34:44.005242] [INFO ] [MAIN ] RS: Loaded 24518 existing records. [2025-10-23T23:34:44.181097] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:44.181328] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-23T23:34:44.181401] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-23T23:34:44.181811] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-10-23T23:34:44.181892] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-23T23:34:44.536273] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:44.602341] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T23:34:44.799415] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-23T23:34:44.987518] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-23T23:34:44.992529] [INFO ] [REMOTE ] RQI: Full fetch complete (42636 records). [2025-10-23T23:34:44.992665] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-23T23:34:45.363592] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-23T23:34:45.363739] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-23T23:34:45.364592] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-23T23:34:45.364686] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-23T23:34:45.365774] [DEBUG] [LOCAL ] RQI: Trimmed 42636 records to 28922 (keeping 200 days of data) [2025-10-23T23:34:45.537453] [DEBUG] [LOCAL ] RQI: Primary data saved (28922 records). [2025-10-23T23:34:45.537602] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-23T23:34:45.537718] [INFO ] [MAIN ] Update Progress: 1829/2367 symbols completed. RQI took 26.9s. Estimated remaining: 1h 9m 2s. Rate: 7.8 symbols/min [2025-10-23T23:34:45.604630] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-23T23:34:45.711097] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:34:45.717707] [DEBUG] [LOCAL ] RSF: Loaded 4258 existing records from primary storage. [2025-10-23T23:34:45.717938] [INFO ] [MAIN ] RSF: Loaded 4258 existing records. [2025-10-23T23:34:45.892032] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:34:45.892208] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-23T23:34:45.892278] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-23T23:34:45.892447] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-23T23:34:45.892516] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-23T23:34:46.269029] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:34:46.295959] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T23:34:46.399413] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-23T23:34:46.950971] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-23T23:34:47.132193] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T23:34:47.199404] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-23T23:34:47.999497] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-23T23:34:48.481939] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T23:34:48.799422] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-23T23:34:49.027363] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-23T23:34:49.096328] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-23T23:34:49.599427] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-23T23:34:50.016164] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-23T23:34:50.399427] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-23T23:34:51.199449] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-23T23:34:51.999498] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-23T23:34:52.044713] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T23:34:52.497563] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T23:34:52.603594] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T23:34:52.799424] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-23T23:34:53.599422] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-23T23:34:54.399435] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-23T23:34:54.575744] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T23:34:55.185314] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-23T23:34:55.204520] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-23T23:34:55.217108] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-23T23:34:55.999446] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-23T23:34:56.622366] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T23:34:56.799416] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-23T23:34:57.419600] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-23T23:34:57.502575] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T23:34:57.599408] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-23T23:34:58.399450] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-23T23:34:58.773737] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-23T23:34:58.986936] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T23:34:59.199453] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-23T23:34:59.999463] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-23T23:35:00.799420] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-23T23:35:01.127031] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T23:35:01.128167] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T23:35:01.599469] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-23T23:35:02.399438] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-23T23:35:02.525804] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:35:03.199420] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-23T23:35:03.280289] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-23T23:35:03.640318] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-23T23:35:03.649637] [INFO ] [REMOTE ] RRC: Full fetch complete (76752 records). [2025-10-23T23:35:03.649835] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-23T23:35:03.891015] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-23T23:35:04.000338] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-23T23:35:04.046466] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-23T23:35:04.046590] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-23T23:35:04.047977] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-23T23:35:04.048080] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-23T23:35:04.050069] [DEBUG] [LOCAL ] RRC: Trimmed 76752 records to 53305 (keeping 200 days of data) [2025-10-23T23:35:04.369152] [DEBUG] [LOCAL ] RRC: Primary data saved (53305 records). [2025-10-23T23:35:04.369304] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-23T23:35:04.369415] [INFO ] [MAIN ] Update Progress: 1830/2367 symbols completed. RRC took 32.1s. Estimated remaining: 1h 8m 58s. Rate: 7.8 symbols/min [2025-10-23T23:35:04.536211] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:04.542915] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-23T23:35:04.544245] [INFO ] [REMOTE ] RSF: Full fetch complete (5616 records). [2025-10-23T23:35:04.544337] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-23T23:35:04.804592] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-23T23:35:04.870767] [DEBUG] [LOCAL ] RSG: Loaded 47300 existing records from primary storage. [2025-10-23T23:35:04.877051] [INFO ] [MAIN ] RSG: Loaded 47300 existing records. [2025-10-23T23:35:05.109552] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-23T23:35:05.148875] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:05.141897] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-23T23:35:05.149358] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-23T23:35:05.149452] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-23T23:35:05.149282] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-23T23:35:05.149603] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-23T23:35:05.149965] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-10-23T23:35:05.150288] [DEBUG] [LOCAL ] RSF: Trimmed 5616 records to 4278 (keeping 200 days of data) [2025-10-23T23:35:05.150107] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-23T23:35:05.286448] [DEBUG] [LOCAL ] RSF: Primary data saved (4278 records). [2025-10-23T23:35:05.298803] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-23T23:35:05.299190] [INFO ] [MAIN ] Update Progress: 1831/2367 symbols completed. RSF took 19.8s. Estimated remaining: 1h 8m 48s. Rate: 7.8 symbols/min [2025-10-23T23:35:05.599564] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-23T23:35:05.697820] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:05.790783] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:05.824665] [DEBUG] [LOCAL ] RSI: Loaded 46976 existing records from primary storage. [2025-10-23T23:35:05.825144] [INFO ] [MAIN ] RSI: Loaded 46976 existing records. [2025-10-23T23:35:06.000562] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:06.000976] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-23T23:35:06.001058] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-23T23:35:06.001531] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-23T23:35:06.001606] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-23T23:35:06.303485] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T23:35:06.388090] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:06.399394] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-23T23:35:07.143296] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T23:35:07.199440] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-23T23:35:08.004730] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-23T23:35:08.025158] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-23T23:35:08.650879] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T23:35:08.799518] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-23T23:35:09.403957] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T23:35:09.599428] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-23T23:35:10.321569] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-23T23:35:10.399397] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-23T23:35:11.082223] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T23:35:11.199393] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-23T23:35:11.999421] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-23T23:35:12.252275] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-23T23:35:12.799465] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-23T23:35:12.946827] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T23:35:13.136822] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T23:35:13.599400] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-23T23:35:14.018628] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T23:35:14.399446] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-23T23:35:15.199521] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-23T23:35:15.553241] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-23T23:35:15.836855] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-23T23:35:15.999410] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-23T23:35:16.205352] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T23:35:16.799444] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-23T23:35:17.558626] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T23:35:17.599402] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-23T23:35:18.399443] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-23T23:35:18.740896] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T23:35:18.894133] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T23:35:18.904251] [INFO ] [REMOTE ] RRX: Full fetch complete (58695 records). [2025-10-23T23:35:18.904486] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-23T23:35:19.204513] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-23T23:35:19.321507] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-23T23:35:19.321614] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-23T23:35:19.322692] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-23T23:35:19.322786] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-23T23:35:19.323954] [DEBUG] [LOCAL ] RRX: Trimmed 58695 records to 41001 (keeping 200 days of data) [2025-10-23T23:35:19.589079] [DEBUG] [LOCAL ] RRX: Primary data saved (41001 records). [2025-10-23T23:35:19.589228] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-23T23:35:19.589376] [INFO ] [MAIN ] Update Progress: 1832/2367 symbols completed. RRX took 37.9s. Estimated remaining: 1h 8m 42s. Rate: 7.8 symbols/min [2025-10-23T23:35:19.756939] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:19.787586] [DEBUG] [LOCAL ] RSKD: Loaded 33238 existing records from primary storage. [2025-10-23T23:35:19.787909] [INFO ] [MAIN ] RSKD: Loaded 33238 existing records. [2025-10-23T23:35:19.968837] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:19.969284] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-23T23:35:19.969474] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-23T23:35:19.969898] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-23T23:35:19.970008] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-23T23:35:20.012127] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-23T23:35:20.163864] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T23:35:20.375130] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:20.799426] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-23T23:35:20.913857] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T23:35:21.178101] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T23:35:21.182488] [INFO ] [REMOTE ] RS: Full fetch complete (38627 records). [2025-10-23T23:35:21.182590] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-23T23:35:21.551705] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-23T23:35:21.551817] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-23T23:35:21.552627] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-23T23:35:21.552723] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-23T23:35:21.553533] [DEBUG] [LOCAL ] RS: Trimmed 38627 records to 24797 (keeping 200 days of data) [2025-10-23T23:35:21.607543] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-23T23:35:21.706580] [DEBUG] [LOCAL ] RS: Primary data saved (24797 records). [2025-10-23T23:35:21.706751] [INFO ] [MAIN ] RS: Full history saved. [2025-10-23T23:35:21.706861] [INFO ] [MAIN ] Update Progress: 1833/2367 symbols completed. RS took 37.9s. Estimated remaining: 1h 8m 33s. Rate: 7.8 symbols/min [2025-10-23T23:35:21.880821] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:21.919976] [DEBUG] [LOCAL ] RTO: Loaded 39724 existing records from primary storage. [2025-10-23T23:35:21.920278] [INFO ] [MAIN ] RTO: Loaded 39724 existing records. [2025-10-23T23:35:22.103025] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:22.113194] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-23T23:35:22.119550] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-23T23:35:22.120699] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T23:35:22.120740] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-23T23:35:22.127415] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-23T23:35:22.402886] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-23T23:35:22.482689] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:22.904712] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-23T23:35:23.199434] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-23T23:35:24.008627] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-23T23:35:24.027254] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T23:35:24.770359] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T23:35:24.799405] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-23T23:35:25.310092] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T23:35:25.599426] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-23T23:35:26.132629] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T23:35:26.399480] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-23T23:35:27.064528] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-23T23:35:27.199433] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-23T23:35:27.714708] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-23T23:35:27.999495] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-23T23:35:28.799466] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-23T23:35:28.842729] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T23:35:29.599414] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-23T23:35:29.782944] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T23:35:30.242314] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T23:35:30.399408] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-23T23:35:30.535887] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T23:35:31.199449] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-23T23:35:31.999477] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-23T23:35:32.041886] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T23:35:32.050232] [INFO ] [REMOTE ] RSG: Full fetch complete (68411 records). [2025-10-23T23:35:32.050436] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-23T23:35:32.444680] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-23T23:35:32.444854] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-23T23:35:32.446152] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-23T23:35:32.446333] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-23T23:35:32.447882] [DEBUG] [LOCAL ] RSG: Trimmed 68411 records to 47641 (keeping 200 days of data) [2025-10-23T23:35:32.566792] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T23:35:32.778748] [DEBUG] [LOCAL ] RSG: Primary data saved (47641 records). [2025-10-23T23:35:32.778907] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-23T23:35:32.779030] [INFO ] [MAIN ] Update Progress: 1834/2367 symbols completed. RSG took 28.4s. Estimated remaining: 1h 8m 26s. Rate: 7.8 symbols/min [2025-10-23T23:35:32.807857] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-23T23:35:32.947168] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:32.998218] [DEBUG] [LOCAL ] RTX: Loaded 53706 existing records from primary storage. [2025-10-23T23:35:32.998580] [INFO ] [MAIN ] RTX: Loaded 53706 existing records. [2025-10-23T23:35:33.177497] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:33.177851] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-23T23:35:33.177927] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-23T23:35:33.178221] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-10-23T23:35:33.178297] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-23T23:35:33.453549] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:35:33.556368] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:33.599392] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-23T23:35:34.399564] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-23T23:35:34.512127] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:35:35.199433] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-23T23:35:35.573426] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-23T23:35:35.999427] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-23T23:35:36.096187] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T23:35:36.660928] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-23T23:35:36.799407] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-23T23:35:37.212944] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T23:35:37.599441] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-23T23:35:38.229908] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-23T23:35:38.399432] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-23T23:35:39.199454] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-23T23:35:39.502722] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-23T23:35:39.600844] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T23:35:39.999502] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-23T23:35:40.481579] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-23T23:35:40.799428] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-23T23:35:41.599441] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-23T23:35:41.982807] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-23T23:35:42.062132] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-23T23:35:42.399461] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-23T23:35:43.056832] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:35:43.065475] [INFO ] [REMOTE ] RSI: Full fetch complete (69743 records). [2025-10-23T23:35:43.065606] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-23T23:35:43.206867] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-23T23:35:43.459706] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-23T23:35:43.459814] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-23T23:35:43.460951] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-23T23:35:43.461029] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-23T23:35:43.462387] [DEBUG] [LOCAL ] RSI: Trimmed 69743 records to 47344 (keeping 200 days of data) [2025-10-23T23:35:43.730275] [DEBUG] [LOCAL ] RSI: Primary data saved (47344 records). [2025-10-23T23:35:43.730432] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-23T23:35:43.730540] [INFO ] [MAIN ] Update Progress: 1835/2367 symbols completed. RSI took 38.4s. Estimated remaining: 1h 8m 19s. Rate: 7.8 symbols/min [2025-10-23T23:35:43.901804] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:43.928588] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T23:35:43.972741] [DEBUG] [LOCAL ] RVLV: Loaded 47368 existing records from primary storage. [2025-10-23T23:35:43.973065] [INFO ] [MAIN ] RVLV: Loaded 47368 existing records. [2025-10-23T23:35:44.004551] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-23T23:35:44.151294] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:44.151487] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-23T23:35:44.151561] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-23T23:35:44.152078] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-23T23:35:44.152151] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-23T23:35:44.505102] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:44.799408] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-23T23:35:45.219909] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-23T23:35:45.505630] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T23:35:45.599450] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-23T23:35:46.390248] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T23:35:46.399664] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-23T23:35:46.491233] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-23T23:35:47.199494] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-23T23:35:47.940441] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-23T23:35:47.999407] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-23T23:35:48.799481] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-23T23:35:49.411306] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-23T23:35:49.599426] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-23T23:35:49.660160] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T23:35:49.826843] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T23:35:50.399444] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-23T23:35:51.199457] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-23T23:35:51.778829] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-23T23:35:51.790189] [INFO ] [REMOTE ] RTO: Full fetch complete (58907 records). [2025-10-23T23:35:51.790498] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-23T23:35:51.918804] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-23T23:35:52.006057] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-23T23:35:52.254572] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-23T23:35:52.254703] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-23T23:35:52.255732] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-23T23:35:52.255809] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-23T23:35:52.256947] [DEBUG] [LOCAL ] RTO: Trimmed 58907 records to 40099 (keeping 200 days of data) [2025-10-23T23:35:52.505443] [DEBUG] [LOCAL ] RTO: Primary data saved (40099 records). [2025-10-23T23:35:52.505598] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-23T23:35:52.507019] [INFO ] [MAIN ] Update Progress: 1836/2367 symbols completed. RTO took 30.8s. Estimated remaining: 1h 8m 12s. Rate: 7.8 symbols/min [2025-10-23T23:35:52.710269] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:35:52.740741] [DEBUG] [LOCAL ] RVT: Loaded 26119 existing records from primary storage. [2025-10-23T23:35:52.741040] [INFO ] [MAIN ] RVT: Loaded 26119 existing records. [2025-10-23T23:35:52.811466] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-23T23:35:52.950999] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:35:52.968051] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-23T23:35:52.968303] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-23T23:35:52.969790] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T23:35:52.980169] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-23T23:35:52.980264] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-23T23:35:53.399744] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:35:53.401812] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-23T23:35:53.410528] [INFO ] [REMOTE ] RSKD: Full fetch complete (48287 records). [2025-10-23T23:35:53.410718] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-23T23:35:53.616020] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-23T23:35:53.814062] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-23T23:35:53.814202] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-23T23:35:53.815188] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-23T23:35:53.815287] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-23T23:35:53.816506] [DEBUG] [LOCAL ] RSKD: Trimmed 48287 records to 33437 (keeping 200 days of data) [2025-10-23T23:35:54.007576] [DEBUG] [LOCAL ] RSKD: Primary data saved (33437 records). [2025-10-23T23:35:54.007824] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-23T23:35:54.007962] [INFO ] [MAIN ] Update Progress: 1837/2367 symbols completed. RSKD took 34.4s. Estimated remaining: 1h 8m 2s. Rate: 7.8 symbols/min [2025-10-23T23:35:54.399422] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-23T23:35:54.933004] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T23:35:55.110113] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-23T23:35:55.199409] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-23T23:35:55.999427] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-23T23:35:56.109247] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-23T23:35:56.799408] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-23T23:35:56.978313] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T23:35:57.171936] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-23T23:35:57.599501] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-23T23:35:58.414568] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-23T23:35:58.417998] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:35:58.883144] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-23T23:35:59.199498] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-23T23:35:59.999442] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-23T23:36:00.370862] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T23:36:00.707087] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T23:36:00.799433] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-23T23:36:01.405148] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T23:36:01.599469] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-23T23:36:02.399530] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-23T23:36:02.491068] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-23T23:36:03.199446] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-23T23:36:03.554159] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T23:36:03.878852] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-23T23:36:03.888438] [INFO ] [REMOTE ] RTX: Full fetch complete (77878 records). [2025-10-23T23:36:03.888604] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-23T23:36:04.004557] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-23T23:36:04.286141] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-23T23:36:04.286281] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-23T23:36:04.287666] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-23T23:36:04.287765] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-23T23:36:04.289215] [DEBUG] [LOCAL ] RTX: Trimmed 77878 records to 54096 (keeping 200 days of data) [2025-10-23T23:36:04.615437] [DEBUG] [LOCAL ] RTX: Primary data saved (54096 records). [2025-10-23T23:36:04.615591] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-23T23:36:04.615726] [INFO ] [MAIN ] Update Progress: 1838/2367 symbols completed. RTX took 31.8s. Estimated remaining: 1h 7m 56s. Rate: 7.8 symbols/min [2025-10-23T23:36:04.891267] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-23T23:36:04.901204] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-23T23:36:04.951279] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T23:36:05.599483] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-23T23:36:06.499872] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T23:36:06.508778] [INFO ] [REMOTE ] RVLV: Full fetch complete (68979 records). [2025-10-23T23:36:06.508925] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-23T23:36:06.961253] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-23T23:36:06.961545] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-23T23:36:06.963394] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-23T23:36:06.963565] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-23T23:36:06.989435] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T23:36:06.996472] [DEBUG] [LOCAL ] RVLV: Trimmed 68979 records to 47671 (keeping 200 days of data) [2025-10-23T23:36:06.996863] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-23T23:36:07.380963] [DEBUG] [LOCAL ] RVLV: Primary data saved (47671 records). [2025-10-23T23:36:07.381193] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-23T23:36:07.381347] [INFO ] [MAIN ] Update Progress: 1839/2367 symbols completed. RVLV took 23.7s. Estimated remaining: 1h 7m 46s. Rate: 7.8 symbols/min [2025-10-23T23:36:08.218567] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-23T23:36:08.226199] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-23T23:36:09.343378] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T23:36:09.349748] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-23T23:36:10.480126] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T23:36:10.484820] [INFO ] [REMOTE ] RVT: Full fetch complete (39084 records). [2025-10-23T23:36:10.484953] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-23T23:36:10.854576] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-23T23:36:10.854752] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-23T23:36:10.855579] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-23T23:36:10.855699] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-23T23:36:10.856743] [DEBUG] [LOCAL ] RVT: Trimmed 39084 records to 26270 (keeping 200 days of data) [2025-10-23T23:36:11.014051] [DEBUG] [LOCAL ] RVT: Primary data saved (26270 records). [2025-10-23T23:36:11.014253] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-23T23:36:11.014386] [INFO ] [MAIN ] Update Progress: 1840/2367 symbols completed. RVT took 18.5s. Estimated remaining: 1h 7m 38s. Rate: 7.8 symbols/min [2025-10-23T23:36:11.628133] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:11.702441] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:11.721754] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:11.698454] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:11.722409] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-23T23:36:11.722537] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-23T23:36:11.722635] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-23T23:36:11.722876] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-23T23:36:11.722965] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-23T23:36:11.722718] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-23T23:36:11.723177] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-23T23:36:11.723285] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-23T23:36:11.735392] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-23T23:36:11.735794] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-23T23:36:11.757685] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-23T23:36:11.764209] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-23T23:36:12.155033] [DEBUG] [LOCAL ] RWT: Loaded 40374 existing records from primary storage. [2025-10-23T23:36:12.188432] [DEBUG] [LOCAL ] RVTY: Loaded 47785 existing records from primary storage. [2025-10-23T23:36:12.248675] [INFO ] [MAIN ] RVTY: Loaded 47785 existing records. [2025-10-23T23:36:12.264263] [INFO ] [MAIN ] RWT: Loaded 40374 existing records. [2025-10-23T23:36:12.646341] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:12.721344] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-23T23:36:12.815810] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:36:12.847257] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:12.875037] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-23T23:36:12.875114] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-23T23:36:12.890596] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-23T23:36:12.913039] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:36:12.913322] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-23T23:36:12.913403] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-23T23:36:12.914262] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-10-23T23:36:12.914388] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-23T23:36:12.914346] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-23T23:36:12.919680] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-23T23:36:13.482446] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-23T23:36:13.576491] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:13.544434] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-23T23:36:13.579171] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-23T23:36:13.578950] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-23T23:36:13.603512] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-23T23:36:13.681115] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:13.681751] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-23T23:36:14.072667] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T23:36:14.073926] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-23T23:36:14.148412] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-23T23:36:14.399422] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-23T23:36:14.524286] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T23:36:14.874947] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T23:36:15.085104] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-23T23:36:15.132883] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-23T23:36:15.199389] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-23T23:36:15.999460] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-23T23:36:16.464873] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-23T23:36:16.749324] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T23:36:16.799418] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-23T23:36:17.599434] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-23T23:36:17.952861] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T23:36:18.399445] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-23T23:36:18.450511] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T23:36:18.815219] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-23T23:36:19.199449] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-23T23:36:19.791295] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T23:36:19.999427] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-23T23:36:20.629776] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T23:36:20.799411] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-23T23:36:21.225900] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-23T23:36:21.599422] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-23T23:36:22.399420] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-23T23:36:22.892696] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-23T23:36:23.199399] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-23T23:36:23.331526] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:36:23.636146] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T23:36:23.999418] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-23T23:36:24.434531] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-23T23:36:24.435711] [INFO ] [REMOTE ] RWTO: Full fetch complete (4818 records). [2025-10-23T23:36:24.435812] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-23T23:36:24.610440] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-23T23:36:24.610683] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:36:24.610776] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:36:24.610873] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-23T23:36:24.611000] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-23T23:36:24.611097] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-23T23:36:24.611210] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-23T23:36:24.611334] [INFO ] [MAIN ] Update Progress: 1841/2367 symbols completed. RWTO took 13.6s. Estimated remaining: 1h 7m 32s. Rate: 7.8 symbols/min [2025-10-23T23:36:24.776182] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:24.776368] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-23T23:36:24.776461] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-23T23:36:24.776604] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-23T23:36:24.776722] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-23T23:36:24.776837] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-23T23:36:24.776930] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-23T23:36:24.806063] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-23T23:36:25.131496] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:25.215959] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-23T23:36:25.599418] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-23T23:36:26.399438] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-23T23:36:27.199419] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-10-23T23:36:27.294844] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T23:36:27.789123] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T23:36:27.814115] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T23:36:27.999422] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-23T23:36:28.799455] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-23T23:36:29.144432] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-23T23:36:29.477928] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T23:36:29.599402] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-23T23:36:30.399454] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-23T23:36:30.806546] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-23T23:36:31.199449] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-23T23:36:31.235188] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T23:36:31.655545] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-23T23:36:31.999448] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-23T23:36:32.799432] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-23T23:36:33.575793] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:36:33.599441] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-10-23T23:36:34.203212] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-23T23:36:34.377835] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T23:36:34.399458] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-23T23:36:35.199506] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-23T23:36:35.999410] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-23T23:36:36.176621] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-23T23:36:36.426098] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-23T23:36:36.427181] [INFO ] [REMOTE ] RWTN: Full fetch complete (3171 records). [2025-10-23T23:36:36.427273] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-23T23:36:36.610841] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-23T23:36:36.611136] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:36:36.611292] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:36:36.611374] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-23T23:36:36.611470] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-23T23:36:36.611549] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-23T23:36:36.611638] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-23T23:36:36.611764] [INFO ] [MAIN ] Update Progress: 1842/2367 symbols completed. RWTN took 25.6s. Estimated remaining: 1h 7m 25s. Rate: 7.8 symbols/min [2025-10-23T23:36:36.793874] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:36.805394] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-23T23:36:36.812538] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:36:36.862917] [DEBUG] [LOCAL ] RXO: Loaded 48464 existing records from primary storage. [2025-10-23T23:36:36.863300] [INFO ] [MAIN ] RXO: Loaded 48464 existing records. [2025-10-23T23:36:37.044483] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:36:37.044807] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-23T23:36:37.044884] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-23T23:36:37.045293] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-23T23:36:37.045366] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-23T23:36:37.396150] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:37.599433] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-23T23:36:38.399462] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-10-23T23:36:38.448953] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T23:36:39.035434] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-23T23:36:39.063806] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T23:36:39.199446] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-10-23T23:36:39.833130] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-23T23:36:39.999471] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-23T23:36:40.799469] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-10-23T23:36:41.263534] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-23T23:36:41.501208] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-23T23:36:41.599433] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-10-23T23:36:42.036547] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-23T23:36:42.399438] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-23T23:36:43.199450] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-23T23:36:43.999464] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-23T23:36:44.074931] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-23T23:36:44.736384] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-23T23:36:44.799472] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-10-23T23:36:45.241598] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T23:36:45.581800] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T23:36:45.599398] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-10-23T23:36:45.940296] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-23T23:36:46.399443] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-23T23:36:47.199470] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-10-23T23:36:47.607078] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-23T23:36:47.945821] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T23:36:47.999455] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-10. [2025-10-23T23:36:48.446699] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T23:36:48.447613] [INFO ] [REMOTE ] RWTP: Full fetch complete (4699 records). [2025-10-23T23:36:48.447722] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-10-23T23:36:48.628077] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-23T23:36:48.628280] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:36:48.628352] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:36:48.628426] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-23T23:36:48.628538] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-23T23:36:48.628610] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-23T23:36:48.628710] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-23T23:36:48.628802] [INFO ] [MAIN ] Update Progress: 1843/2367 symbols completed. RWTP took 24.0s. Estimated remaining: 1h 7m 19s. Rate: 7.8 symbols/min [2025-10-23T23:36:48.795446] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:48.799416] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-23T23:36:48.843150] [DEBUG] [LOCAL ] RY: Loaded 47473 existing records from primary storage. [2025-10-23T23:36:48.843503] [INFO ] [MAIN ] RY: Loaded 47473 existing records. [2025-10-23T23:36:49.026774] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:36:49.027011] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-23T23:36:49.027103] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-23T23:36:49.027373] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-23T23:36:49.027467] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-23T23:36:49.380252] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:49.599434] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-23T23:36:50.399440] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-23T23:36:50.525780] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:36:50.834441] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-23T23:36:51.199429] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-23T23:36:51.999515] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-23T23:36:52.046540] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-23T23:36:52.056886] [INFO ] [REMOTE ] RVTY: Full fetch complete (68118 records). [2025-10-23T23:36:52.057156] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-23T23:36:52.477958] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-23T23:36:52.478154] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-23T23:36:52.480270] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-23T23:36:52.480833] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-23T23:36:52.483001] [DEBUG] [LOCAL ] RVTY: Trimmed 68118 records to 48134 (keeping 200 days of data) [2025-10-23T23:36:52.750696] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T23:36:52.817726] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-23T23:36:52.851857] [DEBUG] [LOCAL ] RVTY: Primary data saved (48134 records). [2025-10-23T23:36:52.852104] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-23T23:36:52.852310] [INFO ] [MAIN ] Update Progress: 1844/2367 symbols completed. RVTY took 41.8s. Estimated remaining: 1h 7m 10s. Rate: 7.8 symbols/min [2025-10-23T23:36:53.045830] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:53.085889] [DEBUG] [LOCAL ] RYAM: Loaded 35018 existing records from primary storage. [2025-10-23T23:36:53.086337] [INFO ] [MAIN ] RYAM: Loaded 35018 existing records. [2025-10-23T23:36:53.279944] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:36:53.280356] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-23T23:36:53.280502] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-23T23:36:53.281120] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-23T23:36:53.281207] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-23T23:36:53.494421] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T23:36:53.603977] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-23T23:36:53.742817] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:54.298046] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T23:36:54.304710] [INFO ] [REMOTE ] RWT: Full fetch complete (58065 records). [2025-10-23T23:36:54.304835] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-23T23:36:54.404608] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-23T23:36:54.710539] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-23T23:36:54.710689] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-23T23:36:54.711726] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-23T23:36:54.711804] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-23T23:36:54.713031] [DEBUG] [LOCAL ] RWT: Trimmed 58065 records to 40660 (keeping 200 days of data) [2025-10-23T23:36:54.945782] [DEBUG] [LOCAL ] RWT: Primary data saved (40660 records). [2025-10-23T23:36:54.945946] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-23T23:36:54.946059] [INFO ] [MAIN ] Update Progress: 1845/2367 symbols completed. RWT took 43.9s. Estimated remaining: 1h 7m 1s. Rate: 7.8 symbols/min [2025-10-23T23:36:55.117495] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:36:55.157117] [DEBUG] [LOCAL ] RYAN: Loaded 45003 existing records from primary storage. [2025-10-23T23:36:55.157513] [INFO ] [MAIN ] RYAN: Loaded 45003 existing records. [2025-10-23T23:36:55.225423] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-23T23:36:55.337790] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:36:55.338171] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-23T23:36:55.338267] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-23T23:36:55.338607] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-23T23:36:55.338728] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-23T23:36:55.538909] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-23T23:36:55.749837] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:36:55.751726] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T23:36:55.999417] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-23T23:36:56.799484] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-23T23:36:56.845572] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:36:57.595599] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T23:36:57.603996] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-23T23:36:58.399418] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-23T23:36:58.596569] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:36:58.788544] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-23T23:36:59.199466] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-23T23:36:59.999541] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-23T23:37:00.063947] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-23T23:37:00.799438] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-23T23:37:01.017930] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T23:37:01.566139] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:37:01.599403] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-23T23:37:01.934285] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T23:37:02.399445] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-23T23:37:03.170272] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:37:03.199441] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-23T23:37:03.749757] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T23:37:03.999475] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-23T23:37:04.561323] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T23:37:04.799441] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-23T23:37:05.608503] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-23T23:37:05.613992] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:37:05.718826] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-23T23:37:06.399432] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-23T23:37:07.016935] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-23T23:37:07.199426] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-23T23:37:07.894062] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-23T23:37:07.999432] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-23T23:37:08.408163] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T23:37:08.799440] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-23T23:37:09.240210] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-23T23:37:09.599454] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-23T23:37:10.271808] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T23:37:10.399443] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-23T23:37:11.062879] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-23T23:37:11.071872] [INFO ] [REMOTE ] RXO: Full fetch complete (69085 records). [2025-10-23T23:37:11.072018] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-23T23:37:11.209845] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-23T23:37:11.460302] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-23T23:37:11.460429] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-23T23:37:11.461701] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-23T23:37:11.461789] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-23T23:37:11.463218] [DEBUG] [LOCAL ] RXO: Trimmed 69085 records to 48829 (keeping 200 days of data) [2025-10-23T23:37:11.741993] [DEBUG] [LOCAL ] RXO: Primary data saved (48829 records). [2025-10-23T23:37:11.742191] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-23T23:37:11.742308] [INFO ] [MAIN ] Update Progress: 1846/2367 symbols completed. RXO took 35.1s. Estimated remaining: 1h 6m 55s. Rate: 7.8 symbols/min [2025-10-23T23:37:11.913258] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:11.940472] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T23:37:11.965577] [DEBUG] [LOCAL ] RYI: Loaded 21663 existing records from primary storage. [2025-10-23T23:37:11.965910] [INFO ] [MAIN ] RYI: Loaded 21663 existing records. [2025-10-23T23:37:12.008134] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-23T23:37:12.149827] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:12.150152] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-23T23:37:12.150226] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-23T23:37:12.150476] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-23T23:37:12.150551] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-23T23:37:12.429202] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T23:37:12.549151] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:37:12.799426] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-23T23:37:13.599464] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-23T23:37:13.723797] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-23T23:37:14.072821] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T23:37:14.399428] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-23T23:37:14.682636] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T23:37:15.199433] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-23T23:37:15.534498] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-23T23:37:15.999432] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-23T23:37:16.799438] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-23T23:37:16.883237] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-23T23:37:17.063784] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T23:37:17.599436] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-23T23:37:18.169416] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-23T23:37:18.399438] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-23T23:37:19.199433] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-23T23:37:19.269601] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T23:37:19.999435] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-23T23:37:20.042790] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T23:37:20.503223] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T23:37:20.512412] [INFO ] [REMOTE ] RYAM: Full fetch complete (49221 records). [2025-10-23T23:37:20.512590] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-23T23:37:20.807604] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-23T23:37:20.913447] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-23T23:37:20.913576] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-23T23:37:20.914565] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-23T23:37:20.914667] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-23T23:37:20.915875] [DEBUG] [LOCAL ] RYAM: Trimmed 49221 records to 35289 (keeping 200 days of data) [2025-10-23T23:37:21.130791] [DEBUG] [LOCAL ] RYAM: Primary data saved (35289 records). [2025-10-23T23:37:21.131102] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-23T23:37:21.131306] [INFO ] [MAIN ] Update Progress: 1847/2367 symbols completed. RYAM took 28.3s. Estimated remaining: 1h 6m 48s. Rate: 7.8 symbols/min [2025-10-23T23:37:21.333113] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:21.379357] [DEBUG] [LOCAL ] RYN: Loaded 45740 existing records from primary storage. [2025-10-23T23:37:21.379943] [INFO ] [MAIN ] RYN: Loaded 45740 existing records. [2025-10-23T23:37:21.570272] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:21.570746] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-23T23:37:21.570843] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-23T23:37:21.571159] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-23T23:37:21.571237] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-23T23:37:21.604777] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-23T23:37:21.950400] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-23T23:37:21.981149] [INFO ] [REMOTE ] RYAN: Full fetch complete (64916 records). [2025-10-23T23:37:22.010155] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-23T23:37:22.064490] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:37:22.171270] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-23T23:37:22.404771] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-23T23:37:22.457391] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-23T23:37:22.457525] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-23T23:37:22.458763] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-23T23:37:22.458850] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-23T23:37:22.460264] [DEBUG] [LOCAL ] RYAN: Trimmed 64916 records to 45325 (keeping 200 days of data) [2025-10-23T23:37:22.725348] [DEBUG] [LOCAL ] RYAN: Primary data saved (45325 records). [2025-10-23T23:37:22.725506] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-23T23:37:22.725662] [INFO ] [MAIN ] Update Progress: 1848/2367 symbols completed. RYAN took 27.8s. Estimated remaining: 1h 6m 39s. Rate: 7.8 symbols/min [2025-10-23T23:37:22.893507] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:22.900462] [DEBUG] [LOCAL ] RZB: Loaded 5891 existing records from primary storage. [2025-10-23T23:37:22.900719] [INFO ] [MAIN ] RZB: Loaded 5891 existing records. [2025-10-23T23:37:23.076948] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:23.077167] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-23T23:37:23.077243] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-23T23:37:23.077452] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-23T23:37:23.077528] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-23T23:37:23.204508] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-23T23:37:23.447289] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:37:23.492441] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-23T23:37:23.498556] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-23T23:37:23.999453] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-23T23:37:24.512231] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-23T23:37:24.516253] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-23T23:37:24.799451] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-23T23:37:25.599446] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-23T23:37:26.404863] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-23T23:37:26.420997] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-23T23:37:26.692947] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T23:37:26.788321] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-23T23:37:27.199516] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-23T23:37:27.999547] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-23T23:37:28.665810] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:37:28.799445] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-23T23:37:28.903429] [DEBUG] [REMOTE ] RY: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-23T23:37:28.903789] [WARN ] [REMOTE ] RY: No data returned for month 2025-10 [2025-10-23T23:37:28.903876] [FATAL] [REMOTE ] RY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:37:28.904001] [FATAL] [MAIN ] RY: Failed to fetch primary data. [2025-10-23T23:37:28.904074] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:37:28.904146] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-23T23:37:28.904236] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-23T23:37:28.904305] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-23T23:37:28.905174] [DEBUG] [LOCAL ] RY: Deleted derivative data file. [2025-10-23T23:37:28.906664] [INFO ] [MAIN ] Update Progress: 1849/2367 symbols completed. RY took 40.3s. Estimated remaining: 1h 6m 31s. Rate: 7.8 symbols/min [2025-10-23T23:37:29.074044] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:29.084130] [DEBUG] [LOCAL ] RZC: Loaded 6485 existing records from primary storage. [2025-10-23T23:37:29.084375] [INFO ] [MAIN ] RZC: Loaded 6485 existing records. [2025-10-23T23:37:29.268562] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:29.278246] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-23T23:37:29.278752] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-23T23:37:29.278956] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-23T23:37:29.285083] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-23T23:37:29.285162] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-23T23:37:29.604570] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-23T23:37:29.639582] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:37:30.260700] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-23T23:37:30.399493] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-23T23:37:31.013726] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-23T23:37:31.199490] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-23T23:37:31.891524] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-23T23:37:31.999477] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-23T23:37:32.799492] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-23T23:37:33.522621] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:37:33.599448] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-23T23:37:33.881243] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T23:37:34.184791] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-23T23:37:34.399479] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-23T23:37:35.199465] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-23T23:37:35.368200] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T23:37:35.763195] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-23T23:37:35.999485] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-23T23:37:36.799423] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-23T23:37:36.936893] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-23T23:37:37.540838] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T23:37:37.599448] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-23T23:37:38.399455] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-23T23:37:38.591406] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T23:37:38.595355] [INFO ] [REMOTE ] RYI: Full fetch complete (31923 records). [2025-10-23T23:37:38.595461] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-23T23:37:38.982419] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-23T23:37:38.982549] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-23T23:37:38.983263] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-23T23:37:38.983350] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-23T23:37:38.984381] [DEBUG] [LOCAL ] RYI: Trimmed 31923 records to 21877 (keeping 200 days of data) [2025-10-23T23:37:39.113553] [DEBUG] [LOCAL ] RYI: Primary data saved (21877 records). [2025-10-23T23:37:39.113730] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-23T23:37:39.113848] [INFO ] [MAIN ] Update Progress: 1850/2367 symbols completed. RYI took 27.4s. Estimated remaining: 1h 6m 24s. Rate: 7.8 symbols/min [2025-10-23T23:37:39.204689] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-23T23:37:39.288963] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:39.340461] [DEBUG] [LOCAL ] S: Loaded 53538 existing records from primary storage. [2025-10-23T23:37:39.340852] [INFO ] [MAIN ] S: Loaded 53538 existing records. [2025-10-23T23:37:39.521053] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:39.521285] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-23T23:37:39.521359] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-23T23:37:39.521942] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-23T23:37:39.522016] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-23T23:37:39.894994] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:37:39.974908] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-23T23:37:39.977194] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-23T23:37:39.999406] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-23T23:37:40.799490] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-23T23:37:41.581679] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T23:37:41.607542] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-23T23:37:41.613168] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T23:37:42.399487] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-23T23:37:43.012531] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-23T23:37:43.199516] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-23T23:37:43.766130] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-23T23:37:43.999414] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-23T23:37:44.450096] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-23T23:37:44.799433] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-23T23:37:45.260547] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T23:37:45.599413] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-23T23:37:46.093671] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T23:37:46.095230] [INFO ] [REMOTE ] RZB: Full fetch complete (8307 records). [2025-10-23T23:37:46.095333] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-23T23:37:46.406591] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-23T23:37:46.467594] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-23T23:37:46.467819] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-23T23:37:46.468197] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-23T23:37:46.468604] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-23T23:37:46.469388] [DEBUG] [LOCAL ] RZB: Trimmed 8307 records to 5912 (keeping 200 days of data) [2025-10-23T23:37:46.535136] [DEBUG] [LOCAL ] RZB: Primary data saved (5912 records). [2025-10-23T23:37:46.547508] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-23T23:37:46.547767] [INFO ] [MAIN ] Update Progress: 1851/2367 symbols completed. RZB took 23.8s. Estimated remaining: 1h 6m 16s. Rate: 7.8 symbols/min [2025-10-23T23:37:46.613518] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-23T23:37:46.753803] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:46.794883] [DEBUG] [LOCAL ] SA: Loaded 44669 existing records from primary storage. [2025-10-23T23:37:46.795206] [INFO ] [MAIN ] SA: Loaded 44669 existing records. [2025-10-23T23:37:46.970479] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:46.970721] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-23T23:37:46.970797] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-23T23:37:46.971119] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-23T23:37:46.971194] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-23T23:37:47.150299] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T23:37:47.207790] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-23T23:37:47.336160] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:37:47.999480] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-23T23:37:48.439054] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-23T23:37:48.799454] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-23T23:37:49.463890] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T23:37:49.599476] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-23T23:37:50.050071] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T23:37:50.399480] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-23T23:37:51.052391] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T23:37:51.199427] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-23T23:37:51.945359] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T23:37:51.999432] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-23T23:37:52.726766] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-23T23:37:52.799397] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-23T23:37:53.599480] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-23T23:37:54.105043] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-23T23:37:54.171612] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T23:37:54.306376] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-23T23:37:54.399414] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-23T23:37:55.108939] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-23T23:37:55.199435] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-23T23:37:55.999511] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-23T23:37:56.732920] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T23:37:56.759762] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T23:37:56.799395] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-23T23:37:57.599422] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-23T23:37:58.150900] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-23T23:37:58.152969] [INFO ] [REMOTE ] RZC: Full fetch complete (9603 records). [2025-10-23T23:37:58.153071] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-23T23:37:58.403170] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-23T23:37:58.467103] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-23T23:37:58.515228] [INFO ] [REMOTE ] RYN: Full fetch complete (65802 records). [2025-10-23T23:37:58.534281] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-23T23:37:58.590203] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-23T23:37:58.629639] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-23T23:37:58.635787] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-23T23:37:58.640992] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-23T23:37:58.663408] [DEBUG] [LOCAL ] RZC: Trimmed 9603 records to 6506 (keeping 200 days of data) [2025-10-23T23:37:58.910089] [DEBUG] [LOCAL ] RZC: Primary data saved (6506 records). [2025-10-23T23:37:58.912741] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-23T23:37:58.913146] [INFO ] [MAIN ] Update Progress: 1852/2367 symbols completed. RZC took 30.0s. Estimated remaining: 1h 6m 9s. Rate: 7.8 symbols/min [2025-10-23T23:37:59.153081] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-23T23:37:59.159296] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-23T23:37:59.160408] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-23T23:37:59.176218] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-23T23:37:59.178888] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:37:59.180198] [DEBUG] [LOCAL ] RYN: Trimmed 65802 records to 46088 (keeping 200 days of data) [2025-10-23T23:37:59.232423] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-23T23:37:59.281384] [DEBUG] [LOCAL ] SABA: Loaded 9181 existing records from primary storage. [2025-10-23T23:37:59.298829] [INFO ] [MAIN ] SABA: Loaded 9181 existing records. [2025-10-23T23:37:59.600130] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:37:59.617187] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-23T23:37:59.617300] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-23T23:37:59.634078] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-23T23:37:59.643462] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-23T23:37:59.652213] [DEBUG] [LOCAL ] RYN: Primary data saved (46088 records). [2025-10-23T23:37:59.696752] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-23T23:37:59.725692] [INFO ] [MAIN ] Update Progress: 1853/2367 symbols completed. RYN took 38.6s. Estimated remaining: 1h 5m 60s. Rate: 7.8 symbols/min [2025-10-23T23:38:00.026785] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:00.207851] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:00.216147] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-23T23:38:00.230873] [DEBUG] [LOCAL ] SAFE: Loaded 29883 existing records from primary storage. [2025-10-23T23:38:00.231147] [INFO ] [MAIN ] SAFE: Loaded 29883 existing records. [2025-10-23T23:38:00.411500] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:00.411808] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-23T23:38:00.411962] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-23T23:38:00.412273] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-23T23:38:00.412431] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-23T23:38:00.536146] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-23T23:38:00.813629] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:00.813709] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-23T23:38:00.871085] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T23:38:01.292390] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T23:38:01.599439] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-23T23:38:02.404548] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-23T23:38:02.431015] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T23:38:02.997725] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T23:38:03.199439] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-23T23:38:03.485084] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-23T23:38:03.999433] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-23T23:38:04.445944] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T23:38:04.578762] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T23:38:04.799442] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-23T23:38:05.599428] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-23T23:38:05.629226] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-23T23:38:06.399436] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-23T23:38:06.640936] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T23:38:07.197412] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-23T23:38:07.199833] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-23T23:38:07.999561] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-23T23:38:08.755783] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T23:38:08.796429] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T23:38:08.799424] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-23T23:38:09.599485] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-23T23:38:10.399404] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-23T23:38:10.870166] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-23T23:38:11.153222] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T23:38:11.199397] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-23T23:38:11.223249] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T23:38:11.999448] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-23T23:38:12.443639] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T23:38:12.799419] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-23T23:38:13.607802] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-23T23:38:13.610329] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:38:14.352026] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-23T23:38:14.399427] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-23T23:38:14.423579] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T23:38:15.138553] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-23T23:38:15.199441] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-23T23:38:15.999423] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-23T23:38:16.027356] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-23T23:38:16.799491] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-23T23:38:17.599414] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-23T23:38:17.717818] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T23:38:17.726638] [INFO ] [REMOTE ] SA: Full fetch complete (63610 records). [2025-10-23T23:38:17.726794] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-23T23:38:18.113152] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-23T23:38:18.113266] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-23T23:38:18.114442] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-23T23:38:18.114522] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-23T23:38:18.115911] [DEBUG] [LOCAL ] SA: Trimmed 63610 records to 44981 (keeping 200 days of data) [2025-10-23T23:38:18.380933] [DEBUG] [LOCAL ] SA: Primary data saved (44981 records). [2025-10-23T23:38:18.381096] [INFO ] [MAIN ] SA: Full history saved. [2025-10-23T23:38:18.381210] [INFO ] [MAIN ] Update Progress: 1854/2367 symbols completed. SA took 31.8s. Estimated remaining: 1h 5m 55s. Rate: 7.8 symbols/min [2025-10-23T23:38:18.417000] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-23T23:38:18.554773] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:18.575146] [DEBUG] [LOCAL ] SAH: Loaded 20685 existing records from primary storage. [2025-10-23T23:38:18.575424] [INFO ] [MAIN ] SAH: Loaded 20685 existing records. [2025-10-23T23:38:18.753088] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:18.753404] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-23T23:38:18.753494] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-23T23:38:18.753826] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-23T23:38:18.753902] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-23T23:38:19.126569] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:19.142495] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T23:38:19.183164] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-23T23:38:19.185255] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-23T23:38:19.198692] [INFO ] [REMOTE ] SABA: Full fetch complete (15019 records). [2025-10-23T23:38:19.198942] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-23T23:38:19.199439] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-23T23:38:19.563849] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-23T23:38:19.563966] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-23T23:38:19.564412] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-23T23:38:19.564509] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-23T23:38:19.565103] [DEBUG] [LOCAL ] SABA: Trimmed 15019 records to 9226 (keeping 200 days of data) [2025-10-23T23:38:19.618361] [DEBUG] [LOCAL ] SABA: Primary data saved (9226 records). [2025-10-23T23:38:19.618528] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-23T23:38:19.618713] [INFO ] [MAIN ] Update Progress: 1855/2367 symbols completed. SABA took 20.7s. Estimated remaining: 1h 5m 46s. Rate: 7.8 symbols/min [2025-10-23T23:38:19.791151] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:19.791387] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-23T23:38:19.791481] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-23T23:38:19.791632] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-23T23:38:19.791744] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-23T23:38:19.791849] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-23T23:38:19.791937] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-23T23:38:20.004594] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-23T23:38:20.153983] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:20.799447] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-23T23:38:21.295420] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-23T23:38:21.314747] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T23:38:21.599454] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-23T23:38:22.399426] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-23T23:38:22.553873] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T23:38:23.199431] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-23T23:38:23.527381] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-23T23:38:23.816526] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (4.62 seconds). [2025-10-23T23:38:23.829370] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-23T23:38:23.999436] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-23T23:38:24.799460] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-23T23:38:25.599450] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-23T23:38:25.706702] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-23T23:38:25.924005] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-23T23:38:26.130610] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-23T23:38:26.399423] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-23T23:38:27.199466] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-23T23:38:27.999425] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-23T23:38:28.338966] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-23T23:38:28.596605] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-23T23:38:28.606290] [INFO ] [REMOTE ] S: Full fetch complete (77658 records). [2025-10-23T23:38:28.606509] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-23T23:38:28.807807] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-23T23:38:29.016685] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-23T23:38:29.016791] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-23T23:38:29.018119] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-23T23:38:29.018199] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-23T23:38:29.019615] [DEBUG] [LOCAL ] S: Trimmed 77658 records to 53927 (keeping 200 days of data) [2025-10-23T23:38:29.330408] [DEBUG] [LOCAL ] S: Primary data saved (53927 records). [2025-10-23T23:38:29.330563] [INFO ] [MAIN ] S: Full history saved. [2025-10-23T23:38:29.330696] [INFO ] [MAIN ] Update Progress: 1856/2367 symbols completed. S took 50.2s. Estimated remaining: 1h 5m 39s. Rate: 7.8 symbols/min [2025-10-23T23:38:29.503342] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:29.526624] [DEBUG] [LOCAL ] SAM: Loaded 21215 existing records from primary storage. [2025-10-23T23:38:29.526940] [INFO ] [MAIN ] SAM: Loaded 21215 existing records. [2025-10-23T23:38:29.604537] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-23T23:38:29.708493] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:29.708727] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-23T23:38:29.708801] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-23T23:38:29.709046] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-23T23:38:29.709120] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-23T23:38:29.826391] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-23T23:38:29.953138] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-23T23:38:30.106882] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:30.223178] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-23T23:38:30.399442] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-23T23:38:30.715046] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-23T23:38:31.199478] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-23T23:38:31.517938] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-23T23:38:31.999479] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-23T23:38:32.317580] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-23T23:38:32.799440] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-23T23:38:33.148740] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-23T23:38:33.599443] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-23T23:38:34.365919] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T23:38:34.399395] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-23T23:38:35.199503] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-23T23:38:35.449830] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-23T23:38:35.999475] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-23T23:38:36.259669] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-23T23:38:36.294997] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-23T23:38:36.299838] [INFO ] [REMOTE ] SAFE: Full fetch complete (43913 records). [2025-10-23T23:38:36.299975] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-23T23:38:36.712866] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-23T23:38:36.713004] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-23T23:38:36.713940] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-23T23:38:36.714022] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-23T23:38:36.715140] [DEBUG] [LOCAL ] SAFE: Trimmed 43913 records to 30040 (keeping 200 days of data) [2025-10-23T23:38:36.803817] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-23T23:38:36.901130] [DEBUG] [LOCAL ] SAFE: Primary data saved (30040 records). [2025-10-23T23:38:36.901307] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-23T23:38:36.901424] [INFO ] [MAIN ] Update Progress: 1857/2367 symbols completed. SAFE took 37.2s. Estimated remaining: 1h 5m 31s. Rate: 7.8 symbols/min [2025-10-23T23:38:37.072907] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:37.122034] [DEBUG] [LOCAL ] SAN: Loaded 52964 existing records from primary storage. [2025-10-23T23:38:37.122393] [INFO ] [MAIN ] SAN: Loaded 52964 existing records. [2025-10-23T23:38:37.298852] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:37.299069] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-23T23:38:37.299146] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-23T23:38:37.299379] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-23T23:38:37.299453] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-23T23:38:37.604684] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-23T23:38:37.711360] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:37.806738] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T23:38:38.399432] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-23T23:38:38.761436] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-23T23:38:38.762262] [INFO ] [REMOTE ] SAJ: Full fetch complete (981 records). [2025-10-23T23:38:38.762367] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-23T23:38:38.940842] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-23T23:38:38.941150] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:38:38.941233] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:38:38.941323] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-23T23:38:38.941514] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-23T23:38:38.941591] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-23T23:38:38.941698] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-23T23:38:38.941791] [INFO ] [MAIN ] Update Progress: 1858/2367 symbols completed. SAJ took 19.3s. Estimated remaining: 1h 5m 22s. Rate: 7.8 symbols/min [2025-10-23T23:38:39.109531] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:39.122441] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:38:39.173039] [DEBUG] [LOCAL ] SAP: Loaded 49878 existing records from primary storage. [2025-10-23T23:38:39.173358] [INFO ] [MAIN ] SAP: Loaded 49878 existing records. [2025-10-23T23:38:39.204521] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-23T23:38:39.354408] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:39.354617] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-23T23:38:39.354711] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-23T23:38:39.355218] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-23T23:38:39.355287] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-23T23:38:39.701215] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:39.999416] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-23T23:38:40.350323] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-23T23:38:40.613719] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T23:38:40.799438] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-23T23:38:41.599478] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-23T23:38:42.399433] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-23T23:38:42.718143] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-23T23:38:43.199414] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-23T23:38:43.368788] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T23:38:43.451016] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-23T23:38:43.999409] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-23T23:38:44.317997] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T23:38:44.799485] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-23T23:38:45.599435] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-23T23:38:45.726574] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-23T23:38:45.919456] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-23T23:38:46.399444] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-23T23:38:46.572749] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T23:38:47.199465] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-23T23:38:47.985773] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-23T23:38:47.999391] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-23T23:38:48.212709] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-23T23:38:48.216124] [INFO ] [REMOTE ] SAH: Full fetch complete (30990 records). [2025-10-23T23:38:48.216219] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-23T23:38:48.582029] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-23T23:38:48.582134] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-23T23:38:48.582796] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-23T23:38:48.582872] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-23T23:38:48.583575] [DEBUG] [LOCAL ] SAH: Trimmed 30990 records to 20933 (keeping 200 days of data) [2025-10-23T23:38:48.710806] [DEBUG] [LOCAL ] SAH: Primary data saved (20933 records). [2025-10-23T23:38:48.710946] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-23T23:38:48.711060] [INFO ] [MAIN ] Update Progress: 1859/2367 symbols completed. SAH took 30.3s. Estimated remaining: 1h 5m 14s. Rate: 7.8 symbols/min [2025-10-23T23:38:48.804767] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-23T23:38:48.885866] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:48.902891] [DEBUG] [LOCAL ] SAR: Loaded 17125 existing records from primary storage. [2025-10-23T23:38:48.903142] [INFO ] [MAIN ] SAR: Loaded 17125 existing records. [2025-10-23T23:38:49.082240] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:49.082513] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-23T23:38:49.082773] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-23T23:38:49.095100] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-23T23:38:49.095876] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-23T23:38:49.095932] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-23T23:38:49.478144] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:49.599406] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-23T23:38:50.399419] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-23T23:38:50.492988] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T23:38:50.537889] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T23:38:51.199446] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-23T23:38:51.999470] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-23T23:38:52.028078] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T23:38:52.258771] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-23T23:38:52.799500] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-23T23:38:53.599427] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-23T23:38:53.819782] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-23T23:38:53.913288] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-23T23:38:54.399446] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-23T23:38:54.684937] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-23T23:38:54.688678] [INFO ] [REMOTE ] SAM: Full fetch complete (31221 records). [2025-10-23T23:38:54.688799] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-23T23:38:55.098913] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-23T23:38:55.099117] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-23T23:38:55.099937] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-23T23:38:55.100022] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-23T23:38:55.111286] [DEBUG] [LOCAL ] SAM: Trimmed 31221 records to 21387 (keeping 200 days of data) [2025-10-23T23:38:55.111181] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T23:38:55.200678] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-23T23:38:55.245860] [DEBUG] [LOCAL ] SAM: Primary data saved (21387 records). [2025-10-23T23:38:55.246021] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-23T23:38:55.246138] [INFO ] [MAIN ] Update Progress: 1860/2367 symbols completed. SAM took 25.9s. Estimated remaining: 1h 5m 6s. Rate: 7.8 symbols/min [2025-10-23T23:38:55.430002] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:38:55.472373] [DEBUG] [LOCAL ] SARO: Loaded 48231 existing records from primary storage. [2025-10-23T23:38:55.472753] [INFO ] [MAIN ] SARO: Loaded 48231 existing records. [2025-10-23T23:38:55.651074] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:38:55.651331] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-23T23:38:55.651407] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-23T23:38:55.651618] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-23T23:38:55.651719] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-23T23:38:56.006534] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-23T23:38:56.011905] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:38:56.139583] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-23T23:38:56.799429] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-23T23:38:57.565562] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-23T23:38:57.599410] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-23T23:38:57.797035] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T23:38:58.399545] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-23T23:38:59.199524] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-23T23:38:59.670565] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T23:38:59.999510] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-23T23:39:00.799546] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-23T23:39:00.941504] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:39:01.124924] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-23T23:39:01.599413] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-23T23:39:01.887142] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T23:39:01.887778] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-23T23:39:02.399504] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-23T23:39:02.964088] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-23T23:39:03.199484] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-23T23:39:03.563793] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-23T23:39:03.999461] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-23T23:39:04.799437] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-23T23:39:05.169617] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T23:39:05.190972] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-23T23:39:05.599444] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-23T23:39:06.399449] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-23T23:39:06.492749] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T23:39:06.607706] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-23T23:39:07.199425] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-23T23:39:07.954673] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T23:39:07.999413] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-23T23:39:08.747301] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T23:39:08.799406] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-23T23:39:09.599424] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-23T23:39:10.091925] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-23T23:39:10.399432] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-23T23:39:10.510759] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-23T23:39:11.072265] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T23:39:11.199436] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-23T23:39:12.001672] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-23T23:39:12.005105] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T23:39:12.262756] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T23:39:12.799431] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-23T23:39:13.154250] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-23T23:39:13.158600] [INFO ] [REMOTE ] SAR: Full fetch complete (24092 records). [2025-10-23T23:39:13.158791] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-23T23:39:13.530434] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-23T23:39:13.530555] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-23T23:39:13.531075] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-23T23:39:13.531154] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-23T23:39:13.531978] [DEBUG] [LOCAL ] SAR: Trimmed 24092 records to 17208 (keeping 200 days of data) [2025-10-23T23:39:13.606184] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-23T23:39:13.640120] [DEBUG] [LOCAL ] SAR: Primary data saved (17208 records). [2025-10-23T23:39:13.640277] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-23T23:39:13.640389] [INFO ] [MAIN ] Update Progress: 1861/2367 symbols completed. SAR took 24.9s. Estimated remaining: 1h 5m 2s. Rate: 7.8 symbols/min [2025-10-23T23:39:13.809817] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:13.810020] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-23T23:39:13.810070] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-23T23:39:13.810144] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-23T23:39:13.810209] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-23T23:39:13.810272] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-23T23:39:13.810311] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-23T23:39:14.164286] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:14.399415] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-23T23:39:14.700301] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-23T23:39:14.762384] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-23T23:39:15.199440] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-23T23:39:15.656527] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-23T23:39:15.999460] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-23T23:39:16.402370] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-23T23:39:16.555406] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-23T23:39:16.799421] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-23T23:39:17.599456] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-23T23:39:18.026139] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-23T23:39:18.399471] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-23T23:39:18.507083] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-23T23:39:18.515983] [INFO ] [REMOTE ] SAP: Full fetch complete (72336 records). [2025-10-23T23:39:18.516162] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-23T23:39:18.906671] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-23T23:39:18.906777] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-23T23:39:18.907947] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-23T23:39:18.908027] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-23T23:39:18.909488] [DEBUG] [LOCAL ] SAP: Trimmed 72336 records to 50250 (keeping 200 days of data) [2025-10-23T23:39:19.203528] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-23T23:39:19.209149] [DEBUG] [LOCAL ] SAP: Primary data saved (50250 records). [2025-10-23T23:39:19.209243] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-23T23:39:19.210701] [INFO ] [MAIN ] Update Progress: 1862/2367 symbols completed. SAP took 40.3s. Estimated remaining: 1h 4m 53s. Rate: 7.8 symbols/min [2025-10-23T23:39:19.383625] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:19.383804] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-23T23:39:19.383874] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-23T23:39:19.383987] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-23T23:39:19.384070] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-23T23:39:19.384135] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-23T23:39:19.384201] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-23T23:39:19.742236] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:20.002290] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-23T23:39:20.007817] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T23:39:20.461317] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T23:39:20.799454] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-23T23:39:21.063750] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T23:39:21.599516] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-23T23:39:21.853711] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-23T23:39:22.399458] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-23T23:39:23.199409] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-23T23:39:23.304002] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-23T23:39:23.549401] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-23T23:39:23.999488] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-23T23:39:24.666314] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-23T23:39:24.799481] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-23T23:39:25.127833] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-23T23:39:25.553164] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T23:39:25.561557] [INFO ] [REMOTE ] SARO: Full fetch complete (68985 records). [2025-10-23T23:39:25.561711] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-23T23:39:25.604549] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-23T23:39:25.953087] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-23T23:39:25.953210] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-23T23:39:25.954333] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-23T23:39:25.954411] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-23T23:39:25.955797] [DEBUG] [LOCAL ] SARO: Trimmed 68985 records to 48571 (keeping 200 days of data) [2025-10-23T23:39:26.048463] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T23:39:26.231186] [DEBUG] [LOCAL ] SARO: Primary data saved (48571 records). [2025-10-23T23:39:26.231340] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-23T23:39:26.231450] [INFO ] [MAIN ] Update Progress: 1863/2367 symbols completed. SARO took 31.0s. Estimated remaining: 1h 4m 45s. Rate: 7.8 symbols/min [2025-10-23T23:39:26.396019] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:26.396170] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-23T23:39:26.396217] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-23T23:39:26.396286] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-23T23:39:26.396351] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-23T23:39:26.396408] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-23T23:39:26.396473] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-23T23:39:26.407471] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-23T23:39:26.756229] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:26.832686] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-23T23:39:27.199460] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-23T23:39:27.551803] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-23T23:39:27.999453] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-23T23:39:28.350111] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-23T23:39:28.799469] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-23T23:39:29.599445] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-23T23:39:29.942139] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-23T23:39:30.399423] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-23T23:39:30.619530] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-23T23:39:30.628752] [INFO ] [REMOTE ] SAN: Full fetch complete (76594 records). [2025-10-23T23:39:30.628912] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-23T23:39:30.790952] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-23T23:39:31.021253] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-23T23:39:31.021378] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-23T23:39:31.022542] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-23T23:39:31.022682] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-23T23:39:31.024202] [DEBUG] [LOCAL ] SAN: Trimmed 76594 records to 53345 (keeping 200 days of data) [2025-10-23T23:39:31.202491] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-23T23:39:31.339857] [DEBUG] [LOCAL ] SAN: Primary data saved (53345 records). [2025-10-23T23:39:31.340030] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-23T23:39:31.340210] [INFO ] [MAIN ] Update Progress: 1864/2367 symbols completed. SAN took 54.4s. Estimated remaining: 1h 4m 37s. Rate: 7.8 symbols/min [2025-10-23T23:39:31.508363] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:31.538926] [DEBUG] [LOCAL ] SB: Loaded 32405 existing records from primary storage. [2025-10-23T23:39:31.539246] [INFO ] [MAIN ] SB: Loaded 32405 existing records. [2025-10-23T23:39:31.632991] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-23T23:39:31.719770] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:39:31.719976] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-23T23:39:31.720071] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-23T23:39:31.720503] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-23T23:39:31.720592] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-23T23:39:32.004577] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-23T23:39:32.075894] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:32.398725] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-23T23:39:32.799435] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-23T23:39:33.247364] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T23:39:33.599446] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-23T23:39:33.935818] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-23T23:39:34.399439] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-23T23:39:35.199446] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-23T23:39:35.437695] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-23T23:39:35.605969] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T23:39:35.999441] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-23T23:39:36.348396] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-23T23:39:36.799447] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-23T23:39:37.142732] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-23T23:39:37.599464] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-23T23:39:37.947075] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T23:39:37.948001] [INFO ] [REMOTE ] SAY: Full fetch complete (1372 records). [2025-10-23T23:39:37.948104] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-23T23:39:38.129717] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-23T23:39:38.129922] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:39:38.130016] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:39:38.130123] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-23T23:39:38.130254] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-23T23:39:38.130387] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-23T23:39:38.130511] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-23T23:39:38.130638] [INFO ] [MAIN ] Update Progress: 1865/2367 symbols completed. SAY took 18.9s. Estimated remaining: 1h 4m 29s. Rate: 7.8 symbols/min [2025-10-23T23:39:38.296773] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:38.296998] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-23T23:39:38.297090] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-23T23:39:38.297248] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-23T23:39:38.297350] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-23T23:39:38.297463] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-23T23:39:38.297557] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-23T23:39:38.404521] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-23T23:39:38.651167] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:38.932192] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-23T23:39:39.199428] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-23T23:39:39.538459] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-23T23:39:39.999474] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-23T23:39:40.799437] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-23T23:39:41.269672] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T23:39:41.397256] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-23T23:39:41.599435] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-23T23:39:41.932098] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-23T23:39:41.932931] [INFO ] [REMOTE ] SAT: Full fetch complete (1481 records). [2025-10-23T23:39:41.933035] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-23T23:39:42.112242] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-23T23:39:42.112491] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:39:42.112579] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:39:42.112710] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-23T23:39:42.112837] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-23T23:39:42.112945] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-23T23:39:42.113054] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-23T23:39:42.113221] [INFO ] [MAIN ] Update Progress: 1866/2367 symbols completed. SAT took 28.5s. Estimated remaining: 1h 4m 20s. Rate: 7.8 symbols/min [2025-10-23T23:39:42.280255] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:42.323734] [DEBUG] [LOCAL ] SBH: Loaded 49854 existing records from primary storage. [2025-10-23T23:39:42.324091] [INFO ] [MAIN ] SBH: Loaded 49854 existing records. [2025-10-23T23:39:42.404701] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-23T23:39:42.504705] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:39:42.504963] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-23T23:39:42.505056] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-23T23:39:42.505318] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-23T23:39:42.505411] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-23T23:39:42.858026] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:43.199407] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-10-23T23:39:43.406510] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:39:43.406822] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-10-23T23:39:43.406908] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:39:43.406986] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-23T23:39:43.407058] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:39:43.407130] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-23T23:39:43.407223] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-23T23:39:43.407296] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-23T23:39:43.407379] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-23T23:39:43.407464] [INFO ] [MAIN ] Update Progress: 1867/2367 symbols completed. SBDS took 5.3s. Estimated remaining: 1h 4m 11s. Rate: 7.8 symbols/min [2025-10-23T23:39:43.576281] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:43.587053] [DEBUG] [LOCAL ] SBI: Loaded 7748 existing records from primary storage. [2025-10-23T23:39:43.587335] [INFO ] [MAIN ] SBI: Loaded 7748 existing records. [2025-10-23T23:39:43.768141] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:39:43.768533] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-23T23:39:43.768797] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-23T23:39:43.769020] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-23T23:39:43.769102] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-23T23:39:44.009417] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-23T23:39:44.079967] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T23:39:44.170577] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:39:44.455053] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T23:39:44.799477] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-23T23:39:45.127331] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-23T23:39:45.599464] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-23T23:39:46.399411] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-23T23:39:47.127548] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-23T23:39:47.199426] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-23T23:39:47.532382] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-23T23:39:47.926392] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T23:39:47.999471] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-23T23:39:48.799441] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-23T23:39:49.558398] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T23:39:49.599399] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-23T23:39:50.198100] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T23:39:50.399485] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-23T23:39:50.975563] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-23T23:39:51.199481] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-23T23:39:51.305512] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T23:39:51.999430] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-23T23:39:52.366447] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-23T23:39:52.404667] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-23T23:39:52.799512] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-23T23:39:53.599436] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-23T23:39:54.250879] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T23:39:54.399432] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-23T23:39:55.199407] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-23T23:39:55.306413] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T23:39:55.624038] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-23T23:39:55.637246] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T23:39:55.999413] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-23T23:39:56.716919] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T23:39:56.799446] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-23T23:39:57.599479] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-23T23:39:58.399479] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-23T23:39:58.463059] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-23T23:39:58.922736] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-23T23:39:58.963551] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-23T23:39:59.199440] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-23T23:39:59.548146] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-23T23:39:59.549066] [INFO ] [REMOTE ] SAZ: Full fetch complete (1851 records). [2025-10-23T23:39:59.549154] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-23T23:39:59.723577] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-23T23:39:59.723807] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:39:59.723889] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:39:59.723969] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-23T23:39:59.724067] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-23T23:39:59.724141] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-23T23:39:59.724219] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-23T23:39:59.724314] [INFO ] [MAIN ] Update Progress: 1868/2367 symbols completed. SAZ took 33.5s. Estimated remaining: 1h 4m 5s. Rate: 7.8 symbols/min [2025-10-23T23:39:59.894530] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:39:59.904047] [DEBUG] [LOCAL ] SBR: Loaded 7813 existing records from primary storage. [2025-10-23T23:39:59.904311] [INFO ] [MAIN ] SBR: Loaded 7813 existing records. [2025-10-23T23:40:00.003457] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-23T23:40:00.081520] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:00.081756] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-23T23:40:00.081832] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-23T23:40:00.082251] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-23T23:40:00.082323] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-23T23:40:00.444927] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:00.799443] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-23T23:40:01.509228] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T23:40:01.570670] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T23:40:01.599453] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-23T23:40:02.399488] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-23T23:40:02.779794] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T23:40:02.786121] [INFO ] [REMOTE ] SB: Full fetch complete (49258 records). [2025-10-23T23:40:02.786304] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-23T23:40:03.121884] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T23:40:03.204689] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-23T23:40:03.207462] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-23T23:40:03.207715] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-23T23:40:03.209540] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-23T23:40:03.209625] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-23T23:40:03.210901] [DEBUG] [LOCAL ] SB: Trimmed 49258 records to 32641 (keeping 200 days of data) [2025-10-23T23:40:03.418916] [DEBUG] [LOCAL ] SB: Primary data saved (32641 records). [2025-10-23T23:40:03.419096] [INFO ] [MAIN ] SB: Full history saved. [2025-10-23T23:40:03.419207] [INFO ] [MAIN ] Update Progress: 1869/2367 symbols completed. SB took 32.1s. Estimated remaining: 1h 3m 57s. Rate: 7.8 symbols/min [2025-10-23T23:40:03.586716] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:03.629543] [DEBUG] [LOCAL ] SBS: Loaded 49293 existing records from primary storage. [2025-10-23T23:40:03.629904] [INFO ] [MAIN ] SBS: Loaded 49293 existing records. [2025-10-23T23:40:03.808471] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:03.808693] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-23T23:40:03.808771] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-23T23:40:03.809051] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-23T23:40:03.809125] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-23T23:40:04.004784] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-23T23:40:04.004843] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-23T23:40:04.177558] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:04.799423] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-23T23:40:04.854285] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:40:05.599484] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-23T23:40:06.397811] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-23T23:40:06.407824] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-23T23:40:06.437115] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-23T23:40:07.199464] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-23T23:40:07.933716] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T23:40:07.999424] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-23T23:40:08.064082] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:40:08.799440] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-23T23:40:09.599428] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-23T23:40:09.817860] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-23T23:40:10.368262] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T23:40:10.399427] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-23T23:40:10.439373] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-23T23:40:11.009785] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-23T23:40:11.199419] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-23T23:40:11.886701] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-23T23:40:11.888588] [INFO ] [REMOTE ] SBI: Full fetch complete (10616 records). [2025-10-23T23:40:11.888732] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-23T23:40:12.004547] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-23T23:40:12.249777] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-23T23:40:12.249885] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-23T23:40:12.250177] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-23T23:40:12.250252] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-23T23:40:12.250729] [DEBUG] [LOCAL ] SBI: Trimmed 10616 records to 7797 (keeping 200 days of data) [2025-10-23T23:40:12.294113] [DEBUG] [LOCAL ] SBI: Primary data saved (7797 records). [2025-10-23T23:40:12.294263] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-23T23:40:12.294382] [INFO ] [MAIN ] Update Progress: 1870/2367 symbols completed. SBI took 28.9s. Estimated remaining: 1h 3m 49s. Rate: 7.8 symbols/min [2025-10-23T23:40:12.461428] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:12.477023] [DEBUG] [LOCAL ] SBSI: Loaded 14802 existing records from primary storage. [2025-10-23T23:40:12.477293] [INFO ] [MAIN ] SBSI: Loaded 14802 existing records. [2025-10-23T23:40:12.654185] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:12.654378] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-23T23:40:12.654458] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-23T23:40:12.654845] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-23T23:40:12.654921] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-23T23:40:12.810155] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-23T23:40:13.012082] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:13.599398] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-23T23:40:13.820157] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-23T23:40:13.839547] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-23T23:40:14.399417] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-23T23:40:14.574401] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T23:40:15.199434] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-23T23:40:15.886462] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-23T23:40:15.934552] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T23:40:15.999406] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-23T23:40:16.676749] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-23T23:40:16.799484] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-23T23:40:17.599501] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-23T23:40:18.399503] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-23T23:40:18.550682] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-23T23:40:18.559710] [INFO ] [REMOTE ] SBH: Full fetch complete (73014 records). [2025-10-23T23:40:18.559903] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-23T23:40:18.840840] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T23:40:18.975944] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-23T23:40:18.976077] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-23T23:40:18.977254] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-23T23:40:18.977338] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-23T23:40:18.978838] [DEBUG] [LOCAL ] SBH: Trimmed 73014 records to 50207 (keeping 200 days of data) [2025-10-23T23:40:19.196155] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-23T23:40:19.200051] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-23T23:40:19.279213] [DEBUG] [LOCAL ] SBH: Primary data saved (50207 records). [2025-10-23T23:40:19.279379] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-23T23:40:19.279506] [INFO ] [MAIN ] Update Progress: 1871/2367 symbols completed. SBH took 37.2s. Estimated remaining: 1h 3m 41s. Rate: 7.8 symbols/min [2025-10-23T23:40:19.453170] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:19.501010] [DEBUG] [LOCAL ] SBSW: Loaded 53185 existing records from primary storage. [2025-10-23T23:40:19.501394] [INFO ] [MAIN ] SBSW: Loaded 53185 existing records. [2025-10-23T23:40:19.691399] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:19.691638] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-23T23:40:19.691744] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-23T23:40:19.692113] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-23T23:40:19.692195] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-23T23:40:20.004621] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-23T23:40:20.055711] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:20.758245] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T23:40:20.799410] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-23T23:40:20.906967] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T23:40:21.599492] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-23T23:40:21.663357] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-23T23:40:22.399534] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-23T23:40:23.118115] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-23T23:40:23.199437] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-23T23:40:23.438291] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T23:40:23.999448] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-23T23:40:24.783602] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-23T23:40:24.799436] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-23T23:40:24.947485] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T23:40:25.599443] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-23T23:40:25.646023] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T23:40:26.399435] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-23T23:40:27.199415] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-23T23:40:27.304153] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-23T23:40:27.355693] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-23T23:40:27.772365] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-23T23:40:27.774719] [INFO ] [REMOTE ] SBR: Full fetch complete (11366 records). [2025-10-23T23:40:27.774820] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-23T23:40:28.008450] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-23T23:40:28.135974] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-23T23:40:28.136078] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-23T23:40:28.136412] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-23T23:40:28.136502] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-23T23:40:28.137023] [DEBUG] [LOCAL ] SBR: Trimmed 11366 records to 7861 (keeping 200 days of data) [2025-10-23T23:40:28.183361] [DEBUG] [LOCAL ] SBR: Primary data saved (7861 records). [2025-10-23T23:40:28.183490] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-23T23:40:28.183596] [INFO ] [MAIN ] Update Progress: 1872/2367 symbols completed. SBR took 28.5s. Estimated remaining: 1h 3m 34s. Rate: 7.8 symbols/min [2025-10-23T23:40:28.354363] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:28.354570] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-23T23:40:28.354667] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-23T23:40:28.354788] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-23T23:40:28.354863] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-23T23:40:28.354959] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-23T23:40:28.355028] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-23T23:40:28.701674] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:28.799401] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-23T23:40:29.011291] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-10-23T23:40:29.599442] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-23T23:40:29.968277] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-23T23:40:30.402387] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-23T23:40:30.405844] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T23:40:30.509502] [DEBUG] [REMOTE ] SBSW: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-23T23:40:30.509874] [WARN ] [REMOTE ] SBSW: No data returned for month 2025-03 [2025-10-23T23:40:30.509996] [FATAL] [REMOTE ] SBSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:40:30.510112] [FATAL] [MAIN ] SBSW: Failed to fetch primary data. [2025-10-23T23:40:30.510185] [WARN ] [MAIN ] SBSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:40:30.510256] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-23T23:40:30.510347] [DEBUG] [LOCAL ] SBSW: No primary data file found to delete. [2025-10-23T23:40:30.510415] [INFO ] [LOCAL ] SBSW: Starting deletion of derivative data. [2025-10-23T23:40:30.510580] [DEBUG] [LOCAL ] SBSW: Deleted derivative data file. [2025-10-23T23:40:30.510702] [INFO ] [MAIN ] Update Progress: 1873/2367 symbols completed. SBSW took 11.2s. Estimated remaining: 1h 3m 25s. Rate: 7.8 symbols/min [2025-10-23T23:40:30.682698] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:30.725834] [DEBUG] [LOCAL ] SCCO: Loaded 49566 existing records from primary storage. [2025-10-23T23:40:30.726152] [INFO ] [MAIN ] SCCO: Loaded 49566 existing records. [2025-10-23T23:40:30.904104] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:30.904334] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-23T23:40:30.904409] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-23T23:40:30.904635] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-23T23:40:30.904738] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-23T23:40:31.204615] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-23T23:40:31.293458] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:31.999466] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-23T23:40:32.808485] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-23T23:40:32.829038] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-23T23:40:32.937229] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-23T23:40:33.599462] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-23T23:40:34.389446] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-23T23:40:34.399388] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-23T23:40:34.548530] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T23:40:35.199474] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-23T23:40:35.834903] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-23T23:40:35.869970] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:40:35.999459] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-23T23:40:36.220563] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-23T23:40:36.799481] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-23T23:40:37.599422] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-23T23:40:37.736458] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T23:40:37.739709] [INFO ] [REMOTE ] SBSI: Full fetch complete (21334 records). [2025-10-23T23:40:37.739804] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-23T23:40:38.098901] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-23T23:40:38.099034] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-23T23:40:38.099530] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-23T23:40:38.099669] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-23T23:40:38.100338] [DEBUG] [LOCAL ] SBSI: Trimmed 21334 records to 14898 (keeping 200 days of data) [2025-10-23T23:40:38.187549] [DEBUG] [LOCAL ] SBSI: Primary data saved (14898 records). [2025-10-23T23:40:38.187740] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-23T23:40:38.187860] [INFO ] [MAIN ] Update Progress: 1874/2367 symbols completed. SBSI took 25.9s. Estimated remaining: 1h 3m 17s. Rate: 7.8 symbols/min [2025-10-23T23:40:38.352359] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:38.366674] [DEBUG] [LOCAL ] SCD: Loaded 13496 existing records from primary storage. [2025-10-23T23:40:38.366916] [INFO ] [MAIN ] SCD: Loaded 13496 existing records. [2025-10-23T23:40:38.408572] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-23T23:40:38.548768] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:38.548977] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-23T23:40:38.549053] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-23T23:40:38.549263] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-23T23:40:38.549337] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-23T23:40:38.900794] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:39.199443] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-23T23:40:39.459665] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T23:40:39.952131] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-23T23:40:39.999479] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-23T23:40:40.155801] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T23:40:40.233263] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-23T23:40:40.799423] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-23T23:40:41.129224] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-23T23:40:41.599463] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-23T23:40:42.362439] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T23:40:42.399395] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-23T23:40:42.967278] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-23T23:40:43.199466] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-23T23:40:43.656083] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T23:40:43.999445] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-23T23:40:44.713753] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-23T23:40:44.799502] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-23T23:40:45.509596] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-23T23:40:45.599504] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-23T23:40:46.377214] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:40:46.399426] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-23T23:40:47.199488] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-23T23:40:47.207335] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T23:40:47.999519] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-23T23:40:48.322095] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-23T23:40:48.658444] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:40:48.799444] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-23T23:40:49.599412] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-23T23:40:49.751212] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-23T23:40:49.845003] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-23T23:40:49.846143] [INFO ] [REMOTE ] SBXD: Full fetch complete (3139 records). [2025-10-23T23:40:49.846263] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-23T23:40:50.027902] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-23T23:40:50.028112] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:40:50.028184] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:40:50.028260] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-23T23:40:50.028353] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-23T23:40:50.028426] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-23T23:40:50.028506] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-23T23:40:50.028599] [INFO ] [MAIN ] Update Progress: 1875/2367 symbols completed. SBXD took 21.8s. Estimated remaining: 1h 3m 11s. Rate: 7.8 symbols/min [2025-10-23T23:40:50.213534] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:50.261206] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-23T23:40:50.261574] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-23T23:40:50.406952] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-23T23:40:50.439685] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:50.440548] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-23T23:40:50.440629] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-23T23:40:50.440899] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-23T23:40:50.440981] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-23T23:40:50.850004] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:51.199447] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-23T23:40:51.999422] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-23T23:40:52.243424] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T23:40:52.300197] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T23:40:52.799447] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-23T23:40:53.599422] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-23T23:40:53.872710] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T23:40:54.399427] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-23T23:40:54.484028] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T23:40:54.970666] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T23:40:55.199422] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-23T23:40:55.384595] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-23T23:40:55.393035] [INFO ] [REMOTE ] SBS: Full fetch complete (70688 records). [2025-10-23T23:40:55.393216] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-23T23:40:55.781244] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-23T23:40:55.781353] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-23T23:40:55.782446] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-23T23:40:55.782525] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-23T23:40:55.783902] [DEBUG] [LOCAL ] SBS: Trimmed 70688 records to 49623 (keeping 200 days of data) [2025-10-23T23:40:55.998203] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-23T23:40:55.999412] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-23T23:40:56.088788] [DEBUG] [LOCAL ] SBS: Primary data saved (49623 records). [2025-10-23T23:40:56.088938] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-23T23:40:56.089072] [INFO ] [MAIN ] Update Progress: 1876/2367 symbols completed. SBS took 52.7s. Estimated remaining: 1h 3m 2s. Rate: 7.8 symbols/min [2025-10-23T23:40:56.259282] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:40:56.299238] [DEBUG] [LOCAL ] SCI: Loaded 46165 existing records from primary storage. [2025-10-23T23:40:56.299576] [INFO ] [MAIN ] SCI: Loaded 46165 existing records. [2025-10-23T23:40:56.475985] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:40:56.476173] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-23T23:40:56.476244] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-23T23:40:56.476566] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-23T23:40:56.476638] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-23T23:40:56.808573] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-23T23:40:56.830846] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:40:57.599416] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-23T23:40:57.692538] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T23:40:57.692917] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T23:40:57.706087] [INFO ] [REMOTE ] SCD: Full fetch complete (17175 records). [2025-10-23T23:40:57.706619] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-23T23:40:58.070781] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-23T23:40:58.070905] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-23T23:40:58.071301] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-23T23:40:58.071375] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-23T23:40:58.072169] [DEBUG] [LOCAL ] SCD: Trimmed 17175 records to 13638 (keeping 200 days of data) [2025-10-23T23:40:58.153967] [DEBUG] [LOCAL ] SCD: Primary data saved (13638 records). [2025-10-23T23:40:58.154140] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-23T23:40:58.154254] [INFO ] [MAIN ] Update Progress: 1877/2367 symbols completed. SCD took 20.0s. Estimated remaining: 1h 2m 53s. Rate: 7.8 symbols/min [2025-10-23T23:40:58.399471] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-23T23:40:59.199455] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-23T23:40:59.250201] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-23T23:40:59.999420] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-23T23:41:00.340303] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-23T23:41:00.799436] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-23T23:41:00.855500] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:41:01.599406] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-23T23:41:02.058052] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-23T23:41:02.399414] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-23T23:41:02.796622] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-23T23:41:03.199414] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-23T23:41:03.304806] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T23:41:03.787230] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T23:41:03.999488] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-23T23:41:04.799444] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-23T23:41:05.164736] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-23T23:41:05.599411] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-23T23:41:05.745566] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T23:41:06.399456] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-23T23:41:06.761439] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T23:41:07.199465] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-23T23:41:07.469834] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-23T23:41:07.950548] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T23:41:07.999438] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-23T23:41:08.799476] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-23T23:41:09.027753] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-23T23:41:09.036944] [INFO ] [REMOTE ] SCCO: Full fetch complete (71877 records). [2025-10-23T23:41:09.037154] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-23T23:41:09.440281] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-23T23:41:09.440442] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-23T23:41:09.441803] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-23T23:41:09.441982] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-23T23:41:09.470426] [DEBUG] [LOCAL ] SCCO: Trimmed 71877 records to 49917 (keeping 200 days of data) [2025-10-23T23:41:09.472431] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-23T23:41:09.600222] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-23T23:41:09.793001] [DEBUG] [LOCAL ] SCCO: Primary data saved (49917 records). [2025-10-23T23:41:09.793210] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-23T23:41:09.793346] [INFO ] [MAIN ] Update Progress: 1878/2367 symbols completed. SCCO took 39.3s. Estimated remaining: 1h 2m 47s. Rate: 7.8 symbols/min [2025-10-23T23:41:10.908342] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-23T23:41:10.920258] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-23T23:41:11.220634] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:41:11.230164] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-23T23:41:12.754271] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T23:41:12.766088] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-23T23:41:12.840796] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T23:41:12.851330] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-23T23:41:14.466912] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T23:41:14.476946] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-23T23:41:14.842517] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-23T23:41:14.853967] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-23T23:41:15.820960] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-23T23:41:15.830438] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-23T23:41:16.903115] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-23T23:41:16.915770] [INFO ] [REMOTE ] SCHW: Full fetch complete (77865 records). [2025-10-23T23:41:16.915990] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-23T23:41:17.333497] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-23T23:41:17.333631] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-23T23:41:17.334982] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-23T23:41:17.335078] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-23T23:41:17.336523] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 54075 (keeping 200 days of data) [2025-10-23T23:41:17.468323] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T23:41:17.479418] [INFO ] [REMOTE ] SCI: Full fetch complete (67457 records). [2025-10-23T23:41:17.487196] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-23T23:41:18.100183] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-23T23:41:18.103835] [DEBUG] [LOCAL ] SCHW: Primary data saved (54075 records). [2025-10-23T23:41:18.103952] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-23T23:41:18.105160] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-23T23:41:18.105093] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-23T23:41:18.105401] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-23T23:41:18.105321] [INFO ] [MAIN ] Update Progress: 1879/2367 symbols completed. SCHW took 28.1s. Estimated remaining: 1h 2m 39s. Rate: 7.8 symbols/min [2025-10-23T23:41:18.106841] [DEBUG] [LOCAL ] SCI: Trimmed 67457 records to 46439 (keeping 200 days of data) [2025-10-23T23:41:18.393845] [DEBUG] [LOCAL ] SCI: Primary data saved (46439 records). [2025-10-23T23:41:18.394027] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-23T23:41:18.394150] [INFO ] [MAIN ] Update Progress: 1880/2367 symbols completed. SCI took 22.3s. Estimated remaining: 1h 2m 29s. Rate: 7.8 symbols/min [2025-10-23T23:41:18.995670] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:19.008690] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:19.097513] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:19.099746] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:19.131780] [DEBUG] [LOCAL ] SCL: Loaded 15126 existing records from primary storage. [2025-10-23T23:41:19.132423] [INFO ] [MAIN ] SCL: Loaded 15126 existing records. [2025-10-23T23:41:19.180693] [DEBUG] [LOCAL ] SCM: Loaded 19989 existing records from primary storage. [2025-10-23T23:41:19.207381] [INFO ] [MAIN ] SCM: Loaded 19989 existing records. [2025-10-23T23:41:19.285109] [DEBUG] [LOCAL ] SD: Loaded 28248 existing records from primary storage. [2025-10-23T23:41:19.318681] [INFO ] [MAIN ] SD: Loaded 28248 existing records. [2025-10-23T23:41:19.499319] [DEBUG] [LOCAL ] SCS: Loaded 43227 existing records from primary storage. [2025-10-23T23:41:19.596387] [INFO ] [MAIN ] SCS: Loaded 43227 existing records. [2025-10-23T23:41:19.653360] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:19.688708] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:19.694158] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-23T23:41:19.767252] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-23T23:41:19.761226] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-23T23:41:19.834781] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-23T23:41:19.802540] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-23T23:41:19.861582] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-23T23:41:19.864667] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:19.873821] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-23T23:41:19.914585] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-23T23:41:19.890914] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-23T23:41:19.993358] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-23T23:41:20.108079] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-23T23:41:20.150618] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:20.178359] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-23T23:41:20.254326] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-23T23:41:20.284053] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-23T23:41:20.438462] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-23T23:41:20.453290] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-23T23:41:21.091718] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:21.166306] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-23T23:41:21.397701] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:21.405344] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-23T23:41:21.416801] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:21.432636] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-23T23:41:21.539960] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:21.540341] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-23T23:41:22.375413] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-23T23:41:22.379446] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-23T23:41:22.498719] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T23:41:22.502997] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-23T23:41:22.554314] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T23:41:22.561199] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-23T23:41:22.963896] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T23:41:22.971471] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-23T23:41:23.228438] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:41:23.232550] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-23T23:41:23.244806] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T23:41:23.249020] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-23T23:41:23.640606] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T23:41:23.999430] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-23T23:41:24.084187] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T23:41:24.296631] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T23:41:24.472284] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-23T23:41:24.799437] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-23T23:41:25.517570] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:41:25.599413] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-23T23:41:25.994260] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T23:41:26.399434] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-23T23:41:26.988451] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-23T23:41:27.088964] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-23T23:41:27.199417] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-23T23:41:27.999437] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-23T23:41:28.249858] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T23:41:28.799407] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-23T23:41:29.581498] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-23T23:41:29.599397] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-23T23:41:29.847960] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T23:41:30.399423] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-23T23:41:31.044029] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T23:41:31.082229] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-23T23:41:31.199418] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-23T23:41:32.002928] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-23T23:41:32.005300] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-23T23:41:32.799455] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-23T23:41:33.108515] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T23:41:33.599458] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-23T23:41:34.241919] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T23:41:34.399429] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-23T23:41:34.536235] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T23:41:35.199453] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-23T23:41:35.838922] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-23T23:41:35.856376] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-23T23:41:35.999448] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-23T23:41:36.799427] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-23T23:41:37.369280] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T23:41:37.599403] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-23T23:41:38.052820] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T23:41:38.399420] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-23T23:41:38.648482] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T23:41:39.199460] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-23T23:41:39.227301] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T23:41:39.999425] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-23T23:41:40.425493] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-23T23:41:40.799424] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-23T23:41:40.971167] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-23T23:41:41.599451] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-23T23:41:42.172743] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-23T23:41:42.399418] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-23T23:41:42.860028] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-23T23:41:43.199403] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-23T23:41:43.518216] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-23T23:41:43.999415] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-23T23:41:44.188168] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T23:41:44.193270] [INFO ] [REMOTE ] SCL: Full fetch complete (21690 records). [2025-10-23T23:41:44.193378] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-23T23:41:44.563610] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-23T23:41:44.563738] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-23T23:41:44.564200] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-23T23:41:44.564269] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-23T23:41:44.564916] [DEBUG] [LOCAL ] SCL: Trimmed 21690 records to 15300 (keeping 200 days of data) [2025-10-23T23:41:44.654415] [DEBUG] [LOCAL ] SCL: Primary data saved (15300 records). [2025-10-23T23:41:44.654574] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-23T23:41:44.654689] [INFO ] [MAIN ] Update Progress: 1881/2367 symbols completed. SCL took 26.3s. Estimated remaining: 1h 2m 27s. Rate: 7.8 symbols/min [2025-10-23T23:41:44.804314] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-23T23:41:44.828609] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:44.840859] [DEBUG] [LOCAL ] SDHC: Loaded 10378 existing records from primary storage. [2025-10-23T23:41:44.841091] [INFO ] [MAIN ] SDHC: Loaded 10378 existing records. [2025-10-23T23:41:45.019986] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:45.020179] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-23T23:41:45.020256] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-23T23:41:45.020463] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-23T23:41:45.020543] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-23T23:41:45.160591] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-23T23:41:45.400586] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:45.599423] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-23T23:41:45.768544] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T23:41:45.773370] [INFO ] [REMOTE ] SCM: Full fetch complete (29407 records). [2025-10-23T23:41:45.773493] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-23T23:41:46.137625] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-23T23:41:46.137781] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-23T23:41:46.138410] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-23T23:41:46.138485] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-23T23:41:46.139279] [DEBUG] [LOCAL ] SCM: Trimmed 29407 records to 20250 (keeping 200 days of data) [2025-10-23T23:41:46.260009] [DEBUG] [LOCAL ] SCM: Primary data saved (20250 records). [2025-10-23T23:41:46.260154] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-23T23:41:46.260269] [INFO ] [MAIN ] Update Progress: 1882/2367 symbols completed. SCM took 27.9s. Estimated remaining: 1h 2m 17s. Rate: 7.8 symbols/min [2025-10-23T23:41:46.406704] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-23T23:41:46.432451] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:46.445451] [DEBUG] [LOCAL ] SDHY: Loaded 11210 existing records from primary storage. [2025-10-23T23:41:46.445716] [INFO ] [MAIN ] SDHY: Loaded 11210 existing records. [2025-10-23T23:41:46.553986] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-23T23:41:46.636065] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:46.636319] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-23T23:41:46.636394] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-23T23:41:46.636624] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-23T23:41:46.636734] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-23T23:41:46.986502] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:47.199408] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-23T23:41:47.568935] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-23T23:41:47.577156] [INFO ] [REMOTE ] SD: Full fetch complete (40673 records). [2025-10-23T23:41:47.577395] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-23T23:41:47.972769] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-23T23:41:47.975549] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-23T23:41:47.975698] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-23T23:41:47.980468] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-23T23:41:47.981278] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-23T23:41:47.982516] [DEBUG] [LOCAL ] SD: Trimmed 40673 records to 28416 (keeping 200 days of data) [2025-10-23T23:41:48.039455] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-23T23:41:48.182867] [DEBUG] [LOCAL ] SD: Primary data saved (28416 records). [2025-10-23T23:41:48.183104] [INFO ] [MAIN ] SD: Full history saved. [2025-10-23T23:41:48.183246] [INFO ] [MAIN ] Update Progress: 1883/2367 symbols completed. SD took 29.8s. Estimated remaining: 1h 2m 8s. Rate: 7.8 symbols/min [2025-10-23T23:41:48.364678] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:48.406426] [DEBUG] [LOCAL ] SDRL: Loaded 41106 existing records from primary storage. [2025-10-23T23:41:48.406883] [INFO ] [MAIN ] SDRL: Loaded 41106 existing records. [2025-10-23T23:41:48.594059] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:41:48.594431] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-23T23:41:48.594552] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-23T23:41:48.594848] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-23T23:41:48.594928] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-23T23:41:48.806516] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-23T23:41:48.961566] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:49.599511] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-23T23:41:49.688466] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-23T23:41:49.763230] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T23:41:50.399452] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-23T23:41:51.139560] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-23T23:41:51.199406] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-23T23:41:51.396962] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-23T23:41:51.999455] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-23T23:41:52.808354] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-23T23:41:52.814057] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-23T23:41:52.842265] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T23:41:53.599508] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-23T23:41:53.795626] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-23T23:41:54.399471] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-23T23:41:55.112389] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T23:41:55.120137] [INFO ] [REMOTE ] SCS: Full fetch complete (61054 records). [2025-10-23T23:41:55.120285] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-23T23:41:55.204596] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-23T23:41:55.505057] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-23T23:41:55.505166] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-23T23:41:55.506225] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-23T23:41:55.506302] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-23T23:41:55.507748] [DEBUG] [LOCAL ] SCS: Trimmed 61054 records to 43507 (keeping 200 days of data) [2025-10-23T23:41:55.771308] [DEBUG] [LOCAL ] SCS: Primary data saved (43507 records). [2025-10-23T23:41:55.771475] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-23T23:41:55.771587] [INFO ] [MAIN ] Update Progress: 1884/2367 symbols completed. SCS took 37.4s. Estimated remaining: 1h 2m 0s. Rate: 7.8 symbols/min [2025-10-23T23:41:55.950607] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:41:55.950933] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-10-23T23:41:55.951046] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-10-23T23:41:55.951327] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-23T23:41:55.951538] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-23T23:41:55.951819] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-23T23:41:55.951905] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-23T23:41:56.020480] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-23T23:41:56.214928] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T23:41:56.301154] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T23:41:56.389319] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:41:56.799416] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-23T23:41:56.915467] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-23T23:41:57.599434] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-23T23:41:58.311339] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T23:41:58.399434] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-23T23:41:59.199441] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-23T23:41:59.240393] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-23T23:41:59.483103] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-23T23:41:59.999442] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-23T23:42:00.646396] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:42:00.715529] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T23:42:00.799409] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-23T23:42:01.599516] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-23T23:42:02.399436] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-23T23:42:02.431621] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T23:42:02.480491] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T23:42:03.092706] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T23:42:03.199414] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-23T23:42:03.954570] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T23:42:03.999433] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-23T23:42:04.799448] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-23T23:42:05.532122] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T23:42:05.548874] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-23T23:42:05.599392] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-23T23:42:06.347557] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T23:42:06.399399] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-23T23:42:07.199415] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-23T23:42:07.422625] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-23T23:42:07.999437] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-23T23:42:08.783124] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T23:42:08.799420] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-23T23:42:08.853364] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-23T23:42:08.857230] [INFO ] [REMOTE ] SDHC: Full fetch complete (16774 records). [2025-10-23T23:42:08.857388] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-23T23:42:09.256708] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-23T23:42:09.256842] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-23T23:42:09.257296] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-23T23:42:09.257402] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-23T23:42:09.258012] [DEBUG] [LOCAL ] SDHC: Trimmed 16774 records to 10434 (keeping 200 days of data) [2025-10-23T23:42:09.315982] [DEBUG] [LOCAL ] SDHC: Primary data saved (10434 records). [2025-10-23T23:42:09.316155] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-23T23:42:09.316312] [INFO ] [MAIN ] Update Progress: 1885/2367 symbols completed. SDHC took 24.7s. Estimated remaining: 1h 1m 54s. Rate: 7.8 symbols/min [2025-10-23T23:42:09.481909] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:09.526877] [DEBUG] [LOCAL ] SEE: Loaded 48091 existing records from primary storage. [2025-10-23T23:42:09.527235] [INFO ] [MAIN ] SEE: Loaded 48091 existing records. [2025-10-23T23:42:09.604587] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-23T23:42:09.705059] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:09.705264] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-23T23:42:09.705354] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-23T23:42:09.705593] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-23T23:42:09.705709] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-23T23:42:10.056196] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:10.399394] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-23T23:42:10.462467] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-23T23:42:10.985110] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-23T23:42:11.199414] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-23T23:42:11.989154] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-23T23:42:11.999398] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-23T23:42:12.034609] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T23:42:12.799524] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-23T23:42:12.869927] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T23:42:12.872780] [INFO ] [REMOTE ] SDHY: Full fetch complete (15955 records). [2025-10-23T23:42:12.872891] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-23T23:42:13.242937] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-23T23:42:13.243044] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-23T23:42:13.243422] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-23T23:42:13.243496] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-23T23:42:13.244096] [DEBUG] [LOCAL ] SDHY: Trimmed 15955 records to 11276 (keeping 200 days of data) [2025-10-23T23:42:13.310722] [DEBUG] [LOCAL ] SDHY: Primary data saved (11276 records). [2025-10-23T23:42:13.310866] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-23T23:42:13.310978] [INFO ] [MAIN ] Update Progress: 1886/2367 symbols completed. SDHY took 27.1s. Estimated remaining: 1h 1m 45s. Rate: 7.8 symbols/min [2025-10-23T23:42:13.478485] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:13.491989] [DEBUG] [LOCAL ] SEG: Loaded 12503 existing records from primary storage. [2025-10-23T23:42:13.492242] [INFO ] [MAIN ] SEG: Loaded 12503 existing records. [2025-10-23T23:42:13.604558] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-23T23:42:13.671728] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:13.671929] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-23T23:42:13.672025] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-23T23:42:13.672246] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-23T23:42:13.672351] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-23T23:42:14.026148] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:14.272809] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T23:42:14.399401] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-23T23:42:15.199430] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-23T23:42:15.784848] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-23T23:42:15.930413] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T23:42:15.999414] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-23T23:42:16.078572] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T23:42:16.799438] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-23T23:42:17.599896] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-23T23:42:17.599958] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-23T23:42:17.608315] [INFO ] [REMOTE ] SDRL: Full fetch complete (61208 records). [2025-10-23T23:42:17.608517] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-23T23:42:18.002134] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-23T23:42:18.002243] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-23T23:42:18.003319] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-23T23:42:18.003402] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-23T23:42:18.004718] [DEBUG] [LOCAL ] SDRL: Trimmed 61208 records to 41448 (keeping 200 days of data) [2025-10-23T23:42:18.246752] [DEBUG] [LOCAL ] SDRL: Primary data saved (41448 records). [2025-10-23T23:42:18.246900] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-23T23:42:18.247026] [INFO ] [MAIN ] Update Progress: 1887/2367 symbols completed. SDRL took 30.1s. Estimated remaining: 1h 1m 37s. Rate: 7.8 symbols/min [2025-10-23T23:42:18.418833] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:18.413254] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-23T23:42:18.469912] [DEBUG] [LOCAL ] SEI: Loaded 50024 existing records from primary storage. [2025-10-23T23:42:18.470746] [INFO ] [MAIN ] SEI: Loaded 50024 existing records. [2025-10-23T23:42:18.657030] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:18.657527] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-23T23:42:18.657677] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-23T23:42:18.658758] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-23T23:42:18.658821] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-23T23:42:18.659000] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-23T23:42:19.016688] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:19.045038] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-23T23:42:19.199428] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-23T23:42:19.976968] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T23:42:19.999392] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-23T23:42:20.799425] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-23T23:42:21.283362] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-23T23:42:21.599420] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-23T23:42:21.752831] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-23T23:42:22.399422] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-23T23:42:22.464130] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:42:23.199410] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-23T23:42:23.371110] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-23T23:42:23.999514] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-23T23:42:24.159507] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-23T23:42:24.185591] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-23T23:42:24.799448] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-23T23:42:25.582545] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:42:25.599391] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-23T23:42:26.158034] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-23T23:42:26.399421] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-23T23:42:26.439430] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T23:42:27.199536] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-23T23:42:27.974893] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T23:42:27.999399] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-23T23:42:28.799425] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-23T23:42:29.318013] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-23T23:42:29.339832] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T23:42:29.599407] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-23T23:42:29.782495] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-23T23:42:30.399472] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-23T23:42:30.495409] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-23T23:42:31.199489] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-23T23:42:31.880050] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T23:42:31.923273] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-23T23:42:31.999411] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-23T23:42:32.799458] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-23T23:42:33.607451] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-23T23:42:33.610134] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:42:34.399445] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-23T23:42:34.627430] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T23:42:35.199418] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-23T23:42:35.514587] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-23T23:42:35.523932] [INFO ] [REMOTE ] SE: Full fetch complete (77287 records). [2025-10-23T23:42:35.524086] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-23T23:42:35.925825] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-23T23:42:35.925935] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-23T23:42:35.927154] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-23T23:42:35.927236] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-23T23:42:35.928799] [DEBUG] [LOCAL ] SE: Trimmed 77287 records to 53690 (keeping 200 days of data) [2025-10-23T23:42:36.019369] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-23T23:42:36.192155] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T23:42:36.297198] [DEBUG] [LOCAL ] SE: Primary data saved (53690 records). [2025-10-23T23:42:36.297360] [INFO ] [MAIN ] SE: Full history saved. [2025-10-23T23:42:36.297480] [INFO ] [MAIN ] Update Progress: 1888/2367 symbols completed. SE took 40.5s. Estimated remaining: 1h 1m 32s. Rate: 7.8 symbols/min [2025-10-23T23:42:36.464148] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:36.505407] [DEBUG] [LOCAL ] SEM: Loaded 43168 existing records from primary storage. [2025-10-23T23:42:36.505736] [INFO ] [MAIN ] SEM: Loaded 43168 existing records. [2025-10-23T23:42:36.686382] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:36.686632] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-23T23:42:36.686728] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-23T23:42:36.687175] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-23T23:42:36.687249] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-23T23:42:36.802144] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-23T23:42:36.939786] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T23:42:37.066117] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:37.092485] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-23T23:42:37.599460] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-23T23:42:38.399405] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-23T23:42:38.509100] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T23:42:39.017892] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-23T23:42:39.199460] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-23T23:42:39.840523] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-23T23:42:39.842781] [INFO ] [REMOTE ] SEG: Full fetch complete (19786 records). [2025-10-23T23:42:39.842874] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-23T23:42:40.000302] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-23T23:42:40.224573] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-23T23:42:40.224715] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-23T23:42:40.225357] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-23T23:42:40.240204] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-23T23:42:40.251741] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-23T23:42:40.252132] [DEBUG] [LOCAL ] SEG: Trimmed 19786 records to 12541 (keeping 200 days of data) [2025-10-23T23:42:40.333451] [DEBUG] [LOCAL ] SEG: Primary data saved (12541 records). [2025-10-23T23:42:40.333607] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-23T23:42:40.333739] [INFO ] [MAIN ] Update Progress: 1889/2367 symbols completed. SEG took 27.0s. Estimated remaining: 1h 1m 23s. Rate: 7.8 symbols/min [2025-10-23T23:42:40.498606] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:40.534826] [DEBUG] [LOCAL ] SEMR: Loaded 42068 existing records from primary storage. [2025-10-23T23:42:40.535151] [INFO ] [MAIN ] SEMR: Loaded 42068 existing records. [2025-10-23T23:42:40.708944] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:40.709168] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-23T23:42:40.709242] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-23T23:42:40.709584] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-23T23:42:40.709690] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-23T23:42:40.804702] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-23T23:42:41.066045] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:41.599433] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-23T23:42:41.753247] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:42:42.275250] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:42:42.399463] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-23T23:42:43.199435] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-23T23:42:43.443004] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-23T23:42:43.787392] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-23T23:42:43.999439] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-23T23:42:44.697213] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T23:42:44.799398] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-23T23:42:45.599591] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-23T23:42:45.768051] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T23:42:46.399436] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-23T23:42:46.440347] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T23:42:47.080750] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T23:42:47.089231] [INFO ] [REMOTE ] SEE: Full fetch complete (70044 records). [2025-10-23T23:42:47.089374] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-23T23:42:47.204702] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-23T23:42:47.494040] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-23T23:42:47.494174] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-23T23:42:47.495448] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-23T23:42:47.495533] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-23T23:42:47.496944] [DEBUG] [LOCAL ] SEE: Trimmed 70044 records to 48408 (keeping 200 days of data) [2025-10-23T23:42:47.794919] [DEBUG] [LOCAL ] SEE: Primary data saved (48408 records). [2025-10-23T23:42:47.795067] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-23T23:42:47.796325] [INFO ] [MAIN ] Update Progress: 1890/2367 symbols completed. SEE took 38.5s. Estimated remaining: 1h 1m 16s. Rate: 7.8 symbols/min [2025-10-23T23:42:47.965935] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:47.999437] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-23T23:42:48.019443] [DEBUG] [LOCAL ] SES: Loaded 51614 existing records from primary storage. [2025-10-23T23:42:48.019855] [INFO ] [MAIN ] SES: Loaded 51614 existing records. [2025-10-23T23:42:48.202761] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:48.203182] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-23T23:42:48.203321] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-23T23:42:48.203710] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-23T23:42:48.203861] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-23T23:42:48.526375] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-23T23:42:48.624301] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:48.650082] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T23:42:48.799456] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-23T23:42:49.597492] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:42:49.606421] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-23T23:42:50.399447] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-23T23:42:51.152839] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-23T23:42:51.199418] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-23T23:42:51.475436] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T23:42:51.484792] [INFO ] [REMOTE ] SEI: Full fetch complete (71280 records). [2025-10-23T23:42:51.484986] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-23T23:42:51.923345] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-23T23:42:51.946031] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-23T23:42:51.946892] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T23:42:51.948234] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-23T23:42:51.957389] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-23T23:42:51.959151] [DEBUG] [LOCAL ] SEI: Trimmed 71280 records to 50409 (keeping 200 days of data) [2025-10-23T23:42:52.010832] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-23T23:42:52.280289] [DEBUG] [LOCAL ] SEI: Primary data saved (50409 records). [2025-10-23T23:42:52.280473] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-23T23:42:52.280590] [INFO ] [MAIN ] Update Progress: 1891/2367 symbols completed. SEI took 34.0s. Estimated remaining: 1h 1m 7s. Rate: 7.8 symbols/min [2025-10-23T23:42:52.461620] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:42:52.502780] [DEBUG] [LOCAL ] SF: Loaded 41355 existing records from primary storage. [2025-10-23T23:42:52.503097] [INFO ] [MAIN ] SF: Loaded 41355 existing records. [2025-10-23T23:42:52.675191] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:42:52.675381] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-23T23:42:52.675456] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-23T23:42:52.675723] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-23T23:42:52.675796] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-23T23:42:52.814590] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-23T23:42:53.039152] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:42:53.398416] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-23T23:42:53.527142] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T23:42:53.599424] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-23T23:42:54.243381] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-23T23:42:54.399444] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-23T23:42:55.135383] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T23:42:55.199418] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-23T23:42:55.948512] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T23:42:55.999433] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-23T23:42:56.764056] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-23T23:42:56.799462] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-23T23:42:57.460166] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-23T23:42:57.599468] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-23T23:42:58.231863] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-23T23:42:58.399437] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-23T23:42:59.199463] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-23T23:42:59.683988] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-23T23:42:59.999410] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-23T23:43:00.115248] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-23T23:43:00.488144] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-23T23:43:00.799455] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-23T23:43:01.468976] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T23:43:01.599404] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-23T23:43:02.399420] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-23T23:43:02.974185] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-23T23:43:03.046614] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T23:43:03.199404] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-23T23:43:03.999457] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-23T23:43:04.174350] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-23T23:43:04.730403] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-23T23:43:04.799445] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-23T23:43:04.915977] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-23T23:43:04.923784] [INFO ] [REMOTE ] SEM: Full fetch complete (61531 records). [2025-10-23T23:43:04.923982] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-23T23:43:05.310712] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-23T23:43:05.310846] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-23T23:43:05.311959] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-23T23:43:05.312040] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-23T23:43:05.313400] [DEBUG] [LOCAL ] SEM: Trimmed 61531 records to 43469 (keeping 200 days of data) [2025-10-23T23:43:05.573671] [DEBUG] [LOCAL ] SEM: Primary data saved (43469 records). [2025-10-23T23:43:05.573826] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-23T23:43:05.573938] [INFO ] [MAIN ] Update Progress: 1892/2367 symbols completed. SEM took 29.3s. Estimated remaining: 1h 1m 1s. Rate: 7.8 symbols/min [2025-10-23T23:43:05.604555] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-23T23:43:05.745928] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:05.753021] [DEBUG] [LOCAL ] SFB: Loaded 3697 existing records from primary storage. [2025-10-23T23:43:05.753258] [INFO ] [MAIN ] SFB: Loaded 3697 existing records. [2025-10-23T23:43:05.933833] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:05.934264] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-23T23:43:05.934424] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-23T23:43:05.934761] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-23T23:43:05.934892] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-23T23:43:06.250146] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-23T23:43:06.329015] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:06.399392] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-23T23:43:06.988277] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-23T23:43:07.199426] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-23T23:43:07.675551] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-23T23:43:07.999445] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-23T23:43:08.122841] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-23T23:43:08.799433] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-23T23:43:09.538073] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-23T23:43:09.604530] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-23T23:43:09.611010] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:43:10.399512] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-23T23:43:11.199496] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-23T23:43:11.729076] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-23T23:43:11.845843] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-23T23:43:11.881600] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T23:43:11.999484] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-23T23:43:12.328146] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-23T23:43:12.799499] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-23T23:43:13.599492] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-23T23:43:14.106068] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T23:43:14.399456] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-23T23:43:14.956672] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-23T23:43:15.199517] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-23T23:43:15.750557] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-23T23:43:15.999443] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-23T23:43:16.496426] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-23T23:43:16.504331] [INFO ] [REMOTE ] SEMR: Full fetch complete (60675 records). [2025-10-23T23:43:16.504503] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-23T23:43:16.808537] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-23T23:43:16.906006] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-23T23:43:16.906133] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-23T23:43:16.907197] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-23T23:43:16.907281] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-23T23:43:16.908682] [DEBUG] [LOCAL ] SEMR: Trimmed 60675 records to 42346 (keeping 200 days of data) [2025-10-23T23:43:17.148219] [DEBUG] [LOCAL ] SEMR: Primary data saved (42346 records). [2025-10-23T23:43:17.148461] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-23T23:43:17.148593] [INFO ] [MAIN ] Update Progress: 1893/2367 symbols completed. SEMR took 36.8s. Estimated remaining: 1h 0m 54s. Rate: 7.8 symbols/min [2025-10-23T23:43:17.320521] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:17.345438] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T23:43:17.371207] [DEBUG] [LOCAL ] SFBS: Loaded 21398 existing records from primary storage. [2025-10-23T23:43:17.371486] [INFO ] [MAIN ] SFBS: Loaded 21398 existing records. [2025-10-23T23:43:17.549384] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:17.549664] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-23T23:43:17.549745] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-23T23:43:17.549918] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-23T23:43:17.549987] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-23T23:43:17.612284] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-23T23:43:17.900753] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:18.175151] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-23T23:43:18.399452] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-23T23:43:18.947675] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-23T23:43:18.985715] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-23T23:43:19.199433] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-23T23:43:19.999469] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-23T23:43:20.598895] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-23T23:43:20.799491] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-23T23:43:21.289932] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-23T23:43:21.291134] [INFO ] [REMOTE ] SFB: Full fetch complete (5754 records). [2025-10-23T23:43:21.291236] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-23T23:43:21.621836] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-23T23:43:21.667559] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-23T23:43:21.709484] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-23T23:43:21.710198] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-23T23:43:21.710600] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-23T23:43:21.710743] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-23T23:43:21.712224] [DEBUG] [LOCAL ] SFB: Trimmed 5754 records to 3706 (keeping 200 days of data) [2025-10-23T23:43:21.736994] [DEBUG] [LOCAL ] SFB: Primary data saved (3706 records). [2025-10-23T23:43:21.737154] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-23T23:43:21.737267] [INFO ] [MAIN ] Update Progress: 1894/2367 symbols completed. SFB took 16.2s. Estimated remaining: 1h 0m 46s. Rate: 7.8 symbols/min [2025-10-23T23:43:21.906758] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:21.943866] [DEBUG] [LOCAL ] SFL: Loaded 45244 existing records from primary storage. [2025-10-23T23:43:21.944198] [INFO ] [MAIN ] SFL: Loaded 45244 existing records. [2025-10-23T23:43:22.116739] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:22.116964] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-23T23:43:22.117039] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-23T23:43:22.117351] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-23T23:43:22.117442] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-23T23:43:22.404567] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-23T23:43:22.471755] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:22.714991] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-23T23:43:23.199490] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-23T23:43:23.999462] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-23T23:43:24.701441] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T23:43:24.799413] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-23T23:43:25.062879] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-23T23:43:25.073062] [INFO ] [REMOTE ] SES: Full fetch complete (75646 records). [2025-10-23T23:43:25.073236] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-23T23:43:25.420619] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T23:43:25.532611] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-23T23:43:25.532746] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-23T23:43:25.533901] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-23T23:43:25.533979] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-23T23:43:25.535472] [DEBUG] [LOCAL ] SES: Trimmed 75646 records to 52003 (keeping 200 days of data) [2025-10-23T23:43:25.616893] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-23T23:43:25.828880] [DEBUG] [LOCAL ] SES: Primary data saved (52003 records). [2025-10-23T23:43:25.829039] [INFO ] [MAIN ] SES: Full history saved. [2025-10-23T23:43:25.830197] [INFO ] [MAIN ] Update Progress: 1895/2367 symbols completed. SES took 38.0s. Estimated remaining: 1h 0m 37s. Rate: 7.8 symbols/min [2025-10-23T23:43:25.999459] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:26.052884] [DEBUG] [LOCAL ] SG: Loaded 53505 existing records from primary storage. [2025-10-23T23:43:26.053256] [INFO ] [MAIN ] SG: Loaded 53505 existing records. [2025-10-23T23:43:26.234943] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:26.235545] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-23T23:43:26.235621] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-23T23:43:26.236284] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-23T23:43:26.236358] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-23T23:43:26.411059] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-23T23:43:26.546225] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-23T23:43:26.636215] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:26.646598] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-23T23:43:27.199439] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-23T23:43:27.992681] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-23T23:43:27.999624] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-23T23:43:28.001319] [INFO ] [REMOTE ] SF: Full fetch complete (60465 records). [2025-10-23T23:43:28.001527] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-23T23:43:28.389491] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-23T23:43:28.389620] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-23T23:43:28.390751] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-23T23:43:28.390842] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-23T23:43:28.392232] [DEBUG] [LOCAL ] SF: Trimmed 60465 records to 41695 (keeping 200 days of data) [2025-10-23T23:43:28.637389] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-23T23:43:28.693634] [DEBUG] [LOCAL ] SF: Primary data saved (41695 records). [2025-10-23T23:43:28.693824] [INFO ] [MAIN ] SF: Full history saved. [2025-10-23T23:43:28.693941] [INFO ] [MAIN ] Update Progress: 1896/2367 symbols completed. SF took 36.4s. Estimated remaining: 1h 0m 28s. Rate: 7.8 symbols/min [2025-10-23T23:43:28.804551] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-23T23:43:28.870354] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:28.912049] [DEBUG] [LOCAL ] SGHC: Loaded 47310 existing records from primary storage. [2025-10-23T23:43:28.912366] [INFO ] [MAIN ] SGHC: Loaded 47310 existing records. [2025-10-23T23:43:29.090068] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:29.090397] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-23T23:43:29.090475] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-23T23:43:29.091022] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-23T23:43:29.091097] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-23T23:43:29.254493] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-23T23:43:29.463226] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:29.599408] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-23T23:43:30.404607] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-23T23:43:30.421146] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T23:43:30.881130] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T23:43:31.199440] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-23T23:43:31.999438] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-23T23:43:32.149884] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-23T23:43:32.255787] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T23:43:32.799436] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-23T23:43:32.901301] [DEBUG] [REMOTE ] SFL: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-23T23:43:32.901626] [WARN ] [REMOTE ] SFL: No data returned for month 2025-05 [2025-10-23T23:43:32.901735] [FATAL] [REMOTE ] SFL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:43:32.901819] [FATAL] [MAIN ] SFL: Failed to fetch primary data. [2025-10-23T23:43:32.901883] [WARN ] [MAIN ] SFL: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:43:32.901958] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-23T23:43:32.902052] [DEBUG] [LOCAL ] SFL: No primary data file found to delete. [2025-10-23T23:43:32.902122] [INFO ] [LOCAL ] SFL: Starting deletion of derivative data. [2025-10-23T23:43:32.902301] [DEBUG] [LOCAL ] SFL: Deleted derivative data file. [2025-10-23T23:43:32.902418] [INFO ] [MAIN ] Update Progress: 1897/2367 symbols completed. SFL took 11.2s. Estimated remaining: 1h 0m 19s. Rate: 7.8 symbols/min [2025-10-23T23:43:33.086027] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:33.086221] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-23T23:43:33.086299] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-23T23:43:33.086418] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-23T23:43:33.086500] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-23T23:43:33.086580] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-23T23:43:33.086675] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-23T23:43:33.468506] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T23:43:33.519680] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:33.599419] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-10-23T23:43:33.791959] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:43:33.792305] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-10-23T23:43:33.792393] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:43:33.792471] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-23T23:43:33.792540] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:43:33.792615] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-23T23:43:33.792731] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-23T23:43:33.792803] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-23T23:43:33.792906] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-23T23:43:33.792992] [INFO ] [MAIN ] Update Progress: 1898/2367 symbols completed. SGI took 0.9s. Estimated remaining: 1h 0m 10s. Rate: 7.8 symbols/min [2025-10-23T23:43:33.966124] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:33.974283] [DEBUG] [LOCAL ] SGU: Loaded 6507 existing records from primary storage. [2025-10-23T23:43:33.974499] [INFO ] [MAIN ] SGU: Loaded 6507 existing records. [2025-10-23T23:43:34.151212] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:34.151422] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-23T23:43:34.151495] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-23T23:43:34.151711] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-23T23:43:34.151784] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-23T23:43:34.404540] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-23T23:43:34.504592] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:35.199450] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-23T23:43:35.903957] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-23T23:43:35.999418] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-23T23:43:36.129677] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T23:43:36.799487] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-23T23:43:37.405310] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T23:43:37.599463] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-23T23:43:37.764885] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-23T23:43:38.399510] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-23T23:43:39.076722] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-23T23:43:39.199464] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-23T23:43:39.503547] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-23T23:43:39.999436] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-23T23:43:40.799551] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-23T23:43:41.027092] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T23:43:41.428361] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T23:43:41.563044] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T23:43:41.599422] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-23T23:43:42.259848] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-23T23:43:42.399462] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-23T23:43:43.004190] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T23:43:43.199458] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-23T23:43:43.953305] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T23:43:43.999417] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-23T23:43:44.799410] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-23T23:43:45.599442] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-23T23:43:45.815679] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T23:43:45.918338] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T23:43:46.283339] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-23T23:43:46.399418] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-23T23:43:47.199478] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-23T23:43:47.962555] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T23:43:47.994849] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-23T23:43:47.999389] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-23T23:43:48.799525] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-23T23:43:49.599419] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-23T23:43:49.773633] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-23T23:43:50.295831] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-23T23:43:50.399421] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-23T23:43:50.475033] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T23:43:51.199449] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-23T23:43:51.430242] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T23:43:51.999488] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-23T23:43:52.799453] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-23T23:43:52.924259] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T23:43:53.017453] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T23:43:53.599492] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-23T23:43:54.399424] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-23T23:43:54.629047] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-23T23:43:54.663205] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T23:43:55.199487] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-23T23:43:55.922490] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-23T23:43:55.923954] [INFO ] [REMOTE ] SGU: Full fetch complete (8899 records). [2025-10-23T23:43:55.924073] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-23T23:43:56.007134] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-23T23:43:56.351334] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-23T23:43:56.354299] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-23T23:43:56.354610] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-23T23:43:56.355326] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-23T23:43:56.356368] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T23:43:56.368023] [DEBUG] [LOCAL ] SGU: Trimmed 8899 records to 6520 (keeping 200 days of data) [2025-10-23T23:43:56.409663] [DEBUG] [LOCAL ] SGU: Primary data saved (6520 records). [2025-10-23T23:43:56.409833] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-23T23:43:56.409947] [INFO ] [MAIN ] Update Progress: 1899/2367 symbols completed. SGU took 22.6s. Estimated remaining: 1h 0m 6s. Rate: 7.8 symbols/min [2025-10-23T23:43:56.576175] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:56.618864] [DEBUG] [LOCAL ] SHAK: Loaded 48652 existing records from primary storage. [2025-10-23T23:43:56.619228] [INFO ] [MAIN ] SHAK: Loaded 48652 existing records. [2025-10-23T23:43:56.794422] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:43:56.794722] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-23T23:43:56.794805] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-23T23:43:56.795058] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-23T23:43:56.795139] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-23T23:43:56.806318] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-23T23:43:57.165864] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:57.178837] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T23:43:57.183305] [INFO ] [REMOTE ] SFBS: Full fetch complete (30642 records). [2025-10-23T23:43:57.183420] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-23T23:43:57.550192] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-23T23:43:57.550304] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-23T23:43:57.551067] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-23T23:43:57.551146] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-23T23:43:57.551901] [DEBUG] [LOCAL ] SFBS: Trimmed 30642 records to 21618 (keeping 200 days of data) [2025-10-23T23:43:57.604618] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-23T23:43:57.689739] [DEBUG] [LOCAL ] SFBS: Primary data saved (21618 records). [2025-10-23T23:43:57.689923] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-23T23:43:57.690063] [INFO ] [MAIN ] Update Progress: 1900/2367 symbols completed. SFBS took 40.5s. Estimated remaining: 59m 57s. Rate: 7.8 symbols/min [2025-10-23T23:43:57.864637] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:43:57.864853] [DEBUG] [LOCAL ] SHCO: No existing data file found in primary storage. [2025-10-23T23:43:57.864925] [WARN ] [MAIN ] SHCO: No existing data found, performing full refresh instead. [2025-10-23T23:43:57.865036] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-23T23:43:57.865107] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-23T23:43:57.865201] [DEBUG] [LOCAL ] SHCO: No primary data file found to delete. [2025-10-23T23:43:57.865271] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-23T23:43:58.233095] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:43:58.399421] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-23T23:43:59.042068] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-23T23:43:59.084796] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-23T23:43:59.094198] [INFO ] [REMOTE ] SGHC: Full fetch complete (65783 records). [2025-10-23T23:43:59.094407] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-23T23:43:59.199852] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-23T23:43:59.399519] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-23T23:43:59.520919] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-23T23:43:59.521040] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-23T23:43:59.522316] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-23T23:43:59.522399] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-23T23:43:59.523724] [DEBUG] [LOCAL ] SGHC: Trimmed 65783 records to 47651 (keeping 200 days of data) [2025-10-23T23:43:59.807433] [DEBUG] [LOCAL ] SGHC: Primary data saved (47651 records). [2025-10-23T23:43:59.807610] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-23T23:43:59.807787] [INFO ] [MAIN ] Update Progress: 1901/2367 symbols completed. SGHC took 31.1s. Estimated remaining: 59m 48s. Rate: 7.8 symbols/min [2025-10-23T23:43:59.976736] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:00.004312] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-23T23:44:00.026911] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-23T23:44:00.027259] [INFO ] [MAIN ] SHEL: Loaded 53675 existing records. [2025-10-23T23:44:00.204056] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:00.204272] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-23T23:44:00.204347] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-23T23:44:00.204566] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-23T23:44:00.204638] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-23T23:44:00.561823] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:00.799433] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-23T23:44:00.997088] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T23:44:01.599451] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-23T23:44:02.050440] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-23T23:44:02.399477] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-23T23:44:03.199420] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-23T23:44:03.519939] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-23T23:44:03.999428] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-23T23:44:04.287670] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-23T23:44:04.579029] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-23T23:44:04.799426] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-23T23:44:05.194137] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-23T23:44:05.599441] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-23T23:44:05.948879] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-23T23:44:06.399413] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-23T23:44:06.666422] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-23T23:44:06.728176] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T23:44:07.199435] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-23T23:44:07.999433] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-23T23:44:08.163270] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-23T23:44:08.393125] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T23:44:08.799443] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-23T23:44:09.599395] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-23T23:44:09.926842] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-23T23:44:09.926004] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-23T23:44:09.940742] [INFO ] [REMOTE ] SG: Full fetch complete (77483 records). [2025-10-23T23:44:09.940911] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-23T23:44:10.331302] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-23T23:44:10.331421] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-23T23:44:10.332622] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-23T23:44:10.332720] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-23T23:44:10.334133] [DEBUG] [LOCAL ] SG: Trimmed 77483 records to 53894 (keeping 200 days of data) [2025-10-23T23:44:10.420154] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-23T23:44:10.646145] [DEBUG] [LOCAL ] SG: Primary data saved (53894 records). [2025-10-23T23:44:10.646300] [INFO ] [MAIN ] SG: Full history saved. [2025-10-23T23:44:10.647716] [INFO ] [MAIN ] Update Progress: 1902/2367 symbols completed. SG took 44.8s. Estimated remaining: 59m 41s. Rate: 7.8 symbols/min [2025-10-23T23:44:10.813852] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:10.839820] [DEBUG] [LOCAL ] SHG: Loaded 26653 existing records from primary storage. [2025-10-23T23:44:10.840150] [INFO ] [MAIN ] SHG: Loaded 26653 existing records. [2025-10-23T23:44:11.026464] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:11.027520] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-23T23:44:11.027622] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-23T23:44:11.028449] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-23T23:44:11.028541] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-23T23:44:11.209270] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-23T23:44:11.401780] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:11.451636] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T23:44:11.999415] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-23T23:44:12.337540] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-23T23:44:12.338837] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T23:44:12.799463] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-23T23:44:13.480252] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T23:44:13.599404] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-23T23:44:14.159874] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T23:44:14.399487] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-23T23:44:15.204045] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-23T23:44:15.209574] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:44:15.766232] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T23:44:15.999439] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-23T23:44:16.553410] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-23T23:44:16.799449] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-23T23:44:17.599465] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-23T23:44:17.822464] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T23:44:18.399399] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-23T23:44:18.956529] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-23T23:44:18.986567] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-23T23:44:19.199446] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-23T23:44:19.456752] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-23T23:44:19.999482] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-23T23:44:20.426001] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-23T23:44:20.808679] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-23T23:44:20.812274] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T23:44:21.599472] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-23T23:44:22.399410] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-23T23:44:22.775272] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-23T23:44:22.780523] [INFO ] [REMOTE ] SHCO: Full fetch complete (37748 records). [2025-10-23T23:44:22.780774] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-23T23:44:23.170125] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-23T23:44:23.170271] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-23T23:44:23.171196] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-23T23:44:23.171439] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-23T23:44:23.200287] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-23T23:44:23.204400] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-23T23:44:23.201047] [DEBUG] [LOCAL ] SHCO: Trimmed 37748 records to 25438 (keeping 200 days of data) [2025-10-23T23:44:23.354406] [DEBUG] [LOCAL ] SHCO: Primary data saved (25438 records). [2025-10-23T23:44:23.354566] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-23T23:44:23.354694] [INFO ] [MAIN ] Update Progress: 1903/2367 symbols completed. SHCO took 25.7s. Estimated remaining: 59m 34s. Rate: 7.8 symbols/min [2025-10-23T23:44:23.524574] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:23.566128] [DEBUG] [LOCAL ] SHO: Loaded 49127 existing records from primary storage. [2025-10-23T23:44:23.566475] [INFO ] [MAIN ] SHO: Loaded 49127 existing records. [2025-10-23T23:44:23.743503] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:23.743780] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-23T23:44:23.743920] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-23T23:44:23.744269] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-23T23:44:23.744383] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-23T23:44:24.002829] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-23T23:44:24.127394] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-23T23:44:24.149427] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:24.764188] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-23T23:44:24.799411] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-23T23:44:25.599446] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-23T23:44:26.191691] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-23T23:44:26.399444] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-23T23:44:26.487517] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T23:44:26.495963] [INFO ] [REMOTE ] SHAK: Full fetch complete (71271 records). [2025-10-23T23:44:26.496140] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-23T23:44:26.931210] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-23T23:44:26.931361] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-23T23:44:26.933556] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-23T23:44:26.935335] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-23T23:44:26.935511] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-23T23:44:26.946729] [DEBUG] [LOCAL ] SHAK: Trimmed 71271 records to 49001 (keeping 200 days of data) [2025-10-23T23:44:27.203122] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-23T23:44:27.234794] [DEBUG] [LOCAL ] SHAK: Primary data saved (49001 records). [2025-10-23T23:44:27.234938] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-23T23:44:27.235282] [INFO ] [MAIN ] Update Progress: 1904/2367 symbols completed. SHAK took 30.8s. Estimated remaining: 59m 26s. Rate: 7.8 symbols/min [2025-10-23T23:44:27.408513] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:27.413732] [DEBUG] [LOCAL ] SHOC: Loaded 3016 existing records from primary storage. [2025-10-23T23:44:27.413912] [INFO ] [MAIN ] SHOC: Loaded 3016 existing records. [2025-10-23T23:44:27.587559] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:27.587953] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-23T23:44:27.593214] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-23T23:44:27.602146] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-23T23:44:27.603210] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T23:44:27.602713] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-23T23:44:27.966051] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:27.999402] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-23T23:44:28.724395] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-23T23:44:28.769875] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:44:28.799414] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-23T23:44:29.599445] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-23T23:44:30.322597] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:44:30.399423] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-23T23:44:30.932673] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-23T23:44:31.200128] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-23T23:44:31.793041] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-23T23:44:31.999427] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-23T23:44:32.499495] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-23T23:44:32.771145] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T23:44:32.799451] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-23T23:44:33.415398] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-23T23:44:33.599457] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-23T23:44:34.047764] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T23:44:34.399458] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-23T23:44:35.199458] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-23T23:44:35.740109] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-23T23:44:35.999468] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-23T23:44:36.600232] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-23T23:44:36.799494] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-23T23:44:37.314058] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-23T23:44:37.599484] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-23T23:44:38.399509] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-23T23:44:38.739706] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T23:44:38.786128] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T23:44:38.795673] [INFO ] [REMOTE ] SHEL: Full fetch complete (77838 records). [2025-10-23T23:44:38.795852] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-23T23:44:38.903766] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-23T23:44:39.201819] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-23T23:44:39.201295] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-23T23:44:39.202151] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-23T23:44:39.204850] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-23T23:44:39.205047] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-23T23:44:39.207059] [DEBUG] [LOCAL ] SHEL: Trimmed 77838 records to 54065 (keeping 200 days of data) [2025-10-23T23:44:39.540481] [DEBUG] [LOCAL ] SHEL: Primary data saved (54065 records). [2025-10-23T23:44:39.540673] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-23T23:44:39.540783] [INFO ] [MAIN ] Update Progress: 1905/2367 symbols completed. SHEL took 39.7s. Estimated remaining: 59m 19s. Rate: 7.8 symbols/min [2025-10-23T23:44:39.710006] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:39.738901] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-23T23:44:39.759242] [DEBUG] [LOCAL ] SHW: Loaded 50382 existing records from primary storage. [2025-10-23T23:44:39.759604] [INFO ] [MAIN ] SHW: Loaded 50382 existing records. [2025-10-23T23:44:39.939711] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:39.939960] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-23T23:44:39.940037] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-23T23:44:39.940304] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-23T23:44:39.940381] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-23T23:44:40.009982] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-23T23:44:40.321595] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:40.799484] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-23T23:44:41.599443] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-23T23:44:41.668573] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-23T23:44:42.399458] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-23T23:44:42.801876] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-23T23:44:43.008514] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-23T23:44:43.199445] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-23T23:44:43.999418] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-23T23:44:44.137704] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:44:44.487065] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T23:44:44.492697] [INFO ] [REMOTE ] SHG: Full fetch complete (41373 records). [2025-10-23T23:44:44.492822] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-23T23:44:44.804546] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-23T23:44:44.869628] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-23T23:44:44.869757] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-23T23:44:44.870618] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-23T23:44:44.870732] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-23T23:44:44.871825] [DEBUG] [LOCAL ] SHG: Trimmed 41373 records to 26875 (keeping 200 days of data) [2025-10-23T23:44:45.031054] [DEBUG] [LOCAL ] SHG: Primary data saved (26875 records). [2025-10-23T23:44:45.031226] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-23T23:44:45.031342] [INFO ] [MAIN ] Update Progress: 1906/2367 symbols completed. SHG took 34.4s. Estimated remaining: 59m 11s. Rate: 7.8 symbols/min [2025-10-23T23:44:45.206292] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:45.206524] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-23T23:44:45.206598] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-23T23:44:45.206738] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-23T23:44:45.206812] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-23T23:44:45.206892] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-23T23:44:45.206964] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-23T23:44:45.556379] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:45.599409] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-10-23T23:44:45.794515] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:44:45.794908] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-10-23T23:44:45.795004] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:44:45.795061] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-23T23:44:45.795122] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:44:45.795191] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-23T23:44:45.795260] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-23T23:44:45.795333] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-23T23:44:45.795398] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-23T23:44:45.795482] [INFO ] [MAIN ] Update Progress: 1907/2367 symbols completed. SI took 0.8s. Estimated remaining: 59m 1s. Rate: 7.8 symbols/min [2025-10-23T23:44:45.969504] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:46.000293] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-23T23:44:46.041012] [DEBUG] [LOCAL ] SID: Loaded 42913 existing records from primary storage. [2025-10-23T23:44:46.041351] [INFO ] [MAIN ] SID: Loaded 42913 existing records. [2025-10-23T23:44:46.224676] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:46.224937] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-23T23:44:46.225022] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-23T23:44:46.225282] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-23T23:44:46.225370] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-23T23:44:46.403292] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-23T23:44:46.632710] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:46.667168] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-23T23:44:46.962779] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-23T23:44:47.199506] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-23T23:44:47.999442] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-23T23:44:48.799497] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-23T23:44:49.043866] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T23:44:49.600755] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-23T23:44:49.603545] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-23T23:44:50.185165] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-23T23:44:50.186575] [INFO ] [REMOTE ] SHOC: Full fetch complete (6714 records). [2025-10-23T23:44:50.186695] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-23T23:44:50.404623] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-23T23:44:50.582816] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-23T23:44:50.582980] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-23T23:44:50.583563] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-23T23:44:50.583819] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-23T23:44:50.614632] [DEBUG] [LOCAL ] SHOC: Trimmed 6714 records to 3025 (keeping 200 days of data) [2025-10-23T23:44:50.625738] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-23T23:44:50.646990] [DEBUG] [LOCAL ] SHOC: Primary data saved (3025 records). [2025-10-23T23:44:50.647572] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-23T23:44:50.647758] [INFO ] [MAIN ] Update Progress: 1908/2367 symbols completed. SHOC took 23.4s. Estimated remaining: 58m 53s. Rate: 7.8 symbols/min [2025-10-23T23:44:50.816570] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:44:50.855761] [DEBUG] [LOCAL ] SIG: Loaded 45345 existing records from primary storage. [2025-10-23T23:44:50.856113] [INFO ] [MAIN ] SIG: Loaded 45345 existing records. [2025-10-23T23:44:51.029629] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:44:51.029865] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-23T23:44:51.029946] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-23T23:44:51.030445] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-23T23:44:51.030518] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-23T23:44:51.204398] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-23T23:44:51.398313] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:44:51.872914] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-23T23:44:51.999433] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-23T23:44:52.754582] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T23:44:52.799404] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-23T23:44:53.429803] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T23:44:53.599450] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-23T23:44:54.076264] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T23:44:54.399431] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-23T23:44:55.199456] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-23T23:44:55.263465] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T23:44:55.708304] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-23T23:44:55.999436] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-23T23:44:56.799444] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-23T23:44:56.996564] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T23:44:57.596442] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-23T23:44:57.605912] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-23T23:44:57.957842] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T23:44:58.399489] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-23T23:44:59.204688] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-23T23:44:59.219222] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-23T23:44:59.999414] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-23T23:45:00.243554] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T23:45:00.799417] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-23T23:45:00.821157] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T23:45:00.832549] [INFO ] [REMOTE ] SHO: Full fetch complete (70732 records). [2025-10-23T23:45:00.832766] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-23T23:45:01.216318] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-23T23:45:01.216445] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-23T23:45:01.217587] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-23T23:45:01.217710] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-23T23:45:01.219128] [DEBUG] [LOCAL ] SHO: Trimmed 70732 records to 49414 (keeping 200 days of data) [2025-10-23T23:45:01.510900] [DEBUG] [LOCAL ] SHO: Primary data saved (49414 records). [2025-10-23T23:45:01.511086] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-23T23:45:01.511220] [INFO ] [MAIN ] Update Progress: 1909/2367 symbols completed. SHO took 38.2s. Estimated remaining: 58m 46s. Rate: 7.8 symbols/min [2025-10-23T23:45:01.605102] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-23T23:45:01.687457] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:01.712114] [DEBUG] [LOCAL ] SII: Loaded 24194 existing records from primary storage. [2025-10-23T23:45:01.712536] [INFO ] [MAIN ] SII: Loaded 24194 existing records. [2025-10-23T23:45:01.897862] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:01.898277] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-23T23:45:01.898372] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-23T23:45:01.898773] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-23T23:45:01.898898] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-23T23:45:02.257092] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-23T23:45:02.322880] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:02.403413] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-23T23:45:02.411716] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-23T23:45:03.199432] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-23T23:45:03.473103] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-23T23:45:03.999422] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-23T23:45:04.201251] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T23:45:04.615386] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-23T23:45:04.799419] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-23T23:45:05.599428] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-23T23:45:05.744190] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:45:06.399439] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-23T23:45:06.531697] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T23:45:06.667669] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T23:45:07.199431] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-23T23:45:07.999432] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-23T23:45:08.082172] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T23:45:08.799417] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-23T23:45:08.833543] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T23:45:08.943823] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T23:45:09.599423] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-23T23:45:10.399415] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-23T23:45:10.691028] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-23T23:45:10.794477] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T23:45:11.199436] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-23T23:45:11.999418] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-23T23:45:12.116232] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T23:45:12.125276] [INFO ] [REMOTE ] SHW: Full fetch complete (73360 records). [2025-10-23T23:45:12.125414] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-23T23:45:12.527283] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-23T23:45:12.527388] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-23T23:45:12.528599] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-23T23:45:12.528708] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-23T23:45:12.530161] [DEBUG] [LOCAL ] SHW: Trimmed 73360 records to 50760 (keeping 200 days of data) [2025-10-23T23:45:12.807097] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-23T23:45:12.847476] [DEBUG] [LOCAL ] SHW: Primary data saved (50760 records). [2025-10-23T23:45:12.847659] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-23T23:45:12.848492] [INFO ] [MAIN ] Update Progress: 1910/2367 symbols completed. SHW took 33.3s. Estimated remaining: 58m 39s. Rate: 7.8 symbols/min [2025-10-23T23:45:13.055802] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:13.057344] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T23:45:13.100208] [DEBUG] [LOCAL ] SILA: Loaded 29955 existing records from primary storage. [2025-10-23T23:45:13.100516] [INFO ] [MAIN ] SILA: Loaded 29955 existing records. [2025-10-23T23:45:13.283731] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:13.283932] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-23T23:45:13.284006] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-23T23:45:13.284242] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-23T23:45:13.284316] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-23T23:45:13.604566] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-23T23:45:13.667421] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:13.844744] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T23:45:13.920004] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-23T23:45:14.399467] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-23T23:45:15.199451] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-23T23:45:15.325944] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-23T23:45:15.668206] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-23T23:45:15.999516] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-23T23:45:16.777973] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T23:45:16.799410] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-23T23:45:17.223345] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-23T23:45:17.599460] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-23T23:45:18.251462] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T23:45:18.258991] [INFO ] [REMOTE ] SIG: Full fetch complete (67585 records). [2025-10-23T23:45:18.259148] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-23T23:45:18.409330] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-23T23:45:18.649922] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-23T23:45:18.650039] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-23T23:45:18.651319] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-23T23:45:18.651401] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-23T23:45:18.652701] [DEBUG] [LOCAL ] SIG: Trimmed 67585 records to 45589 (keeping 200 days of data) [2025-10-23T23:45:18.927345] [DEBUG] [LOCAL ] SIG: Primary data saved (45589 records). [2025-10-23T23:45:18.927507] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-23T23:45:18.927620] [INFO ] [MAIN ] Update Progress: 1911/2367 symbols completed. SIG took 28.3s. Estimated remaining: 58m 31s. Rate: 7.8 symbols/min [2025-10-23T23:45:19.118842] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:19.115714] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-23T23:45:19.160848] [DEBUG] [LOCAL ] SITC: Loaded 41703 existing records from primary storage. [2025-10-23T23:45:19.161173] [INFO ] [MAIN ] SITC: Loaded 41703 existing records. [2025-10-23T23:45:19.204582] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-23T23:45:19.364480] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:19.364707] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-23T23:45:19.364781] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-23T23:45:19.365047] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-23T23:45:19.365116] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-23T23:45:19.727960] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:19.999419] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-23T23:45:20.105279] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-23T23:45:20.113745] [INFO ] [REMOTE ] SID: Full fetch complete (61253 records). [2025-10-23T23:45:20.113913] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-23T23:45:20.528315] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-23T23:45:20.528478] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-23T23:45:20.530252] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-23T23:45:20.531462] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-23T23:45:20.531314] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T23:45:20.538171] [DEBUG] [LOCAL ] SID: Trimmed 61253 records to 43285 (keeping 200 days of data) [2025-10-23T23:45:20.770461] [DEBUG] [LOCAL ] SID: Primary data saved (43285 records). [2025-10-23T23:45:20.770611] [INFO ] [MAIN ] SID: Full history saved. [2025-10-23T23:45:20.771947] [INFO ] [MAIN ] Update Progress: 1912/2367 symbols completed. SID took 35.0s. Estimated remaining: 58m 22s. Rate: 7.8 symbols/min [2025-10-23T23:45:20.804135] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-23T23:45:20.950108] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:20.980060] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-23T23:45:21.022711] [DEBUG] [LOCAL ] SITE: Loaded 35501 existing records from primary storage. [2025-10-23T23:45:21.023006] [INFO ] [MAIN ] SITE: Loaded 35501 existing records. [2025-10-23T23:45:21.196603] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:21.196934] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-23T23:45:21.197011] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-23T23:45:21.197457] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-23T23:45:21.197530] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-23T23:45:21.551778] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:21.599405] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-23T23:45:21.950672] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T23:45:22.399500] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-23T23:45:22.524812] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T23:45:23.199402] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-23T23:45:23.342474] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-23T23:45:23.999412] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-23T23:45:24.386882] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-23T23:45:24.799480] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-23T23:45:25.301310] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T23:45:25.599426] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-23T23:45:25.796639] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T23:45:26.399460] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-23T23:45:27.000457] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T23:45:27.199417] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-23T23:45:27.606253] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-23T23:45:27.999457] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-23T23:45:28.440985] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T23:45:28.799446] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-23T23:45:29.445407] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-23T23:45:29.562230] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-23T23:45:29.599442] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-23T23:45:30.399427] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-23T23:45:30.640131] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-23T23:45:30.644849] [INFO ] [REMOTE ] SILA: Full fetch complete (44283 records). [2025-10-23T23:45:30.644959] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-23T23:45:31.014772] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-23T23:45:31.014903] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-23T23:45:31.015823] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-23T23:45:31.015900] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-23T23:45:31.016852] [DEBUG] [LOCAL ] SILA: Trimmed 44283 records to 30079 (keeping 200 days of data) [2025-10-23T23:45:31.191557] [DEBUG] [LOCAL ] SILA: Primary data saved (30079 records). [2025-10-23T23:45:31.191741] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-23T23:45:31.191834] [INFO ] [MAIN ] Update Progress: 1913/2367 symbols completed. SILA took 18.3s. Estimated remaining: 58m 15s. Rate: 7.8 symbols/min [2025-10-23T23:45:31.204558] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-23T23:45:31.359336] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:31.403495] [DEBUG] [LOCAL ] SJM: Loaded 50093 existing records from primary storage. [2025-10-23T23:45:31.404530] [INFO ] [MAIN ] SJM: Loaded 50093 existing records. [2025-10-23T23:45:31.583698] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:31.583978] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-23T23:45:31.584054] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-23T23:45:31.584407] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-23T23:45:31.584482] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-23T23:45:31.940112] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:31.963170] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T23:45:31.999403] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-23T23:45:32.430548] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T23:45:32.435390] [INFO ] [REMOTE ] SII: Full fetch complete (31610 records). [2025-10-23T23:45:32.435521] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-23T23:45:32.803716] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-23T23:45:32.815703] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-23T23:45:32.815979] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-23T23:45:32.817900] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-23T23:45:32.817992] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-23T23:45:32.819026] [DEBUG] [LOCAL ] SII: Trimmed 31610 records to 24307 (keeping 200 days of data) [2025-10-23T23:45:32.966842] [DEBUG] [LOCAL ] SII: Primary data saved (24307 records). [2025-10-23T23:45:32.967008] [INFO ] [MAIN ] SII: Full history saved. [2025-10-23T23:45:32.967118] [INFO ] [MAIN ] Update Progress: 1914/2367 symbols completed. SII took 31.5s. Estimated remaining: 58m 6s. Rate: 7.8 symbols/min [2025-10-23T23:45:33.137568] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:33.159757] [DEBUG] [LOCAL ] SJT: Loaded 22724 existing records from primary storage. [2025-10-23T23:45:33.160047] [INFO ] [MAIN ] SJT: Loaded 22724 existing records. [2025-10-23T23:45:33.340523] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:33.341051] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-23T23:45:33.341227] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-23T23:45:33.341601] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-23T23:45:33.341721] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-23T23:45:33.615002] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-23T23:45:33.652308] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-23T23:45:33.740250] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:34.075183] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T23:45:34.399462] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-23T23:45:35.199410] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-23T23:45:35.291584] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-23T23:45:35.341835] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-23T23:45:35.999480] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-23T23:45:36.809588] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-23T23:45:36.813026] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T23:45:37.233227] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-23T23:45:37.599414] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-23T23:45:37.885444] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-23T23:45:38.399428] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-23T23:45:38.829825] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-23T23:45:39.199530] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-23T23:45:39.670320] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-23T23:45:39.999419] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-23T23:45:40.364262] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-23T23:45:40.799480] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-23T23:45:41.599410] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-23T23:45:41.800600] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:45:42.080176] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-23T23:45:42.399486] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-23T23:45:42.807707] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T23:45:43.050963] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-23T23:45:43.199442] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-23T23:45:43.999456] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-23T23:45:44.623899] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T23:45:44.799408] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-23T23:45:45.270407] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-23T23:45:45.599477] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-23T23:45:46.347792] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-23T23:45:46.399419] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-23T23:45:46.945103] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-23T23:45:47.199447] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-23T23:45:47.999427] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-23T23:45:48.377667] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-23T23:45:48.615902] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-23T23:45:48.742202] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T23:45:48.799453] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-23T23:45:49.599414] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-23T23:45:49.859268] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T23:45:50.399442] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-23T23:45:51.014029] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T23:45:51.199433] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-23T23:45:51.999407] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-23T23:45:52.215917] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-23T23:45:52.443377] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-23T23:45:52.799456] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-23T23:45:53.404929] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T23:45:53.599441] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-23T23:45:53.840616] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-23T23:45:54.399463] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-23T23:45:55.211121] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-23T23:45:55.214246] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T23:45:55.999439] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-23T23:45:56.280309] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-23T23:45:56.286583] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T23:45:56.302212] [INFO ] [REMOTE ] SJT: Full fetch complete (31919 records). [2025-10-23T23:45:56.302370] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-23T23:45:56.663503] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-23T23:45:56.663612] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-23T23:45:56.664298] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-23T23:45:56.664381] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-23T23:45:56.665186] [DEBUG] [LOCAL ] SJT: Trimmed 31919 records to 22795 (keeping 200 days of data) [2025-10-23T23:45:56.787562] [DEBUG] [LOCAL ] SJT: Primary data saved (22795 records). [2025-10-23T23:45:56.787753] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-23T23:45:56.787885] [INFO ] [MAIN ] Update Progress: 1915/2367 symbols completed. SJT took 23.8s. Estimated remaining: 58m 2s. Rate: 7.8 symbols/min [2025-10-23T23:45:56.808374] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-23T23:45:56.957246] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:56.993409] [DEBUG] [LOCAL ] SKE: Loaded 37318 existing records from primary storage. [2025-10-23T23:45:56.993814] [INFO ] [MAIN ] SKE: Loaded 37318 existing records. [2025-10-23T23:45:57.170744] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:57.170998] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-23T23:45:57.171094] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-23T23:45:57.171405] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-23T23:45:57.171491] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-23T23:45:57.563704] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T23:45:57.562112] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:57.571219] [INFO ] [REMOTE ] SITE: Full fetch complete (50803 records). [2025-10-23T23:45:57.571355] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-23T23:45:57.604500] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-23T23:45:57.947305] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-23T23:45:57.947424] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-23T23:45:57.948439] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-23T23:45:57.948519] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-23T23:45:57.949677] [DEBUG] [LOCAL ] SITE: Trimmed 50803 records to 35740 (keeping 200 days of data) [2025-10-23T23:45:58.168108] [DEBUG] [LOCAL ] SITE: Primary data saved (35740 records). [2025-10-23T23:45:58.168296] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-23T23:45:58.168409] [INFO ] [MAIN ] Update Progress: 1916/2367 symbols completed. SITE took 37.4s. Estimated remaining: 57m 53s. Rate: 7.8 symbols/min [2025-10-23T23:45:58.342779] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:45:58.352102] [DEBUG] [LOCAL ] SKIL: Loaded 6902 existing records from primary storage. [2025-10-23T23:45:58.352334] [INFO ] [MAIN ] SKIL: Loaded 6902 existing records. [2025-10-23T23:45:58.415510] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-23T23:45:58.548826] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:45:58.558296] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-23T23:45:58.558396] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-23T23:45:58.560174] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-23T23:45:58.560106] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-23T23:45:58.560411] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-23T23:45:58.924663] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:45:59.199447] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-23T23:45:59.466776] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-23T23:45:59.601866] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T23:45:59.836184] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-23T23:45:59.999443] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-23T23:46:00.742716] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-23T23:46:00.799446] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-23T23:46:01.599446] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-23T23:46:02.064419] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-23T23:46:02.399435] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-23T23:46:03.199444] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-23T23:46:03.252124] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T23:46:03.253694] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T23:46:03.999425] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-23T23:46:04.624125] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-23T23:46:04.799455] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-23T23:46:05.551707] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-23T23:46:05.559136] [INFO ] [REMOTE ] SITC: Full fetch complete (60686 records). [2025-10-23T23:46:05.559265] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-23T23:46:05.605929] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-23T23:46:05.948822] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-23T23:46:05.948934] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-23T23:46:05.950002] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-23T23:46:05.950081] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-23T23:46:05.951321] [DEBUG] [LOCAL ] SITC: Trimmed 60686 records to 42011 (keeping 200 days of data) [2025-10-23T23:46:06.190307] [DEBUG] [LOCAL ] SITC: Primary data saved (42011 records). [2025-10-23T23:46:06.190465] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-23T23:46:06.190576] [INFO ] [MAIN ] Update Progress: 1917/2367 symbols completed. SITC took 47.3s. Estimated remaining: 57m 45s. Rate: 7.8 symbols/min [2025-10-23T23:46:06.398922] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T23:46:06.406354] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-23T23:46:07.048978] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T23:46:07.199416] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-23T23:46:07.404861] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T23:46:07.831518] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-23T23:46:07.999435] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-23T23:46:08.746145] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-23T23:46:08.799451] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-23T23:46:09.599511] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-23T23:46:09.624309] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T23:46:10.399492] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-23T23:46:10.963669] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T23:46:11.199509] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-23T23:46:11.788866] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-23T23:46:11.999429] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-23T23:46:12.081835] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-23T23:46:12.090495] [INFO ] [REMOTE ] SJM: Full fetch complete (72322 records). [2025-10-23T23:46:12.090719] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-23T23:46:12.520953] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-23T23:46:12.521080] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-23T23:46:12.522480] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-23T23:46:12.522581] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-23T23:46:12.524316] [DEBUG] [LOCAL ] SJM: Trimmed 72322 records to 50444 (keeping 200 days of data) [2025-10-23T23:46:12.751302] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-23T23:46:12.805688] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-23T23:46:12.843724] [DEBUG] [LOCAL ] SJM: Primary data saved (50444 records). [2025-10-23T23:46:12.844305] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-23T23:46:12.845425] [INFO ] [MAIN ] Update Progress: 1918/2367 symbols completed. SJM took 41.7s. Estimated remaining: 57m 37s. Rate: 7.8 symbols/min [2025-10-23T23:46:13.599434] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-23T23:46:13.742372] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T23:46:13.746010] [INFO ] [REMOTE ] SKIL: Full fetch complete (10471 records). [2025-10-23T23:46:13.746117] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-23T23:46:14.148734] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-23T23:46:14.148851] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-23T23:46:14.149106] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-23T23:46:14.149174] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-23T23:46:14.149693] [DEBUG] [LOCAL ] SKIL: Trimmed 10471 records to 6988 (keeping 200 days of data) [2025-10-23T23:46:14.189326] [DEBUG] [LOCAL ] SKIL: Primary data saved (6988 records). [2025-10-23T23:46:14.189516] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-23T23:46:14.189688] [INFO ] [MAIN ] Update Progress: 1919/2367 symbols completed. SKIL took 16.0s. Estimated remaining: 57m 28s. Rate: 7.8 symbols/min [2025-10-23T23:46:14.923731] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T23:46:14.930976] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-23T23:46:16.396354] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T23:46:16.404570] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-23T23:46:17.786012] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-23T23:46:17.793309] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-23T23:46:19.447253] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T23:46:19.456172] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-23T23:46:21.199527] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-23T23:46:21.208329] [INFO ] [REMOTE ] SKE: Full fetch complete (52583 records). [2025-10-23T23:46:21.208545] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-23T23:46:21.624196] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-23T23:46:21.624352] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-23T23:46:21.625375] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-23T23:46:21.625455] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-23T23:46:21.626608] [DEBUG] [LOCAL ] SKE: Trimmed 52583 records to 37582 (keeping 200 days of data) [2025-10-23T23:46:21.842556] [DEBUG] [LOCAL ] SKE: Primary data saved (37582 records). [2025-10-23T23:46:21.842743] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-23T23:46:21.842856] [INFO ] [MAIN ] Update Progress: 1920/2367 symbols completed. SKE took 25.1s. Estimated remaining: 57m 20s. Rate: 7.8 symbols/min [2025-10-23T23:46:22.419410] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:22.564526] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:22.615598] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:22.618143] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:22.648402] [DEBUG] [LOCAL ] SKLZ: Loaded 11463 existing records from primary storage. [2025-10-23T23:46:22.648914] [INFO ] [MAIN ] SKLZ: Loaded 11463 existing records. [2025-10-23T23:46:22.779196] [DEBUG] [LOCAL ] SKT: Loaded 42303 existing records from primary storage. [2025-10-23T23:46:22.796384] [INFO ] [MAIN ] SKT: Loaded 42303 existing records. [2025-10-23T23:46:22.988591] [DEBUG] [LOCAL ] SKY: Loaded 38578 existing records from primary storage. [2025-10-23T23:46:22.989780] [DEBUG] [LOCAL ] SKM: Loaded 35160 existing records from primary storage. [2025-10-23T23:46:22.977326] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:23.020937] [INFO ] [MAIN ] SKY: Loaded 38578 existing records. [2025-10-23T23:46:23.020773] [INFO ] [MAIN ] SKM: Loaded 35160 existing records. [2025-10-23T23:46:23.088029] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-23T23:46:23.252089] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-23T23:46:23.283012] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:23.303869] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-23T23:46:23.332324] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-23T23:46:23.332787] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-23T23:46:23.333677] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-23T23:46:23.431938] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-23T23:46:23.461412] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-23T23:46:23.616483] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:23.712188] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-23T23:46:23.696498] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:23.734295] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-23T23:46:23.734541] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-23T23:46:23.767311] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-23T23:46:23.792277] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-23T23:46:23.827788] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-23T23:46:23.833130] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-23T23:46:23.944716] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-23T23:46:24.735935] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:24.800224] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-23T23:46:24.890802] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:24.911196] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-23T23:46:25.076907] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:25.092847] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-23T23:46:25.154711] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:25.155217] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-23T23:46:25.870690] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-23T23:46:25.874883] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-23T23:46:26.072142] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-23T23:46:26.079589] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-23T23:46:26.311947] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T23:46:26.317566] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-23T23:46:26.470754] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-23T23:46:26.479392] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-23T23:46:26.658445] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T23:46:26.661489] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-23T23:46:27.447068] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T23:46:27.450502] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-23T23:46:27.573219] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T23:46:27.582263] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-23T23:46:27.620240] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-23T23:46:27.626749] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-23T23:46:27.810834] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-23T23:46:27.818023] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-23T23:46:28.383036] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T23:46:28.386447] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-23T23:46:28.794587] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-23T23:46:28.803876] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-23T23:46:28.971783] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T23:46:29.196235] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T23:46:29.270782] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-23T23:46:29.599452] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-23T23:46:30.399492] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-23T23:46:30.530394] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-23T23:46:31.070443] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-23T23:46:31.199438] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-23T23:46:31.915705] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T23:46:31.999440] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-23T23:46:32.524598] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T23:46:32.799478] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-23T23:46:33.555801] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-23T23:46:33.600173] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-23T23:46:33.602302] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:46:34.399449] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-23T23:46:35.092907] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T23:46:35.199439] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-23T23:46:36.000002] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-23T23:46:36.002603] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-23T23:46:36.041268] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-23T23:46:36.799453] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-23T23:46:37.599462] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-23T23:46:37.680409] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T23:46:38.168528] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T23:46:38.221236] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T23:46:38.399457] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-23T23:46:39.199481] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-23T23:46:39.859300] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T23:46:39.999429] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-23T23:46:40.789508] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-23T23:46:40.799395] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-23T23:46:40.900564] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-23T23:46:41.599444] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-23T23:46:42.396500] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T23:46:42.399422] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-23T23:46:42.399603] [INFO ] [REMOTE ] SKLZ: Full fetch complete (17714 records). [2025-10-23T23:46:42.399956] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-23T23:46:42.551552] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:46:42.827123] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-23T23:46:42.827229] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-23T23:46:42.827662] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-23T23:46:42.830743] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-23T23:46:42.831375] [DEBUG] [LOCAL ] SKLZ: Trimmed 17714 records to 11598 (keeping 200 days of data) [2025-10-23T23:46:42.893455] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11598 records). [2025-10-23T23:46:42.893601] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-23T23:46:42.893729] [INFO ] [MAIN ] Update Progress: 1921/2367 symbols completed. SKLZ took 21.0s. Estimated remaining: 57m 16s. Rate: 7.8 symbols/min [2025-10-23T23:46:43.058374] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:43.074585] [DEBUG] [LOCAL ] SKYH: Loaded 15813 existing records from primary storage. [2025-10-23T23:46:43.074856] [INFO ] [MAIN ] SKYH: Loaded 15813 existing records. [2025-10-23T23:46:43.213834] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-23T23:46:43.254705] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:43.254871] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-23T23:46:43.254951] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-23T23:46:43.255177] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-23T23:46:43.255250] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-23T23:46:43.607628] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:43.849071] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T23:46:43.999454] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-23T23:46:44.717289] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-23T23:46:44.724353] [INFO ] [REMOTE ] SKY: Full fetch complete (54295 records). [2025-10-23T23:46:44.724469] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-23T23:46:44.800062] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-23T23:46:44.859102] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T23:46:45.123695] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-23T23:46:45.123801] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-23T23:46:45.124756] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-23T23:46:45.124832] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-23T23:46:45.125903] [DEBUG] [LOCAL ] SKY: Trimmed 54295 records to 38830 (keeping 200 days of data) [2025-10-23T23:46:45.346195] [DEBUG] [LOCAL ] SKY: Primary data saved (38830 records). [2025-10-23T23:46:45.346354] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-23T23:46:45.346473] [INFO ] [MAIN ] Update Progress: 1922/2367 symbols completed. SKY took 23.5s. Estimated remaining: 57m 7s. Rate: 7.8 symbols/min [2025-10-23T23:46:45.523895] [INFO ] [MAIN ] SLAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:45.524073] [DEBUG] [LOCAL ] SLAI: No existing data file found in primary storage. [2025-10-23T23:46:45.524143] [WARN ] [MAIN ] SLAI: No existing data found, performing full refresh instead. [2025-10-23T23:46:45.524268] [INFO ] [MAIN ] SLAI: Wiping existing primary data before full refresh. [2025-10-23T23:46:45.524343] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-23T23:46:45.524402] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-23T23:46:45.524473] [INFO ] [MAIN ] SLAI: Starting full primary refresh. [2025-10-23T23:46:45.604704] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-23T23:46:45.893930] [INFO ] [REMOTE ] SLAI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:46.408841] [INFO ] [REMOTE ] SLAI: Fetching primary data for 2025-01. [2025-10-23T23:46:46.413834] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-23T23:46:46.661216] [DEBUG] [REMOTE ] SLAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:46:46.661559] [WARN ] [REMOTE ] SLAI: No data returned for month 2025-01 [2025-10-23T23:46:46.661675] [FATAL] [REMOTE ] SLAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:46:46.661767] [FATAL] [MAIN ] SLAI: Failed to fetch primary data. [2025-10-23T23:46:46.661836] [WARN ] [MAIN ] SLAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:46:46.661909] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-23T23:46:46.661999] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-23T23:46:46.662071] [INFO ] [LOCAL ] SLAI: Starting deletion of derivative data. [2025-10-23T23:46:46.662192] [DEBUG] [LOCAL ] SLAI: No derivative data file found to delete. [2025-10-23T23:46:46.662278] [INFO ] [MAIN ] Update Progress: 1923/2367 symbols completed. SLAI took 1.3s. Estimated remaining: 56m 58s. Rate: 7.8 symbols/min [2025-10-23T23:46:46.845018] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:46.892793] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-23T23:46:46.893148] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-23T23:46:47.082907] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:47.098752] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-23T23:46:47.099760] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T23:46:47.099912] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-23T23:46:47.106226] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-23T23:46:47.106439] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-23T23:46:47.204516] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-23T23:46:47.472707] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:47.999439] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-23T23:46:48.657108] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T23:46:48.799491] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-23T23:46:48.813334] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T23:46:49.599480] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-23T23:46:50.398874] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T23:46:50.407080] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-23T23:46:50.620534] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:46:50.626985] [INFO ] [REMOTE ] SKM: Full fetch complete (49407 records). [2025-10-23T23:46:50.627101] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-23T23:46:50.995826] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-23T23:46:50.995935] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-23T23:46:50.996913] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-23T23:46:50.996991] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-23T23:46:50.998070] [DEBUG] [LOCAL ] SKM: Trimmed 49407 records to 35467 (keeping 200 days of data) [2025-10-23T23:46:51.199481] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-23T23:46:51.216526] [DEBUG] [LOCAL ] SKM: Primary data saved (35467 records). [2025-10-23T23:46:51.216787] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-23T23:46:51.216924] [INFO ] [MAIN ] Update Progress: 1924/2367 symbols completed. SKM took 29.4s. Estimated remaining: 56m 49s. Rate: 7.8 symbols/min [2025-10-23T23:46:51.393108] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:51.428781] [DEBUG] [LOCAL ] SLF: Loaded 38364 existing records from primary storage. [2025-10-23T23:46:51.429137] [INFO ] [MAIN ] SLF: Loaded 38364 existing records. [2025-10-23T23:46:51.617154] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:51.617369] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-23T23:46:51.617443] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-23T23:46:51.617936] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-23T23:46:51.618011] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-23T23:46:51.977562] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:51.999399] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-23T23:46:52.259862] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T23:46:52.799410] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-23T23:46:52.895406] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-23T23:46:53.486884] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-23T23:46:53.599431] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-23T23:46:54.399454] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-23T23:46:54.650725] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-23T23:46:55.199470] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-23T23:46:55.317970] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-23T23:46:55.325725] [INFO ] [REMOTE ] SKT: Full fetch complete (60749 records). [2025-10-23T23:46:55.325885] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-23T23:46:55.477865] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-23T23:46:55.728885] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-23T23:46:55.729011] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-23T23:46:55.730204] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-23T23:46:55.730300] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-23T23:46:55.731532] [DEBUG] [LOCAL ] SKT: Trimmed 60749 records to 42521 (keeping 200 days of data) [2025-10-23T23:46:55.997042] [DEBUG] [LOCAL ] SKT: Primary data saved (42521 records). [2025-10-23T23:46:55.997212] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-23T23:46:55.997333] [INFO ] [MAIN ] Update Progress: 1925/2367 symbols completed. SKT took 34.1s. Estimated remaining: 56m 41s. Rate: 7.8 symbols/min [2025-10-23T23:46:56.008551] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-23T23:46:56.165282] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:46:56.205045] [DEBUG] [LOCAL ] SLG: Loaded 45790 existing records from primary storage. [2025-10-23T23:46:56.205359] [INFO ] [MAIN ] SLG: Loaded 45790 existing records. [2025-10-23T23:46:56.378601] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:46:56.378836] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-23T23:46:56.378910] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-23T23:46:56.379152] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-23T23:46:56.379223] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-23T23:46:56.749027] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:46:56.799389] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-23T23:46:57.125550] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-23T23:46:57.606801] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-23T23:46:57.612040] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:46:57.862053] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-23T23:46:58.399414] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-23T23:46:59.199460] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-23T23:46:59.228147] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T23:46:59.999450] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-23T23:47:00.455516] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T23:47:00.799443] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-23T23:47:00.996447] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-23T23:47:01.604554] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-23T23:47:01.620991] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T23:47:01.769391] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-23T23:47:02.399443] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-23T23:47:03.199415] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-23T23:47:03.270103] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-23T23:47:03.455195] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T23:47:03.999441] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-23T23:47:04.799420] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-23T23:47:05.229691] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T23:47:05.362290] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-23T23:47:05.599412] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-23T23:47:05.807432] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-23T23:47:06.399442] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-23T23:47:07.199457] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-23T23:47:07.583965] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T23:47:07.649922] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-23T23:47:07.999412] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-23T23:47:08.174069] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-23T23:47:08.799454] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-23T23:47:09.486435] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T23:47:09.599456] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-23T23:47:10.399461] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-23T23:47:11.199451] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-23T23:47:11.245102] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-23T23:47:11.321581] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T23:47:11.466945] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-23T23:47:11.999452] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-23T23:47:12.781274] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-23T23:47:12.799401] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-23T23:47:13.604550] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-23T23:47:13.617524] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T23:47:14.217804] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-23T23:47:14.399408] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-23T23:47:14.479866] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-23T23:47:14.483192] [INFO ] [REMOTE ] SKYH: Full fetch complete (22449 records). [2025-10-23T23:47:14.483308] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-23T23:47:14.846297] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-23T23:47:14.846419] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-23T23:47:14.847031] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-23T23:47:14.847126] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-23T23:47:14.847895] [DEBUG] [LOCAL ] SKYH: Trimmed 22449 records to 15863 (keeping 200 days of data) [2025-10-23T23:47:14.937090] [DEBUG] [LOCAL ] SKYH: Primary data saved (15863 records). [2025-10-23T23:47:14.937266] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-23T23:47:14.937403] [INFO ] [MAIN ] Update Progress: 1926/2367 symbols completed. SKYH took 32.0s. Estimated remaining: 56m 36s. Rate: 7.8 symbols/min [2025-10-23T23:47:15.102392] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:15.139465] [DEBUG] [LOCAL ] SLGN: Loaded 41015 existing records from primary storage. [2025-10-23T23:47:15.139823] [INFO ] [MAIN ] SLGN: Loaded 41015 existing records. [2025-10-23T23:47:15.204540] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-23T23:47:15.313949] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:47:15.314206] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-23T23:47:15.314284] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-23T23:47:15.314530] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-23T23:47:15.314603] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-23T23:47:15.655731] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:15.999428] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-23T23:47:16.597162] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-23T23:47:16.626609] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-23T23:47:16.633075] [INFO ] [REMOTE ] SLF: Full fetch complete (56320 records). [2025-10-23T23:47:16.633215] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-23T23:47:16.804509] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-23T23:47:17.037430] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-23T23:47:17.037551] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-23T23:47:17.038740] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-23T23:47:17.038829] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-23T23:47:17.040072] [DEBUG] [LOCAL ] SLF: Trimmed 56320 records to 38557 (keeping 200 days of data) [2025-10-23T23:47:17.269729] [DEBUG] [LOCAL ] SLF: Primary data saved (38557 records). [2025-10-23T23:47:17.269903] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-23T23:47:17.270048] [INFO ] [MAIN ] Update Progress: 1927/2367 symbols completed. SLF took 26.1s. Estimated remaining: 56m 27s. Rate: 7.8 symbols/min [2025-10-23T23:47:17.441542] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:17.441844] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-23T23:47:17.441943] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-23T23:47:17.442172] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-23T23:47:17.442338] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-23T23:47:17.442426] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-23T23:47:17.442498] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-23T23:47:17.611953] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-23T23:47:17.667295] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T23:47:17.830917] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:18.399417] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-23T23:47:18.536843] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T23:47:18.745627] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-23T23:47:19.199528] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-23T23:47:19.530938] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-23T23:47:19.567250] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-23T23:47:19.999499] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-23T23:47:20.799467] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-23T23:47:21.599482] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-23T23:47:22.116666] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-23T23:47:22.126706] [INFO ] [REMOTE ] SLB: Full fetch complete (77877 records). [2025-10-23T23:47:22.126868] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-23T23:47:22.409705] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-23T23:47:22.571523] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-23T23:47:22.576959] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T23:47:22.575002] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-23T23:47:22.578891] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-23T23:47:22.589875] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-23T23:47:22.591479] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 54087 (keeping 200 days of data) [2025-10-23T23:47:22.794662] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-23T23:47:22.807316] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-23T23:47:22.986613] [DEBUG] [LOCAL ] SLB: Primary data saved (54087 records). [2025-10-23T23:47:22.986823] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-23T23:47:22.986941] [INFO ] [MAIN ] Update Progress: 1928/2367 symbols completed. SLB took 36.3s. Estimated remaining: 56m 19s. Rate: 7.8 symbols/min [2025-10-23T23:47:23.155451] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:23.194739] [DEBUG] [LOCAL ] SLQT: Loaded 43361 existing records from primary storage. [2025-10-23T23:47:23.195114] [INFO ] [MAIN ] SLQT: Loaded 43361 existing records. [2025-10-23T23:47:23.205970] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-23T23:47:23.384939] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:47:23.385221] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-23T23:47:23.385308] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-23T23:47:23.385558] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-23T23:47:23.385677] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-23T23:47:23.668000] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-23T23:47:23.907220] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:23.999501] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-23T23:47:24.799560] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-23T23:47:25.599449] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-23T23:47:25.631870] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-23T23:47:25.954949] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-23T23:47:26.399433] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-23T23:47:26.507408] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T23:47:26.760059] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-23T23:47:27.199466] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-23T23:47:27.534908] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-23T23:47:27.999502] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-23T23:47:28.799498] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-23T23:47:29.599470] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-23T23:47:29.641303] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T23:47:29.928633] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-23T23:47:30.399423] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-23T23:47:30.640504] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-23T23:47:30.733462] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-23T23:47:31.199469] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-23T23:47:31.999454] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-23T23:47:32.799427] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-23T23:47:32.967343] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-23T23:47:33.599466] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-23T23:47:33.962196] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-23T23:47:34.399429] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-23T23:47:34.539609] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-23T23:47:35.199421] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-23T23:47:35.523571] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-23T23:47:35.524529] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1052 records). [2025-10-23T23:47:35.524619] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-23T23:47:35.735398] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-23T23:47:35.738306] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:47:35.738513] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:47:35.738666] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-23T23:47:35.738958] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-23T23:47:35.739339] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-23T23:47:35.741123] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-23T23:47:35.739798] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-23T23:47:35.749100] [INFO ] [MAIN ] Update Progress: 1929/2367 symbols completed. SLNZ took 18.5s. Estimated remaining: 56m 12s. Rate: 7.8 symbols/min [2025-10-23T23:47:35.787359] [INFO ] [REMOTE ] SLG: Full fetch complete (65245 records). [2025-10-23T23:47:35.832513] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-23T23:47:36.004941] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-23T23:47:36.018663] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:36.151396] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-23T23:47:36.308284] [DEBUG] [LOCAL ] SLVM: Loaded 27737 existing records from primary storage. [2025-10-23T23:47:36.329420] [INFO ] [MAIN ] SLVM: Loaded 27737 existing records. [2025-10-23T23:47:36.503294] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-23T23:47:36.509180] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-23T23:47:36.525765] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-23T23:47:36.525887] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-23T23:47:36.578489] [DEBUG] [LOCAL ] SLG: Trimmed 65245 records to 46144 (keeping 200 days of data) [2025-10-23T23:47:36.583753] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:47:36.584171] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-23T23:47:36.584402] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-23T23:47:36.584612] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-23T23:47:36.584720] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-23T23:47:36.801464] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-23T23:47:37.240005] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:37.258091] [DEBUG] [LOCAL ] SLG: Primary data saved (46144 records). [2025-10-23T23:47:37.258233] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-23T23:47:37.259550] [INFO ] [MAIN ] Update Progress: 1930/2367 symbols completed. SLG took 41.3s. Estimated remaining: 56m 3s. Rate: 7.8 symbols/min [2025-10-23T23:47:37.425014] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:37.474155] [DEBUG] [LOCAL ] SM: Loaded 52354 existing records from primary storage. [2025-10-23T23:47:37.474488] [INFO ] [MAIN ] SM: Loaded 52354 existing records. [2025-10-23T23:47:37.604611] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-23T23:47:37.657209] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:47:37.657497] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-23T23:47:37.657585] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-23T23:47:37.658187] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-23T23:47:37.658263] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-23T23:47:38.031589] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:38.056299] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-23T23:47:38.399475] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-23T23:47:38.587475] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-23T23:47:38.662053] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-23T23:47:39.199461] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-23T23:47:39.999455] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-23T23:47:40.044033] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-23T23:47:40.698706] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T23:47:40.799427] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-23T23:47:41.604727] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-23T23:47:41.617577] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-23T23:47:42.399504] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-23T23:47:42.448094] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-23T23:47:43.199458] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-23T23:47:43.312394] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T23:47:43.375913] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T23:47:43.999428] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-23T23:47:44.792918] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T23:47:44.802101] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-23T23:47:45.599423] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-23T23:47:45.637211] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T23:47:46.134764] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T23:47:46.399426] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-23T23:47:47.208611] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-23T23:47:47.213108] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T23:47:47.221741] [INFO ] [REMOTE ] SLGN: Full fetch complete (59407 records). [2025-10-23T23:47:47.221894] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-23T23:47:47.611299] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-23T23:47:47.611411] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-23T23:47:47.612467] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-23T23:47:47.612545] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-23T23:47:47.613733] [DEBUG] [LOCAL ] SLGN: Trimmed 59407 records to 41337 (keeping 200 days of data) [2025-10-23T23:47:47.861318] [DEBUG] [LOCAL ] SLGN: Primary data saved (41337 records). [2025-10-23T23:47:47.861473] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-23T23:47:47.861613] [INFO ] [MAIN ] Update Progress: 1931/2367 symbols completed. SLGN took 32.9s. Estimated remaining: 55m 56s. Rate: 7.8 symbols/min [2025-10-23T23:47:48.008865] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-23T23:47:48.035704] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:48.036276] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-23T23:47:48.037373] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-23T23:47:48.037511] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-23T23:47:48.037708] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-23T23:47:48.037986] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-23T23:47:48.038097] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-23T23:47:48.408446] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:48.440146] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-23T23:47:48.506062] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-23T23:47:48.799451] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-23T23:47:49.201449] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-23T23:47:49.599419] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-10-23T23:47:49.804046] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:47:49.804327] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-10-23T23:47:49.804428] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:47:49.804519] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-23T23:47:49.804590] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:47:49.804691] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-23T23:47:49.804789] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-23T23:47:49.804861] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-23T23:47:49.804944] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-23T23:47:49.805029] [INFO ] [MAIN ] Update Progress: 1932/2367 symbols completed. SMA took 1.9s. Estimated remaining: 55m 47s. Rate: 7.8 symbols/min [2025-10-23T23:47:49.984599] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:47:49.995301] [DEBUG] [LOCAL ] SMBK: Loaded 8269 existing records from primary storage. [2025-10-23T23:47:49.995583] [INFO ] [MAIN ] SMBK: Loaded 8269 existing records. [2025-10-23T23:47:50.133413] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-23T23:47:50.197383] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:47:50.197592] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-23T23:47:50.197689] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-23T23:47:50.197894] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-23T23:47:50.197967] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-23T23:47:50.404544] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-23T23:47:50.573605] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:47:51.199436] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-23T23:47:51.450759] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-23T23:47:51.999459] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-23T23:47:52.672607] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T23:47:52.799412] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-23T23:47:53.092130] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-23T23:47:53.497893] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-23T23:47:53.599406] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-23T23:47:54.399438] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-23T23:47:55.199422] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-23T23:47:55.241200] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T23:47:55.602311] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T23:47:55.999503] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-23T23:47:56.583659] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-23T23:47:56.799422] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-23T23:47:57.134887] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-23T23:47:57.599418] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-23T23:47:57.608314] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-23T23:47:58.399447] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-23T23:47:59.199431] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-23T23:47:59.320562] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-23T23:47:59.999418] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-23T23:48:00.160819] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-23T23:48:00.233450] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T23:48:00.799450] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-23T23:48:01.599425] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-23T23:48:02.093361] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-23T23:48:02.278371] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-23T23:48:02.399446] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-23T23:48:03.076873] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-23T23:48:03.199404] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-23T23:48:03.999453] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-23T23:48:04.167902] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-23T23:48:04.442520] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T23:48:04.732115] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T23:48:04.739822] [INFO ] [REMOTE ] SLQT: Full fetch complete (63735 records). [2025-10-23T23:48:04.739988] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-23T23:48:04.804615] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-23T23:48:05.150994] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-23T23:48:05.151134] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-23T23:48:05.152254] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-23T23:48:05.152333] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-23T23:48:05.153551] [DEBUG] [LOCAL ] SLQT: Trimmed 63735 records to 43671 (keeping 200 days of data) [2025-10-23T23:48:05.386697] [DEBUG] [LOCAL ] SLQT: Primary data saved (43671 records). [2025-10-23T23:48:05.386845] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-23T23:48:05.386958] [INFO ] [MAIN ] Update Progress: 1933/2367 symbols completed. SLQT took 42.4s. Estimated remaining: 55m 41s. Rate: 7.8 symbols/min [2025-10-23T23:48:05.551194] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:05.563849] [DEBUG] [LOCAL ] SMC: Loaded 10904 existing records from primary storage. [2025-10-23T23:48:05.564119] [INFO ] [MAIN ] SMC: Loaded 10904 existing records. [2025-10-23T23:48:05.605843] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-23T23:48:05.740157] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:05.740380] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-23T23:48:05.740456] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-23T23:48:05.740709] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-23T23:48:05.740782] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-23T23:48:06.091555] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:06.399485] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-23T23:48:06.507391] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-23T23:48:06.685063] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-23T23:48:07.196283] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-23T23:48:07.201199] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-23T23:48:07.203060] [INFO ] [REMOTE ] SLVM: Full fetch complete (40189 records). [2025-10-23T23:48:07.203316] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-23T23:48:07.570531] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-23T23:48:07.570668] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-23T23:48:07.571585] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-23T23:48:07.571697] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-23T23:48:07.572671] [DEBUG] [LOCAL ] SLVM: Trimmed 40189 records to 27918 (keeping 200 days of data) [2025-10-23T23:48:07.740972] [DEBUG] [LOCAL ] SLVM: Primary data saved (27918 records). [2025-10-23T23:48:07.741154] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-23T23:48:07.741300] [INFO ] [MAIN ] Update Progress: 1934/2367 symbols completed. SLVM took 32.0s. Estimated remaining: 55m 32s. Rate: 7.8 symbols/min [2025-10-23T23:48:07.914612] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:07.958314] [DEBUG] [LOCAL ] SMFG: Loaded 48307 existing records from primary storage. [2025-10-23T23:48:07.958711] [INFO ] [MAIN ] SMFG: Loaded 48307 existing records. [2025-10-23T23:48:08.004575] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-23T23:48:08.141543] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:08.141773] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-23T23:48:08.141863] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-23T23:48:08.142240] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-23T23:48:08.142338] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-23T23:48:08.498924] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:08.799413] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-23T23:48:08.866727] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T23:48:09.009198] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-23T23:48:09.019324] [INFO ] [REMOTE ] SM: Full fetch complete (75946 records). [2025-10-23T23:48:09.019516] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-23T23:48:09.470606] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-23T23:48:09.474452] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-23T23:48:09.477226] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-23T23:48:09.478554] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-23T23:48:09.479205] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-23T23:48:09.480745] [DEBUG] [LOCAL ] SM: Trimmed 75946 records to 52743 (keeping 200 days of data) [2025-10-23T23:48:09.603062] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-23T23:48:09.799836] [DEBUG] [LOCAL ] SM: Primary data saved (52743 records). [2025-10-23T23:48:09.800003] [INFO ] [MAIN ] SM: Full history saved. [2025-10-23T23:48:09.801361] [INFO ] [MAIN ] Update Progress: 1935/2367 symbols completed. SM took 32.5s. Estimated remaining: 55m 23s. Rate: 7.8 symbols/min [2025-10-23T23:48:09.966420] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:10.007920] [DEBUG] [LOCAL ] SMG: Loaded 42743 existing records from primary storage. [2025-10-23T23:48:10.008235] [INFO ] [MAIN ] SMG: Loaded 42743 existing records. [2025-10-23T23:48:10.181026] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:10.181211] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-23T23:48:10.181295] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-23T23:48:10.181530] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-23T23:48:10.181603] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-23T23:48:10.412136] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-23T23:48:10.538020] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:10.547284] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T23:48:11.199445] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-23T23:48:11.773122] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-23T23:48:11.999476] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-23T23:48:12.079077] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-23T23:48:12.799426] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-23T23:48:12.931939] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-23T23:48:13.599436] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-23T23:48:14.368805] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:48:14.399405] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-23T23:48:15.075535] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-23T23:48:15.199437] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-23T23:48:15.999516] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-23T23:48:16.066514] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-23T23:48:16.799412] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-23T23:48:16.891579] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-23T23:48:16.948527] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-23T23:48:17.599468] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-23T23:48:18.184758] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T23:48:18.398540] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-23T23:48:18.408437] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-23T23:48:19.082573] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T23:48:19.084746] [INFO ] [REMOTE ] SMBK: Full fetch complete (11859 records). [2025-10-23T23:48:19.084838] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-23T23:48:19.204618] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-23T23:48:19.452255] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-23T23:48:19.452375] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-23T23:48:19.452717] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-23T23:48:19.452798] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-23T23:48:19.453390] [DEBUG] [LOCAL ] SMBK: Trimmed 11859 records to 8331 (keeping 200 days of data) [2025-10-23T23:48:19.504673] [DEBUG] [LOCAL ] SMBK: Primary data saved (8331 records). [2025-10-23T23:48:19.504860] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-23T23:48:19.504979] [INFO ] [MAIN ] Update Progress: 1936/2367 symbols completed. SMBK took 29.7s. Estimated remaining: 55m 16s. Rate: 7.8 symbols/min [2025-10-23T23:48:19.675112] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:19.687860] [DEBUG] [LOCAL ] SMHI: Loaded 12664 existing records from primary storage. [2025-10-23T23:48:19.688132] [INFO ] [MAIN ] SMHI: Loaded 12664 existing records. [2025-10-23T23:48:19.860854] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:19.861085] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-23T23:48:19.861161] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-23T23:48:19.861389] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-23T23:48:19.861465] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-23T23:48:20.001326] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-23T23:48:20.216733] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:20.799463] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-23T23:48:21.024860] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-23T23:48:21.060150] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-23T23:48:21.599448] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-23T23:48:21.930574] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-23T23:48:22.399448] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-23T23:48:23.183825] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:48:23.199391] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-23T23:48:23.340799] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T23:48:23.999428] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-23T23:48:24.799460] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-23T23:48:24.836266] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-23T23:48:25.023025] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T23:48:25.599447] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-23T23:48:26.392854] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-23T23:48:26.402156] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-23T23:48:26.577675] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-23T23:48:27.199437] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-23T23:48:27.999423] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-23T23:48:28.102348] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-23T23:48:28.799404] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-23T23:48:28.890328] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-23T23:48:29.022032] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-23T23:48:29.599460] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-23T23:48:30.399435] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-23T23:48:30.429896] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T23:48:30.488260] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-23T23:48:31.199427] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-23T23:48:31.320996] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T23:48:31.695501] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T23:48:31.999445] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-23T23:48:32.799454] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-23T23:48:33.516089] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-23T23:48:33.524630] [INFO ] [REMOTE ] SMFG: Full fetch complete (69338 records). [2025-10-23T23:48:33.524797] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-23T23:48:33.599837] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-23T23:48:33.645251] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-23T23:48:33.926658] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-23T23:48:33.926800] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-23T23:48:33.927993] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-23T23:48:33.928089] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-23T23:48:33.929451] [DEBUG] [LOCAL ] SMFG: Trimmed 69338 records to 48644 (keeping 200 days of data) [2025-10-23T23:48:34.208293] [DEBUG] [LOCAL ] SMFG: Primary data saved (48644 records). [2025-10-23T23:48:34.208476] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-23T23:48:34.208608] [INFO ] [MAIN ] Update Progress: 1937/2367 symbols completed. SMFG took 26.5s. Estimated remaining: 55m 10s. Rate: 7.8 symbols/min [2025-10-23T23:48:34.375344] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:34.394178] [DEBUG] [LOCAL ] SMP: Loaded 18640 existing records from primary storage. [2025-10-23T23:48:34.394462] [INFO ] [MAIN ] SMP: Loaded 18640 existing records. [2025-10-23T23:48:34.405738] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-23T23:48:34.574767] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:34.575033] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-23T23:48:34.575127] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-23T23:48:34.575373] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-23T23:48:34.575465] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-23T23:48:34.925241] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:35.199414] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-23T23:48:35.225564] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-23T23:48:35.286140] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:48:35.999500] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-23T23:48:36.168022] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-23T23:48:36.775757] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-23T23:48:36.778094] [INFO ] [REMOTE ] SMC: Full fetch complete (16469 records). [2025-10-23T23:48:36.778185] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-23T23:48:36.809483] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-23T23:48:37.142963] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-23T23:48:37.143068] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-23T23:48:37.143466] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-23T23:48:37.143547] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-23T23:48:37.144156] [DEBUG] [LOCAL ] SMC: Trimmed 16469 records to 10961 (keeping 200 days of data) [2025-10-23T23:48:37.205770] [DEBUG] [LOCAL ] SMC: Primary data saved (10961 records). [2025-10-23T23:48:37.205929] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-23T23:48:37.206078] [INFO ] [MAIN ] Update Progress: 1938/2367 symbols completed. SMC took 31.8s. Estimated remaining: 55m 1s. Rate: 7.8 symbols/min [2025-10-23T23:48:37.372487] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:37.372685] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-10-23T23:48:37.372774] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-10-23T23:48:37.372907] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-23T23:48:37.373003] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-23T23:48:37.373118] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-23T23:48:37.373212] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-23T23:48:37.604834] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-23T23:48:37.729387] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:37.851793] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-23T23:48:38.399440] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-23T23:48:39.164408] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T23:48:39.199400] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-23T23:48:39.999488] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-23T23:48:40.695235] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-23T23:48:40.768377] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T23:48:40.799392] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-23T23:48:40.820691] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-23T23:48:41.599427] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-23T23:48:42.389580] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T23:48:42.399382] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-23T23:48:43.199409] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-23T23:48:43.282154] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-23T23:48:43.317494] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-23T23:48:43.999434] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-23T23:48:44.688698] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-23T23:48:44.799412] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-23T23:48:45.599432] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-23T23:48:46.254230] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T23:48:46.256156] [INFO ] [REMOTE ] SMHI: Full fetch complete (21124 records). [2025-10-23T23:48:46.256246] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-23T23:48:46.403843] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-23T23:48:46.544665] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-23T23:48:46.666057] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-23T23:48:46.666250] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-23T23:48:46.666790] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-23T23:48:46.666945] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-23T23:48:46.694689] [DEBUG] [LOCAL ] SMHI: Trimmed 21124 records to 12718 (keeping 200 days of data) [2025-10-23T23:48:46.696380] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-23T23:48:46.775153] [DEBUG] [LOCAL ] SMHI: Primary data saved (12718 records). [2025-10-23T23:48:46.775313] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-23T23:48:46.775435] [INFO ] [MAIN ] Update Progress: 1939/2367 symbols completed. SMHI took 27.3s. Estimated remaining: 54m 54s. Rate: 7.8 symbols/min [2025-10-23T23:48:46.939611] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:46.979069] [DEBUG] [LOCAL ] SMRT: Loaded 43781 existing records from primary storage. [2025-10-23T23:48:46.979394] [INFO ] [MAIN ] SMRT: Loaded 43781 existing records. [2025-10-23T23:48:47.153318] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:47.153480] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-23T23:48:47.153556] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-23T23:48:47.153886] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-23T23:48:47.153959] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-23T23:48:47.207985] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-23T23:48:47.504113] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:47.753614] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-23T23:48:47.999416] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-23T23:48:48.496563] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T23:48:48.503336] [INFO ] [REMOTE ] SMG: Full fetch complete (62741 records). [2025-10-23T23:48:48.503461] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-23T23:48:48.804584] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-23T23:48:48.892356] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-23T23:48:48.892466] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-23T23:48:48.893533] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-23T23:48:48.893611] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-23T23:48:48.894896] [DEBUG] [LOCAL ] SMG: Trimmed 62741 records to 42957 (keeping 200 days of data) [2025-10-23T23:48:49.155333] [DEBUG] [LOCAL ] SMG: Primary data saved (42957 records). [2025-10-23T23:48:49.155485] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-23T23:48:49.156899] [INFO ] [MAIN ] Update Progress: 1940/2367 symbols completed. SMG took 39.4s. Estimated remaining: 54m 45s. Rate: 7.8 symbols/min [2025-10-23T23:48:49.328192] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:48:49.348789] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-23T23:48:49.381674] [DEBUG] [LOCAL ] SMWB: Loaded 31619 existing records from primary storage. [2025-10-23T23:48:49.381983] [INFO ] [MAIN ] SMWB: Loaded 31619 existing records. [2025-10-23T23:48:49.556095] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:48:49.556300] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-23T23:48:49.556394] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-23T23:48:49.556683] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-23T23:48:49.556774] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-23T23:48:49.604600] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-23T23:48:49.920116] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:48:50.078922] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-23T23:48:50.399457] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-23T23:48:51.199444] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-23T23:48:51.682135] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-23T23:48:51.999408] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-23T23:48:52.175066] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-23T23:48:52.274977] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T23:48:52.799436] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-23T23:48:53.286418] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T23:48:53.599480] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-23T23:48:54.182485] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T23:48:54.399415] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-23T23:48:54.617505] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-23T23:48:55.199449] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-23T23:48:55.863455] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T23:48:55.999444] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-23T23:48:56.799446] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-23T23:48:57.599478] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-23T23:48:57.684838] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-23T23:48:57.870746] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-23T23:48:58.143809] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T23:48:58.399454] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-23T23:48:58.620639] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T23:48:59.199462] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-23T23:48:59.930892] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-23T23:48:59.999498] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-23T23:49:00.799442] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-23T23:49:01.523892] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-23T23:49:01.599409] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-23T23:49:01.841170] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-23T23:49:01.890817] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-23T23:49:02.399440] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-23T23:49:03.076345] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T23:49:03.199448] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-23T23:49:03.999455] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-23T23:49:04.630504] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-23T23:49:04.799406] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-23T23:49:05.019051] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-23T23:49:05.579013] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-23T23:49:05.599393] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-23T23:49:06.202264] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-23T23:49:06.399451] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-23T23:49:06.903509] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T23:49:07.199433] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-23T23:49:07.346348] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-23T23:49:07.999413] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-23T23:49:08.152289] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-23T23:49:08.799430] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-23T23:49:09.517788] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T23:49:09.599406] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-23T23:49:09.887067] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T23:49:10.399441] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-23T23:49:11.124529] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-23T23:49:11.199496] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-23T23:49:11.999436] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-23T23:49:12.331186] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T23:49:12.335687] [INFO ] [REMOTE ] SMWB: Full fetch complete (48515 records). [2025-10-23T23:49:12.335800] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-23T23:49:12.713896] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-23T23:49:12.714065] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-23T23:49:12.715155] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-23T23:49:12.715354] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-23T23:49:12.716773] [DEBUG] [LOCAL ] SMWB: Trimmed 48515 records to 31720 (keeping 200 days of data) [2025-10-23T23:49:12.799753] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-23T23:49:12.937584] [DEBUG] [LOCAL ] SMWB: Primary data saved (31720 records). [2025-10-23T23:49:12.941412] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-23T23:49:12.942201] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-23T23:49:12.942846] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-23T23:49:12.953311] [INFO ] [MAIN ] Update Progress: 1941/2367 symbols completed. SMWB took 23.8s. Estimated remaining: 54m 41s. Rate: 7.8 symbols/min [2025-10-23T23:49:12.969720] [INFO ] [REMOTE ] SMP: Full fetch complete (26567 records). [2025-10-23T23:49:13.002535] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-23T23:49:13.259543] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:13.518240] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-23T23:49:13.531793] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-23T23:49:13.532472] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-23T23:49:13.533273] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-23T23:49:13.533172] [DEBUG] [LOCAL ] SN: Loaded 49982 existing records from primary storage. [2025-10-23T23:49:13.534029] [INFO ] [MAIN ] SN: Loaded 49982 existing records. [2025-10-23T23:49:13.598601] [DEBUG] [LOCAL ] SMP: Trimmed 26567 records to 18750 (keeping 200 days of data) [2025-10-23T23:49:13.615100] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-23T23:49:13.816682] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:13.828114] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-23T23:49:13.833007] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-23T23:49:13.840147] [DEBUG] [LOCAL ] SMP: Primary data saved (18750 records). [2025-10-23T23:49:13.840493] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-23T23:49:13.840561] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-23T23:49:13.840852] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-23T23:49:13.840767] [INFO ] [MAIN ] Update Progress: 1942/2367 symbols completed. SMP took 39.6s. Estimated remaining: 54m 32s. Rate: 7.8 symbols/min [2025-10-23T23:49:14.265778] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:14.433107] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-23T23:49:14.488932] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:14.489069] [INFO ] [REMOTE ] SMRT: Full fetch complete (62569 records). [2025-10-23T23:49:14.489855] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-23T23:49:14.490873] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-23T23:49:14.582193] [DEBUG] [LOCAL ] SNA: Loaded 25699 existing records from primary storage. [2025-10-23T23:49:14.607310] [INFO ] [MAIN ] SNA: Loaded 25699 existing records. [2025-10-23T23:49:15.081474] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:15.102720] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-23T23:49:15.120848] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-23T23:49:15.139263] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-23T23:49:15.172584] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-23T23:49:15.175851] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-23T23:49:15.225220] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-23T23:49:15.249157] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-23T23:49:15.261768] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-23T23:49:15.325448] [DEBUG] [LOCAL ] SMRT: Trimmed 62569 records to 44050 (keeping 200 days of data) [2025-10-23T23:49:15.693553] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:15.703434] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-23T23:49:15.847355] [DEBUG] [LOCAL ] SMRT: Primary data saved (44050 records). [2025-10-23T23:49:15.847552] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-23T23:49:15.847741] [INFO ] [MAIN ] Update Progress: 1943/2367 symbols completed. SMRT took 29.1s. Estimated remaining: 54m 23s. Rate: 7.8 symbols/min [2025-10-23T23:49:16.035098] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:16.082810] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-23T23:49:16.083160] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-23T23:49:16.260082] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:16.260338] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-23T23:49:16.260413] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-23T23:49:16.260624] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-23T23:49:16.260723] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-23T23:49:16.647338] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:16.648683] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-23T23:49:16.649497] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-23T23:49:16.762865] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (3.15 seconds). [2025-10-23T23:49:16.799400] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-23T23:49:16.853051] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-23T23:49:17.599502] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-23T23:49:18.399444] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-23T23:49:18.940096] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-23T23:49:18.991673] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-23T23:49:19.020981] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-23T23:49:19.030202] [INFO ] [REMOTE ] SMR: Full fetch complete (77977 records). [2025-10-23T23:49:19.030373] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-23T23:49:19.204812] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-23T23:49:19.424407] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-23T23:49:19.424533] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-23T23:49:19.425824] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-23T23:49:19.425923] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-23T23:49:19.427365] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 54189 (keeping 200 days of data) [2025-10-23T23:49:19.768331] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-23T23:49:19.786499] [DEBUG] [LOCAL ] SMR: Primary data saved (54189 records). [2025-10-23T23:49:19.786699] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-23T23:49:19.786803] [INFO ] [MAIN ] Update Progress: 1944/2367 symbols completed. SMR took 42.6s. Estimated remaining: 54m 14s. Rate: 7.8 symbols/min [2025-10-23T23:49:19.953130] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:19.959886] [DEBUG] [LOCAL ] SNDA: Loaded 4475 existing records from primary storage. [2025-10-23T23:49:19.960095] [INFO ] [MAIN ] SNDA: Loaded 4475 existing records. [2025-10-23T23:49:20.004731] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-23T23:49:20.142051] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:20.142274] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-23T23:49:20.142376] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-23T23:49:20.142615] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-23T23:49:20.142729] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-23T23:49:20.494902] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:20.799473] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-23T23:49:21.557707] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-23T23:49:21.599392] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-23T23:49:21.645498] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-23T23:49:21.674900] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-23T23:49:22.399444] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-23T23:49:23.199443] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-23T23:49:23.732517] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T23:49:23.821825] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-23T23:49:23.992463] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-23T23:49:24.003433] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-23T23:49:24.799443] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-23T23:49:25.521275] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T23:49:25.599520] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-23T23:49:25.851754] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T23:49:26.399410] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-23T23:49:27.192368] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-23T23:49:27.199595] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-23T23:49:27.836168] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-23T23:49:27.999413] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-23T23:49:28.279125] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-23T23:49:28.799457] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-23T23:49:29.254732] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-23T23:49:29.519813] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T23:49:29.599440] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-23T23:49:30.399493] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-23T23:49:31.199503] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-23T23:49:31.550205] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-23T23:49:31.736343] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-23T23:49:31.793885] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-23T23:49:31.999431] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-23T23:49:32.575602] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T23:49:32.799454] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-23T23:49:33.599482] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-23T23:49:34.046240] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-23T23:49:34.174755] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T23:49:34.399453] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-23T23:49:35.199473] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-23T23:49:35.835766] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T23:49:35.999486] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-23T23:49:36.799429] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-23T23:49:36.833540] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-23T23:49:37.470997] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T23:49:37.472777] [INFO ] [REMOTE ] SNDA: Full fetch complete (7500 records). [2025-10-23T23:49:37.472892] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-23T23:49:37.607283] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-23T23:49:37.888796] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-23T23:49:37.889066] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-23T23:49:37.898834] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-23T23:49:37.899555] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-23T23:49:37.900013] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-23T23:49:37.900478] [DEBUG] [LOCAL ] SNDA: Trimmed 7500 records to 4490 (keeping 200 days of data) [2025-10-23T23:49:37.927197] [DEBUG] [LOCAL ] SNDA: Primary data saved (4490 records). [2025-10-23T23:49:37.927292] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-23T23:49:37.927440] [INFO ] [MAIN ] Update Progress: 1945/2367 symbols completed. SNDA took 18.1s. Estimated remaining: 54m 9s. Rate: 7.8 symbols/min [2025-10-23T23:49:38.092143] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:38.126585] [DEBUG] [LOCAL ] SNDR: Loaded 41601 existing records from primary storage. [2025-10-23T23:49:38.126939] [INFO ] [MAIN ] SNDR: Loaded 41601 existing records. [2025-10-23T23:49:38.297965] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:38.298161] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-23T23:49:38.298253] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-23T23:49:38.298551] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-23T23:49:38.298667] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-23T23:49:38.404502] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-23T23:49:38.675144] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:39.199489] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-23T23:49:39.366424] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-23T23:49:39.902582] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-23T23:49:39.999472] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-23T23:49:40.672717] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-23T23:49:40.799474] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-23T23:49:41.599431] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-23T23:49:42.214744] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T23:49:42.253831] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-23T23:49:42.399441] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-23T23:49:43.199423] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-23T23:49:43.498391] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-23T23:49:43.999412] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-23T23:49:44.351912] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T23:49:44.799409] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-23T23:49:44.903883] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-23T23:49:45.570125] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:49:45.599393] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-23T23:49:46.016351] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-23T23:49:46.021212] [INFO ] [REMOTE ] SNA: Full fetch complete (39099 records). [2025-10-23T23:49:46.021331] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-23T23:49:46.387082] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-23T23:49:46.387188] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-23T23:49:46.387869] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-23T23:49:46.387946] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-23T23:49:46.388812] [DEBUG] [LOCAL ] SNA: Trimmed 39099 records to 25908 (keeping 200 days of data) [2025-10-23T23:49:46.441457] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-23T23:49:46.546660] [DEBUG] [LOCAL ] SNA: Primary data saved (25908 records). [2025-10-23T23:49:46.546811] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-23T23:49:46.546919] [INFO ] [MAIN ] Update Progress: 1946/2367 symbols completed. SNA took 32.7s. Estimated remaining: 54m 1s. Rate: 7.8 symbols/min [2025-10-23T23:49:46.715130] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:46.753144] [DEBUG] [LOCAL ] SNN: Loaded 44338 existing records from primary storage. [2025-10-23T23:49:46.753456] [INFO ] [MAIN ] SNN: Loaded 44338 existing records. [2025-10-23T23:49:46.930198] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:46.930475] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-23T23:49:46.930563] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-23T23:49:46.930914] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-23T23:49:46.931060] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-23T23:49:47.110033] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-23T23:49:47.206635] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-23T23:49:47.315140] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:47.999481] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-23T23:49:48.799518] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-23T23:49:48.868599] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-23T23:49:49.021538] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-23T23:49:49.535686] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T23:49:49.599411] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-23T23:49:50.399426] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-23T23:49:50.663208] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-23T23:49:50.759273] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T23:49:51.199468] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-23T23:49:51.999417] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-23T23:49:52.420931] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-23T23:49:52.540891] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-23T23:49:52.799418] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-23T23:49:53.599414] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-23T23:49:54.170428] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-23T23:49:54.399417] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-23T23:49:54.572523] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-23T23:49:54.582196] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-23T23:49:54.582389] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-23T23:49:54.974001] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-23T23:49:54.974172] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-23T23:49:54.976505] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-23T23:49:54.976713] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-23T23:49:54.978404] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 54186 (keeping 200 days of data) [2025-10-23T23:49:55.200876] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-23T23:49:55.306065] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-23T23:49:55.327279] [DEBUG] [LOCAL ] SNAP: Primary data saved (54186 records). [2025-10-23T23:49:55.327405] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-23T23:49:55.327531] [INFO ] [MAIN ] Update Progress: 1947/2367 symbols completed. SNAP took 39.5s. Estimated remaining: 53m 54s. Rate: 7.8 symbols/min [2025-10-23T23:49:55.495666] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:55.495839] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-10-23T23:49:55.495909] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-10-23T23:49:55.496015] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-23T23:49:55.496084] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-23T23:49:55.496162] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-23T23:49:55.496229] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-23T23:49:55.843586] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:55.865758] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T23:49:55.999411] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-23T23:49:56.799412] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-23T23:49:57.067249] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-23T23:49:57.076960] [INFO ] [REMOTE ] SN: Full fetch complete (71858 records). [2025-10-23T23:49:57.077099] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-23T23:49:57.473400] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-23T23:49:57.473564] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-23T23:49:57.474724] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-23T23:49:57.474946] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-23T23:49:57.476306] [DEBUG] [LOCAL ] SN: Trimmed 71858 records to 50369 (keeping 200 days of data) [2025-10-23T23:49:57.653815] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-23T23:49:57.709596] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-23T23:49:57.811377] [DEBUG] [LOCAL ] SN: Primary data saved (50369 records). [2025-10-23T23:49:57.811539] [INFO ] [MAIN ] SN: Full history saved. [2025-10-23T23:49:57.811670] [INFO ] [MAIN ] Update Progress: 1948/2367 symbols completed. SN took 44.9s. Estimated remaining: 53m 45s. Rate: 7.8 symbols/min [2025-10-23T23:49:57.983798] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:49:58.028304] [DEBUG] [LOCAL ] SNV: Loaded 49060 existing records from primary storage. [2025-10-23T23:49:58.028782] [INFO ] [MAIN ] SNV: Loaded 49060 existing records. [2025-10-23T23:49:58.229801] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:49:58.230021] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-23T23:49:58.230095] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-23T23:49:58.230712] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-23T23:49:58.230795] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-23T23:49:58.407837] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-23T23:49:58.634418] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:49:59.111914] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-23T23:49:59.205366] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-23T23:49:59.217891] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T23:49:59.999410] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-23T23:50:00.101586] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:50:00.799484] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-23T23:50:01.545999] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-23T23:50:01.599400] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-23T23:50:01.806482] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-23T23:50:02.339399] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-23T23:50:02.399440] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-23T23:50:03.199433] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-23T23:50:03.958167] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-23T23:50:03.999406] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-23T23:50:04.100183] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-23T23:50:04.804597] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-23T23:50:04.817580] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-23T23:50:04.826616] [INFO ] [REMOTE ] SNDR: Full fetch complete (60283 records). [2025-10-23T23:50:04.826778] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-23T23:50:05.224294] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-23T23:50:05.224410] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-23T23:50:05.225452] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-23T23:50:05.225530] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-23T23:50:05.226742] [DEBUG] [LOCAL ] SNDR: Trimmed 60283 records to 41922 (keeping 200 days of data) [2025-10-23T23:50:05.469626] [DEBUG] [LOCAL ] SNDR: Primary data saved (41922 records). [2025-10-23T23:50:05.469799] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-23T23:50:05.469905] [INFO ] [MAIN ] Update Progress: 1949/2367 symbols completed. SNDR took 27.5s. Estimated remaining: 53m 37s. Rate: 7.8 symbols/min [2025-10-23T23:50:05.606769] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-23T23:50:05.641877] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:05.679423] [DEBUG] [LOCAL ] SNX: Loaded 38854 existing records from primary storage. [2025-10-23T23:50:05.679719] [INFO ] [MAIN ] SNX: Loaded 38854 existing records. [2025-10-23T23:50:05.856536] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:05.856792] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-23T23:50:05.856867] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-23T23:50:05.857117] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-23T23:50:05.857191] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-23T23:50:06.218410] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:06.248767] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-23T23:50:06.399439] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-23T23:50:06.545038] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-23T23:50:07.199464] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-23T23:50:07.639937] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-23T23:50:07.999420] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-23T23:50:08.801156] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-23T23:50:08.806060] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-23T23:50:08.881180] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-23T23:50:09.599425] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-23T23:50:09.788754] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-23T23:50:10.094695] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-23T23:50:10.399434] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-23T23:50:11.199444] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-23T23:50:11.999443] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-23T23:50:12.045964] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T23:50:12.082530] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-23T23:50:12.331745] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T23:50:12.799490] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-23T23:50:13.599436] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-23T23:50:13.641442] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-23T23:50:14.399453] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-23T23:50:14.605939] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T23:50:15.199437] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-23T23:50:15.276754] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-23T23:50:15.849603] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T23:50:15.999425] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-23T23:50:16.799476] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-23T23:50:17.237426] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T23:50:17.599496] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-23T23:50:17.703863] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T23:50:18.132314] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-23T23:50:18.399496] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-23T23:50:19.199454] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-23T23:50:19.827462] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-23T23:50:19.975846] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T23:50:19.999402] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-23T23:50:20.799416] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-23T23:50:20.985780] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-23T23:50:21.599488] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-23T23:50:21.643870] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-23T23:50:22.136801] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-23T23:50:22.144394] [INFO ] [REMOTE ] SNN: Full fetch complete (63074 records). [2025-10-23T23:50:22.144561] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-23T23:50:22.404690] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-23T23:50:22.538944] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-23T23:50:22.539083] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-23T23:50:22.540192] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-23T23:50:22.540271] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-23T23:50:22.541531] [DEBUG] [LOCAL ] SNN: Trimmed 63074 records to 44659 (keeping 200 days of data) [2025-10-23T23:50:22.806521] [DEBUG] [LOCAL ] SNN: Primary data saved (44659 records). [2025-10-23T23:50:22.806695] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-23T23:50:22.806807] [INFO ] [MAIN ] Update Progress: 1950/2367 symbols completed. SNN took 36.3s. Estimated remaining: 53m 32s. Rate: 7.8 symbols/min [2025-10-23T23:50:22.972553] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:23.020334] [DEBUG] [LOCAL ] SO: Loaded 53615 existing records from primary storage. [2025-10-23T23:50:23.020702] [INFO ] [MAIN ] SO: Loaded 53615 existing records. [2025-10-23T23:50:23.193919] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:23.194128] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-23T23:50:23.194203] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-23T23:50:23.194515] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-23T23:50:23.194589] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-23T23:50:23.210896] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-23T23:50:23.557070] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:23.926475] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-23T23:50:23.999412] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-23T23:50:24.397708] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-23T23:50:24.406925] [INFO ] [REMOTE ] SNOW: Full fetch complete (77718 records). [2025-10-23T23:50:24.407099] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-23T23:50:24.804343] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-23T23:50:24.808416] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-23T23:50:24.808771] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-23T23:50:24.811456] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-23T23:50:24.826683] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-23T23:50:24.843567] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-23T23:50:24.847692] [DEBUG] [LOCAL ] SNOW: Trimmed 77718 records to 53967 (keeping 200 days of data) [2025-10-23T23:50:25.182849] [DEBUG] [LOCAL ] SNOW: Primary data saved (53967 records). [2025-10-23T23:50:25.183051] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-23T23:50:25.183192] [INFO ] [MAIN ] Update Progress: 1951/2367 symbols completed. SNOW took 29.9s. Estimated remaining: 53m 23s. Rate: 7.8 symbols/min [2025-10-23T23:50:25.368240] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:25.404347] [DEBUG] [LOCAL ] SOBO: Loaded 39390 existing records from primary storage. [2025-10-23T23:50:25.404792] [INFO ] [MAIN ] SOBO: Loaded 39390 existing records. [2025-10-23T23:50:25.608044] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-23T23:50:25.612839] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:25.613799] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-23T23:50:25.613878] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-23T23:50:25.614116] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-23T23:50:25.614191] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-23T23:50:25.984467] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:26.015486] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-23T23:50:26.306035] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-23T23:50:26.399413] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-23T23:50:26.893263] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-23T23:50:26.905456] [INFO ] [REMOTE ] SNV: Full fetch complete (71856 records). [2025-10-23T23:50:26.905665] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-23T23:50:27.204804] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-23T23:50:27.305921] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-23T23:50:27.306036] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-23T23:50:27.307321] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-23T23:50:27.307406] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-23T23:50:27.308981] [DEBUG] [LOCAL ] SNV: Trimmed 71856 records to 49425 (keeping 200 days of data) [2025-10-23T23:50:27.605878] [DEBUG] [LOCAL ] SNV: Primary data saved (49425 records). [2025-10-23T23:50:27.606015] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-23T23:50:27.607433] [INFO ] [MAIN ] Update Progress: 1952/2367 symbols completed. SNV took 29.8s. Estimated remaining: 53m 14s. Rate: 7.8 symbols/min [2025-10-23T23:50:27.779610] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:27.831925] [DEBUG] [LOCAL ] SOC: Loaded 51227 existing records from primary storage. [2025-10-23T23:50:27.832283] [INFO ] [MAIN ] SOC: Loaded 51227 existing records. [2025-10-23T23:50:28.015685] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-23T23:50:28.016981] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-23T23:50:28.044968] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:28.054101] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-23T23:50:28.054745] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-23T23:50:28.054956] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-23T23:50:28.055028] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-23T23:50:28.440062] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:28.799449] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-23T23:50:28.833430] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-23T23:50:29.599506] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-23T23:50:29.665961] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-23T23:50:30.353354] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T23:50:30.399399] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-23T23:50:31.199426] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-23T23:50:31.290692] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-23T23:50:31.584742] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-23T23:50:31.999426] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-23T23:50:32.604895] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-23T23:50:32.799418] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-23T23:50:33.504803] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-23T23:50:33.511580] [INFO ] [REMOTE ] SNX: Full fetch complete (57339 records). [2025-10-23T23:50:33.511779] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-23T23:50:33.609580] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-23T23:50:33.917023] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-23T23:50:33.917153] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-23T23:50:33.918351] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-23T23:50:33.918446] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-23T23:50:33.919679] [DEBUG] [LOCAL ] SNX: Trimmed 57339 records to 39146 (keeping 200 days of data) [2025-10-23T23:50:34.163964] [DEBUG] [LOCAL ] SNX: Primary data saved (39146 records). [2025-10-23T23:50:34.164138] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-23T23:50:34.164290] [INFO ] [MAIN ] Update Progress: 1953/2367 symbols completed. SNX took 28.7s. Estimated remaining: 53m 6s. Rate: 7.8 symbols/min [2025-10-23T23:50:34.365063] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-23T23:50:34.368222] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:34.384544] [DEBUG] [LOCAL ] SOJC: Loaded 4574 existing records from primary storage. [2025-10-23T23:50:34.384830] [INFO ] [MAIN ] SOJC: Loaded 4574 existing records. [2025-10-23T23:50:34.405327] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-23T23:50:34.567850] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:34.568048] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-23T23:50:34.568125] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-23T23:50:34.568288] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-23T23:50:34.568360] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-23T23:50:34.928593] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:35.199406] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-23T23:50:35.628126] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-23T23:50:35.999417] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-23T23:50:36.462602] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-23T23:50:36.799453] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-23T23:50:36.834615] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-23T23:50:37.280567] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T23:50:37.404199] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-23T23:50:37.599459] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-23T23:50:38.179335] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-23T23:50:38.399444] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-23T23:50:39.098492] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-23T23:50:39.199452] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-23T23:50:39.999476] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-23T23:50:40.490063] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-23T23:50:40.799444] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-23T23:50:41.594769] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-23T23:50:41.606684] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-23T23:50:42.344453] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T23:50:42.399437] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-23T23:50:43.056627] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-23T23:50:43.199438] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-23T23:50:43.864952] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-23T23:50:43.999439] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-23T23:50:44.778377] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:50:44.799421] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-23T23:50:45.450913] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-23T23:50:45.599458] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-23T23:50:46.202020] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-23T23:50:46.399452] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-23T23:50:46.617332] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-23T23:50:47.012422] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T23:50:47.199449] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-23T23:50:47.999418] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-23T23:50:48.810753] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-23T23:50:48.816527] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:50:49.402326] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-23T23:50:49.472339] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-23T23:50:49.599448] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-23T23:50:50.228688] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-23T23:50:50.399431] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-23T23:50:51.199442] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-23T23:50:51.792289] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-23T23:50:51.793941] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-23T23:50:51.999433] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-23T23:50:52.799436] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-23T23:50:53.317083] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-23T23:50:53.318400] [INFO ] [REMOTE ] SOJC: Full fetch complete (7208 records). [2025-10-23T23:50:53.318505] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-23T23:50:53.601928] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-23T23:50:53.684814] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-23T23:50:53.684924] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-23T23:50:53.685166] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-23T23:50:53.685251] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-23T23:50:53.685844] [DEBUG] [LOCAL ] SOJC: Trimmed 7208 records to 4596 (keeping 200 days of data) [2025-10-23T23:50:53.713363] [DEBUG] [LOCAL ] SOJC: Primary data saved (4596 records). [2025-10-23T23:50:53.713475] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-23T23:50:53.713583] [INFO ] [MAIN ] Update Progress: 1954/2367 symbols completed. SOJC took 19.5s. Estimated remaining: 53m 1s. Rate: 7.8 symbols/min [2025-10-23T23:50:53.885177] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:53.898889] [DEBUG] [LOCAL ] SOJD: Loaded 12581 existing records from primary storage. [2025-10-23T23:50:53.899156] [INFO ] [MAIN ] SOJD: Loaded 12581 existing records. [2025-10-23T23:50:54.080760] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:54.080959] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-23T23:50:54.081037] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-23T23:50:54.081227] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-23T23:50:54.081300] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-23T23:50:54.404531] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-23T23:50:54.478805] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-23T23:50:54.484213] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:55.015476] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-23T23:50:55.022724] [INFO ] [REMOTE ] SOBO: Full fetch complete (58576 records). [2025-10-23T23:50:55.022854] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-23T23:50:55.204544] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-23T23:50:55.412570] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-23T23:50:55.412704] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-23T23:50:55.413780] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-23T23:50:55.413857] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-23T23:50:55.415107] [DEBUG] [LOCAL ] SOBO: Trimmed 58576 records to 39668 (keeping 200 days of data) [2025-10-23T23:50:55.655242] [DEBUG] [LOCAL ] SOBO: Primary data saved (39668 records). [2025-10-23T23:50:55.655449] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-23T23:50:55.655564] [INFO ] [MAIN ] Update Progress: 1955/2367 symbols completed. SOBO took 30.5s. Estimated remaining: 52m 52s. Rate: 7.8 symbols/min [2025-10-23T23:50:55.833697] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:50:55.844691] [DEBUG] [LOCAL ] SOJE: Loaded 8697 existing records from primary storage. [2025-10-23T23:50:55.844949] [INFO ] [MAIN ] SOJE: Loaded 8697 existing records. [2025-10-23T23:50:56.002170] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-23T23:50:56.034107] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:50:56.035432] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-23T23:50:56.035660] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-23T23:50:56.035963] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-23T23:50:56.036084] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-23T23:50:56.326419] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-23T23:50:56.370525] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-23T23:50:56.459799] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:50:56.799418] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-23T23:50:57.531754] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-23T23:50:57.599405] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-23T23:50:57.972341] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-23T23:50:58.127269] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T23:50:58.399437] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-23T23:50:58.989327] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:50:59.199441] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-23T23:50:59.922549] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T23:50:59.999426] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-23T23:51:00.799438] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-23T23:51:01.599415] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-23T23:51:01.813930] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-23T23:51:01.852782] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-23T23:51:02.399458] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-23T23:51:03.199407] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-23T23:51:03.308622] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-23T23:51:03.449112] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-23T23:51:03.458509] [INFO ] [REMOTE ] SO: Full fetch complete (77777 records). [2025-10-23T23:51:03.458692] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-23T23:51:03.855804] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-23T23:51:03.855939] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-23T23:51:03.857270] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-23T23:51:03.857354] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-23T23:51:03.858919] [DEBUG] [LOCAL ] SO: Trimmed 77777 records to 54005 (keeping 200 days of data) [2025-10-23T23:51:04.038005] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-23T23:51:04.083137] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-23T23:51:04.205465] [DEBUG] [LOCAL ] SO: Primary data saved (54005 records). [2025-10-23T23:51:04.205629] [INFO ] [MAIN ] SO: Full history saved. [2025-10-23T23:51:04.205762] [INFO ] [MAIN ] Update Progress: 1956/2367 symbols completed. SO took 41.4s. Estimated remaining: 52m 44s. Rate: 7.8 symbols/min [2025-10-23T23:51:04.378208] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:04.378406] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-23T23:51:04.378477] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-23T23:51:04.378590] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-23T23:51:04.378685] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-23T23:51:04.378769] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-23T23:51:04.378844] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-23T23:51:04.736582] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:04.799410] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-10-23T23:51:05.599411] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-23T23:51:05.790620] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-23T23:51:05.912512] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-23T23:51:06.399438] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-23T23:51:06.483380] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-23T23:51:07.187249] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T23:51:07.199405] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-23T23:51:08.003811] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-10-23T23:51:08.004717] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-23T23:51:08.756164] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-23T23:51:08.799402] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-23T23:51:09.530517] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T23:51:09.599434] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-10-23T23:51:10.391177] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T23:51:10.399447] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-23T23:51:11.199448] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-23T23:51:11.999409] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-10-23T23:51:12.174246] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-23T23:51:12.359527] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-23T23:51:12.373247] [INFO ] [REMOTE ] SOC: Full fetch complete (72289 records). [2025-10-23T23:51:12.373527] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-23T23:51:12.784297] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-23T23:51:12.784433] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-23T23:51:12.785601] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-23T23:51:12.785709] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-23T23:51:12.787163] [DEBUG] [LOCAL ] SOC: Trimmed 72289 records to 51616 (keeping 200 days of data) [2025-10-23T23:51:12.835509] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-23T23:51:12.880484] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-23T23:51:13.096746] [DEBUG] [LOCAL ] SOC: Primary data saved (51616 records). [2025-10-23T23:51:13.096910] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-23T23:51:13.098284] [INFO ] [MAIN ] Update Progress: 1957/2367 symbols completed. SOC took 45.5s. Estimated remaining: 52m 37s. Rate: 7.8 symbols/min [2025-10-23T23:51:13.368686] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-23T23:51:13.599440] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-23T23:51:14.350980] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T23:51:14.399414] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-23T23:51:15.123710] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T23:51:15.199417] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-23T23:51:15.867363] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-23T23:51:15.869307] [INFO ] [REMOTE ] SOJE: Full fetch complete (13420 records). [2025-10-23T23:51:15.869409] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-23T23:51:16.010865] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-23T23:51:16.246624] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-23T23:51:16.246787] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-23T23:51:16.247172] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-23T23:51:16.247248] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-23T23:51:16.247828] [DEBUG] [LOCAL ] SOJE: Trimmed 13420 records to 8744 (keeping 200 days of data) [2025-10-23T23:51:16.301038] [DEBUG] [LOCAL ] SOJE: Primary data saved (8744 records). [2025-10-23T23:51:16.301193] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-23T23:51:16.301285] [INFO ] [MAIN ] Update Progress: 1958/2367 symbols completed. SOJE took 20.6s. Estimated remaining: 52m 28s. Rate: 7.8 symbols/min [2025-10-23T23:51:16.799428] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-10-23T23:51:16.841869] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-23T23:51:17.484377] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-23T23:51:17.599420] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-10-23T23:51:18.208463] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-23T23:51:18.399515] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-10-23T23:51:19.181758] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T23:51:19.199392] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-10-23T23:51:19.986274] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-23T23:51:19.999391] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-10-23T23:51:20.775431] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T23:51:20.799397] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-10. [2025-10-23T23:51:21.411287] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-23T23:51:21.413051] [INFO ] [REMOTE ] SOJF: Full fetch complete (14155 records). [2025-10-23T23:51:21.413141] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-10-23T23:51:21.592737] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-23T23:51:21.593011] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:51:21.593088] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:51:21.593165] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-23T23:51:21.593254] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-23T23:51:21.593331] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-23T23:51:21.593410] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-23T23:51:21.593504] [INFO ] [MAIN ] Update Progress: 1959/2367 symbols completed. SOJF took 17.4s. Estimated remaining: 52m 20s. Rate: 7.8 symbols/min [2025-10-23T23:51:21.599413] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-23T23:51:22.477882] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-23T23:51:22.481182] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-23T23:51:23.270601] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T23:51:23.273255] [INFO ] [REMOTE ] SOJD: Full fetch complete (19081 records). [2025-10-23T23:51:23.273351] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-23T23:51:23.653115] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-23T23:51:23.653241] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-23T23:51:23.653761] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-23T23:51:23.653845] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-23T23:51:23.654465] [DEBUG] [LOCAL ] SOJD: Trimmed 19081 records to 12651 (keeping 200 days of data) [2025-10-23T23:51:23.730554] [DEBUG] [LOCAL ] SOJD: Primary data saved (12651 records). [2025-10-23T23:51:23.730735] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-23T23:51:23.730848] [INFO ] [MAIN ] Update Progress: 1960/2367 symbols completed. SOJD took 30.0s. Estimated remaining: 52m 11s. Rate: 7.8 symbols/min [2025-10-23T23:51:24.245100] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:24.425473] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:24.400394] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:24.445539] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:24.472167] [DEBUG] [LOCAL ] SOL: Loaded 13561 existing records from primary storage. [2025-10-23T23:51:24.473283] [INFO ] [MAIN ] SOL: Loaded 13561 existing records. [2025-10-23T23:51:24.521813] [DEBUG] [LOCAL ] SON: Loaded 43544 existing records from primary storage. [2025-10-23T23:51:24.571410] [INFO ] [MAIN ] SON: Loaded 43544 existing records. [2025-10-23T23:51:24.841250] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:51:24.792182] [DEBUG] [LOCAL ] SOLV: Loaded 43384 existing records from primary storage. [2025-10-23T23:51:24.851878] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-23T23:51:24.878112] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-23T23:51:24.871535] [INFO ] [MAIN ] SOLV: Loaded 43384 existing records. [2025-10-23T23:51:24.878020] [DEBUG] [LOCAL ] SONY: Loaded 53376 existing records from primary storage. [2025-10-23T23:51:24.892392] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-23T23:51:24.892621] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-23T23:51:24.960679] [INFO ] [MAIN ] SONY: Loaded 53376 existing records. [2025-10-23T23:51:24.996356] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:51:25.100426] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-23T23:51:25.129507] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-23T23:51:25.207875] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-23T23:51:25.247123] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-23T23:51:25.472159] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:51:25.548882] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-23T23:51:25.596058] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-23T23:51:25.663298] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:51:25.684166] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-23T23:51:25.706517] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-23T23:51:25.706711] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-23T23:51:25.711124] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-23T23:51:25.731827] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-23T23:51:25.763942] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-23T23:51:25.971514] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:26.061125] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-23T23:51:26.575373] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:26.622807] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-23T23:51:26.762496] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:26.783399] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-23T23:51:26.841262] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:26.841964] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-23T23:51:27.301509] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T23:51:27.305948] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-23T23:51:27.950224] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-23T23:51:27.958815] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-23T23:51:28.387309] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T23:51:28.397827] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-23T23:51:28.415833] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-23T23:51:28.654921] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-23T23:51:28.799442] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-23T23:51:29.383677] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T23:51:29.502438] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-23T23:51:29.599436] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-23T23:51:30.289141] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-23T23:51:30.392028] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-23T23:51:30.399392] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-23T23:51:31.199467] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-23T23:51:31.999434] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-23T23:51:32.157635] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-23T23:51:32.300358] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-23T23:51:32.799425] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-23T23:51:32.835179] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-23T23:51:33.599446] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-23T23:51:34.399427] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-23T23:51:34.476835] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-23T23:51:34.654524] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-23T23:51:35.199460] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-23T23:51:36.000222] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T23:51:36.000289] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-23T23:51:36.799414] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-23T23:51:37.011981] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-23T23:51:37.546681] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-23T23:51:37.599408] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-23T23:51:37.718604] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-23T23:51:38.399441] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-23T23:51:39.199479] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-23T23:51:39.252744] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-23T23:51:39.964567] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T23:51:39.999397] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-23T23:51:40.007763] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T23:51:40.799474] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-23T23:51:41.604572] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-23T23:51:41.622206] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-23T23:51:41.639895] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-23T23:51:42.399470] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-23T23:51:43.199444] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-23T23:51:43.394058] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-23T23:51:43.766318] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-23T23:51:43.999497] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-23T23:51:44.799421] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-23T23:51:45.492969] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-23T23:51:45.549982] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-23T23:51:45.599460] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-23T23:51:45.850443] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-23T23:51:45.853995] [INFO ] [REMOTE ] SOL: Full fetch complete (21012 records). [2025-10-23T23:51:45.854093] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-23T23:51:46.209198] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-23T23:51:46.209304] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-23T23:51:46.209796] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-23T23:51:46.209873] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-23T23:51:46.210417] [DEBUG] [LOCAL ] SOL: Trimmed 21012 records to 13627 (keeping 200 days of data) [2025-10-23T23:51:46.285078] [DEBUG] [LOCAL ] SOL: Primary data saved (13627 records). [2025-10-23T23:51:46.285237] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-23T23:51:46.285345] [INFO ] [MAIN ] Update Progress: 1961/2367 symbols completed. SOL took 22.6s. Estimated remaining: 52m 7s. Rate: 7.8 symbols/min [2025-10-23T23:51:46.404615] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-23T23:51:46.453906] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:46.459008] [DEBUG] [LOCAL ] SOR: Loaded 2818 existing records from primary storage. [2025-10-23T23:51:46.459197] [INFO ] [MAIN ] SOR: Loaded 2818 existing records. [2025-10-23T23:51:46.634352] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:51:46.634546] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-23T23:51:46.634620] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-23T23:51:46.634800] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-23T23:51:46.634871] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-23T23:51:46.980576] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:47.199463] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-23T23:51:47.242409] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-23T23:51:47.777176] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-23T23:51:47.999423] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-23T23:51:48.109624] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-23T23:51:48.450003] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T23:51:48.799429] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-23T23:51:49.599489] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-23T23:51:50.084158] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T23:51:50.197416] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-23T23:51:50.399443] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-23T23:51:51.199509] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-23T23:51:51.999426] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-23T23:51:52.230838] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-23T23:51:52.560288] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-23T23:51:52.799437] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-23T23:51:53.128491] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-23T23:51:53.362511] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-23T23:51:53.599430] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-23T23:51:54.141194] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T23:51:54.399412] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-23T23:51:55.199476] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-23T23:51:55.852192] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T23:51:55.999459] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-23T23:51:56.799418] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-23T23:51:57.131875] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T23:51:57.167517] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T23:51:57.175215] [INFO ] [REMOTE ] SOLV: Full fetch complete (63411 records). [2025-10-23T23:51:57.175426] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-23T23:51:57.465811] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-23T23:51:57.590053] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-23T23:51:57.590177] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-23T23:51:57.591488] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-23T23:51:57.591572] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-23T23:51:57.593044] [DEBUG] [LOCAL ] SOLV: Trimmed 63411 records to 43676 (keeping 200 days of data) [2025-10-23T23:51:57.641529] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-23T23:51:57.847616] [DEBUG] [LOCAL ] SOLV: Primary data saved (43676 records). [2025-10-23T23:51:57.847814] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-23T23:51:57.847928] [INFO ] [MAIN ] Update Progress: 1962/2367 symbols completed. SOLV took 34.1s. Estimated remaining: 51m 60s. Rate: 7.8 symbols/min [2025-10-23T23:51:58.028942] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:51:58.040127] [DEBUG] [LOCAL ] SOS: Loaded 9686 existing records from primary storage. [2025-10-23T23:51:58.040402] [INFO ] [MAIN ] SOS: Loaded 9686 existing records. [2025-10-23T23:51:58.218434] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:51:58.219080] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T23:51:58.219270] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-23T23:51:58.220803] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-23T23:51:58.221022] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-23T23:51:58.221115] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-23T23:51:58.409867] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-23T23:51:58.587952] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:51:59.199432] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-23T23:51:59.856385] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-23T23:51:59.999415] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-23T23:52:00.223330] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-23T23:52:00.655471] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-23T23:52:00.799466] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-23T23:52:01.302713] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-23T23:52:01.599425] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-23T23:52:02.095041] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T23:52:02.399496] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-23T23:52:02.893967] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-23T23:52:03.199499] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-23T23:52:03.747622] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-23T23:52:03.999430] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-23T23:52:04.541947] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T23:52:04.799450] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-23T23:52:05.263442] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-23T23:52:05.264617] [INFO ] [REMOTE ] SOR: Full fetch complete (4356 records). [2025-10-23T23:52:05.264729] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-23T23:52:05.611285] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-23T23:52:05.653025] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-23T23:52:05.653131] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-23T23:52:05.653316] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-23T23:52:05.653391] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-23T23:52:05.653824] [DEBUG] [LOCAL ] SOR: Trimmed 4356 records to 2831 (keeping 200 days of data) [2025-10-23T23:52:05.671367] [DEBUG] [LOCAL ] SOR: Primary data saved (2831 records). [2025-10-23T23:52:05.671463] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-23T23:52:05.671568] [INFO ] [MAIN ] Update Progress: 1963/2367 symbols completed. SOR took 19.4s. Estimated remaining: 51m 52s. Rate: 7.8 symbols/min [2025-10-23T23:52:05.850521] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:05.881731] [DEBUG] [LOCAL ] SPB: Loaded 34013 existing records from primary storage. [2025-10-23T23:52:05.882034] [INFO ] [MAIN ] SPB: Loaded 34013 existing records. [2025-10-23T23:52:06.074778] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:06.075092] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-23T23:52:06.075168] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-23T23:52:06.075543] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-23T23:52:06.075616] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-23T23:52:06.176552] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-23T23:52:06.401320] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-23T23:52:06.428323] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:07.199447] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-23T23:52:07.456856] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T23:52:07.999445] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-23T23:52:08.799436] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-23T23:52:09.172859] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-23T23:52:09.202084] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T23:52:09.200807] [INFO ] [REMOTE ] SONY: Full fetch complete (77411 records). [2025-10-23T23:52:09.202332] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-23T23:52:09.607612] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-23T23:52:09.609236] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-23T23:52:09.609331] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-23T23:52:09.610546] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-23T23:52:09.610757] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-23T23:52:09.612293] [DEBUG] [LOCAL ] SONY: Trimmed 77411 records to 53765 (keeping 200 days of data) [2025-10-23T23:52:09.921956] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T23:52:09.946984] [DEBUG] [LOCAL ] SONY: Primary data saved (53765 records). [2025-10-23T23:52:09.950883] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-23T23:52:09.951512] [INFO ] [MAIN ] Update Progress: 1964/2367 symbols completed. SONY took 46.2s. Estimated remaining: 51m 44s. Rate: 7.8 symbols/min [2025-10-23T23:52:10.117874] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:10.161897] [DEBUG] [LOCAL ] SPCE: Loaded 50052 existing records from primary storage. [2025-10-23T23:52:10.162252] [INFO ] [MAIN ] SPCE: Loaded 50052 existing records. [2025-10-23T23:52:10.344806] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:10.345039] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-23T23:52:10.345114] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-23T23:52:10.345349] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-23T23:52:10.345425] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-23T23:52:10.408888] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-23T23:52:10.699210] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:11.199419] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-23T23:52:11.298674] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-23T23:52:11.307179] [INFO ] [REMOTE ] SON: Full fetch complete (63035 records). [2025-10-23T23:52:11.307350] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-23T23:52:11.738158] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-23T23:52:11.738588] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-23T23:52:11.739858] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-23T23:52:11.739939] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-23T23:52:11.741601] [DEBUG] [LOCAL ] SON: Trimmed 63035 records to 43926 (keeping 200 days of data) [2025-10-23T23:52:11.848811] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-23T23:52:12.002552] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-23T23:52:12.037770] [DEBUG] [LOCAL ] SON: Primary data saved (43926 records). [2025-10-23T23:52:12.037952] [INFO ] [MAIN ] SON: Full history saved. [2025-10-23T23:52:12.038072] [INFO ] [MAIN ] Update Progress: 1965/2367 symbols completed. SON took 48.3s. Estimated remaining: 51m 35s. Rate: 7.8 symbols/min [2025-10-23T23:52:12.205626] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:12.214509] [DEBUG] [LOCAL ] SPE: Loaded 6149 existing records from primary storage. [2025-10-23T23:52:12.214774] [INFO ] [MAIN ] SPE: Loaded 6149 existing records. [2025-10-23T23:52:12.353105] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-23T23:52:12.417304] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:12.417571] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-23T23:52:12.417669] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-23T23:52:12.418145] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-23T23:52:12.418221] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-23T23:52:12.772214] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:12.799442] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-23T23:52:13.599408] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-23T23:52:13.821780] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:52:13.824315] [INFO ] [REMOTE ] SOS: Full fetch complete (11285 records). [2025-10-23T23:52:13.824423] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-23T23:52:14.224897] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-23T23:52:14.225019] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-23T23:52:14.225321] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-23T23:52:14.225395] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-23T23:52:14.225912] [DEBUG] [LOCAL ] SOS: Trimmed 11285 records to 9744 (keeping 200 days of data) [2025-10-23T23:52:14.303568] [DEBUG] [LOCAL ] SOS: Primary data saved (9744 records). [2025-10-23T23:52:14.306595] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-23T23:52:14.307128] [INFO ] [MAIN ] Update Progress: 1966/2367 symbols completed. SOS took 16.5s. Estimated remaining: 51m 26s. Rate: 7.8 symbols/min [2025-10-23T23:52:14.341725] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-23T23:52:14.403361] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-23T23:52:14.428281] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T23:52:14.504636] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:14.555057] [DEBUG] [LOCAL ] SPG: Loaded 49934 existing records from primary storage. [2025-10-23T23:52:14.555446] [INFO ] [MAIN ] SPG: Loaded 49934 existing records. [2025-10-23T23:52:14.754863] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:14.755116] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-23T23:52:14.755193] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-23T23:52:14.755692] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-23T23:52:14.755766] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-23T23:52:15.103337] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:15.199443] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-23T23:52:15.999449] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-23T23:52:16.079074] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-23T23:52:16.799476] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-23T23:52:16.957097] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-23T23:52:17.599454] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-23T23:52:18.399503] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-23T23:52:18.808733] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T23:52:19.199407] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-23T23:52:19.315360] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (4.12 seconds). [2025-10-23T23:52:19.711975] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-23T23:52:19.825934] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-23T23:52:19.999425] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-23T23:52:20.799475] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-23T23:52:21.076390] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-23T23:52:21.404198] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-23T23:52:21.529118] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-23T23:52:21.599448] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-23T23:52:22.399467] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-23T23:52:23.085273] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-23T23:52:23.099491] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-23T23:52:23.199430] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-23T23:52:23.999493] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-23T23:52:24.640465] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-23T23:52:24.799439] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-23T23:52:25.463575] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-23T23:52:25.599461] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-23T23:52:26.399463] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-23T23:52:26.510810] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-23T23:52:27.022954] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-23T23:52:27.199424] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-23T23:52:27.910806] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T23:52:27.999494] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-23T23:52:28.550377] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T23:52:28.799462] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-23T23:52:29.599493] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-23T23:52:30.208450] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-23T23:52:30.293225] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-23T23:52:30.294850] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-23T23:52:30.399413] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-23T23:52:31.199449] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-23T23:52:31.839829] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-23T23:52:31.999424] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-23T23:52:32.337258] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-23T23:52:32.607955] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T23:52:32.799482] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-23T23:52:33.599461] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-23T23:52:34.399496] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-23T23:52:34.733582] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-23T23:52:35.130586] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-23T23:52:35.199488] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-23T23:52:35.396314] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T23:52:35.999415] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-23T23:52:36.014045] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-23T23:52:36.019460] [INFO ] [REMOTE ] SPB: Full fetch complete (47710 records). [2025-10-23T23:52:36.019583] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-23T23:52:36.403124] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-23T23:52:36.403239] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-23T23:52:36.404181] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-23T23:52:36.404258] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-23T23:52:36.405246] [DEBUG] [LOCAL ] SPB: Trimmed 47710 records to 34159 (keeping 200 days of data) [2025-10-23T23:52:36.608863] [DEBUG] [LOCAL ] SPB: Primary data saved (34159 records). [2025-10-23T23:52:36.609022] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-23T23:52:36.609144] [INFO ] [MAIN ] Update Progress: 1967/2367 symbols completed. SPB took 30.9s. Estimated remaining: 51m 21s. Rate: 7.8 symbols/min [2025-10-23T23:52:36.775914] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:36.799914] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-23T23:52:36.818920] [DEBUG] [LOCAL ] SPGI: Loaded 45897 existing records from primary storage. [2025-10-23T23:52:36.819226] [INFO ] [MAIN ] SPGI: Loaded 45897 existing records. [2025-10-23T23:52:36.992988] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:36.993179] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-23T23:52:36.993254] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-23T23:52:36.993450] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-23T23:52:36.993525] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-23T23:52:37.345904] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:37.404119] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T23:52:37.405535] [INFO ] [REMOTE ] SPE: Full fetch complete (9774 records). [2025-10-23T23:52:37.405665] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-23T23:52:37.607096] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-23T23:52:37.784949] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-23T23:52:37.785054] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-23T23:52:37.785319] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-23T23:52:37.785399] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-23T23:52:37.785879] [DEBUG] [LOCAL ] SPE: Trimmed 9774 records to 6180 (keeping 200 days of data) [2025-10-23T23:52:37.823059] [DEBUG] [LOCAL ] SPE: Primary data saved (6180 records). [2025-10-23T23:52:37.823218] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-23T23:52:37.823426] [INFO ] [MAIN ] Update Progress: 1968/2367 symbols completed. SPE took 25.8s. Estimated remaining: 51m 12s. Rate: 7.8 symbols/min [2025-10-23T23:52:38.000288] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-23T23:52:38.019427] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:38.044842] [DEBUG] [LOCAL ] SPH: Loaded 16482 existing records from primary storage. [2025-10-23T23:52:38.045097] [INFO ] [MAIN ] SPH: Loaded 16482 existing records. [2025-10-23T23:52:38.218451] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:38.218675] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-23T23:52:38.218761] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-23T23:52:38.218943] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-23T23:52:38.219013] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-23T23:52:38.409827] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-23T23:52:38.612411] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:39.199428] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-23T23:52:39.266134] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:52:39.984498] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-23T23:52:39.999387] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-23T23:52:40.653295] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-23T23:52:40.799424] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-23T23:52:41.551521] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T23:52:41.599414] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-23T23:52:42.351869] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-23T23:52:42.399434] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-23T23:52:42.841826] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-23T23:52:43.199445] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-23T23:52:43.999433] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-23T23:52:44.194018] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-23T23:52:44.646384] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-23T23:52:44.799428] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-23T23:52:45.599420] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-23T23:52:45.779393] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-23T23:52:46.364507] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-23T23:52:46.399399] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-23T23:52:46.602933] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-23T23:52:47.199491] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-23T23:52:47.999469] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-23T23:52:48.124847] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-23T23:52:48.799405] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-23T23:52:49.056271] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-23T23:52:49.077275] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T23:52:49.599450] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-23T23:52:50.399439] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-23T23:52:50.481909] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-23T23:52:51.199422] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-23T23:52:51.838464] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-23T23:52:51.936364] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-23T23:52:51.948005] [INFO ] [REMOTE ] SPG: Full fetch complete (72051 records). [2025-10-23T23:52:51.948217] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-23T23:52:52.004544] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-23T23:52:52.334856] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-23T23:52:52.334986] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-23T23:52:52.336297] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-23T23:52:52.336393] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-23T23:52:52.337819] [DEBUG] [LOCAL ] SPG: Trimmed 72051 records to 50304 (keeping 200 days of data) [2025-10-23T23:52:52.646297] [DEBUG] [LOCAL ] SPG: Primary data saved (50304 records). [2025-10-23T23:52:52.646469] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-23T23:52:52.646604] [INFO ] [MAIN ] Update Progress: 1969/2367 symbols completed. SPG took 38.3s. Estimated remaining: 51m 6s. Rate: 7.8 symbols/min [2025-10-23T23:52:52.814873] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-23T23:52:52.818239] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:52.855898] [DEBUG] [LOCAL ] SPHR: Loaded 40681 existing records from primary storage. [2025-10-23T23:52:52.856210] [INFO ] [MAIN ] SPHR: Loaded 40681 existing records. [2025-10-23T23:52:53.031982] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:53.032168] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-23T23:52:53.032241] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-23T23:52:53.032512] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-23T23:52:53.032594] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-23T23:52:53.383714] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:53.508947] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-23T23:52:53.599484] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-23T23:52:53.649327] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T23:52:54.268965] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-23T23:52:54.279610] [INFO ] [REMOTE ] SPCE: Full fetch complete (72669 records). [2025-10-23T23:52:54.279853] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-23T23:52:54.404588] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-23T23:52:54.709203] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-23T23:52:54.709334] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-23T23:52:54.710821] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-23T23:52:54.710904] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-23T23:52:54.712414] [DEBUG] [LOCAL ] SPCE: Trimmed 72669 records to 50424 (keeping 200 days of data) [2025-10-23T23:52:54.999319] [DEBUG] [LOCAL ] SPCE: Primary data saved (50424 records). [2025-10-23T23:52:54.999668] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-23T23:52:54.999797] [INFO ] [MAIN ] Update Progress: 1970/2367 symbols completed. SPCE took 45.0s. Estimated remaining: 50m 57s. Rate: 7.8 symbols/min [2025-10-23T23:52:55.189346] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T23:52:55.192235] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:52:55.200670] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-23T23:52:55.212419] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-23T23:52:55.245954] [DEBUG] [LOCAL ] SPIR: Loaded 37535 existing records from primary storage. [2025-10-23T23:52:55.246288] [INFO ] [MAIN ] SPIR: Loaded 37535 existing records. [2025-10-23T23:52:55.419800] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:52:55.420059] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-23T23:52:55.420164] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-23T23:52:55.420427] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-23T23:52:55.420507] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-23T23:52:55.780687] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:52:55.999418] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-23T23:52:56.799415] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-23T23:52:57.163447] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-23T23:52:57.412078] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-23T23:52:57.599415] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-23T23:52:57.816897] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-23T23:52:58.399452] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-23T23:52:59.199433] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-23T23:52:59.521711] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-23T23:52:59.999416] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-23T23:53:00.498760] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-23T23:53:00.713558] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T23:53:00.799425] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-23T23:53:01.599425] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-23T23:53:01.757356] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-23T23:53:01.760423] [INFO ] [REMOTE ] SPH: Full fetch complete (27748 records). [2025-10-23T23:53:01.760555] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-23T23:53:02.133533] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-23T23:53:02.188500] [INFO ] [REMOTE ] SPGI: Full fetch complete (67822 records). [2025-10-23T23:53:02.188756] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-23T23:53:02.188839] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-23T23:53:02.189045] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-23T23:53:02.189697] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-23T23:53:02.189848] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-23T23:53:02.275022] [DEBUG] [LOCAL ] SPH: Trimmed 27748 records to 16559 (keeping 200 days of data) [2025-10-23T23:53:02.406774] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-23T23:53:02.684585] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-23T23:53:02.686814] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-23T23:53:02.688406] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-23T23:53:02.688519] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-23T23:53:02.693602] [DEBUG] [LOCAL ] SPH: Primary data saved (16559 records). [2025-10-23T23:53:02.693744] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-23T23:53:02.693878] [INFO ] [MAIN ] Update Progress: 1971/2367 symbols completed. SPH took 24.9s. Estimated remaining: 50m 50s. Rate: 7.8 symbols/min [2025-10-23T23:53:02.778126] [DEBUG] [LOCAL ] SPGI: Trimmed 67822 records to 46248 (keeping 200 days of data) [2025-10-23T23:53:02.943160] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:03.018795] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-23T23:53:03.033908] [DEBUG] [LOCAL ] SPMC: Loaded 5246 existing records from primary storage. [2025-10-23T23:53:03.038875] [INFO ] [MAIN ] SPMC: Loaded 5246 existing records. [2025-10-23T23:53:03.209499] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-23T23:53:03.345789] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:53:03.348583] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-23T23:53:03.349265] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-23T23:53:03.349933] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-23T23:53:03.350243] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-23T23:53:03.579843] [DEBUG] [LOCAL ] SPGI: Primary data saved (46248 records). [2025-10-23T23:53:03.614805] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-23T23:53:03.628327] [INFO ] [MAIN ] Update Progress: 1972/2367 symbols completed. SPGI took 27.0s. Estimated remaining: 50m 41s. Rate: 7.8 symbols/min [2025-10-23T23:53:03.935287] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:03.955887] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-23T23:53:03.959501] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-23T23:53:03.959360] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:03.959969] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-23T23:53:03.960093] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-23T23:53:03.960672] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-23T23:53:03.960845] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-23T23:53:04.003161] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-23T23:53:04.125293] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-23T23:53:04.344759] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:04.691207] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-23T23:53:04.723771] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T23:53:04.799405] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-23T23:53:05.599445] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-23T23:53:06.245161] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-23T23:53:06.399402] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-23T23:53:06.433133] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-23T23:53:07.116308] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-23T23:53:07.199409] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-23T23:53:07.863140] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-23T23:53:07.999416] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-23T23:53:08.799430] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-10-23T23:53:08.999881] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:53:09.000246] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-10-23T23:53:09.000355] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:53:09.000428] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-23T23:53:09.000498] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:53:09.000588] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-23T23:53:09.000732] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-23T23:53:09.000824] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-23T23:53:09.000926] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-23T23:53:09.001020] [INFO ] [MAIN ] Update Progress: 1973/2367 symbols completed. SPME took 5.4s. Estimated remaining: 50m 32s. Rate: 7.8 symbols/min [2025-10-23T23:53:09.182590] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:09.221164] [DEBUG] [LOCAL ] SPNT: Loaded 34220 existing records from primary storage. [2025-10-23T23:53:09.221479] [INFO ] [MAIN ] SPNT: Loaded 34220 existing records. [2025-10-23T23:53:09.400271] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:53:09.400483] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-23T23:53:09.400557] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-23T23:53:09.400823] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-23T23:53:09.400897] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-23T23:53:09.607301] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-23T23:53:09.759581] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:09.928287] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T23:53:10.399500] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-23T23:53:11.167349] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-23T23:53:11.199452] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-23T23:53:11.914983] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-23T23:53:11.939936] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T23:53:11.999414] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-23T23:53:12.799447] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-23T23:53:13.220153] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T23:53:13.599450] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-23T23:53:14.399411] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-23T23:53:14.430455] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-23T23:53:14.852554] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-23T23:53:15.199513] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-23T23:53:15.813942] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-23T23:53:15.999423] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-23T23:53:16.629803] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-23T23:53:16.799418] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-23T23:53:17.135380] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-23T23:53:17.494910] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-23T23:53:17.599455] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-23T23:53:18.399472] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-23T23:53:18.882868] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-23T23:53:19.199465] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-23T23:53:19.999454] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-23T23:53:20.139792] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-23T23:53:20.704721] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T23:53:20.763992] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-23T23:53:20.799391] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-23T23:53:21.382629] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-23T23:53:21.599467] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-23T23:53:22.399441] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-23T23:53:22.903341] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T23:53:23.038526] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-23T23:53:23.199493] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-23T23:53:23.999445] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-23T23:53:24.698536] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-23T23:53:24.799404] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-23T23:53:25.505679] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-23T23:53:25.599435] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-23T23:53:25.831168] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-23T23:53:26.399466] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-23T23:53:27.001629] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-23T23:53:27.003261] [INFO ] [REMOTE ] SPMC: Full fetch complete (8388 records). [2025-10-23T23:53:27.003353] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-23T23:53:27.207012] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-23T23:53:27.312890] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-23T23:53:27.400589] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-23T23:53:27.400736] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-23T23:53:27.401009] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-23T23:53:27.401104] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-23T23:53:27.401553] [DEBUG] [LOCAL ] SPMC: Trimmed 8388 records to 5288 (keeping 200 days of data) [2025-10-23T23:53:27.432854] [DEBUG] [LOCAL ] SPMC: Primary data saved (5288 records). [2025-10-23T23:53:27.433005] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-23T23:53:27.433139] [INFO ] [MAIN ] Update Progress: 1974/2367 symbols completed. SPMC took 24.7s. Estimated remaining: 50m 27s. Rate: 7.8 symbols/min [2025-10-23T23:53:27.603315] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:27.603560] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-10-23T23:53:27.603673] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-10-23T23:53:27.603815] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-23T23:53:27.603907] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-23T23:53:27.604019] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-23T23:53:27.604106] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-23T23:53:27.951042] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:27.999418] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-23T23:53:28.799438] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-23T23:53:29.048236] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-23T23:53:29.449368] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-23T23:53:29.599425] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-23T23:53:30.262951] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:53:30.399514] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-23T23:53:31.158331] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-23T23:53:31.165387] [INFO ] [REMOTE ] SPIR: Full fetch complete (54186 records). [2025-10-23T23:53:31.165560] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-23T23:53:31.204575] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-23T23:53:31.548893] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-23T23:53:31.549006] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-23T23:53:31.550132] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-23T23:53:31.550214] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-23T23:53:31.551370] [DEBUG] [LOCAL ] SPIR: Trimmed 54186 records to 37729 (keeping 200 days of data) [2025-10-23T23:53:31.764886] [DEBUG] [LOCAL ] SPIR: Primary data saved (37729 records). [2025-10-23T23:53:31.765062] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-23T23:53:31.765206] [INFO ] [MAIN ] Update Progress: 1975/2367 symbols completed. SPIR took 36.8s. Estimated remaining: 50m 18s. Rate: 7.8 symbols/min [2025-10-23T23:53:31.936295] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:31.976695] [DEBUG] [LOCAL ] SPR: Loaded 40712 existing records from primary storage. [2025-10-23T23:53:31.977128] [INFO ] [MAIN ] SPR: Loaded 40712 existing records. [2025-10-23T23:53:32.009056] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-23T23:53:32.161956] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:53:32.162156] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-23T23:53:32.162238] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-23T23:53:32.162484] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-23T23:53:32.162559] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-23T23:53:32.537627] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:32.563178] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-23T23:53:32.587016] [INFO ] [REMOTE ] SPNT: Full fetch complete (48392 records). [2025-10-23T23:53:32.588318] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-23T23:53:32.588597] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-23T23:53:32.809888] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-23T23:53:32.999307] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-23T23:53:32.999426] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-23T23:53:33.000447] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-23T23:53:33.000527] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-23T23:53:33.001573] [DEBUG] [LOCAL ] SPNT: Trimmed 48392 records to 34415 (keeping 200 days of data) [2025-10-23T23:53:33.198052] [DEBUG] [LOCAL ] SPNT: Primary data saved (34415 records). [2025-10-23T23:53:33.198227] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-23T23:53:33.198344] [INFO ] [MAIN ] Update Progress: 1976/2367 symbols completed. SPNT took 24.2s. Estimated remaining: 50m 9s. Rate: 7.8 symbols/min [2025-10-23T23:53:33.363329] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:33.374325] [DEBUG] [LOCAL ] SPRU: Loaded 9997 existing records from primary storage. [2025-10-23T23:53:33.374567] [INFO ] [MAIN ] SPRU: Loaded 9997 existing records. [2025-10-23T23:53:33.572043] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:53:33.572790] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-23T23:53:33.573080] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-23T23:53:33.573322] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-23T23:53:33.573456] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-23T23:53:33.604630] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-23T23:53:33.775661] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-23T23:53:33.866560] [INFO ] [REMOTE ] SPHR: Full fetch complete (58815 records). [2025-10-23T23:53:33.887242] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-23T23:53:34.084170] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:34.345997] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-23T23:53:34.346111] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-23T23:53:34.347328] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-23T23:53:34.347409] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-23T23:53:34.348713] [DEBUG] [LOCAL ] SPHR: Trimmed 58815 records to 40951 (keeping 200 days of data) [2025-10-23T23:53:34.404854] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-23T23:53:34.582616] [DEBUG] [LOCAL ] SPHR: Primary data saved (40951 records). [2025-10-23T23:53:34.582796] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-23T23:53:34.582909] [INFO ] [MAIN ] Update Progress: 1977/2367 symbols completed. SPHR took 41.9s. Estimated remaining: 50m 1s. Rate: 7.8 symbols/min [2025-10-23T23:53:34.752279] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:34.773938] [DEBUG] [LOCAL ] SPXC: Loaded 23163 existing records from primary storage. [2025-10-23T23:53:34.774261] [INFO ] [MAIN ] SPXC: Loaded 23163 existing records. [2025-10-23T23:53:34.953633] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:53:34.954339] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-23T23:53:34.954448] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-23T23:53:34.955319] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-23T23:53:34.955427] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-23T23:53:35.171751] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-23T23:53:35.173984] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-23T23:53:35.208042] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-23T23:53:35.362419] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:35.390479] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-23T23:53:35.999431] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-23T23:53:36.808937] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-23T23:53:36.811296] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:53:37.599465] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-23T23:53:38.207559] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-23T23:53:38.323391] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-23T23:53:38.399412] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-23T23:53:38.796639] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-23T23:53:39.199489] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-23T23:53:39.767961] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-23T23:53:39.999402] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-23T23:53:40.799564] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-23T23:53:40.999997] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-23T23:53:41.132556] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-23T23:53:41.599516] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-23T23:53:42.279932] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-23T23:53:42.399407] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-23T23:53:42.862134] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-23T23:53:43.199443] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-23T23:53:43.999475] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-23T23:53:44.080444] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-23T23:53:44.568497] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-23T23:53:44.799443] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-23T23:53:45.599427] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-23T23:53:45.803388] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-23T23:53:45.904110] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T23:53:46.399455] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-23T23:53:46.985093] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-23T23:53:46.984955] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-23T23:53:47.199419] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-23T23:53:47.999522] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-23T23:53:48.686213] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-23T23:53:48.736237] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-23T23:53:48.799433] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-23T23:53:49.599425] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-23T23:53:49.791262] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-23T23:53:50.399504] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-23T23:53:50.936221] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-23T23:53:51.082774] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-23T23:53:51.199406] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-23T23:53:51.693997] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T23:53:51.999466] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-23T23:53:52.799496] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-23T23:53:53.599487] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-23T23:53:54.020017] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-23T23:53:54.206370] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-23T23:53:54.378594] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T23:53:54.399404] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-23T23:53:55.199417] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-23T23:53:55.446015] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-23T23:53:55.999496] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-23T23:53:56.740860] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-23T23:53:56.799400] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-23T23:53:57.448715] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-23T23:53:57.480917] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-23T23:53:57.483929] [INFO ] [REMOTE ] SPRU: Full fetch complete (12196 records). [2025-10-23T23:53:57.484038] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-23T23:53:57.604549] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-23T23:53:57.858295] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-23T23:53:57.858410] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-23T23:53:57.858733] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-23T23:53:57.858810] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-23T23:53:57.859305] [DEBUG] [LOCAL ] SPRU: Trimmed 12196 records to 10031 (keeping 200 days of data) [2025-10-23T23:53:57.912943] [DEBUG] [LOCAL ] SPRU: Primary data saved (10031 records). [2025-10-23T23:53:57.913089] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-23T23:53:57.913199] [INFO ] [MAIN ] Update Progress: 1978/2367 symbols completed. SPRU took 24.7s. Estimated remaining: 49m 56s. Rate: 7.8 symbols/min [2025-10-23T23:53:58.079331] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:53:58.089887] [DEBUG] [LOCAL ] SPXX: Loaded 9114 existing records from primary storage. [2025-10-23T23:53:58.090121] [INFO ] [MAIN ] SPXX: Loaded 9114 existing records. [2025-10-23T23:53:58.264376] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:53:58.264555] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-23T23:53:58.264636] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-23T23:53:58.264854] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-23T23:53:58.264933] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-23T23:53:58.410849] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-23T23:53:58.631023] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:53:59.072559] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T23:53:59.199426] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-23T23:53:59.708852] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-23T23:53:59.999459] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-23T23:54:00.727169] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T23:54:00.734107] [INFO ] [REMOTE ] SPR: Full fetch complete (59818 records). [2025-10-23T23:54:00.734229] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-23T23:54:00.804679] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-23T23:54:01.122306] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-23T23:54:01.122420] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-23T23:54:01.123611] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-23T23:54:01.123714] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-23T23:54:01.124860] [DEBUG] [LOCAL ] SPR: Trimmed 59818 records to 40937 (keeping 200 days of data) [2025-10-23T23:54:01.362325] [DEBUG] [LOCAL ] SPR: Primary data saved (40937 records). [2025-10-23T23:54:01.362485] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-23T23:54:01.362627] [INFO ] [MAIN ] Update Progress: 1979/2367 symbols completed. SPR took 29.6s. Estimated remaining: 49m 47s. Rate: 7.8 symbols/min [2025-10-23T23:54:01.540579] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:01.540795] [DEBUG] [LOCAL ] SQM: No existing data file found in primary storage. [2025-10-23T23:54:01.540871] [WARN ] [MAIN ] SQM: No existing data found, performing full refresh instead. [2025-10-23T23:54:01.540980] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-23T23:54:01.541051] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-23T23:54:01.541130] [DEBUG] [LOCAL ] SQM: No primary data file found to delete. [2025-10-23T23:54:01.541199] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-23T23:54:01.606090] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-23T23:54:01.663632] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-23T23:54:01.925586] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:02.111259] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-23T23:54:02.399480] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-23T23:54:02.679777] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-23T23:54:03.199511] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-23T23:54:03.999440] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-23T23:54:04.180141] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-23T23:54:04.799423] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-23T23:54:04.988060] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-23T23:54:05.078779] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-23T23:54:05.082814] [INFO ] [REMOTE ] SPXC: Full fetch complete (34106 records). [2025-10-23T23:54:05.082910] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-23T23:54:05.442867] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-23T23:54:05.442975] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-23T23:54:05.443664] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-23T23:54:05.443750] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-23T23:54:05.444492] [DEBUG] [LOCAL ] SPXC: Trimmed 34106 records to 23294 (keeping 200 days of data) [2025-10-23T23:54:05.579277] [DEBUG] [LOCAL ] SPXC: Primary data saved (23294 records). [2025-10-23T23:54:05.579418] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-23T23:54:05.579525] [INFO ] [MAIN ] Update Progress: 1980/2367 symbols completed. SPXC took 31.0s. Estimated remaining: 49m 39s. Rate: 7.8 symbols/min [2025-10-23T23:54:05.610250] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-23T23:54:05.777955] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:05.804490] [DEBUG] [LOCAL ] SQNS: Loaded 28139 existing records from primary storage. [2025-10-23T23:54:05.804802] [INFO ] [MAIN ] SQNS: Loaded 28139 existing records. [2025-10-23T23:54:05.982209] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:05.982444] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-23T23:54:05.982521] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-23T23:54:05.982736] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-23T23:54:05.982808] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-23T23:54:06.351975] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:06.399408] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-23T23:54:06.446596] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-23T23:54:06.786220] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-23T23:54:06.795343] [INFO ] [REMOTE ] SPOT: Full fetch complete (73762 records). [2025-10-23T23:54:06.795538] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-23T23:54:07.190455] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-23T23:54:07.190583] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-23T23:54:07.191807] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-23T23:54:07.191888] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-23T23:54:07.193366] [DEBUG] [LOCAL ] SPOT: Trimmed 73762 records to 50537 (keeping 200 days of data) [2025-10-23T23:54:07.245051] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-23T23:54:07.326121] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-23T23:54:07.517884] [DEBUG] [LOCAL ] SPOT: Primary data saved (50537 records). [2025-10-23T23:54:07.518049] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-23T23:54:07.518152] [INFO ] [MAIN ] Update Progress: 1981/2367 symbols completed. SPOT took 40.1s. Estimated remaining: 49m 30s. Rate: 7.8 symbols/min [2025-10-23T23:54:07.683259] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:07.713951] [DEBUG] [LOCAL ] SR: Loaded 32257 existing records from primary storage. [2025-10-23T23:54:07.714250] [INFO ] [MAIN ] SR: Loaded 32257 existing records. [2025-10-23T23:54:07.901214] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:07.901415] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-23T23:54:07.901489] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-23T23:54:07.901752] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-23T23:54:07.901824] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-23T23:54:08.000765] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-23T23:54:08.252445] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:08.802742] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-23T23:54:08.807867] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-23T23:54:08.856727] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-23T23:54:09.599469] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-23T23:54:09.611323] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-23T23:54:10.399491] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-23T23:54:10.424849] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-23T23:54:11.199486] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-23T23:54:11.590388] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T23:54:11.999455] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-23T23:54:12.560237] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-23T23:54:12.800907] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-23T23:54:12.803598] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-23T23:54:13.528103] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-23T23:54:13.599435] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-23T23:54:14.333348] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-23T23:54:14.399417] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-23T23:54:15.199439] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-23T23:54:15.977239] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-23T23:54:16.004816] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-23T23:54:16.010733] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-23T23:54:16.724786] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-23T23:54:16.799453] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-23T23:54:17.599435] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-23T23:54:18.086922] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-23T23:54:18.390266] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-23T23:54:18.399389] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-23T23:54:19.199410] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-23T23:54:19.378212] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-23T23:54:19.814265] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-23T23:54:19.999482] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-23T23:54:20.799468] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-23T23:54:21.363486] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T23:54:21.378543] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-23T23:54:21.599457] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-23T23:54:22.399454] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-23T23:54:22.456110] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-23T23:54:22.458731] [INFO ] [REMOTE ] SPXX: Full fetch complete (13484 records). [2025-10-23T23:54:22.458824] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-23T23:54:22.814631] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-23T23:54:22.814773] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-23T23:54:22.815089] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-23T23:54:22.815159] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-23T23:54:22.815738] [DEBUG] [LOCAL ] SPXX: Trimmed 13484 records to 9189 (keeping 200 days of data) [2025-10-23T23:54:22.872913] [DEBUG] [LOCAL ] SPXX: Primary data saved (9189 records). [2025-10-23T23:54:22.873076] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-23T23:54:22.873241] [INFO ] [MAIN ] Update Progress: 1982/2367 symbols completed. SPXX took 25.0s. Estimated remaining: 49m 24s. Rate: 7.8 symbols/min [2025-10-23T23:54:23.041185] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:23.091183] [DEBUG] [LOCAL ] SRE: Loaded 53408 existing records from primary storage. [2025-10-23T23:54:23.091525] [INFO ] [MAIN ] SRE: Loaded 53408 existing records. [2025-10-23T23:54:23.204753] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-23T23:54:23.268088] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:23.268363] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-23T23:54:23.268438] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-23T23:54:23.268715] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-23T23:54:23.268790] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-23T23:54:23.623426] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:23.943349] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-23T23:54:23.999401] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-23T23:54:24.799473] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-23T23:54:25.432018] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-23T23:54:25.513575] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-23T23:54:25.599424] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-23T23:54:26.206203] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-23T23:54:26.399566] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-23T23:54:27.199465] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-23T23:54:27.482483] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-23T23:54:27.999437] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-23T23:54:28.313087] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-23T23:54:28.636448] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-23T23:54:28.799467] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-23T23:54:29.599526] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-23T23:54:29.684974] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-23T23:54:30.272211] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T23:54:30.399475] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-23T23:54:30.895922] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T23:54:31.199450] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-23T23:54:31.586355] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-23T23:54:31.592956] [INFO ] [REMOTE ] SQNS: Full fetch complete (33143 records). [2025-10-23T23:54:31.593110] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-23T23:54:31.963441] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-23T23:54:31.963566] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-23T23:54:31.964278] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-23T23:54:31.964359] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-23T23:54:31.965314] [DEBUG] [LOCAL ] SQNS: Trimmed 33143 records to 28317 (keeping 200 days of data) [2025-10-23T23:54:32.011335] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-23T23:54:32.140753] [DEBUG] [LOCAL ] SQNS: Primary data saved (28317 records). [2025-10-23T23:54:32.140937] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-23T23:54:32.141056] [INFO ] [MAIN ] Update Progress: 1983/2367 symbols completed. SQNS took 26.6s. Estimated remaining: 49m 17s. Rate: 7.8 symbols/min [2025-10-23T23:54:32.344038] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:32.357012] [DEBUG] [LOCAL ] SREA: Loaded 9661 existing records from primary storage. [2025-10-23T23:54:32.357276] [INFO ] [MAIN ] SREA: Loaded 9661 existing records. [2025-10-23T23:54:32.555358] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:32.555615] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-23T23:54:32.555718] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-23T23:54:32.555959] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-23T23:54:32.556034] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-23T23:54:32.806124] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-23T23:54:32.991006] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:32.996344] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-23T23:54:33.599484] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-23T23:54:33.745971] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T23:54:34.280032] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-23T23:54:34.399425] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-23T23:54:34.425551] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-23T23:54:35.199458] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-23T23:54:35.748598] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-23T23:54:35.999435] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-23T23:54:36.768716] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T23:54:36.799401] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-23T23:54:37.026854] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-23T23:54:37.568728] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T23:54:37.599412] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-23T23:54:38.399525] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-23T23:54:39.199508] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-23T23:54:39.268327] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-23T23:54:39.999472] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-23T23:54:40.181545] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-23T23:54:40.711937] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-23T23:54:40.799411] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-23T23:54:40.863450] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-23T23:54:41.599422] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-23T23:54:41.971899] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T23:54:41.977261] [INFO ] [REMOTE ] SR: Full fetch complete (46182 records). [2025-10-23T23:54:41.977454] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-23T23:54:42.356289] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-23T23:54:42.356417] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-23T23:54:42.357365] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-23T23:54:42.357444] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-23T23:54:42.358545] [DEBUG] [LOCAL ] SR: Trimmed 46182 records to 32475 (keeping 200 days of data) [2025-10-23T23:54:42.411515] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-23T23:54:42.559208] [DEBUG] [LOCAL ] SR: Primary data saved (32475 records). [2025-10-23T23:54:42.559372] [INFO ] [MAIN ] SR: Full history saved. [2025-10-23T23:54:42.559492] [INFO ] [MAIN ] Update Progress: 1984/2367 symbols completed. SR took 35.0s. Estimated remaining: 49m 9s. Rate: 7.8 symbols/min [2025-10-23T23:54:42.732887] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:42.769034] [DEBUG] [LOCAL ] SRFM: Loaded 40036 existing records from primary storage. [2025-10-23T23:54:42.769345] [INFO ] [MAIN ] SRFM: Loaded 40036 existing records. [2025-10-23T23:54:42.946981] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:42.947175] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-23T23:54:42.947258] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-23T23:54:42.947532] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-23T23:54:42.947608] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-23T23:54:43.199549] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-23T23:54:43.306598] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:43.335364] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-23T23:54:43.999413] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-23T23:54:44.133270] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-23T23:54:44.175200] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T23:54:44.185295] [INFO ] [REMOTE ] SQM: Full fetch complete (69847 records). [2025-10-23T23:54:44.185511] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-23T23:54:44.662000] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-23T23:54:44.662134] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-23T23:54:44.663486] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-23T23:54:44.663580] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-23T23:54:44.665092] [DEBUG] [LOCAL ] SQM: Trimmed 69847 records to 49265 (keeping 200 days of data) [2025-10-23T23:54:44.841064] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-23T23:54:44.982833] [DEBUG] [LOCAL ] SQM: Primary data saved (49265 records). [2025-10-23T23:54:44.983028] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-23T23:54:44.983148] [INFO ] [MAIN ] Update Progress: 1985/2367 symbols completed. SQM took 43.6s. Estimated remaining: 49m 1s. Rate: 7.8 symbols/min [2025-10-23T23:54:45.181513] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:45.197443] [DEBUG] [LOCAL ] SRG: Loaded 14642 existing records from primary storage. [2025-10-23T23:54:45.197844] [INFO ] [MAIN ] SRG: Loaded 14642 existing records. [2025-10-23T23:54:45.388157] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:45.388736] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-23T23:54:45.388832] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-23T23:54:45.389037] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-23T23:54:45.389110] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-23T23:54:45.608570] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-23T23:54:45.747531] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:45.776248] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-23T23:54:46.140828] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-23T23:54:46.399438] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-23T23:54:46.442687] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-23T23:54:47.199513] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-23T23:54:47.644205] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-23T23:54:47.999467] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-23T23:54:48.799416] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-23T23:54:49.009444] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-23T23:54:49.119680] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-23T23:54:49.405211] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-23T23:54:49.599433] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-23T23:54:50.345587] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-23T23:54:50.399410] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-23T23:54:50.908558] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-23T23:54:51.199428] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-23T23:54:51.844464] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-23T23:54:51.846508] [INFO ] [REMOTE ] SREA: Full fetch complete (14691 records). [2025-10-23T23:54:51.846605] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-23T23:54:52.006878] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-23T23:54:52.269241] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-23T23:54:52.269360] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-23T23:54:52.269784] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-23T23:54:52.269863] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-23T23:54:52.270406] [DEBUG] [LOCAL ] SREA: Trimmed 14691 records to 9711 (keeping 200 days of data) [2025-10-23T23:54:52.331832] [DEBUG] [LOCAL ] SREA: Primary data saved (9711 records). [2025-10-23T23:54:52.331997] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-23T23:54:52.332131] [INFO ] [MAIN ] Update Progress: 1986/2367 symbols completed. SREA took 20.2s. Estimated remaining: 48m 53s. Rate: 7.8 symbols/min [2025-10-23T23:54:52.525059] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:54:52.551033] [DEBUG] [LOCAL ] SRI: Loaded 26227 existing records from primary storage. [2025-10-23T23:54:52.551332] [INFO ] [MAIN ] SRI: Loaded 26227 existing records. [2025-10-23T23:54:52.752748] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:54:52.752927] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-23T23:54:52.753007] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-23T23:54:52.753201] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-23T23:54:52.753293] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-23T23:54:52.811956] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-23T23:54:53.106726] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:54:53.599438] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-23T23:54:53.779135] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-23T23:54:54.047915] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-23T23:54:54.399423] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-23T23:54:54.631082] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T23:54:55.199510] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-23T23:54:55.550417] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-23T23:54:55.999460] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-23T23:54:56.396749] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-23T23:54:56.799452] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-23T23:54:57.599428] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-23T23:54:57.796020] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-23T23:54:57.911171] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-23T23:54:58.399445] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-23T23:54:59.130388] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-23T23:54:59.199404] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-23T23:54:59.288539] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-23T23:54:59.999410] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-23T23:55:00.050291] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-23T23:55:00.799434] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-23T23:55:01.599464] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-23T23:55:02.332611] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-23T23:55:02.342318] [INFO ] [REMOTE ] SRE: Full fetch complete (77495 records). [2025-10-23T23:55:02.342514] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-23T23:55:02.406290] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-23T23:55:02.758459] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-23T23:55:02.758770] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-23T23:55:02.774216] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-23T23:55:02.774836] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-23T23:55:02.793323] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-23T23:55:02.819125] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-23T23:55:02.831011] [DEBUG] [LOCAL ] SRE: Trimmed 77495 records to 53793 (keeping 200 days of data) [2025-10-23T23:55:03.153995] [DEBUG] [LOCAL ] SRE: Primary data saved (53793 records). [2025-10-23T23:55:03.154152] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-23T23:55:03.155592] [INFO ] [MAIN ] Update Progress: 1987/2367 symbols completed. SRE took 40.3s. Estimated remaining: 48m 46s. Rate: 7.8 symbols/min [2025-10-23T23:55:03.209487] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-23T23:55:03.323726] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:03.323918] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-23T23:55:03.324017] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-23T23:55:03.324101] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-23T23:55:03.324165] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-23T23:55:03.324224] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-23T23:55:03.324300] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-23T23:55:03.676915] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:03.870838] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T23:55:03.999420] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-23T23:55:04.231020] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-23T23:55:04.501529] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-23T23:55:04.799435] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-23T23:55:05.599432] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-23T23:55:06.399430] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-23T23:55:06.708024] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T23:55:06.805157] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-23T23:55:06.952742] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-23T23:55:07.199440] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-23T23:55:07.565472] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-23T23:55:07.999445] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-23T23:55:08.420501] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-23T23:55:08.799448] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-23T23:55:09.173078] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-23T23:55:09.599482] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-23T23:55:10.399473] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-23T23:55:10.985475] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-23T23:55:11.199418] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-23T23:55:11.256042] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-23T23:55:11.999446] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-23T23:55:12.468306] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T23:55:12.799435] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-23T23:55:13.234263] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-23T23:55:13.599431] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-23T23:55:13.746460] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-23T23:55:14.399455] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-23T23:55:14.739391] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-23T23:55:15.116085] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T23:55:15.199434] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-23T23:55:15.999432] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-23T23:55:16.799435] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-23T23:55:17.386971] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-23T23:55:17.491613] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-23T23:55:17.500511] [INFO ] [REMOTE ] SRFM: Full fetch complete (51353 records). [2025-10-23T23:55:17.500673] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-23T23:55:17.599927] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-23T23:55:17.615709] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-23T23:55:17.669743] [INFO ] [REMOTE ] SRG: Full fetch complete (23229 records). [2025-10-23T23:55:17.680910] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-23T23:55:18.193437] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-23T23:55:18.193582] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-23T23:55:18.194948] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-23T23:55:18.210601] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-23T23:55:18.256041] [DEBUG] [LOCAL ] SRFM: Trimmed 51353 records to 40399 (keeping 200 days of data) [2025-10-23T23:55:18.282965] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-23T23:55:18.283277] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-23T23:55:18.283574] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-23T23:55:18.283683] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-23T23:55:18.284515] [DEBUG] [LOCAL ] SRG: Trimmed 23229 records to 14820 (keeping 200 days of data) [2025-10-23T23:55:18.402587] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-23T23:55:18.456592] [DEBUG] [LOCAL ] SRG: Primary data saved (14820 records). [2025-10-23T23:55:18.457317] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-23T23:55:18.457451] [INFO ] [MAIN ] Update Progress: 1988/2367 symbols completed. SRG took 33.5s. Estimated remaining: 48m 40s. Rate: 7.8 symbols/min [2025-10-23T23:55:18.737580] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:18.772043] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-23T23:55:18.787829] [DEBUG] [LOCAL ] SRV: Loaded 7379 existing records from primary storage. [2025-10-23T23:55:18.792880] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-23T23:55:18.793139] [INFO ] [MAIN ] SRV: Loaded 7379 existing records. [2025-10-23T23:55:18.901575] [DEBUG] [LOCAL ] SRFM: Primary data saved (40399 records). [2025-10-23T23:55:18.912427] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-23T23:55:18.918138] [INFO ] [MAIN ] Update Progress: 1989/2367 symbols completed. SRFM took 36.4s. Estimated remaining: 48m 30s. Rate: 7.8 symbols/min [2025-10-23T23:55:19.092164] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:55:19.118136] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-23T23:55:19.118236] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-23T23:55:19.136517] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-23T23:55:19.143449] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-23T23:55:19.194720] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:19.209690] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-23T23:55:19.532763] [DEBUG] [LOCAL ] SSB: Loaded 42715 existing records from primary storage. [2025-10-23T23:55:19.551884] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:19.552197] [INFO ] [MAIN ] SSB: Loaded 42715 existing records. [2025-10-23T23:55:19.661377] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-23T23:55:19.740208] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:55:19.740406] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-23T23:55:19.740481] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-23T23:55:19.740735] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-23T23:55:19.740807] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-23T23:55:20.004517] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-23T23:55:20.092578] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:20.799430] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-23T23:55:21.098846] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-23T23:55:21.162860] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-23T23:55:21.599475] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-23T23:55:21.974458] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-23T23:55:22.399449] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-23T23:55:23.199469] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-23T23:55:23.387818] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-23T23:55:23.392046] [INFO ] [REMOTE ] SRI: Full fetch complete (39538 records). [2025-10-23T23:55:23.392174] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-23T23:55:23.771818] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-23T23:55:23.771951] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-23T23:55:23.772828] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-23T23:55:23.772909] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-23T23:55:23.773984] [DEBUG] [LOCAL ] SRI: Trimmed 39538 records to 26338 (keeping 200 days of data) [2025-10-23T23:55:23.919393] [DEBUG] [LOCAL ] SRI: Primary data saved (26338 records). [2025-10-23T23:55:23.919546] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-23T23:55:23.919677] [INFO ] [MAIN ] Update Progress: 1990/2367 symbols completed. SRI took 31.6s. Estimated remaining: 48m 22s. Rate: 7.8 symbols/min [2025-10-23T23:55:24.004544] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-23T23:55:24.049609] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-23T23:55:24.100926] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:24.123303] [DEBUG] [LOCAL ] SSD: Loaded 22377 existing records from primary storage. [2025-10-23T23:55:24.123584] [INFO ] [MAIN ] SSD: Loaded 22377 existing records. [2025-10-23T23:55:24.301970] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:55:24.302193] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-23T23:55:24.302271] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-23T23:55:24.302487] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-23T23:55:24.302562] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-23T23:55:24.465889] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-23T23:55:24.529378] [INFO ] [REMOTE ] SRL: Full fetch complete (1662 records). [2025-10-23T23:55:24.556726] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-23T23:55:24.809252] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-23T23:55:24.848927] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:24.855863] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-23T23:55:24.856072] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:55:24.856153] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:55:24.856226] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-23T23:55:24.856318] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-23T23:55:24.856389] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-23T23:55:24.856467] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-23T23:55:24.856555] [INFO ] [MAIN ] Update Progress: 1991/2367 symbols completed. SRL took 21.7s. Estimated remaining: 48m 13s. Rate: 7.8 symbols/min [2025-10-23T23:55:25.028485] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:25.069101] [DEBUG] [LOCAL ] SSL: Loaded 41386 existing records from primary storage. [2025-10-23T23:55:25.069404] [INFO ] [MAIN ] SSL: Loaded 41386 existing records. [2025-10-23T23:55:25.244578] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:55:25.244839] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-23T23:55:25.244923] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-23T23:55:25.245171] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-23T23:55:25.245248] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-23T23:55:25.597146] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:25.599392] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-23T23:55:26.399396] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-23T23:55:26.468186] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-23T23:55:26.785740] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-23T23:55:27.199436] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-23T23:55:27.861864] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-23T23:55:27.983779] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-23T23:55:27.999389] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-23T23:55:28.799474] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-23T23:55:29.133872] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-23T23:55:29.515817] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-23T23:55:29.599415] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-23T23:55:30.399423] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-23T23:55:30.756783] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-23T23:55:31.199422] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-23T23:55:31.250808] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-23T23:55:31.999410] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-23T23:55:32.317259] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T23:55:32.779872] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-23T23:55:32.799420] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-23T23:55:33.599425] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-23T23:55:33.907350] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-23T23:55:34.399452] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-23T23:55:35.180600] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-23T23:55:35.199402] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-23T23:55:35.532931] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-23T23:55:35.935215] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-23T23:55:35.999410] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-23T23:55:36.799442] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-23T23:55:37.321394] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-23T23:55:37.599428] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-23T23:55:38.305142] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-23T23:55:38.399424] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-23T23:55:39.199423] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-23T23:55:39.255783] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T23:55:39.544900] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-23T23:55:39.944384] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T23:55:39.999413] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-23T23:55:40.575576] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-23T23:55:40.799437] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-23T23:55:41.599447] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-23T23:55:41.898601] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T23:55:42.399435] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-23T23:55:43.126502] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-23T23:55:43.128271] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-23T23:55:43.199396] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-23T23:55:43.999403] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-23T23:55:44.712475] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-23T23:55:44.713898] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-23T23:55:44.799493] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-23T23:55:45.599476] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-23T23:55:45.816902] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-23T23:55:45.820879] [INFO ] [REMOTE ] SSD: Full fetch complete (32487 records). [2025-10-23T23:55:45.820975] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-23T23:55:46.215943] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-23T23:55:46.216071] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-23T23:55:46.216837] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-23T23:55:46.216918] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-23T23:55:46.217803] [DEBUG] [LOCAL ] SSD: Trimmed 32487 records to 22503 (keeping 200 days of data) [2025-10-23T23:55:46.356997] [DEBUG] [LOCAL ] SSD: Primary data saved (22503 records). [2025-10-23T23:55:46.357148] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-23T23:55:46.357236] [INFO ] [MAIN ] Update Progress: 1992/2367 symbols completed. SSD took 22.4s. Estimated remaining: 48m 8s. Rate: 7.8 symbols/min [2025-10-23T23:55:46.404734] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-23T23:55:46.530168] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:46.543905] [DEBUG] [LOCAL ] SST: Loaded 11382 existing records from primary storage. [2025-10-23T23:55:46.544247] [INFO ] [MAIN ] SST: Loaded 11382 existing records. [2025-10-23T23:55:46.737205] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:55:46.737403] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-23T23:55:46.737476] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-23T23:55:46.737689] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-23T23:55:46.737779] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-23T23:55:47.090153] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:47.199415] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-23T23:55:47.282110] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-23T23:55:47.987591] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:55:48.000758] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-23T23:55:48.338400] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-23T23:55:48.660242] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-23T23:55:48.662941] [INFO ] [REMOTE ] SRV: Full fetch complete (11246 records). [2025-10-23T23:55:48.663059] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-23T23:55:48.804506] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-23T23:55:49.042985] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-23T23:55:49.043092] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-23T23:55:49.043419] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-23T23:55:49.043500] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-23T23:55:49.044039] [DEBUG] [LOCAL ] SRV: Trimmed 11246 records to 7431 (keeping 200 days of data) [2025-10-23T23:55:49.088135] [DEBUG] [LOCAL ] SRV: Primary data saved (7431 records). [2025-10-23T23:55:49.088266] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-23T23:55:49.088409] [INFO ] [MAIN ] Update Progress: 1993/2367 symbols completed. SRV took 30.6s. Estimated remaining: 47m 60s. Rate: 7.8 symbols/min [2025-10-23T23:55:49.256050] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:55:49.282277] [DEBUG] [LOCAL ] SSTK: Loaded 25244 existing records from primary storage. [2025-10-23T23:55:49.282555] [INFO ] [MAIN ] SSTK: Loaded 25244 existing records. [2025-10-23T23:55:49.468142] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:55:49.468384] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-23T23:55:49.468460] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-23T23:55:49.468725] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-23T23:55:49.468799] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-23T23:55:49.606975] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-23T23:55:49.823695] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:55:50.399417] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-23T23:55:50.506073] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-23T23:55:50.933677] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-23T23:55:51.199447] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-23T23:55:51.260932] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-23T23:55:51.999434] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-23T23:55:52.680703] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-23T23:55:52.799407] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-23T23:55:53.594532] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T23:55:53.603016] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-23T23:55:53.720639] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-23T23:55:54.399438] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-23T23:55:55.199441] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-23T23:55:55.281382] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-23T23:55:55.956829] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-23T23:55:55.999418] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-23T23:55:56.787447] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-23T23:55:56.799397] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-23T23:55:57.554369] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T23:55:57.599455] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-23T23:55:58.145014] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-23T23:55:58.399440] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-23T23:55:59.180271] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-23T23:55:59.199394] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-23T23:55:59.724824] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-23T23:55:59.999417] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-23T23:56:00.154201] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-23T23:56:00.161683] [INFO ] [REMOTE ] SSB: Full fetch complete (61574 records). [2025-10-23T23:56:00.161867] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-23T23:56:00.547707] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-23T23:56:00.547902] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-23T23:56:00.549429] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-23T23:56:00.549512] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-23T23:56:00.550931] [DEBUG] [LOCAL ] SSB: Trimmed 61574 records to 43090 (keeping 200 days of data) [2025-10-23T23:56:00.805171] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-23T23:56:00.815339] [DEBUG] [LOCAL ] SSB: Primary data saved (43090 records). [2025-10-23T23:56:00.816236] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-23T23:56:00.816351] [INFO ] [MAIN ] Update Progress: 1994/2367 symbols completed. SSB took 41.9s. Estimated remaining: 47m 53s. Rate: 7.8 symbols/min [2025-10-23T23:56:00.986919] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:01.028417] [DEBUG] [LOCAL ] ST: Loaded 49668 existing records from primary storage. [2025-10-23T23:56:01.028791] [INFO ] [MAIN ] ST: Loaded 49668 existing records. [2025-10-23T23:56:01.210018] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:56:01.210416] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-23T23:56:01.210491] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-23T23:56:01.210848] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-23T23:56:01.210923] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-23T23:56:01.517293] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-23T23:56:01.603716] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-23T23:56:01.606703] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:01.718999] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-23T23:56:02.399440] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-23T23:56:02.719265] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-23T23:56:02.727597] [INFO ] [REMOTE ] SSL: Full fetch complete (60126 records). [2025-10-23T23:56:02.727881] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-23T23:56:03.117233] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-23T23:56:03.117367] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-23T23:56:03.118509] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-23T23:56:03.118592] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-23T23:56:03.119885] [DEBUG] [LOCAL ] SSL: Trimmed 60126 records to 41739 (keeping 200 days of data) [2025-10-23T23:56:03.200347] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-23T23:56:03.354231] [DEBUG] [LOCAL ] SSL: Primary data saved (41739 records). [2025-10-23T23:56:03.354398] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-23T23:56:03.355799] [INFO ] [MAIN ] Update Progress: 1995/2367 symbols completed. SSL took 38.5s. Estimated remaining: 47m 44s. Rate: 7.8 symbols/min [2025-10-23T23:56:03.477430] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-23T23:56:03.545637] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:03.590777] [DEBUG] [LOCAL ] STAG: Loaded 50046 existing records from primary storage. [2025-10-23T23:56:03.591122] [INFO ] [MAIN ] STAG: Loaded 50046 existing records. [2025-10-23T23:56:03.764140] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:56:03.764361] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-23T23:56:03.764438] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-23T23:56:03.764732] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-23T23:56:03.764804] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-23T23:56:04.004734] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-23T23:56:04.163438] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:04.584074] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-23T23:56:04.799441] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-23T23:56:05.304381] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-23T23:56:05.599445] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-23T23:56:05.654183] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T23:56:06.399446] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-23T23:56:07.200106] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-23T23:56:07.202503] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-23T23:56:07.570172] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-23T23:56:07.999414] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-23T23:56:08.282307] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-23T23:56:08.799452] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-23T23:56:09.599456] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-23T23:56:09.660357] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-23T23:56:09.882992] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-23T23:56:10.399413] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-23T23:56:10.626479] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-23T23:56:11.199454] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-23T23:56:11.967096] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-23T23:56:11.999400] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-23T23:56:12.103012] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-23T23:56:12.799431] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-23T23:56:13.599428] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-23T23:56:13.708678] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-23T23:56:14.399418] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-23T23:56:14.489584] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-23T23:56:14.698563] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-23T23:56:14.828161] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-23T23:56:15.199482] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-23T23:56:15.651053] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T23:56:15.652724] [INFO ] [REMOTE ] SST: Full fetch complete (17821 records). [2025-10-23T23:56:15.652832] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-23T23:56:16.006373] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-23T23:56:16.020510] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-23T23:56:16.020601] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-23T23:56:16.021213] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-23T23:56:16.021365] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-23T23:56:16.022196] [DEBUG] [LOCAL ] SST: Trimmed 17821 records to 11417 (keeping 200 days of data) [2025-10-23T23:56:16.089810] [DEBUG] [LOCAL ] SST: Primary data saved (11417 records). [2025-10-23T23:56:16.089976] [INFO ] [MAIN ] SST: Full history saved. [2025-10-23T23:56:16.090093] [INFO ] [MAIN ] Update Progress: 1996/2367 symbols completed. SST took 29.7s. Estimated remaining: 47m 37s. Rate: 7.8 symbols/min [2025-10-23T23:56:16.256561] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:16.274002] [DEBUG] [LOCAL ] STC: Loaded 17391 existing records from primary storage. [2025-10-23T23:56:16.274265] [INFO ] [MAIN ] STC: Loaded 17391 existing records. [2025-10-23T23:56:16.448507] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:56:16.448722] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-23T23:56:16.448796] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-23T23:56:16.449025] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-23T23:56:16.449113] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-23T23:56:16.796209] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:16.799408] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-23T23:56:17.177272] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-23T23:56:17.186057] [INFO ] [REMOTE ] SSTK: Full fetch complete (41614 records). [2025-10-23T23:56:17.186234] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-23T23:56:17.560285] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-23T23:56:17.560393] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-23T23:56:17.561357] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-23T23:56:17.561435] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-23T23:56:17.562326] [DEBUG] [LOCAL ] SSTK: Trimmed 41614 records to 25424 (keeping 200 days of data) [2025-10-23T23:56:17.613705] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-23T23:56:17.717621] [DEBUG] [LOCAL ] SSTK: Primary data saved (25424 records). [2025-10-23T23:56:17.717846] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-23T23:56:17.717968] [INFO ] [MAIN ] Update Progress: 1997/2367 symbols completed. SSTK took 28.6s. Estimated remaining: 47m 28s. Rate: 7.8 symbols/min [2025-10-23T23:56:18.399499] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-23T23:56:18.528147] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-23T23:56:19.177758] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-23T23:56:19.199397] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-23T23:56:19.434070] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-23T23:56:19.999469] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-23T23:56:20.799433] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-23T23:56:20.933969] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-23T23:56:21.361523] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-23T23:56:21.599431] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-23T23:56:21.775739] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-23T23:56:22.399443] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-23T23:56:23.199493] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-23T23:56:23.430863] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-23T23:56:24.005106] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-23T23:56:24.017972] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-23T23:56:24.230610] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-23T23:56:24.799481] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-23T23:56:25.599430] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-23T23:56:25.729392] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T23:56:26.391038] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-23T23:56:26.400575] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-23T23:56:26.533855] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-23T23:56:27.199483] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-23T23:56:27.973712] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-23T23:56:27.999392] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-23T23:56:28.191475] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-23T23:56:28.799486] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-23T23:56:29.599473] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-23T23:56:29.630116] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-23T23:56:30.035759] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-23T23:56:30.045890] [INFO ] [REMOTE ] ST: Full fetch complete (72119 records). [2025-10-23T23:56:30.046058] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-23T23:56:30.404633] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-23T23:56:30.514181] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-23T23:56:30.514337] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-23T23:56:30.515987] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-23T23:56:30.516123] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-23T23:56:30.517845] [DEBUG] [LOCAL ] ST: Trimmed 72119 records to 50012 (keeping 200 days of data) [2025-10-23T23:56:30.634724] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-23T23:56:30.845866] [DEBUG] [LOCAL ] ST: Primary data saved (50012 records). [2025-10-23T23:56:30.846034] [INFO ] [MAIN ] ST: Full history saved. [2025-10-23T23:56:30.846148] [INFO ] [MAIN ] Update Progress: 1998/2367 symbols completed. ST took 30.0s. Estimated remaining: 47m 22s. Rate: 7.8 symbols/min [2025-10-23T23:56:31.199452] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-23T23:56:31.948445] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-23T23:56:31.999409] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-23T23:56:32.241859] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-23T23:56:32.799454] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-23T23:56:33.607074] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-23T23:56:33.617735] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-23T23:56:33.799064] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-23T23:56:34.399440] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-23T23:56:35.341457] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-23T23:56:35.345549] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-23T23:56:35.398796] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-23T23:56:35.408097] [INFO ] [REMOTE ] STAG: Full fetch complete (72561 records). [2025-10-23T23:56:35.408261] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-23T23:56:35.836357] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-23T23:56:35.836478] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-23T23:56:35.838004] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-23T23:56:35.838102] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-23T23:56:35.839804] [DEBUG] [LOCAL ] STAG: Trimmed 72561 records to 50429 (keeping 200 days of data) [2025-10-23T23:56:36.172920] [DEBUG] [LOCAL ] STAG: Primary data saved (50429 records). [2025-10-23T23:56:36.173113] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-23T23:56:36.173251] [INFO ] [MAIN ] Update Progress: 1999/2367 symbols completed. STAG took 32.8s. Estimated remaining: 47m 14s. Rate: 7.8 symbols/min [2025-10-23T23:56:36.216709] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-23T23:56:36.221237] [INFO ] [REMOTE ] STC: Full fetch complete (25693 records). [2025-10-23T23:56:36.221365] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-23T23:56:36.586856] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-23T23:56:36.586967] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-23T23:56:36.587511] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-23T23:56:36.587585] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-23T23:56:36.588351] [DEBUG] [LOCAL ] STC: Trimmed 25693 records to 17598 (keeping 200 days of data) [2025-10-23T23:56:36.697602] [DEBUG] [LOCAL ] STC: Primary data saved (17598 records). [2025-10-23T23:56:36.697821] [INFO ] [MAIN ] STC: Full history saved. [2025-10-23T23:56:36.697961] [INFO ] [MAIN ] Update Progress: 2000/2367 symbols completed. STC took 20.6s. Estimated remaining: 47m 5s. Rate: 7.8 symbols/min [2025-10-23T23:56:37.339241] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:37.420860] [DEBUG] [LOCAL ] STE: No existing data file found in primary storage. [2025-10-23T23:56:37.421861] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:37.437677] [WARN ] [MAIN ] STE: No existing data found, performing full refresh instead. [2025-10-23T23:56:37.437625] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:37.445991] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-23T23:56:37.471587] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:37.471891] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-23T23:56:37.472568] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-23T23:56:37.472670] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-23T23:56:37.649454] [DEBUG] [LOCAL ] STEL: Loaded 22328 existing records from primary storage. [2025-10-23T23:56:37.648538] [DEBUG] [LOCAL ] STEW: Loaded 15067 existing records from primary storage. [2025-10-23T23:56:37.722000] [INFO ] [MAIN ] STEW: Loaded 15067 existing records. [2025-10-23T23:56:37.722100] [INFO ] [MAIN ] STEL: Loaded 22328 existing records. [2025-10-23T23:56:37.749295] [DEBUG] [LOCAL ] STEM: Loaded 38406 existing records from primary storage. [2025-10-23T23:56:37.918163] [INFO ] [MAIN ] STEM: Loaded 38406 existing records. [2025-10-23T23:56:38.104084] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:38.174477] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-23T23:56:38.332996] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:56:38.376453] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-23T23:56:38.402074] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-23T23:56:38.376351] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:56:38.426589] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-23T23:56:38.450303] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-23T23:56:38.449965] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:56:38.450587] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-23T23:56:38.462899] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-23T23:56:38.462804] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-23T23:56:38.494677] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-23T23:56:38.515205] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-23T23:56:38.515349] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-23T23:56:38.520689] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-23T23:56:38.532269] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-23T23:56:39.296457] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:39.374717] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-23T23:56:39.534758] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:39.584371] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-23T23:56:39.605887] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:39.606451] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-23T23:56:39.672737] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-23T23:56:39.679637] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-23T23:56:40.212719] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-23T23:56:40.218187] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-23T23:56:40.404285] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T23:56:40.799473] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-23T23:56:41.062878] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-23T23:56:41.160438] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-23T23:56:41.557186] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T23:56:41.599407] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-23T23:56:41.936439] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-23T23:56:42.399426] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-23T23:56:42.601104] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-23T23:56:43.199416] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-23T23:56:43.592571] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-23T23:56:43.999482] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-23T23:56:44.250820] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-23T23:56:44.799442] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-23T23:56:45.342237] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-23T23:56:45.599459] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-23T23:56:46.048691] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-23T23:56:46.399431] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-23T23:56:46.694717] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-23T23:56:47.199440] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-23T23:56:47.900146] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-23T23:56:47.999415] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-23T23:56:48.110572] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-23T23:56:48.799445] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-23T23:56:49.599473] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-23T23:56:49.662441] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-23T23:56:49.823822] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-23T23:56:50.399431] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-23T23:56:51.157578] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-23T23:56:51.183459] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T23:56:51.199403] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-23T23:56:51.999419] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-23T23:56:52.198403] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-23T23:56:52.783139] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-23T23:56:52.799398] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-23T23:56:53.585756] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T23:56:53.588400] [INFO ] [REMOTE ] STEW: Full fetch complete (21744 records). [2025-10-23T23:56:53.588492] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-23T23:56:53.608770] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-23T23:56:53.968474] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-23T23:56:53.968607] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-23T23:56:53.969145] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-23T23:56:53.969220] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-23T23:56:53.969908] [DEBUG] [LOCAL ] STEW: Trimmed 21744 records to 15156 (keeping 200 days of data) [2025-10-23T23:56:54.061498] [DEBUG] [LOCAL ] STEW: Primary data saved (15156 records). [2025-10-23T23:56:54.061696] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-23T23:56:54.061811] [INFO ] [MAIN ] Update Progress: 2001/2367 symbols completed. STEW took 17.4s. Estimated remaining: 46m 59s. Rate: 7.8 symbols/min [2025-10-23T23:56:54.230120] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:56:54.230310] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-23T23:56:54.230383] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-23T23:56:54.230497] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-23T23:56:54.230567] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-23T23:56:54.230670] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-23T23:56:54.230744] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-23T23:56:54.411888] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-23T23:56:54.605875] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:56:55.199434] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-23T23:56:55.223771] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-23T23:56:55.540223] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-23T23:56:55.999503] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-23T23:56:56.799418] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-23T23:56:57.042596] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-23T23:56:57.195307] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-23T23:56:57.231565] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-23T23:56:57.599450] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-23T23:56:58.399465] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-23T23:56:59.011426] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-23T23:56:59.199426] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-23T23:56:59.999449] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-23T23:57:00.209567] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-23T23:57:00.241527] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-23T23:57:00.267579] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-23T23:57:00.799449] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-23T23:57:01.139920] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-23T23:57:01.599439] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-23T23:57:02.399471] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-23T23:57:03.123390] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-23T23:57:03.146460] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-23T23:57:03.199426] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-23T23:57:03.537084] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-23T23:57:03.999431] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-23T23:57:04.799438] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-23T23:57:05.599422] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-23T23:57:05.905909] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-23T23:57:06.208750] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-23T23:57:06.399431] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-23T23:57:06.601091] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-23T23:57:06.604937] [INFO ] [REMOTE ] STEL: Full fetch complete (32343 records). [2025-10-23T23:57:06.605044] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-23T23:57:06.975210] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-23T23:57:06.975320] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-23T23:57:06.976009] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-23T23:57:06.976096] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-23T23:57:06.977037] [DEBUG] [LOCAL ] STEL: Trimmed 32343 records to 22468 (keeping 200 days of data) [2025-10-23T23:57:07.110472] [DEBUG] [LOCAL ] STEL: Primary data saved (22468 records). [2025-10-23T23:57:07.110624] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-23T23:57:07.110752] [INFO ] [MAIN ] Update Progress: 2002/2367 symbols completed. STEL took 30.4s. Estimated remaining: 46m 52s. Rate: 7.8 symbols/min [2025-10-23T23:57:07.206055] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-23T23:57:07.288539] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:07.299511] [DEBUG] [LOCAL ] STK: Loaded 9700 existing records from primary storage. [2025-10-23T23:57:07.299812] [INFO ] [MAIN ] STK: Loaded 9700 existing records. [2025-10-23T23:57:07.481200] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:57:07.481506] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-23T23:57:07.481585] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-23T23:57:07.482195] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-23T23:57:07.482271] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-23T23:57:07.837351] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:07.999406] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-23T23:57:08.144056] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-23T23:57:08.651345] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-23T23:57:08.657431] [INFO ] [REMOTE ] STE: Full fetch complete (50901 records). [2025-10-23T23:57:08.657552] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-23T23:57:08.802294] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-23T23:57:08.797060] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-23T23:57:09.075731] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-23T23:57:09.075945] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-23T23:57:09.077014] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-23T23:57:09.077092] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-23T23:57:09.078266] [DEBUG] [LOCAL ] STE: Trimmed 50901 records to 35341 (keeping 200 days of data) [2025-10-23T23:57:09.290178] [DEBUG] [LOCAL ] STE: Primary data saved (35341 records). [2025-10-23T23:57:09.290348] [INFO ] [MAIN ] STE: Full history saved. [2025-10-23T23:57:09.290465] [INFO ] [MAIN ] Update Progress: 2003/2367 symbols completed. STE took 32.6s. Estimated remaining: 46m 43s. Rate: 7.8 symbols/min [2025-10-23T23:57:09.455676] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:09.503372] [DEBUG] [LOCAL ] STLA: Loaded 53557 existing records from primary storage. [2025-10-23T23:57:09.503721] [INFO ] [MAIN ] STLA: Loaded 53557 existing records. [2025-10-23T23:57:09.602312] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-23T23:57:09.682307] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:57:09.682502] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-23T23:57:09.682578] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-23T23:57:09.682868] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-23T23:57:09.682941] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-23T23:57:10.026528] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:10.358506] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-23T23:57:10.399394] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-23T23:57:10.502040] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-23T23:57:10.698338] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-23T23:57:11.199436] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-23T23:57:11.999506] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-23T23:57:12.330594] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-23T23:57:12.487258] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-23T23:57:12.799469] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-23T23:57:13.599487] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-23T23:57:14.105902] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-23T23:57:14.399479] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-23T23:57:15.185337] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-23T23:57:15.199389] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-23T23:57:15.444740] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-23T23:57:15.731373] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-23T23:57:15.999436] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-23T23:57:16.799418] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-23T23:57:16.846674] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-23T23:57:17.531252] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-23T23:57:17.599402] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-23T23:57:18.399444] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-23T23:57:19.143768] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-23T23:57:19.199408] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-23T23:57:19.607999] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-23T23:57:19.999465] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-23T23:57:20.614626] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T23:57:20.799426] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-23T23:57:20.840055] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-23T23:57:20.846535] [INFO ] [REMOTE ] STEM: Full fetch complete (60579 records). [2025-10-23T23:57:20.846677] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-23T23:57:21.232727] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-23T23:57:21.232858] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-23T23:57:21.233922] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-23T23:57:21.234001] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-23T23:57:21.235180] [DEBUG] [LOCAL ] STEM: Trimmed 60579 records to 38586 (keeping 200 days of data) [2025-10-23T23:57:21.456315] [DEBUG] [LOCAL ] STEM: Primary data saved (38586 records). [2025-10-23T23:57:21.456477] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-23T23:57:21.456586] [INFO ] [MAIN ] Update Progress: 2004/2367 symbols completed. STEM took 44.7s. Estimated remaining: 46m 36s. Rate: 7.8 symbols/min [2025-10-23T23:57:21.585582] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-23T23:57:21.603452] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-23T23:57:21.638431] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:21.689390] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-23T23:57:21.689769] [INFO ] [MAIN ] STM: Loaded 53573 existing records. [2025-10-23T23:57:21.862734] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:57:21.862966] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-23T23:57:21.863064] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-23T23:57:21.863322] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-23T23:57:21.863399] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-23T23:57:21.968293] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-23T23:57:22.217088] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:22.399426] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-23T23:57:23.199468] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-23T23:57:23.529723] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-23T23:57:23.530800] [INFO ] [REMOTE ] STG: Full fetch complete (2478 records). [2025-10-23T23:57:23.530911] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-23T23:57:23.715493] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-23T23:57:23.715728] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:57:23.715801] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:57:23.715850] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-23T23:57:23.715911] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-23T23:57:23.715976] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-23T23:57:23.716057] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-23T23:57:23.716145] [INFO ] [MAIN ] Update Progress: 2005/2367 symbols completed. STG took 29.7s. Estimated remaining: 46m 28s. Rate: 7.8 symbols/min [2025-10-23T23:57:23.904511] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:23.928520] [DEBUG] [LOCAL ] STN: Loaded 22576 existing records from primary storage. [2025-10-23T23:57:23.928840] [INFO ] [MAIN ] STN: Loaded 22576 existing records. [2025-10-23T23:57:24.004722] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-23T23:57:24.123080] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:57:24.123311] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-23T23:57:24.123387] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-23T23:57:24.123604] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-23T23:57:24.123709] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-23T23:57:24.476830] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:24.506836] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-23T23:57:24.799441] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-23T23:57:25.599469] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-23T23:57:26.392711] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-23T23:57:26.403200] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-23T23:57:26.412380] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T23:57:26.672044] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-23T23:57:27.199415] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-23T23:57:27.449465] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-23T23:57:27.680087] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-23T23:57:27.999462] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-23T23:57:28.793339] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-23T23:57:28.795800] [INFO ] [REMOTE ] STK: Full fetch complete (14337 records). [2025-10-23T23:57:28.795887] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-23T23:57:28.807127] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-23T23:57:29.155582] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-23T23:57:29.155711] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-23T23:57:29.156054] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-23T23:57:29.156129] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-23T23:57:29.156623] [DEBUG] [LOCAL ] STK: Trimmed 14337 records to 9757 (keeping 200 days of data) [2025-10-23T23:57:29.212398] [DEBUG] [LOCAL ] STK: Primary data saved (9757 records). [2025-10-23T23:57:29.212526] [INFO ] [MAIN ] STK: Full history saved. [2025-10-23T23:57:29.212636] [INFO ] [MAIN ] Update Progress: 2006/2367 symbols completed. STK took 22.1s. Estimated remaining: 46m 19s. Rate: 7.8 symbols/min [2025-10-23T23:57:29.376520] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:29.414484] [DEBUG] [LOCAL ] STNG: Loaded 43272 existing records from primary storage. [2025-10-23T23:57:29.414847] [INFO ] [MAIN ] STNG: Loaded 43272 existing records. [2025-10-23T23:57:29.585632] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:57:29.585812] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-23T23:57:29.585887] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-23T23:57:29.586354] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-23T23:57:29.586429] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-23T23:57:29.606726] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-23T23:57:29.964698] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:30.010844] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-23T23:57:30.399462] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-23T23:57:31.168864] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-23T23:57:31.199432] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-23T23:57:31.814184] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-23T23:57:31.999421] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-23T23:57:32.434110] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-23T23:57:32.799411] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-23T23:57:33.599400] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-23T23:57:33.917824] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-23T23:57:34.116430] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-23T23:57:34.399458] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-23T23:57:34.851157] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-23T23:57:35.199430] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-23T23:57:35.999455] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-23T23:57:36.253306] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-23T23:57:36.766989] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-23T23:57:36.799406] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-23T23:57:37.027286] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-23T23:57:37.599478] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-23T23:57:38.397105] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-23T23:57:38.405850] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-23T23:57:39.199412] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-23T23:57:39.464573] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-23T23:57:39.634471] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-23T23:57:39.999481] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-23T23:57:40.799415] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-23T23:57:40.924093] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-23T23:57:41.599439] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-23T23:57:41.983509] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-23T23:57:42.399434] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-23T23:57:42.535002] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-23T23:57:43.199424] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-23T23:57:43.403788] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-23T23:57:43.999436] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-23T23:57:44.520010] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-23T23:57:44.577771] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-23T23:57:44.799399] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-23T23:57:45.116677] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-23T23:57:45.599457] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-23T23:57:46.399440] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-23T23:57:46.827802] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-23T23:57:47.199466] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-23T23:57:47.599334] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-23T23:57:47.625432] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-23T23:57:47.999439] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-23T23:57:48.778353] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:57:48.799533] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-23T23:57:48.828116] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-23T23:57:48.832927] [INFO ] [REMOTE ] STN: Full fetch complete (32699 records). [2025-10-23T23:57:48.833187] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-23T23:57:49.373759] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-23T23:57:49.373952] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-23T23:57:49.375854] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-23T23:57:49.375966] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-23T23:57:49.377706] [DEBUG] [LOCAL ] STN: Trimmed 32699 records to 22702 (keeping 200 days of data) [2025-10-23T23:57:49.555043] [DEBUG] [LOCAL ] STN: Primary data saved (22702 records). [2025-10-23T23:57:49.555275] [INFO ] [MAIN ] STN: Full history saved. [2025-10-23T23:57:49.555422] [INFO ] [MAIN ] Update Progress: 2007/2367 symbols completed. STN took 25.8s. Estimated remaining: 46m 14s. Rate: 7.8 symbols/min [2025-10-23T23:57:49.604756] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-23T23:57:49.743364] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:49.755191] [DEBUG] [LOCAL ] STRV: Loaded 10686 existing records from primary storage. [2025-10-23T23:57:49.755450] [INFO ] [MAIN ] STRV: Loaded 10686 existing records. [2025-10-23T23:57:49.929231] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:57:49.929461] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-23T23:57:49.929543] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-23T23:57:49.929780] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-23T23:57:49.929858] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-23T23:57:50.286590] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:50.399404] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-23T23:57:50.584985] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-23T23:57:51.199473] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-23T23:57:51.309253] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-23T23:57:51.758737] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-23T23:57:51.999429] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-23T23:57:52.773421] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-23T23:57:52.799445] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-23T23:57:53.006558] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-23T23:57:53.599459] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-23T23:57:54.399436] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-23T23:57:54.775466] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-23T23:57:54.784753] [INFO ] [REMOTE ] STLA: Full fetch complete (77661 records). [2025-10-23T23:57:54.784911] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-23T23:57:55.183675] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-23T23:57:55.183849] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-23T23:57:55.185074] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-23T23:57:55.185178] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-23T23:57:55.186561] [DEBUG] [LOCAL ] STLA: Trimmed 77661 records to 53944 (keeping 200 days of data) [2025-10-23T23:57:55.236056] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-23T23:57:55.411214] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T23:57:55.529033] [DEBUG] [LOCAL ] STLA: Primary data saved (53944 records). [2025-10-23T23:57:55.538817] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-23T23:57:55.546236] [INFO ] [MAIN ] Update Progress: 2008/2367 symbols completed. STLA took 46.3s. Estimated remaining: 46m 6s. Rate: 7.8 symbols/min [2025-10-23T23:57:55.624124] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-23T23:57:55.742597] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:55.742852] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-10-23T23:57:55.742935] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-10-23T23:57:55.743075] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-23T23:57:55.743162] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-23T23:57:55.743265] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-23T23:57:55.743352] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-23T23:57:56.004619] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-23T23:57:56.090659] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:56.799430] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-23T23:57:56.875110] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-23T23:57:57.599433] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-23T23:57:58.170399] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-23T23:57:58.179620] [INFO ] [REMOTE ] STM: Full fetch complete (77695 records). [2025-10-23T23:57:58.179803] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-23T23:57:58.409194] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-23T23:57:58.580400] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-23T23:57:58.613668] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-23T23:57:58.614272] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-23T23:57:58.615521] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-23T23:57:58.615613] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-23T23:57:58.617050] [DEBUG] [LOCAL ] STM: Trimmed 77695 records to 53963 (keeping 200 days of data) [2025-10-23T23:57:58.950746] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-23T23:57:58.985481] [DEBUG] [LOCAL ] STM: Primary data saved (53963 records). [2025-10-23T23:57:58.985639] [INFO ] [MAIN ] STM: Full history saved. [2025-10-23T23:57:58.987156] [INFO ] [MAIN ] Update Progress: 2009/2367 symbols completed. STM took 37.5s. Estimated remaining: 45m 58s. Rate: 7.8 symbols/min [2025-10-23T23:57:59.161222] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:57:59.161537] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-23T23:57:59.161634] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-23T23:57:59.171532] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-23T23:57:59.172490] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-23T23:57:59.172561] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-23T23:57:59.176341] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-23T23:57:59.177193] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-23T23:57:59.206456] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-23T23:57:59.536824] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:57:59.999410] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-10-23T23:58:00.204848] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-23T23:58:00.205203] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-10-23T23:58:00.205304] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-23T23:58:00.205387] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-23T23:58:00.205471] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-23T23:58:00.205558] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-23T23:58:00.205691] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-23T23:58:00.205780] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-23T23:58:00.205916] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-23T23:58:00.206019] [INFO ] [MAIN ] Update Progress: 2010/2367 symbols completed. STUB took 1.2s. Estimated remaining: 45m 49s. Rate: 7.8 symbols/min [2025-10-23T23:58:00.372250] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:00.401842] [DEBUG] [LOCAL ] STVN: Loaded 26683 existing records from primary storage. [2025-10-23T23:58:00.402162] [INFO ] [MAIN ] STVN: Loaded 26683 existing records. [2025-10-23T23:58:00.576535] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:58:00.576758] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-23T23:58:00.576852] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-23T23:58:00.577121] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-23T23:58:00.577211] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-23T23:58:00.804526] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-23T23:58:00.930730] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:00.986506] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-23T23:58:01.599434] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-23T23:58:02.030097] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-23T23:58:02.037237] [INFO ] [REMOTE ] STNG: Full fetch complete (64111 records). [2025-10-23T23:58:02.037372] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-23T23:58:02.400401] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-23T23:58:02.419411] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-23T23:58:02.420262] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-23T23:58:02.421554] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-23T23:58:02.421766] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-23T23:58:02.423056] [DEBUG] [LOCAL ] STNG: Trimmed 64111 records to 43583 (keeping 200 days of data) [2025-10-23T23:58:02.675927] [DEBUG] [LOCAL ] STNG: Primary data saved (43583 records). [2025-10-23T23:58:02.676085] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-23T23:58:02.676211] [INFO ] [MAIN ] Update Progress: 2011/2367 symbols completed. STNG took 33.5s. Estimated remaining: 45m 40s. Rate: 7.8 symbols/min [2025-10-23T23:58:02.844098] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:02.892828] [DEBUG] [LOCAL ] STWD: Loaded 51960 existing records from primary storage. [2025-10-23T23:58:02.893177] [INFO ] [MAIN ] STWD: Loaded 51960 existing records. [2025-10-23T23:58:03.083280] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:58:03.083533] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-23T23:58:03.083612] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-23T23:58:03.083864] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-23T23:58:03.083936] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-23T23:58:03.204579] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-23T23:58:03.445634] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:03.477155] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-23T23:58:03.643522] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-23T23:58:03.999436] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-23T23:58:04.125772] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-23T23:58:04.799453] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-23T23:58:05.599460] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-23T23:58:05.795860] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-23T23:58:05.866310] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-23T23:58:06.399417] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-23T23:58:07.199408] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-23T23:58:07.527857] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-23T23:58:08.005893] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-23T23:58:08.023554] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T23:58:08.263539] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-23T23:58:08.799416] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-23T23:58:09.599478] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-23T23:58:09.909216] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-23T23:58:10.399465] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-23T23:58:10.569917] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-23T23:58:10.611680] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-23T23:58:11.199525] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-23T23:58:11.723257] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-23T23:58:11.999436] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-23T23:58:12.799475] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-23T23:58:13.103337] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-23T23:58:13.235890] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-23T23:58:13.279383] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-23T23:58:13.599426] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-23T23:58:14.399498] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-23T23:58:14.791140] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-23T23:58:15.199435] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-23T23:58:15.999468] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-23T23:58:16.392694] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-23T23:58:16.802830] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-23T23:58:16.805766] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-23T23:58:16.974477] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-23T23:58:17.599486] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-23T23:58:17.965084] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-23T23:58:18.402570] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-23T23:58:18.405754] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-23T23:58:19.199418] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-23T23:58:19.515502] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-23T23:58:19.999469] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-23T23:58:20.748832] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-23T23:58:20.751202] [INFO ] [REMOTE ] STRV: Full fetch complete (17300 records). [2025-10-23T23:58:20.751394] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-23T23:58:20.805458] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-23T23:58:21.132415] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-23T23:58:21.143689] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-23T23:58:21.144156] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-23T23:58:21.144402] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-23T23:58:21.145726] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T23:58:21.156017] [DEBUG] [LOCAL ] STRV: Trimmed 17300 records to 10739 (keeping 200 days of data) [2025-10-23T23:58:21.219160] [DEBUG] [LOCAL ] STRV: Primary data saved (10739 records). [2025-10-23T23:58:21.219302] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-23T23:58:21.219411] [INFO ] [MAIN ] Update Progress: 2012/2367 symbols completed. STRV took 31.7s. Estimated remaining: 45m 34s. Rate: 7.8 symbols/min [2025-10-23T23:58:21.383108] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:21.386711] [DEBUG] [LOCAL ] STXD: Loaded 1337 existing records from primary storage. [2025-10-23T23:58:21.386877] [INFO ] [MAIN ] STXD: Loaded 1337 existing records. [2025-10-23T23:58:21.559855] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:58:21.560023] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-23T23:58:21.560103] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-23T23:58:21.560262] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-23T23:58:21.560334] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-23T23:58:21.604728] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-23T23:58:21.908453] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:22.266734] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-23T23:58:22.399392] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-23T23:58:23.199470] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-23T23:58:23.457883] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-23T23:58:23.704633] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-23T23:58:23.863577] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-23T23:58:23.999414] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-23T23:58:24.799459] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-23T23:58:25.236078] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-23T23:58:25.599471] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-23T23:58:25.716308] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-23T23:58:26.399445] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-23T23:58:26.744140] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-23T23:58:26.898943] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-23T23:58:27.199429] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-23T23:58:27.999459] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-23T23:58:28.799419] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-23T23:58:28.857859] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-23T23:58:28.867111] [INFO ] [REMOTE ] STT: Full fetch complete (74524 records). [2025-10-23T23:58:28.867274] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-23T23:58:29.249840] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-23T23:58:29.249961] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-23T23:58:29.251154] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-23T23:58:29.251255] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-23T23:58:29.252687] [DEBUG] [LOCAL ] STT: Trimmed 74524 records to 51483 (keeping 200 days of data) [2025-10-23T23:58:29.568365] [DEBUG] [LOCAL ] STT: Primary data saved (51483 records). [2025-10-23T23:58:29.568526] [INFO ] [MAIN ] STT: Full history saved. [2025-10-23T23:58:29.568631] [INFO ] [MAIN ] Update Progress: 2013/2367 symbols completed. STT took 34.0s. Estimated remaining: 45m 27s. Rate: 7.8 symbols/min [2025-10-23T23:58:29.600180] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-23T23:58:29.740775] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:29.744723] [DEBUG] [LOCAL ] STXE: Loaded 2051 existing records from primary storage. [2025-10-23T23:58:29.744892] [INFO ] [MAIN ] STXE: Loaded 2051 existing records. [2025-10-23T23:58:29.945106] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:58:29.945664] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-23T23:58:29.945748] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-23T23:58:29.970294] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-23T23:58:29.974287] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-23T23:58:29.998745] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-23T23:58:30.084263] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-23T23:58:30.262426] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-23T23:58:30.383047] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:30.399395] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-23T23:58:30.945502] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-23T23:58:31.199442] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-23T23:58:31.999444] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-23T23:58:32.328891] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-23T23:58:32.333786] [INFO ] [REMOTE ] STVN: Full fetch complete (39150 records). [2025-10-23T23:58:32.333893] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-23T23:58:32.605706] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-23T23:58:32.721490] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-23T23:58:32.721594] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-23T23:58:32.722400] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-23T23:58:32.722475] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-23T23:58:32.723348] [DEBUG] [LOCAL ] STVN: Trimmed 39150 records to 26897 (keeping 200 days of data) [2025-10-23T23:58:32.806638] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-23T23:58:32.878326] [DEBUG] [LOCAL ] STVN: Primary data saved (26897 records). [2025-10-23T23:58:32.878477] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-23T23:58:32.878586] [INFO ] [MAIN ] Update Progress: 2014/2367 symbols completed. STVN took 32.7s. Estimated remaining: 45m 18s. Rate: 7.8 symbols/min [2025-10-23T23:58:33.045467] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:33.049982] [DEBUG] [LOCAL ] STXG: Loaded 2290 existing records from primary storage. [2025-10-23T23:58:33.050164] [INFO ] [MAIN ] STXG: Loaded 2290 existing records. [2025-10-23T23:58:33.224221] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:58:33.224409] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-23T23:58:33.224481] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-23T23:58:33.224671] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-23T23:58:33.224758] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-23T23:58:33.570967] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:33.599395] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-23T23:58:34.172372] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-23T23:58:34.399425] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-23T23:58:34.563591] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-23T23:58:34.573604] [INFO ] [REMOTE ] STWD: Full fetch complete (75362 records). [2025-10-23T23:58:34.573794] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-23T23:58:34.791589] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-23T23:58:35.031804] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-23T23:58:35.031923] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-23T23:58:35.033263] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-23T23:58:35.033345] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-23T23:58:35.034850] [DEBUG] [LOCAL ] STWD: Trimmed 75362 records to 52342 (keeping 200 days of data) [2025-10-23T23:58:35.210921] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-23T23:58:35.355588] [DEBUG] [LOCAL ] STWD: Primary data saved (52342 records). [2025-10-23T23:58:35.355770] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-23T23:58:35.355883] [INFO ] [MAIN ] Update Progress: 2015/2367 symbols completed. STWD took 32.7s. Estimated remaining: 45m 10s. Rate: 7.8 symbols/min [2025-10-23T23:58:35.532073] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:35.535928] [DEBUG] [LOCAL ] STXK: Loaded 1477 existing records from primary storage. [2025-10-23T23:58:35.536095] [INFO ] [MAIN ] STXK: Loaded 1477 existing records. [2025-10-23T23:58:35.716464] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:58:35.716699] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-23T23:58:35.716777] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-23T23:58:35.716921] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-23T23:58:35.716991] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-23T23:58:35.814877] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-23T23:58:36.006636] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-23T23:58:36.090112] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:36.474771] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T23:58:36.799445] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-23T23:58:37.357058] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-23T23:58:37.599437] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-23T23:58:38.226191] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-23T23:58:38.399484] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-23T23:58:38.835287] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-23T23:58:39.199442] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-23T23:58:39.645492] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-23T23:58:39.999427] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-23T23:58:40.438992] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-23T23:58:40.799473] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-23T23:58:41.255452] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-23T23:58:41.599523] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-23T23:58:42.048678] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-23T23:58:42.399507] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-23T23:58:42.752444] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-23T23:58:43.199475] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-23T23:58:43.596742] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-23T23:58:43.999444] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-23T23:58:44.450270] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-23T23:58:44.799461] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-23T23:58:45.240353] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-23T23:58:45.599497] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-23T23:58:46.043724] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T23:58:46.399465] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-23T23:58:46.818396] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-23T23:58:47.199501] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-23T23:58:47.643175] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-23T23:58:47.999471] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-23T23:58:48.683465] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-23T23:58:48.799499] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-23T23:58:49.228876] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-23T23:58:49.599436] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-23T23:58:49.945377] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-23T23:58:50.399461] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-23T23:58:50.870878] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-23T23:58:51.199467] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-23T23:58:51.672223] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T23:58:51.673235] [INFO ] [REMOTE ] STXE: Full fetch complete (3475 records). [2025-10-23T23:58:51.673329] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-23T23:58:52.002027] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-23T23:58:52.031759] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-23T23:58:52.031869] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-23T23:58:52.032045] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-23T23:58:52.032130] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-23T23:58:52.032519] [DEBUG] [LOCAL ] STXE: Trimmed 3475 records to 2067 (keeping 200 days of data) [2025-10-23T23:58:52.045563] [DEBUG] [LOCAL ] STXE: Primary data saved (2067 records). [2025-10-23T23:58:52.045680] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-23T23:58:52.045809] [INFO ] [MAIN ] Update Progress: 2016/2367 symbols completed. STXE took 22.5s. Estimated remaining: 45m 4s. Rate: 7.8 symbols/min [2025-10-23T23:58:52.210734] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:58:52.210933] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-23T23:58:52.211003] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-23T23:58:52.211104] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-23T23:58:52.211169] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-23T23:58:52.211229] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-23T23:58:52.211291] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-23T23:58:52.562481] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-23T23:58:52.567779] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:58:52.799462] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-23T23:58:53.173022] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-23T23:58:53.599435] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-23T23:58:53.952935] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-23T23:58:54.399454] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-23T23:58:54.669594] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-23T23:58:55.199436] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-23T23:58:55.697325] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-23T23:58:55.999458] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-23T23:58:56.597616] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-23T23:58:56.799475] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-23T23:58:57.247766] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-23T23:58:57.599485] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-23T23:58:58.031009] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-23T23:58:58.399482] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-23T23:58:58.820383] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-23T23:58:59.199494] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-23T23:58:59.618918] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-23T23:58:59.619851] [INFO ] [REMOTE ] STXK: Full fetch complete (2386 records). [2025-10-23T23:58:59.619939] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-23T23:58:59.967962] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-23T23:58:59.968078] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-23T23:58:59.968191] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-23T23:58:59.968260] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-23T23:58:59.968635] [DEBUG] [LOCAL ] STXK: Trimmed 2386 records to 1484 (keeping 200 days of data) [2025-10-23T23:58:59.978021] [DEBUG] [LOCAL ] STXK: Primary data saved (1484 records). [2025-10-23T23:58:59.978105] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-23T23:58:59.978217] [INFO ] [MAIN ] Update Progress: 2017/2367 symbols completed. STXK took 24.6s. Estimated remaining: 44m 56s. Rate: 7.8 symbols/min [2025-10-23T23:59:00.007111] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-23T23:59:00.153613] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:00.157591] [DEBUG] [LOCAL ] STXT: Loaded 2509 existing records from primary storage. [2025-10-23T23:59:00.157809] [INFO ] [MAIN ] STXT: Loaded 2509 existing records. [2025-10-23T23:59:00.331238] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:00.331437] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-23T23:59:00.331511] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-23T23:59:00.331710] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-23T23:59:00.331782] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-23T23:59:00.482268] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-23T23:59:00.689832] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:00.799449] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-23T23:59:01.180669] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-23T23:59:01.599459] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-23T23:59:02.073554] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-23T23:59:02.074582] [INFO ] [REMOTE ] STXG: Full fetch complete (4047 records). [2025-10-23T23:59:02.074708] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-23T23:59:02.404555] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-23T23:59:02.465336] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-23T23:59:02.465492] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-23T23:59:02.465763] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-23T23:59:02.465843] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-23T23:59:02.466481] [DEBUG] [LOCAL ] STXG: Trimmed 4047 records to 2312 (keeping 200 days of data) [2025-10-23T23:59:02.482020] [DEBUG] [LOCAL ] STXG: Primary data saved (2312 records). [2025-10-23T23:59:02.482128] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-23T23:59:02.482235] [INFO ] [MAIN ] Update Progress: 2018/2367 symbols completed. STXG took 29.6s. Estimated remaining: 44m 47s. Rate: 7.8 symbols/min [2025-10-23T23:59:02.663612] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:02.667958] [DEBUG] [LOCAL ] STXV: Loaded 1462 existing records from primary storage. [2025-10-23T23:59:02.668188] [INFO ] [MAIN ] STXV: Loaded 1462 existing records. [2025-10-23T23:59:02.856621] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:02.856840] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-23T23:59:02.856914] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-23T23:59:02.857103] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-23T23:59:02.857178] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-23T23:59:02.954119] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-23T23:59:03.210528] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-23T23:59:03.235535] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:03.840671] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-23T23:59:03.999450] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-23T23:59:04.462620] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-23T23:59:04.799449] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-23T23:59:05.250212] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-23T23:59:05.251229] [INFO ] [REMOTE ] STXD: Full fetch complete (2165 records). [2025-10-23T23:59:05.251316] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-23T23:59:05.606162] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-23T23:59:05.612759] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-23T23:59:05.613950] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-23T23:59:05.614431] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-23T23:59:05.614549] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-23T23:59:05.615783] [DEBUG] [LOCAL ] STXD: Trimmed 2165 records to 1352 (keeping 200 days of data) [2025-10-23T23:59:05.625812] [DEBUG] [LOCAL ] STXD: Primary data saved (1352 records). [2025-10-23T23:59:05.625988] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-23T23:59:05.626140] [INFO ] [MAIN ] Update Progress: 2019/2367 symbols completed. STXD took 44.4s. Estimated remaining: 44m 39s. Rate: 7.8 symbols/min [2025-10-23T23:59:05.800869] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:05.801166] [DEBUG] [LOCAL ] STZ: No existing data file found in primary storage. [2025-10-23T23:59:05.801244] [WARN ] [MAIN ] STZ: No existing data found, performing full refresh instead. [2025-10-23T23:59:05.801370] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-23T23:59:05.801446] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-23T23:59:05.801531] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-23T23:59:05.801607] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-23T23:59:06.043460] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-23T23:59:06.171878] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:06.399415] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-23T23:59:07.010061] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-23T23:59:07.199470] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-23T23:59:07.552309] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-23T23:59:07.999475] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-23T23:59:08.799479] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-23T23:59:09.254238] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-23T23:59:09.599418] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-23T23:59:09.930910] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-23T23:59:10.052616] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-23T23:59:10.399457] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-23T23:59:10.737290] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-23T23:59:11.199482] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-23T23:59:11.999442] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-23T23:59:12.494538] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-23T23:59:12.799412] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-23T23:59:13.235873] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-23T23:59:13.293417] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-23T23:59:13.599464] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-23T23:59:13.861043] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-23T23:59:14.399437] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-23T23:59:14.732520] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-23T23:59:15.199439] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-23T23:59:15.724380] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-23T23:59:15.999444] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-23T23:59:16.461141] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-23T23:59:16.799457] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-23T23:59:17.137276] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-23T23:59:17.138084] [INFO ] [REMOTE ] STXM: Full fetch complete (1375 records). [2025-10-23T23:59:17.138172] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-23T23:59:17.315837] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-23T23:59:17.316017] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-23T23:59:17.316066] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-23T23:59:17.316137] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-23T23:59:17.316224] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-23T23:59:17.316294] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-23T23:59:17.316372] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-23T23:59:17.316462] [INFO ] [MAIN ] Update Progress: 2020/2367 symbols completed. STXM took 25.3s. Estimated remaining: 44m 32s. Rate: 7.8 symbols/min [2025-10-23T23:59:17.491226] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:17.538206] [DEBUG] [LOCAL ] SU: Loaded 53430 existing records from primary storage. [2025-10-23T23:59:17.538543] [INFO ] [MAIN ] SU: Loaded 53430 existing records. [2025-10-23T23:59:17.604725] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-23T23:59:17.720116] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:17.720332] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-23T23:59:17.720431] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-23T23:59:17.720759] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-23T23:59:17.720842] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-23T23:59:18.065904] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:18.100525] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-23T23:59:18.399404] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-23T23:59:19.199501] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-23T23:59:19.647144] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-23T23:59:19.999412] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-23T23:59:20.104259] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-23T23:59:20.799472] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-23T23:59:21.228721] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-23T23:59:21.599412] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-23T23:59:22.011930] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-23T23:59:22.054461] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-23T23:59:22.399416] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-23T23:59:23.199436] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-23T23:59:23.638460] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-23T23:59:24.004508] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-23T23:59:24.019702] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-23T23:59:24.769993] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-23T23:59:24.799396] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-23T23:59:25.332113] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-23T23:59:25.599419] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-23T23:59:26.011031] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-23T23:59:26.011898] [INFO ] [REMOTE ] STXV: Full fetch complete (2518 records). [2025-10-23T23:59:26.011988] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-23T23:59:26.354086] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-23T23:59:26.354194] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-23T23:59:26.354325] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-23T23:59:26.354398] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-23T23:59:26.354812] [DEBUG] [LOCAL ] STXV: Trimmed 2518 records to 1474 (keeping 200 days of data) [2025-10-23T23:59:26.364111] [DEBUG] [LOCAL ] STXV: Primary data saved (1474 records). [2025-10-23T23:59:26.364191] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-23T23:59:26.364296] [INFO ] [MAIN ] Update Progress: 2021/2367 symbols completed. STXV took 23.9s. Estimated remaining: 44m 24s. Rate: 7.8 symbols/min [2025-10-23T23:59:26.404738] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-23T23:59:26.534791] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:26.576491] [DEBUG] [LOCAL ] SUI: Loaded 41833 existing records from primary storage. [2025-10-23T23:59:26.576829] [INFO ] [MAIN ] SUI: Loaded 41833 existing records. [2025-10-23T23:59:26.747107] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:26.747305] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-23T23:59:26.747378] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-23T23:59:26.747694] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-23T23:59:26.747777] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-23T23:59:27.020550] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-23T23:59:27.098670] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:27.199394] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-23T23:59:27.999470] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-23T23:59:28.311521] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-23T23:59:28.421179] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-23T23:59:28.799437] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-23T23:59:29.599485] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-23T23:59:30.399458] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-23T23:59:30.662422] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-23T23:59:31.199421] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-23T23:59:31.666439] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-23T23:59:31.875675] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-23T23:59:31.999411] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-23T23:59:32.799434] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-23T23:59:33.016857] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T23:59:33.463967] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-23T23:59:33.599406] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-23T23:59:34.399503] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-23T23:59:34.856634] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-23T23:59:34.858331] [INFO ] [REMOTE ] STXT: Full fetch complete (3894 records). [2025-10-23T23:59:34.858449] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-23T23:59:35.203484] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-23T23:59:35.256569] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-23T23:59:35.370547] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-23T23:59:35.370890] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-23T23:59:35.371109] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-23T23:59:35.371258] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-23T23:59:35.372164] [DEBUG] [LOCAL ] STXT: Trimmed 3894 records to 2533 (keeping 200 days of data) [2025-10-23T23:59:35.415505] [DEBUG] [LOCAL ] STXT: Primary data saved (2533 records). [2025-10-23T23:59:35.417520] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-23T23:59:35.417891] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-23T23:59:35.428691] [INFO ] [MAIN ] Update Progress: 2022/2367 symbols completed. STXT took 35.5s. Estimated remaining: 44m 17s. Rate: 7.8 symbols/min [2025-10-23T23:59:35.622770] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:35.656202] [DEBUG] [LOCAL ] SUN: Loaded 38757 existing records from primary storage. [2025-10-23T23:59:35.656551] [INFO ] [MAIN ] SUN: Loaded 38757 existing records. [2025-10-23T23:59:35.831576] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:35.831797] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-23T23:59:35.831874] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-23T23:59:35.832157] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-23T23:59:35.832233] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-23T23:59:36.004691] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-23T23:59:36.190919] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:36.784887] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-23T23:59:36.799438] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-23T23:59:37.599458] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-23T23:59:37.958708] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-23T23:59:38.349924] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-23T23:59:38.399396] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-23T23:59:39.184030] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-23T23:59:39.199432] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-23T23:59:39.892201] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-23T23:59:39.999478] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-23T23:59:40.401013] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-23T23:59:40.799487] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-23T23:59:41.571666] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-23T23:59:41.599404] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-23T23:59:42.185470] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-23T23:59:42.399473] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-23T23:59:43.199421] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-23T23:59:43.455126] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-23T23:59:43.834911] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-23T23:59:43.999448] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-23T23:59:44.694618] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-23T23:59:44.799413] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-23T23:59:45.599404] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-23T23:59:45.953295] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-23T23:59:46.399470] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-23T23:59:46.713570] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-23T23:59:47.077929] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-23T23:59:47.199440] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-23T23:59:47.936434] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-23T23:59:47.999399] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-23T23:59:48.652969] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-23T23:59:48.799428] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-23T23:59:49.599563] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-23T23:59:49.604272] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-23T23:59:50.241358] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-23T23:59:50.399457] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-23T23:59:51.199423] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-23T23:59:51.402563] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-23T23:59:51.921002] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-23T23:59:51.999410] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-23T23:59:52.715021] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-23T23:59:52.799405] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-23T23:59:53.599447] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-23T23:59:53.835440] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-23T23:59:53.844883] [INFO ] [REMOTE ] SU: Full fetch complete (77570 records). [2025-10-23T23:59:53.845037] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-23T23:59:54.247866] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-23T23:59:54.248039] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-23T23:59:54.249572] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-23T23:59:54.249687] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-23T23:59:54.271266] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-23T23:59:54.278969] [DEBUG] [LOCAL ] SU: Trimmed 77570 records to 53820 (keeping 200 days of data) [2025-10-23T23:59:54.401067] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-23T23:59:54.601890] [DEBUG] [LOCAL ] SU: Primary data saved (53820 records). [2025-10-23T23:59:54.602044] [INFO ] [MAIN ] SU: Full history saved. [2025-10-23T23:59:54.602154] [INFO ] [MAIN ] Update Progress: 2023/2367 symbols completed. SU took 37.3s. Estimated remaining: 44m 11s. Rate: 7.8 symbols/min [2025-10-23T23:59:54.772805] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:54.815006] [DEBUG] [LOCAL ] SUPV: Loaded 48048 existing records from primary storage. [2025-10-23T23:59:54.815416] [INFO ] [MAIN ] SUPV: Loaded 48048 existing records. [2025-10-23T23:59:54.987949] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:54.988176] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-23T23:59:54.988273] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-23T23:59:54.988595] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-23T23:59:54.988710] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-23T23:59:55.224142] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-23T23:59:55.342450] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:55.637877] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-23T23:59:55.989039] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-23T23:59:55.996178] [INFO ] [REMOTE ] SUI: Full fetch complete (60809 records). [2025-10-23T23:59:55.996306] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-23T23:59:56.008148] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-23T23:59:56.379285] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-23T23:59:56.379423] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-23T23:59:56.380544] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-23T23:59:56.380624] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-23T23:59:56.381950] [DEBUG] [LOCAL ] SUI: Trimmed 60809 records to 42165 (keeping 200 days of data) [2025-10-23T23:59:56.644215] [DEBUG] [LOCAL ] SUI: Primary data saved (42165 records). [2025-10-23T23:59:56.644370] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-23T23:59:56.646040] [INFO ] [MAIN ] Update Progress: 2024/2367 symbols completed. SUI took 30.3s. Estimated remaining: 44m 2s. Rate: 7.8 symbols/min [2025-10-23T23:59:56.831281] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:56.829565] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-23T23:59:56.835975] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-23T23:59:56.843624] [INFO ] [REMOTE ] SUN: Full fetch complete (55693 records). [2025-10-23T23:59:56.843772] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-23T23:59:57.183574] [DEBUG] [LOCAL ] SUZ: Loaded 45524 existing records from primary storage. [2025-10-23T23:59:57.204616] [INFO ] [MAIN ] SUZ: Loaded 45524 existing records. [2025-10-23T23:59:57.375019] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-23T23:59:57.375366] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-23T23:59:57.392192] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-23T23:59:57.397407] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-23T23:59:57.455214] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:57.450719] [DEBUG] [LOCAL ] SUN: Trimmed 55693 records to 39054 (keeping 200 days of data) [2025-10-23T23:59:57.455636] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-23T23:59:57.455744] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-23T23:59:57.456010] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-23T23:59:57.456122] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-23T23:59:57.942744] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:57.947243] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-23T23:59:58.062663] [DEBUG] [LOCAL ] SUN: Primary data saved (39054 records). [2025-10-23T23:59:58.062825] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-23T23:59:58.062943] [INFO ] [MAIN ] Update Progress: 2025/2367 symbols completed. SUN took 22.6s. Estimated remaining: 43m 54s. Rate: 7.8 symbols/min [2025-10-23T23:59:58.215080] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-23T23:59:58.266220] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:58.263739] [INFO ] [REMOTE ] STZ: Full fetch complete (76209 records). [2025-10-23T23:59:58.266403] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-23T23:59:58.590081] [DEBUG] [LOCAL ] SVV: Loaded 40253 existing records from primary storage. [2025-10-23T23:59:58.638993] [INFO ] [MAIN ] SVV: Loaded 40253 existing records. [2025-10-23T23:59:58.716525] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-23T23:59:58.776699] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-23T23:59:58.788752] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-23T23:59:58.794604] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-23T23:59:58.891907] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-23T23:59:58.894460] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-23T23:59:58.894593] [DEBUG] [LOCAL ] STZ: Trimmed 76209 records to 52805 (keeping 200 days of data) [2025-10-23T23:59:58.893000] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-23T23:59:58.905094] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-23T23:59:58.904204] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-23T23:59:58.906482] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-23T23:59:58.906581] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-23T23:59:59.479943] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2025-01-07 to 2025-10-23 (requires 10 months of data pull). [2025-10-23T23:59:59.480960] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-23T23:59:59.510793] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-23T23:59:59.627116] [DEBUG] [LOCAL ] STZ: Primary data saved (52805 records). [2025-10-23T23:59:59.627277] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-23T23:59:59.627380] [INFO ] [MAIN ] Update Progress: 2026/2367 symbols completed. STZ took 54.0s. Estimated remaining: 43m 45s. Rate: 7.8 symbols/min [2025-10-23T23:59:59.793529] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-23T23:59:59.839986] [DEBUG] [LOCAL ] SW: Loaded 53179 existing records from primary storage. [2025-10-23T23:59:59.840318] [INFO ] [MAIN ] SW: Loaded 53179 existing records. [2025-10-24T00:00:00.008348] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-24T00:00:00.013054] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:00.014331] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-24T00:00:00.014408] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-24T00:00:00.014725] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-24T00:00:00.014789] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-24T00:00:00.430075] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-24T00:00:00.508729] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-24T00:00:01.229823] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-24T00:00:01.599459] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-24T00:00:02.399452] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-24T00:00:02.927634] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-24T00:00:03.199444] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-24T00:00:03.699012] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-24T00:00:03.999434] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-24T00:00:04.954518] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-24T00:00:05.599518] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-24T00:00:05.664622] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-24T00:00:06.399489] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-24T00:00:07.199490] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-24T00:00:07.263703] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-24T00:00:07.999446] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-24T00:00:08.188179] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-24T00:00:08.787503] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-24T00:00:08.799401] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-24T00:00:09.568801] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-24T00:00:09.599409] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-24T00:00:10.120412] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-24T00:00:10.399423] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-24T00:00:11.210546] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-24T00:00:11.999502] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-24T00:00:12.059619] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-24T00:00:12.799456] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-24T00:00:13.591557] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-24T00:00:14.399431] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-24T00:00:14.440576] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-24T00:00:15.199419] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-24T00:00:15.999474] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-24T00:00:16.032571] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-24T00:00:16.799464] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-24T00:00:17.046219] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-24T00:00:17.599465] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-24T00:00:17.637106] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-24T00:00:18.058481] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-24T00:00:18.399423] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-24T00:00:19.199404] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-24T00:00:19.248859] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-24T00:00:19.257785] [INFO ] [REMOTE ] SUPV: Full fetch complete (68999 records). [2025-10-24T00:00:19.257944] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-24T00:00:19.664774] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-24T00:00:19.664937] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-24T00:00:19.666253] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-24T00:00:19.666355] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-24T00:00:19.667825] [DEBUG] [LOCAL ] SUPV: Trimmed 68999 records to 48430 (keeping 200 days of data) [2025-10-24T00:00:19.898855] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-24T00:00:19.977598] [DEBUG] [LOCAL ] SUPV: Primary data saved (48430 records). [2025-10-24T00:00:19.977806] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-24T00:00:19.977924] [INFO ] [MAIN ] Update Progress: 2027/2367 symbols completed. SUPV took 25.4s. Estimated remaining: 43m 39s. Rate: 7.8 symbols/min [2025-10-24T00:00:20.008302] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-24T00:00:20.145111] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:20.190272] [DEBUG] [LOCAL ] SWK: Loaded 52397 existing records from primary storage. [2025-10-24T00:00:20.190582] [INFO ] [MAIN ] SWK: Loaded 52397 existing records. [2025-10-24T00:00:20.375462] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:20.375707] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-24T00:00:20.375782] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-24T00:00:20.376164] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-24T00:00:20.376248] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-24T00:00:20.844284] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-24T00:00:21.557370] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-24T00:00:21.599445] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-24T00:00:22.947042] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-24T00:00:23.199428] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-24T00:00:23.999425] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-24T00:00:24.327905] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-24T00:00:24.335504] [INFO ] [REMOTE ] SVV: Full fetch complete (57503 records). [2025-10-24T00:00:24.335637] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-24T00:00:24.739293] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-24T00:00:24.739401] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-24T00:00:24.740618] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-24T00:00:24.740716] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-24T00:00:24.741904] [DEBUG] [LOCAL ] SVV: Trimmed 57503 records to 40525 (keeping 200 days of data) [2025-10-24T00:00:24.971260] [DEBUG] [LOCAL ] SVV: Primary data saved (40525 records). [2025-10-24T00:00:24.971400] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-24T00:00:24.971508] [INFO ] [MAIN ] Update Progress: 2028/2367 symbols completed. SVV took 26.9s. Estimated remaining: 43m 31s. Rate: 7.8 symbols/min [2025-10-24T00:00:25.137308] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:25.165930] [DEBUG] [LOCAL ] SWX: Loaded 30595 existing records from primary storage. [2025-10-24T00:00:25.166241] [INFO ] [MAIN ] SWX: Loaded 30595 existing records. [2025-10-24T00:00:25.344435] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:25.344677] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-24T00:00:25.344751] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-24T00:00:25.344979] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-24T00:00:25.345052] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-24T00:00:25.726691] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-24T00:00:26.399486] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-24T00:00:27.948096] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-24T00:00:27.957033] [INFO ] [REMOTE ] SUZ: Full fetch complete (66739 records). [2025-10-24T00:00:27.957182] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-24T00:00:28.336144] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-24T00:00:28.336258] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-24T00:00:28.337443] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-24T00:00:28.337528] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-24T00:00:28.338894] [DEBUG] [LOCAL ] SUZ: Trimmed 66739 records to 45832 (keeping 200 days of data) [2025-10-24T00:00:28.599823] [DEBUG] [LOCAL ] SUZ: Primary data saved (45832 records). [2025-10-24T00:00:28.599986] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-24T00:00:28.601357] [INFO ] [MAIN ] Update Progress: 2029/2367 symbols completed. SUZ took 32.0s. Estimated remaining: 43m 23s. Rate: 7.8 symbols/min [2025-10-24T00:00:28.766161] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:28.774989] [DEBUG] [LOCAL ] SWZ: Loaded 5997 existing records from primary storage. [2025-10-24T00:00:28.775239] [INFO ] [MAIN ] SWZ: Loaded 5997 existing records. [2025-10-24T00:00:28.961152] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:28.961528] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-24T00:00:28.961606] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-24T00:00:28.961815] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-24T00:00:28.961888] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-24T00:00:46.597201] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-24T00:00:46.976764] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-24T00:00:46.976882] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-24T00:00:46.977818] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-24T00:00:46.977900] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-24T00:00:46.978937] [DEBUG] [LOCAL ] SWX: Trimmed 43827 records to 30757 (keeping 200 days of data) [2025-10-24T00:00:47.164937] [DEBUG] [LOCAL ] SWX: Primary data saved (30757 records). [2025-10-24T00:00:47.165120] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-24T00:00:47.165238] [INFO ] [MAIN ] Update Progress: 2030/2367 symbols completed. SWX took 22.2s. Estimated remaining: 43m 17s. Rate: 7.8 symbols/min [2025-10-24T00:00:47.337463] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:47.373823] [DEBUG] [LOCAL ] SXC: Loaded 41575 existing records from primary storage. [2025-10-24T00:00:47.374141] [INFO ] [MAIN ] SXC: Loaded 41575 existing records. [2025-10-24T00:00:47.560536] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:47.560767] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-24T00:00:47.560851] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-24T00:00:47.561105] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-24T00:00:47.561178] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-24T00:00:51.504720] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-24T00:00:51.906689] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-24T00:00:51.906965] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-24T00:00:51.908315] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-24T00:00:51.908519] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-24T00:00:51.933896] [DEBUG] [LOCAL ] SWK: Trimmed 75545 records to 52755 (keeping 200 days of data) [2025-10-24T00:00:52.275988] [DEBUG] [LOCAL ] SWK: Primary data saved (52755 records). [2025-10-24T00:00:52.276147] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-24T00:00:52.276258] [INFO ] [MAIN ] Update Progress: 2031/2367 symbols completed. SWK took 32.3s. Estimated remaining: 43m 9s. Rate: 7.8 symbols/min [2025-10-24T00:00:52.445177] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:52.458685] [DEBUG] [LOCAL ] SXI: Loaded 12002 existing records from primary storage. [2025-10-24T00:00:52.458930] [INFO ] [MAIN ] SXI: Loaded 12002 existing records. [2025-10-24T00:00:52.632266] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:52.632468] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-24T00:00:52.632541] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-24T00:00:52.632746] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-24T00:00:52.632823] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-24T00:00:53.891906] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-24T00:00:54.300739] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-24T00:00:54.301019] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-24T00:00:54.300911] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-24T00:00:54.302448] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-24T00:00:54.347514] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-24T00:00:54.440813] [DEBUG] [LOCAL ] SW: Trimmed 77119 records to 53568 (keeping 200 days of data) [2025-10-24T00:00:54.801330] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-24T00:00:54.806362] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-24T00:00:54.806629] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-24T00:00:54.813928] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-24T00:00:54.814598] [DEBUG] [LOCAL ] SWZ: Trimmed 8271 records to 6009 (keeping 200 days of data) [2025-10-24T00:00:54.943269] [DEBUG] [LOCAL ] SWZ: Primary data saved (6009 records). [2025-10-24T00:00:54.960912] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-24T00:00:54.961053] [INFO ] [MAIN ] Update Progress: 2032/2367 symbols completed. SWZ took 26.4s. Estimated remaining: 43m 0s. Rate: 7.8 symbols/min [2025-10-24T00:00:55.210857] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:55.225043] [DEBUG] [LOCAL ] SW: Primary data saved (53568 records). [2025-10-24T00:00:55.225535] [INFO ] [MAIN ] SW: Full history saved. [2025-10-24T00:00:55.225778] [INFO ] [MAIN ] Update Progress: 2033/2367 symbols completed. SW took 55.6s. Estimated remaining: 42m 51s. Rate: 7.8 symbols/min [2025-10-24T00:00:55.405708] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:00:55.416132] [DEBUG] [LOCAL ] SXT: Loaded 29654 existing records from primary storage. [2025-10-24T00:00:55.416485] [INFO ] [MAIN ] SXT: Loaded 29654 existing records. [2025-10-24T00:00:55.595246] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:55.608362] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-24T00:00:55.608456] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-24T00:00:55.608710] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-24T00:00:55.608787] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-24T00:00:55.742819] [DEBUG] [LOCAL ] SYF: Loaded 53451 existing records from primary storage. [2025-10-24T00:00:55.776045] [INFO ] [MAIN ] SYF: Loaded 53451 existing records. [2025-10-24T00:00:56.104046] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:00:56.112955] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-24T00:00:56.113171] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-24T00:00:56.164051] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-24T00:00:56.185550] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-24T00:01:17.608800] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-24T00:01:18.023254] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-24T00:01:18.023375] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-24T00:01:18.024487] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-24T00:01:18.024577] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-24T00:01:18.025890] [DEBUG] [LOCAL ] SXC: Trimmed 60986 records to 41860 (keeping 200 days of data) [2025-10-24T00:01:18.272311] [DEBUG] [LOCAL ] SXC: Primary data saved (41860 records). [2025-10-24T00:01:18.272468] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-24T00:01:18.272590] [INFO ] [MAIN ] Update Progress: 2034/2367 symbols completed. SXC took 31.1s. Estimated remaining: 42m 46s. Rate: 7.8 symbols/min [2025-10-24T00:01:18.446022] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:18.497839] [DEBUG] [LOCAL ] SYK: Loaded 46804 existing records from primary storage. [2025-10-24T00:01:18.498215] [INFO ] [MAIN ] SYK: Loaded 46804 existing records. [2025-10-24T00:01:18.686467] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:18.686758] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-24T00:01:18.686836] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-24T00:01:18.687060] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-24T00:01:18.687133] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-24T00:01:24.468910] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-24T00:01:24.842839] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-24T00:01:24.844048] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-24T00:01:24.844894] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-24T00:01:24.845069] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-24T00:01:24.846041] [DEBUG] [LOCAL ] SXT: Trimmed 39611 records to 29769 (keeping 200 days of data) [2025-10-24T00:01:24.964877] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-24T00:01:25.334737] [DEBUG] [LOCAL ] SXT: Primary data saved (29769 records). [2025-10-24T00:01:25.340830] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-24T00:01:25.357790] [INFO ] [MAIN ] Update Progress: 2035/2367 symbols completed. SXT took 30.4s. Estimated remaining: 42m 38s. Rate: 7.8 symbols/min [2025-10-24T00:01:25.520328] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-24T00:01:25.520676] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-24T00:01:25.531458] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-24T00:01:25.541819] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-24T00:01:25.571594] [DEBUG] [LOCAL ] SXI: Trimmed 15914 records to 12093 (keeping 200 days of data) [2025-10-24T00:01:25.590436] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:25.668563] [DEBUG] [LOCAL ] SXI: Primary data saved (12093 records). [2025-10-24T00:01:25.668789] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-24T00:01:25.668940] [INFO ] [MAIN ] Update Progress: 2036/2367 symbols completed. SXI took 33.4s. Estimated remaining: 42m 29s. Rate: 7.8 symbols/min [2025-10-24T00:01:25.876795] [DEBUG] [LOCAL ] SYY: Loaded 53204 existing records from primary storage. [2025-10-24T00:01:25.876705] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:25.877407] [INFO ] [MAIN ] SYY: Loaded 53204 existing records. [2025-10-24T00:01:26.060258] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:26.073724] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-24T00:01:26.073836] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-24T00:01:26.074131] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-24T00:01:26.074215] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-24T00:01:26.237918] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-24T00:01:26.258369] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-24T00:01:26.649931] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:26.654775] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-24T00:01:26.656519] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-24T00:01:26.656995] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-24T00:01:26.657103] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-24T00:01:30.604405] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-24T00:01:30.988895] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-24T00:01:30.989028] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-24T00:01:30.990263] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-24T00:01:30.990361] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-24T00:01:30.991849] [DEBUG] [LOCAL ] SYF: Trimmed 77580 records to 53841 (keeping 200 days of data) [2025-10-24T00:01:31.320903] [DEBUG] [LOCAL ] SYF: Primary data saved (53841 records). [2025-10-24T00:01:31.321120] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-24T00:01:31.321272] [INFO ] [MAIN ] Update Progress: 2037/2367 symbols completed. SYF took 36.1s. Estimated remaining: 42m 21s. Rate: 7.8 symbols/min [2025-10-24T00:01:42.560127] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-24T00:01:42.941411] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-24T00:01:42.941533] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-24T00:01:42.942826] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-24T00:01:42.942919] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-24T00:01:42.944320] [DEBUG] [LOCAL ] SYK: Trimmed 69190 records to 47139 (keeping 200 days of data) [2025-10-24T00:01:43.247609] [DEBUG] [LOCAL ] SYK: Primary data saved (47139 records). [2025-10-24T00:01:43.248144] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-24T00:01:43.248276] [INFO ] [MAIN ] Update Progress: 2038/2367 symbols completed. SYK took 25.0s. Estimated remaining: 42m 14s. Rate: 7.8 symbols/min [2025-10-24T00:01:48.825072] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-24T00:01:49.222856] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-24T00:01:49.222970] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-24T00:01:49.224201] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-24T00:01:49.224282] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-24T00:01:49.225718] [DEBUG] [LOCAL ] SYY: Trimmed 77246 records to 53592 (keeping 200 days of data) [2025-10-24T00:01:49.612708] [DEBUG] [LOCAL ] SYY: Primary data saved (53592 records). [2025-10-24T00:01:49.612859] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-24T00:01:49.614481] [INFO ] [MAIN ] Update Progress: 2039/2367 symbols completed. SYY took 24.3s. Estimated remaining: 42m 6s. Rate: 7.8 symbols/min [2025-10-24T00:01:54.372412] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-24T00:01:54.780795] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-24T00:01:54.780931] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-24T00:01:54.782150] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-24T00:01:54.782230] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-24T00:01:54.783667] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 54188 (keeping 200 days of data) [2025-10-24T00:01:55.109051] [DEBUG] [LOCAL ] T: Primary data saved (54188 records). [2025-10-24T00:01:55.109211] [INFO ] [MAIN ] T: Full history saved. [2025-10-24T00:01:55.109322] [INFO ] [MAIN ] Update Progress: 2040/2367 symbols completed. T took 29.4s. Estimated remaining: 41m 58s. Rate: 7.8 symbols/min [2025-10-24T00:01:55.725811] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:55.821230] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:55.848047] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:55.849587] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:01:55.933984] [DEBUG] [LOCAL ] TAL: Loaded 51715 existing records from primary storage. [2025-10-24T00:01:55.948419] [INFO ] [MAIN ] TAL: Loaded 51715 existing records. [2025-10-24T00:01:55.972189] [DEBUG] [LOCAL ] TALO: Loaded 50988 existing records from primary storage. [2025-10-24T00:01:56.035422] [INFO ] [MAIN ] TALO: Loaded 50988 existing records. [2025-10-24T00:01:56.009097] [DEBUG] [LOCAL ] TAC: Loaded 43411 existing records from primary storage. [2025-10-24T00:01:56.063114] [DEBUG] [LOCAL ] TAK: Loaded 50230 existing records from primary storage. [2025-10-24T00:01:56.115299] [INFO ] [MAIN ] TAC: Loaded 43411 existing records. [2025-10-24T00:01:56.257478] [INFO ] [MAIN ] TAK: Loaded 50230 existing records. [2025-10-24T00:01:56.643785] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:56.687639] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:56.710447] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:56.710906] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-24T00:01:56.726635] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-24T00:01:56.705920] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-24T00:01:56.726725] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-24T00:01:56.760088] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-24T00:01:56.768439] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-24T00:01:56.770284] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-24T00:01:56.786003] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-24T00:01:56.790991] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:01:56.791109] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-24T00:01:56.788042] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-24T00:01:56.791229] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-24T00:01:56.791586] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-24T00:01:56.802478] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-24T00:01:56.855317] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-24T00:01:56.999044] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-24T00:01:57.071491] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-24T00:02:14.821101] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-24T00:02:15.220175] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-24T00:02:15.220296] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-24T00:02:15.221604] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-24T00:02:15.221827] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-24T00:02:15.223326] [DEBUG] [LOCAL ] TALO: Trimmed 73415 records to 51375 (keeping 200 days of data) [2025-10-24T00:02:15.519727] [DEBUG] [LOCAL ] TALO: Primary data saved (51375 records). [2025-10-24T00:02:15.519950] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-24T00:02:15.520062] [INFO ] [MAIN ] Update Progress: 2041/2367 symbols completed. TALO took 20.4s. Estimated remaining: 41m 53s. Rate: 7.8 symbols/min [2025-10-24T00:02:15.692327] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:15.739700] [DEBUG] [LOCAL ] TAP: Loaded 52959 existing records from primary storage. [2025-10-24T00:02:15.740036] [INFO ] [MAIN ] TAP: Loaded 52959 existing records. [2025-10-24T00:02:15.947262] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:02:15.949348] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-24T00:02:15.949527] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-24T00:02:15.958235] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-24T00:02:15.958317] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-24T00:02:18.529481] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-24T00:02:18.908289] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-24T00:02:18.908396] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-24T00:02:18.909517] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-24T00:02:18.909595] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-24T00:02:18.910860] [DEBUG] [LOCAL ] TAC: Trimmed 64791 records to 43784 (keeping 200 days of data) [2025-10-24T00:02:19.170502] [DEBUG] [LOCAL ] TAC: Primary data saved (43784 records). [2025-10-24T00:02:19.170681] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-24T00:02:19.170805] [INFO ] [MAIN ] Update Progress: 2042/2367 symbols completed. TAC took 24.1s. Estimated remaining: 41m 44s. Rate: 7.8 symbols/min [2025-10-24T00:02:19.347048] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:19.347389] [DEBUG] [LOCAL ] TBB: No existing data file found in primary storage. [2025-10-24T00:02:19.347573] [WARN ] [MAIN ] TBB: No existing data found, performing full refresh instead. [2025-10-24T00:02:19.356974] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-24T00:02:19.357114] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-24T00:02:19.370662] [DEBUG] [LOCAL ] TBB: No primary data file found to delete. [2025-10-24T00:02:19.373385] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-24T00:02:21.927510] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-24T00:02:22.331502] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-24T00:02:22.335557] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-24T00:02:22.337450] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-24T00:02:22.337535] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-24T00:02:22.338964] [DEBUG] [LOCAL ] TAL: Trimmed 75714 records to 52091 (keeping 200 days of data) [2025-10-24T00:02:22.641006] [DEBUG] [LOCAL ] TAL: Primary data saved (52091 records). [2025-10-24T00:02:22.641171] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-24T00:02:22.641315] [INFO ] [MAIN ] Update Progress: 2043/2367 symbols completed. TAL took 27.5s. Estimated remaining: 41m 36s. Rate: 7.8 symbols/min [2025-10-24T00:02:22.812262] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:22.844481] [DEBUG] [LOCAL ] TBBB: Loaded 35604 existing records from primary storage. [2025-10-24T00:02:22.844847] [INFO ] [MAIN ] TBBB: Loaded 35604 existing records. [2025-10-24T00:02:23.022590] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:02:23.022849] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-24T00:02:23.022950] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-24T00:02:23.023232] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-24T00:02:23.023313] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-24T00:02:24.976892] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-24T00:02:25.361632] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-24T00:02:25.361778] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-24T00:02:25.362987] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-24T00:02:25.363069] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-24T00:02:25.364503] [DEBUG] [LOCAL ] TAK: Trimmed 72061 records to 50590 (keeping 200 days of data) [2025-10-24T00:02:25.660090] [DEBUG] [LOCAL ] TAK: Primary data saved (50590 records). [2025-10-24T00:02:25.660213] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-24T00:02:25.660334] [INFO ] [MAIN ] Update Progress: 2044/2367 symbols completed. TAK took 30.5s. Estimated remaining: 41m 28s. Rate: 7.8 symbols/min [2025-10-24T00:02:25.850778] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:25.872148] [DEBUG] [LOCAL ] TBI: Loaded 22761 existing records from primary storage. [2025-10-24T00:02:25.872474] [INFO ] [MAIN ] TBI: Loaded 22761 existing records. [2025-10-24T00:02:26.049024] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:02:26.049219] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-24T00:02:26.049293] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-24T00:02:26.049486] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-24T00:02:26.049556] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-24T00:02:49.837810] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-24T00:02:50.265112] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-24T00:02:50.265302] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-24T00:02:50.266503] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-24T00:02:50.266582] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-24T00:02:50.268044] [DEBUG] [LOCAL ] TAP: Trimmed 76518 records to 53338 (keeping 200 days of data) [2025-10-24T00:02:50.376660] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-24T00:02:50.926308] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-24T00:02:50.927419] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-24T00:02:50.931144] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-24T00:02:50.934584] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-24T00:02:50.939539] [DEBUG] [LOCAL ] TBB: Trimmed 16294 records to 11343 (keeping 200 days of data) [2025-10-24T00:02:51.077693] [DEBUG] [LOCAL ] TBB: Primary data saved (11343 records). [2025-10-24T00:02:51.090370] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-24T00:02:51.090664] [INFO ] [MAIN ] Update Progress: 2045/2367 symbols completed. TBB took 31.9s. Estimated remaining: 41m 23s. Rate: 7.8 symbols/min [2025-10-24T00:02:51.090470] [DEBUG] [LOCAL ] TAP: Primary data saved (53338 records). [2025-10-24T00:02:51.133988] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-24T00:02:51.178426] [INFO ] [MAIN ] Update Progress: 2046/2367 symbols completed. TAP took 35.7s. Estimated remaining: 41m 14s. Rate: 7.8 symbols/min [2025-10-24T00:02:51.391866] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:51.397740] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-24T00:02:51.402935] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-24T00:02:51.418479] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-24T00:02:51.431787] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-24T00:02:51.432012] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-24T00:02:51.438519] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-24T00:02:51.534191] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:51.612158] [DEBUG] [LOCAL ] TBN: Loaded 4034 existing records from primary storage. [2025-10-24T00:02:51.617671] [INFO ] [MAIN ] TBN: Loaded 4034 existing records. [2025-10-24T00:02:51.958919] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-24T00:02:52.130216] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:02:52.188925] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-24T00:02:52.189035] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-24T00:02:52.189379] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-24T00:02:52.210536] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-24T00:02:52.779133] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-24T00:02:52.790392] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-24T00:02:52.791398] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-24T00:02:52.791626] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-24T00:02:52.843218] [DEBUG] [LOCAL ] TBI: Trimmed 32145 records to 22933 (keeping 200 days of data) [2025-10-24T00:02:53.031948] [DEBUG] [LOCAL ] TBI: Primary data saved (22933 records). [2025-10-24T00:02:53.032115] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-24T00:02:53.032227] [INFO ] [MAIN ] Update Progress: 2047/2367 symbols completed. TBI took 27.4s. Estimated remaining: 41m 5s. Rate: 7.8 symbols/min [2025-10-24T00:02:53.204114] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:53.204311] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-24T00:02:53.204385] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-24T00:02:53.204468] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-24T00:02:53.204534] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-24T00:02:53.204614] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-24T00:02:53.204703] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-24T00:02:53.812314] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-24T00:02:53.812402] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:02:53.812496] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-24T00:02:53.812613] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-24T00:02:53.812719] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-24T00:02:53.812824] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-24T00:02:53.812926] [INFO ] [MAIN ] Update Progress: 2048/2367 symbols completed. TCAI took 0.8s. Estimated remaining: 40m 56s. Rate: 7.8 symbols/min [2025-10-24T00:02:53.990253] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:54.002354] [DEBUG] [LOCAL ] TCBX: Loaded 10195 existing records from primary storage. [2025-10-24T00:02:54.002677] [INFO ] [MAIN ] TCBX: Loaded 10195 existing records. [2025-10-24T00:02:54.184934] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:02:54.185179] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-24T00:02:54.185272] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-24T00:02:54.185478] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-24T00:02:54.185568] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-24T00:02:57.504332] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-24T00:02:57.893380] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-24T00:02:57.893492] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-24T00:02:57.894517] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-24T00:02:57.894596] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-24T00:02:57.895694] [DEBUG] [LOCAL ] TBBB: Trimmed 52150 records to 35816 (keeping 200 days of data) [2025-10-24T00:02:58.105087] [DEBUG] [LOCAL ] TBBB: Primary data saved (35816 records). [2025-10-24T00:02:58.105241] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-24T00:02:58.105354] [INFO ] [MAIN ] Update Progress: 2049/2367 symbols completed. TBBB took 35.5s. Estimated remaining: 40m 48s. Rate: 7.8 symbols/min [2025-10-24T00:02:58.282720] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:02:58.285250] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-24T00:02:58.286279] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-24T00:02:58.286456] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-24T00:02:58.286531] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-24T00:02:58.286616] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-24T00:02:58.286709] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-24T00:03:01.821918] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-24T00:03:01.821994] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:03:01.822072] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-24T00:03:01.822169] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-24T00:03:01.822241] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-24T00:03:01.822376] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-24T00:03:01.822470] [INFO ] [MAIN ] Update Progress: 2050/2367 symbols completed. TCPA took 3.7s. Estimated remaining: 40m 40s. Rate: 7.8 symbols/min [2025-10-24T00:03:02.001167] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:02.049666] [DEBUG] [LOCAL ] TD: Loaded 52240 existing records from primary storage. [2025-10-24T00:03:02.050022] [INFO ] [MAIN ] TD: Loaded 52240 existing records. [2025-10-24T00:03:02.225064] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:02.225276] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-24T00:03:02.225354] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-24T00:03:02.225589] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-24T00:03:02.225691] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-24T00:03:12.418238] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-24T00:03:12.624550] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-24T00:03:12.624741] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-24T00:03:12.624815] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-24T00:03:12.624906] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-24T00:03:12.625012] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-24T00:03:12.625083] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-24T00:03:12.625164] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-24T00:03:12.625276] [INFO ] [MAIN ] Update Progress: 2051/2367 symbols completed. TBLU took 21.5s. Estimated remaining: 40m 33s. Rate: 7.8 symbols/min [2025-10-24T00:03:12.814602] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:12.858496] [DEBUG] [LOCAL ] TDC: Loaded 46401 existing records from primary storage. [2025-10-24T00:03:12.858839] [INFO ] [MAIN ] TDC: Loaded 46401 existing records. [2025-10-24T00:03:13.034133] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:13.034348] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-24T00:03:13.034423] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-24T00:03:13.034681] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-24T00:03:13.034745] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-24T00:03:20.980461] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-24T00:03:21.338203] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-24T00:03:21.338326] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-24T00:03:21.338525] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-24T00:03:21.338598] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-24T00:03:21.339024] [DEBUG] [LOCAL ] TBN: Trimmed 6180 records to 4269 (keeping 200 days of data) [2025-10-24T00:03:21.362671] [DEBUG] [LOCAL ] TBN: Primary data saved (4269 records). [2025-10-24T00:03:21.362765] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-24T00:03:21.362872] [INFO ] [MAIN ] Update Progress: 2052/2367 symbols completed. TBN took 30.2s. Estimated remaining: 40m 25s. Rate: 7.8 symbols/min [2025-10-24T00:03:21.528322] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:21.536194] [DEBUG] [LOCAL ] TDF: Loaded 6197 existing records from primary storage. [2025-10-24T00:03:21.536389] [INFO ] [MAIN ] TDF: Loaded 6197 existing records. [2025-10-24T00:03:21.719173] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:21.719453] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-24T00:03:21.719547] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-24T00:03:21.719954] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-24T00:03:21.720041] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-24T00:03:35.217023] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-24T00:03:35.593406] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-24T00:03:35.593513] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-24T00:03:35.593909] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-24T00:03:35.593987] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-24T00:03:35.594501] [DEBUG] [LOCAL ] TCBX: Trimmed 15809 records to 10283 (keeping 200 days of data) [2025-10-24T00:03:35.652019] [DEBUG] [LOCAL ] TCBX: Primary data saved (10283 records). [2025-10-24T00:03:35.652172] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-24T00:03:35.652283] [INFO ] [MAIN ] Update Progress: 2053/2367 symbols completed. TCBX took 41.8s. Estimated remaining: 40m 18s. Rate: 7.8 symbols/min [2025-10-24T00:03:35.822253] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:35.844452] [DEBUG] [LOCAL ] TDG: Loaded 21943 existing records from primary storage. [2025-10-24T00:03:35.844768] [INFO ] [MAIN ] TDG: Loaded 21943 existing records. [2025-10-24T00:03:36.021573] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:36.021863] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-24T00:03:36.021974] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-24T00:03:36.023154] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-24T00:03:36.023246] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-24T00:03:41.628445] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-24T00:03:42.018274] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-24T00:03:42.018385] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-24T00:03:42.019613] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-24T00:03:42.019722] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-24T00:03:42.021136] [DEBUG] [LOCAL ] TD: Trimmed 75863 records to 52588 (keeping 200 days of data) [2025-10-24T00:03:42.373254] [DEBUG] [LOCAL ] TD: Primary data saved (52588 records). [2025-10-24T00:03:42.373560] [INFO ] [MAIN ] TD: Full history saved. [2025-10-24T00:03:42.374802] [INFO ] [MAIN ] Update Progress: 2054/2367 symbols completed. TD took 40.6s. Estimated remaining: 40m 10s. Rate: 7.8 symbols/min [2025-10-24T00:03:42.374917] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-24T00:03:42.709596] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:42.978198] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-24T00:03:42.978393] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-24T00:03:42.992928] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-24T00:03:43.013621] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-24T00:03:43.014822] [DEBUG] [LOCAL ] TDOC: Loaded 53369 existing records from primary storage. [2025-10-24T00:03:43.015188] [INFO ] [MAIN ] TDOC: Loaded 53369 existing records. [2025-10-24T00:03:43.116719] [DEBUG] [LOCAL ] TDC: Trimmed 67828 records to 46766 (keeping 200 days of data) [2025-10-24T00:03:43.254989] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:43.289922] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-24T00:03:43.293210] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-24T00:03:43.299614] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-24T00:03:43.304225] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-24T00:03:43.981199] [DEBUG] [LOCAL ] TDC: Primary data saved (46766 records). [2025-10-24T00:03:43.981390] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-24T00:03:43.982102] [INFO ] [MAIN ] Update Progress: 2055/2367 symbols completed. TDC took 31.4s. Estimated remaining: 40m 2s. Rate: 7.8 symbols/min [2025-10-24T00:03:44.258560] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:44.308225] [DEBUG] [LOCAL ] TDS: Loaded 42187 existing records from primary storage. [2025-10-24T00:03:44.308703] [INFO ] [MAIN ] TDS: Loaded 42187 existing records. [2025-10-24T00:03:44.551082] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:44.551850] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-24T00:03:44.551961] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-24T00:03:44.552283] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-24T00:03:44.552390] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-24T00:03:46.092289] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-24T00:03:46.495436] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-24T00:03:46.495605] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-24T00:03:46.495915] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-24T00:03:46.495989] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-24T00:03:46.496547] [DEBUG] [LOCAL ] TDF: Trimmed 10310 records to 6235 (keeping 200 days of data) [2025-10-24T00:03:46.536939] [DEBUG] [LOCAL ] TDF: Primary data saved (6235 records). [2025-10-24T00:03:46.537111] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-24T00:03:46.537242] [INFO ] [MAIN ] Update Progress: 2056/2367 symbols completed. TDF took 25.2s. Estimated remaining: 39m 53s. Rate: 7.8 symbols/min [2025-10-24T00:03:46.720271] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:03:46.757229] [DEBUG] [LOCAL ] TDW: Loaded 44907 existing records from primary storage. [2025-10-24T00:03:46.757537] [INFO ] [MAIN ] TDW: Loaded 44907 existing records. [2025-10-24T00:03:46.956951] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:03:46.959929] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-24T00:03:46.960042] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-24T00:03:46.960635] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-24T00:03:46.961985] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-24T00:04:07.059043] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-24T00:04:07.491370] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-24T00:04:07.491545] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-24T00:04:07.492780] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-24T00:04:07.493016] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-24T00:04:07.494612] [DEBUG] [LOCAL ] TDS: Trimmed 61294 records to 42409 (keeping 200 days of data) [2025-10-24T00:04:07.802418] [DEBUG] [LOCAL ] TDS: Primary data saved (42409 records). [2025-10-24T00:04:07.802580] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-24T00:04:07.802720] [INFO ] [MAIN ] Update Progress: 2057/2367 symbols completed. TDS took 23.8s. Estimated remaining: 39m 48s. Rate: 7.8 symbols/min [2025-10-24T00:04:07.970235] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:07.989812] [DEBUG] [LOCAL ] TDY: Loaded 22146 existing records from primary storage. [2025-10-24T00:04:07.990081] [INFO ] [MAIN ] TDY: Loaded 22146 existing records. [2025-10-24T00:04:08.181159] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:08.181545] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-24T00:04:08.181626] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-24T00:04:08.181877] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-24T00:04:08.181949] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-24T00:04:13.093438] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-24T00:04:13.483065] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-24T00:04:13.483184] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-24T00:04:13.483925] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-24T00:04:13.484014] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-24T00:04:13.484997] [DEBUG] [LOCAL ] TDG: Trimmed 32014 records to 22110 (keeping 200 days of data) [2025-10-24T00:04:13.627255] [DEBUG] [LOCAL ] TDG: Primary data saved (22110 records). [2025-10-24T00:04:13.627387] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-24T00:04:13.627500] [INFO ] [MAIN ] Update Progress: 2058/2367 symbols completed. TDG took 38.0s. Estimated remaining: 39m 40s. Rate: 7.8 symbols/min [2025-10-24T00:04:13.795287] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:13.795463] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-24T00:04:13.795554] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-24T00:04:13.795689] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-24T00:04:13.795762] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-24T00:04:13.795842] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-24T00:04:13.795908] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-24T00:04:15.442177] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-24T00:04:15.442249] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:04:15.442327] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-24T00:04:15.442616] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-24T00:04:15.442873] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-24T00:04:15.442962] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-24T00:04:15.470591] [INFO ] [MAIN ] Update Progress: 2059/2367 symbols completed. TE took 1.8s. Estimated remaining: 39m 31s. Rate: 7.8 symbols/min [2025-10-24T00:04:15.657589] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:15.667746] [DEBUG] [LOCAL ] TEAF: Loaded 7331 existing records from primary storage. [2025-10-24T00:04:15.668042] [INFO ] [MAIN ] TEAF: Loaded 7331 existing records. [2025-10-24T00:04:15.852735] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:15.852974] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-24T00:04:15.853055] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-24T00:04:15.853257] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-24T00:04:15.853331] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-24T00:04:16.774261] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-24T00:04:17.171744] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-24T00:04:17.171873] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-24T00:04:17.173023] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-24T00:04:17.173104] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-24T00:04:17.174435] [DEBUG] [LOCAL ] TDW: Trimmed 66689 records to 45265 (keeping 200 days of data) [2025-10-24T00:04:17.433280] [DEBUG] [LOCAL ] TDW: Primary data saved (45265 records). [2025-10-24T00:04:17.433447] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-24T00:04:17.433563] [INFO ] [MAIN ] Update Progress: 2060/2367 symbols completed. TDW took 30.9s. Estimated remaining: 39m 23s. Rate: 7.8 symbols/min [2025-10-24T00:04:17.600946] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:17.650925] [DEBUG] [LOCAL ] TECK: Loaded 53435 existing records from primary storage. [2025-10-24T00:04:17.651280] [INFO ] [MAIN ] TECK: Loaded 53435 existing records. [2025-10-24T00:04:17.825668] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:17.825874] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-24T00:04:17.825948] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-24T00:04:17.826372] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-24T00:04:17.826446] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-24T00:04:18.750878] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-24T00:04:19.139208] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-24T00:04:19.139337] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-24T00:04:19.140574] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-24T00:04:19.140676] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-24T00:04:19.142180] [DEBUG] [LOCAL ] TDOC: Trimmed 77441 records to 53758 (keeping 200 days of data) [2025-10-24T00:04:19.467869] [DEBUG] [LOCAL ] TDOC: Primary data saved (53758 records). [2025-10-24T00:04:19.468059] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-24T00:04:19.468193] [INFO ] [MAIN ] Update Progress: 2061/2367 symbols completed. TDOC took 37.1s. Estimated remaining: 39m 14s. Rate: 7.8 symbols/min [2025-10-24T00:04:19.651499] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:19.690317] [DEBUG] [LOCAL ] TEF: Loaded 36800 existing records from primary storage. [2025-10-24T00:04:19.690712] [INFO ] [MAIN ] TEF: Loaded 36800 existing records. [2025-10-24T00:04:19.925028] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:19.931959] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-24T00:04:19.932047] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-24T00:04:19.932314] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-24T00:04:19.932416] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-24T00:04:33.068257] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-24T00:04:33.439195] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-24T00:04:33.439307] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-24T00:04:33.440051] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-24T00:04:33.440139] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-24T00:04:33.441030] [DEBUG] [LOCAL ] TDY: Trimmed 32118 records to 22311 (keeping 200 days of data) [2025-10-24T00:04:33.585909] [DEBUG] [LOCAL ] TDY: Primary data saved (22311 records). [2025-10-24T00:04:33.586078] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-24T00:04:33.586209] [INFO ] [MAIN ] Update Progress: 2062/2367 symbols completed. TDY took 25.8s. Estimated remaining: 39m 7s. Rate: 7.8 symbols/min [2025-10-24T00:04:33.760234] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:33.780601] [DEBUG] [LOCAL ] TEI: Loaded 21181 existing records from primary storage. [2025-10-24T00:04:33.780893] [INFO ] [MAIN ] TEI: Loaded 21181 existing records. [2025-10-24T00:04:33.951612] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:33.951867] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-24T00:04:33.951962] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-24T00:04:33.952167] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-24T00:04:33.952243] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-24T00:04:35.988601] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-24T00:04:36.418812] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-24T00:04:36.418961] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-24T00:04:36.419309] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-24T00:04:36.419427] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-24T00:04:36.419993] [DEBUG] [LOCAL ] TEAF: Trimmed 10202 records to 7393 (keeping 200 days of data) [2025-10-24T00:04:36.468046] [DEBUG] [LOCAL ] TEAF: Primary data saved (7393 records). [2025-10-24T00:04:36.468237] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-24T00:04:36.468380] [INFO ] [MAIN ] Update Progress: 2063/2367 symbols completed. TEAF took 21.0s. Estimated remaining: 38m 59s. Rate: 7.8 symbols/min [2025-10-24T00:04:36.645309] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:36.692887] [DEBUG] [LOCAL ] TEL: Loaded 51046 existing records from primary storage. [2025-10-24T00:04:36.693206] [INFO ] [MAIN ] TEL: Loaded 51046 existing records. [2025-10-24T00:04:36.872488] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:36.873180] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-24T00:04:36.873294] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-24T00:04:36.873897] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-24T00:04:36.873979] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-24T00:04:51.870025] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-24T00:04:52.271026] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-24T00:04:52.275370] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-24T00:04:52.276852] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-24T00:04:52.277269] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-24T00:04:52.278412] [DEBUG] [LOCAL ] TEF: Trimmed 54457 records to 37042 (keeping 200 days of data) [2025-10-24T00:04:52.499993] [DEBUG] [LOCAL ] TEF: Primary data saved (37042 records). [2025-10-24T00:04:52.500165] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-24T00:04:52.500276] [INFO ] [MAIN ] Update Progress: 2064/2367 symbols completed. TEF took 33.0s. Estimated remaining: 38m 52s. Rate: 7.8 symbols/min [2025-10-24T00:04:52.665405] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:52.696001] [DEBUG] [LOCAL ] TEN: Loaded 30257 existing records from primary storage. [2025-10-24T00:04:52.696281] [INFO ] [MAIN ] TEN: Loaded 30257 existing records. [2025-10-24T00:04:52.872375] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:52.872543] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-24T00:04:52.872616] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-24T00:04:52.872867] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-24T00:04:52.872941] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-24T00:04:58.880414] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-24T00:04:59.251835] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-24T00:04:59.251951] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-24T00:04:59.253002] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-24T00:04:59.253083] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-24T00:04:59.253856] [DEBUG] [LOCAL ] TEI: Trimmed 30702 records to 21262 (keeping 200 days of data) [2025-10-24T00:04:59.403723] [DEBUG] [LOCAL ] TEI: Primary data saved (21262 records). [2025-10-24T00:04:59.405337] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-24T00:04:59.405583] [INFO ] [MAIN ] Update Progress: 2065/2367 symbols completed. TEI took 25.8s. Estimated remaining: 38m 45s. Rate: 7.8 symbols/min [2025-10-24T00:04:59.592569] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:04:59.612967] [DEBUG] [LOCAL ] TEO: Loaded 22745 existing records from primary storage. [2025-10-24T00:04:59.613427] [INFO ] [MAIN ] TEO: Loaded 22745 existing records. [2025-10-24T00:04:59.792135] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:04:59.792485] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-24T00:04:59.809248] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-24T00:04:59.810420] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-24T00:04:59.817195] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-24T00:05:09.668906] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-24T00:05:10.050235] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-24T00:05:10.050409] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-24T00:05:10.051696] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-24T00:05:10.051786] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-24T00:05:10.053289] [DEBUG] [LOCAL ] TEL: Trimmed 73823 records to 51400 (keeping 200 days of data) [2025-10-24T00:05:10.396100] [DEBUG] [LOCAL ] TEL: Primary data saved (51400 records). [2025-10-24T00:05:10.396267] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-24T00:05:10.396381] [INFO ] [MAIN ] Update Progress: 2066/2367 symbols completed. TEL took 33.9s. Estimated remaining: 38m 37s. Rate: 7.8 symbols/min [2025-10-24T00:05:10.565662] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:10.615891] [DEBUG] [LOCAL ] TEVA: Loaded 53622 existing records from primary storage. [2025-10-24T00:05:10.616238] [INFO ] [MAIN ] TEVA: Loaded 53622 existing records. [2025-10-24T00:05:10.790521] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:10.790754] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-24T00:05:10.790811] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-24T00:05:10.791037] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-24T00:05:10.791110] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-24T00:05:11.194079] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-24T00:05:11.586088] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-24T00:05:11.586241] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-24T00:05:11.587545] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-24T00:05:11.592794] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-24T00:05:11.606179] [DEBUG] [LOCAL ] TECK: Trimmed 77531 records to 53821 (keeping 200 days of data) [2025-10-24T00:05:11.607283] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-24T00:05:12.297038] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-24T00:05:12.315704] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-24T00:05:12.317160] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-24T00:05:12.318868] [DEBUG] [LOCAL ] TECK: Primary data saved (53821 records). [2025-10-24T00:05:12.318988] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-24T00:05:12.319410] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-24T00:05:12.319549] [INFO ] [MAIN ] Update Progress: 2067/2367 symbols completed. TECK took 54.9s. Estimated remaining: 38m 29s. Rate: 7.8 symbols/min [2025-10-24T00:05:12.402212] [DEBUG] [LOCAL ] TEN: Trimmed 44072 records to 30505 (keeping 200 days of data) [2025-10-24T00:05:12.560568] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:12.720752] [DEBUG] [LOCAL ] TEN: Primary data saved (30505 records). [2025-10-24T00:05:12.732849] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-24T00:05:12.733002] [INFO ] [MAIN ] Update Progress: 2068/2367 symbols completed. TEN took 20.2s. Estimated remaining: 38m 20s. Rate: 7.8 symbols/min [2025-10-24T00:05:12.758556] [DEBUG] [LOCAL ] TEX: Loaded 43477 existing records from primary storage. [2025-10-24T00:05:12.805530] [INFO ] [MAIN ] TEX: Loaded 43477 existing records. [2025-10-24T00:05:13.089222] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:13.093887] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:13.094510] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-24T00:05:13.094587] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-24T00:05:13.094895] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-24T00:05:13.094970] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-24T00:05:13.475481] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-24T00:05:13.475932] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-24T00:05:13.654617] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:13.654873] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-24T00:05:13.655038] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-24T00:05:13.655260] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-24T00:05:13.655332] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-24T00:05:29.898531] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-24T00:05:30.271898] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-24T00:05:30.272042] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-24T00:05:30.272780] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-24T00:05:30.272872] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-24T00:05:30.273896] [DEBUG] [LOCAL ] TEO: Trimmed 32789 records to 23036 (keeping 200 days of data) [2025-10-24T00:05:30.402849] [DEBUG] [LOCAL ] TEO: Primary data saved (23036 records). [2025-10-24T00:05:30.403961] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-24T00:05:30.404113] [INFO ] [MAIN ] Update Progress: 2069/2367 symbols completed. TEO took 31.0s. Estimated remaining: 38m 14s. Rate: 7.8 symbols/min [2025-10-24T00:05:30.577141] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:30.606981] [DEBUG] [LOCAL ] TFII: Loaded 32251 existing records from primary storage. [2025-10-24T00:05:30.607318] [INFO ] [MAIN ] TFII: Loaded 32251 existing records. [2025-10-24T00:05:30.782631] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:30.782888] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-24T00:05:30.782984] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-24T00:05:30.783219] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-24T00:05:30.783316] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-24T00:05:43.109108] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-24T00:05:43.494435] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-24T00:05:43.494555] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-24T00:05:43.495720] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-24T00:05:43.495798] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-24T00:05:43.497054] [DEBUG] [LOCAL ] TEX: Trimmed 64425 records to 43837 (keeping 200 days of data) [2025-10-24T00:05:43.753375] [DEBUG] [LOCAL ] TEX: Primary data saved (43837 records). [2025-10-24T00:05:43.753547] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-24T00:05:43.753704] [INFO ] [MAIN ] Update Progress: 2070/2367 symbols completed. TEX took 31.4s. Estimated remaining: 38m 7s. Rate: 7.8 symbols/min [2025-10-24T00:05:43.923511] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:43.945182] [DEBUG] [LOCAL ] TFIN: Loaded 23665 existing records from primary storage. [2025-10-24T00:05:43.945509] [INFO ] [MAIN ] TFIN: Loaded 23665 existing records. [2025-10-24T00:05:44.132315] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:44.132510] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-24T00:05:44.132587] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-24T00:05:44.132811] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-24T00:05:44.132885] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-24T00:05:46.800182] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-24T00:05:47.202864] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-24T00:05:47.203079] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-24T00:05:47.204683] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-24T00:05:47.205725] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-24T00:05:47.207779] [DEBUG] [LOCAL ] TEVA: Trimmed 77780 records to 54007 (keeping 200 days of data) [2025-10-24T00:05:47.584084] [DEBUG] [LOCAL ] TEVA: Primary data saved (54007 records). [2025-10-24T00:05:47.584265] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-24T00:05:47.584400] [INFO ] [MAIN ] Update Progress: 2071/2367 symbols completed. TEVA took 37.2s. Estimated remaining: 37m 59s. Rate: 7.8 symbols/min [2025-10-24T00:05:47.777337] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:47.813225] [DEBUG] [LOCAL ] TFPM: Loaded 39860 existing records from primary storage. [2025-10-24T00:05:47.813529] [INFO ] [MAIN ] TFPM: Loaded 39860 existing records. [2025-10-24T00:05:47.987154] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:47.987375] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-24T00:05:47.987449] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-24T00:05:47.987731] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-24T00:05:47.987796] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-24T00:05:51.344946] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-24T00:05:51.820408] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-24T00:05:51.820520] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-24T00:05:51.821829] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-24T00:05:51.821911] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-24T00:05:51.823475] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 54057 (keeping 200 days of data) [2025-10-24T00:05:52.170557] [DEBUG] [LOCAL ] TFC: Primary data saved (54057 records). [2025-10-24T00:05:52.170748] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-24T00:05:52.170876] [INFO ] [MAIN ] Update Progress: 2072/2367 symbols completed. TFC took 39.4s. Estimated remaining: 37m 51s. Rate: 7.8 symbols/min [2025-10-24T00:05:52.345068] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:05:52.379707] [DEBUG] [LOCAL ] TFX: Loaded 35633 existing records from primary storage. [2025-10-24T00:05:52.380019] [INFO ] [MAIN ] TFX: Loaded 35633 existing records. [2025-10-24T00:05:52.558621] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:05:52.558877] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-24T00:05:52.558968] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-24T00:05:52.559238] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-24T00:05:52.559328] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-24T00:06:00.183870] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-24T00:06:00.558586] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-24T00:06:00.558713] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-24T00:06:00.559687] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-24T00:06:00.559765] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-24T00:06:00.560778] [DEBUG] [LOCAL ] TFII: Trimmed 47981 records to 32486 (keeping 200 days of data) [2025-10-24T00:06:00.761982] [DEBUG] [LOCAL ] TFII: Primary data saved (32486 records). [2025-10-24T00:06:00.762148] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-24T00:06:00.762264] [INFO ] [MAIN ] Update Progress: 2073/2367 symbols completed. TFII took 30.4s. Estimated remaining: 37m 43s. Rate: 7.8 symbols/min [2025-10-24T00:06:00.942727] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:00.955223] [DEBUG] [LOCAL ] TG: Loaded 10631 existing records from primary storage. [2025-10-24T00:06:00.955477] [INFO ] [MAIN ] TG: Loaded 10631 existing records. [2025-10-24T00:06:01.146461] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:01.146697] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-24T00:06:01.146773] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-24T00:06:01.147084] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-24T00:06:01.147159] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-24T00:06:12.125488] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-24T00:06:12.503753] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-24T00:06:12.504049] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-24T00:06:12.505186] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-24T00:06:12.505314] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-24T00:06:12.506802] [DEBUG] [LOCAL ] TFPM: Trimmed 53129 records to 40157 (keeping 200 days of data) [2025-10-24T00:06:12.792269] [DEBUG] [LOCAL ] TFPM: Primary data saved (40157 records). [2025-10-24T00:06:12.792424] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-24T00:06:12.792514] [INFO ] [MAIN ] Update Progress: 2074/2367 symbols completed. TFPM took 25.2s. Estimated remaining: 37m 36s. Rate: 7.8 symbols/min [2025-10-24T00:06:12.966549] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:12.966807] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-24T00:06:12.966884] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-24T00:06:12.967012] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-24T00:06:12.967088] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-24T00:06:12.967173] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-24T00:06:12.967245] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-24T00:06:17.876506] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-24T00:06:18.242978] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-24T00:06:18.243105] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-24T00:06:18.243818] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-24T00:06:18.243913] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-24T00:06:18.244715] [DEBUG] [LOCAL ] TFIN: Trimmed 32713 records to 23831 (keeping 200 days of data) [2025-10-24T00:06:18.384830] [DEBUG] [LOCAL ] TFIN: Primary data saved (23831 records). [2025-10-24T00:06:18.384963] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-24T00:06:18.385087] [INFO ] [MAIN ] Update Progress: 2075/2367 symbols completed. TFIN took 34.6s. Estimated remaining: 37m 28s. Rate: 7.8 symbols/min [2025-10-24T00:06:18.563753] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:18.588732] [DEBUG] [LOCAL ] TGLS: Loaded 27643 existing records from primary storage. [2025-10-24T00:06:18.589036] [INFO ] [MAIN ] TGLS: Loaded 27643 existing records. [2025-10-24T00:06:18.782051] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:18.782375] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-24T00:06:18.782578] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-24T00:06:18.782977] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-24T00:06:18.783057] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-24T00:06:23.417477] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-24T00:06:23.417545] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:06:23.417617] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-24T00:06:23.417759] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-24T00:06:23.417829] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-24T00:06:23.417911] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-24T00:06:23.417992] [INFO ] [MAIN ] Update Progress: 2076/2367 symbols completed. TGE took 10.6s. Estimated remaining: 37m 20s. Rate: 7.8 symbols/min [2025-10-24T00:06:23.593281] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:23.638459] [DEBUG] [LOCAL ] TGNA: Loaded 48517 existing records from primary storage. [2025-10-24T00:06:23.638846] [INFO ] [MAIN ] TGNA: Loaded 48517 existing records. [2025-10-24T00:06:23.817756] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:23.818021] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-24T00:06:23.818122] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-24T00:06:23.818494] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-24T00:06:23.818582] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-24T00:06:28.549929] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-24T00:06:28.952475] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-24T00:06:28.952602] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-24T00:06:28.952728] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-24T00:06:28.953906] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-24T00:06:28.954031] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-24T00:06:29.057034] [DEBUG] [LOCAL ] TFX: Trimmed 54694 records to 35805 (keeping 200 days of data) [2025-10-24T00:06:29.521855] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-24T00:06:29.525671] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-24T00:06:29.528044] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-24T00:06:29.528712] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-24T00:06:29.540811] [DEBUG] [LOCAL ] TG: Trimmed 15143 records to 10709 (keeping 200 days of data) [2025-10-24T00:06:29.551673] [DEBUG] [LOCAL ] TFX: Primary data saved (35805 records). [2025-10-24T00:06:29.552078] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-24T00:06:29.552447] [INFO ] [MAIN ] Update Progress: 2077/2367 symbols completed. TFX took 37.4s. Estimated remaining: 37m 12s. Rate: 7.8 symbols/min [2025-10-24T00:06:29.615932] [DEBUG] [LOCAL ] TG: Primary data saved (10709 records). [2025-10-24T00:06:29.616094] [INFO ] [MAIN ] TG: Full history saved. [2025-10-24T00:06:29.616212] [INFO ] [MAIN ] Update Progress: 2078/2367 symbols completed. TG took 28.9s. Estimated remaining: 37m 3s. Rate: 7.8 symbols/min [2025-10-24T00:06:37.996480] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-24T00:06:38.364440] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-24T00:06:38.364547] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-24T00:06:38.365411] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-24T00:06:38.365488] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-24T00:06:38.366432] [DEBUG] [LOCAL ] TGLS: Trimmed 40549 records to 27762 (keeping 200 days of data) [2025-10-24T00:06:38.537172] [DEBUG] [LOCAL ] TGLS: Primary data saved (27762 records). [2025-10-24T00:06:38.537334] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-24T00:06:38.537470] [INFO ] [MAIN ] Update Progress: 2079/2367 symbols completed. TGLS took 20.2s. Estimated remaining: 36m 56s. Rate: 7.8 symbols/min [2025-10-24T00:06:42.794331] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-24T00:06:43.179133] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-24T00:06:43.179245] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-24T00:06:43.180401] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-24T00:06:43.180481] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-24T00:06:43.181786] [DEBUG] [LOCAL ] TGNA: Trimmed 70025 records to 48836 (keeping 200 days of data) [2025-10-24T00:06:43.465267] [DEBUG] [LOCAL ] TGNA: Primary data saved (48836 records). [2025-10-24T00:06:43.465425] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-24T00:06:43.465536] [INFO ] [MAIN ] Update Progress: 2080/2367 symbols completed. TGNA took 20.0s. Estimated remaining: 36m 48s. Rate: 7.8 symbols/min [2025-10-24T00:06:44.036730] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:44.277591] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:44.281413] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:44.255517] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:06:44.306045] [DEBUG] [LOCAL ] TGS: Loaded 33787 existing records from primary storage. [2025-10-24T00:06:44.306711] [INFO ] [MAIN ] TGS: Loaded 33787 existing records. [2025-10-24T00:06:44.479147] [DEBUG] [LOCAL ] THG: Loaded 21455 existing records from primary storage. [2025-10-24T00:06:44.515788] [INFO ] [MAIN ] THG: Loaded 21455 existing records. [2025-10-24T00:06:44.552558] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:44.613285] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-24T00:06:44.623045] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-24T00:06:44.622806] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-24T00:06:44.643511] [DEBUG] [LOCAL ] THC: Loaded 46634 existing records from primary storage. [2025-10-24T00:06:44.649093] [INFO ] [MAIN ] TGT: Loaded 53777 existing records. [2025-10-24T00:06:44.664965] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-24T00:06:44.665321] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-24T00:06:44.654510] [INFO ] [MAIN ] THC: Loaded 46634 existing records. [2025-10-24T00:06:45.074502] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:45.214946] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-24T00:06:45.275507] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:45.283880] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:06:45.312634] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-24T00:06:45.312820] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-24T00:06:45.284015] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-24T00:06:45.312891] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-24T00:06:45.343133] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-24T00:06:45.350403] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-24T00:06:45.339484] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-24T00:06:45.364225] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-24T00:06:45.358896] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-24T00:06:45.358811] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-24T00:06:45.384270] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-24T00:07:04.644592] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-24T00:07:05.102795] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-24T00:07:05.102929] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-24T00:07:05.104014] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-24T00:07:05.104112] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-24T00:07:05.105241] [DEBUG] [LOCAL ] TGS: Trimmed 48721 records to 34102 (keeping 200 days of data) [2025-10-24T00:07:05.302539] [DEBUG] [LOCAL ] TGS: Primary data saved (34102 records). [2025-10-24T00:07:05.302750] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-24T00:07:05.302887] [INFO ] [MAIN ] Update Progress: 2081/2367 symbols completed. TGS took 21.8s. Estimated remaining: 36m 42s. Rate: 7.8 symbols/min [2025-10-24T00:07:05.468984] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:05.473885] [DEBUG] [LOCAL ] THIR: Loaded 2461 existing records from primary storage. [2025-10-24T00:07:05.474100] [INFO ] [MAIN ] THIR: Loaded 2461 existing records. [2025-10-24T00:07:05.654239] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:05.654470] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-24T00:07:05.654564] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-24T00:07:05.654781] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-24T00:07:05.654872] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-24T00:07:06.720771] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-24T00:07:07.167025] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-24T00:07:07.167141] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-24T00:07:07.167959] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-24T00:07:07.168046] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-24T00:07:07.168911] [DEBUG] [LOCAL ] THG: Trimmed 31537 records to 21631 (keeping 200 days of data) [2025-10-24T00:07:07.303180] [DEBUG] [LOCAL ] THG: Primary data saved (21631 records). [2025-10-24T00:07:07.303353] [INFO ] [MAIN ] THG: Full history saved. [2025-10-24T00:07:07.303501] [INFO ] [MAIN ] Update Progress: 2082/2367 symbols completed. THG took 23.8s. Estimated remaining: 36m 33s. Rate: 7.8 symbols/min [2025-10-24T00:07:07.469916] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:07.473680] [DEBUG] [LOCAL ] THLV: Loaded 1491 existing records from primary storage. [2025-10-24T00:07:07.473894] [INFO ] [MAIN ] THLV: Loaded 1491 existing records. [2025-10-24T00:07:07.648884] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:07.649193] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-24T00:07:07.649285] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-24T00:07:07.649467] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-24T00:07:07.649561] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-24T00:07:19.174678] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-24T00:07:19.579761] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-24T00:07:19.579900] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-24T00:07:19.581235] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-24T00:07:19.581319] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-24T00:07:19.582771] [DEBUG] [LOCAL ] TGT: Trimmed 77955 records to 54167 (keeping 200 days of data) [2025-10-24T00:07:19.925111] [DEBUG] [LOCAL ] TGT: Primary data saved (54167 records). [2025-10-24T00:07:19.925296] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-24T00:07:19.925437] [INFO ] [MAIN ] Update Progress: 2083/2367 symbols completed. TGT took 36.4s. Estimated remaining: 36m 26s. Rate: 7.8 symbols/min [2025-10-24T00:07:20.100906] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:20.180479] [DEBUG] [LOCAL ] THO: Loaded 41016 existing records from primary storage. [2025-10-24T00:07:20.180923] [INFO ] [MAIN ] THO: Loaded 41016 existing records. [2025-10-24T00:07:20.362939] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:20.363192] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-24T00:07:20.363292] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-24T00:07:20.363613] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-24T00:07:20.363723] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-24T00:07:23.161789] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-24T00:07:23.543081] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-24T00:07:23.543209] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-24T00:07:23.544562] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-24T00:07:23.544674] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-24T00:07:23.545964] [DEBUG] [LOCAL ] THC: Trimmed 68645 records to 46974 (keeping 200 days of data) [2025-10-24T00:07:23.817618] [DEBUG] [LOCAL ] THC: Primary data saved (46974 records). [2025-10-24T00:07:23.817834] [INFO ] [MAIN ] THC: Full history saved. [2025-10-24T00:07:23.817953] [INFO ] [MAIN ] Update Progress: 2084/2367 symbols completed. THC took 40.3s. Estimated remaining: 36m 18s. Rate: 7.8 symbols/min [2025-10-24T00:07:24.010535] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:24.041881] [DEBUG] [LOCAL ] THQ: Loaded 25335 existing records from primary storage. [2025-10-24T00:07:24.042168] [INFO ] [MAIN ] THQ: Loaded 25335 existing records. [2025-10-24T00:07:24.224902] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:24.225152] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-24T00:07:24.225228] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-24T00:07:24.225406] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-24T00:07:24.225472] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-24T00:07:30.777427] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-24T00:07:31.132430] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-24T00:07:31.132534] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-24T00:07:31.132706] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-24T00:07:31.132788] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-24T00:07:31.133167] [DEBUG] [LOCAL ] THLV: Trimmed 2527 records to 1496 (keeping 200 days of data) [2025-10-24T00:07:31.141943] [DEBUG] [LOCAL ] THLV: Primary data saved (1496 records). [2025-10-24T00:07:31.142024] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-24T00:07:31.142125] [INFO ] [MAIN ] Update Progress: 2085/2367 symbols completed. THLV took 23.8s. Estimated remaining: 36m 10s. Rate: 7.8 symbols/min [2025-10-24T00:07:31.315686] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:31.334956] [DEBUG] [LOCAL ] THR: Loaded 19563 existing records from primary storage. [2025-10-24T00:07:31.335230] [INFO ] [MAIN ] THR: Loaded 19563 existing records. [2025-10-24T00:07:31.533876] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:31.534104] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-24T00:07:31.534180] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-24T00:07:31.534382] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-24T00:07:31.534456] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-24T00:07:35.545765] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-24T00:07:35.890175] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-24T00:07:35.890291] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-24T00:07:35.890438] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-24T00:07:35.890521] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-24T00:07:35.890944] [DEBUG] [LOCAL ] THIR: Trimmed 2969 records to 2480 (keeping 200 days of data) [2025-10-24T00:07:35.905159] [DEBUG] [LOCAL ] THIR: Primary data saved (2480 records). [2025-10-24T00:07:35.905242] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-24T00:07:35.905375] [INFO ] [MAIN ] Update Progress: 2086/2367 symbols completed. THIR took 30.6s. Estimated remaining: 36m 2s. Rate: 7.8 symbols/min [2025-10-24T00:07:36.075014] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:36.112509] [DEBUG] [LOCAL ] THS: Loaded 38681 existing records from primary storage. [2025-10-24T00:07:36.112892] [INFO ] [MAIN ] THS: Loaded 38681 existing records. [2025-10-24T00:07:36.284583] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:36.284825] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-24T00:07:36.284923] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-24T00:07:36.285195] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-24T00:07:36.285274] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-24T00:07:47.558926] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-24T00:07:48.005682] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-24T00:07:48.006849] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-24T00:07:48.008101] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-24T00:07:48.008305] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-24T00:07:48.009637] [DEBUG] [LOCAL ] THO: Trimmed 60140 records to 41235 (keeping 200 days of data) [2025-10-24T00:07:48.262433] [DEBUG] [LOCAL ] THO: Primary data saved (41235 records). [2025-10-24T00:07:48.262599] [INFO ] [MAIN ] THO: Full history saved. [2025-10-24T00:07:48.262750] [INFO ] [MAIN ] Update Progress: 2087/2367 symbols completed. THO took 28.3s. Estimated remaining: 35m 55s. Rate: 7.8 symbols/min [2025-10-24T00:07:48.429188] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:48.449264] [DEBUG] [LOCAL ] THW: Loaded 19592 existing records from primary storage. [2025-10-24T00:07:48.449714] [INFO ] [MAIN ] THW: Loaded 19592 existing records. [2025-10-24T00:07:48.626510] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:48.626881] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-24T00:07:48.626973] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-24T00:07:48.634325] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-24T00:07:48.645874] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-24T00:07:49.145203] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-24T00:07:49.507394] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-24T00:07:49.507499] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-24T00:07:49.508137] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-24T00:07:49.508218] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-24T00:07:49.509083] [DEBUG] [LOCAL ] THQ: Trimmed 34722 records to 25471 (keeping 200 days of data) [2025-10-24T00:07:49.662865] [DEBUG] [LOCAL ] THQ: Primary data saved (25471 records). [2025-10-24T00:07:49.662994] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-24T00:07:49.663125] [INFO ] [MAIN ] Update Progress: 2088/2367 symbols completed. THQ took 25.8s. Estimated remaining: 35m 47s. Rate: 7.8 symbols/min [2025-10-24T00:07:49.834812] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:49.835014] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-24T00:07:49.836064] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-24T00:07:49.836173] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-24T00:07:49.836242] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-24T00:07:49.836325] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-24T00:07:49.836416] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-24T00:07:50.609219] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-24T00:07:50.609303] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:07:50.609391] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-24T00:07:50.609499] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-24T00:07:50.609583] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-24T00:07:50.609708] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-24T00:07:50.609807] [INFO ] [MAIN ] Update Progress: 2089/2367 symbols completed. TIC took 0.9s. Estimated remaining: 35m 38s. Rate: 7.8 symbols/min [2025-10-24T00:07:50.778855] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:07:50.824408] [DEBUG] [LOCAL ] TIMB: Loaded 34700 existing records from primary storage. [2025-10-24T00:07:50.824769] [INFO ] [MAIN ] TIMB: Loaded 34700 existing records. [2025-10-24T00:07:51.001595] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:07:51.001832] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-24T00:07:51.001921] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-24T00:07:51.002200] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-24T00:07:51.002300] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-24T00:08:10.638755] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-24T00:08:11.005037] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-24T00:08:11.005180] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-24T00:08:11.005797] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-24T00:08:11.005875] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-24T00:08:11.006601] [DEBUG] [LOCAL ] THR: Trimmed 28794 records to 19624 (keeping 200 days of data) [2025-10-24T00:08:11.120023] [DEBUG] [LOCAL ] THR: Primary data saved (19624 records). [2025-10-24T00:08:11.120211] [INFO ] [MAIN ] THR: Full history saved. [2025-10-24T00:08:11.120343] [INFO ] [MAIN ] Update Progress: 2090/2367 symbols completed. THR took 40.0s. Estimated remaining: 35m 32s. Rate: 7.8 symbols/min [2025-10-24T00:08:11.316117] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:11.322205] [DEBUG] [LOCAL ] TISI: Loaded 3153 existing records from primary storage. [2025-10-24T00:08:11.322410] [INFO ] [MAIN ] TISI: Loaded 3153 existing records. [2025-10-24T00:08:11.541983] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:11.542319] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-24T00:08:11.542419] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-24T00:08:11.542693] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-24T00:08:11.542771] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-24T00:08:12.466596] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-24T00:08:12.865762] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-24T00:08:12.865869] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-24T00:08:12.867065] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-24T00:08:12.867148] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-24T00:08:12.868273] [DEBUG] [LOCAL ] TIMB: Trimmed 53036 records to 34898 (keeping 200 days of data) [2025-10-24T00:08:13.087221] [DEBUG] [LOCAL ] TIMB: Primary data saved (34898 records). [2025-10-24T00:08:13.088092] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-24T00:08:13.088244] [INFO ] [MAIN ] Update Progress: 2091/2367 symbols completed. TIMB took 22.5s. Estimated remaining: 35m 24s. Rate: 7.8 symbols/min [2025-10-24T00:08:13.268878] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:13.299698] [DEBUG] [LOCAL ] TIXT: Loaded 32607 existing records from primary storage. [2025-10-24T00:08:13.300006] [INFO ] [MAIN ] TIXT: Loaded 32607 existing records. [2025-10-24T00:08:13.489284] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:13.489504] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-24T00:08:13.489580] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-24T00:08:13.490142] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-24T00:08:13.490217] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-24T00:08:14.665749] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-24T00:08:15.051262] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-24T00:08:15.051382] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-24T00:08:15.052006] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-24T00:08:15.052085] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-24T00:08:15.052874] [DEBUG] [LOCAL ] THW: Trimmed 28728 records to 19695 (keeping 200 days of data) [2025-10-24T00:08:15.171410] [DEBUG] [LOCAL ] THW: Primary data saved (19695 records). [2025-10-24T00:08:15.171582] [INFO ] [MAIN ] THW: Full history saved. [2025-10-24T00:08:15.171721] [INFO ] [MAIN ] Update Progress: 2092/2367 symbols completed. THW took 26.9s. Estimated remaining: 35m 15s. Rate: 7.8 symbols/min [2025-10-24T00:08:15.355175] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:15.406754] [DEBUG] [LOCAL ] TJX: Loaded 53661 existing records from primary storage. [2025-10-24T00:08:15.407133] [INFO ] [MAIN ] TJX: Loaded 53661 existing records. [2025-10-24T00:08:15.597063] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:15.597329] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-24T00:08:15.597410] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-24T00:08:15.597628] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-24T00:08:15.597761] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-24T00:08:26.954815] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-24T00:08:27.360101] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-24T00:08:27.360212] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-24T00:08:27.361275] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-24T00:08:27.361356] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-24T00:08:27.362469] [DEBUG] [LOCAL ] THS: Trimmed 54572 records to 38900 (keeping 200 days of data) [2025-10-24T00:08:27.617756] [DEBUG] [LOCAL ] THS: Primary data saved (38900 records). [2025-10-24T00:08:27.618048] [INFO ] [MAIN ] THS: Full history saved. [2025-10-24T00:08:27.619257] [INFO ] [MAIN ] Update Progress: 2093/2367 symbols completed. THS took 51.7s. Estimated remaining: 35m 8s. Rate: 7.8 symbols/min [2025-10-24T00:08:27.810841] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:27.811028] [DEBUG] [LOCAL ] TK: No existing data file found in primary storage. [2025-10-24T00:08:27.811100] [WARN ] [MAIN ] TK: No existing data found, performing full refresh instead. [2025-10-24T00:08:27.811211] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-24T00:08:27.811280] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-24T00:08:27.811359] [DEBUG] [LOCAL ] TK: No primary data file found to delete. [2025-10-24T00:08:27.811428] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-24T00:08:34.078087] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-24T00:08:34.479791] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-24T00:08:34.479887] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-24T00:08:34.480084] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-24T00:08:34.480162] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-24T00:08:34.480583] [DEBUG] [LOCAL ] TISI: Trimmed 4825 records to 3185 (keeping 200 days of data) [2025-10-24T00:08:34.498800] [DEBUG] [LOCAL ] TISI: Primary data saved (3185 records). [2025-10-24T00:08:34.498892] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-24T00:08:34.498998] [INFO ] [MAIN ] Update Progress: 2094/2367 symbols completed. TISI took 23.4s. Estimated remaining: 35m 0s. Rate: 7.8 symbols/min [2025-10-24T00:08:34.664111] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:34.697826] [DEBUG] [LOCAL ] TKC: Loaded 40053 existing records from primary storage. [2025-10-24T00:08:34.698150] [INFO ] [MAIN ] TKC: Loaded 40053 existing records. [2025-10-24T00:08:34.871508] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:34.871724] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-24T00:08:34.871803] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-24T00:08:34.872198] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-24T00:08:34.872264] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-24T00:08:52.864402] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-24T00:08:53.273779] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-24T00:08:53.273896] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-24T00:08:53.275262] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-24T00:08:53.275369] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-24T00:08:53.277031] [DEBUG] [LOCAL ] TJX: Trimmed 77830 records to 54050 (keeping 200 days of data) [2025-10-24T00:08:53.431230] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-24T00:08:54.029180] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-24T00:08:54.031183] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-24T00:08:54.035580] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-24T00:08:54.038211] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-24T00:08:54.050039] [DEBUG] [LOCAL ] TIXT: Trimmed 46130 records to 32881 (keeping 200 days of data) [2025-10-24T00:08:54.148324] [DEBUG] [LOCAL ] TJX: Primary data saved (54050 records). [2025-10-24T00:08:54.168350] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-24T00:08:54.170599] [INFO ] [MAIN ] Update Progress: 2095/2367 symbols completed. TJX took 39.0s. Estimated remaining: 34m 54s. Rate: 7.8 symbols/min [2025-10-24T00:08:54.337619] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-24T00:08:54.529189] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:54.525435] [DEBUG] [LOCAL ] TIXT: Primary data saved (32881 records). [2025-10-24T00:08:54.551985] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-24T00:08:54.552341] [INFO ] [MAIN ] Update Progress: 2096/2367 symbols completed. TIXT took 41.5s. Estimated remaining: 34m 46s. Rate: 7.8 symbols/min [2025-10-24T00:08:54.918377] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:54.945539] [DEBUG] [LOCAL ] TKO: Loaded 43490 existing records from primary storage. [2025-10-24T00:08:54.956403] [INFO ] [MAIN ] TKO: Loaded 43490 existing records. [2025-10-24T00:08:55.189133] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-24T00:08:55.244190] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:55.219850] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-24T00:08:55.246400] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-24T00:08:55.245700] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-24T00:08:55.266112] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-24T00:08:55.266191] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-24T00:08:55.279532] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-24T00:08:55.281089] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-24T00:08:55.283305] [DEBUG] [LOCAL ] TKR: Loaded 39247 existing records from primary storage. [2025-10-24T00:08:55.334796] [INFO ] [MAIN ] TKR: Loaded 39247 existing records. [2025-10-24T00:08:55.328929] [DEBUG] [LOCAL ] TK: Trimmed 56280 records to 39324 (keeping 200 days of data) [2025-10-24T00:08:55.876352] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:55.943822] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-24T00:08:56.038529] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-24T00:08:56.056402] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-24T00:08:56.056494] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-24T00:08:56.250060] [DEBUG] [LOCAL ] TK: Primary data saved (39324 records). [2025-10-24T00:08:56.260932] [INFO ] [MAIN ] TK: Full history saved. [2025-10-24T00:08:56.277043] [INFO ] [MAIN ] Update Progress: 2097/2367 symbols completed. TK took 28.7s. Estimated remaining: 34m 37s. Rate: 7.8 symbols/min [2025-10-24T00:08:56.630678] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:08:56.672151] [DEBUG] [LOCAL ] TLK: Loaded 38709 existing records from primary storage. [2025-10-24T00:08:56.672462] [INFO ] [MAIN ] TLK: Loaded 38709 existing records. [2025-10-24T00:08:56.846751] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:08:56.846985] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-24T00:08:56.847070] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-24T00:08:56.847372] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-24T00:08:56.847444] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-24T00:09:01.427438] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-24T00:09:01.820014] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-24T00:09:01.820123] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-24T00:09:01.821184] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-24T00:09:01.821262] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-24T00:09:01.822355] [DEBUG] [LOCAL ] TKC: Trimmed 54498 records to 40332 (keeping 200 days of data) [2025-10-24T00:09:02.048060] [DEBUG] [LOCAL ] TKC: Primary data saved (40332 records). [2025-10-24T00:09:02.048225] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-24T00:09:02.048317] [INFO ] [MAIN ] Update Progress: 2098/2367 symbols completed. TKC took 27.5s. Estimated remaining: 34m 29s. Rate: 7.8 symbols/min [2025-10-24T00:09:02.224587] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:09:02.242702] [DEBUG] [LOCAL ] TLYS: Loaded 16539 existing records from primary storage. [2025-10-24T00:09:02.243035] [INFO ] [MAIN ] TLYS: Loaded 16539 existing records. [2025-10-24T00:09:02.458242] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:09:02.461758] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-24T00:09:02.472113] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-24T00:09:02.472887] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-24T00:09:02.472965] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-24T00:09:21.584284] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-24T00:09:21.974851] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-24T00:09:21.975113] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-24T00:09:21.976406] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-24T00:09:21.976586] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-24T00:09:21.978024] [DEBUG] [LOCAL ] TLK: Trimmed 57726 records to 39028 (keeping 200 days of data) [2025-10-24T00:09:22.264584] [DEBUG] [LOCAL ] TLK: Primary data saved (39028 records). [2025-10-24T00:09:22.264814] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-24T00:09:22.264932] [INFO ] [MAIN ] Update Progress: 2099/2367 symbols completed. TLK took 26.0s. Estimated remaining: 34m 23s. Rate: 7.8 symbols/min [2025-10-24T00:09:22.439117] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:09:22.475821] [DEBUG] [LOCAL ] TM: Loaded 36037 existing records from primary storage. [2025-10-24T00:09:22.476131] [INFO ] [MAIN ] TM: Loaded 36037 existing records. [2025-10-24T00:09:22.651886] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:09:22.652047] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-24T00:09:22.652124] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-24T00:09:22.652328] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-24T00:09:22.652412] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-24T00:09:27.890495] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-24T00:09:28.307403] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-24T00:09:28.307523] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-24T00:09:28.308818] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-24T00:09:28.308901] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-24T00:09:28.310162] [DEBUG] [LOCAL ] TKR: Trimmed 57909 records to 39524 (keeping 200 days of data) [2025-10-24T00:09:28.545782] [DEBUG] [LOCAL ] TKR: Primary data saved (39524 records). [2025-10-24T00:09:28.545956] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-24T00:09:28.546074] [INFO ] [MAIN ] Update Progress: 2100/2367 symbols completed. TKR took 34.0s. Estimated remaining: 34m 15s. Rate: 7.8 symbols/min [2025-10-24T00:09:28.722999] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:09:28.774372] [DEBUG] [LOCAL ] TME: Loaded 53197 existing records from primary storage. [2025-10-24T00:09:28.774777] [INFO ] [MAIN ] TME: Loaded 53197 existing records. [2025-10-24T00:09:28.961309] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:09:28.961517] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-24T00:09:28.961590] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-24T00:09:28.961869] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-24T00:09:28.961943] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-24T00:09:29.634173] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-24T00:09:30.028077] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-24T00:09:30.028186] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-24T00:09:30.028678] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-24T00:09:30.028756] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-24T00:09:30.029379] [DEBUG] [LOCAL ] TLYS: Trimmed 21115 records to 16609 (keeping 200 days of data) [2025-10-24T00:09:30.119089] [DEBUG] [LOCAL ] TLYS: Primary data saved (16609 records). [2025-10-24T00:09:30.119265] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-24T00:09:30.119383] [INFO ] [MAIN ] Update Progress: 2101/2367 symbols completed. TLYS took 28.1s. Estimated remaining: 34m 7s. Rate: 7.8 symbols/min [2025-10-24T00:09:30.289211] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:09:30.328703] [DEBUG] [LOCAL ] TMHC: Loaded 45657 existing records from primary storage. [2025-10-24T00:09:30.329069] [INFO ] [MAIN ] TMHC: Loaded 45657 existing records. [2025-10-24T00:09:30.524394] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:09:30.524673] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-24T00:09:30.524745] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-24T00:09:30.524961] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-24T00:09:30.525036] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-24T00:09:39.538839] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-24T00:09:39.927118] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-24T00:09:39.927247] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-24T00:09:39.928448] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-24T00:09:39.928530] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-24T00:09:39.929896] [DEBUG] [LOCAL ] TKO: Trimmed 65568 records to 43818 (keeping 200 days of data) [2025-10-24T00:09:40.201199] [DEBUG] [LOCAL ] TKO: Primary data saved (43818 records). [2025-10-24T00:09:40.201361] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-24T00:09:40.201490] [INFO ] [MAIN ] Update Progress: 2102/2367 symbols completed. TKO took 46.0s. Estimated remaining: 33m 59s. Rate: 7.8 symbols/min [2025-10-24T00:09:40.374866] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:09:40.454031] [DEBUG] [LOCAL ] TMO: Loaded 52400 existing records from primary storage. [2025-10-24T00:09:40.454366] [INFO ] [MAIN ] TMO: Loaded 52400 existing records. [2025-10-24T00:09:40.637527] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:09:40.638047] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-24T00:09:40.638204] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-24T00:09:40.638464] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-24T00:09:40.638541] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-24T00:09:45.413619] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-24T00:09:45.823840] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-24T00:09:45.823952] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-24T00:09:45.824984] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-24T00:09:45.825062] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-24T00:09:45.826112] [DEBUG] [LOCAL ] TM: Trimmed 51860 records to 36277 (keeping 200 days of data) [2025-10-24T00:09:46.046390] [DEBUG] [LOCAL ] TM: Primary data saved (36277 records). [2025-10-24T00:09:46.046555] [INFO ] [MAIN ] TM: Full history saved. [2025-10-24T00:09:46.046689] [INFO ] [MAIN ] Update Progress: 2103/2367 symbols completed. TM took 23.8s. Estimated remaining: 33m 51s. Rate: 7.8 symbols/min [2025-10-24T00:09:46.226818] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:09:46.240766] [DEBUG] [LOCAL ] TNC: Loaded 14163 existing records from primary storage. [2025-10-24T00:09:46.241054] [INFO ] [MAIN ] TNC: Loaded 14163 existing records. [2025-10-24T00:09:46.439386] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:09:46.440778] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-24T00:09:46.440858] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-24T00:09:46.441082] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-24T00:09:46.441155] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-24T00:09:59.224416] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-24T00:09:59.634391] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-24T00:09:59.634530] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-24T00:09:59.635758] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-24T00:09:59.635841] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-24T00:09:59.637111] [DEBUG] [LOCAL ] TMHC: Trimmed 66741 records to 46022 (keeping 200 days of data) [2025-10-24T00:09:59.899309] [DEBUG] [LOCAL ] TMHC: Primary data saved (46022 records). [2025-10-24T00:09:59.899475] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-24T00:09:59.899591] [INFO ] [MAIN ] Update Progress: 2104/2367 symbols completed. TMHC took 29.8s. Estimated remaining: 33m 44s. Rate: 7.8 symbols/min [2025-10-24T00:10:00.068411] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:00.096295] [DEBUG] [LOCAL ] TNET: Loaded 28176 existing records from primary storage. [2025-10-24T00:10:00.096586] [INFO ] [MAIN ] TNET: Loaded 28176 existing records. [2025-10-24T00:10:00.269605] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:00.269850] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-24T00:10:00.269939] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-24T00:10:00.270187] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-24T00:10:00.270260] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-24T00:10:01.382900] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-24T00:10:02.028130] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-24T00:10:02.035773] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-24T00:10:02.060517] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-24T00:10:02.096835] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-24T00:10:02.117044] [DEBUG] [LOCAL ] TME: Trimmed 77157 records to 53583 (keeping 200 days of data) [2025-10-24T00:10:02.502557] [DEBUG] [LOCAL ] TME: Primary data saved (53583 records). [2025-10-24T00:10:02.502842] [INFO ] [MAIN ] TME: Full history saved. [2025-10-24T00:10:02.503104] [INFO ] [MAIN ] Update Progress: 2105/2367 symbols completed. TME took 34.0s. Estimated remaining: 33m 36s. Rate: 7.8 symbols/min [2025-10-24T00:10:02.681322] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:02.691379] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-24T00:10:02.692075] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-24T00:10:02.695982] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-24T00:10:02.696355] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-24T00:10:02.696444] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-24T00:10:02.696515] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-24T00:10:03.821805] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-24T00:10:03.821877] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:10:03.821953] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-24T00:10:03.822048] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-24T00:10:03.822119] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-24T00:10:03.822202] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-24T00:10:03.822287] [INFO ] [MAIN ] Update Progress: 2106/2367 symbols completed. TNGY took 1.3s. Estimated remaining: 33m 28s. Rate: 7.8 symbols/min [2025-10-24T00:10:04.035759] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:04.069723] [DEBUG] [LOCAL ] TNK: Loaded 35270 existing records from primary storage. [2025-10-24T00:10:04.070061] [INFO ] [MAIN ] TNK: Loaded 35270 existing records. [2025-10-24T00:10:04.242019] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:04.242254] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-24T00:10:04.242331] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-24T00:10:04.242595] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-24T00:10:04.242704] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-24T00:10:13.670781] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-24T00:10:14.054065] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-24T00:10:14.054282] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-24T00:10:14.054855] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-24T00:10:14.055017] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-24T00:10:14.055819] [DEBUG] [LOCAL ] TNC: Trimmed 22148 records to 14222 (keeping 200 days of data) [2025-10-24T00:10:14.144089] [DEBUG] [LOCAL ] TNC: Primary data saved (14222 records). [2025-10-24T00:10:14.144279] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-24T00:10:14.144401] [INFO ] [MAIN ] Update Progress: 2107/2367 symbols completed. TNC took 28.1s. Estimated remaining: 33m 20s. Rate: 7.8 symbols/min [2025-10-24T00:10:14.332377] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:14.370498] [DEBUG] [LOCAL ] TNL: Loaded 41725 existing records from primary storage. [2025-10-24T00:10:14.370856] [INFO ] [MAIN ] TNL: Loaded 41725 existing records. [2025-10-24T00:10:14.558182] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:14.558389] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-24T00:10:14.558463] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-24T00:10:14.558922] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-24T00:10:14.558996] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-24T00:10:22.741728] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-24T00:10:23.142561] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-24T00:10:23.142693] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-24T00:10:23.143525] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-24T00:10:23.143599] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-24T00:10:23.144561] [DEBUG] [LOCAL ] TNET: Trimmed 41829 records to 28369 (keeping 200 days of data) [2025-10-24T00:10:23.314331] [DEBUG] [LOCAL ] TNET: Primary data saved (28369 records). [2025-10-24T00:10:23.314494] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-24T00:10:23.314607] [INFO ] [MAIN ] Update Progress: 2108/2367 symbols completed. TNET took 23.4s. Estimated remaining: 33m 13s. Rate: 7.8 symbols/min [2025-10-24T00:10:23.479325] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:23.527720] [DEBUG] [LOCAL ] TOL: Loaded 50535 existing records from primary storage. [2025-10-24T00:10:23.528051] [INFO ] [MAIN ] TOL: Loaded 50535 existing records. [2025-10-24T00:10:23.705370] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:23.705596] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-24T00:10:23.705692] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-24T00:10:23.705929] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-24T00:10:23.706003] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-24T00:10:28.284150] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-24T00:10:28.702268] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-24T00:10:28.702535] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-24T00:10:28.703852] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-24T00:10:28.714869] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-24T00:10:28.746793] [DEBUG] [LOCAL ] TMO: Trimmed 75753 records to 52781 (keeping 200 days of data) [2025-10-24T00:10:29.084369] [DEBUG] [LOCAL ] TMO: Primary data saved (52781 records). [2025-10-24T00:10:29.084533] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-24T00:10:29.084667] [INFO ] [MAIN ] Update Progress: 2109/2367 symbols completed. TMO took 48.9s. Estimated remaining: 33m 5s. Rate: 7.8 symbols/min [2025-10-24T00:10:29.252493] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:29.305517] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-24T00:10:29.305891] [INFO ] [MAIN ] TOST: Loaded 53690 existing records. [2025-10-24T00:10:29.483105] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:29.483327] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-24T00:10:29.483402] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-24T00:10:29.483628] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-24T00:10:29.483732] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-24T00:10:32.521807] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-24T00:10:32.930097] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-24T00:10:32.930209] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-24T00:10:32.931369] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-24T00:10:32.931450] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-24T00:10:32.932530] [DEBUG] [LOCAL ] TNK: Trimmed 51957 records to 35590 (keeping 200 days of data) [2025-10-24T00:10:33.141446] [DEBUG] [LOCAL ] TNK: Primary data saved (35590 records). [2025-10-24T00:10:33.141622] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-24T00:10:33.141754] [INFO ] [MAIN ] Update Progress: 2110/2367 symbols completed. TNK took 29.3s. Estimated remaining: 32m 57s. Rate: 7.8 symbols/min [2025-10-24T00:10:33.307950] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:33.333199] [DEBUG] [LOCAL ] TPB: Loaded 26309 existing records from primary storage. [2025-10-24T00:10:33.333480] [INFO ] [MAIN ] TPB: Loaded 26309 existing records. [2025-10-24T00:10:33.514408] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:33.514604] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-24T00:10:33.514699] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-24T00:10:33.515040] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-24T00:10:33.515111] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-24T00:10:43.905046] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-24T00:10:44.297507] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-24T00:10:44.297628] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-24T00:10:44.298815] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-24T00:10:44.298894] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-24T00:10:44.300167] [DEBUG] [LOCAL ] TNL: Trimmed 59764 records to 42070 (keeping 200 days of data) [2025-10-24T00:10:44.575164] [DEBUG] [LOCAL ] TNL: Primary data saved (42070 records). [2025-10-24T00:10:44.575342] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-24T00:10:44.575462] [INFO ] [MAIN ] Update Progress: 2111/2367 symbols completed. TNL took 30.4s. Estimated remaining: 32m 49s. Rate: 7.8 symbols/min [2025-10-24T00:10:44.746281] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:44.781601] [DEBUG] [LOCAL ] TPC: Loaded 39105 existing records from primary storage. [2025-10-24T00:10:44.781929] [INFO ] [MAIN ] TPC: Loaded 39105 existing records. [2025-10-24T00:10:44.961619] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:44.961852] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-24T00:10:44.961936] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-24T00:10:44.962167] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-24T00:10:44.962286] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-24T00:10:55.319355] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-24T00:10:55.735306] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-24T00:10:55.735876] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-24T00:10:55.737109] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-24T00:10:55.737191] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-24T00:10:55.738631] [DEBUG] [LOCAL ] TOL: Trimmed 73699 records to 50843 (keeping 200 days of data) [2025-10-24T00:10:56.056574] [DEBUG] [LOCAL ] TOL: Primary data saved (50843 records). [2025-10-24T00:10:56.056753] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-24T00:10:56.056866] [INFO ] [MAIN ] Update Progress: 2112/2367 symbols completed. TOL took 32.7s. Estimated remaining: 32m 42s. Rate: 7.8 symbols/min [2025-10-24T00:10:56.222975] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:10:56.262293] [DEBUG] [LOCAL ] TPH: Loaded 44779 existing records from primary storage. [2025-10-24T00:10:56.262613] [INFO ] [MAIN ] TPH: Loaded 44779 existing records. [2025-10-24T00:10:56.440344] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:10:56.440564] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-24T00:10:56.440662] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-24T00:10:56.440879] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-24T00:10:56.440952] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-24T00:11:05.921949] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-24T00:11:05.928019] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-24T00:11:06.679719] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-24T00:11:06.689874] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-24T00:11:06.699019] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-24T00:11:06.732171] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-24T00:11:06.732732] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-24T00:11:06.732861] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-24T00:11:06.733693] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-24T00:11:06.733972] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-24T00:11:06.734864] [DEBUG] [LOCAL ] TOST: Trimmed 77852 records to 54080 (keeping 200 days of data) [2025-10-24T00:11:06.735987] [DEBUG] [LOCAL ] TPB: Trimmed 36311 records to 26451 (keeping 200 days of data) [2025-10-24T00:11:07.131875] [DEBUG] [LOCAL ] TPB: Primary data saved (26451 records). [2025-10-24T00:11:07.133991] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-24T00:11:07.134138] [INFO ] [MAIN ] Update Progress: 2113/2367 symbols completed. TPB took 34.0s. Estimated remaining: 32m 35s. Rate: 7.8 symbols/min [2025-10-24T00:11:07.357858] [DEBUG] [LOCAL ] TOST: Primary data saved (54080 records). [2025-10-24T00:11:07.360034] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-24T00:11:07.375012] [INFO ] [MAIN ] Update Progress: 2114/2367 symbols completed. TOST took 38.3s. Estimated remaining: 32m 26s. Rate: 7.8 symbols/min [2025-10-24T00:11:07.519303] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:07.623509] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:07.628523] [DEBUG] [LOCAL ] TPL: Loaded 12262 existing records from primary storage. [2025-10-24T00:11:07.628831] [INFO ] [MAIN ] TPL: Loaded 12262 existing records. [2025-10-24T00:11:07.808878] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:07.809576] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-24T00:11:07.809707] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-24T00:11:07.809892] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-24T00:11:07.809964] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-24T00:11:07.995769] [DEBUG] [LOCAL ] TPR: Loaded 53368 existing records from primary storage. [2025-10-24T00:11:08.078193] [INFO ] [MAIN ] TPR: Loaded 53368 existing records. [2025-10-24T00:11:08.399552] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:08.399965] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-24T00:11:08.400210] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-24T00:11:08.408545] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-24T00:11:08.423734] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-24T00:11:11.879953] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-24T00:11:12.283790] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-24T00:11:12.283918] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-24T00:11:12.285131] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-24T00:11:12.285213] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-24T00:11:12.286444] [DEBUG] [LOCAL ] TPC: Trimmed 55506 records to 39366 (keeping 200 days of data) [2025-10-24T00:11:12.518470] [DEBUG] [LOCAL ] TPC: Primary data saved (39366 records). [2025-10-24T00:11:12.518635] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-24T00:11:12.518776] [INFO ] [MAIN ] Update Progress: 2115/2367 symbols completed. TPC took 27.9s. Estimated remaining: 32m 18s. Rate: 7.8 symbols/min [2025-10-24T00:11:12.684168] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:12.710308] [DEBUG] [LOCAL ] TPVG: Loaded 27151 existing records from primary storage. [2025-10-24T00:11:12.710587] [INFO ] [MAIN ] TPVG: Loaded 27151 existing records. [2025-10-24T00:11:12.888060] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:12.888289] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-24T00:11:12.888362] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-24T00:11:12.888583] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-24T00:11:12.888683] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-24T00:11:31.109139] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-24T00:11:31.479247] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-24T00:11:31.479432] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-24T00:11:31.479932] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-24T00:11:31.480027] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-24T00:11:31.480667] [DEBUG] [LOCAL ] TPL: Trimmed 17526 records to 12313 (keeping 200 days of data) [2025-10-24T00:11:31.559539] [DEBUG] [LOCAL ] TPL: Primary data saved (12313 records). [2025-10-24T00:11:31.559728] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-24T00:11:31.559857] [INFO ] [MAIN ] Update Progress: 2116/2367 symbols completed. TPL took 24.4s. Estimated remaining: 32m 12s. Rate: 7.8 symbols/min [2025-10-24T00:11:31.733362] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:31.771553] [DEBUG] [LOCAL ] TPYP: Loaded 7866 existing records from primary storage. [2025-10-24T00:11:31.782777] [INFO ] [MAIN ] TPYP: Loaded 7866 existing records. [2025-10-24T00:11:31.970514] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:31.970759] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-24T00:11:31.970836] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-24T00:11:31.971024] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-24T00:11:31.971095] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-24T00:11:33.534329] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-24T00:11:33.956292] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-24T00:11:33.956406] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-24T00:11:33.957538] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-24T00:11:33.957619] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-24T00:11:33.958927] [DEBUG] [LOCAL ] TPH: Trimmed 65004 records to 45097 (keeping 200 days of data) [2025-10-24T00:11:34.211982] [DEBUG] [LOCAL ] TPH: Primary data saved (45097 records). [2025-10-24T00:11:34.212140] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-24T00:11:34.212255] [INFO ] [MAIN ] Update Progress: 2117/2367 symbols completed. TPH took 38.2s. Estimated remaining: 32m 4s. Rate: 7.8 symbols/min [2025-10-24T00:11:40.484082] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-24T00:11:40.854293] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-24T00:11:40.854412] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-24T00:11:40.855294] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-24T00:11:40.855373] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-24T00:11:40.856473] [DEBUG] [LOCAL ] TPVG: Trimmed 39298 records to 27412 (keeping 200 days of data) [2025-10-24T00:11:41.008785] [DEBUG] [LOCAL ] TPVG: Primary data saved (27412 records). [2025-10-24T00:11:41.008952] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-24T00:11:41.009098] [INFO ] [MAIN ] Update Progress: 2118/2367 symbols completed. TPVG took 28.5s. Estimated remaining: 31m 56s. Rate: 7.8 symbols/min [2025-10-24T00:11:42.377557] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-24T00:11:42.798599] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-24T00:11:42.798759] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-24T00:11:42.800023] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-24T00:11:42.800117] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-24T00:11:42.801675] [DEBUG] [LOCAL ] TPR: Trimmed 77496 records to 53752 (keeping 200 days of data) [2025-10-24T00:11:43.132739] [DEBUG] [LOCAL ] TPR: Primary data saved (53752 records). [2025-10-24T00:11:43.132902] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-24T00:11:43.133033] [INFO ] [MAIN ] Update Progress: 2119/2367 symbols completed. TPR took 35.7s. Estimated remaining: 31m 48s. Rate: 7.8 symbols/min [2025-10-24T00:11:45.468975] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-24T00:11:45.846431] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-24T00:11:45.846539] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-24T00:11:45.846875] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-24T00:11:45.846955] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-24T00:11:45.847481] [DEBUG] [LOCAL ] TPYP: Trimmed 12297 records to 7924 (keeping 200 days of data) [2025-10-24T00:11:45.894502] [DEBUG] [LOCAL ] TPYP: Primary data saved (7924 records). [2025-10-24T00:11:45.894667] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-24T00:11:45.894779] [INFO ] [MAIN ] Update Progress: 2120/2367 symbols completed. TPYP took 14.3s. Estimated remaining: 31m 39s. Rate: 7.8 symbols/min [2025-10-24T00:11:46.464981] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:46.574550] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:46.599473] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:46.621803] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:11:46.638497] [DEBUG] [LOCAL ] TRAK: Loaded 9585 existing records from primary storage. [2025-10-24T00:11:46.638950] [INFO ] [MAIN ] TRAK: Loaded 9585 existing records. [2025-10-24T00:11:46.683092] [DEBUG] [LOCAL ] TPZ: Loaded 4600 existing records from primary storage. [2025-10-24T00:11:46.742187] [DEBUG] [LOCAL ] TRC: Loaded 15391 existing records from primary storage. [2025-10-24T00:11:46.752789] [INFO ] [MAIN ] TRC: Loaded 15391 existing records. [2025-10-24T00:11:46.763280] [INFO ] [MAIN ] TPZ: Loaded 4600 existing records. [2025-10-24T00:11:46.699459] [DEBUG] [LOCAL ] TR: Loaded 19117 existing records from primary storage. [2025-10-24T00:11:46.859248] [INFO ] [MAIN ] TR: Loaded 19117 existing records. [2025-10-24T00:11:47.091360] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:47.282487] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-24T00:11:47.327255] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-24T00:11:47.407616] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:47.417388] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-24T00:11:47.413705] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:47.417752] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-24T00:11:47.417919] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-24T00:11:47.417559] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-24T00:11:47.417007] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:11:47.429542] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-24T00:11:47.475071] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-24T00:11:47.485307] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-24T00:11:47.522624] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-24T00:11:47.501242] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-24T00:11:47.528185] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-24T00:11:47.533696] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-24T00:11:47.536091] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-24T00:11:47.536530] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-24T00:11:47.536615] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-24T00:12:09.431686] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-24T00:12:09.797497] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-24T00:12:09.797629] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-24T00:12:09.797965] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-24T00:12:09.798041] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-24T00:12:09.798677] [DEBUG] [LOCAL ] TPZ: Trimmed 8334 records to 4619 (keeping 200 days of data) [2025-10-24T00:12:09.827639] [DEBUG] [LOCAL ] TPZ: Primary data saved (4619 records). [2025-10-24T00:12:09.827843] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-24T00:12:09.827970] [INFO ] [MAIN ] Update Progress: 2121/2367 symbols completed. TPZ took 23.9s. Estimated remaining: 31m 33s. Rate: 7.8 symbols/min [2025-10-24T00:12:10.010771] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:10.052310] [DEBUG] [LOCAL ] TREX: Loaded 49790 existing records from primary storage. [2025-10-24T00:12:10.052638] [INFO ] [MAIN ] TREX: Loaded 49790 existing records. [2025-10-24T00:12:10.228113] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:10.228310] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-24T00:12:10.228392] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-24T00:12:10.228744] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-24T00:12:10.228829] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-24T00:12:14.405891] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-24T00:12:14.779955] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-24T00:12:14.780085] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-24T00:12:14.780634] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-24T00:12:14.780752] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-24T00:12:14.781393] [DEBUG] [LOCAL ] TRC: Trimmed 21764 records to 15456 (keeping 200 days of data) [2025-10-24T00:12:14.881759] [DEBUG] [LOCAL ] TRC: Primary data saved (15456 records). [2025-10-24T00:12:14.881898] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-24T00:12:14.882011] [INFO ] [MAIN ] Update Progress: 2122/2367 symbols completed. TRC took 29.0s. Estimated remaining: 31m 25s. Rate: 7.8 symbols/min [2025-10-24T00:12:15.051287] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:15.101193] [DEBUG] [LOCAL ] TRGP: Loaded 50729 existing records from primary storage. [2025-10-24T00:12:15.101523] [INFO ] [MAIN ] TRGP: Loaded 50729 existing records. [2025-10-24T00:12:15.279694] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:15.280002] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-24T00:12:15.280086] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-24T00:12:15.280606] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-24T00:12:15.280714] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-24T00:12:15.644070] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-24T00:12:16.005807] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-24T00:12:16.006573] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-24T00:12:16.007169] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-24T00:12:16.007248] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-24T00:12:16.008030] [DEBUG] [LOCAL ] TR: Trimmed 25537 records to 19306 (keeping 200 days of data) [2025-10-24T00:12:16.121448] [DEBUG] [LOCAL ] TR: Primary data saved (19306 records). [2025-10-24T00:12:16.121602] [INFO ] [MAIN ] TR: Full history saved. [2025-10-24T00:12:16.121733] [INFO ] [MAIN ] Update Progress: 2123/2367 symbols completed. TR took 30.2s. Estimated remaining: 31m 17s. Rate: 7.8 symbols/min [2025-10-24T00:12:16.286344] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:16.318798] [DEBUG] [LOCAL ] TRN: Loaded 36276 existing records from primary storage. [2025-10-24T00:12:16.319123] [INFO ] [MAIN ] TRN: Loaded 36276 existing records. [2025-10-24T00:12:16.501230] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:16.501584] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-24T00:12:16.501695] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-24T00:12:16.501961] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-24T00:12:16.502035] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-24T00:12:31.111984] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-24T00:12:31.471181] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-24T00:12:31.471290] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-24T00:12:31.471628] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-24T00:12:31.471722] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-24T00:12:31.472242] [DEBUG] [LOCAL ] TRAK: Trimmed 13669 records to 9632 (keeping 200 days of data) [2025-10-24T00:12:31.529420] [DEBUG] [LOCAL ] TRAK: Primary data saved (9632 records). [2025-10-24T00:12:31.529562] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-24T00:12:31.529689] [INFO ] [MAIN ] Update Progress: 2124/2367 symbols completed. TRAK took 45.6s. Estimated remaining: 31m 10s. Rate: 7.8 symbols/min [2025-10-24T00:12:31.702467] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:31.741150] [DEBUG] [LOCAL ] TRNO: Loaded 43615 existing records from primary storage. [2025-10-24T00:12:31.741488] [INFO ] [MAIN ] TRNO: Loaded 43615 existing records. [2025-10-24T00:12:31.913761] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:31.913964] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-24T00:12:31.914051] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-24T00:12:31.914290] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-24T00:12:31.914378] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-24T00:12:38.456046] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-24T00:12:38.827202] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-24T00:12:38.827316] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-24T00:12:38.828475] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-24T00:12:38.828562] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-24T00:12:38.829763] [DEBUG] [LOCAL ] TRN: Trimmed 52593 records to 36448 (keeping 200 days of data) [2025-10-24T00:12:39.060086] [DEBUG] [LOCAL ] TRN: Primary data saved (36448 records). [2025-10-24T00:12:39.060251] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-24T00:12:39.060364] [INFO ] [MAIN ] Update Progress: 2125/2367 symbols completed. TRN took 22.9s. Estimated remaining: 31m 3s. Rate: 7.8 symbols/min [2025-10-24T00:12:39.228994] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:39.314298] [DEBUG] [LOCAL ] TROX: Loaded 52233 existing records from primary storage. [2025-10-24T00:12:39.314626] [INFO ] [MAIN ] TROX: Loaded 52233 existing records. [2025-10-24T00:12:39.486379] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:39.486578] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-24T00:12:39.486673] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-24T00:12:39.486918] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-24T00:12:39.486991] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-24T00:12:45.740689] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-24T00:12:46.130051] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-24T00:12:46.130215] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-24T00:12:46.131493] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-24T00:12:46.131576] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-24T00:12:46.133064] [DEBUG] [LOCAL ] TREX: Trimmed 71926 records to 50160 (keeping 200 days of data) [2025-10-24T00:12:46.457163] [DEBUG] [LOCAL ] TREX: Primary data saved (50160 records). [2025-10-24T00:12:46.459856] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-24T00:12:46.460180] [INFO ] [MAIN ] Update Progress: 2126/2367 symbols completed. TREX took 36.6s. Estimated remaining: 30m 55s. Rate: 7.8 symbols/min [2025-10-24T00:12:46.639403] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:46.685927] [DEBUG] [LOCAL ] TRP: Loaded 52127 existing records from primary storage. [2025-10-24T00:12:46.686287] [INFO ] [MAIN ] TRP: Loaded 52127 existing records. [2025-10-24T00:12:46.857159] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:46.857355] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-24T00:12:46.857428] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-24T00:12:46.857683] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-24T00:12:46.857759] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-24T00:12:49.636908] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-24T00:12:50.075170] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-24T00:12:50.075295] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-24T00:12:50.076827] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-24T00:12:50.077060] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-24T00:12:50.078628] [DEBUG] [LOCAL ] TRGP: Trimmed 73627 records to 51093 (keeping 200 days of data) [2025-10-24T00:12:50.419499] [DEBUG] [LOCAL ] TRGP: Primary data saved (51093 records). [2025-10-24T00:12:50.419634] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-24T00:12:50.419815] [INFO ] [MAIN ] Update Progress: 2127/2367 symbols completed. TRGP took 35.5s. Estimated remaining: 30m 47s. Rate: 7.8 symbols/min [2025-10-24T00:12:50.588293] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:12:50.619886] [DEBUG] [LOCAL ] TRTX: Loaded 36901 existing records from primary storage. [2025-10-24T00:12:50.620232] [INFO ] [MAIN ] TRTX: Loaded 36901 existing records. [2025-10-24T00:12:50.797773] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:12:50.798007] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-24T00:12:50.798108] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-24T00:12:50.798442] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-24T00:12:50.798522] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-24T00:13:00.730878] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-24T00:13:01.118175] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-24T00:13:01.118288] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-24T00:13:01.119553] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-24T00:13:01.119633] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-24T00:13:01.120935] [DEBUG] [LOCAL ] TRNO: Trimmed 62758 records to 43908 (keeping 200 days of data) [2025-10-24T00:13:01.385348] [DEBUG] [LOCAL ] TRNO: Primary data saved (43908 records). [2025-10-24T00:13:01.385506] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-24T00:13:01.385619] [INFO ] [MAIN ] Update Progress: 2128/2367 symbols completed. TRNO took 29.9s. Estimated remaining: 30m 39s. Rate: 7.8 symbols/min [2025-10-24T00:13:01.573592] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:01.651328] [DEBUG] [LOCAL ] TRU: Loaded 51459 existing records from primary storage. [2025-10-24T00:13:01.651759] [INFO ] [MAIN ] TRU: Loaded 51459 existing records. [2025-10-24T00:13:01.854102] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:01.854342] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-24T00:13:01.854420] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-24T00:13:01.854675] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-24T00:13:01.854752] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-24T00:13:10.605202] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-24T00:13:10.993948] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-24T00:13:10.994073] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-24T00:13:10.995313] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-24T00:13:10.995395] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-24T00:13:10.996796] [DEBUG] [LOCAL ] TROX: Trimmed 74144 records to 52582 (keeping 200 days of data) [2025-10-24T00:13:11.308265] [DEBUG] [LOCAL ] TROX: Primary data saved (52582 records). [2025-10-24T00:13:11.308546] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-24T00:13:11.310088] [INFO ] [MAIN ] Update Progress: 2129/2367 symbols completed. TROX took 32.2s. Estimated remaining: 30m 32s. Rate: 7.8 symbols/min [2025-10-24T00:13:11.569980] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:11.619349] [DEBUG] [LOCAL ] TRV: Loaded 47467 existing records from primary storage. [2025-10-24T00:13:11.619729] [INFO ] [MAIN ] TRV: Loaded 47467 existing records. [2025-10-24T00:13:11.810266] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:11.810749] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-24T00:13:11.810901] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-24T00:13:11.823854] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-24T00:13:11.840223] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-24T00:13:15.757411] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-24T00:13:16.143522] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-24T00:13:16.143670] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-24T00:13:16.144720] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-24T00:13:16.144799] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-24T00:13:16.145880] [DEBUG] [LOCAL ] TRTX: Trimmed 53019 records to 37134 (keeping 200 days of data) [2025-10-24T00:13:16.360420] [DEBUG] [LOCAL ] TRTX: Primary data saved (37134 records). [2025-10-24T00:13:16.360594] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-24T00:13:16.360745] [INFO ] [MAIN ] Update Progress: 2130/2367 symbols completed. TRTX took 25.9s. Estimated remaining: 30m 24s. Rate: 7.8 symbols/min [2025-10-24T00:13:16.529932] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:16.575513] [DEBUG] [LOCAL ] TS: Loaded 51646 existing records from primary storage. [2025-10-24T00:13:16.575886] [INFO ] [MAIN ] TS: Loaded 51646 existing records. [2025-10-24T00:13:16.760468] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:16.760713] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-24T00:13:16.760832] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-24T00:13:16.761232] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-24T00:13:16.761307] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-24T00:13:18.403947] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-24T00:13:18.811377] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-24T00:13:18.811493] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-24T00:13:18.812778] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-24T00:13:18.812857] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-24T00:13:18.814286] [DEBUG] [LOCAL ] TRP: Trimmed 75767 records to 52516 (keeping 200 days of data) [2025-10-24T00:13:19.130296] [DEBUG] [LOCAL ] TRP: Primary data saved (52516 records). [2025-10-24T00:13:19.130460] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-24T00:13:19.130575] [INFO ] [MAIN ] Update Progress: 2131/2367 symbols completed. TRP took 32.7s. Estimated remaining: 30m 16s. Rate: 7.8 symbols/min [2025-10-24T00:13:19.302120] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:19.329147] [DEBUG] [LOCAL ] TSE: Loaded 27651 existing records from primary storage. [2025-10-24T00:13:19.329521] [INFO ] [MAIN ] TSE: Loaded 27651 existing records. [2025-10-24T00:13:19.507039] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:19.534045] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-24T00:13:19.534139] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-24T00:13:19.534575] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-24T00:13:19.534682] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-24T00:13:38.685751] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-24T00:13:39.074409] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-24T00:13:39.074547] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-24T00:13:39.075951] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-24T00:13:39.076055] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-24T00:13:39.077539] [DEBUG] [LOCAL ] TRU: Trimmed 74203 records to 51849 (keeping 200 days of data) [2025-10-24T00:13:39.444879] [DEBUG] [LOCAL ] TRU: Primary data saved (51849 records). [2025-10-24T00:13:39.445048] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-24T00:13:39.445201] [INFO ] [MAIN ] Update Progress: 2132/2367 symbols completed. TRU took 38.1s. Estimated remaining: 30m 9s. Rate: 7.8 symbols/min [2025-10-24T00:13:39.613664] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:39.613839] [DEBUG] [LOCAL ] TSI: No existing data file found in primary storage. [2025-10-24T00:13:39.613913] [WARN ] [MAIN ] TSI: No existing data found, performing full refresh instead. [2025-10-24T00:13:39.614020] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-24T00:13:39.614089] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-24T00:13:39.614168] [DEBUG] [LOCAL ] TSI: No primary data file found to delete. [2025-10-24T00:13:39.614235] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-24T00:13:43.541273] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-24T00:13:43.947069] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-24T00:13:43.947218] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-24T00:13:43.948574] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-24T00:13:43.948687] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-24T00:13:43.949844] [DEBUG] [LOCAL ] TSE: Trimmed 40851 records to 27989 (keeping 200 days of data) [2025-10-24T00:13:44.144924] [DEBUG] [LOCAL ] TSE: Primary data saved (27989 records). [2025-10-24T00:13:44.145687] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-24T00:13:44.146255] [INFO ] [MAIN ] Update Progress: 2133/2367 symbols completed. TSE took 25.0s. Estimated remaining: 30m 1s. Rate: 7.8 symbols/min [2025-10-24T00:13:44.336615] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:44.372064] [DEBUG] [LOCAL ] TSLX: Loaded 35762 existing records from primary storage. [2025-10-24T00:13:44.372379] [INFO ] [MAIN ] TSLX: Loaded 35762 existing records. [2025-10-24T00:13:44.558384] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:44.558603] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-24T00:13:44.558700] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-24T00:13:44.558918] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-24T00:13:44.558990] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-24T00:13:48.907516] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-24T00:13:49.337769] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-24T00:13:49.337885] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-24T00:13:49.339260] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-24T00:13:49.339360] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-24T00:13:49.340895] [DEBUG] [LOCAL ] TS: Trimmed 74882 records to 52030 (keeping 200 days of data) [2025-10-24T00:13:49.671177] [DEBUG] [LOCAL ] TS: Primary data saved (52030 records). [2025-10-24T00:13:49.671316] [INFO ] [MAIN ] TS: Full history saved. [2025-10-24T00:13:49.671427] [INFO ] [MAIN ] Update Progress: 2134/2367 symbols completed. TS took 33.3s. Estimated remaining: 29m 53s. Rate: 7.8 symbols/min [2025-10-24T00:13:49.865391] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:49.920674] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-24T00:13:49.921119] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-24T00:13:50.127384] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:50.127806] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-24T00:13:50.127948] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-24T00:13:50.128251] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-24T00:13:50.128327] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-24T00:13:51.345100] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-24T00:13:51.752817] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-24T00:13:51.753013] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-24T00:13:51.754313] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-24T00:13:51.754396] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-24T00:13:51.755803] [DEBUG] [LOCAL ] TRV: Trimmed 69973 records to 47845 (keeping 200 days of data) [2025-10-24T00:13:52.076191] [DEBUG] [LOCAL ] TRV: Primary data saved (47845 records). [2025-10-24T00:13:52.076397] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-24T00:13:52.079231] [INFO ] [MAIN ] Update Progress: 2135/2367 symbols completed. TRV took 40.8s. Estimated remaining: 29m 45s. Rate: 7.8 symbols/min [2025-10-24T00:13:52.254239] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:52.311418] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-24T00:13:52.311826] [INFO ] [MAIN ] TSN: Loaded 53088 existing records. [2025-10-24T00:13:52.486571] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:52.486794] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-24T00:13:52.486880] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-24T00:13:52.487113] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-24T00:13:52.487185] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-24T00:13:57.665546] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-24T00:13:58.021499] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-24T00:13:58.021606] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-24T00:13:58.021965] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-24T00:13:58.022040] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-24T00:13:58.022515] [DEBUG] [LOCAL ] TSI: Trimmed 13979 records to 8234 (keeping 200 days of data) [2025-10-24T00:13:58.070660] [DEBUG] [LOCAL ] TSI: Primary data saved (8234 records). [2025-10-24T00:13:58.070830] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-24T00:13:58.070956] [INFO ] [MAIN ] Update Progress: 2136/2367 symbols completed. TSI took 18.6s. Estimated remaining: 29m 37s. Rate: 7.8 symbols/min [2025-10-24T00:13:58.235630] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:13:58.248430] [DEBUG] [LOCAL ] TSQ: Loaded 11595 existing records from primary storage. [2025-10-24T00:13:58.248705] [INFO ] [MAIN ] TSQ: Loaded 11595 existing records. [2025-10-24T00:13:58.423577] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:13:58.424546] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-24T00:13:58.424602] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-24T00:13:58.424767] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-24T00:13:58.424828] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-24T00:14:08.731006] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-24T00:14:09.109233] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-24T00:14:09.109682] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-24T00:14:09.110689] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-24T00:14:09.110765] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-24T00:14:09.111800] [DEBUG] [LOCAL ] TSLX: Trimmed 50854 records to 36029 (keeping 200 days of data) [2025-10-24T00:14:09.324143] [DEBUG] [LOCAL ] TSLX: Primary data saved (36029 records). [2025-10-24T00:14:09.324302] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-24T00:14:09.324415] [INFO ] [MAIN ] Update Progress: 2137/2367 symbols completed. TSLX took 25.2s. Estimated remaining: 29m 30s. Rate: 7.8 symbols/min [2025-10-24T00:14:09.489008] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:09.531086] [DEBUG] [LOCAL ] TT: Loaded 47001 existing records from primary storage. [2025-10-24T00:14:09.531395] [INFO ] [MAIN ] TT: Loaded 47001 existing records. [2025-10-24T00:14:09.711113] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:14:09.711359] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-24T00:14:09.711462] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-24T00:14:09.711926] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-24T00:14:09.712001] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-24T00:14:23.950739] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-24T00:14:24.326278] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-24T00:14:24.326386] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-24T00:14:24.326769] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-24T00:14:24.326845] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-24T00:14:24.327374] [DEBUG] [LOCAL ] TSQ: Trimmed 16337 records to 11726 (keeping 200 days of data) [2025-10-24T00:14:24.392050] [DEBUG] [LOCAL ] TSQ: Primary data saved (11726 records). [2025-10-24T00:14:24.392200] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-24T00:14:24.392310] [INFO ] [MAIN ] Update Progress: 2138/2367 symbols completed. TSQ took 26.3s. Estimated remaining: 29m 23s. Rate: 7.8 symbols/min [2025-10-24T00:14:24.559357] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:24.559555] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-24T00:14:24.559634] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-24T00:14:24.559771] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-24T00:14:24.559855] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-24T00:14:24.559937] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-24T00:14:24.559991] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-24T00:14:26.611890] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-24T00:14:26.611961] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:14:26.612035] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-24T00:14:26.612127] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-24T00:14:26.612197] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-24T00:14:26.612276] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-24T00:14:26.612360] [INFO ] [MAIN ] Update Progress: 2139/2367 symbols completed. TTAM took 2.2s. Estimated remaining: 29m 15s. Rate: 7.8 symbols/min [2025-10-24T00:14:26.796292] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:26.836566] [DEBUG] [LOCAL ] TTC: Loaded 41525 existing records from primary storage. [2025-10-24T00:14:26.836930] [INFO ] [MAIN ] TTC: Loaded 41525 existing records. [2025-10-24T00:14:27.037582] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:14:27.037838] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-24T00:14:27.037916] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-24T00:14:27.038142] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-24T00:14:27.038218] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-24T00:14:34.571054] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-24T00:14:34.978813] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-24T00:14:34.979083] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-24T00:14:34.980451] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-24T00:14:34.980721] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-24T00:14:35.009486] [DEBUG] [LOCAL ] TSN: Trimmed 76685 records to 53474 (keeping 200 days of data) [2025-10-24T00:14:35.382566] [DEBUG] [LOCAL ] TSN: Primary data saved (53474 records). [2025-10-24T00:14:35.382768] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-24T00:14:35.384297] [INFO ] [MAIN ] Update Progress: 2140/2367 symbols completed. TSN took 43.3s. Estimated remaining: 29m 7s. Rate: 7.8 symbols/min [2025-10-24T00:14:35.578453] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:35.632367] [DEBUG] [LOCAL ] TTE: Loaded 51552 existing records from primary storage. [2025-10-24T00:14:35.632741] [INFO ] [MAIN ] TTE: Loaded 51552 existing records. [2025-10-24T00:14:35.815669] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:14:35.816129] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-24T00:14:35.816381] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-24T00:14:35.816747] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-24T00:14:35.816824] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-24T00:14:36.249578] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-24T00:14:36.627786] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-24T00:14:36.627892] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-24T00:14:36.629111] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-24T00:14:36.629189] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-24T00:14:36.630560] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 54209 (keeping 200 days of data) [2025-10-24T00:14:36.972623] [DEBUG] [LOCAL ] TSM: Primary data saved (54209 records). [2025-10-24T00:14:36.972801] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-24T00:14:36.972912] [INFO ] [MAIN ] Update Progress: 2141/2367 symbols completed. TSM took 47.3s. Estimated remaining: 28m 59s. Rate: 7.8 symbols/min [2025-10-24T00:14:37.150307] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:37.189690] [DEBUG] [LOCAL ] TTI: Loaded 46650 existing records from primary storage. [2025-10-24T00:14:37.190028] [INFO ] [MAIN ] TTI: Loaded 46650 existing records. [2025-10-24T00:14:37.383233] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:14:37.383427] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-24T00:14:37.383499] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-24T00:14:37.383817] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-24T00:14:37.383890] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-24T00:14:43.262895] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-24T00:14:43.642660] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-24T00:14:43.642780] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-24T00:14:43.643983] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-24T00:14:43.644066] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-24T00:14:43.645426] [DEBUG] [LOCAL ] TT: Trimmed 69961 records to 47349 (keeping 200 days of data) [2025-10-24T00:14:43.945672] [DEBUG] [LOCAL ] TT: Primary data saved (47349 records). [2025-10-24T00:14:43.965342] [INFO ] [MAIN ] TT: Full history saved. [2025-10-24T00:14:43.968037] [INFO ] [MAIN ] Update Progress: 2142/2367 symbols completed. TT took 34.6s. Estimated remaining: 28m 51s. Rate: 7.8 symbols/min [2025-10-24T00:14:44.153720] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:44.199251] [DEBUG] [LOCAL ] TU: Loaded 49774 existing records from primary storage. [2025-10-24T00:14:44.199591] [INFO ] [MAIN ] TU: Loaded 49774 existing records. [2025-10-24T00:14:44.371562] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:14:44.371759] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-24T00:14:44.371831] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-24T00:14:44.372075] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-24T00:14:44.372147] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-24T00:14:47.720278] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-24T00:14:48.093869] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-24T00:14:48.093974] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-24T00:14:48.095094] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-24T00:14:48.095172] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-24T00:14:48.096367] [DEBUG] [LOCAL ] TTC: Trimmed 61828 records to 41771 (keeping 200 days of data) [2025-10-24T00:14:48.346811] [DEBUG] [LOCAL ] TTC: Primary data saved (41771 records). [2025-10-24T00:14:48.346961] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-24T00:14:48.347112] [INFO ] [MAIN ] Update Progress: 2143/2367 symbols completed. TTC took 21.7s. Estimated remaining: 28m 43s. Rate: 7.8 symbols/min [2025-10-24T00:14:48.520030] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:14:48.558514] [DEBUG] [LOCAL ] TUYA: Loaded 45737 existing records from primary storage. [2025-10-24T00:14:48.558918] [INFO ] [MAIN ] TUYA: Loaded 45737 existing records. [2025-10-24T00:14:48.748447] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:14:48.748731] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-24T00:14:48.748953] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-24T00:14:48.749247] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-24T00:14:48.749319] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-24T00:15:05.836063] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-24T00:15:06.213693] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-24T00:15:06.213807] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-24T00:15:06.214941] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-24T00:15:06.215020] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-24T00:15:06.216219] [DEBUG] [LOCAL ] TTI: Trimmed 66576 records to 47037 (keeping 200 days of data) [2025-10-24T00:15:06.478057] [DEBUG] [LOCAL ] TTI: Primary data saved (47037 records). [2025-10-24T00:15:06.478261] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-24T00:15:06.478385] [INFO ] [MAIN ] Update Progress: 2144/2367 symbols completed. TTI took 29.5s. Estimated remaining: 28m 36s. Rate: 7.8 symbols/min [2025-10-24T00:15:06.649114] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:06.683105] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-24T00:15:06.965443] [DEBUG] [LOCAL ] TV: Loaded 41238 existing records from primary storage. [2025-10-24T00:15:06.992964] [INFO ] [MAIN ] TV: Loaded 41238 existing records. [2025-10-24T00:15:07.248872] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-24T00:15:07.278035] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-24T00:15:07.277812] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:07.279607] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-24T00:15:07.279829] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-24T00:15:07.279919] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-24T00:15:07.280076] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-24T00:15:07.280481] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-24T00:15:07.280807] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-24T00:15:07.375625] [DEBUG] [LOCAL ] TTE: Trimmed 75070 records to 51922 (keeping 200 days of data) [2025-10-24T00:15:08.014472] [DEBUG] [LOCAL ] TTE: Primary data saved (51922 records). [2025-10-24T00:15:08.014835] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-24T00:15:08.016225] [INFO ] [MAIN ] Update Progress: 2145/2367 symbols completed. TTE took 32.6s. Estimated remaining: 28m 28s. Rate: 7.8 symbols/min [2025-10-24T00:15:08.190321] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:08.220782] [DEBUG] [LOCAL ] TVC: Loaded 3118 existing records from primary storage. [2025-10-24T00:15:08.221102] [INFO ] [MAIN ] TVC: Loaded 3118 existing records. [2025-10-24T00:15:08.407983] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:08.408227] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-24T00:15:08.408318] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-24T00:15:08.408516] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-24T00:15:08.408604] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-24T00:15:23.980352] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-24T00:15:24.381965] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-24T00:15:24.382097] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-24T00:15:24.383250] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-24T00:15:24.383328] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-24T00:15:24.384554] [DEBUG] [LOCAL ] TUYA: Trimmed 66937 records to 46014 (keeping 200 days of data) [2025-10-24T00:15:24.634419] [DEBUG] [LOCAL ] TUYA: Primary data saved (46014 records). [2025-10-24T00:15:24.634576] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-24T00:15:24.634707] [INFO ] [MAIN ] Update Progress: 2146/2367 symbols completed. TUYA took 36.3s. Estimated remaining: 28m 21s. Rate: 7.8 symbols/min [2025-10-24T00:15:24.799949] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:24.806248] [DEBUG] [LOCAL ] TVE: Loaded 2547 existing records from primary storage. [2025-10-24T00:15:24.806437] [INFO ] [MAIN ] TVE: Loaded 2547 existing records. [2025-10-24T00:15:24.980219] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:24.980484] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-24T00:15:24.980560] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-24T00:15:24.980755] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-24T00:15:24.980833] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-24T00:15:28.929350] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-24T00:15:29.334546] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-24T00:15:29.334797] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-24T00:15:29.340287] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-24T00:15:29.340556] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-24T00:15:29.340778] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-24T00:15:29.447267] [DEBUG] [LOCAL ] TU: Trimmed 72855 records to 50129 (keeping 200 days of data) [2025-10-24T00:15:29.849921] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-24T00:15:29.851762] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-24T00:15:29.851975] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-24T00:15:29.855692] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-24T00:15:29.858342] [DEBUG] [LOCAL ] TVC: Trimmed 5042 records to 3123 (keeping 200 days of data) [2025-10-24T00:15:29.888618] [DEBUG] [LOCAL ] TVC: Primary data saved (3123 records). [2025-10-24T00:15:29.895390] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-24T00:15:29.895612] [INFO ] [MAIN ] Update Progress: 2147/2367 symbols completed. TVC took 21.9s. Estimated remaining: 28m 13s. Rate: 7.8 symbols/min [2025-10-24T00:15:30.177007] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:30.255941] [DEBUG] [LOCAL ] TU: Primary data saved (50129 records). [2025-10-24T00:15:30.256139] [INFO ] [MAIN ] TU: Full history saved. [2025-10-24T00:15:30.256262] [INFO ] [MAIN ] Update Progress: 2148/2367 symbols completed. TU took 46.3s. Estimated remaining: 28m 5s. Rate: 7.8 symbols/min [2025-10-24T00:15:30.376402] [DEBUG] [LOCAL ] TWI: Loaded 33814 existing records from primary storage. [2025-10-24T00:15:30.382365] [INFO ] [MAIN ] TWI: Loaded 33814 existing records. [2025-10-24T00:15:30.519559] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:30.637405] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:30.637763] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-24T00:15:30.637856] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-24T00:15:30.638095] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-24T00:15:30.638186] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-24T00:15:30.894433] [DEBUG] [LOCAL ] TWLO: Loaded 52813 existing records from primary storage. [2025-10-24T00:15:30.916191] [INFO ] [MAIN ] TWLO: Loaded 52813 existing records. [2025-10-24T00:15:31.259942] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:31.268014] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-24T00:15:31.281783] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-24T00:15:31.282114] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-24T00:15:31.283352] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-24T00:15:34.853747] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-24T00:15:35.256070] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-24T00:15:35.256175] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-24T00:15:35.257282] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-24T00:15:35.257384] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-24T00:15:35.258781] [DEBUG] [LOCAL ] TV: Trimmed 60829 records to 41483 (keeping 200 days of data) [2025-10-24T00:15:35.490981] [DEBUG] [LOCAL ] TV: Primary data saved (41483 records). [2025-10-24T00:15:35.491154] [INFO ] [MAIN ] TV: Full history saved. [2025-10-24T00:15:35.491291] [INFO ] [MAIN ] Update Progress: 2149/2367 symbols completed. TV took 29.0s. Estimated remaining: 27m 57s. Rate: 7.8 symbols/min [2025-10-24T00:15:35.661388] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:35.666686] [DEBUG] [LOCAL ] TWN: Loaded 3211 existing records from primary storage. [2025-10-24T00:15:35.666887] [INFO ] [MAIN ] TWN: Loaded 3211 existing records. [2025-10-24T00:15:35.847630] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:35.848010] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-24T00:15:35.848103] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-24T00:15:35.848307] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-24T00:15:35.848400] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-24T00:15:48.491324] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-24T00:15:48.839507] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-24T00:15:48.839619] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-24T00:15:48.839852] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-24T00:15:48.839945] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-24T00:15:48.840400] [DEBUG] [LOCAL ] TVE: Trimmed 4213 records to 2559 (keeping 200 days of data) [2025-10-24T00:15:48.856495] [DEBUG] [LOCAL ] TVE: Primary data saved (2559 records). [2025-10-24T00:15:48.856722] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-24T00:15:48.856852] [INFO ] [MAIN ] Update Progress: 2150/2367 symbols completed. TVE took 24.2s. Estimated remaining: 27m 50s. Rate: 7.8 symbols/min [2025-10-24T00:15:49.023463] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:15:49.068404] [DEBUG] [LOCAL ] TWO: Loaded 48553 existing records from primary storage. [2025-10-24T00:15:49.068815] [INFO ] [MAIN ] TWO: Loaded 48553 existing records. [2025-10-24T00:15:49.265608] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:15:49.265895] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-24T00:15:49.266005] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-24T00:15:49.266386] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-24T00:15:49.266475] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-24T00:16:02.165071] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-24T00:16:02.575803] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-24T00:16:02.575929] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-24T00:16:02.576173] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-24T00:16:02.576265] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-24T00:16:02.576791] [DEBUG] [LOCAL ] TWN: Trimmed 5216 records to 3242 (keeping 200 days of data) [2025-10-24T00:16:02.596509] [DEBUG] [LOCAL ] TWN: Primary data saved (3242 records). [2025-10-24T00:16:02.596715] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-24T00:16:02.596852] [INFO ] [MAIN ] Update Progress: 2151/2367 symbols completed. TWN took 27.1s. Estimated remaining: 27m 43s. Rate: 7.8 symbols/min [2025-10-24T00:16:02.782928] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:02.783125] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-24T00:16:02.783196] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-24T00:16:02.783313] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-24T00:16:02.783385] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-24T00:16:02.783467] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-24T00:16:02.783535] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-24T00:16:03.431064] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-24T00:16:03.431137] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:16:03.431211] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-24T00:16:03.431301] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-24T00:16:03.431372] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-24T00:16:03.431452] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-24T00:16:03.431533] [INFO ] [MAIN ] Update Progress: 2152/2367 symbols completed. TWOD took 0.8s. Estimated remaining: 27m 34s. Rate: 7.8 symbols/min [2025-10-24T00:16:03.599151] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:03.620871] [DEBUG] [LOCAL ] TX: Loaded 23146 existing records from primary storage. [2025-10-24T00:16:03.621157] [INFO ] [MAIN ] TX: Loaded 23146 existing records. [2025-10-24T00:16:03.829365] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:03.835842] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-24T00:16:03.836099] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-24T00:16:03.837221] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-24T00:16:03.837312] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-24T00:16:10.195313] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-24T00:16:10.589271] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-24T00:16:10.589439] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-24T00:16:10.591610] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-24T00:16:10.591725] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-24T00:16:10.593434] [DEBUG] [LOCAL ] TWI: Trimmed 52083 records to 34041 (keeping 200 days of data) [2025-10-24T00:16:10.813185] [DEBUG] [LOCAL ] TWI: Primary data saved (34041 records). [2025-10-24T00:16:10.813464] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-24T00:16:10.813676] [INFO ] [MAIN ] Update Progress: 2153/2367 symbols completed. TWI took 40.9s. Estimated remaining: 27m 27s. Rate: 7.8 symbols/min [2025-10-24T00:16:11.001377] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:11.050203] [DEBUG] [LOCAL ] TXNM: Loaded 42857 existing records from primary storage. [2025-10-24T00:16:11.051472] [INFO ] [MAIN ] TXNM: Loaded 42857 existing records. [2025-10-24T00:16:11.256523] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:11.257123] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-24T00:16:11.257207] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-24T00:16:11.257518] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-24T00:16:11.257598] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-24T00:16:11.689054] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-24T00:16:12.100558] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-24T00:16:12.100729] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-24T00:16:12.102193] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-24T00:16:12.102276] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-24T00:16:12.103825] [DEBUG] [LOCAL ] TWLO: Trimmed 76604 records to 53169 (keeping 200 days of data) [2025-10-24T00:16:12.464679] [DEBUG] [LOCAL ] TWLO: Primary data saved (53169 records). [2025-10-24T00:16:12.464841] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-24T00:16:12.464953] [INFO ] [MAIN ] Update Progress: 2154/2367 symbols completed. TWLO took 42.2s. Estimated remaining: 27m 18s. Rate: 7.8 symbols/min [2025-10-24T00:16:12.635047] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:12.674783] [DEBUG] [LOCAL ] TXO: Loaded 20043 existing records from primary storage. [2025-10-24T00:16:12.675093] [INFO ] [MAIN ] TXO: Loaded 20043 existing records. [2025-10-24T00:16:12.867606] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:12.867888] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-24T00:16:12.867982] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-24T00:16:12.868424] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-24T00:16:12.868507] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-24T00:16:19.278080] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-24T00:16:19.713816] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-24T00:16:19.714021] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-24T00:16:19.715216] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-24T00:16:19.715296] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-24T00:16:19.716725] [DEBUG] [LOCAL ] TWO: Trimmed 69254 records to 48886 (keeping 200 days of data) [2025-10-24T00:16:20.019236] [DEBUG] [LOCAL ] TWO: Primary data saved (48886 records). [2025-10-24T00:16:20.019395] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-24T00:16:20.019510] [INFO ] [MAIN ] Update Progress: 2155/2367 symbols completed. TWO took 31.2s. Estimated remaining: 27m 11s. Rate: 7.8 symbols/min [2025-10-24T00:16:20.188520] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:20.231514] [DEBUG] [LOCAL ] TXT: Loaded 49510 existing records from primary storage. [2025-10-24T00:16:20.231869] [INFO ] [MAIN ] TXT: Loaded 49510 existing records. [2025-10-24T00:16:20.410955] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:20.411204] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-24T00:16:20.411280] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-24T00:16:20.411516] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-24T00:16:20.411590] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-24T00:16:32.752083] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-24T00:16:33.173103] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-24T00:16:33.173225] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-24T00:16:33.173971] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-24T00:16:33.174050] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-24T00:16:33.174844] [DEBUG] [LOCAL ] TX: Trimmed 35442 records to 23300 (keeping 200 days of data) [2025-10-24T00:16:33.304672] [DEBUG] [LOCAL ] TX: Primary data saved (23300 records). [2025-10-24T00:16:33.304821] [INFO ] [MAIN ] TX: Full history saved. [2025-10-24T00:16:33.304927] [INFO ] [MAIN ] Update Progress: 2156/2367 symbols completed. TX took 29.9s. Estimated remaining: 27m 4s. Rate: 7.8 symbols/min [2025-10-24T00:16:33.469921] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:33.479285] [DEBUG] [LOCAL ] TY: Loaded 7524 existing records from primary storage. [2025-10-24T00:16:33.479526] [INFO ] [MAIN ] TY: Loaded 7524 existing records. [2025-10-24T00:16:33.682031] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:33.683069] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-24T00:16:33.683171] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-24T00:16:33.683469] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-24T00:16:33.683618] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-24T00:16:37.981216] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-24T00:16:38.350960] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-24T00:16:38.351080] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-24T00:16:38.351776] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-24T00:16:38.351857] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-24T00:16:38.352676] [DEBUG] [LOCAL ] TXO: Trimmed 27303 records to 20165 (keeping 200 days of data) [2025-10-24T00:16:38.478481] [DEBUG] [LOCAL ] TXO: Primary data saved (20165 records). [2025-10-24T00:16:38.478632] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-24T00:16:38.478776] [INFO ] [MAIN ] Update Progress: 2157/2367 symbols completed. TXO took 26.0s. Estimated remaining: 26m 56s. Rate: 7.8 symbols/min [2025-10-24T00:16:43.955278] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-24T00:16:44.344442] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-24T00:16:44.344600] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-24T00:16:44.345927] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-24T00:16:44.346026] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-24T00:16:44.347371] [DEBUG] [LOCAL ] TXNM: Trimmed 62762 records to 43114 (keeping 200 days of data) [2025-10-24T00:16:44.613586] [DEBUG] [LOCAL ] TXNM: Primary data saved (43114 records). [2025-10-24T00:16:44.613751] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-24T00:16:44.615069] [INFO ] [MAIN ] Update Progress: 2158/2367 symbols completed. TXNM took 33.8s. Estimated remaining: 26m 48s. Rate: 7.8 symbols/min [2025-10-24T00:16:48.516696] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-24T00:16:48.885962] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-24T00:16:48.886187] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-24T00:16:48.886603] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-24T00:16:48.886741] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-24T00:16:48.887615] [DEBUG] [LOCAL ] TY: Trimmed 11303 records to 7553 (keeping 200 days of data) [2025-10-24T00:16:48.978826] [DEBUG] [LOCAL ] TY: Primary data saved (7553 records). [2025-10-24T00:16:48.980241] [INFO ] [MAIN ] TY: Full history saved. [2025-10-24T00:16:48.980385] [INFO ] [MAIN ] Update Progress: 2159/2367 symbols completed. TY took 15.7s. Estimated remaining: 26m 40s. Rate: 7.8 symbols/min [2025-10-24T00:16:53.784223] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-24T00:16:54.165804] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-24T00:16:54.165912] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-24T00:16:54.167075] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-24T00:16:54.167153] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-24T00:16:54.168474] [DEBUG] [LOCAL ] TXT: Trimmed 72444 records to 49899 (keeping 200 days of data) [2025-10-24T00:16:54.475673] [DEBUG] [LOCAL ] TXT: Primary data saved (49899 records). [2025-10-24T00:16:54.475870] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-24T00:16:54.476039] [INFO ] [MAIN ] Update Progress: 2160/2367 symbols completed. TXT took 34.5s. Estimated remaining: 26m 32s. Rate: 7.8 symbols/min [2025-10-24T00:16:55.109535] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:55.193369] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:55.194237] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:55.195465] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:16:55.216971] [DEBUG] [LOCAL ] TYG: Loaded 13892 existing records from primary storage. [2025-10-24T00:16:55.217267] [INFO ] [MAIN ] TYG: Loaded 13892 existing records. [2025-10-24T00:16:55.292058] [DEBUG] [LOCAL ] TYL: Loaded 21988 existing records from primary storage. [2025-10-24T00:16:55.328136] [INFO ] [MAIN ] TYL: Loaded 21988 existing records. [2025-10-24T00:16:55.562926] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-24T00:16:55.570084] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:55.606328] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-24T00:16:55.641925] [DEBUG] [LOCAL ] UA: Loaded 50473 existing records from primary storage. [2025-10-24T00:16:55.653967] [INFO ] [MAIN ] UA: Loaded 50473 existing records. [2025-10-24T00:16:55.641233] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-24T00:16:55.676711] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-24T00:16:55.676616] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:55.729769] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-24T00:16:55.730025] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-24T00:16:55.783076] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-24T00:16:55.800390] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-24T00:16:55.823382] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-24T00:16:55.855769] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-24T00:16:56.155217] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:56.251302] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:16:56.270011] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-24T00:16:56.313530] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-24T00:16:56.355166] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-24T00:16:56.460628] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-24T00:16:56.381005] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-24T00:16:56.467537] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-24T00:16:56.603149] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-24T00:16:56.643508] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-24T00:17:13.627386] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-24T00:17:14.010405] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-24T00:17:14.010590] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-24T00:17:14.011308] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-24T00:17:14.011400] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-24T00:17:14.012326] [DEBUG] [LOCAL ] TYG: Trimmed 22118 records to 14093 (keeping 200 days of data) [2025-10-24T00:17:14.101966] [DEBUG] [LOCAL ] TYG: Primary data saved (14093 records). [2025-10-24T00:17:14.102122] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-24T00:17:14.102233] [INFO ] [MAIN ] Update Progress: 2161/2367 symbols completed. TYG took 19.6s. Estimated remaining: 26m 25s. Rate: 7.8 symbols/min [2025-10-24T00:17:14.285722] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:17:14.368239] [DEBUG] [LOCAL ] UAA: Loaded 53498 existing records from primary storage. [2025-10-24T00:17:14.368586] [INFO ] [MAIN ] UAA: Loaded 53498 existing records. [2025-10-24T00:17:14.550308] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:17:14.550508] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-24T00:17:14.550586] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-24T00:17:14.550825] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-24T00:17:14.550897] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-24T00:17:22.745480] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-24T00:17:23.161745] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-24T00:17:23.161856] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-24T00:17:23.162508] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-24T00:17:23.162582] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-24T00:17:23.163317] [DEBUG] [LOCAL ] TYL: Trimmed 31628 records to 22120 (keeping 200 days of data) [2025-10-24T00:17:23.300267] [DEBUG] [LOCAL ] TYL: Primary data saved (22120 records). [2025-10-24T00:17:23.300422] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-24T00:17:23.300512] [INFO ] [MAIN ] Update Progress: 2162/2367 symbols completed. TYL took 28.8s. Estimated remaining: 26m 18s. Rate: 7.8 symbols/min [2025-10-24T00:17:23.465118] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:17:23.477061] [DEBUG] [LOCAL ] UAN: Loaded 5302 existing records from primary storage. [2025-10-24T00:17:23.477253] [INFO ] [MAIN ] UAN: Loaded 5302 existing records. [2025-10-24T00:17:23.649103] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:17:23.649314] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-24T00:17:23.649388] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-24T00:17:23.649539] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-24T00:17:23.649605] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-24T00:17:25.846966] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-24T00:17:26.340317] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-24T00:17:26.340453] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-24T00:17:26.341846] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-24T00:17:26.341942] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-24T00:17:26.343581] [DEBUG] [LOCAL ] UA: Trimmed 73217 records to 50822 (keeping 200 days of data) [2025-10-24T00:17:26.633837] [DEBUG] [LOCAL ] UA: Primary data saved (50822 records). [2025-10-24T00:17:26.634021] [INFO ] [MAIN ] UA: Full history saved. [2025-10-24T00:17:26.634140] [INFO ] [MAIN ] Update Progress: 2163/2367 symbols completed. UA took 32.2s. Estimated remaining: 26m 10s. Rate: 7.8 symbols/min [2025-10-24T00:17:26.800307] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:17:26.850401] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-24T00:17:26.850799] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-24T00:17:27.029943] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:17:27.030165] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-24T00:17:27.030252] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-24T00:17:27.030519] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-24T00:17:27.030593] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-24T00:17:29.700174] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-24T00:17:30.085829] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-24T00:17:30.085949] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-24T00:17:30.087252] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-24T00:17:30.087367] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-24T00:17:30.088909] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 54189 (keeping 200 days of data) [2025-10-24T00:17:30.416836] [DEBUG] [LOCAL ] U: Primary data saved (54189 records). [2025-10-24T00:17:30.423056] [INFO ] [MAIN ] U: Full history saved. [2025-10-24T00:17:30.424017] [INFO ] [MAIN ] Update Progress: 2164/2367 symbols completed. U took 35.9s. Estimated remaining: 26m 2s. Rate: 7.8 symbols/min [2025-10-24T00:17:30.601832] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:17:30.689279] [DEBUG] [LOCAL ] UBS: Loaded 52286 existing records from primary storage. [2025-10-24T00:17:30.689694] [INFO ] [MAIN ] UBS: Loaded 52286 existing records. [2025-10-24T00:17:30.870991] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:17:30.871381] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-24T00:17:30.871535] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-24T00:17:30.882506] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-24T00:17:30.900147] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-24T00:17:38.200713] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-24T00:17:38.565052] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-24T00:17:38.565175] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-24T00:17:38.565419] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-24T00:17:38.565493] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-24T00:17:38.565954] [DEBUG] [LOCAL ] UAN: Trimmed 7837 records to 5331 (keeping 200 days of data) [2025-10-24T00:17:38.598157] [DEBUG] [LOCAL ] UAN: Primary data saved (5331 records). [2025-10-24T00:17:38.598322] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-24T00:17:38.598435] [INFO ] [MAIN ] Update Progress: 2165/2367 symbols completed. UAN took 15.3s. Estimated remaining: 25m 54s. Rate: 7.8 symbols/min [2025-10-24T00:17:38.766253] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:17:38.766461] [DEBUG] [LOCAL ] UCB: No existing data file found in primary storage. [2025-10-24T00:17:38.766538] [WARN ] [MAIN ] UCB: No existing data found, performing full refresh instead. [2025-10-24T00:17:38.766673] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-24T00:17:38.766743] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-24T00:17:38.766821] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-24T00:17:38.766893] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-24T00:17:49.175918] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-24T00:17:49.561805] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-24T00:17:49.562075] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-24T00:17:49.563410] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-24T00:17:49.563507] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-24T00:17:49.565130] [DEBUG] [LOCAL ] UAA: Trimmed 77643 records to 53888 (keeping 200 days of data) [2025-10-24T00:17:49.913349] [DEBUG] [LOCAL ] UAA: Primary data saved (53888 records). [2025-10-24T00:17:49.913877] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-24T00:17:49.914002] [INFO ] [MAIN ] Update Progress: 2166/2367 symbols completed. UAA took 35.8s. Estimated remaining: 25m 47s. Rate: 7.8 symbols/min [2025-10-24T00:17:50.088516] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:17:50.135165] [DEBUG] [LOCAL ] UDR: Loaded 52105 existing records from primary storage. [2025-10-24T00:17:50.135501] [INFO ] [MAIN ] UDR: Loaded 52105 existing records. [2025-10-24T00:17:50.313776] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:17:50.313985] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-24T00:17:50.314062] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-24T00:17:50.314322] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-24T00:17:50.314397] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-24T00:18:01.449395] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-24T00:18:01.850471] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-24T00:18:01.850590] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-24T00:18:01.851732] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-24T00:18:01.851812] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-24T00:18:01.853006] [DEBUG] [LOCAL ] UCB: Trimmed 55069 records to 38009 (keeping 200 days of data) [2025-10-24T00:18:02.083016] [DEBUG] [LOCAL ] UCB: Primary data saved (38009 records). [2025-10-24T00:18:02.083180] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-24T00:18:02.083284] [INFO ] [MAIN ] Update Progress: 2167/2367 symbols completed. UCB took 23.5s. Estimated remaining: 25m 39s. Rate: 7.8 symbols/min [2025-10-24T00:18:02.262001] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:02.301809] [DEBUG] [LOCAL ] UE: Loaded 42468 existing records from primary storage. [2025-10-24T00:18:02.302139] [INFO ] [MAIN ] UE: Loaded 42468 existing records. [2025-10-24T00:18:02.477705] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:02.477922] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-24T00:18:02.477997] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-24T00:18:02.478241] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-24T00:18:02.478317] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-24T00:18:02.933391] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-24T00:18:03.333042] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-24T00:18:03.333228] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-24T00:18:03.334551] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-24T00:18:03.334636] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-24T00:18:03.336116] [DEBUG] [LOCAL ] UBS: Trimmed 75955 records to 52657 (keeping 200 days of data) [2025-10-24T00:18:03.644711] [DEBUG] [LOCAL ] UBS: Primary data saved (52657 records). [2025-10-24T00:18:03.644879] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-24T00:18:03.644981] [INFO ] [MAIN ] Update Progress: 2168/2367 symbols completed. UBS took 33.2s. Estimated remaining: 25m 31s. Rate: 7.8 symbols/min [2025-10-24T00:18:03.824359] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:03.833542] [DEBUG] [LOCAL ] UFI: Loaded 8232 existing records from primary storage. [2025-10-24T00:18:03.834005] [INFO ] [MAIN ] UFI: Loaded 8232 existing records. [2025-10-24T00:18:04.022558] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:04.022917] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-24T00:18:04.023000] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-24T00:18:04.023200] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-24T00:18:04.023280] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-24T00:18:21.692227] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-24T00:18:22.077306] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-24T00:18:22.077440] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-24T00:18:22.078830] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-24T00:18:22.078932] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-24T00:18:22.080453] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 54196 (keeping 200 days of data) [2025-10-24T00:18:22.454945] [DEBUG] [LOCAL ] UBER: Primary data saved (54196 records). [2025-10-24T00:18:22.455082] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-24T00:18:22.455247] [INFO ] [MAIN ] Update Progress: 2169/2367 symbols completed. UBER took 55.8s. Estimated remaining: 25m 24s. Rate: 7.8 symbols/min [2025-10-24T00:18:22.623072] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:22.668058] [DEBUG] [LOCAL ] UGI: Loaded 50495 existing records from primary storage. [2025-10-24T00:18:22.668466] [INFO ] [MAIN ] UGI: Loaded 50495 existing records. [2025-10-24T00:18:22.845701] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:22.845915] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-24T00:18:22.846010] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-24T00:18:22.846364] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-24T00:18:22.846456] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-24T00:18:24.085565] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-24T00:18:24.522503] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-24T00:18:24.522609] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-24T00:18:24.522933] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-24T00:18:24.523007] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-24T00:18:24.523506] [DEBUG] [LOCAL ] UFI: Trimmed 12408 records to 8257 (keeping 200 days of data) [2025-10-24T00:18:24.566840] [DEBUG] [LOCAL ] UFI: Primary data saved (8257 records). [2025-10-24T00:18:24.566968] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-24T00:18:24.567077] [INFO ] [MAIN ] Update Progress: 2170/2367 symbols completed. UFI took 20.9s. Estimated remaining: 25m 16s. Rate: 7.8 symbols/min [2025-10-24T00:18:24.732923] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:24.769844] [DEBUG] [LOCAL ] UGP: Loaded 42993 existing records from primary storage. [2025-10-24T00:18:24.770154] [INFO ] [MAIN ] UGP: Loaded 42993 existing records. [2025-10-24T00:18:24.949023] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:24.949214] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-24T00:18:24.949298] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-24T00:18:24.949519] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-24T00:18:24.949595] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-24T00:18:26.109030] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-24T00:18:26.525090] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-24T00:18:26.525204] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-24T00:18:26.526443] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-24T00:18:26.526522] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-24T00:18:26.527955] [DEBUG] [LOCAL ] UDR: Trimmed 75126 records to 52492 (keeping 200 days of data) [2025-10-24T00:18:26.842851] [DEBUG] [LOCAL ] UDR: Primary data saved (52492 records). [2025-10-24T00:18:26.843006] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-24T00:18:26.843118] [INFO ] [MAIN ] Update Progress: 2171/2367 symbols completed. UDR took 36.9s. Estimated remaining: 25m 8s. Rate: 7.8 symbols/min [2025-10-24T00:18:27.010859] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:27.027908] [DEBUG] [LOCAL ] UHAL: Loaded 16849 existing records from primary storage. [2025-10-24T00:18:27.028183] [INFO ] [MAIN ] UHAL: Loaded 16849 existing records. [2025-10-24T00:18:27.205608] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:27.205967] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-24T00:18:27.206111] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-24T00:18:27.207070] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-24T00:18:27.207159] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-24T00:18:34.266784] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-24T00:18:34.696152] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-24T00:18:34.696267] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-24T00:18:34.697408] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-24T00:18:34.697488] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-24T00:18:34.698714] [DEBUG] [LOCAL ] UE: Trimmed 61049 records to 42745 (keeping 200 days of data) [2025-10-24T00:18:34.956738] [DEBUG] [LOCAL ] UE: Primary data saved (42745 records). [2025-10-24T00:18:34.956955] [INFO ] [MAIN ] UE: Full history saved. [2025-10-24T00:18:34.958430] [INFO ] [MAIN ] Update Progress: 2172/2367 symbols completed. UE took 32.9s. Estimated remaining: 25m 0s. Rate: 7.8 symbols/min [2025-10-24T00:18:35.126044] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:35.169126] [DEBUG] [LOCAL ] UHS: Loaded 39620 existing records from primary storage. [2025-10-24T00:18:35.169434] [INFO ] [MAIN ] UHS: Loaded 39620 existing records. [2025-10-24T00:18:35.346700] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:35.346897] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-24T00:18:35.346971] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-24T00:18:35.347578] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-24T00:18:35.347698] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-24T00:18:51.300583] [FATAL] [MAIN ] UHS: Failed to fetch primary data. [2025-10-24T00:18:51.300701] [WARN ] [MAIN ] UHS: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:18:51.300797] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-24T00:18:51.300918] [DEBUG] [LOCAL ] UHS: No primary data file found to delete. [2025-10-24T00:18:51.301017] [INFO ] [LOCAL ] UHS: Starting deletion of derivative data. [2025-10-24T00:18:51.301489] [DEBUG] [LOCAL ] UHS: Deleted derivative data file. [2025-10-24T00:18:51.301605] [INFO ] [MAIN ] Update Progress: 2173/2367 symbols completed. UHS took 16.3s. Estimated remaining: 24m 53s. Rate: 7.8 symbols/min [2025-10-24T00:18:51.519679] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:51.532800] [DEBUG] [LOCAL ] UHT: Loaded 10210 existing records from primary storage. [2025-10-24T00:18:51.533091] [INFO ] [MAIN ] UHT: Loaded 10210 existing records. [2025-10-24T00:18:51.708990] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:51.709210] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-24T00:18:51.709334] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-24T00:18:51.709591] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-24T00:18:51.709703] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-24T00:18:53.085461] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-24T00:18:53.467787] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-24T00:18:53.468014] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-24T00:18:53.468989] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-24T00:18:53.469078] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-24T00:18:53.470318] [DEBUG] [LOCAL ] UHAL: Trimmed 23449 records to 16970 (keeping 200 days of data) [2025-10-24T00:18:53.580291] [DEBUG] [LOCAL ] UHAL: Primary data saved (16970 records). [2025-10-24T00:18:53.580591] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-24T00:18:53.580774] [INFO ] [MAIN ] Update Progress: 2174/2367 symbols completed. UHAL took 26.7s. Estimated remaining: 24m 45s. Rate: 7.8 symbols/min [2025-10-24T00:18:53.753742] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:53.772237] [DEBUG] [LOCAL ] UI: Loaded 14196 existing records from primary storage. [2025-10-24T00:18:53.772528] [INFO ] [MAIN ] UI: Loaded 14196 existing records. [2025-10-24T00:18:53.956400] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:53.956599] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-24T00:18:53.956695] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-24T00:18:53.956932] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-24T00:18:53.957007] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-24T00:18:54.339639] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-24T00:18:54.755784] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-24T00:18:54.755896] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-24T00:18:54.757210] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-24T00:18:54.757293] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-24T00:18:54.758611] [DEBUG] [LOCAL ] UGP: Trimmed 62261 records to 43339 (keeping 200 days of data) [2025-10-24T00:18:55.033900] [DEBUG] [LOCAL ] UGP: Primary data saved (43339 records). [2025-10-24T00:18:55.034129] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-24T00:18:55.034379] [INFO ] [MAIN ] Update Progress: 2175/2367 symbols completed. UGP took 30.5s. Estimated remaining: 24m 37s. Rate: 7.8 symbols/min [2025-10-24T00:18:55.241368] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:55.296091] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-24T00:18:55.413607] [DEBUG] [LOCAL ] UIS: Loaded 36623 existing records from primary storage. [2025-10-24T00:18:55.424715] [INFO ] [MAIN ] UIS: Loaded 36623 existing records. [2025-10-24T00:18:55.803550] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:55.843964] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-24T00:18:55.864463] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-24T00:18:55.882076] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-24T00:18:55.882232] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-24T00:18:55.883472] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-24T00:18:55.883514] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-24T00:18:55.883682] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-24T00:18:55.883805] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-24T00:18:55.988140] [DEBUG] [LOCAL ] UGI: Trimmed 73444 records to 50834 (keeping 200 days of data) [2025-10-24T00:18:56.580952] [DEBUG] [LOCAL ] UGI: Primary data saved (50834 records). [2025-10-24T00:18:56.581156] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-24T00:18:56.581302] [INFO ] [MAIN ] Update Progress: 2176/2367 symbols completed. UGI took 34.1s. Estimated remaining: 24m 29s. Rate: 7.8 symbols/min [2025-10-24T00:18:56.751377] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:18:56.807893] [DEBUG] [LOCAL ] UL: Loaded 53069 existing records from primary storage. [2025-10-24T00:18:56.808307] [INFO ] [MAIN ] UL: Loaded 53069 existing records. [2025-10-24T00:18:56.981525] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:18:56.981780] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-24T00:18:56.981872] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-24T00:18:56.982425] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-24T00:18:56.982517] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-24T00:19:19.516940] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-24T00:19:19.871846] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-24T00:19:19.871982] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-24T00:19:19.872502] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-24T00:19:19.872600] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-24T00:19:19.873251] [DEBUG] [LOCAL ] UI: Trimmed 19800 records to 14283 (keeping 200 days of data) [2025-10-24T00:19:19.960311] [DEBUG] [LOCAL ] UI: Primary data saved (14283 records). [2025-10-24T00:19:19.960503] [INFO ] [MAIN ] UI: Full history saved. [2025-10-24T00:19:19.960662] [INFO ] [MAIN ] Update Progress: 2177/2367 symbols completed. UI took 26.4s. Estimated remaining: 24m 22s. Rate: 7.8 symbols/min [2025-10-24T00:19:20.130250] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:19:20.166001] [DEBUG] [LOCAL ] ULS: Loaded 38524 existing records from primary storage. [2025-10-24T00:19:20.166333] [INFO ] [MAIN ] ULS: Loaded 38524 existing records. [2025-10-24T00:19:20.345991] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:19:20.346321] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-24T00:19:20.346399] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-24T00:19:20.346618] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-24T00:19:20.346731] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-24T00:19:20.684995] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-24T00:19:21.211230] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-24T00:19:21.211366] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-24T00:19:21.212592] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-24T00:19:21.212703] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-24T00:19:21.214029] [DEBUG] [LOCAL ] UIS: Trimmed 52021 records to 36820 (keeping 200 days of data) [2025-10-24T00:19:21.437115] [DEBUG] [LOCAL ] UIS: Primary data saved (36820 records). [2025-10-24T00:19:21.437303] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-24T00:19:21.437430] [INFO ] [MAIN ] Update Progress: 2178/2367 symbols completed. UIS took 26.4s. Estimated remaining: 24m 14s. Rate: 7.8 symbols/min [2025-10-24T00:19:21.633175] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:19:21.683129] [DEBUG] [LOCAL ] UMC: Loaded 52671 existing records from primary storage. [2025-10-24T00:19:21.683490] [INFO ] [MAIN ] UMC: Loaded 52671 existing records. [2025-10-24T00:19:21.884744] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:19:21.884978] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-24T00:19:21.885093] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-24T00:19:21.885312] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-24T00:19:21.885386] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-24T00:19:22.314781] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-24T00:19:22.756512] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-24T00:19:22.756774] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-24T00:19:22.757334] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-24T00:19:22.757482] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-24T00:19:22.758402] [DEBUG] [LOCAL ] UHT: Trimmed 15055 records to 10280 (keeping 200 days of data) [2025-10-24T00:19:22.867387] [DEBUG] [LOCAL ] UHT: Primary data saved (10280 records). [2025-10-24T00:19:22.867518] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-24T00:19:22.867632] [INFO ] [MAIN ] Update Progress: 2179/2367 symbols completed. UHT took 31.6s. Estimated remaining: 24m 6s. Rate: 7.8 symbols/min [2025-10-24T00:19:23.034080] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:19:23.071561] [DEBUG] [LOCAL ] UMH: Loaded 34213 existing records from primary storage. [2025-10-24T00:19:23.071895] [INFO ] [MAIN ] UMH: Loaded 34213 existing records. [2025-10-24T00:19:23.245549] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:19:23.245990] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-24T00:19:23.246115] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-24T00:19:23.246329] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-24T00:19:23.246401] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-24T00:19:41.901569] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-24T00:19:42.296037] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-24T00:19:42.296149] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-24T00:19:42.297403] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-24T00:19:42.297486] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-24T00:19:42.298934] [DEBUG] [LOCAL ] UL: Trimmed 77082 records to 53459 (keeping 200 days of data) [2025-10-24T00:19:42.628755] [DEBUG] [LOCAL ] UL: Primary data saved (53459 records). [2025-10-24T00:19:42.629072] [INFO ] [MAIN ] UL: Full history saved. [2025-10-24T00:19:42.629206] [INFO ] [MAIN ] Update Progress: 2180/2367 symbols completed. UL took 46.0s. Estimated remaining: 23m 59s. Rate: 7.8 symbols/min [2025-10-24T00:19:42.847445] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:19:42.860143] [DEBUG] [LOCAL ] UNF: Loaded 11751 existing records from primary storage. [2025-10-24T00:19:42.860393] [INFO ] [MAIN ] UNF: Loaded 11751 existing records. [2025-10-24T00:19:43.036772] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:19:43.037143] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-24T00:19:43.037284] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-24T00:19:43.037565] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-24T00:19:43.037711] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-24T00:19:45.365287] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-24T00:19:45.757344] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-24T00:19:45.757483] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-24T00:19:45.758679] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-24T00:19:45.758786] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-24T00:19:45.760070] [DEBUG] [LOCAL ] ULS: Trimmed 53794 records to 38712 (keeping 200 days of data) [2025-10-24T00:19:46.017333] [DEBUG] [LOCAL ] ULS: Primary data saved (38712 records). [2025-10-24T00:19:46.017533] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-24T00:19:46.017687] [INFO ] [MAIN ] Update Progress: 2181/2367 symbols completed. ULS took 26.1s. Estimated remaining: 23m 51s. Rate: 7.8 symbols/min [2025-10-24T00:19:46.193786] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:19:46.230546] [DEBUG] [LOCAL ] UNFI: Loaded 42609 existing records from primary storage. [2025-10-24T00:19:46.230943] [INFO ] [MAIN ] UNFI: Loaded 42609 existing records. [2025-10-24T00:19:46.413842] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:19:46.414098] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-24T00:19:46.414193] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-24T00:19:46.415364] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-24T00:19:46.415441] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-24T00:19:47.934339] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-24T00:19:48.317582] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-24T00:19:48.317818] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-24T00:19:48.318808] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-24T00:19:48.318884] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-24T00:19:48.319862] [DEBUG] [LOCAL ] UMH: Trimmed 47448 records to 34448 (keeping 200 days of data) [2025-10-24T00:19:48.536587] [DEBUG] [LOCAL ] UMH: Primary data saved (34448 records). [2025-10-24T00:19:48.536954] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-24T00:19:48.537130] [INFO ] [MAIN ] Update Progress: 2182/2367 symbols completed. UMH took 25.7s. Estimated remaining: 23m 43s. Rate: 7.8 symbols/min [2025-10-24T00:19:48.739098] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:19:48.787375] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-24T00:19:48.787763] [INFO ] [MAIN ] UNH: Loaded 53819 existing records. [2025-10-24T00:19:48.968130] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:19:48.968350] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-24T00:19:48.968427] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-24T00:19:48.968697] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-24T00:19:48.968769] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-24T00:20:02.039950] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-24T00:20:02.468052] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-24T00:20:02.468493] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-24T00:20:02.470956] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-24T00:20:02.471414] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-24T00:20:02.473742] [DEBUG] [LOCAL ] UMC: Trimmed 76662 records to 53054 (keeping 200 days of data) [2025-10-24T00:20:02.820316] [DEBUG] [LOCAL ] UMC: Primary data saved (53054 records). [2025-10-24T00:20:02.820506] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-24T00:20:02.820626] [INFO ] [MAIN ] Update Progress: 2183/2367 symbols completed. UMC took 41.4s. Estimated remaining: 23m 36s. Rate: 7.8 symbols/min [2025-10-24T00:20:03.001200] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:03.042220] [DEBUG] [LOCAL ] UNM: Loaded 47961 existing records from primary storage. [2025-10-24T00:20:03.042579] [INFO ] [MAIN ] UNM: Loaded 47961 existing records. [2025-10-24T00:20:03.226274] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:03.227788] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-24T00:20:03.227953] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-24T00:20:03.228326] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-24T00:20:03.228418] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-24T00:20:08.198958] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-24T00:20:08.609600] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-24T00:20:08.609757] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-24T00:20:08.610326] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-24T00:20:08.610428] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-24T00:20:08.611180] [DEBUG] [LOCAL ] UNF: Trimmed 18100 records to 11947 (keeping 200 days of data) [2025-10-24T00:20:08.699145] [DEBUG] [LOCAL ] UNF: Primary data saved (11947 records). [2025-10-24T00:20:08.699322] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-24T00:20:08.699434] [INFO ] [MAIN ] Update Progress: 2184/2367 symbols completed. UNF took 26.1s. Estimated remaining: 23m 28s. Rate: 7.8 symbols/min [2025-10-24T00:20:08.867425] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:08.873317] [DEBUG] [LOCAL ] UNMA: Loaded 3413 existing records from primary storage. [2025-10-24T00:20:08.873939] [INFO ] [MAIN ] UNMA: Loaded 3413 existing records. [2025-10-24T00:20:09.108563] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:09.108763] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-24T00:20:09.108840] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-24T00:20:09.109009] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-24T00:20:09.109096] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-24T00:20:14.391301] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-24T00:20:14.834421] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-24T00:20:14.851099] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-24T00:20:14.852904] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-24T00:20:14.853802] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-24T00:20:14.855608] [DEBUG] [LOCAL ] UNFI: Trimmed 59887 records to 42908 (keeping 200 days of data) [2025-10-24T00:20:15.110751] [DEBUG] [LOCAL ] UNFI: Primary data saved (42908 records). [2025-10-24T00:20:15.113005] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-24T00:20:15.113122] [INFO ] [MAIN ] Update Progress: 2185/2367 symbols completed. UNFI took 29.1s. Estimated remaining: 23m 20s. Rate: 7.8 symbols/min [2025-10-24T00:20:15.313396] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:15.402316] [DEBUG] [LOCAL ] UNP: Loaded 53362 existing records from primary storage. [2025-10-24T00:20:15.402781] [INFO ] [MAIN ] UNP: Loaded 53362 existing records. [2025-10-24T00:20:15.596693] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:15.596934] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-24T00:20:15.597019] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-24T00:20:15.597300] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-24T00:20:15.597417] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-24T00:20:28.563398] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-24T00:20:28.929362] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-24T00:20:28.929470] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-24T00:20:28.929679] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-24T00:20:28.929755] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-24T00:20:28.930152] [DEBUG] [LOCAL ] UNMA: Trimmed 5412 records to 3427 (keeping 200 days of data) [2025-10-24T00:20:28.950334] [DEBUG] [LOCAL ] UNMA: Primary data saved (3427 records). [2025-10-24T00:20:28.950434] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-24T00:20:28.950538] [INFO ] [MAIN ] Update Progress: 2186/2367 symbols completed. UNMA took 20.3s. Estimated remaining: 23m 13s. Rate: 7.8 symbols/min [2025-10-24T00:20:29.136320] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:29.176517] [DEBUG] [LOCAL ] UP: Loaded 44436 existing records from primary storage. [2025-10-24T00:20:29.176940] [INFO ] [MAIN ] UP: Loaded 44436 existing records. [2025-10-24T00:20:29.367117] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:29.367421] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-24T00:20:29.367682] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-24T00:20:29.368019] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-24T00:20:29.368122] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-24T00:20:34.561086] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-24T00:20:34.964476] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-24T00:20:34.964677] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-24T00:20:34.966147] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-24T00:20:34.966268] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-24T00:20:34.968016] [DEBUG] [LOCAL ] UNH: Trimmed 77960 records to 54209 (keeping 200 days of data) [2025-10-24T00:20:35.357266] [DEBUG] [LOCAL ] UNH: Primary data saved (54209 records). [2025-10-24T00:20:35.357430] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-24T00:20:35.357544] [INFO ] [MAIN ] Update Progress: 2187/2367 symbols completed. UNH took 46.8s. Estimated remaining: 23m 5s. Rate: 7.8 symbols/min [2025-10-24T00:20:35.521969] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:35.570386] [DEBUG] [LOCAL ] UPS: Loaded 53721 existing records from primary storage. [2025-10-24T00:20:35.570736] [INFO ] [MAIN ] UPS: Loaded 53721 existing records. [2025-10-24T00:20:35.745008] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:35.745305] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-24T00:20:35.745379] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-24T00:20:35.745598] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-24T00:20:35.745705] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-24T00:20:40.811978] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-24T00:20:41.193437] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-24T00:20:41.193555] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-24T00:20:41.194843] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-24T00:20:41.194923] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-24T00:20:41.196324] [DEBUG] [LOCAL ] UNM: Trimmed 69947 records to 48281 (keeping 200 days of data) [2025-10-24T00:20:41.493491] [DEBUG] [LOCAL ] UNM: Primary data saved (48281 records). [2025-10-24T00:20:41.493787] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-24T00:20:41.493902] [INFO ] [MAIN ] Update Progress: 2188/2367 symbols completed. UNM took 38.7s. Estimated remaining: 22m 57s. Rate: 7.8 symbols/min [2025-10-24T00:20:41.666170] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:41.699179] [DEBUG] [LOCAL ] URI: Loaded 34264 existing records from primary storage. [2025-10-24T00:20:41.699570] [INFO ] [MAIN ] URI: Loaded 34264 existing records. [2025-10-24T00:20:41.884984] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:41.885245] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-24T00:20:41.885395] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-24T00:20:41.885705] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-24T00:20:41.885778] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-24T00:20:46.679813] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-24T00:20:47.126083] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-24T00:20:47.126399] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-24T00:20:47.128179] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-24T00:20:47.128261] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-24T00:20:47.129620] [DEBUG] [LOCAL ] UNP: Trimmed 77146 records to 53752 (keeping 200 days of data) [2025-10-24T00:20:47.464212] [DEBUG] [LOCAL ] UNP: Primary data saved (53752 records). [2025-10-24T00:20:47.464383] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-24T00:20:47.465155] [INFO ] [MAIN ] Update Progress: 2189/2367 symbols completed. UNP took 32.4s. Estimated remaining: 22m 50s. Rate: 7.8 symbols/min [2025-10-24T00:20:47.641334] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:47.703240] [DEBUG] [LOCAL ] USA: Loaded 36378 existing records from primary storage. [2025-10-24T00:20:47.703548] [INFO ] [MAIN ] USA: Loaded 36378 existing records. [2025-10-24T00:20:47.883413] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:47.883696] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-24T00:20:47.883773] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-24T00:20:47.884003] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-24T00:20:47.884077] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-24T00:20:58.869293] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-24T00:20:59.254822] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-24T00:20:59.254930] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-24T00:20:59.256216] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-24T00:20:59.256296] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-24T00:20:59.257767] [DEBUG] [LOCAL ] UP: Trimmed 63044 records to 44786 (keeping 200 days of data) [2025-10-24T00:20:59.501070] [DEBUG] [LOCAL ] UP: Primary data saved (44786 records). [2025-10-24T00:20:59.501226] [INFO ] [MAIN ] UP: Full history saved. [2025-10-24T00:20:59.501359] [INFO ] [MAIN ] Update Progress: 2190/2367 symbols completed. UP took 30.6s. Estimated remaining: 22m 42s. Rate: 7.8 symbols/min [2025-10-24T00:20:59.675921] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:20:59.697122] [DEBUG] [LOCAL ] USAC: Loaded 21590 existing records from primary storage. [2025-10-24T00:20:59.697390] [INFO ] [MAIN ] USAC: Loaded 21590 existing records. [2025-10-24T00:20:59.875209] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:20:59.875414] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-24T00:20:59.875489] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-24T00:20:59.875883] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-24T00:20:59.875958] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-24T00:21:06.711002] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-24T00:21:07.116253] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-24T00:21:07.116365] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-24T00:21:07.117435] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-24T00:21:07.117515] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-24T00:21:07.118584] [DEBUG] [LOCAL ] URI: Trimmed 52702 records to 34614 (keeping 200 days of data) [2025-10-24T00:21:07.343738] [DEBUG] [LOCAL ] URI: Primary data saved (34614 records). [2025-10-24T00:21:07.343932] [INFO ] [MAIN ] URI: Full history saved. [2025-10-24T00:21:07.344077] [INFO ] [MAIN ] Update Progress: 2191/2367 symbols completed. URI took 25.9s. Estimated remaining: 22m 35s. Rate: 7.8 symbols/min [2025-10-24T00:21:07.535834] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:21:07.585508] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-24T00:21:07.604048] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-24T00:21:07.808896] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:21:07.809105] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-24T00:21:07.809181] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-24T00:21:07.809408] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-24T00:21:07.809483] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-24T00:21:13.390416] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-24T00:21:13.833616] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-24T00:21:13.833763] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-24T00:21:13.835086] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-24T00:21:13.835165] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-24T00:21:13.836595] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 54111 (keeping 200 days of data) [2025-10-24T00:21:14.191041] [DEBUG] [LOCAL ] UPS: Primary data saved (54111 records). [2025-10-24T00:21:14.191208] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-24T00:21:14.192682] [INFO ] [MAIN ] Update Progress: 2192/2367 symbols completed. UPS took 38.8s. Estimated remaining: 22m 27s. Rate: 7.8 symbols/min [2025-10-24T00:21:14.358620] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:21:14.410890] [DEBUG] [LOCAL ] USFD: Loaded 51132 existing records from primary storage. [2025-10-24T00:21:14.411173] [INFO ] [MAIN ] USFD: Loaded 51132 existing records. [2025-10-24T00:21:14.591755] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:21:14.592018] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-24T00:21:14.592094] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-24T00:21:14.592324] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-24T00:21:14.592398] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-24T00:21:15.254432] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-24T00:21:15.632739] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-24T00:21:15.632859] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-24T00:21:15.633917] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-24T00:21:15.633997] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-24T00:21:15.635191] [DEBUG] [LOCAL ] USA: Trimmed 52532 records to 36639 (keeping 200 days of data) [2025-10-24T00:21:15.844845] [DEBUG] [LOCAL ] USA: Primary data saved (36639 records). [2025-10-24T00:21:15.845052] [INFO ] [MAIN ] USA: Full history saved. [2025-10-24T00:21:15.845174] [INFO ] [MAIN ] Update Progress: 2193/2367 symbols completed. USA took 28.4s. Estimated remaining: 22m 19s. Rate: 7.8 symbols/min [2025-10-24T00:21:16.013005] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:21:16.032329] [DEBUG] [LOCAL ] USNA: Loaded 17995 existing records from primary storage. [2025-10-24T00:21:16.032596] [INFO ] [MAIN ] USNA: Loaded 17995 existing records. [2025-10-24T00:21:16.208559] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:21:16.208807] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-24T00:21:16.208881] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-24T00:21:16.209069] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-24T00:21:16.209140] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-24T00:21:35.417268] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-24T00:21:35.832537] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-24T00:21:35.832661] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-24T00:21:35.833391] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-24T00:21:35.833465] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-24T00:21:35.834277] [DEBUG] [LOCAL ] USAC: Trimmed 35291 records to 21803 (keeping 200 days of data) [2025-10-24T00:21:35.961505] [DEBUG] [LOCAL ] USAC: Primary data saved (21803 records). [2025-10-24T00:21:35.961717] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-24T00:21:35.961879] [INFO ] [MAIN ] Update Progress: 2194/2367 symbols completed. USAC took 36.5s. Estimated remaining: 22m 12s. Rate: 7.8 symbols/min [2025-10-24T00:21:36.150294] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:21:36.147913] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-24T00:21:36.322523] [DEBUG] [LOCAL ] USPH: Loaded 17006 existing records from primary storage. [2025-10-24T00:21:36.354723] [INFO ] [MAIN ] USPH: Loaded 17006 existing records. [2025-10-24T00:21:36.697851] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-24T00:21:36.717849] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:21:36.717919] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-24T00:21:36.718669] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-24T00:21:36.718787] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-24T00:21:36.718885] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-24T00:21:36.719002] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-24T00:21:36.719389] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-24T00:21:36.719636] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-24T00:21:36.751172] [DEBUG] [LOCAL ] USNA: Trimmed 27221 records to 18214 (keeping 200 days of data) [2025-10-24T00:21:37.132231] [DEBUG] [LOCAL ] USNA: Primary data saved (18214 records). [2025-10-24T00:21:37.155504] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-24T00:21:37.168704] [INFO ] [MAIN ] Update Progress: 2195/2367 symbols completed. USNA took 21.3s. Estimated remaining: 22m 4s. Rate: 7.8 symbols/min [2025-10-24T00:21:37.361752] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:21:37.391204] [DEBUG] [LOCAL ] UTF: Loaded 30943 existing records from primary storage. [2025-10-24T00:21:37.391529] [INFO ] [MAIN ] UTF: Loaded 30943 existing records. [2025-10-24T00:21:37.588687] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:21:37.588904] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-24T00:21:37.589002] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-24T00:21:37.589270] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-24T00:21:37.589346] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-24T00:21:37.981480] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-24T00:21:38.368982] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-24T00:21:38.369147] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-24T00:21:38.370486] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-24T00:21:38.370563] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-24T00:21:38.372007] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 54078 (keeping 200 days of data) [2025-10-24T00:21:38.766263] [DEBUG] [LOCAL ] USB: Primary data saved (54078 records). [2025-10-24T00:21:38.766396] [INFO ] [MAIN ] USB: Full history saved. [2025-10-24T00:21:38.766499] [INFO ] [MAIN ] Update Progress: 2196/2367 symbols completed. USB took 31.4s. Estimated remaining: 21m 56s. Rate: 7.8 symbols/min [2025-10-24T00:21:38.934588] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:21:38.934789] [DEBUG] [LOCAL ] UTI: No existing data file found in primary storage. [2025-10-24T00:21:38.934860] [WARN ] [MAIN ] UTI: No existing data found, performing full refresh instead. [2025-10-24T00:21:38.934976] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-24T00:21:38.935055] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-24T00:21:38.935139] [DEBUG] [LOCAL ] UTI: No primary data file found to delete. [2025-10-24T00:21:38.935211] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-24T00:21:58.569910] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-24T00:21:58.982471] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-24T00:21:58.982608] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-24T00:21:58.983888] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-24T00:21:58.983970] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-24T00:21:58.985423] [DEBUG] [LOCAL ] USFD: Trimmed 74341 records to 51509 (keeping 200 days of data) [2025-10-24T00:21:59.290007] [DEBUG] [LOCAL ] USFD: Primary data saved (51509 records). [2025-10-24T00:21:59.290191] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-24T00:21:59.291554] [INFO ] [MAIN ] Update Progress: 2197/2367 symbols completed. USFD took 45.1s. Estimated remaining: 21m 49s. Rate: 7.8 symbols/min [2025-10-24T00:22:04.011006] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-24T00:22:04.378888] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-24T00:22:04.379003] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-24T00:22:04.379938] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-24T00:22:04.380018] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-24T00:22:04.381066] [DEBUG] [LOCAL ] UTF: Trimmed 43927 records to 31254 (keeping 200 days of data) [2025-10-24T00:22:04.572257] [DEBUG] [LOCAL ] UTF: Primary data saved (31254 records). [2025-10-24T00:22:04.572424] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-24T00:22:04.572537] [INFO ] [MAIN ] Update Progress: 2198/2367 symbols completed. UTF took 27.4s. Estimated remaining: 21m 41s. Rate: 7.8 symbols/min [2025-10-24T00:22:05.041686] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-24T00:22:05.404438] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-24T00:22:05.404549] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-24T00:22:05.405122] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-24T00:22:05.405199] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-24T00:22:05.405837] [DEBUG] [LOCAL ] USPH: Trimmed 22972 records to 17083 (keeping 200 days of data) [2025-10-24T00:22:05.511200] [DEBUG] [LOCAL ] USPH: Primary data saved (17083 records). [2025-10-24T00:22:05.511424] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-24T00:22:05.511584] [INFO ] [MAIN ] Update Progress: 2199/2367 symbols completed. USPH took 29.5s. Estimated remaining: 21m 33s. Rate: 7.8 symbols/min [2025-10-24T00:22:07.861896] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-24T00:22:08.241461] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-24T00:22:08.241573] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-24T00:22:08.242710] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-24T00:22:08.242787] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-24T00:22:08.243914] [DEBUG] [LOCAL ] UTI: Trimmed 58946 records to 40647 (keeping 200 days of data) [2025-10-24T00:22:08.471981] [DEBUG] [LOCAL ] UTI: Primary data saved (40647 records). [2025-10-24T00:22:08.472133] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-24T00:22:08.472231] [INFO ] [MAIN ] Update Progress: 2200/2367 symbols completed. UTI took 29.7s. Estimated remaining: 21m 25s. Rate: 7.8 symbols/min [2025-10-24T00:22:09.076556] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:09.150622] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:09.204349] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:09.201896] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:09.224964] [DEBUG] [LOCAL ] UTL: Loaded 11858 existing records from primary storage. [2025-10-24T00:22:09.229911] [INFO ] [MAIN ] UTL: Loaded 11858 existing records. [2025-10-24T00:22:09.339864] [DEBUG] [LOCAL ] UVE: Loaded 21957 existing records from primary storage. [2025-10-24T00:22:09.368805] [DEBUG] [LOCAL ] UVV: Loaded 22770 existing records from primary storage. [2025-10-24T00:22:09.369563] [INFO ] [MAIN ] UVV: Loaded 22770 existing records. [2025-10-24T00:22:09.390598] [INFO ] [MAIN ] UVE: Loaded 21957 existing records. [2025-10-24T00:22:09.594939] [DEBUG] [LOCAL ] UTZ: Loaded 44265 existing records from primary storage. [2025-10-24T00:22:09.660599] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:09.676847] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-24T00:22:09.656139] [INFO ] [MAIN ] UTZ: Loaded 44265 existing records. [2025-10-24T00:22:09.709549] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-24T00:22:09.784754] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:09.860480] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-24T00:22:09.860626] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-24T00:22:09.860749] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-24T00:22:09.882832] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-24T00:22:09.897782] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-24T00:22:09.925784] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-24T00:22:09.925622] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:09.937790] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-24T00:22:10.027688] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-24T00:22:10.101068] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-24T00:22:10.122958] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:10.131903] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-24T00:22:10.119818] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-24T00:22:10.132006] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-24T00:22:10.233409] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-24T00:22:10.344365] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-24T00:22:28.131517] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-24T00:22:28.500387] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-24T00:22:28.500491] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-24T00:22:28.500872] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-24T00:22:28.500960] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-24T00:22:28.501516] [DEBUG] [LOCAL ] UTL: Trimmed 15852 records to 11902 (keeping 200 days of data) [2025-10-24T00:22:28.571091] [DEBUG] [LOCAL ] UTL: Primary data saved (11902 records). [2025-10-24T00:22:28.571241] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-24T00:22:28.571355] [INFO ] [MAIN ] Update Progress: 2201/2367 symbols completed. UTL took 20.1s. Estimated remaining: 21m 18s. Rate: 7.8 symbols/min [2025-10-24T00:22:28.738180] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:28.789280] [DEBUG] [LOCAL ] UWMC: Loaded 52960 existing records from primary storage. [2025-10-24T00:22:28.789672] [INFO ] [MAIN ] UWMC: Loaded 52960 existing records. [2025-10-24T00:22:28.967030] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:28.967221] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-24T00:22:28.967299] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-24T00:22:28.967549] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-24T00:22:28.967622] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-24T00:22:33.861801] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-24T00:22:34.229915] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-24T00:22:34.230025] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-24T00:22:34.230694] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-24T00:22:34.230781] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-24T00:22:34.231490] [DEBUG] [LOCAL ] UVV: Trimmed 30204 records to 22875 (keeping 200 days of data) [2025-10-24T00:22:34.365927] [DEBUG] [LOCAL ] UVV: Primary data saved (22875 records). [2025-10-24T00:22:34.366073] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-24T00:22:34.366199] [INFO ] [MAIN ] Update Progress: 2202/2367 symbols completed. UVV took 25.9s. Estimated remaining: 21m 10s. Rate: 7.8 symbols/min [2025-10-24T00:22:34.542135] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:34.549682] [DEBUG] [LOCAL ] UZD: Loaded 5801 existing records from primary storage. [2025-10-24T00:22:34.549876] [INFO ] [MAIN ] UZD: Loaded 5801 existing records. [2025-10-24T00:22:34.720471] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:34.720704] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-24T00:22:34.720780] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-24T00:22:34.720952] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-24T00:22:34.721023] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-24T00:22:40.245542] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-24T00:22:40.611553] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-24T00:22:40.611687] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-24T00:22:40.612338] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-24T00:22:40.612413] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-24T00:22:40.613218] [DEBUG] [LOCAL ] UVE: Trimmed 30330 records to 22079 (keeping 200 days of data) [2025-10-24T00:22:40.744439] [DEBUG] [LOCAL ] UVE: Primary data saved (22079 records). [2025-10-24T00:22:40.744610] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-24T00:22:40.744746] [INFO ] [MAIN ] Update Progress: 2203/2367 symbols completed. UVE took 32.3s. Estimated remaining: 21m 2s. Rate: 7.8 symbols/min [2025-10-24T00:22:40.913754] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:40.923065] [DEBUG] [LOCAL ] UZE: Loaded 6947 existing records from primary storage. [2025-10-24T00:22:40.923306] [INFO ] [MAIN ] UZE: Loaded 6947 existing records. [2025-10-24T00:22:41.096564] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:22:41.096766] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-24T00:22:41.096841] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-24T00:22:41.097012] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-24T00:22:41.097088] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-24T00:22:43.107744] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-24T00:22:43.501220] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-24T00:22:43.501337] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-24T00:22:43.502499] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-24T00:22:43.502579] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-24T00:22:43.503877] [DEBUG] [LOCAL ] UTZ: Trimmed 64441 records to 44488 (keeping 200 days of data) [2025-10-24T00:22:43.773562] [DEBUG] [LOCAL ] UTZ: Primary data saved (44488 records). [2025-10-24T00:22:43.773734] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-24T00:22:43.773846] [INFO ] [MAIN ] Update Progress: 2204/2367 symbols completed. UTZ took 35.3s. Estimated remaining: 20m 54s. Rate: 7.8 symbols/min [2025-10-24T00:22:43.940702] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:22:43.940894] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-24T00:22:43.940968] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-24T00:22:43.941076] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-24T00:22:43.941145] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-24T00:22:43.941223] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-24T00:22:43.941290] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-24T00:23:05.621782] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-24T00:23:06.010324] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-24T00:23:06.013061] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-24T00:23:06.016694] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-24T00:23:06.016903] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-24T00:23:06.018353] [DEBUG] [LOCAL ] UZE: Trimmed 9743 records to 6952 (keeping 200 days of data) [2025-10-24T00:23:06.094345] [DEBUG] [LOCAL ] UZE: Primary data saved (6952 records). [2025-10-24T00:23:06.097428] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-24T00:23:06.098167] [INFO ] [MAIN ] Update Progress: 2205/2367 symbols completed. UZE took 25.4s. Estimated remaining: 20m 48s. Rate: 7.8 symbols/min [2025-10-24T00:23:06.286541] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:06.337013] [DEBUG] [LOCAL ] V: Loaded 53751 existing records from primary storage. [2025-10-24T00:23:06.337352] [INFO ] [MAIN ] V: Loaded 53751 existing records. [2025-10-24T00:23:06.521341] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:06.521693] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-24T00:23:06.521773] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-24T00:23:06.522734] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-24T00:23:06.522810] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-24T00:23:06.972364] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-24T00:23:07.358384] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-24T00:23:07.358491] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-24T00:23:07.358781] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-24T00:23:07.358860] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-24T00:23:07.359349] [DEBUG] [LOCAL ] UZD: Trimmed 8823 records to 5805 (keeping 200 days of data) [2025-10-24T00:23:07.394637] [DEBUG] [LOCAL ] UZD: Primary data saved (5805 records). [2025-10-24T00:23:07.394805] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-24T00:23:07.394916] [INFO ] [MAIN ] Update Progress: 2206/2367 symbols completed. UZD took 33.0s. Estimated remaining: 20m 39s. Rate: 7.8 symbols/min [2025-10-24T00:23:07.593904] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:07.627565] [DEBUG] [LOCAL ] VAC: Loaded 33667 existing records from primary storage. [2025-10-24T00:23:07.627901] [INFO ] [MAIN ] VAC: Loaded 33667 existing records. [2025-10-24T00:23:07.809971] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:07.810179] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-24T00:23:07.810259] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-24T00:23:07.810511] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-24T00:23:07.810586] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-24T00:23:12.486403] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-24T00:23:12.662690] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-24T00:23:12.663091] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-24T00:23:12.663166] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-24T00:23:12.663241] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-24T00:23:12.663337] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-24T00:23:12.663410] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-24T00:23:12.663513] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-24T00:23:12.663606] [INFO ] [MAIN ] Update Progress: 2207/2367 symbols completed. UZF took 28.9s. Estimated remaining: 20m 32s. Rate: 7.8 symbols/min [2025-10-24T00:23:12.841944] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:12.880044] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-24T00:23:13.191351] [DEBUG] [LOCAL ] VAL: Loaded 49858 existing records from primary storage. [2025-10-24T00:23:13.227442] [INFO ] [MAIN ] VAL: Loaded 49858 existing records. [2025-10-24T00:23:13.483605] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-24T00:23:13.493536] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-24T00:23:13.495318] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-24T00:23:13.510449] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-24T00:23:13.516089] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:13.516876] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-24T00:23:13.517002] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-24T00:23:13.517475] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-24T00:23:13.517793] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-24T00:23:13.517562] [DEBUG] [LOCAL ] UWMC: Trimmed 75931 records to 53348 (keeping 200 days of data) [2025-10-24T00:23:14.207446] [DEBUG] [LOCAL ] UWMC: Primary data saved (53348 records). [2025-10-24T00:23:14.207666] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-24T00:23:14.209331] [INFO ] [MAIN ] Update Progress: 2208/2367 symbols completed. UWMC took 45.6s. Estimated remaining: 20m 23s. Rate: 7.8 symbols/min [2025-10-24T00:23:14.379573] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:14.458785] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-24T00:23:14.459146] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-24T00:23:14.641253] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:14.641472] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-24T00:23:14.641553] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-24T00:23:14.641809] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-24T00:23:14.641884] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-24T00:23:35.614204] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-24T00:23:36.001836] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-24T00:23:36.002062] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-24T00:23:36.003291] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-24T00:23:36.003720] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-24T00:23:36.005685] [DEBUG] [LOCAL ] VAC: Trimmed 48757 records to 33922 (keeping 200 days of data) [2025-10-24T00:23:36.210598] [DEBUG] [LOCAL ] VAC: Primary data saved (33922 records). [2025-10-24T00:23:36.210787] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-24T00:23:36.210902] [INFO ] [MAIN ] Update Progress: 2209/2367 symbols completed. VAC took 28.8s. Estimated remaining: 20m 17s. Rate: 7.8 symbols/min [2025-10-24T00:23:36.381746] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:36.388999] [DEBUG] [LOCAL ] VATE: Loaded 5039 existing records from primary storage. [2025-10-24T00:23:36.389226] [INFO ] [MAIN ] VATE: Loaded 5039 existing records. [2025-10-24T00:23:36.567861] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:36.568081] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-24T00:23:36.568158] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-24T00:23:36.568333] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-24T00:23:36.568406] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-24T00:23:43.733954] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-24T00:23:44.224065] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-24T00:23:44.225530] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-24T00:23:44.235408] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-24T00:23:44.235603] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-24T00:23:44.235979] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-24T00:23:44.340438] [DEBUG] [LOCAL ] V: Trimmed 77925 records to 54139 (keeping 200 days of data) [2025-10-24T00:23:44.768973] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-24T00:23:44.770670] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-24T00:23:44.772387] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-24T00:23:44.772809] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-24T00:23:44.844847] [DEBUG] [LOCAL ] VAL: Trimmed 72930 records to 50242 (keeping 200 days of data) [2025-10-24T00:23:45.251829] [DEBUG] [LOCAL ] V: Primary data saved (54139 records). [2025-10-24T00:23:45.253039] [INFO ] [MAIN ] V: Full history saved. [2025-10-24T00:23:45.256510] [INFO ] [MAIN ] Update Progress: 2210/2367 symbols completed. V took 39.2s. Estimated remaining: 20m 9s. Rate: 7.8 symbols/min [2025-10-24T00:23:45.479335] [DEBUG] [LOCAL ] VAL: Primary data saved (50242 records). [2025-10-24T00:23:45.496160] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-24T00:23:45.521725] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-24T00:23:45.542589] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:45.539615] [INFO ] [MAIN ] Update Progress: 2211/2367 symbols completed. VAL took 32.9s. Estimated remaining: 20m 1s. Rate: 7.8 symbols/min [2025-10-24T00:23:45.751479] [DEBUG] [LOCAL ] VBF: Loaded 7200 existing records from primary storage. [2025-10-24T00:23:45.820563] [INFO ] [MAIN ] VBF: Loaded 7200 existing records. [2025-10-24T00:23:46.012473] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:46.273904] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:46.302862] [DEBUG] [LOCAL ] VCV: Loaded 13198 existing records from primary storage. [2025-10-24T00:23:46.354473] [INFO ] [MAIN ] VCV: Loaded 13198 existing records. [2025-10-24T00:23:46.350432] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-24T00:23:46.354786] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-24T00:23:46.354952] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-24T00:23:46.354682] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-24T00:23:46.356323] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-24T00:23:46.356423] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-24T00:23:46.356568] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-24T00:23:46.356625] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-24T00:23:46.595949] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 54083 (keeping 200 days of data) [2025-10-24T00:23:46.870363] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:46.912069] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-24T00:23:46.937467] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-24T00:23:46.962986] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-24T00:23:46.974295] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-24T00:23:47.609831] [DEBUG] [LOCAL ] VALE: Primary data saved (54083 records). [2025-10-24T00:23:47.630191] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-24T00:23:47.647487] [INFO ] [MAIN ] Update Progress: 2212/2367 symbols completed. VALE took 33.4s. Estimated remaining: 19m 53s. Rate: 7.8 symbols/min [2025-10-24T00:23:47.826015] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:47.873256] [DEBUG] [LOCAL ] VEEV: Loaded 47109 existing records from primary storage. [2025-10-24T00:23:47.873567] [INFO ] [MAIN ] VEEV: Loaded 47109 existing records. [2025-10-24T00:23:48.057204] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:48.057416] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-24T00:23:48.057491] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-24T00:23:48.057764] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-24T00:23:48.057838] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-24T00:23:58.212717] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-24T00:23:58.583395] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-24T00:23:58.583508] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-24T00:23:58.583804] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-24T00:23:58.583881] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-24T00:23:58.584349] [DEBUG] [LOCAL ] VATE: Trimmed 10652 records to 5078 (keeping 200 days of data) [2025-10-24T00:23:58.611472] [DEBUG] [LOCAL ] VATE: Primary data saved (5078 records). [2025-10-24T00:23:58.611597] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-24T00:23:58.611731] [INFO ] [MAIN ] Update Progress: 2213/2367 symbols completed. VATE took 22.4s. Estimated remaining: 19m 45s. Rate: 7.8 symbols/min [2025-10-24T00:23:58.775402] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:23:58.788666] [DEBUG] [LOCAL ] VEL: Loaded 11927 existing records from primary storage. [2025-10-24T00:23:58.788915] [INFO ] [MAIN ] VEL: Loaded 11927 existing records. [2025-10-24T00:23:58.960254] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:23:58.960480] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-24T00:23:58.960553] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-24T00:23:58.960766] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-24T00:23:58.960844] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-24T00:24:13.641147] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-24T00:24:14.055104] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-24T00:24:14.055230] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-24T00:24:14.055557] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-24T00:24:14.055637] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-24T00:24:14.056198] [DEBUG] [LOCAL ] VBF: Trimmed 10928 records to 7227 (keeping 200 days of data) [2025-10-24T00:24:14.100265] [DEBUG] [LOCAL ] VBF: Primary data saved (7227 records). [2025-10-24T00:24:14.100459] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-24T00:24:14.100597] [INFO ] [MAIN ] Update Progress: 2214/2367 symbols completed. VBF took 28.8s. Estimated remaining: 19m 38s. Rate: 7.8 symbols/min [2025-10-24T00:24:14.270693] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:24:14.309970] [DEBUG] [LOCAL ] VET: Loaded 44082 existing records from primary storage. [2025-10-24T00:24:14.310296] [INFO ] [MAIN ] VET: Loaded 44082 existing records. [2025-10-24T00:24:14.490085] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:24:14.490330] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-24T00:24:14.490411] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-24T00:24:14.490674] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-24T00:24:14.490752] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-24T00:24:21.597496] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-24T00:24:21.965518] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-24T00:24:21.965632] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-24T00:24:21.966073] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-24T00:24:21.966156] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-24T00:24:21.966772] [DEBUG] [LOCAL ] VEL: Trimmed 17192 records to 11991 (keeping 200 days of data) [2025-10-24T00:24:22.034625] [DEBUG] [LOCAL ] VEL: Primary data saved (11991 records). [2025-10-24T00:24:22.034815] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-24T00:24:22.034932] [INFO ] [MAIN ] Update Progress: 2215/2367 symbols completed. VEL took 23.4s. Estimated remaining: 19m 31s. Rate: 7.8 symbols/min [2025-10-24T00:24:22.198514] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:24:22.251636] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-24T00:24:22.252023] [INFO ] [MAIN ] VFC: Loaded 53607 existing records. [2025-10-24T00:24:22.429126] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:24:22.430936] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-24T00:24:22.431023] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-24T00:24:22.431352] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-24T00:24:22.431431] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-24T00:24:24.953229] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-24T00:24:25.364423] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-24T00:24:25.364607] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-24T00:24:25.365856] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-24T00:24:25.365938] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-24T00:24:25.367397] [DEBUG] [LOCAL ] VEEV: Trimmed 68390 records to 47474 (keeping 200 days of data) [2025-10-24T00:24:25.652951] [DEBUG] [LOCAL ] VEEV: Primary data saved (47474 records). [2025-10-24T00:24:25.653091] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-24T00:24:25.654435] [INFO ] [MAIN ] Update Progress: 2216/2367 symbols completed. VEEV took 38.0s. Estimated remaining: 19m 23s. Rate: 7.8 symbols/min [2025-10-24T00:24:25.826345] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:24:25.834707] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-24T00:24:25.834958] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-24T00:24:25.836700] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-24T00:24:25.838306] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-24T00:24:25.841956] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-24T00:24:25.842152] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-24T00:24:27.910715] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-24T00:24:28.269541] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-24T00:24:28.269684] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-24T00:24:28.270109] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-24T00:24:28.270202] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-24T00:24:28.270812] [DEBUG] [LOCAL ] VCV: Trimmed 18329 records to 13232 (keeping 200 days of data) [2025-10-24T00:24:28.346594] [DEBUG] [LOCAL ] VCV: Primary data saved (13232 records). [2025-10-24T00:24:28.346776] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-24T00:24:28.346905] [INFO ] [MAIN ] Update Progress: 2217/2367 symbols completed. VCV took 42.8s. Estimated remaining: 19m 15s. Rate: 7.8 symbols/min [2025-10-24T00:24:28.511906] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:24:28.519194] [DEBUG] [LOCAL ] VGI: Loaded 5213 existing records from primary storage. [2025-10-24T00:24:28.519437] [INFO ] [MAIN ] VGI: Loaded 5213 existing records. [2025-10-24T00:24:28.695348] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:24:28.695564] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-24T00:24:28.695638] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-24T00:24:28.695829] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-24T00:24:28.695896] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-24T00:24:44.848781] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-24T00:24:45.247833] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-24T00:24:45.247949] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-24T00:24:45.249154] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-24T00:24:45.249233] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-24T00:24:45.250480] [DEBUG] [LOCAL ] VET: Trimmed 64502 records to 44405 (keeping 200 days of data) [2025-10-24T00:24:45.509129] [DEBUG] [LOCAL ] VET: Primary data saved (44405 records). [2025-10-24T00:24:45.509294] [INFO ] [MAIN ] VET: Full history saved. [2025-10-24T00:24:45.509444] [INFO ] [MAIN ] Update Progress: 2218/2367 symbols completed. VET took 31.4s. Estimated remaining: 19m 7s. Rate: 7.8 symbols/min [2025-10-24T00:24:45.689483] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:24:45.707905] [DEBUG] [LOCAL ] VGM: Loaded 18643 existing records from primary storage. [2025-10-24T00:24:45.708341] [INFO ] [MAIN ] VGM: Loaded 18643 existing records. [2025-10-24T00:24:45.884775] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:24:45.885154] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-24T00:24:45.885310] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-24T00:24:45.885536] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-24T00:24:45.885698] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-24T00:24:50.031947] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-24T00:24:50.438074] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-24T00:24:50.438164] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-24T00:24:50.438386] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-24T00:24:50.438459] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-24T00:24:50.438932] [DEBUG] [LOCAL ] VGI: Trimmed 7568 records to 5240 (keeping 200 days of data) [2025-10-24T00:24:50.468675] [DEBUG] [LOCAL ] VGI: Primary data saved (5240 records). [2025-10-24T00:24:50.468777] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-24T00:24:50.468883] [INFO ] [MAIN ] Update Progress: 2219/2367 symbols completed. VGI took 22.1s. Estimated remaining: 18m 60s. Rate: 7.8 symbols/min [2025-10-24T00:24:50.632545] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:24:50.637490] [DEBUG] [LOCAL ] VHI: Loaded 2673 existing records from primary storage. [2025-10-24T00:24:50.637703] [INFO ] [MAIN ] VHI: Loaded 2673 existing records. [2025-10-24T00:24:50.809507] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:24:50.809698] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-24T00:24:50.809771] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-24T00:24:50.809953] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-24T00:24:50.810026] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-24T00:25:02.952157] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-24T00:25:03.357127] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-24T00:25:03.357278] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-24T00:25:03.357524] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-24T00:25:03.357667] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-24T00:25:03.358345] [DEBUG] [LOCAL ] VHI: Trimmed 4322 records to 2684 (keeping 200 days of data) [2025-10-24T00:25:03.377835] [DEBUG] [LOCAL ] VHI: Primary data saved (2684 records). [2025-10-24T00:25:03.377990] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-24T00:25:03.378129] [INFO ] [MAIN ] Update Progress: 2220/2367 symbols completed. VHI took 12.9s. Estimated remaining: 18m 52s. Rate: 7.8 symbols/min [2025-10-24T00:25:03.564259] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:03.564447] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-24T00:25:03.564518] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-24T00:25:03.564627] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-24T00:25:03.564717] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-24T00:25:03.564798] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-24T00:25:03.564867] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-24T00:25:04.302267] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-24T00:25:04.302352] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:25:04.302499] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-24T00:25:04.314870] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-24T00:25:04.315498] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-24T00:25:04.316097] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-24T00:25:04.321178] [INFO ] [MAIN ] Update Progress: 2221/2367 symbols completed. VIA took 0.9s. Estimated remaining: 18m 44s. Rate: 7.8 symbols/min [2025-10-24T00:25:04.506967] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:04.560404] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-24T00:25:04.560835] [INFO ] [MAIN ] VICI: Loaded 53653 existing records. [2025-10-24T00:25:04.737133] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:04.737382] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-24T00:25:04.737461] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-24T00:25:04.737736] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-24T00:25:04.737809] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-24T00:25:09.313744] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-10-24T00:25:09.521412] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-24T00:25:09.523417] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-10-24T00:25:09.523635] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-10-24T00:25:09.527284] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-24T00:25:09.527912] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-24T00:25:09.528263] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-24T00:25:09.528348] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-24T00:25:09.528452] [INFO ] [MAIN ] Update Progress: 2222/2367 symbols completed. VG took 43.9s. Estimated remaining: 18m 36s. Rate: 7.8 symbols/min [2025-10-24T00:25:09.719166] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:09.776315] [DEBUG] [LOCAL ] VIK: Loaded 52371 existing records from primary storage. [2025-10-24T00:25:09.776756] [INFO ] [MAIN ] VIK: Loaded 52371 existing records. [2025-10-24T00:25:09.991591] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:09.992163] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-24T00:25:09.992258] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-24T00:25:09.992677] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-24T00:25:09.992746] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-24T00:25:11.597827] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-24T00:25:12.065070] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-24T00:25:12.065343] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-24T00:25:12.067103] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-24T00:25:12.067340] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-24T00:25:12.069117] [DEBUG] [LOCAL ] VFC: Trimmed 77749 records to 53996 (keeping 200 days of data) [2025-10-24T00:25:12.452904] [DEBUG] [LOCAL ] VFC: Primary data saved (53996 records). [2025-10-24T00:25:12.453076] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-24T00:25:12.453193] [INFO ] [MAIN ] Update Progress: 2223/2367 symbols completed. VFC took 50.4s. Estimated remaining: 18m 28s. Rate: 7.8 symbols/min [2025-10-24T00:25:12.622195] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:12.670724] [DEBUG] [LOCAL ] VIPS: Loaded 51251 existing records from primary storage. [2025-10-24T00:25:12.671064] [INFO ] [MAIN ] VIPS: Loaded 51251 existing records. [2025-10-24T00:25:12.853822] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:12.854133] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-24T00:25:12.854215] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-24T00:25:12.854454] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-24T00:25:12.854529] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-24T00:25:13.762147] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-24T00:25:14.142521] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-24T00:25:14.151681] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-24T00:25:14.165067] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-24T00:25:14.167840] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-24T00:25:14.179698] [DEBUG] [LOCAL ] VGM: Trimmed 25750 records to 18736 (keeping 200 days of data) [2025-10-24T00:25:14.290987] [DEBUG] [LOCAL ] VGM: Primary data saved (18736 records). [2025-10-24T00:25:14.291193] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-24T00:25:14.291329] [INFO ] [MAIN ] Update Progress: 2224/2367 symbols completed. VGM took 28.8s. Estimated remaining: 18m 20s. Rate: 7.8 symbols/min [2025-10-24T00:25:14.472216] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:14.512560] [DEBUG] [LOCAL ] VIRT: Loaded 46460 existing records from primary storage. [2025-10-24T00:25:14.512920] [INFO ] [MAIN ] VIRT: Loaded 46460 existing records. [2025-10-24T00:25:14.686740] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:14.686989] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-24T00:25:14.687063] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-24T00:25:14.687298] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-24T00:25:14.687380] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-24T00:25:36.843701] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-24T00:25:37.250106] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-24T00:25:37.250217] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-24T00:25:37.251469] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-24T00:25:37.251548] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-24T00:25:37.252961] [DEBUG] [LOCAL ] VIK: Trimmed 75924 records to 52713 (keeping 200 days of data) [2025-10-24T00:25:37.559315] [DEBUG] [LOCAL ] VIK: Primary data saved (52713 records). [2025-10-24T00:25:37.559470] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-24T00:25:37.561000] [INFO ] [MAIN ] Update Progress: 2225/2367 symbols completed. VIK took 28.0s. Estimated remaining: 18m 13s. Rate: 7.8 symbols/min [2025-10-24T00:25:37.760707] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:37.817563] [DEBUG] [LOCAL ] VIST: Loaded 46640 existing records from primary storage. [2025-10-24T00:25:37.817957] [INFO ] [MAIN ] VIST: Loaded 46640 existing records. [2025-10-24T00:25:37.991831] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:37.992084] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-24T00:25:37.992178] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-24T00:25:37.992489] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-24T00:25:37.992585] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-24T00:25:41.075305] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-24T00:25:41.469977] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-24T00:25:41.470225] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-24T00:25:41.471592] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-24T00:25:41.471849] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-24T00:25:41.509773] [DEBUG] [LOCAL ] VICI: Trimmed 77803 records to 54043 (keeping 200 days of data) [2025-10-24T00:25:41.839394] [DEBUG] [LOCAL ] VICI: Primary data saved (54043 records). [2025-10-24T00:25:41.839565] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-24T00:25:41.839702] [INFO ] [MAIN ] Update Progress: 2226/2367 symbols completed. VICI took 37.5s. Estimated remaining: 18m 6s. Rate: 7.8 symbols/min [2025-10-24T00:25:42.006459] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:42.046961] [DEBUG] [LOCAL ] VIV: Loaded 44584 existing records from primary storage. [2025-10-24T00:25:42.047277] [INFO ] [MAIN ] VIV: Loaded 44584 existing records. [2025-10-24T00:25:42.221820] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:42.222026] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-24T00:25:42.222101] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-24T00:25:42.222328] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-24T00:25:42.222412] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-24T00:25:46.180597] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-24T00:25:46.569976] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-24T00:25:46.570112] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-24T00:25:46.571349] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-24T00:25:46.571428] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-24T00:25:46.572822] [DEBUG] [LOCAL ] VIRT: Trimmed 67531 records to 46759 (keeping 200 days of data) [2025-10-24T00:25:46.856361] [DEBUG] [LOCAL ] VIRT: Primary data saved (46759 records). [2025-10-24T00:25:46.877480] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-24T00:25:46.880748] [INFO ] [MAIN ] Update Progress: 2227/2367 symbols completed. VIRT took 32.6s. Estimated remaining: 17m 58s. Rate: 7.8 symbols/min [2025-10-24T00:25:47.065180] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:47.083159] [DEBUG] [LOCAL ] VKQ: Loaded 17853 existing records from primary storage. [2025-10-24T00:25:47.083435] [INFO ] [MAIN ] VKQ: Loaded 17853 existing records. [2025-10-24T00:25:47.275140] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:47.275380] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-24T00:25:47.275476] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-24T00:25:47.275751] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-24T00:25:47.275831] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-24T00:25:48.157884] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-24T00:25:48.557878] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-24T00:25:48.558000] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-24T00:25:48.559270] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-24T00:25:48.559352] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-24T00:25:48.560876] [DEBUG] [LOCAL ] VIPS: Trimmed 74867 records to 51623 (keeping 200 days of data) [2025-10-24T00:25:48.876408] [DEBUG] [LOCAL ] VIPS: Primary data saved (51623 records). [2025-10-24T00:25:48.876616] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-24T00:25:48.876776] [INFO ] [MAIN ] Update Progress: 2228/2367 symbols completed. VIPS took 36.4s. Estimated remaining: 17m 50s. Rate: 7.8 symbols/min [2025-10-24T00:25:49.055568] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:25:49.119350] [DEBUG] [LOCAL ] VLN: Loaded 31057 existing records from primary storage. [2025-10-24T00:25:49.119679] [INFO ] [MAIN ] VLN: Loaded 31057 existing records. [2025-10-24T00:25:49.301285] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:25:49.301670] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-24T00:25:49.301756] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-24T00:25:49.302123] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-24T00:25:49.302216] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-24T00:26:11.103463] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-24T00:26:11.480103] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-24T00:26:11.480221] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-24T00:26:11.481387] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-24T00:26:11.481468] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-24T00:26:11.482767] [DEBUG] [LOCAL ] VIV: Trimmed 64329 records to 44842 (keeping 200 days of data) [2025-10-24T00:26:11.765159] [DEBUG] [LOCAL ] VIV: Primary data saved (44842 records). [2025-10-24T00:26:11.765350] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-24T00:26:11.765618] [INFO ] [MAIN ] Update Progress: 2229/2367 symbols completed. VIV took 29.9s. Estimated remaining: 17m 43s. Rate: 7.8 symbols/min [2025-10-24T00:26:11.940075] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:12.025783] [DEBUG] [LOCAL ] VLO: Loaded 52956 existing records from primary storage. [2025-10-24T00:26:12.026103] [INFO ] [MAIN ] VLO: Loaded 52956 existing records. [2025-10-24T00:26:12.198443] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:12.198630] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-24T00:26:12.198717] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-24T00:26:12.198930] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-24T00:26:12.199005] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-24T00:26:12.632447] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-24T00:26:13.056007] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-24T00:26:13.056131] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-24T00:26:13.056781] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-24T00:26:13.056861] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-24T00:26:13.057685] [DEBUG] [LOCAL ] VKQ: Trimmed 24587 records to 17940 (keeping 200 days of data) [2025-10-24T00:26:13.169409] [DEBUG] [LOCAL ] VKQ: Primary data saved (17940 records). [2025-10-24T00:26:13.169567] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-24T00:26:13.169752] [INFO ] [MAIN ] Update Progress: 2230/2367 symbols completed. VKQ took 26.3s. Estimated remaining: 17m 35s. Rate: 7.8 symbols/min [2025-10-24T00:26:13.349820] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:13.387427] [DEBUG] [LOCAL ] VLRS: Loaded 39240 existing records from primary storage. [2025-10-24T00:26:13.387779] [INFO ] [MAIN ] VLRS: Loaded 39240 existing records. [2025-10-24T00:26:13.560735] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:13.560931] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-24T00:26:13.561006] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-24T00:26:13.561243] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-24T00:26:13.561317] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-24T00:26:14.971695] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-24T00:26:15.361514] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-24T00:26:15.361636] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-24T00:26:15.362906] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-24T00:26:15.362986] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-24T00:26:15.364459] [DEBUG] [LOCAL ] VIST: Trimmed 67522 records to 47029 (keeping 200 days of data) [2025-10-24T00:26:15.639359] [DEBUG] [LOCAL ] VIST: Primary data saved (47029 records). [2025-10-24T00:26:15.639505] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-24T00:26:15.640857] [INFO ] [MAIN ] Update Progress: 2231/2367 symbols completed. VIST took 38.1s. Estimated remaining: 17m 27s. Rate: 7.8 symbols/min [2025-10-24T00:26:15.807504] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:15.815512] [DEBUG] [LOCAL ] VLT: Loaded 4282 existing records from primary storage. [2025-10-24T00:26:15.815824] [INFO ] [MAIN ] VLT: Loaded 4282 existing records. [2025-10-24T00:26:16.023634] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:16.024306] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-24T00:26:16.025156] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-24T00:26:16.025334] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-24T00:26:16.025405] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-24T00:26:20.774829] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-24T00:26:21.185549] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-24T00:26:21.185689] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-24T00:26:21.186663] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-24T00:26:21.186747] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-24T00:26:21.187789] [DEBUG] [LOCAL ] VLN: Trimmed 43264 records to 31255 (keeping 200 days of data) [2025-10-24T00:26:21.358103] [DEBUG] [LOCAL ] VLN: Primary data saved (31255 records). [2025-10-24T00:26:21.358283] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-24T00:26:21.358396] [INFO ] [MAIN ] Update Progress: 2232/2367 symbols completed. VLN took 32.5s. Estimated remaining: 17m 19s. Rate: 7.8 symbols/min [2025-10-24T00:26:21.536103] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:21.580534] [DEBUG] [LOCAL ] VLTO: Loaded 46055 existing records from primary storage. [2025-10-24T00:26:21.580902] [INFO ] [MAIN ] VLTO: Loaded 46055 existing records. [2025-10-24T00:26:21.764726] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:21.765003] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-24T00:26:21.765081] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-24T00:26:21.765316] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-24T00:26:21.765393] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-24T00:26:38.830108] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-24T00:26:39.222998] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-24T00:26:39.223109] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-24T00:26:39.223363] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-24T00:26:39.223440] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-24T00:26:39.223907] [DEBUG] [LOCAL ] VLT: Trimmed 7424 records to 4306 (keeping 200 days of data) [2025-10-24T00:26:39.249999] [DEBUG] [LOCAL ] VLT: Primary data saved (4306 records). [2025-10-24T00:26:39.250100] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-24T00:26:39.250213] [INFO ] [MAIN ] Update Progress: 2233/2367 symbols completed. VLT took 23.6s. Estimated remaining: 17m 12s. Rate: 7.8 symbols/min [2025-10-24T00:26:39.414544] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:39.456475] [DEBUG] [LOCAL ] VMC: Loaded 42153 existing records from primary storage. [2025-10-24T00:26:39.456823] [INFO ] [MAIN ] VMC: Loaded 42153 existing records. [2025-10-24T00:26:39.628193] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:39.628425] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-24T00:26:39.628501] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-24T00:26:39.628965] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-24T00:26:39.629039] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-24T00:26:41.886032] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-24T00:26:42.268032] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-24T00:26:42.268142] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-24T00:26:42.269278] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-24T00:26:42.269354] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-24T00:26:42.270495] [DEBUG] [LOCAL ] VLRS: Trimmed 58251 records to 39561 (keeping 200 days of data) [2025-10-24T00:26:42.489723] [DEBUG] [LOCAL ] VLRS: Primary data saved (39561 records). [2025-10-24T00:26:42.489900] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-24T00:26:42.490022] [INFO ] [MAIN ] Update Progress: 2234/2367 symbols completed. VLRS took 29.3s. Estimated remaining: 17m 4s. Rate: 7.8 symbols/min [2025-10-24T00:26:42.655118] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:42.671586] [DEBUG] [LOCAL ] VMI: Loaded 14939 existing records from primary storage. [2025-10-24T00:26:42.671880] [INFO ] [MAIN ] VMI: Loaded 14939 existing records. [2025-10-24T00:26:42.842697] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:42.842926] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-24T00:26:42.843001] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-24T00:26:42.843192] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-24T00:26:42.843265] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-24T00:26:43.420901] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-24T00:26:43.802551] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-24T00:26:43.802891] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-24T00:26:43.804209] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-24T00:26:43.804412] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-24T00:26:43.805905] [DEBUG] [LOCAL ] VLO: Trimmed 76911 records to 53345 (keeping 200 days of data) [2025-10-24T00:26:44.170263] [DEBUG] [LOCAL ] VLO: Primary data saved (53345 records). [2025-10-24T00:26:44.170407] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-24T00:26:44.171266] [INFO ] [MAIN ] Update Progress: 2235/2367 symbols completed. VLO took 32.4s. Estimated remaining: 16m 56s. Rate: 7.8 symbols/min [2025-10-24T00:26:44.334495] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:44.355349] [DEBUG] [LOCAL ] VMO: Loaded 20692 existing records from primary storage. [2025-10-24T00:26:44.355618] [INFO ] [MAIN ] VMO: Loaded 20692 existing records. [2025-10-24T00:26:44.527192] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:44.527450] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-24T00:26:44.527527] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-24T00:26:44.527790] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-24T00:26:44.527865] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-24T00:26:56.103708] [FATAL] [MAIN ] VMI: Failed to fetch primary data. [2025-10-24T00:26:56.103787] [WARN ] [MAIN ] VMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:26:56.103867] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-24T00:26:56.103971] [DEBUG] [LOCAL ] VMI: No primary data file found to delete. [2025-10-24T00:26:56.104047] [INFO ] [LOCAL ] VMI: Starting deletion of derivative data. [2025-10-24T00:26:56.104809] [DEBUG] [LOCAL ] VMI: Deleted derivative data file. [2025-10-24T00:26:56.104955] [INFO ] [MAIN ] Update Progress: 2236/2367 symbols completed. VMI took 13.6s. Estimated remaining: 16m 48s. Rate: 7.8 symbols/min [2025-10-24T00:26:56.299203] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:26:56.350422] [DEBUG] [LOCAL ] VNO: Loaded 48826 existing records from primary storage. [2025-10-24T00:26:56.350939] [INFO ] [MAIN ] VNO: Loaded 48826 existing records. [2025-10-24T00:26:56.572525] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:26:56.572874] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-24T00:26:56.572959] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-24T00:26:56.573233] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-24T00:26:56.573313] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-24T00:27:05.104019] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-24T00:27:05.488215] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-24T00:27:05.488356] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-24T00:27:05.489140] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-24T00:27:05.489251] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-24T00:27:05.490101] [DEBUG] [LOCAL ] VMO: Trimmed 30729 records to 20786 (keeping 200 days of data) [2025-10-24T00:27:05.613813] [DEBUG] [LOCAL ] VMO: Primary data saved (20786 records). [2025-10-24T00:27:05.613935] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-24T00:27:05.614059] [INFO ] [MAIN ] Update Progress: 2237/2367 symbols completed. VMO took 21.4s. Estimated remaining: 16m 41s. Rate: 7.8 symbols/min [2025-10-24T00:27:09.594316] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-24T00:27:09.993318] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-24T00:27:09.993487] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-24T00:27:09.994767] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-24T00:27:09.994847] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-24T00:27:09.996193] [DEBUG] [LOCAL ] VLTO: Trimmed 67368 records to 46360 (keeping 200 days of data) [2025-10-24T00:27:10.251119] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-24T00:27:10.485064] [DEBUG] [LOCAL ] VLTO: Primary data saved (46360 records). [2025-10-24T00:27:10.507265] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-24T00:27:10.548341] [INFO ] [MAIN ] Update Progress: 2238/2367 symbols completed. VLTO took 49.2s. Estimated remaining: 16m 33s. Rate: 7.8 symbols/min [2025-10-24T00:27:10.694834] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-24T00:27:10.694949] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-24T00:27:10.696225] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-24T00:27:10.696316] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-24T00:27:10.697590] [DEBUG] [LOCAL ] VMC: Trimmed 62290 records to 42397 (keeping 200 days of data) [2025-10-24T00:27:10.957380] [DEBUG] [LOCAL ] VMC: Primary data saved (42397 records). [2025-10-24T00:27:10.957595] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-24T00:27:10.959592] [INFO ] [MAIN ] Update Progress: 2239/2367 symbols completed. VMC took 31.7s. Estimated remaining: 16m 25s. Rate: 7.8 symbols/min [2025-10-24T00:27:19.601327] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-24T00:27:19.996975] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-24T00:27:19.997094] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-24T00:27:19.998467] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-24T00:27:19.998558] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-24T00:27:19.999921] [DEBUG] [LOCAL ] VNO: Trimmed 70492 records to 49140 (keeping 200 days of data) [2025-10-24T00:27:20.278070] [DEBUG] [LOCAL ] VNO: Primary data saved (49140 records). [2025-10-24T00:27:20.278290] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-24T00:27:20.278404] [INFO ] [MAIN ] Update Progress: 2240/2367 symbols completed. VNO took 24.2s. Estimated remaining: 16m 17s. Rate: 7.8 symbols/min [2025-10-24T00:27:20.844146] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:20.937324] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:20.912082] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-24T00:27:20.960002] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:20.960168] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-24T00:27:20.984399] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-24T00:27:20.985428] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:20.985929] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-24T00:27:20.986283] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-24T00:27:20.986360] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-24T00:27:21.073772] [DEBUG] [LOCAL ] VOC: Loaded 9041 existing records from primary storage. [2025-10-24T00:27:21.096403] [INFO ] [MAIN ] VOC: Loaded 9041 existing records. [2025-10-24T00:27:21.278991] [DEBUG] [LOCAL ] VOYA: Loaded 41801 existing records from primary storage. [2025-10-24T00:27:21.380518] [INFO ] [MAIN ] VOYA: Loaded 41801 existing records. [2025-10-24T00:27:21.466263] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:21.550585] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-24T00:27:21.582662] [DEBUG] [LOCAL ] VNT: Loaded 43884 existing records from primary storage. [2025-10-24T00:27:21.642859] [INFO ] [MAIN ] VNT: Loaded 43884 existing records. [2025-10-24T00:27:21.643104] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-24T00:27:21.724932] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-24T00:27:21.789738] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-24T00:27:21.977904] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:22.027319] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-24T00:27:22.069101] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-24T00:27:22.112855] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-24T00:27:22.152950] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:22.153459] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-24T00:27:22.159260] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-24T00:27:22.159375] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-24T00:27:22.191946] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-24T00:27:22.247117] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-24T00:27:22.635346] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-24T00:27:22.732012] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:27:22.923182] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-24T00:27:23.008754] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-24T00:27:23.063579] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-24T00:27:23.129159] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-24T00:27:23.140061] [INFO ] [MAIN ] Update Progress: 2241/2367 symbols completed. VOYG took 2.9s. Estimated remaining: 16m 9s. Rate: 7.8 symbols/min [2025-10-24T00:27:23.396376] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:23.414129] [DEBUG] [LOCAL ] VPG: Loaded 16880 existing records from primary storage. [2025-10-24T00:27:23.414415] [INFO ] [MAIN ] VPG: Loaded 16880 existing records. [2025-10-24T00:27:23.597437] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:23.597708] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-24T00:27:23.597787] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-24T00:27:23.598305] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-24T00:27:23.598379] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-24T00:27:37.563728] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-24T00:27:37.947313] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-24T00:27:37.947427] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-24T00:27:37.947840] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-24T00:27:37.947918] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-24T00:27:37.948429] [DEBUG] [LOCAL ] VOC: Trimmed 13275 records to 9134 (keeping 200 days of data) [2025-10-24T00:27:38.000460] [DEBUG] [LOCAL ] VOC: Primary data saved (9134 records). [2025-10-24T00:27:38.000628] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-24T00:27:38.000907] [INFO ] [MAIN ] Update Progress: 2242/2367 symbols completed. VOC took 17.7s. Estimated remaining: 16m 2s. Rate: 7.8 symbols/min [2025-10-24T00:27:38.166522] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:38.172538] [DEBUG] [LOCAL ] VPV: Loaded 5221 existing records from primary storage. [2025-10-24T00:27:38.172754] [INFO ] [MAIN ] VPV: Loaded 5221 existing records. [2025-10-24T00:27:38.350361] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:38.350529] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-24T00:27:38.350609] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-24T00:27:38.350827] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-24T00:27:38.350901] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-24T00:27:43.926468] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-24T00:27:44.310264] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-24T00:27:44.310383] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-24T00:27:44.310959] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-24T00:27:44.311058] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-24T00:27:44.311739] [DEBUG] [LOCAL ] VPG: Trimmed 23167 records to 16985 (keeping 200 days of data) [2025-10-24T00:27:44.417806] [DEBUG] [LOCAL ] VPG: Primary data saved (16985 records). [2025-10-24T00:27:44.417994] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-24T00:27:44.418110] [INFO ] [MAIN ] Update Progress: 2243/2367 symbols completed. VPG took 21.3s. Estimated remaining: 15m 54s. Rate: 7.8 symbols/min [2025-10-24T00:27:44.583821] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:44.618374] [DEBUG] [LOCAL ] VRE: Loaded 35221 existing records from primary storage. [2025-10-24T00:27:44.618726] [INFO ] [MAIN ] VRE: Loaded 35221 existing records. [2025-10-24T00:27:44.814226] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:44.815552] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-24T00:27:44.815666] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-24T00:27:44.815895] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-24T00:27:44.815975] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-24T00:27:49.863523] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-24T00:27:50.250136] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-24T00:27:50.251657] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-24T00:27:50.253434] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-24T00:27:50.253515] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-24T00:27:50.254667] [DEBUG] [LOCAL ] VOYA: Trimmed 61558 records to 42078 (keeping 200 days of data) [2025-10-24T00:27:50.512120] [DEBUG] [LOCAL ] VOYA: Primary data saved (42078 records). [2025-10-24T00:27:50.512280] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-24T00:27:50.512397] [INFO ] [MAIN ] Update Progress: 2244/2367 symbols completed. VOYA took 30.2s. Estimated remaining: 15m 46s. Rate: 7.8 symbols/min [2025-10-24T00:27:50.687490] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:50.738488] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-24T00:27:50.738856] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-24T00:27:50.918969] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:50.919183] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-24T00:27:50.919260] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-24T00:27:50.919485] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-24T00:27:50.919563] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-24T00:27:51.988144] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-24T00:27:52.423336] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-24T00:27:52.423516] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-24T00:27:52.424778] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-24T00:27:52.424864] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-24T00:27:52.426273] [DEBUG] [LOCAL ] VNT: Trimmed 64274 records to 44209 (keeping 200 days of data) [2025-10-24T00:27:52.706496] [DEBUG] [LOCAL ] VNT: Primary data saved (44209 records). [2025-10-24T00:27:52.706594] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-24T00:27:52.706728] [INFO ] [MAIN ] Update Progress: 2245/2367 symbols completed. VNT took 32.4s. Estimated remaining: 15m 38s. Rate: 7.8 symbols/min [2025-10-24T00:27:52.888630] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:27:52.906239] [DEBUG] [LOCAL ] VRTS: Loaded 9371 existing records from primary storage. [2025-10-24T00:27:52.906620] [INFO ] [MAIN ] VRTS: Loaded 9371 existing records. [2025-10-24T00:27:53.103767] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:27:53.104012] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-24T00:27:53.104091] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-24T00:27:53.104309] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-24T00:27:53.104387] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-24T00:28:01.452757] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-24T00:28:01.824277] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-24T00:28:01.824418] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-24T00:28:01.824751] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-24T00:28:01.824837] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-24T00:28:01.825787] [DEBUG] [LOCAL ] VPV: Trimmed 8820 records to 5234 (keeping 200 days of data) [2025-10-24T00:28:01.888350] [DEBUG] [LOCAL ] VPV: Primary data saved (5234 records). [2025-10-24T00:28:01.889141] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-24T00:28:01.890732] [INFO ] [MAIN ] Update Progress: 2246/2367 symbols completed. VPV took 23.9s. Estimated remaining: 15m 31s. Rate: 7.8 symbols/min [2025-10-24T00:28:02.069951] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:28:02.122630] [DEBUG] [LOCAL ] VSCO: Loaded 52694 existing records from primary storage. [2025-10-24T00:28:02.122991] [INFO ] [MAIN ] VSCO: Loaded 52694 existing records. [2025-10-24T00:28:02.314041] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:28:02.314253] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-24T00:28:02.314329] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-24T00:28:02.314551] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-24T00:28:02.314625] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-24T00:28:17.611853] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-24T00:28:17.965847] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-24T00:28:17.965965] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-24T00:28:17.966277] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-24T00:28:17.966352] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-24T00:28:17.966916] [DEBUG] [LOCAL ] VRTS: Trimmed 11851 records to 9434 (keeping 200 days of data) [2025-10-24T00:28:18.025221] [DEBUG] [LOCAL ] VRTS: Primary data saved (9434 records). [2025-10-24T00:28:18.025404] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-24T00:28:18.025538] [INFO ] [MAIN ] Update Progress: 2247/2367 symbols completed. VRTS took 25.3s. Estimated remaining: 15m 24s. Rate: 7.8 symbols/min [2025-10-24T00:28:18.203427] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:28:18.248938] [DEBUG] [LOCAL ] VSH: Loaded 48228 existing records from primary storage. [2025-10-24T00:28:18.249270] [INFO ] [MAIN ] VSH: Loaded 48228 existing records. [2025-10-24T00:28:18.450420] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:28:18.450992] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-24T00:28:18.451266] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-24T00:28:18.461436] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-24T00:28:18.471797] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-24T00:28:23.760508] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-24T00:28:24.130013] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-24T00:28:24.130119] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-24T00:28:24.131120] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-24T00:28:24.131198] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-24T00:28:24.132279] [DEBUG] [LOCAL ] VRE: Trimmed 48760 records to 35499 (keeping 200 days of data) [2025-10-24T00:28:24.342796] [DEBUG] [LOCAL ] VRE: Primary data saved (35499 records). [2025-10-24T00:28:24.342957] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-24T00:28:24.343070] [INFO ] [MAIN ] Update Progress: 2248/2367 symbols completed. VRE took 39.9s. Estimated remaining: 15m 16s. Rate: 7.8 symbols/min [2025-10-24T00:28:24.511570] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:28:24.562215] [DEBUG] [LOCAL ] VST: Loaded 53709 existing records from primary storage. [2025-10-24T00:28:24.562567] [INFO ] [MAIN ] VST: Loaded 53709 existing records. [2025-10-24T00:28:24.739133] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:28:24.739321] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-24T00:28:24.739404] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-24T00:28:24.739679] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-24T00:28:24.739753] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-24T00:28:32.879570] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-24T00:28:33.283726] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-24T00:28:33.283852] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-24T00:28:33.285112] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-24T00:28:33.285192] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-24T00:28:33.286697] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 54143 (keeping 200 days of data) [2025-10-24T00:28:33.622592] [DEBUG] [LOCAL ] VRT: Primary data saved (54143 records). [2025-10-24T00:28:33.622803] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-24T00:28:33.624259] [INFO ] [MAIN ] Update Progress: 2249/2367 symbols completed. VRT took 43.1s. Estimated remaining: 15m 8s. Rate: 7.8 symbols/min [2025-10-24T00:28:33.833328] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:28:33.891307] [DEBUG] [LOCAL ] VSTS: Loaded 48857 existing records from primary storage. [2025-10-24T00:28:33.891707] [INFO ] [MAIN ] VSTS: Loaded 48857 existing records. [2025-10-24T00:28:34.073282] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:28:34.073512] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-24T00:28:34.073592] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-24T00:28:34.073844] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-24T00:28:34.073919] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-24T00:28:34.552694] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-24T00:28:34.930362] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-24T00:28:34.930477] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-24T00:28:34.931757] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-24T00:28:34.931837] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-24T00:28:34.933248] [DEBUG] [LOCAL ] VSCO: Trimmed 76433 records to 53067 (keeping 200 days of data) [2025-10-24T00:28:35.237592] [DEBUG] [LOCAL ] VSCO: Primary data saved (53067 records). [2025-10-24T00:28:35.238696] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-24T00:28:35.238814] [INFO ] [MAIN ] Update Progress: 2250/2367 symbols completed. VSCO took 33.3s. Estimated remaining: 15m 0s. Rate: 7.8 symbols/min [2025-10-24T00:28:35.405450] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:28:35.442496] [DEBUG] [LOCAL ] VTEX: Loaded 42874 existing records from primary storage. [2025-10-24T00:28:35.442834] [INFO ] [MAIN ] VTEX: Loaded 42874 existing records. [2025-10-24T00:28:35.616607] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:28:35.616951] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-24T00:28:35.617028] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-24T00:28:35.617250] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-24T00:28:35.617323] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-24T00:28:48.835042] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-24T00:28:49.224331] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-24T00:28:49.224440] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-24T00:28:49.225633] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-24T00:28:49.225729] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-24T00:28:49.227039] [DEBUG] [LOCAL ] VSH: Trimmed 70958 records to 48614 (keeping 200 days of data) [2025-10-24T00:28:49.515263] [DEBUG] [LOCAL ] VSH: Primary data saved (48614 records). [2025-10-24T00:28:49.515431] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-24T00:28:49.515524] [INFO ] [MAIN ] Update Progress: 2251/2367 symbols completed. VSH took 31.5s. Estimated remaining: 14m 53s. Rate: 7.8 symbols/min [2025-10-24T00:28:49.712618] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:28:49.766406] [DEBUG] [LOCAL ] VTLE: Loaded 47548 existing records from primary storage. [2025-10-24T00:28:49.766758] [INFO ] [MAIN ] VTLE: Loaded 47548 existing records. [2025-10-24T00:28:49.940207] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:28:49.940460] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-24T00:28:49.940536] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-24T00:28:49.940779] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-24T00:28:49.940854] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-24T00:29:00.769262] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-24T00:29:01.151959] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-24T00:29:01.152091] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-24T00:29:01.153337] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-24T00:29:01.153453] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-24T00:29:01.154842] [DEBUG] [LOCAL ] VTEX: Trimmed 61095 records to 43140 (keeping 200 days of data) [2025-10-24T00:29:01.387830] [DEBUG] [LOCAL ] VTEX: Primary data saved (43140 records). [2025-10-24T00:29:01.387986] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-24T00:29:01.388121] [INFO ] [MAIN ] Update Progress: 2252/2367 symbols completed. VTEX took 26.1s. Estimated remaining: 14m 45s. Rate: 7.8 symbols/min [2025-10-24T00:29:01.556472] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:01.573928] [DEBUG] [LOCAL ] VTMX: Loaded 17525 existing records from primary storage. [2025-10-24T00:29:01.574255] [INFO ] [MAIN ] VTMX: Loaded 17525 existing records. [2025-10-24T00:29:01.758885] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:01.759117] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-24T00:29:01.759195] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-24T00:29:01.759432] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-24T00:29:01.759510] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-24T00:29:02.592578] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-24T00:29:03.024694] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-24T00:29:03.024840] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-24T00:29:03.026142] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-24T00:29:03.026223] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-24T00:29:03.028050] [DEBUG] [LOCAL ] VST: Trimmed 77888 records to 54099 (keeping 200 days of data) [2025-10-24T00:29:03.405590] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-24T00:29:03.407314] [DEBUG] [LOCAL ] VST: Primary data saved (54099 records). [2025-10-24T00:29:03.407707] [INFO ] [MAIN ] VST: Full history saved. [2025-10-24T00:29:03.407860] [INFO ] [MAIN ] Update Progress: 2253/2367 symbols completed. VST took 39.1s. Estimated remaining: 14m 37s. Rate: 7.8 symbols/min [2025-10-24T00:29:03.791638] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:03.925424] [DEBUG] [LOCAL ] VTN: Loaded 7114 existing records from primary storage. [2025-10-24T00:29:03.941021] [INFO ] [MAIN ] VTN: Loaded 7114 existing records. [2025-10-24T00:29:04.094681] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-24T00:29:04.094840] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-24T00:29:04.096234] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-24T00:29:04.120443] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-24T00:29:04.171503] [DEBUG] [LOCAL ] VSTS: Trimmed 69742 records to 49200 (keeping 200 days of data) [2025-10-24T00:29:04.265692] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:04.266253] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-24T00:29:04.295362] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-24T00:29:04.299826] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-24T00:29:04.300201] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-24T00:29:04.867033] [DEBUG] [LOCAL ] VSTS: Primary data saved (49200 records). [2025-10-24T00:29:04.867307] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-24T00:29:04.868717] [INFO ] [MAIN ] Update Progress: 2254/2367 symbols completed. VSTS took 31.2s. Estimated remaining: 14m 29s. Rate: 7.8 symbols/min [2025-10-24T00:29:05.079213] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:05.098933] [DEBUG] [LOCAL ] VTOL: Loaded 19344 existing records from primary storage. [2025-10-24T00:29:05.099204] [INFO ] [MAIN ] VTOL: Loaded 19344 existing records. [2025-10-24T00:29:05.297746] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:05.297934] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-24T00:29:05.298024] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-24T00:29:05.298273] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-24T00:29:05.298351] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-24T00:29:23.148892] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-24T00:29:23.540971] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-24T00:29:23.541080] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-24T00:29:23.542288] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-24T00:29:23.542366] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-24T00:29:23.543678] [DEBUG] [LOCAL ] VTLE: Trimmed 68398 records to 47877 (keeping 200 days of data) [2025-10-24T00:29:23.810756] [DEBUG] [LOCAL ] VTLE: Primary data saved (47877 records). [2025-10-24T00:29:23.810911] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-24T00:29:23.811023] [INFO ] [MAIN ] Update Progress: 2255/2367 symbols completed. VTLE took 34.3s. Estimated remaining: 14m 22s. Rate: 7.8 symbols/min [2025-10-24T00:29:23.978326] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:24.026831] [DEBUG] [LOCAL ] VTR: Loaded 52678 existing records from primary storage. [2025-10-24T00:29:24.027174] [INFO ] [MAIN ] VTR: Loaded 52678 existing records. [2025-10-24T00:29:24.205089] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:24.205293] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-24T00:29:24.205370] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-24T00:29:24.205636] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-24T00:29:24.205739] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-24T00:29:25.776586] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-24T00:29:26.167737] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-24T00:29:26.167877] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-24T00:29:26.168458] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-24T00:29:26.168532] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-24T00:29:26.169336] [DEBUG] [LOCAL ] VTMX: Trimmed 25807 records to 17668 (keeping 200 days of data) [2025-10-24T00:29:26.292129] [DEBUG] [LOCAL ] VTMX: Primary data saved (17668 records). [2025-10-24T00:29:26.292329] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-24T00:29:26.292476] [INFO ] [MAIN ] Update Progress: 2256/2367 symbols completed. VTMX took 24.9s. Estimated remaining: 14m 14s. Rate: 7.8 symbols/min [2025-10-24T00:29:26.487232] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:26.514887] [DEBUG] [LOCAL ] VTS: Loaded 29835 existing records from primary storage. [2025-10-24T00:29:26.515182] [INFO ] [MAIN ] VTS: Loaded 29835 existing records. [2025-10-24T00:29:26.692492] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:26.692777] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-24T00:29:26.692853] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-24T00:29:26.693182] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-24T00:29:26.693258] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-24T00:29:29.768025] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-24T00:29:30.160731] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-24T00:29:30.160862] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-24T00:29:30.161450] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-24T00:29:30.161528] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-24T00:29:30.162421] [DEBUG] [LOCAL ] VTOL: Trimmed 26468 records to 19509 (keeping 200 days of data) [2025-10-24T00:29:30.276019] [DEBUG] [LOCAL ] VTOL: Primary data saved (19509 records). [2025-10-24T00:29:30.276185] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-24T00:29:30.276296] [INFO ] [MAIN ] Update Progress: 2257/2367 symbols completed. VTOL took 25.4s. Estimated remaining: 14m 6s. Rate: 7.8 symbols/min [2025-10-24T00:29:30.459087] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:30.494399] [DEBUG] [LOCAL ] VVR: Loaded 31188 existing records from primary storage. [2025-10-24T00:29:30.494778] [INFO ] [MAIN ] VVR: Loaded 31188 existing records. [2025-10-24T00:29:30.676866] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:30.677062] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-24T00:29:30.677141] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-24T00:29:30.677586] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-24T00:29:30.677699] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-24T00:29:37.610532] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-24T00:29:38.020900] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-24T00:29:38.021028] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-24T00:29:38.021314] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-24T00:29:38.021410] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-24T00:29:38.021953] [DEBUG] [LOCAL ] VTN: Trimmed 11014 records to 7335 (keeping 200 days of data) [2025-10-24T00:29:38.065053] [DEBUG] [LOCAL ] VTN: Primary data saved (7335 records). [2025-10-24T00:29:38.065180] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-24T00:29:38.065289] [INFO ] [MAIN ] Update Progress: 2258/2367 symbols completed. VTN took 34.7s. Estimated remaining: 13m 59s. Rate: 7.8 symbols/min [2025-10-24T00:29:38.232393] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:38.274881] [DEBUG] [LOCAL ] VVV: Loaded 50131 existing records from primary storage. [2025-10-24T00:29:38.275237] [INFO ] [MAIN ] VVV: Loaded 50131 existing records. [2025-10-24T00:29:38.457774] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:38.458115] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-24T00:29:38.458193] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-24T00:29:38.458478] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-24T00:29:38.458558] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-24T00:29:48.967810] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-24T00:29:49.344781] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-24T00:29:49.344907] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-24T00:29:49.345951] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-24T00:29:49.346038] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-24T00:29:49.347092] [DEBUG] [LOCAL ] VTS: Trimmed 41603 records to 30045 (keeping 200 days of data) [2025-10-24T00:29:49.543622] [DEBUG] [LOCAL ] VTS: Primary data saved (30045 records). [2025-10-24T00:29:49.543820] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-24T00:29:49.543937] [INFO ] [MAIN ] Update Progress: 2259/2367 symbols completed. VTS took 23.3s. Estimated remaining: 13m 51s. Rate: 7.8 symbols/min [2025-10-24T00:29:49.742387] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:49.766766] [DEBUG] [LOCAL ] VVX: Loaded 23034 existing records from primary storage. [2025-10-24T00:29:49.767059] [INFO ] [MAIN ] VVX: Loaded 23034 existing records. [2025-10-24T00:29:49.955617] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:49.955865] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-24T00:29:49.955947] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-24T00:29:49.956146] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-24T00:29:49.956216] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-24T00:29:57.633270] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-24T00:29:58.016805] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-24T00:29:58.017236] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-24T00:29:58.018795] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-24T00:29:58.018909] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-24T00:29:58.020501] [DEBUG] [LOCAL ] VTR: Trimmed 76449 records to 53049 (keeping 200 days of data) [2025-10-24T00:29:58.390248] [DEBUG] [LOCAL ] VTR: Primary data saved (53049 records). [2025-10-24T00:29:58.390392] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-24T00:29:58.390502] [INFO ] [MAIN ] Update Progress: 2260/2367 symbols completed. VTR took 34.6s. Estimated remaining: 13m 44s. Rate: 7.8 symbols/min [2025-10-24T00:29:58.563503] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:29:58.609293] [DEBUG] [LOCAL ] VYX: Loaded 48308 existing records from primary storage. [2025-10-24T00:29:58.609635] [INFO ] [MAIN ] VYX: Loaded 48308 existing records. [2025-10-24T00:29:58.788369] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:29:58.788816] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-24T00:29:58.799387] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-24T00:29:58.804404] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-24T00:29:58.804927] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-24T00:30:06.958182] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-24T00:30:07.359290] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-24T00:30:07.359403] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-24T00:30:07.360825] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-24T00:30:07.360914] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-24T00:30:07.362672] [DEBUG] [LOCAL ] VVV: Trimmed 72457 records to 50497 (keeping 200 days of data) [2025-10-24T00:30:07.656607] [DEBUG] [LOCAL ] VVV: Primary data saved (50497 records). [2025-10-24T00:30:07.656781] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-24T00:30:07.656890] [INFO ] [MAIN ] Update Progress: 2261/2367 symbols completed. VVV took 29.6s. Estimated remaining: 13m 36s. Rate: 7.8 symbols/min [2025-10-24T00:30:07.850627] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:07.904131] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-24T00:30:07.904503] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-24T00:30:08.083075] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:08.083274] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-24T00:30:08.083350] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-24T00:30:08.083547] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-24T00:30:08.083615] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-24T00:30:12.030097] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-24T00:30:12.420598] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-24T00:30:12.420752] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-24T00:30:12.421457] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-24T00:30:12.421533] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-24T00:30:12.422347] [DEBUG] [LOCAL ] VVX: Trimmed 33101 records to 23194 (keeping 200 days of data) [2025-10-24T00:30:12.552884] [DEBUG] [LOCAL ] VVX: Primary data saved (23194 records). [2025-10-24T00:30:12.553032] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-24T00:30:12.553139] [INFO ] [MAIN ] Update Progress: 2262/2367 symbols completed. VVX took 23.0s. Estimated remaining: 13m 28s. Rate: 7.8 symbols/min [2025-10-24T00:30:12.718922] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:12.766377] [DEBUG] [LOCAL ] W: Loaded 53410 existing records from primary storage. [2025-10-24T00:30:12.766735] [INFO ] [MAIN ] W: Loaded 53410 existing records. [2025-10-24T00:30:12.948529] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:12.948749] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-24T00:30:12.948824] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-24T00:30:12.949051] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-24T00:30:12.949126] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-24T00:30:17.446483] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-24T00:30:17.832293] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-24T00:30:17.832445] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-24T00:30:17.833403] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-24T00:30:17.833498] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-24T00:30:17.834494] [DEBUG] [LOCAL ] VVR: Trimmed 46692 records to 31357 (keeping 200 days of data) [2025-10-24T00:30:18.012488] [DEBUG] [LOCAL ] VVR: Primary data saved (31357 records). [2025-10-24T00:30:18.012689] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-24T00:30:18.012826] [INFO ] [MAIN ] Update Progress: 2263/2367 symbols completed. VVR took 47.7s. Estimated remaining: 13m 20s. Rate: 7.8 symbols/min [2025-10-24T00:30:18.181811] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:18.223776] [DEBUG] [LOCAL ] WAB: Loaded 43796 existing records from primary storage. [2025-10-24T00:30:18.224106] [INFO ] [MAIN ] WAB: Loaded 43796 existing records. [2025-10-24T00:30:18.412341] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:18.412848] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-24T00:30:18.413703] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-24T00:30:18.414183] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-24T00:30:18.414436] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-24T00:30:36.846345] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-24T00:30:37.231421] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-24T00:30:37.231568] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-24T00:30:37.233050] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-24T00:30:37.233152] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-24T00:30:37.234738] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 54181 (keeping 200 days of data) [2025-10-24T00:30:37.560304] [DEBUG] [LOCAL ] VZ: Primary data saved (54181 records). [2025-10-24T00:30:37.560455] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-24T00:30:37.560562] [INFO ] [MAIN ] Update Progress: 2264/2367 symbols completed. VZ took 29.9s. Estimated remaining: 13m 13s. Rate: 7.8 symbols/min [2025-10-24T00:30:37.730262] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:37.769861] [DEBUG] [LOCAL ] WAL: Loaded 45667 existing records from primary storage. [2025-10-24T00:30:37.770190] [INFO ] [MAIN ] WAL: Loaded 45667 existing records. [2025-10-24T00:30:37.951360] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:37.951633] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-24T00:30:37.951826] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-24T00:30:37.952141] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-24T00:30:37.952214] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-24T00:30:41.923142] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-24T00:30:42.312363] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-24T00:30:42.312599] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-24T00:30:42.313901] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-24T00:30:42.314001] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-24T00:30:42.315565] [DEBUG] [LOCAL ] W: Trimmed 77507 records to 53793 (keeping 200 days of data) [2025-10-24T00:30:42.694923] [DEBUG] [LOCAL ] W: Primary data saved (53793 records). [2025-10-24T00:30:42.695184] [INFO ] [MAIN ] W: Full history saved. [2025-10-24T00:30:42.695337] [INFO ] [MAIN ] Update Progress: 2265/2367 symbols completed. W took 30.1s. Estimated remaining: 13m 5s. Rate: 7.8 symbols/min [2025-10-24T00:30:42.874169] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:42.914201] [DEBUG] [LOCAL ] WAT: Loaded 35665 existing records from primary storage. [2025-10-24T00:30:42.914674] [INFO ] [MAIN ] WAT: Loaded 35665 existing records. [2025-10-24T00:30:43.109536] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:43.109983] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-24T00:30:43.110210] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-24T00:30:43.110701] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-24T00:30:43.110845] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-24T00:30:43.989401] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-24T00:30:44.369536] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-24T00:30:44.369670] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-24T00:30:44.371011] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-24T00:30:44.371092] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-24T00:30:44.372378] [DEBUG] [LOCAL ] WAB: Trimmed 64406 records to 44111 (keeping 200 days of data) [2025-10-24T00:30:44.641173] [DEBUG] [LOCAL ] WAB: Primary data saved (44111 records). [2025-10-24T00:30:44.641317] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-24T00:30:44.642931] [INFO ] [MAIN ] Update Progress: 2266/2367 symbols completed. WAB took 26.6s. Estimated remaining: 12m 57s. Rate: 7.8 symbols/min [2025-10-24T00:30:44.811626] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:44.812706] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-24T00:30:44.812780] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-24T00:30:44.812884] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-24T00:30:44.812953] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-24T00:30:44.813036] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-24T00:30:44.813120] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-24T00:30:45.805815] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-24T00:30:45.805912] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:30:45.806013] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-24T00:30:45.806139] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-24T00:30:45.806241] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-24T00:30:45.806395] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-24T00:30:45.806508] [INFO ] [MAIN ] Update Progress: 2267/2367 symbols completed. WBI took 1.2s. Estimated remaining: 12m 49s. Rate: 7.8 symbols/min [2025-10-24T00:30:45.976250] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:46.029783] [DEBUG] [LOCAL ] WBS: Loaded 48843 existing records from primary storage. [2025-10-24T00:30:46.030163] [INFO ] [MAIN ] WBS: Loaded 48843 existing records. [2025-10-24T00:30:46.212004] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:46.212350] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-24T00:30:46.212474] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-24T00:30:46.212909] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-24T00:30:46.212987] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-24T00:30:48.062967] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-24T00:30:48.448761] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-24T00:30:48.448891] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-24T00:30:48.450279] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-24T00:30:48.450379] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-24T00:30:48.451949] [DEBUG] [LOCAL ] VYX: Trimmed 70213 records to 48651 (keeping 200 days of data) [2025-10-24T00:30:48.731444] [DEBUG] [LOCAL ] VYX: Primary data saved (48651 records). [2025-10-24T00:30:48.731599] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-24T00:30:48.731733] [INFO ] [MAIN ] Update Progress: 2268/2367 symbols completed. VYX took 50.3s. Estimated remaining: 12m 41s. Rate: 7.8 symbols/min [2025-10-24T00:30:48.906903] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:30:48.941786] [DEBUG] [LOCAL ] WBX: Loaded 9953 existing records from primary storage. [2025-10-24T00:30:48.952015] [INFO ] [MAIN ] WBX: Loaded 9953 existing records. [2025-10-24T00:30:49.133211] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:30:49.133436] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-24T00:30:49.133681] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-24T00:30:49.134025] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-24T00:30:49.134204] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-24T00:31:09.158372] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-24T00:31:09.538388] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-24T00:31:09.538507] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-24T00:31:09.539540] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-24T00:31:09.539619] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-24T00:31:09.540779] [DEBUG] [LOCAL ] WAT: Trimmed 50952 records to 35962 (keeping 200 days of data) [2025-10-24T00:31:09.756566] [DEBUG] [LOCAL ] WAT: Primary data saved (35962 records). [2025-10-24T00:31:09.756755] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-24T00:31:09.756918] [INFO ] [MAIN ] Update Progress: 2269/2367 symbols completed. WAT took 27.1s. Estimated remaining: 12m 34s. Rate: 7.8 symbols/min [2025-10-24T00:31:09.924391] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:09.961810] [DEBUG] [LOCAL ] WCC: Loaded 38478 existing records from primary storage. [2025-10-24T00:31:09.962115] [INFO ] [MAIN ] WCC: Loaded 38478 existing records. [2025-10-24T00:31:10.160350] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:10.160604] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-24T00:31:10.160822] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-24T00:31:10.161040] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-24T00:31:10.161111] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-24T00:31:11.332933] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-24T00:31:11.734321] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-24T00:31:11.734445] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-24T00:31:11.735636] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-24T00:31:11.735752] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-24T00:31:11.737129] [DEBUG] [LOCAL ] WAL: Trimmed 67352 records to 46034 (keeping 200 days of data) [2025-10-24T00:31:12.020612] [DEBUG] [LOCAL ] WAL: Primary data saved (46034 records). [2025-10-24T00:31:12.020736] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-24T00:31:12.020848] [INFO ] [MAIN ] Update Progress: 2270/2367 symbols completed. WAL took 34.5s. Estimated remaining: 12m 26s. Rate: 7.8 symbols/min [2025-10-24T00:31:12.187912] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:12.232524] [DEBUG] [LOCAL ] WCN: Loaded 47886 existing records from primary storage. [2025-10-24T00:31:12.232885] [INFO ] [MAIN ] WCN: Loaded 47886 existing records. [2025-10-24T00:31:12.408861] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:12.409091] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-24T00:31:12.409167] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-24T00:31:12.409387] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-24T00:31:12.409474] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-24T00:31:16.876800] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-24T00:31:17.274005] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-24T00:31:17.274113] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-24T00:31:17.275333] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-24T00:31:17.275412] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-24T00:31:17.276894] [DEBUG] [LOCAL ] WBS: Trimmed 70374 records to 49206 (keeping 200 days of data) [2025-10-24T00:31:17.518253] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-24T00:31:17.794099] [DEBUG] [LOCAL ] WBS: Primary data saved (49206 records). [2025-10-24T00:31:17.830618] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-24T00:31:17.873071] [INFO ] [MAIN ] Update Progress: 2271/2367 symbols completed. WBS took 32.1s. Estimated remaining: 12m 19s. Rate: 7.8 symbols/min [2025-10-24T00:31:18.187184] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-24T00:31:18.209362] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:18.204897] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-24T00:31:18.210056] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-24T00:31:18.210473] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-24T00:31:18.211185] [DEBUG] [LOCAL ] WBX: Trimmed 21428 records to 9989 (keeping 200 days of data) [2025-10-24T00:31:18.268047] [DEBUG] [LOCAL ] WBX: Primary data saved (9989 records). [2025-10-24T00:31:18.273622] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-24T00:31:18.273842] [INFO ] [MAIN ] Update Progress: 2272/2367 symbols completed. WBX took 29.5s. Estimated remaining: 12m 11s. Rate: 7.8 symbols/min [2025-10-24T00:31:18.384674] [DEBUG] [LOCAL ] WD: Loaded 22521 existing records from primary storage. [2025-10-24T00:31:18.388264] [INFO ] [MAIN ] WD: Loaded 22521 existing records. [2025-10-24T00:31:18.520982] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:18.651315] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:18.651566] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-24T00:31:18.651660] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-24T00:31:18.651860] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-24T00:31:18.651956] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-24T00:31:18.748039] [DEBUG] [LOCAL ] WDH: Loaded 18039 existing records from primary storage. [2025-10-24T00:31:18.758548] [INFO ] [MAIN ] WDH: Loaded 18039 existing records. [2025-10-24T00:31:19.192831] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:19.198238] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-24T00:31:19.198567] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-24T00:31:19.198805] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-24T00:31:19.198878] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-24T00:31:42.366788] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-24T00:31:42.834383] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-24T00:31:42.834619] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-24T00:31:42.834978] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-24T00:31:42.836325] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-24T00:31:42.881392] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-24T00:31:42.948114] [DEBUG] [LOCAL ] WCN: Trimmed 69499 records to 48248 (keeping 200 days of data) [2025-10-24T00:31:43.323668] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-24T00:31:43.324857] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-24T00:31:43.325813] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-24T00:31:43.326442] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-24T00:31:43.341738] [DEBUG] [LOCAL ] WDH: Trimmed 23958 records to 18142 (keeping 200 days of data) [2025-10-24T00:31:43.569710] [DEBUG] [LOCAL ] WDH: Primary data saved (18142 records). [2025-10-24T00:31:43.577991] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-24T00:31:43.586768] [INFO ] [MAIN ] Update Progress: 2273/2367 symbols completed. WDH took 25.3s. Estimated remaining: 12m 4s. Rate: 7.8 symbols/min [2025-10-24T00:31:43.765080] [DEBUG] [LOCAL ] WCN: Primary data saved (48248 records). [2025-10-24T00:31:43.785819] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-24T00:31:43.828551] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:43.829086] [INFO ] [MAIN ] Update Progress: 2274/2367 symbols completed. WCN took 31.8s. Estimated remaining: 11m 56s. Rate: 7.8 symbols/min [2025-10-24T00:31:44.023847] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:44.025338] [DEBUG] [LOCAL ] WDI: Loaded 21235 existing records from primary storage. [2025-10-24T00:31:44.025996] [INFO ] [MAIN ] WDI: Loaded 21235 existing records. [2025-10-24T00:31:44.212669] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:44.213493] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-24T00:31:44.234250] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-24T00:31:44.245769] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-24T00:31:44.258496] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-24T00:31:44.387849] [DEBUG] [LOCAL ] WDS: Loaded 43018 existing records from primary storage. [2025-10-24T00:31:44.421169] [INFO ] [MAIN ] WDS: Loaded 43018 existing records. [2025-10-24T00:31:44.855932] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:44.887583] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-24T00:31:44.888145] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-24T00:31:44.888692] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-24T00:31:44.888784] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-24T00:31:48.117508] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-24T00:31:48.475009] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-24T00:31:48.475128] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-24T00:31:48.475859] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-24T00:31:48.475938] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-24T00:31:48.476726] [DEBUG] [LOCAL ] WD: Trimmed 33026 records to 22618 (keeping 200 days of data) [2025-10-24T00:31:48.616313] [DEBUG] [LOCAL ] WD: Primary data saved (22618 records). [2025-10-24T00:31:48.616494] [INFO ] [MAIN ] WD: Full history saved. [2025-10-24T00:31:48.616605] [INFO ] [MAIN ] Update Progress: 2275/2367 symbols completed. WD took 30.7s. Estimated remaining: 11m 48s. Rate: 7.8 symbols/min [2025-10-24T00:31:48.780093] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:48.789853] [DEBUG] [LOCAL ] WEA: Loaded 7893 existing records from primary storage. [2025-10-24T00:31:48.790071] [INFO ] [MAIN ] WEA: Loaded 7893 existing records. [2025-10-24T00:31:48.965922] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:48.966130] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-24T00:31:48.966203] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-24T00:31:48.966401] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-24T00:31:48.966474] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-24T00:31:53.354517] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-24T00:31:53.750850] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-24T00:31:53.750968] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-24T00:31:53.752068] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-24T00:31:53.752146] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-24T00:31:53.753255] [DEBUG] [LOCAL ] WCC: Trimmed 57028 records to 38640 (keeping 200 days of data) [2025-10-24T00:31:53.992170] [DEBUG] [LOCAL ] WCC: Primary data saved (38640 records). [2025-10-24T00:31:53.992346] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-24T00:31:53.992461] [INFO ] [MAIN ] Update Progress: 2276/2367 symbols completed. WCC took 44.2s. Estimated remaining: 11m 40s. Rate: 7.8 symbols/min [2025-10-24T00:31:54.164920] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:31:54.202180] [DEBUG] [LOCAL ] WEAV: Loaded 42360 existing records from primary storage. [2025-10-24T00:31:54.202487] [INFO ] [MAIN ] WEAV: Loaded 42360 existing records. [2025-10-24T00:31:54.377209] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:31:54.377443] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-24T00:31:54.377519] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-24T00:31:54.377774] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-24T00:31:54.377850] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-24T00:32:11.415875] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-24T00:32:11.778131] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-24T00:32:11.778242] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-24T00:32:11.778946] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-24T00:32:11.779029] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-24T00:32:11.779867] [DEBUG] [LOCAL ] WDI: Trimmed 30330 records to 21400 (keeping 200 days of data) [2025-10-24T00:32:11.913055] [DEBUG] [LOCAL ] WDI: Primary data saved (21400 records). [2025-10-24T00:32:11.913244] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-24T00:32:11.913427] [INFO ] [MAIN ] Update Progress: 2277/2367 symbols completed. WDI took 28.3s. Estimated remaining: 11m 33s. Rate: 7.8 symbols/min [2025-10-24T00:32:18.805827] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-24T00:32:19.213429] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-24T00:32:19.213613] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-24T00:32:19.215971] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-24T00:32:19.216148] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-24T00:32:19.219134] [DEBUG] [LOCAL ] WDS: Trimmed 64166 records to 43353 (keeping 200 days of data) [2025-10-24T00:32:19.524088] [DEBUG] [LOCAL ] WDS: Primary data saved (43353 records). [2025-10-24T00:32:19.524277] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-24T00:32:19.524410] [INFO ] [MAIN ] Update Progress: 2278/2367 symbols completed. WDS took 35.7s. Estimated remaining: 11m 25s. Rate: 7.8 symbols/min [2025-10-24T00:32:19.900370] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-24T00:32:20.246074] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-24T00:32:20.438425] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-24T00:32:20.454355] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-24T00:32:20.454803] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-24T00:32:20.460183] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-24T00:32:20.523903] [DEBUG] [LOCAL ] WEA: Trimmed 10117 records to 7912 (keeping 200 days of data) [2025-10-24T00:32:20.722698] [DEBUG] [LOCAL ] WEA: Primary data saved (7912 records). [2025-10-24T00:32:20.738347] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-24T00:32:20.762004] [INFO ] [MAIN ] Update Progress: 2279/2367 symbols completed. WEA took 32.1s. Estimated remaining: 11m 17s. Rate: 7.8 symbols/min [2025-10-24T00:32:20.811932] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-24T00:32:20.812061] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-24T00:32:20.813438] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-24T00:32:20.813537] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-24T00:32:20.814879] [DEBUG] [LOCAL ] WEAV: Trimmed 61765 records to 42662 (keeping 200 days of data) [2025-10-24T00:32:21.048088] [DEBUG] [LOCAL ] WEAV: Primary data saved (42662 records). [2025-10-24T00:32:21.048290] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-24T00:32:21.048423] [INFO ] [MAIN ] Update Progress: 2280/2367 symbols completed. WEAV took 27.1s. Estimated remaining: 11m 9s. Rate: 7.8 symbols/min [2025-10-24T00:32:21.680688] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:21.679833] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:21.759968] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:21.764358] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:21.840529] [DEBUG] [LOCAL ] WEX: Loaded 32398 existing records from primary storage. [2025-10-24T00:32:21.841085] [INFO ] [MAIN ] WEX: Loaded 32398 existing records. [2025-10-24T00:32:21.955181] [DEBUG] [LOCAL ] WES: Loaded 48723 existing records from primary storage. [2025-10-24T00:32:21.994539] [INFO ] [MAIN ] WES: Loaded 48723 existing records. [2025-10-24T00:32:22.000374] [DEBUG] [LOCAL ] WELL: Loaded 52296 existing records from primary storage. [2025-10-24T00:32:22.001370] [DEBUG] [LOCAL ] WEC: Loaded 52169 existing records from primary storage. [2025-10-24T00:32:22.050365] [INFO ] [MAIN ] WELL: Loaded 52296 existing records. [2025-10-24T00:32:22.149917] [INFO ] [MAIN ] WEC: Loaded 52169 existing records. [2025-10-24T00:32:22.227137] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:22.290748] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-24T00:32:22.363130] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-24T00:32:22.473520] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:22.459567] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-24T00:32:22.489817] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-24T00:32:22.495262] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-24T00:32:22.521468] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-24T00:32:22.656178] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:22.652444] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-24T00:32:22.682599] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:22.682799] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-24T00:32:22.703565] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-24T00:32:22.708894] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-24T00:32:22.720092] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-24T00:32:22.730472] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-24T00:32:22.765098] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-24T00:32:22.802020] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-24T00:32:22.846954] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-24T00:32:22.877120] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-24T00:32:47.577897] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-24T00:32:47.948894] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-24T00:32:47.949004] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-24T00:32:47.950119] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-24T00:32:47.950198] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-24T00:32:47.951323] [DEBUG] [LOCAL ] WEX: Trimmed 50418 records to 32584 (keeping 200 days of data) [2025-10-24T00:32:48.146913] [DEBUG] [LOCAL ] WEX: Primary data saved (32584 records). [2025-10-24T00:32:48.147102] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-24T00:32:48.148193] [INFO ] [MAIN ] Update Progress: 2281/2367 symbols completed. WEX took 27.0s. Estimated remaining: 11m 2s. Rate: 7.8 symbols/min [2025-10-24T00:32:48.317024] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:48.329058] [DEBUG] [LOCAL ] WF: Loaded 10726 existing records from primary storage. [2025-10-24T00:32:48.329294] [INFO ] [MAIN ] WF: Loaded 10726 existing records. [2025-10-24T00:32:48.506444] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:48.506676] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-24T00:32:48.506751] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-24T00:32:48.506951] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-24T00:32:48.507028] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-24T00:32:50.478759] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-24T00:32:50.890596] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-24T00:32:50.890723] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-24T00:32:50.891978] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-24T00:32:50.892056] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-24T00:32:50.893420] [DEBUG] [LOCAL ] WEC: Trimmed 75897 records to 52524 (keeping 200 days of data) [2025-10-24T00:32:51.218077] [DEBUG] [LOCAL ] WEC: Primary data saved (52524 records). [2025-10-24T00:32:51.218185] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-24T00:32:51.218270] [INFO ] [MAIN ] Update Progress: 2282/2367 symbols completed. WEC took 30.2s. Estimated remaining: 10m 54s. Rate: 7.8 symbols/min [2025-10-24T00:32:51.387132] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:51.436199] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-24T00:32:51.436595] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-24T00:32:51.611285] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:51.611480] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-24T00:32:51.611555] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-24T00:32:51.611819] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-24T00:32:51.611899] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-24T00:32:52.026070] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-24T00:32:52.418637] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-24T00:32:52.418778] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-24T00:32:52.420248] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-24T00:32:52.420334] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-24T00:32:52.421853] [DEBUG] [LOCAL ] WELL: Trimmed 76007 records to 52666 (keeping 200 days of data) [2025-10-24T00:32:52.738440] [DEBUG] [LOCAL ] WELL: Primary data saved (52666 records). [2025-10-24T00:32:52.738614] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-24T00:32:52.738745] [INFO ] [MAIN ] Update Progress: 2283/2367 symbols completed. WELL took 31.7s. Estimated remaining: 10m 46s. Rate: 7.8 symbols/min [2025-10-24T00:32:52.909082] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:52.931711] [DEBUG] [LOCAL ] WFG: Loaded 24486 existing records from primary storage. [2025-10-24T00:32:52.932005] [INFO ] [MAIN ] WFG: Loaded 24486 existing records. [2025-10-24T00:32:53.106544] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:53.106809] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-24T00:32:53.106883] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-24T00:32:53.107081] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-24T00:32:53.107152] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-24T00:32:56.933618] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-24T00:32:57.308175] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-24T00:32:57.308281] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-24T00:32:57.309353] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-24T00:32:57.309432] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-24T00:32:57.310816] [DEBUG] [LOCAL ] WES: Trimmed 70651 records to 49086 (keeping 200 days of data) [2025-10-24T00:32:57.598340] [DEBUG] [LOCAL ] WES: Primary data saved (49086 records). [2025-10-24T00:32:57.598495] [INFO ] [MAIN ] WES: Full history saved. [2025-10-24T00:32:57.598606] [INFO ] [MAIN ] Update Progress: 2284/2367 symbols completed. WES took 36.5s. Estimated remaining: 10m 39s. Rate: 7.8 symbols/min [2025-10-24T00:32:57.769269] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:32:57.804733] [DEBUG] [LOCAL ] WGO: Loaded 37944 existing records from primary storage. [2025-10-24T00:32:57.805047] [INFO ] [MAIN ] WGO: Loaded 37944 existing records. [2025-10-24T00:32:57.978051] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:32:57.978334] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-24T00:32:57.978410] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-24T00:32:57.978681] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-24T00:32:57.978763] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-24T00:33:09.578682] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-24T00:33:09.941758] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-24T00:33:09.941876] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-24T00:33:09.942221] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-24T00:33:09.942296] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-24T00:33:09.942867] [DEBUG] [LOCAL ] WF: Trimmed 16010 records to 10779 (keeping 200 days of data) [2025-10-24T00:33:10.006123] [DEBUG] [LOCAL ] WF: Primary data saved (10779 records). [2025-10-24T00:33:10.006264] [INFO ] [MAIN ] WF: Full history saved. [2025-10-24T00:33:10.006371] [INFO ] [MAIN ] Update Progress: 2285/2367 symbols completed. WF took 21.9s. Estimated remaining: 10m 31s. Rate: 7.8 symbols/min [2025-10-24T00:33:10.172740] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:10.213865] [DEBUG] [LOCAL ] WH: Loaded 45260 existing records from primary storage. [2025-10-24T00:33:10.214169] [INFO ] [MAIN ] WH: Loaded 45260 existing records. [2025-10-24T00:33:10.390102] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:10.390279] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-24T00:33:10.390351] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-24T00:33:10.390611] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-24T00:33:10.390721] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-24T00:33:24.747925] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-24T00:33:25.128738] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-24T00:33:25.128866] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-24T00:33:25.129963] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-24T00:33:25.130070] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-24T00:33:25.131206] [DEBUG] [LOCAL ] WGO: Trimmed 57183 records to 38321 (keeping 200 days of data) [2025-10-24T00:33:25.359862] [DEBUG] [LOCAL ] WGO: Primary data saved (38321 records). [2025-10-24T00:33:25.360036] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-24T00:33:25.360179] [INFO ] [MAIN ] Update Progress: 2286/2367 symbols completed. WGO took 27.8s. Estimated remaining: 10m 24s. Rate: 7.8 symbols/min [2025-10-24T00:33:25.527945] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:25.571979] [DEBUG] [LOCAL ] WHD: Loaded 39955 existing records from primary storage. [2025-10-24T00:33:25.572271] [INFO ] [MAIN ] WHD: Loaded 39955 existing records. [2025-10-24T00:33:25.749319] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:25.749581] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-24T00:33:25.749684] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-24T00:33:25.749897] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-24T00:33:25.749968] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-24T00:33:27.479436] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-24T00:33:27.842943] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-24T00:33:27.843048] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-24T00:33:27.843608] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-24T00:33:27.843699] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-24T00:33:27.844615] [DEBUG] [LOCAL ] WFG: Trimmed 36532 records to 24704 (keeping 200 days of data) [2025-10-24T00:33:27.995938] [DEBUG] [LOCAL ] WFG: Primary data saved (24704 records). [2025-10-24T00:33:27.996098] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-24T00:33:27.996207] [INFO ] [MAIN ] Update Progress: 2287/2367 symbols completed. WFG took 35.3s. Estimated remaining: 10m 16s. Rate: 7.8 symbols/min [2025-10-24T00:33:28.167430] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:28.172920] [DEBUG] [LOCAL ] WHG: Loaded 3052 existing records from primary storage. [2025-10-24T00:33:28.173125] [INFO ] [MAIN ] WHG: Loaded 3052 existing records. [2025-10-24T00:33:28.346797] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:28.347007] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-24T00:33:28.347081] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-24T00:33:28.347242] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-24T00:33:28.347314] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-24T00:33:30.174994] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-24T00:33:30.571802] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-24T00:33:30.571982] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-24T00:33:30.573400] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-24T00:33:30.573481] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-24T00:33:30.601188] [DEBUG] [LOCAL ] WFC: Trimmed 77927 records to 54138 (keeping 200 days of data) [2025-10-24T00:33:30.949156] [DEBUG] [LOCAL ] WFC: Primary data saved (54138 records). [2025-10-24T00:33:30.953054] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-24T00:33:30.953253] [INFO ] [MAIN ] Update Progress: 2288/2367 symbols completed. WFC took 39.7s. Estimated remaining: 10m 8s. Rate: 7.8 symbols/min [2025-10-24T00:33:31.147682] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:31.199608] [DEBUG] [LOCAL ] WHR: Loaded 48900 existing records from primary storage. [2025-10-24T00:33:31.200992] [INFO ] [MAIN ] WHR: Loaded 48900 existing records. [2025-10-24T00:33:31.374938] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:31.375165] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-24T00:33:31.375243] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-24T00:33:31.375464] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-24T00:33:31.375536] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-24T00:33:37.594354] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-24T00:33:38.098706] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-24T00:33:38.098891] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-24T00:33:38.100225] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-24T00:33:38.100320] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-24T00:33:38.101736] [DEBUG] [LOCAL ] WH: Trimmed 65737 records to 45647 (keeping 200 days of data) [2025-10-24T00:33:38.388946] [DEBUG] [LOCAL ] WH: Primary data saved (45647 records). [2025-10-24T00:33:38.389101] [INFO ] [MAIN ] WH: Full history saved. [2025-10-24T00:33:38.389221] [INFO ] [MAIN ] Update Progress: 2289/2367 symbols completed. WH took 28.4s. Estimated remaining: 10m 0s. Rate: 7.8 symbols/min [2025-10-24T00:33:38.608773] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:38.616499] [DEBUG] [LOCAL ] WIA: Loaded 5029 existing records from primary storage. [2025-10-24T00:33:38.616771] [INFO ] [MAIN ] WIA: Loaded 5029 existing records. [2025-10-24T00:33:38.807102] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:38.807305] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-24T00:33:38.807379] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-24T00:33:38.807586] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-24T00:33:38.807714] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-24T00:33:56.369198] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-24T00:33:56.716052] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-24T00:33:56.716160] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-24T00:33:56.716327] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-24T00:33:56.716401] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-24T00:33:56.716825] [DEBUG] [LOCAL ] WHG: Trimmed 4359 records to 3056 (keeping 200 days of data) [2025-10-24T00:33:56.735555] [DEBUG] [LOCAL ] WHG: Primary data saved (3056 records). [2025-10-24T00:33:56.735676] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-24T00:33:56.735783] [INFO ] [MAIN ] Update Progress: 2290/2367 symbols completed. WHG took 28.7s. Estimated remaining: 9m 53s. Rate: 7.8 symbols/min [2025-10-24T00:33:56.904607] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:56.917951] [DEBUG] [LOCAL ] WINN: Loaded 11207 existing records from primary storage. [2025-10-24T00:33:56.918175] [INFO ] [MAIN ] WINN: Loaded 11207 existing records. [2025-10-24T00:33:57.094670] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:57.094936] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-24T00:33:57.095015] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-24T00:33:57.095362] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-24T00:33:57.095439] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-24T00:33:58.217161] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-24T00:33:58.601941] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-24T00:33:58.602160] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-24T00:33:58.602422] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-24T00:33:58.602512] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-24T00:33:58.603223] [DEBUG] [LOCAL ] WIA: Trimmed 7284 records to 5067 (keeping 200 days of data) [2025-10-24T00:33:58.632674] [DEBUG] [LOCAL ] WIA: Primary data saved (5067 records). [2025-10-24T00:33:58.632906] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-24T00:33:58.633025] [INFO ] [MAIN ] Update Progress: 2291/2367 symbols completed. WIA took 20.2s. Estimated remaining: 9m 45s. Rate: 7.8 symbols/min [2025-10-24T00:33:58.837260] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:33:58.883941] [DEBUG] [LOCAL ] WIT: Loaded 52537 existing records from primary storage. [2025-10-24T00:33:58.884284] [INFO ] [MAIN ] WIT: Loaded 52537 existing records. [2025-10-24T00:33:59.060708] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:33:59.060940] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-24T00:33:59.061018] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-24T00:33:59.061445] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-24T00:33:59.061518] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-24T00:34:04.328067] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-24T00:34:04.708235] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-24T00:34:04.708400] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-24T00:34:04.709680] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-24T00:34:04.709780] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-24T00:34:04.710952] [DEBUG] [LOCAL ] WHD: Trimmed 58033 records to 40265 (keeping 200 days of data) [2025-10-24T00:34:04.952679] [DEBUG] [LOCAL ] WHD: Primary data saved (40265 records). [2025-10-24T00:34:04.952840] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-24T00:34:04.954104] [INFO ] [MAIN ] Update Progress: 2292/2367 symbols completed. WHD took 39.6s. Estimated remaining: 9m 37s. Rate: 7.8 symbols/min [2025-10-24T00:34:05.125695] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:05.146182] [DEBUG] [LOCAL ] WIW: Loaded 20236 existing records from primary storage. [2025-10-24T00:34:05.146456] [INFO ] [MAIN ] WIW: Loaded 20236 existing records. [2025-10-24T00:34:05.327097] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:34:05.327385] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-24T00:34:05.327460] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-24T00:34:05.327733] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-24T00:34:05.327815] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-24T00:34:11.463800] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-24T00:34:11.852624] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-24T00:34:11.852855] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-24T00:34:11.854256] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-24T00:34:11.854350] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-24T00:34:11.855855] [DEBUG] [LOCAL ] WHR: Trimmed 69773 records to 49256 (keeping 200 days of data) [2025-10-24T00:34:12.224468] [DEBUG] [LOCAL ] WHR: Primary data saved (49256 records). [2025-10-24T00:34:12.224664] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-24T00:34:12.224802] [INFO ] [MAIN ] Update Progress: 2293/2367 symbols completed. WHR took 41.3s. Estimated remaining: 9m 30s. Rate: 7.8 symbols/min [2025-10-24T00:34:12.390580] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:12.427097] [DEBUG] [LOCAL ] WK: Loaded 37058 existing records from primary storage. [2025-10-24T00:34:12.427435] [INFO ] [MAIN ] WK: Loaded 37058 existing records. [2025-10-24T00:34:12.600207] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:34:12.600428] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-24T00:34:12.600526] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-24T00:34:12.600855] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-24T00:34:12.600935] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-24T00:34:27.974828] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-24T00:34:28.332635] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-24T00:34:28.332770] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-24T00:34:28.333188] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-24T00:34:28.333262] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-24T00:34:28.333837] [DEBUG] [LOCAL ] WINN: Trimmed 17325 records to 11255 (keeping 200 days of data) [2025-10-24T00:34:28.400605] [DEBUG] [LOCAL ] WINN: Primary data saved (11255 records). [2025-10-24T00:34:28.400810] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-24T00:34:28.400927] [INFO ] [MAIN ] Update Progress: 2294/2367 symbols completed. WINN took 31.7s. Estimated remaining: 9m 22s. Rate: 7.8 symbols/min [2025-10-24T00:34:28.565933] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:28.597918] [DEBUG] [LOCAL ] WKC: Loaded 34432 existing records from primary storage. [2025-10-24T00:34:28.598216] [INFO ] [MAIN ] WKC: Loaded 34432 existing records. [2025-10-24T00:34:28.782084] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:34:28.782310] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-24T00:34:28.782388] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-24T00:34:28.782676] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-24T00:34:28.782763] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-24T00:34:30.398075] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-24T00:34:30.806768] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-24T00:34:30.806900] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-24T00:34:30.808191] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-24T00:34:30.808269] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-24T00:34:30.809683] [DEBUG] [LOCAL ] WIT: Trimmed 76019 records to 52922 (keeping 200 days of data) [2025-10-24T00:34:31.130969] [DEBUG] [LOCAL ] WIT: Primary data saved (52922 records). [2025-10-24T00:34:31.131129] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-24T00:34:31.131241] [INFO ] [MAIN ] Update Progress: 2295/2367 symbols completed. WIT took 32.5s. Estimated remaining: 9m 14s. Rate: 7.8 symbols/min [2025-10-24T00:34:31.303870] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:31.343234] [DEBUG] [LOCAL ] WLK: Loaded 45827 existing records from primary storage. [2025-10-24T00:34:31.343557] [INFO ] [MAIN ] WLK: Loaded 45827 existing records. [2025-10-24T00:34:31.516559] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:34:31.516782] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-24T00:34:31.516858] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-24T00:34:31.517075] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-24T00:34:31.517146] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-24T00:34:42.706555] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-24T00:34:43.071668] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-24T00:34:43.071775] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-24T00:34:43.072395] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-24T00:34:43.072468] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-24T00:34:43.073200] [DEBUG] [LOCAL ] WIW: Trimmed 29282 records to 20389 (keeping 200 days of data) [2025-10-24T00:34:43.191283] [DEBUG] [LOCAL ] WIW: Primary data saved (20389 records). [2025-10-24T00:34:43.191431] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-24T00:34:43.191539] [INFO ] [MAIN ] Update Progress: 2296/2367 symbols completed. WIW took 38.2s. Estimated remaining: 9m 7s. Rate: 7.8 symbols/min [2025-10-24T00:34:43.364391] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:43.373421] [DEBUG] [LOCAL ] WLKP: Loaded 7193 existing records from primary storage. [2025-10-24T00:34:43.373666] [INFO ] [MAIN ] WLKP: Loaded 7193 existing records. [2025-10-24T00:34:43.549880] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:34:43.550096] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-24T00:34:43.550168] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-24T00:34:43.550363] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-24T00:34:43.550442] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-24T00:34:44.738789] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-24T00:34:45.117546] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-24T00:34:45.117730] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-24T00:34:45.118848] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-24T00:34:45.118926] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-24T00:34:45.120005] [DEBUG] [LOCAL ] WK: Trimmed 53472 records to 37264 (keeping 200 days of data) [2025-10-24T00:34:45.334993] [DEBUG] [LOCAL ] WK: Primary data saved (37264 records). [2025-10-24T00:34:45.335164] [INFO ] [MAIN ] WK: Full history saved. [2025-10-24T00:34:45.335278] [INFO ] [MAIN ] Update Progress: 2297/2367 symbols completed. WK took 33.1s. Estimated remaining: 8m 59s. Rate: 7.8 symbols/min [2025-10-24T00:34:45.505612] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:45.505863] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-24T00:34:45.505936] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-24T00:34:45.506043] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-24T00:34:45.506112] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-24T00:34:45.506192] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-24T00:34:45.506280] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-24T00:34:54.992726] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-24T00:34:55.370535] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-24T00:34:55.370667] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-24T00:34:55.371634] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-24T00:34:55.371733] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-24T00:34:55.372769] [DEBUG] [LOCAL ] WKC: Trimmed 50160 records to 34728 (keeping 200 days of data) [2025-10-24T00:34:55.582476] [DEBUG] [LOCAL ] WKC: Primary data saved (34728 records). [2025-10-24T00:34:55.582625] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-24T00:34:55.582762] [INFO ] [MAIN ] Update Progress: 2298/2367 symbols completed. WKC took 27.2s. Estimated remaining: 8m 51s. Rate: 7.8 symbols/min [2025-10-24T00:34:55.759492] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:34:55.787781] [DEBUG] [LOCAL ] WLY: Loaded 29776 existing records from primary storage. [2025-10-24T00:34:55.788077] [INFO ] [MAIN ] WLY: Loaded 29776 existing records. [2025-10-24T00:34:55.966036] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:34:55.966264] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-24T00:34:55.966340] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-24T00:34:55.966539] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-24T00:34:55.966612] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-24T00:35:04.366175] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-24T00:35:04.544417] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-24T00:35:04.544660] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-24T00:35:04.544743] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-24T00:35:04.544832] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-24T00:35:04.544953] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-24T00:35:04.545051] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-24T00:35:04.545168] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-24T00:35:04.545291] [INFO ] [MAIN ] Update Progress: 2299/2367 symbols completed. WLTG took 19.2s. Estimated remaining: 8m 44s. Rate: 7.8 symbols/min [2025-10-24T00:35:04.719713] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:04.768993] [DEBUG] [LOCAL ] WM: Loaded 50847 existing records from primary storage. [2025-10-24T00:35:04.769360] [INFO ] [MAIN ] WM: Loaded 50847 existing records. [2025-10-24T00:35:04.971787] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:04.972088] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-24T00:35:04.972170] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-24T00:35:04.972412] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-24T00:35:04.972506] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-24T00:35:08.631337] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-24T00:35:09.031719] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-24T00:35:09.031857] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-24T00:35:09.033058] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-24T00:35:09.033182] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-24T00:35:09.034600] [DEBUG] [LOCAL ] WLK: Trimmed 64094 records to 46176 (keeping 200 days of data) [2025-10-24T00:35:09.310361] [DEBUG] [LOCAL ] WLK: Primary data saved (46176 records). [2025-10-24T00:35:09.310512] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-24T00:35:09.310619] [INFO ] [MAIN ] Update Progress: 2300/2367 symbols completed. WLK took 38.2s. Estimated remaining: 8m 36s. Rate: 7.8 symbols/min [2025-10-24T00:35:09.476216] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:09.523286] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-24T00:35:09.523619] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-24T00:35:09.702769] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:09.702974] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-24T00:35:09.703050] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-24T00:35:09.703296] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-24T00:35:09.703370] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-24T00:35:11.310060] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-24T00:35:11.660880] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-24T00:35:11.661007] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-24T00:35:11.661275] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-24T00:35:11.661351] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-24T00:35:11.661857] [DEBUG] [LOCAL ] WLKP: Trimmed 10072 records to 7323 (keeping 200 days of data) [2025-10-24T00:35:11.705059] [DEBUG] [LOCAL ] WLKP: Primary data saved (7323 records). [2025-10-24T00:35:11.705213] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-24T00:35:11.705303] [INFO ] [MAIN ] Update Progress: 2301/2367 symbols completed. WLKP took 28.5s. Estimated remaining: 8m 28s. Rate: 7.8 symbols/min [2025-10-24T00:35:11.873587] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:11.887304] [DEBUG] [LOCAL ] WMK: Loaded 14666 existing records from primary storage. [2025-10-24T00:35:11.887559] [INFO ] [MAIN ] WMK: Loaded 14666 existing records. [2025-10-24T00:35:12.062830] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:12.063003] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-24T00:35:12.063076] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-24T00:35:12.063295] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-24T00:35:12.063369] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-24T00:35:27.681703] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-24T00:35:28.063385] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-24T00:35:28.063491] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-24T00:35:28.064518] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-24T00:35:28.064601] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-24T00:35:28.065515] [DEBUG] [LOCAL ] WLY: Trimmed 42931 records to 29962 (keeping 200 days of data) [2025-10-24T00:35:28.248222] [DEBUG] [LOCAL ] WLY: Primary data saved (29962 records). [2025-10-24T00:35:28.248381] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-24T00:35:28.248510] [INFO ] [MAIN ] Update Progress: 2302/2367 symbols completed. WLY took 32.7s. Estimated remaining: 8m 20s. Rate: 7.8 symbols/min [2025-10-24T00:35:28.418113] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:28.456093] [DEBUG] [LOCAL ] WMS: Loaded 39517 existing records from primary storage. [2025-10-24T00:35:28.456393] [INFO ] [MAIN ] WMS: Loaded 39517 existing records. [2025-10-24T00:35:28.631778] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:28.631974] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-24T00:35:28.632050] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-24T00:35:28.632376] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-24T00:35:28.632443] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-24T00:35:40.706369] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-24T00:35:40.924918] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-24T00:35:41.343489] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-24T00:35:41.380582] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-24T00:35:41.410795] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-24T00:35:41.413126] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-24T00:35:41.490175] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 54062 (keeping 200 days of data) [2025-10-24T00:35:41.500430] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-24T00:35:41.501074] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-24T00:35:41.501629] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-24T00:35:41.501747] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-24T00:35:41.502409] [DEBUG] [LOCAL ] WMK: Trimmed 20022 records to 14724 (keeping 200 days of data) [2025-10-24T00:35:41.701923] [DEBUG] [LOCAL ] WMK: Primary data saved (14724 records). [2025-10-24T00:35:41.712275] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-24T00:35:41.717164] [INFO ] [MAIN ] Update Progress: 2303/2367 symbols completed. WMK took 30.0s. Estimated remaining: 8m 13s. Rate: 7.8 symbols/min [2025-10-24T00:35:42.035982] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:42.138269] [DEBUG] [LOCAL ] WMB: Primary data saved (54062 records). [2025-10-24T00:35:42.138504] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-24T00:35:42.138622] [INFO ] [MAIN ] Update Progress: 2304/2367 symbols completed. WMB took 32.8s. Estimated remaining: 8m 5s. Rate: 7.8 symbols/min [2025-10-24T00:35:42.339980] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:42.342577] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-24T00:35:42.343039] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-24T00:35:42.553296] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:42.563473] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-24T00:35:42.563630] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-24T00:35:42.564177] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-24T00:35:42.564278] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-24T00:35:42.700573] [DEBUG] [LOCAL ] WNC: Loaded 38118 existing records from primary storage. [2025-10-24T00:35:42.729755] [INFO ] [MAIN ] WNC: Loaded 38118 existing records. [2025-10-24T00:35:43.171141] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:43.174747] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-24T00:35:43.184004] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-24T00:35:43.184400] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-24T00:35:43.184788] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-24T00:35:43.257281] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-24T00:35:43.986255] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-24T00:35:43.986374] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-24T00:35:43.987574] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-24T00:35:43.987696] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-24T00:35:43.989183] [DEBUG] [LOCAL ] WM: Trimmed 73834 records to 51209 (keeping 200 days of data) [2025-10-24T00:35:44.309527] [DEBUG] [LOCAL ] WM: Primary data saved (51209 records). [2025-10-24T00:35:44.309726] [INFO ] [MAIN ] WM: Full history saved. [2025-10-24T00:35:44.309841] [INFO ] [MAIN ] Update Progress: 2305/2367 symbols completed. WM took 39.8s. Estimated remaining: 7m 57s. Rate: 7.8 symbols/min [2025-10-24T00:35:44.473156] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:35:44.526052] [DEBUG] [LOCAL ] WOLF: Loaded 53071 existing records from primary storage. [2025-10-24T00:35:44.526430] [INFO ] [MAIN ] WOLF: Loaded 53071 existing records. [2025-10-24T00:35:44.702112] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:35:44.702304] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-24T00:35:44.702377] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-24T00:35:44.702639] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-24T00:35:44.702751] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-24T00:36:04.643983] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-24T00:36:05.059188] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-24T00:36:05.059298] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-24T00:36:05.060437] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-24T00:36:05.060515] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-24T00:36:05.062007] [DEBUG] [LOCAL ] WMS: Trimmed 57080 records to 39739 (keeping 200 days of data) [2025-10-24T00:36:05.306847] [DEBUG] [LOCAL ] WMS: Primary data saved (39739 records). [2025-10-24T00:36:05.307010] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-24T00:36:05.307122] [INFO ] [MAIN ] Update Progress: 2306/2367 symbols completed. WMS took 37.1s. Estimated remaining: 7m 50s. Rate: 7.8 symbols/min [2025-10-24T00:36:05.477113] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:05.499891] [DEBUG] [LOCAL ] WOR: Loaded 23551 existing records from primary storage. [2025-10-24T00:36:05.500168] [INFO ] [MAIN ] WOR: Loaded 23551 existing records. [2025-10-24T00:36:05.679139] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:05.679332] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-24T00:36:05.679408] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-24T00:36:05.679865] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-24T00:36:05.679943] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-24T00:36:06.059847] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-24T00:36:06.485823] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-24T00:36:06.486095] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-24T00:36:06.487285] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-24T00:36:06.487488] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-24T00:36:06.500756] [DEBUG] [LOCAL ] WNC: Trimmed 57794 records to 38303 (keeping 200 days of data) [2025-10-24T00:36:06.763560] [DEBUG] [LOCAL ] WNC: Primary data saved (38303 records). [2025-10-24T00:36:06.763762] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-24T00:36:06.763893] [INFO ] [MAIN ] Update Progress: 2307/2367 symbols completed. WNC took 24.6s. Estimated remaining: 7m 42s. Rate: 7.8 symbols/min [2025-10-24T00:36:06.935052] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:06.961959] [DEBUG] [LOCAL ] WOW: Loaded 31103 existing records from primary storage. [2025-10-24T00:36:06.962289] [INFO ] [MAIN ] WOW: Loaded 31103 existing records. [2025-10-24T00:36:07.136904] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:07.137145] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-24T00:36:07.137238] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-24T00:36:07.137888] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-24T00:36:07.137980] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-24T00:36:14.999724] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-24T00:36:15.428992] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-24T00:36:15.429166] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-24T00:36:15.430611] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-24T00:36:15.430713] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-24T00:36:15.432467] [DEBUG] [LOCAL ] WOLF: Trimmed 77138 records to 53356 (keeping 200 days of data) [2025-10-24T00:36:15.772126] [DEBUG] [LOCAL ] WOLF: Primary data saved (53356 records). [2025-10-24T00:36:15.772306] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-24T00:36:15.772421] [INFO ] [MAIN ] Update Progress: 2308/2367 symbols completed. WOLF took 31.5s. Estimated remaining: 7m 34s. Rate: 7.8 symbols/min [2025-10-24T00:36:15.937284] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:15.989984] [DEBUG] [LOCAL ] WPC: Loaded 48154 existing records from primary storage. [2025-10-24T00:36:15.990413] [INFO ] [MAIN ] WPC: Loaded 48154 existing records. [2025-10-24T00:36:16.171177] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:16.171377] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-24T00:36:16.171449] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-24T00:36:16.171735] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-24T00:36:16.171814] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-24T00:36:22.726679] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-24T00:36:23.123842] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-24T00:36:23.123998] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-24T00:36:23.125540] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-24T00:36:23.125630] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-24T00:36:23.127278] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 54190 (keeping 200 days of data) [2025-10-24T00:36:23.553754] [DEBUG] [LOCAL ] WMT: Primary data saved (54190 records). [2025-10-24T00:36:23.553940] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-24T00:36:23.555386] [INFO ] [MAIN ] Update Progress: 2309/2367 symbols completed. WMT took 41.8s. Estimated remaining: 7m 27s. Rate: 7.8 symbols/min [2025-10-24T00:36:23.771205] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:23.832322] [DEBUG] [LOCAL ] WPM: Loaded 52787 existing records from primary storage. [2025-10-24T00:36:23.832748] [INFO ] [MAIN ] WPM: Loaded 52787 existing records. [2025-10-24T00:36:24.013294] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:24.013573] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-24T00:36:24.013677] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-24T00:36:24.014117] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-24T00:36:24.014194] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-24T00:36:25.225629] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-24T00:36:25.603340] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-24T00:36:25.604346] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-24T00:36:25.605167] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-24T00:36:25.605342] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-24T00:36:25.606441] [DEBUG] [LOCAL ] WOR: Trimmed 36255 records to 23641 (keeping 200 days of data) [2025-10-24T00:36:25.745919] [DEBUG] [LOCAL ] WOR: Primary data saved (23641 records). [2025-10-24T00:36:25.746123] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-24T00:36:25.746243] [INFO ] [MAIN ] Update Progress: 2310/2367 symbols completed. WOR took 20.4s. Estimated remaining: 7m 19s. Rate: 7.8 symbols/min [2025-10-24T00:36:25.915412] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:25.949389] [DEBUG] [LOCAL ] WPP: Loaded 34340 existing records from primary storage. [2025-10-24T00:36:25.949749] [INFO ] [MAIN ] WPP: Loaded 34340 existing records. [2025-10-24T00:36:26.130662] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:26.130957] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-24T00:36:26.131035] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-24T00:36:26.131252] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-24T00:36:26.131339] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-24T00:36:42.557252] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-24T00:36:42.936803] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-24T00:36:42.936928] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-24T00:36:42.937854] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-24T00:36:42.937931] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-24T00:36:42.938983] [DEBUG] [LOCAL ] WOW: Trimmed 43111 records to 31346 (keeping 200 days of data) [2025-10-24T00:36:43.110298] [DEBUG] [LOCAL ] WOW: Primary data saved (31346 records). [2025-10-24T00:36:43.110512] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-24T00:36:43.110674] [INFO ] [MAIN ] Update Progress: 2311/2367 symbols completed. WOW took 36.3s. Estimated remaining: 7m 11s. Rate: 7.8 symbols/min [2025-10-24T00:36:43.315206] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:43.363062] [DEBUG] [LOCAL ] WRB: Loaded 50788 existing records from primary storage. [2025-10-24T00:36:43.363400] [INFO ] [MAIN ] WRB: Loaded 50788 existing records. [2025-10-24T00:36:43.535529] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:43.535749] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-24T00:36:43.535825] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-24T00:36:43.536047] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-24T00:36:43.536118] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-24T00:36:51.253074] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-24T00:36:51.637543] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-24T00:36:51.637797] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-24T00:36:51.639200] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-24T00:36:51.639301] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-24T00:36:51.640677] [DEBUG] [LOCAL ] WPC: Trimmed 70458 records to 48471 (keeping 200 days of data) [2025-10-24T00:36:51.987808] [DEBUG] [LOCAL ] WPC: Primary data saved (48471 records). [2025-10-24T00:36:51.988015] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-24T00:36:51.989476] [INFO ] [MAIN ] Update Progress: 2312/2367 symbols completed. WPC took 36.2s. Estimated remaining: 7m 4s. Rate: 7.8 symbols/min [2025-10-24T00:36:52.177193] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:52.222766] [DEBUG] [LOCAL ] WRBY: Loaded 50685 existing records from primary storage. [2025-10-24T00:36:52.223108] [INFO ] [MAIN ] WRBY: Loaded 50685 existing records. [2025-10-24T00:36:52.407729] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:52.407941] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-24T00:36:52.408019] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-24T00:36:52.408245] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-24T00:36:52.408318] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-24T00:36:52.891507] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-24T00:36:53.280186] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-24T00:36:53.280299] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-24T00:36:53.281681] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-24T00:36:53.281764] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-24T00:36:53.283196] [DEBUG] [LOCAL ] WPM: Trimmed 76434 records to 53176 (keeping 200 days of data) [2025-10-24T00:36:53.609364] [DEBUG] [LOCAL ] WPM: Primary data saved (53176 records). [2025-10-24T00:36:53.609463] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-24T00:36:53.610809] [INFO ] [MAIN ] Update Progress: 2313/2367 symbols completed. WPM took 30.1s. Estimated remaining: 6m 56s. Rate: 7.8 symbols/min [2025-10-24T00:36:53.789760] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:53.812880] [DEBUG] [LOCAL ] WS: Loaded 23459 existing records from primary storage. [2025-10-24T00:36:53.813155] [INFO ] [MAIN ] WS: Loaded 23459 existing records. [2025-10-24T00:36:54.001244] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:54.001488] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-24T00:36:54.001570] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-24T00:36:54.001847] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-24T00:36:54.001926] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-24T00:36:56.674072] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-24T00:36:57.055769] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-24T00:36:57.055879] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-24T00:36:57.056853] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-24T00:36:57.056930] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-24T00:36:57.057986] [DEBUG] [LOCAL ] WPP: Trimmed 47767 records to 34564 (keeping 200 days of data) [2025-10-24T00:36:57.265417] [DEBUG] [LOCAL ] WPP: Primary data saved (34564 records). [2025-10-24T00:36:57.265599] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-24T00:36:57.265732] [INFO ] [MAIN ] Update Progress: 2314/2367 symbols completed. WPP took 31.5s. Estimated remaining: 6m 48s. Rate: 7.8 symbols/min [2025-10-24T00:36:57.441165] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:36:57.485368] [DEBUG] [LOCAL ] WSM: Loaded 48709 existing records from primary storage. [2025-10-24T00:36:57.485859] [INFO ] [MAIN ] WSM: Loaded 48709 existing records. [2025-10-24T00:36:57.674540] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:36:57.675053] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-24T00:36:57.699789] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-24T00:36:57.700505] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-24T00:36:57.701870] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-24T00:37:20.112607] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-24T00:37:20.290673] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-24T00:37:20.810787] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-24T00:37:20.830422] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-24T00:37:20.832987] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-24T00:37:20.837166] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-24T00:37:20.897874] [DEBUG] [LOCAL ] WRB: Trimmed 73870 records to 51176 (keeping 200 days of data) [2025-10-24T00:37:20.928055] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-24T00:37:20.928482] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-24T00:37:20.928892] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-24T00:37:20.928970] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-24T00:37:21.026866] [DEBUG] [LOCAL ] WS: Trimmed 35480 records to 23638 (keeping 200 days of data) [2025-10-24T00:37:21.365727] [DEBUG] [LOCAL ] WS: Primary data saved (23638 records). [2025-10-24T00:37:21.380679] [INFO ] [MAIN ] WS: Full history saved. [2025-10-24T00:37:21.380801] [INFO ] [MAIN ] Update Progress: 2315/2367 symbols completed. WS took 27.8s. Estimated remaining: 6m 41s. Rate: 7.8 symbols/min [2025-10-24T00:37:21.400388] [DEBUG] [LOCAL ] WRB: Primary data saved (51176 records). [2025-10-24T00:37:21.432215] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-24T00:37:21.481063] [INFO ] [MAIN ] Update Progress: 2316/2367 symbols completed. WRB took 38.4s. Estimated remaining: 6m 33s. Rate: 7.8 symbols/min [2025-10-24T00:37:21.694132] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:21.768016] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:21.799099] [DEBUG] [LOCAL ] WSR: Loaded 22566 existing records from primary storage. [2025-10-24T00:37:21.833586] [DEBUG] [LOCAL ] WSO: Loaded 25878 existing records from primary storage. [2025-10-24T00:37:21.833946] [INFO ] [MAIN ] WSR: Loaded 22566 existing records. [2025-10-24T00:37:21.834208] [INFO ] [MAIN ] WSO: Loaded 25878 existing records. [2025-10-24T00:37:22.221029] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:37:22.225147] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:37:22.225718] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-24T00:37:22.225813] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-24T00:37:22.225978] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-24T00:37:22.226046] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-24T00:37:22.226093] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-24T00:37:22.226246] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-24T00:37:22.257072] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-24T00:37:22.299865] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-24T00:37:24.851986] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-24T00:37:25.257601] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-24T00:37:25.257754] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-24T00:37:25.259068] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-24T00:37:25.259153] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-24T00:37:25.260558] [DEBUG] [LOCAL ] WRBY: Trimmed 73646 records to 51034 (keeping 200 days of data) [2025-10-24T00:37:25.548830] [DEBUG] [LOCAL ] WRBY: Primary data saved (51034 records). [2025-10-24T00:37:25.548990] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-24T00:37:25.549105] [INFO ] [MAIN ] Update Progress: 2317/2367 symbols completed. WRBY took 33.6s. Estimated remaining: 6m 25s. Rate: 7.8 symbols/min [2025-10-24T00:37:26.935960] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-24T00:37:27.323567] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-24T00:37:27.323702] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-24T00:37:27.324976] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-24T00:37:27.325056] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-24T00:37:27.326376] [DEBUG] [LOCAL ] WSM: Trimmed 71303 records to 49047 (keeping 200 days of data) [2025-10-24T00:37:27.634971] [DEBUG] [LOCAL ] WSM: Primary data saved (49047 records). [2025-10-24T00:37:27.635307] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-24T00:37:27.635497] [INFO ] [MAIN ] Update Progress: 2318/2367 symbols completed. WSM took 30.4s. Estimated remaining: 6m 17s. Rate: 7.8 symbols/min [2025-10-24T00:37:39.776189] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-24T00:37:40.189817] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-24T00:37:40.189944] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-24T00:37:40.190924] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-24T00:37:40.191011] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-24T00:37:40.192174] [DEBUG] [LOCAL ] WSO: Trimmed 36012 records to 26088 (keeping 200 days of data) [2025-10-24T00:37:40.315776] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-24T00:37:40.754336] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-24T00:37:40.757673] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-24T00:37:40.758395] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-24T00:37:40.762883] [DEBUG] [LOCAL ] WSO: Primary data saved (26088 records). [2025-10-24T00:37:40.763004] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-24T00:37:40.763316] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-24T00:37:40.763709] [INFO ] [MAIN ] Update Progress: 2319/2367 symbols completed. WSO took 19.4s. Estimated remaining: 6m 10s. Rate: 7.8 symbols/min [2025-10-24T00:37:40.764491] [DEBUG] [LOCAL ] WSR: Trimmed 32668 records to 22684 (keeping 200 days of data) [2025-10-24T00:37:40.912318] [DEBUG] [LOCAL ] WSR: Primary data saved (22684 records). [2025-10-24T00:37:40.912492] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-24T00:37:40.912616] [INFO ] [MAIN ] Update Progress: 2320/2367 symbols completed. WSR took 19.4s. Estimated remaining: 6m 2s. Rate: 7.8 symbols/min [2025-10-24T00:37:41.441391] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:41.522689] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-24T00:37:41.610142] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-24T00:37:41.620626] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:41.640199] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-24T00:37:41.643829] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-24T00:37:41.647151] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-24T00:37:41.645903] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:41.664369] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-24T00:37:41.700097] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:41.876102] [DEBUG] [LOCAL ] WTI: Loaded 44731 existing records from primary storage. [2025-10-24T00:37:41.965727] [INFO ] [MAIN ] WTI: Loaded 44731 existing records. [2025-10-24T00:37:42.049206] [DEBUG] [LOCAL ] WST: Loaded 36684 existing records from primary storage. [2025-10-24T00:37:42.129999] [INFO ] [MAIN ] WST: Loaded 36684 existing records. [2025-10-24T00:37:42.170386] [DEBUG] [LOCAL ] WT: Loaded 48178 existing records from primary storage. [2025-10-24T00:37:42.377773] [INFO ] [MAIN ] WT: Loaded 48178 existing records. [2025-10-24T00:37:42.567638] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:37:42.672317] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-24T00:37:42.740621] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:37:42.740796] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-24T00:37:42.746739] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-24T00:37:42.779937] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-24T00:37:42.779870] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-24T00:37:42.796935] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-24T00:37:42.829312] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-24T00:37:42.829681] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-24T00:37:42.824040] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:37:42.933259] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-24T00:37:42.970910] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-24T00:37:43.028681] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-24T00:37:43.043150] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-24T00:37:51.843350] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-24T00:37:52.027179] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-24T00:37:52.028162] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-24T00:37:52.028237] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-24T00:37:52.028306] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-24T00:37:52.028406] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-24T00:37:52.028479] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-24T00:37:52.028560] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-24T00:37:52.028673] [INFO ] [MAIN ] Update Progress: 2321/2367 symbols completed. WTM took 11.1s. Estimated remaining: 5m 54s. Rate: 7.8 symbols/min [2025-10-24T00:37:52.200490] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:37:52.248889] [DEBUG] [LOCAL ] WTRG: Loaded 50940 existing records from primary storage. [2025-10-24T00:37:52.249285] [INFO ] [MAIN ] WTRG: Loaded 50940 existing records. [2025-10-24T00:37:52.422378] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:37:52.422620] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-24T00:37:52.422716] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-24T00:37:52.423017] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-24T00:37:52.423090] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-24T00:38:15.294629] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-24T00:38:15.682327] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-24T00:38:15.682822] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-24T00:38:15.684099] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-24T00:38:15.684184] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-24T00:38:15.685621] [DEBUG] [LOCAL ] WT: Trimmed 69833 records to 48552 (keeping 200 days of data) [2025-10-24T00:38:15.979241] [DEBUG] [LOCAL ] WT: Primary data saved (48552 records). [2025-10-24T00:38:15.979419] [INFO ] [MAIN ] WT: Full history saved. [2025-10-24T00:38:15.979543] [INFO ] [MAIN ] Update Progress: 2322/2367 symbols completed. WT took 35.1s. Estimated remaining: 5m 47s. Rate: 7.8 symbols/min [2025-10-24T00:38:16.154559] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:16.203590] [DEBUG] [LOCAL ] WTS: Loaded 17226 existing records from primary storage. [2025-10-24T00:38:16.203919] [INFO ] [MAIN ] WTS: Loaded 17226 existing records. [2025-10-24T00:38:16.379757] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:16.379983] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-24T00:38:16.380087] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-24T00:38:16.380598] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-24T00:38:16.380721] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-24T00:38:17.601930] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-24T00:38:17.995860] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-24T00:38:17.995978] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-24T00:38:17.997076] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-24T00:38:17.997156] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-24T00:38:17.998431] [DEBUG] [LOCAL ] WST: Trimmed 54642 records to 37059 (keeping 200 days of data) [2025-10-24T00:38:18.225042] [DEBUG] [LOCAL ] WST: Primary data saved (37059 records). [2025-10-24T00:38:18.225210] [INFO ] [MAIN ] WST: Full history saved. [2025-10-24T00:38:18.225326] [INFO ] [MAIN ] Update Progress: 2323/2367 symbols completed. WST took 37.3s. Estimated remaining: 5m 39s. Rate: 7.8 symbols/min [2025-10-24T00:38:18.390531] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:18.430155] [DEBUG] [LOCAL ] WTTR: Loaded 44535 existing records from primary storage. [2025-10-24T00:38:18.430475] [INFO ] [MAIN ] WTTR: Loaded 44535 existing records. [2025-10-24T00:38:18.604268] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:18.604499] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-24T00:38:18.604574] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-24T00:38:18.604842] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-24T00:38:18.604930] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-24T00:38:19.416410] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-24T00:38:19.825204] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-24T00:38:19.825316] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-24T00:38:19.826605] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-24T00:38:19.826704] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-24T00:38:19.828120] [DEBUG] [LOCAL ] WTRG: Trimmed 73917 records to 51295 (keeping 200 days of data) [2025-10-24T00:38:20.129792] [DEBUG] [LOCAL ] WTRG: Primary data saved (51295 records). [2025-10-24T00:38:20.129951] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-24T00:38:20.130085] [INFO ] [MAIN ] Update Progress: 2324/2367 symbols completed. WTRG took 28.1s. Estimated remaining: 5m 31s. Rate: 7.8 symbols/min [2025-10-24T00:38:20.304145] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:20.350864] [DEBUG] [LOCAL ] WU: Loaded 53487 existing records from primary storage. [2025-10-24T00:38:20.351247] [INFO ] [MAIN ] WU: Loaded 53487 existing records. [2025-10-24T00:38:20.528397] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:20.528661] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-24T00:38:20.528761] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-24T00:38:20.529017] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-24T00:38:20.529104] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-24T00:38:26.600560] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-24T00:38:27.012484] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-24T00:38:27.012757] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-24T00:38:27.014068] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-24T00:38:27.014214] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-24T00:38:27.016003] [DEBUG] [LOCAL ] WTI: Trimmed 63937 records to 45096 (keeping 200 days of data) [2025-10-24T00:38:27.319889] [DEBUG] [LOCAL ] WTI: Primary data saved (45096 records). [2025-10-24T00:38:27.320077] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-24T00:38:27.321441] [INFO ] [MAIN ] Update Progress: 2325/2367 symbols completed. WTI took 46.4s. Estimated remaining: 5m 23s. Rate: 7.8 symbols/min [2025-10-24T00:38:27.497163] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:27.547035] [DEBUG] [LOCAL ] WWW: Loaded 49243 existing records from primary storage. [2025-10-24T00:38:27.547431] [INFO ] [MAIN ] WWW: Loaded 49243 existing records. [2025-10-24T00:38:27.745053] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:27.745432] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-24T00:38:27.745750] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-24T00:38:27.746161] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-24T00:38:27.746301] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-24T00:38:41.696884] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-24T00:38:42.056878] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-24T00:38:42.056987] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-24T00:38:42.057671] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-24T00:38:42.057771] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-24T00:38:42.058445] [DEBUG] [LOCAL ] WTS: Trimmed 25705 records to 17345 (keeping 200 days of data) [2025-10-24T00:38:42.165906] [DEBUG] [LOCAL ] WTS: Primary data saved (17345 records). [2025-10-24T00:38:42.166106] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-24T00:38:42.166240] [INFO ] [MAIN ] Update Progress: 2326/2367 symbols completed. WTS took 26.2s. Estimated remaining: 5m 16s. Rate: 7.8 symbols/min [2025-10-24T00:38:42.355830] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:42.404226] [DEBUG] [LOCAL ] WY: Loaded 53213 existing records from primary storage. [2025-10-24T00:38:42.404629] [INFO ] [MAIN ] WY: Loaded 53213 existing records. [2025-10-24T00:38:42.581091] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:42.581278] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-24T00:38:42.581351] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-24T00:38:42.581694] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-24T00:38:42.581768] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-24T00:38:53.080529] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-24T00:38:53.472458] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-24T00:38:53.472580] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-24T00:38:53.486709] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-24T00:38:53.497165] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-24T00:38:53.507428] [DEBUG] [LOCAL ] WU: Trimmed 77519 records to 53877 (keeping 200 days of data) [2025-10-24T00:38:53.508058] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-24T00:38:54.123326] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-24T00:38:54.126402] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-24T00:38:54.131905] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-24T00:38:54.133442] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-24T00:38:54.153987] [DEBUG] [LOCAL ] WTTR: Trimmed 65531 records to 44859 (keeping 200 days of data) [2025-10-24T00:38:54.334600] [DEBUG] [LOCAL ] WU: Primary data saved (53877 records). [2025-10-24T00:38:54.336994] [INFO ] [MAIN ] WU: Full history saved. [2025-10-24T00:38:54.339299] [INFO ] [MAIN ] Update Progress: 2327/2367 symbols completed. WU took 34.2s. Estimated remaining: 5m 8s. Rate: 7.8 symbols/min [2025-10-24T00:38:54.641787] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:54.761491] [DEBUG] [LOCAL ] WTTR: Primary data saved (44859 records). [2025-10-24T00:38:54.762570] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-24T00:38:54.762775] [INFO ] [MAIN ] Update Progress: 2328/2367 symbols completed. WTTR took 36.5s. Estimated remaining: 5m 0s. Rate: 7.8 symbols/min [2025-10-24T00:38:54.863022] [DEBUG] [LOCAL ] XFLT: Loaded 29930 existing records from primary storage. [2025-10-24T00:38:54.891734] [INFO ] [MAIN ] XFLT: Loaded 29930 existing records. [2025-10-24T00:38:55.081204] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:38:55.170926] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:55.171740] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-24T00:38:55.171875] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-24T00:38:55.172091] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-24T00:38:55.172163] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-24T00:38:55.451398] [DEBUG] [LOCAL ] XHR: Loaded 43369 existing records from primary storage. [2025-10-24T00:38:55.483168] [INFO ] [MAIN ] XHR: Loaded 43369 existing records. [2025-10-24T00:38:55.827571] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:38:55.838142] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-24T00:38:55.838849] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-24T00:38:55.849996] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-24T00:38:55.850455] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-24T00:39:02.429726] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-24T00:39:02.852978] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-24T00:39:02.853106] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-24T00:39:02.854498] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-24T00:39:02.854749] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-24T00:39:02.856284] [DEBUG] [LOCAL ] WWW: Trimmed 70648 records to 49577 (keeping 200 days of data) [2025-10-24T00:39:03.168374] [DEBUG] [LOCAL ] WWW: Primary data saved (49577 records). [2025-10-24T00:39:03.168756] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-24T00:39:03.170273] [INFO ] [MAIN ] Update Progress: 2329/2367 symbols completed. WWW took 35.8s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min [2025-10-24T00:39:03.376902] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:03.381297] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-24T00:39:03.391134] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-24T00:39:03.391597] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-24T00:39:03.391705] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-24T00:39:03.391793] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-24T00:39:03.391864] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-24T00:39:07.400400] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-24T00:39:07.400437] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-24T00:39:07.400482] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-24T00:39:07.400564] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-24T00:39:07.400639] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-24T00:39:07.400759] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-24T00:39:07.400842] [INFO ] [MAIN ] Update Progress: 2330/2367 symbols completed. XIFR took 4.2s. Estimated remaining: 4m 45s. Rate: 7.8 symbols/min [2025-10-24T00:39:07.602594] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:07.609617] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-24T00:39:08.052675] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-24T00:39:08.079072] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-24T00:39:08.081902] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-24T00:39:08.082088] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-24T00:39:08.126190] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-24T00:39:08.139040] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-24T00:39:08.198374] [DEBUG] [LOCAL ] WY: Trimmed 77041 records to 53597 (keeping 200 days of data) [2025-10-24T00:39:08.335365] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:08.366129] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-24T00:39:08.372416] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-24T00:39:08.376084] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-24T00:39:08.377153] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-24T00:39:08.961067] [DEBUG] [LOCAL ] WY: Primary data saved (53597 records). [2025-10-24T00:39:08.961226] [INFO ] [MAIN ] WY: Full history saved. [2025-10-24T00:39:08.961354] [INFO ] [MAIN ] Update Progress: 2331/2367 symbols completed. WY took 26.8s. Estimated remaining: 4m 37s. Rate: 7.8 symbols/min [2025-10-24T00:39:09.134412] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:09.161951] [DEBUG] [LOCAL ] XPER: Loaded 30694 existing records from primary storage. [2025-10-24T00:39:09.162290] [INFO ] [MAIN ] XPER: Loaded 30694 existing records. [2025-10-24T00:39:09.347339] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:09.347707] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-24T00:39:09.347841] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-24T00:39:09.362336] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-24T00:39:09.363314] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-24T00:39:17.989335] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-24T00:39:18.372175] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-24T00:39:18.372314] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-24T00:39:18.373508] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-24T00:39:18.373590] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-24T00:39:18.374944] [DEBUG] [LOCAL ] XHR: Trimmed 61903 records to 43601 (keeping 200 days of data) [2025-10-24T00:39:18.640181] [DEBUG] [LOCAL ] XHR: Primary data saved (43601 records). [2025-10-24T00:39:18.640333] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-24T00:39:18.640441] [INFO ] [MAIN ] Update Progress: 2332/2367 symbols completed. XHR took 23.9s. Estimated remaining: 4m 29s. Rate: 7.8 symbols/min [2025-10-24T00:39:18.812205] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:18.894274] [DEBUG] [LOCAL ] XPEV: Loaded 53619 existing records from primary storage. [2025-10-24T00:39:18.894605] [INFO ] [MAIN ] XPEV: Loaded 53619 existing records. [2025-10-24T00:39:19.067512] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:19.067757] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-24T00:39:19.067832] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-24T00:39:19.068092] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-24T00:39:19.068165] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-24T00:39:29.252877] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-24T00:39:29.635944] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-24T00:39:29.637335] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-24T00:39:29.638344] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-24T00:39:29.638785] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-24T00:39:29.639767] [DEBUG] [LOCAL ] XFLT: Trimmed 43960 records to 30116 (keeping 200 days of data) [2025-10-24T00:39:29.843743] [DEBUG] [LOCAL ] XFLT: Primary data saved (30116 records). [2025-10-24T00:39:29.844515] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-24T00:39:29.856437] [INFO ] [MAIN ] Update Progress: 2333/2367 symbols completed. XFLT took 35.5s. Estimated remaining: 4m 22s. Rate: 7.8 symbols/min [2025-10-24T00:39:30.023683] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:30.065674] [DEBUG] [LOCAL ] XPO: Loaded 47458 existing records from primary storage. [2025-10-24T00:39:30.066022] [INFO ] [MAIN ] XPO: Loaded 47458 existing records. [2025-10-24T00:39:30.239421] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:30.239632] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-24T00:39:30.239724] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-24T00:39:30.239994] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-24T00:39:30.240066] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-24T00:39:40.862226] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-24T00:39:41.299615] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-24T00:39:41.302710] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-24T00:39:41.304064] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-24T00:39:41.304816] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-24T00:39:41.318737] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 54183 (keeping 200 days of data) [2025-10-24T00:39:41.655952] [DEBUG] [LOCAL ] XOM: Primary data saved (54183 records). [2025-10-24T00:39:41.656093] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-24T00:39:41.657638] [INFO ] [MAIN ] Update Progress: 2334/2367 symbols completed. XOM took 34.3s. Estimated remaining: 4m 14s. Rate: 7.8 symbols/min [2025-10-24T00:39:41.835369] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:41.873083] [DEBUG] [LOCAL ] XPOF: Loaded 36943 existing records from primary storage. [2025-10-24T00:39:41.873403] [INFO ] [MAIN ] XPOF: Loaded 36943 existing records. [2025-10-24T00:39:42.058243] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:42.058519] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-24T00:39:42.058677] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-24T00:39:42.059171] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-24T00:39:42.059381] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-24T00:39:42.258977] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-24T00:39:42.933157] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-24T00:39:42.933280] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-24T00:39:42.934247] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-24T00:39:42.934327] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-24T00:39:42.935237] [DEBUG] [LOCAL ] XPER: Trimmed 43665 records to 30878 (keeping 200 days of data) [2025-10-24T00:39:43.115696] [DEBUG] [LOCAL ] XPER: Primary data saved (30878 records). [2025-10-24T00:39:43.115964] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-24T00:39:43.116092] [INFO ] [MAIN ] Update Progress: 2335/2367 symbols completed. XPER took 34.2s. Estimated remaining: 4m 6s. Rate: 7.8 symbols/min [2025-10-24T00:39:43.327442] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:43.368846] [DEBUG] [LOCAL ] XPRO: Loaded 45796 existing records from primary storage. [2025-10-24T00:39:43.369189] [INFO ] [MAIN ] XPRO: Loaded 45796 existing records. [2025-10-24T00:39:43.543248] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:43.543454] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-24T00:39:43.543529] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-24T00:39:43.543824] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-24T00:39:43.543899] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-24T00:39:53.480434] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-24T00:39:53.938016] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-24T00:39:53.938163] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-24T00:39:53.939488] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-24T00:39:53.939583] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-24T00:39:53.941497] [DEBUG] [LOCAL ] XPEV: Trimmed 77772 records to 54006 (keeping 200 days of data) [2025-10-24T00:39:54.301329] [DEBUG] [LOCAL ] XPEV: Primary data saved (54006 records). [2025-10-24T00:39:54.301511] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-24T00:39:54.301626] [INFO ] [MAIN ] Update Progress: 2336/2367 symbols completed. XPEV took 35.7s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min [2025-10-24T00:39:54.473620] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:54.502143] [DEBUG] [LOCAL ] XYF: Loaded 27365 existing records from primary storage. [2025-10-24T00:39:54.502496] [INFO ] [MAIN ] XYF: Loaded 27365 existing records. [2025-10-24T00:39:54.679038] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:54.679303] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-24T00:39:54.679406] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-24T00:39:54.679738] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-24T00:39:54.679817] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-24T00:39:58.441228] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-24T00:39:58.833584] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-24T00:39:58.833813] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-24T00:39:58.835140] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-24T00:39:58.835323] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-24T00:39:58.870765] [DEBUG] [LOCAL ] XPO: Trimmed 69579 records to 47814 (keeping 200 days of data) [2025-10-24T00:39:59.161454] [DEBUG] [LOCAL ] XPO: Primary data saved (47814 records). [2025-10-24T00:39:59.161612] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-24T00:39:59.161754] [INFO ] [MAIN ] Update Progress: 2337/2367 symbols completed. XPO took 29.3s. Estimated remaining: 3m 51s. Rate: 7.8 symbols/min [2025-10-24T00:39:59.335212] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:39:59.382021] [DEBUG] [LOCAL ] XYL: Loaded 47551 existing records from primary storage. [2025-10-24T00:39:59.382420] [INFO ] [MAIN ] XYL: Loaded 47551 existing records. [2025-10-24T00:39:59.571762] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:39:59.572188] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-24T00:39:59.572302] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-24T00:39:59.572731] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-24T00:39:59.572821] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-24T00:40:12.807017] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-24T00:40:13.208155] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-24T00:40:13.208662] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-24T00:40:13.210257] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-24T00:40:13.210339] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-24T00:40:13.211754] [DEBUG] [LOCAL ] XPRO: Trimmed 66485 records to 46174 (keeping 200 days of data) [2025-10-24T00:40:13.336687] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-24T00:40:13.891195] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-24T00:40:13.891337] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-24T00:40:13.892803] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-24T00:40:13.900429] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-24T00:40:13.900506] [DEBUG] [LOCAL ] XPRO: Primary data saved (46174 records). [2025-10-24T00:40:13.900745] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-24T00:40:13.901004] [INFO ] [MAIN ] Update Progress: 2338/2367 symbols completed. XPRO took 30.8s. Estimated remaining: 3m 43s. Rate: 7.8 symbols/min [2025-10-24T00:40:14.002820] [DEBUG] [LOCAL ] XPOF: Trimmed 52937 records to 37137 (keeping 200 days of data) [2025-10-24T00:40:14.129236] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:40:14.166141] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-24T00:40:14.168446] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-24T00:40:14.175736] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-24T00:40:14.175822] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-24T00:40:14.183842] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-24T00:40:14.190125] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-24T00:40:14.553036] [DEBUG] [LOCAL ] XPOF: Primary data saved (37137 records). [2025-10-24T00:40:14.575575] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-24T00:40:14.587134] [INFO ] [MAIN ] Update Progress: 2339/2367 symbols completed. XPOF took 32.9s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min [2025-10-24T00:40:14.858771] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:40:14.927295] [DEBUG] [LOCAL ] YALA: Loaded 36411 existing records from primary storage. [2025-10-24T00:40:14.927818] [INFO ] [MAIN ] YALA: Loaded 36411 existing records. [2025-10-24T00:40:15.109789] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:40:15.128572] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-24T00:40:15.129426] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-24T00:40:15.136916] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-24T00:40:15.137005] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-24T00:40:28.079951] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-24T00:40:28.483317] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-24T00:40:28.483668] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-24T00:40:28.485925] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-24T00:40:28.486026] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-24T00:40:28.488033] [DEBUG] [LOCAL ] XYL: Trimmed 70043 records to 47890 (keeping 200 days of data) [2025-10-24T00:40:28.846264] [DEBUG] [LOCAL ] XYL: Primary data saved (47890 records). [2025-10-24T00:40:28.846510] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-24T00:40:28.846681] [INFO ] [MAIN ] Update Progress: 2340/2367 symbols completed. XYL took 29.7s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min [2025-10-24T00:40:29.028238] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:40:29.074949] [DEBUG] [LOCAL ] YELP: Loaded 45182 existing records from primary storage. [2025-10-24T00:40:29.075404] [INFO ] [MAIN ] YELP: Loaded 45182 existing records. [2025-10-24T00:40:29.284067] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:40:29.289709] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-24T00:40:29.290260] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-24T00:40:29.290610] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-24T00:40:29.290728] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-24T00:40:31.464002] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-24T00:40:31.834586] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-24T00:40:31.834763] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-24T00:40:31.835468] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-24T00:40:31.835539] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-24T00:40:31.836547] [DEBUG] [LOCAL ] XYF: Trimmed 33826 records to 27493 (keeping 200 days of data) [2025-10-24T00:40:32.003965] [DEBUG] [LOCAL ] XYF: Primary data saved (27493 records). [2025-10-24T00:40:32.004161] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-24T00:40:32.005102] [INFO ] [MAIN ] Update Progress: 2341/2367 symbols completed. XYF took 37.7s. Estimated remaining: 3m 20s. Rate: 7.8 symbols/min [2025-10-24T00:40:32.205094] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:40:32.252574] [DEBUG] [LOCAL ] YETI: Loaded 52517 existing records from primary storage. [2025-10-24T00:40:32.252921] [INFO ] [MAIN ] YETI: Loaded 52517 existing records. [2025-10-24T00:40:32.431739] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:40:32.431943] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-24T00:40:32.432019] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-24T00:40:32.432242] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-24T00:40:32.432315] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-24T00:40:41.184691] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-24T00:40:41.605201] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-24T00:40:41.605324] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-24T00:40:41.606336] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-24T00:40:41.606516] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-24T00:40:41.607597] [DEBUG] [LOCAL ] YALA: Trimmed 47119 records to 36512 (keeping 200 days of data) [2025-10-24T00:40:41.817558] [DEBUG] [LOCAL ] YALA: Primary data saved (36512 records). [2025-10-24T00:40:41.817799] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-24T00:40:41.817921] [INFO ] [MAIN ] Update Progress: 2342/2367 symbols completed. YALA took 27.2s. Estimated remaining: 3m 13s. Rate: 7.8 symbols/min [2025-10-24T00:40:41.993549] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:40:42.066675] [DEBUG] [LOCAL ] YEXT: Loaded 43044 existing records from primary storage. [2025-10-24T00:40:42.067040] [INFO ] [MAIN ] YEXT: Loaded 43044 existing records. [2025-10-24T00:40:42.245282] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:40:42.245530] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-24T00:40:42.245609] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-24T00:40:42.245862] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-24T00:40:42.245935] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-24T00:40:43.875733] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-10-24T00:40:44.079282] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-24T00:40:44.080196] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-24T00:40:44.080286] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-24T00:40:44.080511] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-24T00:40:44.080617] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-24T00:40:44.080716] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-24T00:40:44.080801] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-24T00:40:44.080915] [INFO ] [MAIN ] Update Progress: 2343/2367 symbols completed. XYZ took 30.2s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min [2025-10-24T00:40:44.259826] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:40:44.359682] [DEBUG] [LOCAL ] YMM: Loaded 52576 existing records from primary storage. [2025-10-24T00:40:44.360120] [INFO ] [MAIN ] YMM: Loaded 52576 existing records. [2025-10-24T00:40:44.545311] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:40:44.545731] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-24T00:40:44.545906] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-24T00:40:44.546167] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-24T00:40:44.546257] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-24T00:40:59.362351] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-24T00:40:59.756738] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-24T00:40:59.756994] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-24T00:40:59.758367] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-24T00:40:59.758555] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-24T00:40:59.795628] [DEBUG] [LOCAL ] YETI: Trimmed 75528 records to 52897 (keeping 200 days of data) [2025-10-24T00:41:00.109063] [DEBUG] [LOCAL ] YETI: Primary data saved (52897 records). [2025-10-24T00:41:00.109227] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-24T00:41:00.109339] [INFO ] [MAIN ] Update Progress: 2344/2367 symbols completed. YETI took 28.1s. Estimated remaining: 2m 57s. Rate: 7.8 symbols/min [2025-10-24T00:41:00.280412] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:00.324524] [DEBUG] [LOCAL ] YOU: Loaded 49536 existing records from primary storage. [2025-10-24T00:41:00.324925] [INFO ] [MAIN ] YOU: Loaded 49536 existing records. [2025-10-24T00:41:00.507504] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:00.507788] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-24T00:41:00.507865] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-24T00:41:00.508120] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-24T00:41:00.508194] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-24T00:41:01.647448] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-24T00:41:02.045343] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-24T00:41:02.045472] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-24T00:41:02.046734] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-24T00:41:02.046812] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-24T00:41:02.048252] [DEBUG] [LOCAL ] YELP: Trimmed 64741 records to 45479 (keeping 200 days of data) [2025-10-24T00:41:02.324255] [DEBUG] [LOCAL ] YELP: Primary data saved (45479 records). [2025-10-24T00:41:02.324725] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-24T00:41:02.324908] [INFO ] [MAIN ] Update Progress: 2345/2367 symbols completed. YELP took 33.5s. Estimated remaining: 2m 49s. Rate: 7.8 symbols/min [2025-10-24T00:41:02.507752] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:02.585761] [DEBUG] [LOCAL ] YPF: Loaded 50750 existing records from primary storage. [2025-10-24T00:41:02.586129] [INFO ] [MAIN ] YPF: Loaded 50750 existing records. [2025-10-24T00:41:02.767605] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:02.767870] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-24T00:41:02.767948] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-24T00:41:02.768167] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-24T00:41:02.768239] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-24T00:41:09.514133] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-24T00:41:09.946284] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-24T00:41:09.946424] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-24T00:41:09.948123] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-24T00:41:09.948215] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-24T00:41:09.949698] [DEBUG] [LOCAL ] YEXT: Trimmed 63071 records to 43337 (keeping 200 days of data) [2025-10-24T00:41:10.219121] [DEBUG] [LOCAL ] YEXT: Primary data saved (43337 records). [2025-10-24T00:41:10.219344] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-24T00:41:10.221340] [INFO ] [MAIN ] Update Progress: 2346/2367 symbols completed. YEXT took 28.4s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min [2025-10-24T00:41:10.417227] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:10.472200] [DEBUG] [LOCAL ] YRD: Loaded 11169 existing records from primary storage. [2025-10-24T00:41:10.472782] [INFO ] [MAIN ] YRD: Loaded 11169 existing records. [2025-10-24T00:41:10.703565] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:10.703899] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-24T00:41:10.703998] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-24T00:41:10.704292] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-24T00:41:10.704387] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-24T00:41:14.424580] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-24T00:41:14.811381] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-24T00:41:14.811509] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-24T00:41:14.812822] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-24T00:41:14.812907] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-24T00:41:14.814385] [DEBUG] [LOCAL ] YMM: Trimmed 76464 records to 52966 (keeping 200 days of data) [2025-10-24T00:41:15.182475] [DEBUG] [LOCAL ] YMM: Primary data saved (52966 records). [2025-10-24T00:41:15.186314] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-24T00:41:15.186561] [INFO ] [MAIN ] Update Progress: 2347/2367 symbols completed. YMM took 31.1s. Estimated remaining: 2m 34s. Rate: 7.8 symbols/min [2025-10-24T00:41:15.387054] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:15.415740] [DEBUG] [LOCAL ] YSG: Loaded 25642 existing records from primary storage. [2025-10-24T00:41:15.416159] [INFO ] [MAIN ] YSG: Loaded 25642 existing records. [2025-10-24T00:41:15.645724] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:15.646100] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-24T00:41:15.646189] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-24T00:41:15.646577] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-24T00:41:15.646706] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-24T00:41:32.141435] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-24T00:41:32.540503] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-24T00:41:32.540617] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-24T00:41:32.541896] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-24T00:41:32.541984] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-24T00:41:32.543345] [DEBUG] [LOCAL ] YPF: Trimmed 73870 records to 51139 (keeping 200 days of data) [2025-10-24T00:41:32.835446] [DEBUG] [LOCAL ] YPF: Primary data saved (51139 records). [2025-10-24T00:41:32.835788] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-24T00:41:32.835925] [INFO ] [MAIN ] Update Progress: 2348/2367 symbols completed. YPF took 30.5s. Estimated remaining: 2m 26s. Rate: 7.8 symbols/min [2025-10-24T00:41:33.004982] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:33.054502] [DEBUG] [LOCAL ] YUM: Loaded 51147 existing records from primary storage. [2025-10-24T00:41:33.054860] [INFO ] [MAIN ] YUM: Loaded 51147 existing records. [2025-10-24T00:41:33.252743] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:33.252981] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-24T00:41:33.253059] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-24T00:41:33.253295] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-24T00:41:33.253371] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-24T00:41:39.183146] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-24T00:41:39.626020] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-24T00:41:39.626140] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-24T00:41:39.626668] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-24T00:41:39.626746] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-24T00:41:39.627292] [DEBUG] [LOCAL ] YRD: Trimmed 18766 records to 11205 (keeping 200 days of data) [2025-10-24T00:41:39.691886] [DEBUG] [LOCAL ] YRD: Primary data saved (11205 records). [2025-10-24T00:41:39.692050] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-24T00:41:39.692189] [INFO ] [MAIN ] Update Progress: 2349/2367 symbols completed. YRD took 29.5s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min [2025-10-24T00:41:39.859631] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:39.911792] [DEBUG] [LOCAL ] YUMC: Loaded 52576 existing records from primary storage. [2025-10-24T00:41:39.912141] [INFO ] [MAIN ] YUMC: Loaded 52576 existing records. [2025-10-24T00:41:40.089571] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:40.089816] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-24T00:41:40.089894] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-24T00:41:40.090129] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-24T00:41:40.090204] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-24T00:41:41.029478] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-24T00:41:41.447554] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-24T00:41:41.447772] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-24T00:41:41.449078] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-24T00:41:41.449158] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-24T00:41:41.450589] [DEBUG] [LOCAL ] YOU: Trimmed 72312 records to 49826 (keeping 200 days of data) [2025-10-24T00:41:41.777370] [DEBUG] [LOCAL ] YOU: Primary data saved (49826 records). [2025-10-24T00:41:41.777550] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-24T00:41:41.777706] [INFO ] [MAIN ] Update Progress: 2350/2367 symbols completed. YOU took 41.7s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min [2025-10-24T00:41:41.975692] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:42.025676] [DEBUG] [LOCAL ] ZBH: Loaded 50705 existing records from primary storage. [2025-10-24T00:41:42.026051] [INFO ] [MAIN ] ZBH: Loaded 50705 existing records. [2025-10-24T00:41:42.227935] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:42.228159] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-24T00:41:42.228235] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-24T00:41:42.228520] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-24T00:41:42.228594] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-24T00:41:51.961062] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-24T00:41:52.332815] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-24T00:41:52.332928] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-24T00:41:52.333640] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-24T00:41:52.333742] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-24T00:41:52.334477] [DEBUG] [LOCAL ] YSG: Trimmed 32595 records to 25773 (keeping 200 days of data) [2025-10-24T00:41:52.471610] [DEBUG] [LOCAL ] YSG: Primary data saved (25773 records). [2025-10-24T00:41:52.471780] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-24T00:41:52.471887] [INFO ] [MAIN ] Update Progress: 2351/2367 symbols completed. YSG took 37.3s. Estimated remaining: 2m 3s. Rate: 7.8 symbols/min [2025-10-24T00:41:52.634731] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:41:52.654131] [DEBUG] [LOCAL ] ZEPP: Loaded 19612 existing records from primary storage. [2025-10-24T00:41:52.654398] [INFO ] [MAIN ] ZEPP: Loaded 19612 existing records. [2025-10-24T00:41:52.828229] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:41:52.829323] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-24T00:41:52.829404] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-24T00:41:52.829615] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-24T00:41:52.829731] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-24T00:42:05.804460] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-24T00:42:06.194488] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-24T00:42:06.194597] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-24T00:42:06.195891] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-24T00:42:06.195971] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-24T00:42:06.197315] [DEBUG] [LOCAL ] YUM: Trimmed 74646 records to 51489 (keeping 200 days of data) [2025-10-24T00:42:06.528791] [DEBUG] [LOCAL ] YUM: Primary data saved (51489 records). [2025-10-24T00:42:06.528941] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-24T00:42:06.529054] [INFO ] [MAIN ] Update Progress: 2352/2367 symbols completed. YUM took 33.7s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min [2025-10-24T00:42:06.699055] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:06.782551] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-24T00:42:06.782907] [INFO ] [MAIN ] ZETA: Loaded 53618 existing records. [2025-10-24T00:42:06.957610] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:06.957882] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-24T00:42:06.957961] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-24T00:42:06.958229] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-24T00:42:06.958309] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-24T00:42:08.999446] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-24T00:42:09.389382] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-24T00:42:09.389525] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-24T00:42:09.390800] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-24T00:42:09.390877] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-24T00:42:09.392269] [DEBUG] [LOCAL ] ZBH: Trimmed 73894 records to 51035 (keeping 200 days of data) [2025-10-24T00:42:09.705952] [DEBUG] [LOCAL ] ZBH: Primary data saved (51035 records). [2025-10-24T00:42:09.706145] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-24T00:42:09.706292] [INFO ] [MAIN ] Update Progress: 2353/2367 symbols completed. ZBH took 27.9s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min [2025-10-24T00:42:09.890564] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:09.927162] [DEBUG] [LOCAL ] ZGN: Loaded 40896 existing records from primary storage. [2025-10-24T00:42:09.927695] [INFO ] [MAIN ] ZGN: Loaded 40896 existing records. [2025-10-24T00:42:10.115318] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:10.116343] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-24T00:42:10.116447] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-24T00:42:10.116760] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-24T00:42:10.116838] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-24T00:42:16.202915] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-24T00:42:16.595270] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-24T00:42:16.595389] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-24T00:42:16.596727] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-24T00:42:16.596807] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-24T00:42:16.598354] [DEBUG] [LOCAL ] YUMC: Trimmed 76455 records to 52963 (keeping 200 days of data) [2025-10-24T00:42:16.920403] [DEBUG] [LOCAL ] YUMC: Primary data saved (52963 records). [2025-10-24T00:42:16.920575] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-24T00:42:16.922134] [INFO ] [MAIN ] Update Progress: 2354/2367 symbols completed. YUMC took 37.2s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min [2025-10-24T00:42:17.090742] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:17.148686] [DEBUG] [LOCAL ] ZH: Loaded 24633 existing records from primary storage. [2025-10-24T00:42:17.149079] [INFO ] [MAIN ] ZH: Loaded 24633 existing records. [2025-10-24T00:42:17.365025] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:17.365371] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-24T00:42:17.365522] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-24T00:42:17.365761] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-24T00:42:17.365835] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-24T00:42:24.312464] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-24T00:42:24.696782] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-24T00:42:24.702115] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-24T00:42:24.708875] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-24T00:42:24.709502] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-24T00:42:24.715024] [DEBUG] [LOCAL ] ZEPP: Trimmed 21374 records to 19786 (keeping 200 days of data) [2025-10-24T00:42:24.835626] [DEBUG] [LOCAL ] ZEPP: Primary data saved (19786 records). [2025-10-24T00:42:24.835821] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-24T00:42:24.835947] [INFO ] [MAIN ] Update Progress: 2355/2367 symbols completed. ZEPP took 32.4s. Estimated remaining: 1m 32s. Rate: 7.8 symbols/min [2025-10-24T00:42:25.004326] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:25.053752] [DEBUG] [LOCAL ] ZIM: Loaded 53462 existing records from primary storage. [2025-10-24T00:42:25.054079] [INFO ] [MAIN ] ZIM: Loaded 53462 existing records. [2025-10-24T00:42:25.227919] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:25.228103] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-24T00:42:25.228177] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-24T00:42:25.228406] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-24T00:42:25.228479] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-24T00:42:36.636926] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-24T00:42:37.050194] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-24T00:42:37.055142] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-24T00:42:37.056430] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-24T00:42:37.056622] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-24T00:42:37.056866] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-24T00:42:37.196739] [DEBUG] [LOCAL ] ZGN: Trimmed 58820 records to 41195 (keeping 200 days of data) [2025-10-24T00:42:37.610694] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-24T00:42:37.611167] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-24T00:42:37.615277] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-24T00:42:37.615436] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-24T00:42:37.621363] [DEBUG] [LOCAL ] ZH: Trimmed 39737 records to 24766 (keeping 200 days of data) [2025-10-24T00:42:37.834390] [DEBUG] [LOCAL ] ZGN: Primary data saved (41195 records). [2025-10-24T00:42:37.845775] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-24T00:42:37.846945] [INFO ] [MAIN ] Update Progress: 2356/2367 symbols completed. ZGN took 28.1s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min [2025-10-24T00:42:37.979154] [DEBUG] [LOCAL ] ZH: Primary data saved (24766 records). [2025-10-24T00:42:37.990054] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-24T00:42:37.995331] [INFO ] [MAIN ] Update Progress: 2357/2367 symbols completed. ZH took 21.1s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min [2025-10-24T00:42:38.046634] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:38.084418] [DEBUG] [LOCAL ] ZIP: Loaded 43466 existing records from primary storage. [2025-10-24T00:42:38.084790] [INFO ] [MAIN ] ZIP: Loaded 43466 existing records. [2025-10-24T00:42:38.271715] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:38.271932] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-24T00:42:38.272008] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-24T00:42:38.272250] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-24T00:42:38.272326] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-24T00:42:46.489797] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-24T00:42:46.881457] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-24T00:42:46.881728] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-24T00:42:46.883111] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-24T00:42:46.883349] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-24T00:42:46.884836] [DEBUG] [LOCAL ] ZETA: Trimmed 77735 records to 54008 (keeping 200 days of data) [2025-10-24T00:42:47.264920] [DEBUG] [LOCAL ] ZETA: Primary data saved (54008 records). [2025-10-24T00:42:47.265093] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-24T00:42:47.265213] [INFO ] [MAIN ] Update Progress: 2358/2367 symbols completed. ZETA took 40.7s. Estimated remaining: 1m 9s. Rate: 7.8 symbols/min [2025-10-24T00:42:53.720237] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-24T00:42:54.135430] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-24T00:42:54.135549] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-24T00:42:54.137010] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-24T00:42:54.137102] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-24T00:42:54.138767] [DEBUG] [LOCAL ] ZIM: Trimmed 77567 records to 53836 (keeping 200 days of data) [2025-10-24T00:42:54.496404] [DEBUG] [LOCAL ] ZIM: Primary data saved (53836 records). [2025-10-24T00:42:54.496588] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-24T00:42:54.496758] [INFO ] [MAIN ] Update Progress: 2359/2367 symbols completed. ZIM took 29.7s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min [2025-10-24T00:42:55.056203] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-24T00:42:55.470808] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-24T00:42:55.470990] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-24T00:42:55.473016] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-24T00:42:55.473103] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-24T00:42:55.474902] [DEBUG] [LOCAL ] ZIP: Trimmed 60806 records to 43737 (keeping 200 days of data) [2025-10-24T00:42:55.741413] [DEBUG] [LOCAL ] ZIP: Primary data saved (43737 records). [2025-10-24T00:42:55.741636] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-24T00:42:55.741795] [INFO ] [MAIN ] Update Progress: 2360/2367 symbols completed. ZIP took 17.9s. Estimated remaining: 53.9s. Rate: 7.8 symbols/min [2025-10-24T00:42:56.379542] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:56.473861] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:56.492960] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:56.580742] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:42:56.563219] [DEBUG] [LOCAL ] ZKH: Loaded 7323 existing records from primary storage. [2025-10-24T00:42:56.582052] [INFO ] [MAIN ] ZKH: Loaded 7323 existing records. [2025-10-24T00:42:56.635158] [DEBUG] [LOCAL ] ZTR: Loaded 16504 existing records from primary storage. [2025-10-24T00:42:56.688267] [INFO ] [MAIN ] ZTR: Loaded 16504 existing records. [2025-10-24T00:42:56.889995] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:56.926260] [DEBUG] [LOCAL ] ZK: Loaded 38961 existing records from primary storage. [2025-10-24T00:42:56.925485] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-24T00:42:56.926705] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-24T00:42:56.927436] [INFO ] [MAIN ] ZK: Loaded 38961 existing records. [2025-10-24T00:42:56.973867] [DEBUG] [LOCAL ] ZTO: Loaded 49371 existing records from primary storage. [2025-10-24T00:42:56.994081] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-24T00:42:57.048112] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-24T00:42:57.067810] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:57.113921] [INFO ] [MAIN ] ZTO: Loaded 49371 existing records. [2025-10-24T00:42:57.162447] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-24T00:42:57.214583] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-24T00:42:57.282145] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-24T00:42:57.352587] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-24T00:42:57.652247] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:57.797574] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-24T00:42:57.767620] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:42:57.832908] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-24T00:42:57.860312] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-24T00:42:57.870857] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-24T00:42:57.881595] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-24T00:42:57.905482] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-24T00:42:57.916392] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-24T00:42:57.963682] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-24T00:43:16.109781] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-24T00:43:16.481568] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-24T00:43:16.481751] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-24T00:43:16.482486] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-24T00:43:16.482586] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-24T00:43:16.483695] [DEBUG] [LOCAL ] ZTR: Trimmed 26877 records to 16659 (keeping 200 days of data) [2025-10-24T00:43:16.579075] [DEBUG] [LOCAL ] ZTR: Primary data saved (16659 records). [2025-10-24T00:43:16.579230] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-24T00:43:16.579338] [INFO ] [MAIN ] Update Progress: 2361/2367 symbols completed. ZTR took 20.8s. Estimated remaining: 46.2s. Rate: 7.8 symbols/min [2025-10-24T00:43:16.745187] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:43:16.795004] [DEBUG] [LOCAL ] ZTS: Loaded 53128 existing records from primary storage. [2025-10-24T00:43:16.795389] [INFO ] [MAIN ] ZTS: Loaded 53128 existing records. [2025-10-24T00:43:16.972677] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:43:16.972885] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-24T00:43:16.972963] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-24T00:43:16.973216] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-24T00:43:16.973305] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-24T00:43:19.712140] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-24T00:43:20.068527] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-24T00:43:20.068853] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-24T00:43:20.069224] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-24T00:43:20.069350] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-24T00:43:20.070090] [DEBUG] [LOCAL ] ZKH: Trimmed 11752 records to 7354 (keeping 200 days of data) [2025-10-24T00:43:20.110034] [DEBUG] [LOCAL ] ZKH: Primary data saved (7354 records). [2025-10-24T00:43:20.110239] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-24T00:43:20.110461] [INFO ] [MAIN ] Update Progress: 2362/2367 symbols completed. ZKH took 24.3s. Estimated remaining: 38.5s. Rate: 7.8 symbols/min [2025-10-24T00:43:20.288379] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:43:20.385102] [DEBUG] [LOCAL ] ZVIA: Loaded 35832 existing records from primary storage. [2025-10-24T00:43:20.385474] [INFO ] [MAIN ] ZVIA: Loaded 35832 existing records. [2025-10-24T00:43:20.588168] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:43:20.588375] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-24T00:43:20.588449] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-24T00:43:20.588696] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-24T00:43:20.588772] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-24T00:43:21.919719] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-24T00:43:22.325477] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-24T00:43:22.325600] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-24T00:43:22.326859] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-24T00:43:22.326942] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-24T00:43:22.328154] [DEBUG] [LOCAL ] ZK: Trimmed 57121 records to 39272 (keeping 200 days of data) [2025-10-24T00:43:22.557071] [DEBUG] [LOCAL ] ZK: Primary data saved (39272 records). [2025-10-24T00:43:22.557245] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-24T00:43:22.557360] [INFO ] [MAIN ] Update Progress: 2363/2367 symbols completed. ZK took 26.8s. Estimated remaining: 30.8s. Rate: 7.8 symbols/min [2025-10-24T00:43:22.727078] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-15 to 2025-10-23. [2025-10-24T00:43:22.766944] [DEBUG] [LOCAL ] ZWS: Loaded 42136 existing records from primary storage. [2025-10-24T00:43:22.767449] [INFO ] [MAIN ] ZWS: Loaded 42136 existing records. [2025-10-24T00:43:22.960206] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-07 for 200 day retention. Performing full refresh. [2025-10-24T00:43:22.960606] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-24T00:43:22.960738] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-24T00:43:22.961135] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-24T00:43:22.961230] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-24T00:43:35.784909] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-24T00:43:36.235008] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-24T00:43:36.235180] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-24T00:43:36.236743] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-24T00:43:36.236841] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-24T00:43:36.238391] [DEBUG] [LOCAL ] ZTO: Trimmed 72672 records to 49634 (keeping 200 days of data) [2025-10-24T00:43:36.545454] [DEBUG] [LOCAL ] ZTO: Primary data saved (49634 records). [2025-10-24T00:43:36.545629] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-24T00:43:36.545773] [INFO ] [MAIN ] Update Progress: 2364/2367 symbols completed. ZTO took 40.8s. Estimated remaining: 23.1s. Rate: 7.8 symbols/min [2025-10-24T00:43:43.071685] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-24T00:43:43.448438] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-24T00:43:43.448552] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-24T00:43:43.449867] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-24T00:43:43.449965] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-24T00:43:43.451097] [DEBUG] [LOCAL ] ZVIA: Trimmed 52478 records to 36071 (keeping 200 days of data) [2025-10-24T00:43:43.645870] [DEBUG] [LOCAL ] ZVIA: Primary data saved (36071 records). [2025-10-24T00:43:43.646028] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-24T00:43:43.646138] [INFO ] [MAIN ] Update Progress: 2365/2367 symbols completed. ZVIA took 23.5s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min [2025-10-24T00:43:47.885967] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-24T00:43:48.327002] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-24T00:43:48.327422] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-24T00:43:48.328824] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-24T00:43:48.328960] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-24T00:43:48.331469] [DEBUG] [LOCAL ] ZWS: Trimmed 62043 records to 42439 (keeping 200 days of data) [2025-10-24T00:43:48.585352] [DEBUG] [LOCAL ] ZWS: Primary data saved (42439 records). [2025-10-24T00:43:48.585503] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-24T00:43:48.586692] [INFO ] [MAIN ] Update Progress: 2366/2367 symbols completed. ZWS took 26.0s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min [2025-10-24T00:43:51.964030] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-24T00:43:52.354489] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-24T00:43:52.354598] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-24T00:43:52.355933] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-24T00:43:52.356014] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-24T00:43:52.357400] [DEBUG] [LOCAL ] ZTS: Trimmed 76880 records to 53500 (keeping 200 days of data) [2025-10-24T00:43:52.678464] [DEBUG] [LOCAL ] ZTS: Primary data saved (53500 records). [2025-10-24T00:43:52.678634] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-24T00:43:52.679438] [INFO ] [MAIN ] Update Progress: 2367/2367 symbols completed. ZTS took 36.1s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min [2025-10-24T00:43:52.680212] [INFO ] [MAIN ] Parallel update completed in 5h 3m 48s [2025-10-24T00:43:52.680323] [WARN ] [MAIN ] Failed symbols (203): AAM, AAUC, ABEV, ABG, ABBV, AD, AEXA, AHL, AII, AKA... [2025-10-24T00:43:52.680416] [INFO ] [MAIN ] Update success rate: 91.4% (2164/2367 symbols) [2025-10-24T00:43:53.326787] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2164/2367 @ 91.42%)' [2025-10-24T00:43:53.327392] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-24T00:43:53.327495] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-24T00:43:53.327587] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-24T00:43:53.327784] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-24T00:43:54.983532] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-24T00:43:54.984916] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-24T00:43:54.984991] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-24T00:43:54.985067] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-24T00:43:54.985161] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-24T00:43:54.985252] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-24T00:43:54.985320] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-24T00:43:54.985719] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-24T00:43:54.985788] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-24T00:43:54.986003] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-24T00:43:54.986071] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-24T00:43:54.986139] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-24T00:43:54.986207] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-24T00:43:55.014371] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-24T00:43:55.040328] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-24T00:43:55.040459] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-24T00:43:55.040533] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-24T00:43:55.040600] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-24T00:43:55.040715] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-24T00:43:55.040785] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-24T00:43:55.040857] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-24T00:43:55.042108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-24T00:43:55.042226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-24T00:43:55.042348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-24T00:43:55.042473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-24T00:43:55.042585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-24T00:43:55.042719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-24T00:43:55.042824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-24T00:43:55.042926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-24T00:43:55.043029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-24T00:43:55.043147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-24T00:43:55.043274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-24T00:43:55.043390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-24T00:43:55.043509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-24T00:43:55.043622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-24T00:43:55.044486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-24T00:43:55.044680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-24T00:43:55.044799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-24T00:43:55.044915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-24T00:43:55.045030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-24T00:43:55.045143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-24T00:43:55.045242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-24T00:43:55.045375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-24T00:43:55.045529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-24T00:43:55.045636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-24T00:43:55.045759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-24T00:43:55.045867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-24T00:43:55.045966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-24T00:43:55.046063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-24T00:43:55.046182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-24T00:43:55.046285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-24T00:43:55.046382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-24T00:43:55.046519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-24T00:43:55.046618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-24T00:43:55.046748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-24T00:43:55.046847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-24T00:43:55.046957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-24T00:43:55.047058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-24T00:43:55.047167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-24T00:43:55.047277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-24T00:43:55.047406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-10-24T00:43:55.047508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-24T00:43:55.047608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-24T00:43:55.047761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-24T00:43:55.047864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-24T00:43:55.047976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-24T00:43:55.048090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-24T00:43:55.048188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-24T00:43:55.048287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-24T00:43:55.048393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-24T00:43:55.048509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-24T00:43:55.048620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-24T00:43:55.048747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-24T00:43:55.048876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-24T00:43:55.048989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-24T00:43:55.049107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-24T00:43:55.049231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-24T00:43:55.049339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-24T00:43:55.049437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-24T00:43:55.049540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-24T00:43:55.049637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-24T00:43:55.049760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-24T00:43:55.049894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-24T00:43:55.049993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-24T00:43:55.050100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-24T00:43:55.050220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-24T00:43:55.050333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-24T00:43:55.050438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-24T00:43:55.050536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-24T00:43:55.050634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-24T00:43:55.050774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-24T00:43:55.050886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-24T00:43:55.050986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-24T00:43:55.051084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-24T00:43:55.051210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-10-24T00:43:55.051310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-24T00:43:55.051415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-24T00:43:55.051517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-24T00:43:55.051634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-24T00:43:55.051766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-24T00:43:55.051878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-24T00:43:55.051977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-10-24T00:43:55.052088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-10-24T00:43:55.052185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-24T00:43:55.052293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-24T00:43:55.052414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-24T00:43:55.052517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-24T00:43:55.052612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-24T00:43:55.052743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-10-24T00:43:55.052843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-24T00:43:55.052960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-24T00:43:55.053058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-24T00:43:55.053154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-24T00:43:55.053252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-24T00:43:55.053350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-24T00:43:55.053448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-10-24T00:43:55.053565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-24T00:43:55.053687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-24T00:43:55.053787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-24T00:43:55.053885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-24T00:43:55.053999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-24T00:43:55.054106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-24T00:43:55.054211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-24T00:43:55.054315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-24T00:43:55.054411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-24T00:43:55.054519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-24T00:43:55.054623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-24T00:43:55.054773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-24T00:43:55.054875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-24T00:43:55.054987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-24T00:43:55.055087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-24T00:43:55.055196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-24T00:43:55.055308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-24T00:43:55.055408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-24T00:43:55.055516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-24T00:43:55.055616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-24T00:43:55.055737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-24T00:43:55.055837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-24T00:43:55.055950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-24T00:43:55.056049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-24T00:43:55.056150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-24T00:43:55.056254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-24T00:43:55.056378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-24T00:43:55.056501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-24T00:43:55.056599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-24T00:43:55.056731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-24T00:43:55.056833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-24T00:43:55.056931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-24T00:43:55.057032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-24T00:43:55.057139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-24T00:43:55.057248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-24T00:43:55.057349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-24T00:43:55.057469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-24T00:43:55.057570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-10-24T00:43:55.057710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-24T00:43:55.057808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-24T00:43:55.057904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-24T00:43:55.058002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-24T00:43:55.058112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-24T00:43:55.058212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-24T00:43:55.058323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-24T00:43:55.058433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-24T00:43:55.058540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-24T00:43:55.058675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-24T00:43:55.058774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-24T00:43:55.058872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-24T00:43:55.058968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-24T00:43:55.059083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-24T00:43:55.059194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-24T00:43:55.059292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-10-24T00:43:55.059408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-24T00:43:55.059510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-24T00:43:55.059613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-24T00:43:55.059752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-24T00:43:55.059850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-24T00:43:55.059968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-24T00:43:55.060070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-24T00:43:55.060184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-24T00:43:55.060281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-24T00:43:55.060388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-24T00:43:55.060494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-24T00:43:55.060612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-24T00:43:55.060775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-24T00:43:55.060887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-24T00:43:55.060996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-24T00:43:55.061103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-24T00:43:55.061202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-24T00:43:55.061297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-24T00:43:55.061394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-24T00:43:55.061492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-24T00:43:55.061592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-24T00:43:55.061725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-24T00:43:55.061830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-24T00:43:55.061928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-24T00:43:55.062025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-24T00:43:55.062122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-24T00:43:55.062232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-24T00:43:55.062330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-24T00:43:55.062430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-24T00:43:55.062528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-24T00:43:55.062625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-24T00:43:55.062743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-24T00:43:55.062840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-24T00:43:55.062936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-24T00:43:55.063032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-24T00:43:55.063139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-24T00:43:55.063244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-24T00:43:55.063351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-24T00:43:55.063447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-24T00:43:55.063544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-24T00:43:55.063696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-24T00:43:55.063797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-24T00:43:55.063916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-24T00:43:55.064020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-24T00:43:55.064121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-24T00:43:55.064226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-24T00:43:55.064321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-24T00:43:55.064418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-24T00:43:55.064515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-24T00:43:55.064611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-24T00:43:55.064739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-24T00:43:55.064837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-24T00:43:55.064932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-24T00:43:55.065038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-24T00:43:55.065134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-24T00:43:55.065230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-24T00:43:55.065348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-24T00:43:55.065472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-24T00:43:55.065596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-24T00:43:55.065716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-24T00:43:55.065820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-10-24T00:43:55.065917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-24T00:43:55.066012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-24T00:43:55.066119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-24T00:43:55.066221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-24T00:43:55.066316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-24T00:43:55.066422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-24T00:43:55.066517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-24T00:43:55.066618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-24T00:43:55.066745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-10-24T00:43:55.066842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-24T00:43:55.066939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-24T00:43:55.067036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-24T00:43:55.067147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-24T00:43:55.067245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-24T00:43:55.067356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-24T00:43:55.067477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-24T00:43:55.067586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-24T00:43:55.067734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-24T00:43:55.067841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-24T00:43:55.067938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-24T00:43:55.068036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-24T00:43:55.068131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-24T00:43:55.068244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-24T00:43:55.068357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-24T00:43:55.068480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-24T00:43:55.068607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-24T00:43:55.068879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-24T00:43:55.068995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-24T00:43:55.069097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-24T00:43:55.069200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-10-24T00:43:55.069334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-24T00:43:55.069443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-24T00:43:55.069548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-24T00:43:55.069679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-24T00:43:55.069790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-24T00:43:55.069892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-24T00:43:55.070016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-24T00:43:55.070120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-24T00:43:55.070221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-24T00:43:55.070316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-24T00:43:55.070413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-24T00:43:55.070512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-24T00:43:55.070614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-24T00:43:55.070738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-24T00:43:55.070850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-24T00:43:55.070945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-24T00:43:55.071049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-24T00:43:55.071152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-24T00:43:55.071249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-24T00:43:55.071352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-24T00:43:55.071446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-24T00:43:55.071559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-24T00:43:55.071679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-24T00:43:55.071777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-24T00:43:55.071873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-24T00:43:55.071971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-24T00:43:55.072078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-24T00:43:55.072180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-24T00:43:55.072288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-24T00:43:55.072403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-24T00:43:55.072503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-24T00:43:55.072600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-24T00:43:55.072726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-10-24T00:43:55.072833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-24T00:43:55.072953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-24T00:43:55.073069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-24T00:43:55.073197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-24T00:43:55.073322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-24T00:43:55.073436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-24T00:43:55.073543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-24T00:43:55.073667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-24T00:43:55.073782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-24T00:43:55.073899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-24T00:43:55.074007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-24T00:43:55.074110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-24T00:43:55.074233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-10-24T00:43:55.074332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-24T00:43:55.074455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-24T00:43:55.074558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-24T00:43:55.074693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-24T00:43:55.074855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-24T00:43:55.074977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-24T00:43:55.075080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-24T00:43:55.075187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-24T00:43:55.075302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-24T00:43:55.075404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-24T00:43:55.075515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-24T00:43:55.075622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-24T00:43:55.075757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-24T00:43:55.075866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-24T00:43:55.075977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-24T00:43:55.076085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-24T00:43:55.076189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-24T00:43:55.076288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-10-24T00:43:55.076408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-24T00:43:55.076512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-24T00:43:55.076623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-24T00:43:55.076772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-24T00:43:55.076880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-24T00:43:55.076977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-24T00:43:55.077081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-24T00:43:55.077182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-24T00:43:55.077284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-10-24T00:43:55.077385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-24T00:43:55.077491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-24T00:43:55.077587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-24T00:43:55.077732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-24T00:43:55.077833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-24T00:43:55.077932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-24T00:43:55.078028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-24T00:43:55.078123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-24T00:43:55.078237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-24T00:43:55.078341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-10-24T00:43:55.078436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-24T00:43:55.078540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-10-24T00:43:55.078765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-24T00:43:55.078890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-24T00:43:55.078998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-24T00:43:55.079115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-24T00:43:55.079228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-24T00:43:55.079342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-24T00:43:55.079463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-24T00:43:55.079570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-24T00:43:55.079710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-24T00:43:55.079813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-24T00:43:55.079918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-24T00:43:55.080036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-24T00:43:55.080147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-24T00:43:55.080265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-24T00:43:55.080371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-24T00:43:55.080481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-24T00:43:55.080588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-24T00:43:55.080719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-24T00:43:55.080816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-24T00:43:55.080913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-24T00:43:55.081022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-24T00:43:55.081130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-24T00:43:55.081226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-24T00:43:55.081344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-24T00:43:55.081460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-24T00:43:55.081582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-24T00:43:55.081709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-24T00:43:55.081809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-24T00:43:55.081904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-24T00:43:55.082010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-24T00:43:55.082109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-10-24T00:43:55.082215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-24T00:43:55.082310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-24T00:43:55.082406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-24T00:43:55.082500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-24T00:43:55.082595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-24T00:43:55.082726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-10-24T00:43:55.082825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-24T00:43:55.082946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-10-24T00:43:55.083044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-24T00:43:55.083152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-24T00:43:55.083267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-24T00:43:55.083368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-24T00:43:55.083474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-24T00:43:55.083584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-10-24T00:43:55.083783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-24T00:43:55.083885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-24T00:43:55.083991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-24T00:43:55.084111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-24T00:43:55.084221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-24T00:43:55.084319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-24T00:43:55.084415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-24T00:43:55.084509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-24T00:43:55.084617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-24T00:43:55.084735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-24T00:43:55.084854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-24T00:43:55.084962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-24T00:43:55.085060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-24T00:43:55.085155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-24T00:43:55.085250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-24T00:43:55.085346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-24T00:43:55.085441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-24T00:43:55.085536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-24T00:43:55.085630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-24T00:43:55.085747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-24T00:43:55.085844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-24T00:43:55.085950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-24T00:43:55.086046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-10-24T00:43:55.086171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-24T00:43:55.086268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-24T00:43:55.086365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-24T00:43:55.086473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-24T00:43:55.086591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-24T00:43:55.086723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-24T00:43:55.086820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRSU.csv [2025-10-24T00:43:55.086923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-24T00:43:55.087032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-24T00:43:55.087130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-24T00:43:55.087236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-24T00:43:55.087339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-24T00:43:55.087444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-24T00:43:55.087543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-24T00:43:55.087687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-24T00:43:55.087789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-24T00:43:55.087885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-24T00:43:55.087980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-24T00:43:55.088085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-24T00:43:55.088192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-24T00:43:55.088296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-24T00:43:55.088400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-24T00:43:55.088507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-24T00:43:55.088624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-24T00:43:55.088863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-24T00:43:55.088967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-24T00:43:55.089075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-24T00:43:55.089172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-24T00:43:55.089268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-24T00:43:55.089389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-24T00:43:55.089486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-24T00:43:55.089584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-24T00:43:55.089711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-24T00:43:55.089807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-24T00:43:55.089901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-24T00:43:55.090008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-24T00:43:55.090113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-24T00:43:55.090208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-24T00:43:55.090319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-24T00:43:55.090413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-24T00:43:55.090523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-10-24T00:43:55.090618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-24T00:43:55.090749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-24T00:43:55.090860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-24T00:43:55.090960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-10-24T00:43:55.091058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-24T00:43:55.091161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-24T00:43:55.091262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-24T00:43:55.091362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-24T00:43:55.091457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-24T00:43:55.091577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-24T00:43:55.091712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-24T00:43:55.091823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-24T00:43:55.091936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-24T00:43:55.092046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-24T00:43:55.092157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-24T00:43:55.092253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-24T00:43:55.092349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-24T00:43:55.092462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-24T00:43:55.092564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-24T00:43:55.092690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-24T00:43:55.092794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-24T00:43:55.092901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-24T00:43:55.092997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-24T00:43:55.093095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-24T00:43:55.093212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-24T00:43:55.093312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-24T00:43:55.093450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-10-24T00:43:55.093578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-24T00:43:55.093769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-10-24T00:43:55.093870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-24T00:43:55.093966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-24T00:43:55.094066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-24T00:43:55.094164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-24T00:43:55.094270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-24T00:43:55.094373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-24T00:43:55.094474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-24T00:43:55.094578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-24T00:43:55.094699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-24T00:43:55.094799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-24T00:43:55.094893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-24T00:43:55.094992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-24T00:43:55.095089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-24T00:43:55.095197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-10-24T00:43:55.095302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-24T00:43:55.095411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-10-24T00:43:55.095530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-24T00:43:55.095629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-24T00:43:55.095768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-24T00:43:55.095866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-24T00:43:55.095970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-24T00:43:55.096076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-24T00:43:55.096176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-24T00:43:55.096284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-24T00:43:55.096384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-24T00:43:55.096484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-24T00:43:55.096579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-24T00:43:55.096700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-24T00:43:55.096797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-24T00:43:55.096894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-24T00:43:55.096989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-24T00:43:55.097085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-24T00:43:55.097192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-10-24T00:43:55.097303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-24T00:43:55.097412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-24T00:43:55.097513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-24T00:43:55.097608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-24T00:43:55.097760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-24T00:43:55.097859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-24T00:43:55.097957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-24T00:43:55.098061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-24T00:43:55.098164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-24T00:43:55.098268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-24T00:43:55.098364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-24T00:43:55.098467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-24T00:43:55.098562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-24T00:43:55.098693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-24T00:43:55.098792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-24T00:43:55.098889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-24T00:43:55.098984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-24T00:43:55.099082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-24T00:43:55.099190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-24T00:43:55.099290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-24T00:43:55.099385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-24T00:43:55.099486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-24T00:43:55.099589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-24T00:43:55.099713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-24T00:43:55.099810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-24T00:43:55.099904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-24T00:43:55.100025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-24T00:43:55.100125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-24T00:43:55.100222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-10-24T00:43:55.100318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-24T00:43:55.100416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-24T00:43:55.100511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-24T00:43:55.100618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-24T00:43:55.100770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-24T00:43:55.100867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-24T00:43:55.100980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-24T00:43:55.101085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-24T00:43:55.101179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-24T00:43:55.101287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-24T00:43:55.101399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-24T00:43:55.101497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-24T00:43:55.101592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-24T00:43:55.101729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-24T00:43:55.101833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-24T00:43:55.101939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-10-24T00:43:55.102035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-24T00:43:55.102130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-24T00:43:55.102224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-24T00:43:55.102350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-24T00:43:55.102471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-24T00:43:55.102587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-24T00:43:55.102782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-24T00:43:55.102881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-24T00:43:55.102988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-10-24T00:43:55.103095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-24T00:43:55.103191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-10-24T00:43:55.103288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-24T00:43:55.103397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-24T00:43:55.103494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-24T00:43:55.103596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-24T00:43:55.103719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-24T00:43:55.103840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-24T00:43:55.103939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-24T00:43:55.104035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-24T00:43:55.104131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-24T00:43:55.104227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-24T00:43:55.104323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-24T00:43:55.104417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-24T00:43:55.104512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-24T00:43:55.104617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-24T00:43:55.104743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-10-24T00:43:55.104851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-24T00:43:55.104948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-24T00:43:55.105045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-24T00:43:55.105151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-24T00:43:55.105247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-24T00:43:55.105342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-10-24T00:43:55.105460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-24T00:43:55.105568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-24T00:43:55.105719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-10-24T00:43:55.105820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-24T00:43:55.105935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-24T00:43:55.106045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-24T00:43:55.106147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-24T00:43:55.106246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-10-24T00:43:55.106351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-24T00:43:55.106455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-24T00:43:55.106559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-24T00:43:55.106686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-24T00:43:55.106789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-10-24T00:43:55.106896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-24T00:43:55.107002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-24T00:43:55.107104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-24T00:43:55.107222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-24T00:43:55.107331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-24T00:43:55.107439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-24T00:43:55.107547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-24T00:43:55.107740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-24T00:43:55.107848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-24T00:43:55.107956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-24T00:43:55.108056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-24T00:43:55.108156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-24T00:43:55.108275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-24T00:43:55.108375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-24T00:43:55.108477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-24T00:43:55.108599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-24T00:43:55.108739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-24T00:43:55.108851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-10-24T00:43:55.108948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-24T00:43:55.109047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-24T00:43:55.109143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-24T00:43:55.109242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-24T00:43:55.109363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-24T00:43:55.109467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-24T00:43:55.109568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-24T00:43:55.109709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-24T00:43:55.109808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-24T00:43:55.109905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-24T00:43:55.110017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-24T00:43:55.110115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-24T00:43:55.110220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-24T00:43:55.110336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-24T00:43:55.110437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-24T00:43:55.110538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-24T00:43:55.110669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-24T00:43:55.110786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-10-24T00:43:55.110910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-24T00:43:55.111009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-24T00:43:55.111122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-24T00:43:55.111219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-24T00:43:55.111325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-24T00:43:55.111439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-24T00:43:55.111539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-24T00:43:55.111638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-24T00:43:55.111791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-24T00:43:55.111893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-24T00:43:55.111989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-24T00:43:55.112089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-24T00:43:55.112191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-24T00:43:55.112296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-24T00:43:55.112394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-10-24T00:43:55.112497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-24T00:43:55.112593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-24T00:43:55.112797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-24T00:43:55.112906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-24T00:43:55.113005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-24T00:43:55.113100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-24T00:43:55.113204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-24T00:43:55.113309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-24T00:43:55.113416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-24T00:43:55.113513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-24T00:43:55.113622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-24T00:43:55.113759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-24T00:43:55.113857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-24T00:43:55.113955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-10-24T00:43:55.114062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-24T00:43:55.114168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-24T00:43:55.114271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-24T00:43:55.114374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-24T00:43:55.114470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-24T00:43:55.114564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-24T00:43:55.114681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-24T00:43:55.114789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-24T00:43:55.114893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-24T00:43:55.114998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-24T00:43:55.115092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-24T00:43:55.115196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-24T00:43:55.115299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-24T00:43:55.115395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-24T00:43:55.115495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-24T00:43:55.115596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-24T00:43:55.115735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-24T00:43:55.115839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-24T00:43:55.115935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-24T00:43:55.116039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-24T00:43:55.116133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-24T00:43:55.116242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-24T00:43:55.116345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-24T00:43:55.116441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-10-24T00:43:55.116534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-24T00:43:55.116662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-24T00:43:55.116761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-24T00:43:55.116863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-24T00:43:55.116967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-24T00:43:55.117069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-24T00:43:55.117164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-10-24T00:43:55.117265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-24T00:43:55.117378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-24T00:43:55.117473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-10-24T00:43:55.117568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-24T00:43:55.117729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-24T00:43:55.117845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-10-24T00:43:55.117939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-24T00:43:55.118043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-24T00:43:55.118137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-24T00:43:55.118230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-24T00:43:55.118324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-24T00:43:55.118416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-24T00:43:55.118526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-24T00:43:55.118621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-24T00:43:55.118745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-24T00:43:55.118839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-24T00:43:55.118933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-24T00:43:55.119027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-24T00:43:55.119121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-24T00:43:55.119221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-24T00:43:55.119328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-24T00:43:55.119455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-24T00:43:55.119554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-24T00:43:55.119689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-24T00:43:55.119787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-24T00:43:55.119895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-24T00:43:55.119999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-24T00:43:55.120097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-24T00:43:55.120223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-24T00:43:55.120327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-24T00:43:55.120422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-24T00:43:55.120518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-24T00:43:55.120628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-24T00:43:55.120803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-24T00:43:55.120919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-24T00:43:55.121023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-24T00:43:55.121121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-24T00:43:55.121216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-24T00:43:55.121323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-24T00:43:55.121490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-24T00:43:55.121598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-24T00:43:55.121718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-24T00:43:55.121833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-24T00:43:55.121940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-24T00:43:55.122047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-24T00:43:55.122142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-24T00:43:55.122240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-24T00:43:55.122335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-24T00:43:55.122432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-24T00:43:55.122538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-10-24T00:43:55.122637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-24T00:43:55.122760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-24T00:43:55.122865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-24T00:43:55.122973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-24T00:43:55.123068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-24T00:43:55.123172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-24T00:43:55.123276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-24T00:43:55.123373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-24T00:43:55.123476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-24T00:43:55.123574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-24T00:43:55.123702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-24T00:43:55.123802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-24T00:43:55.123897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-24T00:43:55.123991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-24T00:43:55.124094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-24T00:43:55.124201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-24T00:43:55.124313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-24T00:43:55.124413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-24T00:43:55.124510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-10-24T00:43:55.124607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-24T00:43:55.124743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-24T00:43:55.124849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-24T00:43:55.124948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-24T00:43:55.125043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-24T00:43:55.125136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-24T00:43:55.125232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-24T00:43:55.125328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-24T00:43:55.125434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-24T00:43:55.125531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-24T00:43:55.125624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-24T00:43:55.125745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-24T00:43:55.125864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-24T00:43:55.125959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-24T00:43:55.126056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-24T00:43:55.126151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-24T00:43:55.126318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-24T00:43:55.126413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-24T00:43:55.126508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-24T00:43:55.126622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-24T00:43:55.126743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-24T00:43:55.126841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-24T00:43:55.126939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-24T00:43:55.127036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-24T00:43:55.127134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-24T00:43:55.127232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-24T00:43:55.127348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-24T00:43:55.127447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-10-24T00:43:55.127544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-24T00:43:55.132288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-24T00:43:55.132720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-24T00:43:55.132837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-24T00:43:55.132940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-24T00:43:55.133050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-24T00:43:55.133151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-24T00:43:55.133252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-24T00:43:55.133387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-24T00:43:55.133527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-24T00:43:55.133629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-24T00:43:55.133781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-10-24T00:43:55.133911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-24T00:43:55.134012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-24T00:43:55.134125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-24T00:43:55.134262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-24T00:43:55.134364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-24T00:43:55.134461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-24T00:43:55.134558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-24T00:43:55.134693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-24T00:43:55.134796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-24T00:43:55.134894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-24T00:43:55.134990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-24T00:43:55.135098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-24T00:43:55.135208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-24T00:43:55.135310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-24T00:43:55.135433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-24T00:43:55.135555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-24T00:43:55.135691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-24T00:43:55.135813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-24T00:43:55.135920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-24T00:43:55.136019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-24T00:43:55.136136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-24T00:43:55.136255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-24T00:43:55.136413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-24T00:43:55.136516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-24T00:43:55.136613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-24T00:43:55.137046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-24T00:43:55.137160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-24T00:43:55.137280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-24T00:43:55.137392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-24T00:43:55.137506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-24T00:43:55.137609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-24T00:43:55.137817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-24T00:43:55.137940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-10-24T00:43:55.138042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-24T00:43:55.138130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-24T00:43:55.138199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-10-24T00:43:55.138280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-24T00:43:55.138369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-24T00:43:55.138435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-24T00:43:55.138518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-24T00:43:55.138587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-10-24T00:43:55.138713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-24T00:43:55.138824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-24T00:43:55.138924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-24T00:43:55.139024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-24T00:43:55.139127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-24T00:43:55.139260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-24T00:43:55.139376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-24T00:43:55.139497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-24T00:43:55.139595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-24T00:43:55.139756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-24T00:43:55.139873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-24T00:43:55.139985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-24T00:43:55.140094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-24T00:43:55.140203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-24T00:43:55.140303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-24T00:43:55.140413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-24T00:43:55.140538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-24T00:43:55.140863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-24T00:43:55.140973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-24T00:43:55.141075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-24T00:43:55.141175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-24T00:43:55.141279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-24T00:43:55.141394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-24T00:43:55.141500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-24T00:43:55.141623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-24T00:43:55.141765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-24T00:43:55.141877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-24T00:43:55.141980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-24T00:43:55.142082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-24T00:43:55.142201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-24T00:43:55.142302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-24T00:43:55.142409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-24T00:43:55.142510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-24T00:43:55.142612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-24T00:43:55.142754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-24T00:43:55.142864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-24T00:43:55.142964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-24T00:43:55.143065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-24T00:43:55.143162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-24T00:43:55.143274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-24T00:43:55.143377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-24T00:43:55.143488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-24T00:43:55.143597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-24T00:43:55.143733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-24T00:43:55.143847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-24T00:43:55.143963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-24T00:43:55.144063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-24T00:43:55.144163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-24T00:43:55.144265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-24T00:43:55.144393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-24T00:43:55.144525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-24T00:43:55.144635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-24T00:43:55.144777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-24T00:43:55.144887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-24T00:43:55.144986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-24T00:43:55.145109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-24T00:43:55.145222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-24T00:43:55.145323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-24T00:43:55.145429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-24T00:43:55.145536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-24T00:43:55.145633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-24T00:43:55.145820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-24T00:43:55.145937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-24T00:43:55.146067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-24T00:43:55.146171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-24T00:43:55.146273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-24T00:43:55.146372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-24T00:43:55.146481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-24T00:43:55.146582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-24T00:43:55.146738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-24T00:43:55.146850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-24T00:43:55.146958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-24T00:43:55.147069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-24T00:43:55.147169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-24T00:43:55.147268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-24T00:43:55.147369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-24T00:43:55.147487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-24T00:43:55.147602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-24T00:43:55.147747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-24T00:43:55.147846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-24T00:43:55.147946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-24T00:43:55.148055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-24T00:43:55.148174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-24T00:43:55.148284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-24T00:43:55.148405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-24T00:43:55.148563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-24T00:43:55.148753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-10-24T00:43:55.148856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-24T00:43:55.148962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-24T00:43:55.149089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-24T00:43:55.149199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-24T00:43:55.149297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-24T00:43:55.149403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-24T00:43:55.149511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-24T00:43:55.149611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-24T00:43:55.149733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-24T00:43:55.149832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-24T00:43:55.149958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-24T00:43:55.150069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-24T00:43:55.150190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-24T00:43:55.150289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-24T00:43:55.150395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-24T00:43:55.150493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-24T00:43:55.150603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-24T00:43:55.150737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-24T00:43:55.150845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-24T00:43:55.150945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-24T00:43:55.151062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-24T00:43:55.151165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-10-24T00:43:55.151263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-24T00:43:55.151372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-24T00:43:55.151470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-24T00:43:55.151568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-24T00:43:55.151692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-24T00:43:55.151805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-24T00:43:55.151907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-24T00:43:55.152012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-24T00:43:55.152108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-24T00:43:55.152206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-24T00:43:55.152303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-24T00:43:55.152402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-10-24T00:43:55.152515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-24T00:43:55.152633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-24T00:43:55.152848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-24T00:43:55.152962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-24T00:43:55.153072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-24T00:43:55.153171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-24T00:43:55.153269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-24T00:43:55.153369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-24T00:43:55.153472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-24T00:43:55.153592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-24T00:43:55.153723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-24T00:43:55.153824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-24T00:43:55.153928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-24T00:43:55.154030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-24T00:43:55.154132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-24T00:43:55.154231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-24T00:43:55.154333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-24T00:43:55.154451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-24T00:43:55.154574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-24T00:43:55.154704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-24T00:43:55.154807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-24T00:43:55.154930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-24T00:43:55.155031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-24T00:43:55.155209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-10-24T00:43:55.155330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-24T00:43:55.155463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-24T00:43:55.155571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-24T00:43:55.155700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-24T00:43:55.155812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-24T00:43:55.155926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-24T00:43:55.156025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-24T00:43:55.156123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-24T00:43:55.156226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-24T00:43:55.156339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-24T00:43:55.156452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-24T00:43:55.156553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-10-24T00:43:55.156804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-24T00:43:55.156912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-24T00:43:55.157024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-24T00:43:55.157135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-24T00:43:55.157251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-10-24T00:43:55.157354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-24T00:43:55.157462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-24T00:43:55.157569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-24T00:43:55.157726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-24T00:43:55.157852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-24T00:43:55.157956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-10-24T00:43:55.158074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-24T00:43:55.158173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-24T00:43:55.158281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-24T00:43:55.158381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-24T00:43:55.158480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-24T00:43:55.158578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-24T00:43:55.158704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-10-24T00:43:55.158803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-24T00:43:55.158901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-24T00:43:55.159004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-24T00:43:55.159105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-24T00:43:55.159204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-24T00:43:55.159304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-24T00:43:55.159404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-24T00:43:55.159503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-24T00:43:55.159624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-24T00:43:55.159760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-24T00:43:55.159857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-24T00:43:55.159957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-24T00:43:55.160077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-24T00:43:55.160185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-24T00:43:55.160287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-24T00:43:55.160394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-24T00:43:55.160510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-24T00:43:55.160632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-24T00:43:55.160808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-24T00:43:55.160918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-24T00:43:55.161055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-24T00:43:55.161175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-24T00:43:55.161303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-24T00:43:55.161413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-10-24T00:43:55.161516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-24T00:43:55.161637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-24T00:43:55.161760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-24T00:43:55.161879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-24T00:43:55.161980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-24T00:43:55.162098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-24T00:43:55.162200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-24T00:43:55.162300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-24T00:43:55.162410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-24T00:43:55.162508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-24T00:43:55.162607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-24T00:43:55.162758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-24T00:43:55.162880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-24T00:43:55.162983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-24T00:43:55.163082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-24T00:43:55.163212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-24T00:43:55.163346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-24T00:43:55.163510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-24T00:43:55.163626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-24T00:43:55.163790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-24T00:43:55.163889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-24T00:43:55.163989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-24T00:43:55.164086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-24T00:43:55.164193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-24T00:43:55.164292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-24T00:43:55.164391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-24T00:43:55.164515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-24T00:43:55.164622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-24T00:43:55.164823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-10-24T00:43:55.164924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-24T00:43:55.165023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-24T00:43:55.165121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-24T00:43:55.165219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-24T00:43:55.165316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-24T00:43:55.165434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-24T00:43:55.165531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-24T00:43:55.165675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-24T00:43:55.165778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-24T00:43:55.165877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-24T00:43:55.165983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-24T00:43:55.166081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-24T00:43:55.166179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-24T00:43:55.166277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-24T00:43:55.166386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-24T00:43:55.166510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-24T00:43:55.166620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-24T00:43:55.166750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-24T00:43:55.166858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-24T00:43:55.166967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-24T00:43:55.167078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-24T00:43:55.167203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-24T00:43:55.167304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-24T00:43:55.167420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-24T00:43:55.167526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-24T00:43:55.167671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-24T00:43:55.167775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-24T00:43:55.167888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-24T00:43:55.168021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-10-24T00:43:55.168122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-24T00:43:55.168253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-24T00:43:55.168363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-24T00:43:55.168477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-24T00:43:55.168596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-24T00:43:55.168722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-24T00:43:55.168826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-24T00:43:55.168930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-24T00:43:55.169029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-24T00:43:55.169140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-24T00:43:55.169251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-24T00:43:55.169350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-24T00:43:55.169463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-24T00:43:55.169584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-24T00:43:55.169718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-24T00:43:55.169821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-10-24T00:43:55.169924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-24T00:43:55.170053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-24T00:43:55.170161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-24T00:43:55.170261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-24T00:43:55.170362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-24T00:43:55.170483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-24T00:43:55.170596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-24T00:43:55.170721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-24T00:43:55.170821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-24T00:43:55.170931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-24T00:43:55.171040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-24T00:43:55.171148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-24T00:43:55.171256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-24T00:43:55.171356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-24T00:43:55.171472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-24T00:43:55.171575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-24T00:43:55.171697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-24T00:43:55.171800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-10-24T00:43:55.171902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-24T00:43:55.172014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-24T00:43:55.172136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-24T00:43:55.172245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-24T00:43:55.172348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-24T00:43:55.172446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-24T00:43:55.172544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-24T00:43:55.172760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-24T00:43:55.172875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-24T00:43:55.172999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-24T00:43:55.173111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-24T00:43:55.173234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-24T00:43:55.173345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-10-24T00:43:55.173448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-24T00:43:55.173555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-24T00:43:55.173685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-24T00:43:55.173798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-24T00:43:55.173911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-24T00:43:55.174012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-24T00:43:55.174114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-10-24T00:43:55.174220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-24T00:43:55.174329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-24T00:43:55.174429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-24T00:43:55.174536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-24T00:43:55.174687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-24T00:43:55.174803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-24T00:43:55.174913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-24T00:43:55.175023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-24T00:43:55.175124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-24T00:43:55.175225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-24T00:43:55.175336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-24T00:43:55.175436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-24T00:43:55.175536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-24T00:43:55.175635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-24T00:43:55.175761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-24T00:43:55.175952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-24T00:43:55.176054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-24T00:43:55.176155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-10-24T00:43:55.176256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-24T00:43:55.176363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-24T00:43:55.176461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-24T00:43:55.176575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-24T00:43:55.176710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-24T00:43:55.176811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-24T00:43:55.176911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-10-24T00:43:55.177020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-24T00:43:55.177127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-24T00:43:55.177228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-10-24T00:43:55.177328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-24T00:43:55.177426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-24T00:43:55.177533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-24T00:43:55.177693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-24T00:43:55.177794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-24T00:43:55.177878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-24T00:43:55.177988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-24T00:43:55.178088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-24T00:43:55.178197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-24T00:43:55.178306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-24T00:43:55.178407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-10-24T00:43:55.178506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-24T00:43:55.178612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-24T00:43:55.178743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-24T00:43:55.178853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-24T00:43:55.178953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-24T00:43:55.179062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-24T00:43:55.179161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-24T00:43:55.179259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-24T00:43:55.179358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-24T00:43:55.179464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-24T00:43:55.179578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-10-24T00:43:55.179702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-24T00:43:55.179802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-24T00:43:55.179901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-24T00:43:55.180007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-24T00:43:55.180105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-24T00:43:55.180214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-24T00:43:55.180313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-24T00:43:55.180418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-24T00:43:55.180517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-24T00:43:55.180616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-10-24T00:43:55.180820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-24T00:43:55.180920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-24T00:43:55.181033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-24T00:43:55.181150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-24T00:43:55.181271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-24T00:43:55.181381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-24T00:43:55.181488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-24T00:43:55.181590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-24T00:43:55.181717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-10-24T00:43:55.181829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-24T00:43:55.181945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-24T00:43:55.182052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-24T00:43:55.182179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-10-24T00:43:55.182282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-24T00:43:55.182384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-24T00:43:55.182490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-24T00:43:55.182590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-24T00:43:55.182722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-24T00:43:55.182823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-24T00:43:55.182926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-24T00:43:55.183028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-24T00:43:55.183138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-24T00:43:55.183237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-24T00:43:55.183342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-24T00:43:55.183442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-24T00:43:55.183551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-24T00:43:55.183679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-24T00:43:55.183783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-24T00:43:55.183883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-24T00:43:55.183992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-24T00:43:55.184113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-24T00:43:55.184212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-24T00:43:55.184322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-24T00:43:55.184432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-24T00:43:55.184534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-24T00:43:55.184634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-24T00:43:55.184783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-24T00:43:55.184887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-24T00:43:55.184994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-24T00:43:55.185096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-24T00:43:55.185198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-24T00:43:55.185319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-10-24T00:43:55.185424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-24T00:43:55.185531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-24T00:43:55.185629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-24T00:43:55.185821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-24T00:43:55.185930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-24T00:43:55.186029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-10-24T00:43:55.186149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-24T00:43:55.186247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-10-24T00:43:55.186353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-24T00:43:55.186450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-24T00:43:55.186559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-24T00:43:55.186681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-24T00:43:55.186784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-24T00:43:55.186894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-24T00:43:55.186993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-24T00:43:55.187090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-24T00:43:55.187188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-24T00:43:55.187284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-24T00:43:55.187384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-24T00:43:55.187482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-10-24T00:43:55.187580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-24T00:43:55.187716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-24T00:43:55.187817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-24T00:43:55.187937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-24T00:43:55.188037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-10-24T00:43:55.188137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-24T00:43:55.188233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-24T00:43:55.188330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-24T00:43:55.188428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-24T00:43:55.188530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-24T00:43:55.188627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-24T00:43:55.188768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-24T00:43:55.188877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-24T00:43:55.188975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-24T00:43:55.189071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-24T00:43:55.189191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-24T00:43:55.189288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-24T00:43:55.189393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-24T00:43:55.189497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-24T00:43:55.189609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-24T00:43:55.189736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-24T00:43:55.189845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-24T00:43:55.189944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-24T00:43:55.190049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-24T00:43:55.190150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-24T00:43:55.190247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-24T00:43:55.190346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-24T00:43:55.190451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-24T00:43:55.190549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-24T00:43:55.190762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-24T00:43:55.190863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-24T00:43:55.190983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-24T00:43:55.191082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-24T00:43:55.191191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-24T00:43:55.191289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-24T00:43:55.191387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-24T00:43:55.191489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-24T00:43:55.191588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-24T00:43:55.191717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-24T00:43:55.191828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-10-24T00:43:55.191934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-24T00:43:55.192033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-24T00:43:55.192147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-24T00:43:55.192254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-24T00:43:55.192353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-24T00:43:55.192451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-24T00:43:55.192548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-24T00:43:55.192715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-24T00:43:55.192818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-24T00:43:55.192916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-24T00:43:55.193014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-24T00:43:55.193120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-24T00:43:55.193218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-24T00:43:55.193383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-24T00:43:55.193480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-24T00:43:55.193579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-24T00:43:55.193716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-24T00:43:55.193814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-24T00:43:55.194076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-24T00:43:55.194188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-24T00:43:55.194290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-24T00:43:55.194389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-24T00:43:55.194566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-24T00:43:55.194750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-24T00:43:55.194869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-24T00:43:55.194987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-24T00:43:55.195098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-24T00:43:55.195212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-24T00:43:55.195311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-24T00:43:55.195469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-24T00:43:55.195589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-24T00:43:55.195716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-24T00:43:55.195834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-24T00:43:55.195934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-24T00:43:55.196033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-24T00:43:55.196139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-24T00:43:55.196245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-24T00:43:55.196344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-24T00:43:55.196492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-24T00:43:55.196603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-24T00:43:55.196749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-24T00:43:55.196852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-24T00:43:55.196966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-24T00:43:55.197066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-24T00:43:55.197170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-24T00:43:55.197274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-24T00:43:55.197437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-24T00:43:55.197540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-24T00:43:55.197686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-24T00:43:55.197781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-24T00:43:55.197883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-24T00:43:55.197989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-24T00:43:55.198101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-24T00:43:55.198226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-10-24T00:43:55.198385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-24T00:43:55.198501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-10-24T00:43:55.198615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-24T00:43:55.198788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-24T00:43:55.198931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-24T00:43:55.199052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-24T00:43:55.199154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-24T00:43:55.199258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-24T00:43:55.199410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-24T00:43:55.199516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-24T00:43:55.199617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-24T00:43:55.199769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-24T00:43:55.199869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-24T00:43:55.199974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-24T00:43:55.200098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-24T00:43:55.200213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-24T00:43:55.200354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-24T00:43:55.200466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-24T00:43:55.200565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-24T00:43:55.200704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-24T00:43:55.200811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-24T00:43:55.200945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-24T00:43:55.201060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-24T00:43:55.201168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-24T00:43:55.201345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-24T00:43:55.201458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-24T00:43:55.201556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-24T00:43:55.201737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-24T00:43:55.201858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-24T00:43:55.201971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-24T00:43:55.202081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-24T00:43:55.202180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-24T00:43:55.202348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-10-24T00:43:55.202452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-24T00:43:55.202552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-24T00:43:55.202699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-24T00:43:55.202806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-24T00:43:55.202908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-24T00:43:55.203024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-24T00:43:55.203137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-24T00:43:55.203285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-24T00:43:55.203386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-24T00:43:55.203498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-24T00:43:55.203600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-24T00:43:55.203745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-24T00:43:55.203863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-24T00:43:55.203964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-24T00:43:55.204076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-24T00:43:55.204228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-24T00:43:55.204329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-24T00:43:55.204428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-24T00:43:55.204542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-24T00:43:55.204665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-24T00:43:55.204767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-10-24T00:43:55.204902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-24T00:43:55.205011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-24T00:43:55.205139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-24T00:43:55.205260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-24T00:43:55.205359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-24T00:43:55.205458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-24T00:43:55.205565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-24T00:43:55.205694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-24T00:43:55.205797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-24T00:43:55.205905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-24T00:43:55.206034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-24T00:43:55.206182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-10-24T00:43:55.206298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-24T00:43:55.206396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-24T00:43:55.206497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-24T00:43:55.206594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-24T00:43:55.206815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-24T00:43:55.206919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-24T00:43:55.207019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-24T00:43:55.207168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-24T00:43:55.207354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-24T00:43:55.207464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-24T00:43:55.207561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-24T00:43:55.207710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-24T00:43:55.207810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-24T00:43:55.207929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-24T00:43:55.208036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-24T00:43:55.208144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-24T00:43:55.208254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-24T00:43:55.208353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-24T00:43:55.208452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-24T00:43:55.208549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-24T00:43:55.208673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-24T00:43:55.208775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-24T00:43:55.208874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-24T00:43:55.208991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-24T00:43:55.209121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-24T00:43:55.209259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-24T00:43:55.209370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-24T00:43:55.209480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-24T00:43:55.209579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-24T00:43:55.209706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-24T00:43:55.209834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-24T00:43:55.209936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-24T00:43:55.210034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-24T00:43:55.210143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-24T00:43:55.210241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-24T00:43:55.210340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-24T00:43:55.210441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-24T00:43:55.210543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-24T00:43:55.210669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-24T00:43:55.210779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-24T00:43:55.210879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-24T00:43:55.210987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-24T00:43:55.211086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-24T00:43:55.211186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNR.csv [2025-10-24T00:43:55.211292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-24T00:43:55.211391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-24T00:43:55.211497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-24T00:43:55.211594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-24T00:43:55.211793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-24T00:43:55.211899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-24T00:43:55.212008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-24T00:43:55.212107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-24T00:43:55.212219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-24T00:43:55.212317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-24T00:43:55.212415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-24T00:43:55.212530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-24T00:43:55.212628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-10-24T00:43:55.212756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-24T00:43:55.212855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-24T00:43:55.212972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-10-24T00:43:55.213078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-24T00:43:55.213176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-24T00:43:55.213294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-24T00:43:55.213392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-24T00:43:55.213497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-24T00:43:55.213609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-24T00:43:55.213729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-24T00:43:55.213837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-24T00:43:55.213947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-24T00:43:55.214068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-24T00:43:55.214185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-10-24T00:43:55.214285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-24T00:43:55.214387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-24T00:43:55.214491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-24T00:43:55.214603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-24T00:43:55.214738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-24T00:43:55.214859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-24T00:43:55.214971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-24T00:43:55.215079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-24T00:43:55.215181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-10-24T00:43:55.215280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-24T00:43:55.215400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-24T00:43:55.215499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-24T00:43:55.215595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-24T00:43:55.215719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-24T00:43:55.215817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-24T00:43:55.215916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-24T00:43:55.216040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-24T00:43:55.216141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-10-24T00:43:55.216262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-24T00:43:55.216363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-24T00:43:55.216472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-24T00:43:55.216581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-24T00:43:55.216714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-24T00:43:55.216817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-24T00:43:55.216919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-24T00:43:55.217019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-24T00:43:55.217117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-24T00:43:55.217215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-24T00:43:55.217322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-24T00:43:55.217448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-24T00:43:55.217549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-10-24T00:43:55.217698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-24T00:43:55.217824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-24T00:43:55.217932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-24T00:43:55.218033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-24T00:43:55.218140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-24T00:43:55.218249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-24T00:43:55.218356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-24T00:43:55.218473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-24T00:43:55.218573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-24T00:43:55.218709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-24T00:43:55.218844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-24T00:43:55.218954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-24T00:43:55.219061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-24T00:43:55.219159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-24T00:43:55.219285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-24T00:43:55.219397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-24T00:43:55.219518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-24T00:43:55.219732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-10-24T00:43:55.219851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-24T00:43:55.219961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-24T00:43:55.220060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-24T00:43:55.220182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-24T00:43:55.220303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-24T00:43:55.220404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-24T00:43:55.220518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-24T00:43:55.220617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-24T00:43:55.220747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-24T00:43:55.220849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-24T00:43:55.221033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-24T00:43:55.221143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-24T00:43:55.221247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-24T00:43:55.221349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-24T00:43:55.221448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-24T00:43:55.221549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-24T00:43:55.221671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-24T00:43:55.221777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-24T00:43:55.221885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-24T00:43:55.221986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-24T00:43:55.222092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-24T00:43:55.222201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-24T00:43:55.222309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-24T00:43:55.222423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-24T00:43:55.222534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-24T00:43:55.222634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-24T00:43:55.222761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-24T00:43:55.222861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-24T00:43:55.222969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-24T00:43:55.223070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-24T00:43:55.223178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-24T00:43:55.223278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-24T00:43:55.223385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-24T00:43:55.223484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-24T00:43:55.223583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-24T00:43:55.223708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-24T00:43:55.223816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-24T00:43:55.223916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-24T00:43:55.224015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-24T00:43:55.224115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-10-24T00:43:55.224214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-24T00:43:55.224321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-24T00:43:55.224421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-24T00:43:55.224521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-24T00:43:55.224627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-24T00:43:55.224767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-10-24T00:43:55.224866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-24T00:43:55.224965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-24T00:43:55.225078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-24T00:43:55.225212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-10-24T00:43:55.225324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-24T00:43:55.225433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-24T00:43:55.225543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-24T00:43:55.225664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-24T00:43:55.225792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-24T00:43:55.225896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-10-24T00:43:55.226019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-24T00:43:55.226119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-24T00:43:55.226229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-24T00:43:55.226336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-24T00:43:55.226434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-24T00:43:55.226533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-24T00:43:55.226630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-24T00:43:55.226790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-24T00:43:55.226909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-10-24T00:43:55.227033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-24T00:43:55.227133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-24T00:43:55.227232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-24T00:43:55.227334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-24T00:43:55.227433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-24T00:43:55.227531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-24T00:43:55.227696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-24T00:43:55.227809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-24T00:43:55.227909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-24T00:43:55.228011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-24T00:43:55.228118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-24T00:43:55.228229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-24T00:43:55.228331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-10-24T00:43:55.228439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-24T00:43:55.228536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-24T00:43:55.228672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-24T00:43:55.228782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-24T00:43:55.228897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-24T00:43:55.229007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-24T00:43:55.229105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-24T00:43:55.229203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-24T00:43:55.229304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-10-24T00:43:55.229401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-24T00:43:55.229503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-24T00:43:55.229604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-24T00:43:55.229750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-24T00:43:55.229849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-24T00:43:55.229948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-24T00:43:55.230055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-24T00:43:55.230156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-24T00:43:55.230258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-24T00:43:55.230360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-24T00:43:55.230467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-24T00:43:55.230566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-24T00:43:55.230696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-24T00:43:55.230817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-24T00:43:55.230916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-24T00:43:55.231014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-24T00:43:55.231129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-24T00:43:55.231229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-24T00:43:55.231332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-24T00:43:55.231432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-24T00:43:55.231537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-24T00:43:55.231635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-24T00:43:55.231778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-24T00:43:55.231880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-24T00:43:55.231980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-24T00:43:55.232095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-24T00:43:55.232196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-10-24T00:43:55.232303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-24T00:43:55.232403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-24T00:43:55.232503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-24T00:43:55.232614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-24T00:43:55.232734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-24T00:43:55.232833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-24T00:43:55.232957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-24T00:43:55.233055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-24T00:43:55.233164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-24T00:43:55.233262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-24T00:43:55.233373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-24T00:43:55.233474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-10-24T00:43:55.233580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-24T00:43:55.233710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-24T00:43:55.233820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-24T00:43:55.233918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-24T00:43:55.234028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-24T00:43:55.234130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-24T00:43:55.234238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-24T00:43:55.234345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-24T00:43:55.234464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-24T00:43:55.234568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-24T00:43:55.234783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-24T00:43:55.234909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-24T00:43:55.235009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-24T00:43:55.235108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-24T00:43:55.235225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-10-24T00:43:55.235324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-24T00:43:55.235432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-24T00:43:55.235529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-24T00:43:55.235629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-24T00:43:55.235766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-24T00:43:55.235865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-24T00:43:55.235964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-24T00:43:55.236061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-24T00:43:55.236158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-24T00:43:55.236256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-24T00:43:55.236479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-24T00:43:55.236591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-24T00:43:55.236727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-24T00:43:55.236876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-24T00:43:55.236988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-24T00:43:55.237088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-24T00:43:55.237193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-24T00:43:55.237330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-24T00:43:55.237449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-24T00:43:55.237552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-10-24T00:43:55.237696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-24T00:43:55.237828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-24T00:43:55.237962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-24T00:43:55.238070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-24T00:43:55.238177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-24T00:43:55.238276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-24T00:43:55.238413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-24T00:43:55.238513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-24T00:43:55.238612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-24T00:43:55.238743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-24T00:43:55.238884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-10-24T00:43:55.238983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-24T00:43:55.239082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-24T00:43:55.239192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-24T00:43:55.239296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-24T00:43:55.239415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-24T00:43:55.239536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-24T00:43:55.239635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-10-24T00:43:55.239800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-24T00:43:55.239902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-24T00:43:55.240001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-24T00:43:55.240112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-24T00:43:55.240211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-24T00:43:55.240320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-24T00:43:55.240419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-24T00:43:55.240518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-24T00:43:55.240617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-24T00:43:55.240768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-24T00:43:55.240875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-24T00:43:55.240978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-10-24T00:43:55.241083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-24T00:43:55.241187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-24T00:43:55.241299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-24T00:43:55.241404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-24T00:43:55.241505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-24T00:43:55.241613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-24T00:43:55.241749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-24T00:43:55.241850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-24T00:43:55.241960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-24T00:43:55.242073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-10-24T00:43:55.242176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-24T00:43:55.242278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-24T00:43:55.242391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-24T00:43:55.242506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-24T00:43:55.242698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-24T00:43:55.242814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-24T00:43:55.242915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-24T00:43:55.243015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-24T00:43:55.243117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-10-24T00:43:55.243260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-24T00:43:55.243371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-10-24T00:43:55.243473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-24T00:43:55.243588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-24T00:43:55.243777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-24T00:43:55.243887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-24T00:43:55.243989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-24T00:43:55.244089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-24T00:43:55.244193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-24T00:43:55.244315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-24T00:43:55.244415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-24T00:43:55.244519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-24T00:43:55.244629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-24T00:43:55.244757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-24T00:43:55.244855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-24T00:43:55.244964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-24T00:43:55.245066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-24T00:43:55.245186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-24T00:43:55.245307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-24T00:43:55.245412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-24T00:43:55.245524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-24T00:43:55.245623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-24T00:43:55.245745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-24T00:43:55.245844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-24T00:43:55.245946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-24T00:43:55.246055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-24T00:43:55.246164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-24T00:43:55.246272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-24T00:43:55.246372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-24T00:43:55.246479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-24T00:43:55.246580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-24T00:43:55.246716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-24T00:43:55.246827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-24T00:43:55.246938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-24T00:43:55.247046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-24T00:43:55.247154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-24T00:43:55.247254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-24T00:43:55.247376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-10-24T00:43:55.247583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-10-24T00:43:55.247774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-24T00:43:55.247887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-24T00:43:55.247986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-24T00:43:55.248087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-24T00:43:55.248187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-24T00:43:55.248287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-24T00:43:55.248395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-24T00:43:55.248530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-24T00:43:55.248727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-24T00:43:55.248834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-24T00:43:55.248942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-24T00:43:55.249054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-24T00:43:55.249229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-24T00:43:55.249351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-24T00:43:55.249507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-24T00:43:55.249773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-24T00:43:55.249878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-10-24T00:43:55.249978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-24T00:43:55.250079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-24T00:43:55.250179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-24T00:43:55.250278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-24T00:43:55.250395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-24T00:43:55.250512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-24T00:43:55.250611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-24T00:43:55.250756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-24T00:43:55.250872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-24T00:43:55.250972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-24T00:43:55.251088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-24T00:43:55.251187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-10-24T00:43:55.251294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-24T00:43:55.251392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-24T00:43:55.251507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-24T00:43:55.251606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-24T00:43:55.251730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-24T00:43:55.251851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-24T00:43:55.251951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-24T00:43:55.252069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-10-24T00:43:55.252168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-24T00:43:55.252277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-24T00:43:55.252459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-24T00:43:55.252564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-24T00:43:55.252700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-24T00:43:55.252811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-24T00:43:55.252910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-24T00:43:55.253010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-24T00:43:55.253108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-24T00:43:55.253207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-24T00:43:55.253305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-24T00:43:55.253403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-24T00:43:55.253502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-24T00:43:55.253601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-24T00:43:55.253734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-24T00:43:55.253833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-24T00:43:55.253953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-24T00:43:55.254054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-24T00:43:55.254155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-24T00:43:55.254264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-24T00:43:55.254367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-24T00:43:55.254465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-24T00:43:55.254571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-10-24T00:43:55.254697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-24T00:43:55.254823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-24T00:43:55.254961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-24T00:43:55.255063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-24T00:43:55.255167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-24T00:43:55.255269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-24T00:43:55.255390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-24T00:43:55.255497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-24T00:43:55.255600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-10-24T00:43:55.255797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-24T00:43:55.255917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-24T00:43:55.256017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-24T00:43:55.256129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-10-24T00:43:55.256233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-10-24T00:43:55.256341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-24T00:43:55.256440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-24T00:43:55.256542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-24T00:43:55.256671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-24T00:43:55.256774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-24T00:43:55.256872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-24T00:43:55.256973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-24T00:43:55.257072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-24T00:43:55.257195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-10-24T00:43:55.257313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-24T00:43:55.257421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-24T00:43:55.257527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-24T00:43:55.257687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-24T00:43:55.257815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-10-24T00:43:55.257917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-24T00:43:55.258017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-24T00:43:55.258139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-24T00:43:55.258240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-24T00:43:55.258341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-24T00:43:55.258451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-24T00:43:55.258562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-24T00:43:55.258714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-24T00:43:55.258820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-24T00:43:55.258921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-24T00:43:55.259022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-24T00:43:55.259122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-24T00:43:55.259244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-24T00:43:55.259349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-24T00:43:55.259472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-24T00:43:55.259595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-24T00:43:55.259720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-24T00:43:55.259830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-24T00:43:55.259933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-24T00:43:55.260044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-10-24T00:43:55.260144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-24T00:43:55.260262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-24T00:43:55.260361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-24T00:43:55.260461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-24T00:43:55.260568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-24T00:43:55.260708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-24T00:43:55.260819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-24T00:43:55.260922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-24T00:43:55.261021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-24T00:43:55.261129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-24T00:43:55.261251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-24T00:43:55.261366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-24T00:43:55.261479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-24T00:43:55.261581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-24T00:43:55.261710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-24T00:43:55.261812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-24T00:43:55.261934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-24T00:43:55.262032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-24T00:43:55.262132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-24T00:43:55.262252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-24T00:43:55.262353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-10-24T00:43:55.262451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-24T00:43:55.262550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-24T00:43:55.262687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-24T00:43:55.262802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-24T00:43:55.262900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-24T00:43:55.263000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-24T00:43:55.263109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-24T00:43:55.263216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-24T00:43:55.263326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-24T00:43:55.263436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-10-24T00:43:55.263543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-24T00:43:55.263721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-24T00:43:55.263825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-24T00:43:55.263926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-24T00:43:55.264025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-24T00:43:55.264124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-24T00:43:55.264233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-24T00:43:55.264339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-24T00:43:55.264450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-24T00:43:55.264582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-10-24T00:43:55.264715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-24T00:43:55.264827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-24T00:43:55.264928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-24T00:43:55.265027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-24T00:43:55.265126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-24T00:43:55.265224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-24T00:43:55.265322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-24T00:43:55.265432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-24T00:43:55.265563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-24T00:43:55.265699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-24T00:43:55.265803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-24T00:43:55.265904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-24T00:43:55.266004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-24T00:43:55.266104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-24T00:43:55.266203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-10-24T00:43:55.266301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-24T00:43:55.266398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-24T00:43:55.266496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-24T00:43:55.266593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-24T00:43:55.266740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-24T00:43:55.266850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-24T00:43:55.266948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-24T00:43:55.267055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-24T00:43:55.267154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-24T00:43:55.267280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-10-24T00:43:55.267391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-24T00:43:55.267489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-24T00:43:55.267596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-24T00:43:55.267839] [INFO ] [LOCAL ] Deleted 1971 derivative data files. [2025-10-24T00:43:55.267914] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-24T00:43:55.270238] [INFO ] [LOCAL ] Found 2164 symbols with primary data. [2025-10-24T00:43:55.270716] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2164 symbols [2025-10-24T00:43:55.271763] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:55.272341] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:55.272902] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:55.299197] [DEBUG] [LOCAL ] AAMI: Loaded 24527 existing records from primary storage. [2025-10-24T00:43:55.299467] [INFO ] [MAIN ] AAMI: Loaded 24527 primary data records. [2025-10-24T00:43:55.563095] [DEBUG] [LOCAL ] AA: Loaded 54012 existing records from primary storage. [2025-10-24T00:43:55.636098] [INFO ] [MAIN ] AA: Loaded 54012 primary data records. [2025-10-24T00:43:55.725333] [DEBUG] [LOCAL ] A: Loaded 51001 existing records from primary storage. [2025-10-24T00:43:55.749317] [INFO ] [MAIN ] A: Loaded 51001 primary data records. [2025-10-24T00:43:56.327710] [DEBUG] [MAIN ] AAMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:56.403881] [DEBUG] [MAIN ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:56.403198] [DEBUG] [MAIN ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:56.441278] [INFO ] [MAIN ] AAMI: Generated 139 derivative records from 24527 primary records. [2025-10-24T00:43:56.444261] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-24T00:43:56.445263] [FATAL] [LOCAL ] AAMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:56.448207] [FATAL] [MAIN ] AAMI: Failed to save derivative data. [2025-10-24T00:43:56.450666] [INFO ] [MAIN ] Derivative Progress: 1/2164 symbols completed. AAMI took 1.2s. Estimated remaining: 42m 33s. Rate: 50.8 symbols/min [2025-10-24T00:43:56.452925] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:56.489710] [INFO ] [MAIN ] AA: Generated 139 derivative records from 54012 primary records. [2025-10-24T00:43:56.489951] [INFO ] [MAIN ] A: Generated 139 derivative records from 51001 primary records. [2025-10-24T00:43:56.490350] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-24T00:43:56.490544] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-24T00:43:56.491146] [FATAL] [LOCAL ] A: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:56.490861] [FATAL] [LOCAL ] AA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:56.491302] [FATAL] [MAIN ] A: Failed to save derivative data. [2025-10-24T00:43:56.494829] [INFO ] [MAIN ] Derivative Progress: 2/2164 symbols completed. A took 1.2s. Estimated remaining: 22m 4s. Rate: 98.0 symbols/min [2025-10-24T00:43:56.491434] [FATAL] [MAIN ] AA: Failed to save derivative data. [2025-10-24T00:43:56.495077] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:56.498150] [INFO ] [MAIN ] Derivative Progress: 3/2164 symbols completed. AA took 1.2s. Estimated remaining: 14m 44s. Rate: 146.6 symbols/min [2025-10-24T00:43:56.498453] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:56.539101] [DEBUG] [LOCAL ] AAP: Loaded 52090 existing records from primary storage. [2025-10-24T00:43:56.546168] [INFO ] [MAIN ] AAP: Loaded 52090 primary data records. [2025-10-24T00:43:56.646332] [DEBUG] [LOCAL ] AAT: Loaded 30402 existing records from primary storage. [2025-10-24T00:43:56.651796] [INFO ] [MAIN ] AAT: Loaded 30402 primary data records. [2025-10-24T00:43:56.645567] [DEBUG] [LOCAL ] AB: Loaded 24773 existing records from primary storage. [2025-10-24T00:43:56.657842] [INFO ] [MAIN ] AB: Loaded 24773 primary data records. [2025-10-24T00:43:57.490497] [DEBUG] [MAIN ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:57.530666] [DEBUG] [MAIN ] AB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:57.555307] [DEBUG] [MAIN ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:57.596551] [INFO ] [MAIN ] AAP: Generated 139 derivative records from 52090 primary records. [2025-10-24T00:43:57.597610] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-24T00:43:57.598211] [FATAL] [LOCAL ] AAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:57.598418] [FATAL] [MAIN ] AAP: Failed to save derivative data. [2025-10-24T00:43:57.604421] [INFO ] [MAIN ] Derivative Progress: 4/2164 symbols completed. AAP took 1.2s. Estimated remaining: 21m 0s. Rate: 102.8 symbols/min [2025-10-24T00:43:57.608604] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:57.623390] [INFO ] [MAIN ] AAT: Generated 139 derivative records from 30402 primary records. [2025-10-24T00:43:57.622995] [INFO ] [MAIN ] AB: Generated 139 derivative records from 24773 primary records. [2025-10-24T00:43:57.623564] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-24T00:43:57.623610] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-24T00:43:57.623889] [FATAL] [LOCAL ] AB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:57.624049] [FATAL] [LOCAL ] AAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:57.624385] [FATAL] [MAIN ] AB: Failed to save derivative data. [2025-10-24T00:43:57.626389] [INFO ] [MAIN ] Derivative Progress: 5/2164 symbols completed. AB took 1.1s. Estimated remaining: 16m 57s. Rate: 127.3 symbols/min [2025-10-24T00:43:57.626606] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:57.626762] [FATAL] [MAIN ] AAT: Failed to save derivative data. [2025-10-24T00:43:57.629050] [INFO ] [MAIN ] Derivative Progress: 6/2164 symbols completed. AAT took 1.1s. Estimated remaining: 14m 8s. Rate: 152.6 symbols/min [2025-10-24T00:43:57.637047] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:57.651021] [DEBUG] [LOCAL ] ABCB: Loaded 30498 existing records from primary storage. [2025-10-24T00:43:57.651186] [INFO ] [MAIN ] ABCB: Loaded 30498 primary data records. [2025-10-24T00:43:57.802938] [DEBUG] [LOCAL ] ABM: Loaded 32319 existing records from primary storage. [2025-10-24T00:43:57.821792] [INFO ] [MAIN ] ABM: Loaded 32319 primary data records. [2025-10-24T00:43:58.112238] [DEBUG] [LOCAL ] ABR: Loaded 52253 existing records from primary storage. [2025-10-24T00:43:58.159872] [INFO ] [MAIN ] ABR: Loaded 52253 primary data records. [2025-10-24T00:43:58.650851] [DEBUG] [MAIN ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:58.686673] [DEBUG] [MAIN ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:58.734796] [DEBUG] [MAIN ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:58.761228] [INFO ] [MAIN ] ABCB: Generated 139 derivative records from 30498 primary records. [2025-10-24T00:43:58.762485] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-24T00:43:58.763072] [FATAL] [LOCAL ] ABCB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:58.763187] [FATAL] [MAIN ] ABCB: Failed to save derivative data. [2025-10-24T00:43:58.767594] [INFO ] [MAIN ] Derivative Progress: 7/2164 symbols completed. ABCB took 1.2s. Estimated remaining: 17m 58s. Rate: 120.1 symbols/min [2025-10-24T00:43:58.771596] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:58.775831] [INFO ] [MAIN ] ABM: Generated 139 derivative records from 32319 primary records. [2025-10-24T00:43:58.778698] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-24T00:43:58.778933] [FATAL] [LOCAL ] ABM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:58.780219] [FATAL] [MAIN ] ABM: Failed to save derivative data. [2025-10-24T00:43:58.784562] [INFO ] [MAIN ] Derivative Progress: 8/2164 symbols completed. ABM took 1.2s. Estimated remaining: 15m 47s. Rate: 136.6 symbols/min [2025-10-24T00:43:58.785929] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:58.792922] [INFO ] [MAIN ] ABR: Generated 139 derivative records from 52253 primary records. [2025-10-24T00:43:58.793176] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-24T00:43:58.793517] [FATAL] [LOCAL ] ABR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:58.793693] [FATAL] [MAIN ] ABR: Failed to save derivative data. [2025-10-24T00:43:58.796247] [INFO ] [MAIN ] Derivative Progress: 9/2164 symbols completed. ABR took 1.2s. Estimated remaining: 14m 4s. Rate: 153.2 symbols/min [2025-10-24T00:43:58.796467] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:58.827741] [DEBUG] [LOCAL ] ACA: Loaded 22636 existing records from primary storage. [2025-10-24T00:43:58.827920] [INFO ] [MAIN ] ACA: Loaded 22636 primary data records. [2025-10-24T00:43:58.953347] [DEBUG] [LOCAL ] ABT: Loaded 54014 existing records from primary storage. [2025-10-24T00:43:58.981437] [INFO ] [MAIN ] ABT: Loaded 54014 primary data records. [2025-10-24T00:43:59.186902] [DEBUG] [LOCAL ] ACCO: Loaded 36869 existing records from primary storage. [2025-10-24T00:43:59.239207] [INFO ] [MAIN ] ACCO: Loaded 36869 primary data records. [2025-10-24T00:43:59.773084] [DEBUG] [MAIN ] ACA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:59.816819] [DEBUG] [MAIN ] ABT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:43:59.843532] [DEBUG] [MAIN ] ACCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:43:59.891742] [INFO ] [MAIN ] ACA: Generated 139 derivative records from 22636 primary records. [2025-10-24T00:43:59.894119] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-24T00:43:59.896461] [FATAL] [LOCAL ] ACA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:59.898262] [FATAL] [MAIN ] ACA: Failed to save derivative data. [2025-10-24T00:43:59.900496] [INFO ] [MAIN ] Derivative Progress: 10/2164 symbols completed. ACA took 1.1s. Estimated remaining: 16m 37s. Rate: 129.6 symbols/min [2025-10-24T00:43:59.903479] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:59.912526] [INFO ] [MAIN ] ABT: Generated 139 derivative records from 54014 primary records. [2025-10-24T00:43:59.912824] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-24T00:43:59.915586] [FATAL] [LOCAL ] ABT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:59.915796] [FATAL] [MAIN ] ABT: Failed to save derivative data. [2025-10-24T00:43:59.917810] [INFO ] [MAIN ] Derivative Progress: 11/2164 symbols completed. ABT took 1.1s. Estimated remaining: 15m 10s. Rate: 142.0 symbols/min [2025-10-24T00:43:59.918010] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:59.929299] [INFO ] [MAIN ] ACCO: Generated 139 derivative records from 36869 primary records. [2025-10-24T00:43:59.929533] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-24T00:43:59.929779] [FATAL] [LOCAL ] ACCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:43:59.929916] [FATAL] [MAIN ] ACCO: Failed to save derivative data. [2025-10-24T00:43:59.932245] [INFO ] [MAIN ] Derivative Progress: 12/2164 symbols completed. ACCO took 1.1s. Estimated remaining: 13m 56s. Rate: 154.4 symbols/min [2025-10-24T00:43:59.932464] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:43:59.943311] [DEBUG] [LOCAL ] ACEL: Loaded 26458 existing records from primary storage. [2025-10-24T00:43:59.943628] [INFO ] [MAIN ] ACEL: Loaded 26458 primary data records. [2025-10-24T00:44:00.292575] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-24T00:44:00.316419] [INFO ] [MAIN ] ACHR: Loaded 54208 primary data records. [2025-10-24T00:44:00.447352] [DEBUG] [LOCAL ] ACI: Loaded 53675 existing records from primary storage. [2025-10-24T00:44:00.477882] [INFO ] [MAIN ] ACI: Loaded 53675 primary data records. [2025-10-24T00:44:00.984467] [DEBUG] [MAIN ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:01.020965] [DEBUG] [MAIN ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:01.072413] [DEBUG] [MAIN ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:01.103005] [INFO ] [MAIN ] ACEL: Generated 139 derivative records from 26458 primary records. [2025-10-24T00:44:01.106036] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-24T00:44:01.107473] [FATAL] [LOCAL ] ACEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:01.107815] [FATAL] [MAIN ] ACEL: Failed to save derivative data. [2025-10-24T00:44:01.110256] [INFO ] [MAIN ] Derivative Progress: 13/2164 symbols completed. ACEL took 1.2s. Estimated remaining: 16m 6s. Rate: 133.6 symbols/min [2025-10-24T00:44:01.117541] [INFO ] [MAIN ] ACHR: Generated 139 derivative records from 54208 primary records. [2025-10-24T00:44:01.118863] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-24T00:44:01.119204] [FATAL] [LOCAL ] ACHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:01.121726] [FATAL] [MAIN ] ACHR: Failed to save derivative data. [2025-10-24T00:44:01.124771] [INFO ] [MAIN ] Derivative Progress: 14/2164 symbols completed. ACHR took 1.2s. Estimated remaining: 14m 59s. Rate: 143.5 symbols/min [2025-10-24T00:44:01.129957] [INFO ] [MAIN ] ACI: Generated 139 derivative records from 53675 primary records. [2025-10-24T00:44:01.130143] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-24T00:44:01.130347] [FATAL] [LOCAL ] ACI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:01.130427] [FATAL] [MAIN ] ACI: Failed to save derivative data. [2025-10-24T00:44:01.132515] [INFO ] [MAIN ] Derivative Progress: 15/2164 symbols completed. ACI took 1.2s. Estimated remaining: 13m 60s. Rate: 153.5 symbols/min [2025-10-24T00:44:01.132981] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:01.133113] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:01.133383] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:01.172749] [DEBUG] [LOCAL ] ACP: Loaded 31336 existing records from primary storage. [2025-10-24T00:44:01.172953] [INFO ] [MAIN ] ACP: Loaded 31336 primary data records. [2025-10-24T00:44:01.303961] [DEBUG] [LOCAL ] ACM: Loaded 43000 existing records from primary storage. [2025-10-24T00:44:01.319198] [INFO ] [MAIN ] ACM: Loaded 43000 primary data records. [2025-10-24T00:44:01.347329] [DEBUG] [LOCAL ] ACN: Loaded 53828 existing records from primary storage. [2025-10-24T00:44:01.397536] [INFO ] [MAIN ] ACN: Loaded 53828 primary data records. [2025-10-24T00:44:02.227514] [DEBUG] [MAIN ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:02.272795] [DEBUG] [MAIN ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:02.304673] [DEBUG] [MAIN ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:02.337768] [INFO ] [MAIN ] ACP: Generated 139 derivative records from 31336 primary records. [2025-10-24T00:44:02.340311] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-24T00:44:02.341994] [FATAL] [LOCAL ] ACP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:02.344662] [FATAL] [MAIN ] ACP: Failed to save derivative data. [2025-10-24T00:44:02.348951] [INFO ] [MAIN ] Derivative Progress: 16/2164 symbols completed. ACP took 1.2s. Estimated remaining: 15m 50s. Rate: 135.6 symbols/min [2025-10-24T00:44:02.350500] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:02.366375] [DEBUG] [LOCAL ] ACR: Loaded 5325 existing records from primary storage. [2025-10-24T00:44:02.367222] [INFO ] [MAIN ] ACR: Loaded 5325 primary data records. [2025-10-24T00:44:02.407982] [INFO ] [MAIN ] ACN: Generated 139 derivative records from 53828 primary records. [2025-10-24T00:44:02.450720] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-24T00:44:02.482411] [FATAL] [LOCAL ] ACN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:02.486207] [FATAL] [MAIN ] ACN: Failed to save derivative data. [2025-10-24T00:44:02.515820] [INFO ] [MAIN ] Derivative Progress: 17/2164 symbols completed. ACN took 1.4s. Estimated remaining: 15m 15s. Rate: 140.8 symbols/min [2025-10-24T00:44:02.542879] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:02.578972] [INFO ] [MAIN ] ACM: Generated 139 derivative records from 43000 primary records. [2025-10-24T00:44:02.692630] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-24T00:44:02.693535] [FATAL] [LOCAL ] ACM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:02.694039] [FATAL] [MAIN ] ACM: Failed to save derivative data. [2025-10-24T00:44:02.697815] [INFO ] [MAIN ] Derivative Progress: 18/2164 symbols completed. ACM took 1.6s. Estimated remaining: 14m 46s. Rate: 145.4 symbols/min [2025-10-24T00:44:02.698292] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:02.723634] [DEBUG] [LOCAL ] ACV: Loaded 7456 existing records from primary storage. [2025-10-24T00:44:02.724050] [INFO ] [MAIN ] ACV: Loaded 7456 primary data records. [2025-10-24T00:44:02.857007] [DEBUG] [LOCAL ] ACRE: Loaded 33455 existing records from primary storage. [2025-10-24T00:44:02.873090] [INFO ] [MAIN ] ACRE: Loaded 33455 primary data records. [2025-10-24T00:44:03.166172] [DEBUG] [MAIN ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:03.434198] [DEBUG] [MAIN ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:03.437054] [INFO ] [MAIN ] ACR: Generated 139 derivative records from 5325 primary records. [2025-10-24T00:44:03.450324] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-24T00:44:03.454074] [FATAL] [LOCAL ] ACR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:03.454203] [FATAL] [MAIN ] ACR: Failed to save derivative data. [2025-10-24T00:44:03.458126] [INFO ] [MAIN ] Derivative Progress: 19/2164 symbols completed. ACR took 1.1s. Estimated remaining: 15m 24s. Rate: 139.2 symbols/min [2025-10-24T00:44:03.458588] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:03.491101] [DEBUG] [MAIN ] ACRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:03.534296] [INFO ] [MAIN ] ACV: Generated 139 derivative records from 7456 primary records. [2025-10-24T00:44:03.538518] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-24T00:44:03.540462] [FATAL] [LOCAL ] ACV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:03.544308] [FATAL] [MAIN ] ACV: Failed to save derivative data. [2025-10-24T00:44:03.548710] [INFO ] [MAIN ] Derivative Progress: 20/2164 symbols completed. ACV took 0.9s. Estimated remaining: 14m 47s. Rate: 145.0 symbols/min [2025-10-24T00:44:03.554061] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:03.574684] [DEBUG] [LOCAL ] ACVA: Loaded 49608 existing records from primary storage. [2025-10-24T00:44:03.577180] [INFO ] [MAIN ] ACRE: Generated 139 derivative records from 33455 primary records. [2025-10-24T00:44:03.577356] [INFO ] [MAIN ] ACVA: Loaded 49608 primary data records. [2025-10-24T00:44:03.577469] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-24T00:44:03.577912] [FATAL] [LOCAL ] ACRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:03.610401] [FATAL] [MAIN ] ACRE: Failed to save derivative data. [2025-10-24T00:44:03.648998] [INFO ] [MAIN ] Derivative Progress: 21/2164 symbols completed. ACRE took 1.1s. Estimated remaining: 14m 15s. Rate: 150.4 symbols/min [2025-10-24T00:44:03.670269] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:04.040714] [DEBUG] [LOCAL ] ADC: Loaded 46761 existing records from primary storage. [2025-10-24T00:44:04.051696] [INFO ] [MAIN ] ADC: Loaded 46761 primary data records. [2025-10-24T00:44:04.160745] [DEBUG] [LOCAL ] ADCT: Loaded 35735 existing records from primary storage. [2025-10-24T00:44:04.179796] [INFO ] [MAIN ] ADCT: Loaded 35735 primary data records. [2025-10-24T00:44:04.883315] [DEBUG] [MAIN ] ACVA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:04.927134] [DEBUG] [MAIN ] ADC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:04.964963] [INFO ] [MAIN ] ACVA: Generated 139 derivative records from 49608 primary records. [2025-10-24T00:44:04.979205] [DEBUG] [MAIN ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:04.982241] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-24T00:44:04.982606] [FATAL] [LOCAL ] ACVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:04.994388] [FATAL] [MAIN ] ACVA: Failed to save derivative data. [2025-10-24T00:44:04.997723] [INFO ] [MAIN ] Derivative Progress: 22/2164 symbols completed. ACVA took 1.5s. Estimated remaining: 15m 47s. Rate: 135.7 symbols/min [2025-10-24T00:44:04.998531] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:05.020423] [INFO ] [MAIN ] ADC: Generated 139 derivative records from 46761 primary records. [2025-10-24T00:44:05.024217] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-24T00:44:05.024780] [FATAL] [LOCAL ] ADC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:05.026017] [FATAL] [MAIN ] ADC: Failed to save derivative data. [2025-10-24T00:44:05.027994] [INFO ] [MAIN ] Derivative Progress: 23/2164 symbols completed. ADC took 1.5s. Estimated remaining: 15m 8s. Rate: 141.4 symbols/min [2025-10-24T00:44:05.028223] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:05.049874] [INFO ] [MAIN ] ADCT: Generated 139 derivative records from 35735 primary records. [2025-10-24T00:44:05.050107] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-24T00:44:05.050344] [FATAL] [LOCAL ] ADCT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:05.050421] [FATAL] [MAIN ] ADCT: Failed to save derivative data. [2025-10-24T00:44:05.052622] [INFO ] [MAIN ] Derivative Progress: 24/2164 symbols completed. ADCT took 1.4s. Estimated remaining: 14m 32s. Rate: 147.2 symbols/min [2025-10-24T00:44:05.052964] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:05.074468] [DEBUG] [LOCAL ] ADM: Loaded 53780 existing records from primary storage. [2025-10-24T00:44:05.085636] [INFO ] [MAIN ] ADM: Loaded 53780 primary data records. [2025-10-24T00:44:05.214031] [DEBUG] [LOCAL ] ADNT: Loaded 46574 existing records from primary storage. [2025-10-24T00:44:05.230889] [INFO ] [MAIN ] ADNT: Loaded 46574 primary data records. [2025-10-24T00:44:05.497215] [DEBUG] [LOCAL ] ADT: Loaded 53825 existing records from primary storage. [2025-10-24T00:44:05.515137] [INFO ] [MAIN ] ADT: Loaded 53825 primary data records. [2025-10-24T00:44:06.055314] [DEBUG] [MAIN ] ADM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:06.092278] [DEBUG] [MAIN ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:06.129891] [DEBUG] [MAIN ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:06.170975] [INFO ] [MAIN ] ADM: Generated 139 derivative records from 53780 primary records. [2025-10-24T00:44:06.172477] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-24T00:44:06.175723] [FATAL] [LOCAL ] ADM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:06.180449] [FATAL] [MAIN ] ADM: Failed to save derivative data. [2025-10-24T00:44:06.182749] [INFO ] [MAIN ] Derivative Progress: 25/2164 symbols completed. ADM took 1.2s. Estimated remaining: 15m 34s. Rate: 137.5 symbols/min [2025-10-24T00:44:06.183102] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:06.202722] [INFO ] [MAIN ] ADT: Generated 139 derivative records from 53825 primary records. [2025-10-24T00:44:06.202931] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-24T00:44:06.200415] [INFO ] [MAIN ] ADNT: Generated 139 derivative records from 46574 primary records. [2025-10-24T00:44:06.210819] [FATAL] [LOCAL ] ADT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:06.211063] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-24T00:44:06.211574] [FATAL] [LOCAL ] ADNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:06.211756] [FATAL] [MAIN ] ADNT: Failed to save derivative data. [2025-10-24T00:44:06.213560] [INFO ] [MAIN ] Derivative Progress: 26/2164 symbols completed. ADNT took 1.2s. Estimated remaining: 14m 60s. Rate: 142.6 symbols/min [2025-10-24T00:44:06.211144] [FATAL] [MAIN ] ADT: Failed to save derivative data. [2025-10-24T00:44:06.213835] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:06.217294] [INFO ] [MAIN ] Derivative Progress: 27/2164 symbols completed. ADT took 1.2s. Estimated remaining: 14m 26s. Rate: 148.0 symbols/min [2025-10-24T00:44:06.218092] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:06.229132] [DEBUG] [LOCAL ] ADX: Loaded 27825 existing records from primary storage. [2025-10-24T00:44:06.231306] [INFO ] [MAIN ] ADX: Loaded 27825 primary data records. [2025-10-24T00:44:06.310693] [DEBUG] [LOCAL ] AEFC: Loaded 7685 existing records from primary storage. [2025-10-24T00:44:06.321165] [INFO ] [MAIN ] AEFC: Loaded 7685 primary data records. [2025-10-24T00:44:06.887598] [DEBUG] [LOCAL ] AEE: Loaded 50377 existing records from primary storage. [2025-10-24T00:44:06.888347] [INFO ] [MAIN ] AEE: Loaded 50377 primary data records. [2025-10-24T00:44:07.227807] [DEBUG] [MAIN ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:07.257532] [DEBUG] [MAIN ] AEFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:07.318620] [DEBUG] [MAIN ] AEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:07.347448] [INFO ] [MAIN ] ADX: Generated 139 derivative records from 27825 primary records. [2025-10-24T00:44:07.347873] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-24T00:44:07.348260] [FATAL] [LOCAL ] ADX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:07.350983] [FATAL] [MAIN ] ADX: Failed to save derivative data. [2025-10-24T00:44:07.353130] [INFO ] [MAIN ] Derivative Progress: 28/2164 symbols completed. ADX took 1.2s. Estimated remaining: 15m 22s. Rate: 139.0 symbols/min [2025-10-24T00:44:07.358062] [INFO ] [MAIN ] AEFC: Generated 139 derivative records from 7685 primary records. [2025-10-24T00:44:07.360677] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-24T00:44:07.362253] [FATAL] [LOCAL ] AEFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:07.362468] [FATAL] [MAIN ] AEFC: Failed to save derivative data. [2025-10-24T00:44:07.364770] [INFO ] [MAIN ] Derivative Progress: 29/2164 symbols completed. AEFC took 1.1s. Estimated remaining: 14m 50s. Rate: 143.9 symbols/min [2025-10-24T00:44:07.372593] [INFO ] [MAIN ] AEE: Generated 139 derivative records from 50377 primary records. [2025-10-24T00:44:07.372734] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-24T00:44:07.372939] [FATAL] [LOCAL ] AEE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:07.373018] [FATAL] [MAIN ] AEE: Failed to save derivative data. [2025-10-24T00:44:07.375316] [INFO ] [MAIN ] Derivative Progress: 30/2164 symbols completed. AEE took 1.2s. Estimated remaining: 14m 21s. Rate: 148.7 symbols/min [2025-10-24T00:44:07.375718] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:07.375853] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:07.375994] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:07.446410] [DEBUG] [LOCAL ] AEG: Loaded 49897 existing records from primary storage. [2025-10-24T00:44:07.446709] [INFO ] [MAIN ] AEG: Loaded 49897 primary data records. [2025-10-24T00:44:07.579130] [DEBUG] [LOCAL ] AEM: Loaded 53865 existing records from primary storage. [2025-10-24T00:44:07.579379] [INFO ] [MAIN ] AEM: Loaded 53865 primary data records. [2025-10-24T00:44:07.596978] [DEBUG] [LOCAL ] AEO: Loaded 53953 existing records from primary storage. [2025-10-24T00:44:07.618772] [INFO ] [MAIN ] AEO: Loaded 53953 primary data records. [2025-10-24T00:44:08.412037] [DEBUG] [MAIN ] AEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:08.446769] [DEBUG] [MAIN ] AEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:08.463670] [DEBUG] [MAIN ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:08.550437] [INFO ] [MAIN ] AEG: Generated 139 derivative records from 49897 primary records. [2025-10-24T00:44:08.553308] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-24T00:44:08.553940] [FATAL] [LOCAL ] AEG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:08.554418] [FATAL] [MAIN ] AEG: Failed to save derivative data. [2025-10-24T00:44:08.558009] [INFO ] [MAIN ] Derivative Progress: 31/2164 symbols completed. AEG took 1.2s. Estimated remaining: 15m 14s. Rate: 140.0 symbols/min [2025-10-24T00:44:08.560373] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:08.560261] [INFO ] [MAIN ] AEM: Generated 139 derivative records from 53865 primary records. [2025-10-24T00:44:08.560831] [INFO ] [MAIN ] AEO: Generated 139 derivative records from 53953 primary records. [2025-10-24T00:44:08.561760] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-24T00:44:08.562438] [FATAL] [LOCAL ] AEM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:08.561683] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-24T00:44:08.562931] [FATAL] [MAIN ] AEM: Failed to save derivative data. [2025-10-24T00:44:08.562837] [FATAL] [LOCAL ] AEO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:08.563213] [FATAL] [MAIN ] AEO: Failed to save derivative data. [2025-10-24T00:44:08.566023] [INFO ] [MAIN ] Derivative Progress: 32/2164 symbols completed. AEO took 1.2s. Estimated remaining: 14m 46s. Rate: 144.4 symbols/min [2025-10-24T00:44:08.569397] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:08.569792] [INFO ] [MAIN ] Derivative Progress: 33/2164 symbols completed. AEM took 1.2s. Estimated remaining: 14m 19s. Rate: 148.9 symbols/min [2025-10-24T00:44:08.570200] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:08.645243] [DEBUG] [LOCAL ] AER: Loaded 48226 existing records from primary storage. [2025-10-24T00:44:08.659842] [INFO ] [MAIN ] AER: Loaded 48226 primary data records. [2025-10-24T00:44:08.660535] [DEBUG] [LOCAL ] AES: Loaded 54053 existing records from primary storage. [2025-10-24T00:44:08.660862] [INFO ] [MAIN ] AES: Loaded 54053 primary data records. [2025-10-24T00:44:08.884445] [DEBUG] [LOCAL ] AESI: Loaded 50191 existing records from primary storage. [2025-10-24T00:44:08.912790] [INFO ] [MAIN ] AESI: Loaded 50191 primary data records. [2025-10-24T00:44:09.664006] [DEBUG] [MAIN ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:09.701264] [DEBUG] [MAIN ] AER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:09.728571] [DEBUG] [MAIN ] AESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:09.799036] [INFO ] [MAIN ] AES: Generated 139 derivative records from 54053 primary records. [2025-10-24T00:44:09.799543] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-24T00:44:09.801488] [FATAL] [LOCAL ] AES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:09.801669] [FATAL] [MAIN ] AES: Failed to save derivative data. [2025-10-24T00:44:09.803376] [INFO ] [MAIN ] Derivative Progress: 34/2164 symbols completed. AES took 1.2s. Estimated remaining: 15m 10s. Rate: 140.4 symbols/min [2025-10-24T00:44:09.805290] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:09.808686] [INFO ] [MAIN ] AER: Generated 139 derivative records from 48226 primary records. [2025-10-24T00:44:09.811567] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-24T00:44:09.811986] [FATAL] [LOCAL ] AER: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:09.812839] [FATAL] [MAIN ] AER: Failed to save derivative data. [2025-10-24T00:44:09.818320] [INFO ] [MAIN ] Derivative Progress: 35/2164 symbols completed. AER took 1.3s. Estimated remaining: 14m 45s. Rate: 144.3 symbols/min [2025-10-24T00:44:09.818982] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:09.825582] [INFO ] [MAIN ] AESI: Generated 139 derivative records from 50191 primary records. [2025-10-24T00:44:09.825794] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-24T00:44:09.826031] [FATAL] [LOCAL ] AESI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:09.826365] [FATAL] [MAIN ] AESI: Failed to save derivative data. [2025-10-24T00:44:09.831817] [DEBUG] [LOCAL ] AFB: Loaded 11099 existing records from primary storage. [2025-10-24T00:44:09.834456] [INFO ] [MAIN ] Derivative Progress: 36/2164 symbols completed. AESI took 1.3s. Estimated remaining: 14m 21s. Rate: 148.3 symbols/min [2025-10-24T00:44:09.834713] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:09.835150] [INFO ] [MAIN ] AFB: Loaded 11099 primary data records. [2025-10-24T00:44:09.929061] [DEBUG] [LOCAL ] AFGB: Loaded 2217 existing records from primary storage. [2025-10-24T00:44:09.950940] [INFO ] [MAIN ] AFGB: Loaded 2217 primary data records. [2025-10-24T00:44:10.127610] [DEBUG] [LOCAL ] AFG: Loaded 32088 existing records from primary storage. [2025-10-24T00:44:10.277994] [INFO ] [MAIN ] AFG: Loaded 32088 primary data records. [2025-10-24T00:44:10.912227] [DEBUG] [MAIN ] AFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:10.943727] [DEBUG] [MAIN ] AFGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:10.998883] [DEBUG] [MAIN ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:11.018977] [INFO ] [MAIN ] AFB: Generated 139 derivative records from 11099 primary records. [2025-10-24T00:44:11.023771] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-24T00:44:11.027397] [FATAL] [LOCAL ] AFB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:11.028085] [FATAL] [MAIN ] AFB: Failed to save derivative data. [2025-10-24T00:44:11.030057] [INFO ] [MAIN ] Derivative Progress: 37/2164 symbols completed. AFB took 1.2s. Estimated remaining: 15m 6s. Rate: 140.9 symbols/min [2025-10-24T00:44:11.035782] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:11.047598] [INFO ] [MAIN ] AFGB: Generated 139 derivative records from 2217 primary records. [2025-10-24T00:44:11.051052] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-24T00:44:11.053296] [DEBUG] [LOCAL ] AFGC: Loaded 2557 existing records from primary storage. [2025-10-24T00:44:11.055083] [FATAL] [LOCAL ] AFGB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:11.055621] [FATAL] [MAIN ] AFGB: Failed to save derivative data. [2025-10-24T00:44:11.055516] [INFO ] [MAIN ] AFGC: Loaded 2557 primary data records. [2025-10-24T00:44:11.063144] [INFO ] [MAIN ] Derivative Progress: 38/2164 symbols completed. AFGB took 1.2s. Estimated remaining: 14m 44s. Rate: 144.4 symbols/min [2025-10-24T00:44:11.084670] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:11.196447] [DEBUG] [LOCAL ] AFGD: Loaded 1757 existing records from primary storage. [2025-10-24T00:44:11.197105] [INFO ] [MAIN ] AFG: Generated 139 derivative records from 32088 primary records. [2025-10-24T00:44:11.213176] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-24T00:44:11.213247] [INFO ] [MAIN ] AFGD: Loaded 1757 primary data records. [2025-10-24T00:44:11.259946] [FATAL] [LOCAL ] AFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:11.327359] [FATAL] [MAIN ] AFG: Failed to save derivative data. [2025-10-24T00:44:11.493860] [INFO ] [MAIN ] Derivative Progress: 39/2164 symbols completed. AFG took 1.7s. Estimated remaining: 14m 44s. Rate: 144.2 symbols/min [2025-10-24T00:44:11.507274] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:11.590299] [DEBUG] [LOCAL ] AFGE: Loaded 2248 existing records from primary storage. [2025-10-24T00:44:11.704319] [INFO ] [MAIN ] AFGE: Loaded 2248 primary data records. [2025-10-24T00:44:12.035861] [DEBUG] [MAIN ] AFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:12.073051] [DEBUG] [MAIN ] AFGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:12.129082] [DEBUG] [MAIN ] AFGE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:12.143249] [INFO ] [MAIN ] AFGC: Generated 139 derivative records from 2557 primary records. [2025-10-24T00:44:12.144710] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-24T00:44:12.148189] [FATAL] [LOCAL ] AFGC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:12.148896] [FATAL] [MAIN ] AFGC: Failed to save derivative data. [2025-10-24T00:44:12.152526] [INFO ] [MAIN ] Derivative Progress: 40/2164 symbols completed. AFGC took 1.1s. Estimated remaining: 14m 56s. Rate: 142.2 symbols/min [2025-10-24T00:44:12.155629] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:12.162685] [INFO ] [MAIN ] AFGD: Generated 139 derivative records from 1757 primary records. [2025-10-24T00:44:12.163225] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-24T00:44:12.163485] [FATAL] [LOCAL ] AFGD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:12.163734] [FATAL] [MAIN ] AFGD: Failed to save derivative data. [2025-10-24T00:44:12.166446] [INFO ] [MAIN ] Derivative Progress: 41/2164 symbols completed. AFGD took 1.1s. Estimated remaining: 14m 35s. Rate: 145.6 symbols/min [2025-10-24T00:44:12.167120] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:12.182055] [INFO ] [MAIN ] AFGE: Generated 139 derivative records from 2248 primary records. [2025-10-24T00:44:12.182220] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-24T00:44:12.182400] [FATAL] [LOCAL ] AFGE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:12.182476] [FATAL] [MAIN ] AFGE: Failed to save derivative data. [2025-10-24T00:44:12.184461] [INFO ] [MAIN ] Derivative Progress: 42/2164 symbols completed. AFGE took 0.7s. Estimated remaining: 14m 15s. Rate: 149.0 symbols/min [2025-10-24T00:44:12.184667] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:12.253826] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-10-24T00:44:12.263054] [DEBUG] [LOCAL ] AFL: Loaded 53562 existing records from primary storage. [2025-10-24T00:44:12.263279] [INFO ] [MAIN ] AG: Loaded 54033 primary data records. [2025-10-24T00:44:12.263483] [INFO ] [MAIN ] AFL: Loaded 53562 primary data records. [2025-10-24T00:44:12.483969] [DEBUG] [LOCAL ] AGCO: Loaded 42392 existing records from primary storage. [2025-10-24T00:44:12.503735] [INFO ] [MAIN ] AGCO: Loaded 42392 primary data records. [2025-10-24T00:44:13.292829] [DEBUG] [MAIN ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:13.334883] [DEBUG] [MAIN ] AFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:13.389864] [DEBUG] [MAIN ] AGCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:13.418862] [INFO ] [MAIN ] AG: Generated 139 derivative records from 54033 primary records. [2025-10-24T00:44:13.421909] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-24T00:44:13.425853] [FATAL] [LOCAL ] AG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:13.426237] [FATAL] [MAIN ] AG: Failed to save derivative data. [2025-10-24T00:44:13.428743] [INFO ] [MAIN ] AFL: Generated 139 derivative records from 53562 primary records. [2025-10-24T00:44:13.430696] [INFO ] [MAIN ] Derivative Progress: 43/2164 symbols completed. AG took 1.3s. Estimated remaining: 14m 56s. Rate: 142.1 symbols/min [2025-10-24T00:44:13.431035] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-24T00:44:13.431558] [FATAL] [LOCAL ] AFL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:13.434664] [FATAL] [MAIN ] AFL: Failed to save derivative data. [2025-10-24T00:44:13.437167] [INFO ] [MAIN ] Derivative Progress: 44/2164 symbols completed. AFL took 1.3s. Estimated remaining: 14m 35s. Rate: 145.3 symbols/min [2025-10-24T00:44:13.445376] [INFO ] [MAIN ] AGCO: Generated 139 derivative records from 42392 primary records. [2025-10-24T00:44:13.445466] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-24T00:44:13.445696] [FATAL] [LOCAL ] AGCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:13.445776] [FATAL] [MAIN ] AGCO: Failed to save derivative data. [2025-10-24T00:44:13.447803] [INFO ] [MAIN ] Derivative Progress: 45/2164 symbols completed. AGCO took 1.3s. Estimated remaining: 14m 16s. Rate: 148.5 symbols/min [2025-10-24T00:44:13.448155] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:13.448546] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:13.448476] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:13.472879] [DEBUG] [LOCAL ] AGD: Loaded 19375 existing records from primary storage. [2025-10-24T00:44:13.473066] [INFO ] [MAIN ] AGD: Loaded 19375 primary data records. [2025-10-24T00:44:13.782819] [DEBUG] [LOCAL ] AGL: Loaded 52979 existing records from primary storage. [2025-10-24T00:44:13.834708] [INFO ] [MAIN ] AGL: Loaded 52979 primary data records. [2025-10-24T00:44:13.835797] [DEBUG] [LOCAL ] AGI: Loaded 53813 existing records from primary storage. [2025-10-24T00:44:13.836038] [INFO ] [MAIN ] AGI: Loaded 53813 primary data records. [2025-10-24T00:44:14.458327] [DEBUG] [MAIN ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:14.500891] [DEBUG] [MAIN ] AGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:14.543788] [DEBUG] [MAIN ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:14.567493] [INFO ] [MAIN ] AGD: Generated 139 derivative records from 19375 primary records. [2025-10-24T00:44:14.569723] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-24T00:44:14.572095] [FATAL] [LOCAL ] AGD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:14.572837] [FATAL] [MAIN ] AGD: Failed to save derivative data. [2025-10-24T00:44:14.579508] [INFO ] [MAIN ] Derivative Progress: 46/2164 symbols completed. AGD took 1.1s. Estimated remaining: 14m 49s. Rate: 142.9 symbols/min [2025-10-24T00:44:14.581673] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:14.597455] [INFO ] [MAIN ] AGI: Generated 139 derivative records from 53813 primary records. [2025-10-24T00:44:14.601256] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-24T00:44:14.603080] [FATAL] [LOCAL ] AGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:14.606594] [FATAL] [MAIN ] AGI: Failed to save derivative data. [2025-10-24T00:44:14.613190] [INFO ] [MAIN ] Derivative Progress: 47/2164 symbols completed. AGI took 1.2s. Estimated remaining: 14m 31s. Rate: 145.8 symbols/min [2025-10-24T00:44:14.614775] [DEBUG] [LOCAL ] AGM: Loaded 10659 existing records from primary storage. [2025-10-24T00:44:14.615321] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:14.615784] [INFO ] [MAIN ] AGM: Loaded 10659 primary data records. [2025-10-24T00:44:14.727157] [INFO ] [MAIN ] AGL: Generated 139 derivative records from 52979 primary records. [2025-10-24T00:44:14.734979] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-24T00:44:14.741336] [FATAL] [LOCAL ] AGL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:14.762211] [FATAL] [MAIN ] AGL: Failed to save derivative data. [2025-10-24T00:44:14.821139] [INFO ] [MAIN ] Derivative Progress: 48/2164 symbols completed. AGL took 1.4s. Estimated remaining: 14m 22s. Rate: 147.3 symbols/min [2025-10-24T00:44:14.953837] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:14.953715] [DEBUG] [LOCAL ] AGO: Loaded 27888 existing records from primary storage. [2025-10-24T00:44:14.968202] [INFO ] [MAIN ] AGO: Loaded 27888 primary data records. [2025-10-24T00:44:15.295820] [DEBUG] [LOCAL ] AGRO: Loaded 32732 existing records from primary storage. [2025-10-24T00:44:15.296272] [INFO ] [MAIN ] AGRO: Loaded 32732 primary data records. [2025-10-24T00:44:15.421846] [DEBUG] [MAIN ] AGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:15.661567] [DEBUG] [MAIN ] AGO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:15.688079] [INFO ] [MAIN ] AGM: Generated 139 derivative records from 10659 primary records. [2025-10-24T00:44:15.689864] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-24T00:44:15.692408] [FATAL] [LOCAL ] AGM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:15.692734] [FATAL] [MAIN ] AGM: Failed to save derivative data. [2025-10-24T00:44:15.694829] [INFO ] [MAIN ] Derivative Progress: 49/2164 symbols completed. AGM took 1.1s. Estimated remaining: 14m 42s. Rate: 143.9 symbols/min [2025-10-24T00:44:15.695002] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:15.721725] [DEBUG] [MAIN ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:15.737336] [INFO ] [MAIN ] AGO: Generated 139 derivative records from 27888 primary records. [2025-10-24T00:44:15.741213] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-24T00:44:15.752557] [FATAL] [LOCAL ] AGO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:15.756548] [FATAL] [MAIN ] AGO: Failed to save derivative data. [2025-10-24T00:44:15.760326] [INFO ] [MAIN ] Derivative Progress: 50/2164 symbols completed. AGO took 1.1s. Estimated remaining: 14m 26s. Rate: 146.4 symbols/min [2025-10-24T00:44:15.763802] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:15.790791] [INFO ] [MAIN ] AGRO: Generated 139 derivative records from 32732 primary records. [2025-10-24T00:44:15.790146] [DEBUG] [LOCAL ] AGX: Loaded 32812 existing records from primary storage. [2025-10-24T00:44:15.791412] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-24T00:44:15.791352] [INFO ] [MAIN ] AGX: Loaded 32812 primary data records. [2025-10-24T00:44:15.791674] [FATAL] [LOCAL ] AGRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:15.791872] [FATAL] [MAIN ] AGRO: Failed to save derivative data. [2025-10-24T00:44:15.805813] [INFO ] [MAIN ] Derivative Progress: 51/2164 symbols completed. AGRO took 0.9s. Estimated remaining: 14m 11s. Rate: 149.0 symbols/min [2025-10-24T00:44:15.806016] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:16.062758] [DEBUG] [LOCAL ] AHH: Loaded 40406 existing records from primary storage. [2025-10-24T00:44:16.119094] [INFO ] [MAIN ] AHH: Loaded 40406 primary data records. [2025-10-24T00:44:16.263131] [DEBUG] [LOCAL ] AHR: Loaded 49276 existing records from primary storage. [2025-10-24T00:44:16.292283] [INFO ] [MAIN ] AHR: Loaded 49276 primary data records. [2025-10-24T00:44:16.805935] [DEBUG] [MAIN ] AGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:16.847104] [DEBUG] [MAIN ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:16.895595] [DEBUG] [MAIN ] AHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:16.895793] [INFO ] [MAIN ] AGX: Generated 139 derivative records from 32812 primary records. [2025-10-24T00:44:16.897282] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-24T00:44:16.909168] [FATAL] [LOCAL ] AGX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:16.909344] [FATAL] [MAIN ] AGX: Failed to save derivative data. [2025-10-24T00:44:16.913618] [INFO ] [MAIN ] Derivative Progress: 52/2164 symbols completed. AGX took 1.2s. Estimated remaining: 14m 39s. Rate: 144.2 symbols/min [2025-10-24T00:44:16.917328] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:16.935339] [DEBUG] [LOCAL ] AHT: Loaded 6449 existing records from primary storage. [2025-10-24T00:44:16.937884] [INFO ] [MAIN ] AHH: Generated 139 derivative records from 40406 primary records. [2025-10-24T00:44:16.937505] [INFO ] [MAIN ] AHT: Loaded 6449 primary data records. [2025-10-24T00:44:16.952690] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-24T00:44:16.996876] [FATAL] [LOCAL ] AHH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:17.017811] [FATAL] [MAIN ] AHH: Failed to save derivative data. [2025-10-24T00:44:17.036980] [INFO ] [MAIN ] Derivative Progress: 53/2164 symbols completed. AHH took 1.3s. Estimated remaining: 14m 27s. Rate: 146.1 symbols/min [2025-10-24T00:44:17.051732] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:17.233019] [INFO ] [MAIN ] AHR: Generated 139 derivative records from 49276 primary records. [2025-10-24T00:44:17.246800] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-24T00:44:17.247132] [FATAL] [LOCAL ] AHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:17.247230] [FATAL] [MAIN ] AHR: Failed to save derivative data. [2025-10-24T00:44:17.249182] [INFO ] [MAIN ] Derivative Progress: 54/2164 symbols completed. AHR took 1.4s. Estimated remaining: 14m 19s. Rate: 147.4 symbols/min [2025-10-24T00:44:17.249613] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:17.289380] [DEBUG] [MAIN ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:17.338103] [DEBUG] [LOCAL ] AI: Loaded 54154 existing records from primary storage. [2025-10-24T00:44:17.342764] [INFO ] [MAIN ] AI: Loaded 54154 primary data records. [2025-10-24T00:44:17.464666] [DEBUG] [LOCAL ] AIG: Loaded 53845 existing records from primary storage. [2025-10-24T00:44:17.469078] [INFO ] [MAIN ] AIG: Loaded 53845 primary data records. [2025-10-24T00:44:17.834857] [INFO ] [MAIN ] AHT: Generated 139 derivative records from 6449 primary records. [2025-10-24T00:44:17.872667] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-24T00:44:17.980607] [FATAL] [LOCAL ] AHT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:17.989293] [FATAL] [MAIN ] AHT: Failed to save derivative data. [2025-10-24T00:44:17.991717] [INFO ] [MAIN ] Derivative Progress: 55/2164 symbols completed. AHT took 1.1s. Estimated remaining: 14m 31s. Rate: 145.2 symbols/min [2025-10-24T00:44:17.992014] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:18.023322] [DEBUG] [MAIN ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:18.048499] [DEBUG] [LOCAL ] AIN: Loaded 24456 existing records from primary storage. [2025-10-24T00:44:18.050751] [INFO ] [MAIN ] AIN: Loaded 24456 primary data records. [2025-10-24T00:44:18.111090] [DEBUG] [MAIN ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:18.411376] [INFO ] [MAIN ] AI: Generated 139 derivative records from 54154 primary records. [2025-10-24T00:44:18.413992] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-24T00:44:18.414863] [FATAL] [LOCAL ] AI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:18.415128] [FATAL] [MAIN ] AI: Failed to save derivative data. [2025-10-24T00:44:18.417092] [INFO ] [MAIN ] Derivative Progress: 56/2164 symbols completed. AI took 1.4s. Estimated remaining: 14m 31s. Rate: 145.2 symbols/min [2025-10-24T00:44:18.418439] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:18.426263] [INFO ] [MAIN ] AIG: Generated 139 derivative records from 53845 primary records. [2025-10-24T00:44:18.426591] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-24T00:44:18.432171] [FATAL] [LOCAL ] AIG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:18.436327] [FATAL] [MAIN ] AIG: Failed to save derivative data. [2025-10-24T00:44:18.439091] [INFO ] [MAIN ] Derivative Progress: 57/2164 symbols completed. AIG took 1.2s. Estimated remaining: 14m 16s. Rate: 147.6 symbols/min [2025-10-24T00:44:18.446879] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:18.451961] [DEBUG] [MAIN ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:18.470885] [DEBUG] [LOCAL ] AIO: Loaded 13054 existing records from primary storage. [2025-10-24T00:44:18.472710] [INFO ] [MAIN ] AIO: Loaded 13054 primary data records. [2025-10-24T00:44:18.601146] [DEBUG] [LOCAL ] AIR: Loaded 28815 existing records from primary storage. [2025-10-24T00:44:18.628773] [INFO ] [MAIN ] AIR: Loaded 28815 primary data records. [2025-10-24T00:44:18.992556] [INFO ] [MAIN ] AIN: Generated 139 derivative records from 24456 primary records. [2025-10-24T00:44:19.156782] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-24T00:44:19.157414] [FATAL] [LOCAL ] AIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:19.157752] [FATAL] [MAIN ] AIN: Failed to save derivative data. [2025-10-24T00:44:19.159793] [INFO ] [MAIN ] Derivative Progress: 58/2164 symbols completed. AIN took 1.2s. Estimated remaining: 14m 27s. Rate: 145.7 symbols/min [2025-10-24T00:44:19.181613] [DEBUG] [MAIN ] AIO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:19.228837] [DEBUG] [MAIN ] AIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:19.243233] [INFO ] [MAIN ] AIO: Generated 139 derivative records from 13054 primary records. [2025-10-24T00:44:19.245434] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-24T00:44:19.245902] [FATAL] [LOCAL ] AIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:19.246150] [FATAL] [MAIN ] AIO: Failed to save derivative data. [2025-10-24T00:44:19.248292] [INFO ] [MAIN ] Derivative Progress: 59/2164 symbols completed. AIO took 0.8s. Estimated remaining: 14m 15s. Rate: 147.6 symbols/min [2025-10-24T00:44:19.262735] [INFO ] [MAIN ] AIR: Generated 139 derivative records from 28815 primary records. [2025-10-24T00:44:19.262934] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-24T00:44:19.263154] [FATAL] [LOCAL ] AIR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:19.263246] [FATAL] [MAIN ] AIR: Failed to save derivative data. [2025-10-24T00:44:19.265622] [INFO ] [MAIN ] Derivative Progress: 60/2164 symbols completed. AIR took 0.8s. Estimated remaining: 14m 1s. Rate: 150.0 symbols/min [2025-10-24T00:44:19.266300] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:19.266447] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:19.266568] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:19.303071] [DEBUG] [LOCAL ] AIT: Loaded 26768 existing records from primary storage. [2025-10-24T00:44:19.303233] [INFO ] [MAIN ] AIT: Loaded 26768 primary data records. [2025-10-24T00:44:19.387466] [DEBUG] [LOCAL ] AIZ: Loaded 29404 existing records from primary storage. [2025-10-24T00:44:19.417179] [INFO ] [MAIN ] AIZ: Loaded 29404 primary data records. [2025-10-24T00:44:19.524129] [DEBUG] [LOCAL ] AIV: Loaded 42214 existing records from primary storage. [2025-10-24T00:44:19.556900] [INFO ] [MAIN ] AIV: Loaded 42214 primary data records. [2025-10-24T00:44:20.310451] [DEBUG] [MAIN ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:20.355236] [DEBUG] [MAIN ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:20.395907] [DEBUG] [MAIN ] AIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:20.448502] [INFO ] [MAIN ] AIT: Generated 139 derivative records from 26768 primary records. [2025-10-24T00:44:20.450000] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-24T00:44:20.455173] [FATAL] [LOCAL ] AIT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:20.455338] [FATAL] [MAIN ] AIT: Failed to save derivative data. [2025-10-24T00:44:20.458176] [INFO ] [MAIN ] Derivative Progress: 61/2164 symbols completed. AIT took 1.2s. Estimated remaining: 14m 28s. Rate: 145.3 symbols/min [2025-10-24T00:44:20.466619] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:20.479747] [INFO ] [MAIN ] AIZ: Generated 139 derivative records from 29404 primary records. [2025-10-24T00:44:20.482025] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-24T00:44:20.482412] [FATAL] [LOCAL ] AIZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:20.486730] [FATAL] [MAIN ] AIZ: Failed to save derivative data. [2025-10-24T00:44:20.487018] [DEBUG] [LOCAL ] AIZN: Loaded 3838 existing records from primary storage. [2025-10-24T00:44:20.492542] [INFO ] [MAIN ] AIZN: Loaded 3838 primary data records. [2025-10-24T00:44:20.489690] [INFO ] [MAIN ] Derivative Progress: 62/2164 symbols completed. AIZ took 1.2s. Estimated remaining: 14m 15s. Rate: 147.5 symbols/min [2025-10-24T00:44:20.493098] [INFO ] [MAIN ] AIV: Generated 139 derivative records from 42214 primary records. [2025-10-24T00:44:20.493484] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:20.512029] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-24T00:44:20.536604] [FATAL] [LOCAL ] AIV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:20.549186] [FATAL] [MAIN ] AIV: Failed to save derivative data. [2025-10-24T00:44:20.577236] [INFO ] [MAIN ] Derivative Progress: 63/2164 symbols completed. AIV took 1.3s. Estimated remaining: 14m 4s. Rate: 149.4 symbols/min [2025-10-24T00:44:20.585030] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:20.906583] [DEBUG] [LOCAL ] AJG: Loaded 46707 existing records from primary storage. [2025-10-24T00:44:20.908168] [INFO ] [MAIN ] AJG: Loaded 46707 primary data records. [2025-10-24T00:44:21.064426] [DEBUG] [LOCAL ] AKR: Loaded 46444 existing records from primary storage. [2025-10-24T00:44:21.070364] [INFO ] [MAIN ] AKR: Loaded 46444 primary data records. [2025-10-24T00:44:21.491430] [DEBUG] [MAIN ] AIZN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:21.673959] [DEBUG] [MAIN ] AJG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:21.717868] [DEBUG] [MAIN ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:21.747525] [INFO ] [MAIN ] AIZN: Generated 139 derivative records from 3838 primary records. [2025-10-24T00:44:21.751883] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-24T00:44:21.752829] [FATAL] [LOCAL ] AIZN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:21.754019] [FATAL] [MAIN ] AIZN: Failed to save derivative data. [2025-10-24T00:44:21.757221] [INFO ] [MAIN ] Derivative Progress: 64/2164 symbols completed. AIZN took 1.3s. Estimated remaining: 14m 29s. Rate: 145.0 symbols/min [2025-10-24T00:44:21.757813] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:21.781278] [INFO ] [MAIN ] AJG: Generated 139 derivative records from 46707 primary records. [2025-10-24T00:44:21.782535] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-24T00:44:21.782850] [FATAL] [LOCAL ] AJG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:21.785463] [FATAL] [MAIN ] AJG: Failed to save derivative data. [2025-10-24T00:44:21.787827] [INFO ] [MAIN ] Derivative Progress: 65/2164 symbols completed. AJG took 1.3s. Estimated remaining: 14m 16s. Rate: 147.1 symbols/min [2025-10-24T00:44:21.788442] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:21.810460] [INFO ] [MAIN ] AKR: Generated 139 derivative records from 46444 primary records. [2025-10-24T00:44:21.811073] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-24T00:44:21.811786] [FATAL] [LOCAL ] AKR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:21.812072] [FATAL] [MAIN ] AKR: Failed to save derivative data. [2025-10-24T00:44:21.815531] [INFO ] [MAIN ] Derivative Progress: 66/2164 symbols completed. AKR took 1.2s. Estimated remaining: 14m 4s. Rate: 149.2 symbols/min [2025-10-24T00:44:21.816185] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:21.836889] [DEBUG] [LOCAL ] AL: Loaded 45163 existing records from primary storage. [2025-10-24T00:44:21.837103] [INFO ] [MAIN ] AL: Loaded 45163 primary data records. [2025-10-24T00:44:22.181968] [DEBUG] [LOCAL ] ALB: Loaded 53752 existing records from primary storage. [2025-10-24T00:44:22.196694] [INFO ] [MAIN ] ALB: Loaded 53752 primary data records. [2025-10-24T00:44:22.197622] [DEBUG] [LOCAL ] ALC: Loaded 51590 existing records from primary storage. [2025-10-24T00:44:22.209808] [INFO ] [MAIN ] ALC: Loaded 51590 primary data records. [2025-10-24T00:44:22.875995] [DEBUG] [MAIN ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:22.922682] [DEBUG] [MAIN ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:22.958765] [DEBUG] [MAIN ] ALC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:22.979599] [INFO ] [MAIN ] AL: Generated 139 derivative records from 45163 primary records. [2025-10-24T00:44:22.982738] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-24T00:44:22.983427] [FATAL] [LOCAL ] AL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:22.983764] [FATAL] [MAIN ] AL: Failed to save derivative data. [2025-10-24T00:44:22.989473] [INFO ] [MAIN ] Derivative Progress: 67/2164 symbols completed. AL took 1.2s. Estimated remaining: 14m 28s. Rate: 145.0 symbols/min [2025-10-24T00:44:22.990235] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:23.014007] [INFO ] [MAIN ] ALB: Generated 139 derivative records from 53752 primary records. [2025-10-24T00:44:23.015509] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-24T00:44:23.017142] [FATAL] [LOCAL ] ALB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:23.017484] [INFO ] [MAIN ] ALC: Generated 139 derivative records from 51590 primary records. [2025-10-24T00:44:23.017725] [FATAL] [MAIN ] ALB: Failed to save derivative data. [2025-10-24T00:44:23.017616] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-24T00:44:23.017969] [FATAL] [LOCAL ] ALC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:23.019852] [INFO ] [MAIN ] Derivative Progress: 68/2164 symbols completed. ALB took 1.2s. Estimated remaining: 14m 15s. Rate: 147.0 symbols/min [2025-10-24T00:44:23.020203] [FATAL] [MAIN ] ALC: Failed to save derivative data. [2025-10-24T00:44:23.022418] [INFO ] [MAIN ] Derivative Progress: 69/2164 symbols completed. ALC took 1.2s. Estimated remaining: 14m 3s. Rate: 149.2 symbols/min [2025-10-24T00:44:23.020049] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:23.022692] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:23.053001] [DEBUG] [LOCAL ] ALG: Loaded 9765 existing records from primary storage. [2025-10-24T00:44:23.054245] [INFO ] [MAIN ] ALG: Loaded 9765 primary data records. [2025-10-24T00:44:23.054927] [DEBUG] [LOCAL ] ALE: Loaded 32276 existing records from primary storage. [2025-10-24T00:44:23.055062] [INFO ] [MAIN ] ALE: Loaded 32276 primary data records. [2025-10-24T00:44:23.276493] [DEBUG] [LOCAL ] ALEX: Loaded 31013 existing records from primary storage. [2025-10-24T00:44:23.283581] [INFO ] [MAIN ] ALEX: Loaded 31013 primary data records. [2025-10-24T00:44:24.025027] [DEBUG] [MAIN ] ALG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:24.025581] [DEBUG] [MAIN ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:24.074079] [DEBUG] [MAIN ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:24.148178] [INFO ] [MAIN ] ALG: Generated 139 derivative records from 9765 primary records. [2025-10-24T00:44:24.154379] [INFO ] [MAIN ] ALE: Generated 139 derivative records from 32276 primary records. [2025-10-24T00:44:24.153388] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-24T00:44:24.155299] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-24T00:44:24.155664] [FATAL] [LOCAL ] ALG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:24.157711] [FATAL] [LOCAL ] ALE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:24.158003] [INFO ] [MAIN ] ALEX: Generated 139 derivative records from 31013 primary records. [2025-10-24T00:44:24.158369] [FATAL] [MAIN ] ALE: Failed to save derivative data. [2025-10-24T00:44:24.158278] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-24T00:44:24.158206] [FATAL] [MAIN ] ALG: Failed to save derivative data. [2025-10-24T00:44:24.160692] [INFO ] [MAIN ] Derivative Progress: 70/2164 symbols completed. ALE took 1.2s. Estimated remaining: 14m 24s. Rate: 145.4 symbols/min [2025-10-24T00:44:24.163152] [FATAL] [LOCAL ] ALEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:24.163556] [FATAL] [MAIN ] ALEX: Failed to save derivative data. [2025-10-24T00:44:24.163379] [INFO ] [MAIN ] Derivative Progress: 71/2164 symbols completed. ALG took 1.1s. Estimated remaining: 14m 12s. Rate: 147.4 symbols/min [2025-10-24T00:44:24.163262] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:24.163734] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:24.166579] [INFO ] [MAIN ] Derivative Progress: 72/2164 symbols completed. ALEX took 1.1s. Estimated remaining: 13m 60s. Rate: 149.5 symbols/min [2025-10-24T00:44:24.167289] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:24.253055] [DEBUG] [LOCAL ] ALIT: Loaded 53163 existing records from primary storage. [2025-10-24T00:44:24.253732] [INFO ] [MAIN ] ALIT: Loaded 53163 primary data records. [2025-10-24T00:44:24.265948] [DEBUG] [LOCAL ] ALK: Loaded 53477 existing records from primary storage. [2025-10-24T00:44:24.305238] [INFO ] [MAIN ] ALK: Loaded 53477 primary data records. [2025-10-24T00:44:24.345372] [DEBUG] [LOCAL ] ALL: Loaded 49959 existing records from primary storage. [2025-10-24T00:44:24.397985] [INFO ] [MAIN ] ALL: Loaded 49959 primary data records. [2025-10-24T00:44:25.283443] [DEBUG] [MAIN ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:25.331081] [DEBUG] [MAIN ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:25.331871] [DEBUG] [MAIN ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:25.428278] [INFO ] [MAIN ] ALIT: Generated 139 derivative records from 53163 primary records. [2025-10-24T00:44:25.428937] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-24T00:44:25.429975] [FATAL] [LOCAL ] ALIT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:25.431888] [FATAL] [MAIN ] ALIT: Failed to save derivative data. [2025-10-24T00:44:25.435049] [INFO ] [MAIN ] Derivative Progress: 73/2164 symbols completed. ALIT took 1.3s. Estimated remaining: 14m 24s. Rate: 145.2 symbols/min [2025-10-24T00:44:25.439171] [INFO ] [MAIN ] ALK: Generated 139 derivative records from 53477 primary records. [2025-10-24T00:44:25.439619] [INFO ] [MAIN ] ALL: Generated 139 derivative records from 49959 primary records. [2025-10-24T00:44:25.439381] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-24T00:44:25.440470] [FATAL] [LOCAL ] ALK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:25.440727] [FATAL] [MAIN ] ALK: Failed to save derivative data. [2025-10-24T00:44:25.440597] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-24T00:44:25.441160] [FATAL] [LOCAL ] ALL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:25.445090] [INFO ] [MAIN ] Derivative Progress: 74/2164 symbols completed. ALK took 1.3s. Estimated remaining: 14m 12s. Rate: 147.1 symbols/min [2025-10-24T00:44:25.445197] [FATAL] [MAIN ] ALL: Failed to save derivative data. [2025-10-24T00:44:25.449213] [INFO ] [MAIN ] Derivative Progress: 75/2164 symbols completed. ALL took 1.3s. Estimated remaining: 14m 1s. Rate: 149.1 symbols/min [2025-10-24T00:44:25.449834] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:25.449626] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:25.449736] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:25.513444] [DEBUG] [LOCAL ] ALLE: Loaded 44288 existing records from primary storage. [2025-10-24T00:44:25.525975] [INFO ] [MAIN ] ALLE: Loaded 44288 primary data records. [2025-10-24T00:44:25.547691] [DEBUG] [LOCAL ] ALSN: Loaded 43535 existing records from primary storage. [2025-10-24T00:44:25.562928] [INFO ] [MAIN ] ALSN: Loaded 43535 primary data records. [2025-10-24T00:44:25.721315] [DEBUG] [LOCAL ] ALLY: Loaded 53610 existing records from primary storage. [2025-10-24T00:44:25.743730] [INFO ] [MAIN ] ALLY: Loaded 53610 primary data records. [2025-10-24T00:44:26.508943] [DEBUG] [MAIN ] ALLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:26.508079] [DEBUG] [MAIN ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:26.564081] [DEBUG] [MAIN ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:26.622463] [INFO ] [MAIN ] ALLE: Generated 139 derivative records from 44288 primary records. [2025-10-24T00:44:26.623155] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-24T00:44:26.625866] [FATAL] [LOCAL ] ALLE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:26.629185] [FATAL] [MAIN ] ALLE: Failed to save derivative data. [2025-10-24T00:44:26.635547] [INFO ] [MAIN ] ALSN: Generated 139 derivative records from 43535 primary records. [2025-10-24T00:44:26.635004] [INFO ] [MAIN ] Derivative Progress: 76/2164 symbols completed. ALLE took 1.2s. Estimated remaining: 14m 22s. Rate: 145.4 symbols/min [2025-10-24T00:44:26.637535] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-24T00:44:26.638461] [FATAL] [LOCAL ] ALSN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:26.637890] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:26.638771] [FATAL] [MAIN ] ALSN: Failed to save derivative data. [2025-10-24T00:44:26.642340] [INFO ] [MAIN ] Derivative Progress: 77/2164 symbols completed. ALSN took 1.2s. Estimated remaining: 14m 10s. Rate: 147.3 symbols/min [2025-10-24T00:44:26.646704] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:26.650980] [INFO ] [MAIN ] ALLY: Generated 139 derivative records from 53610 primary records. [2025-10-24T00:44:26.651234] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-24T00:44:26.651592] [FATAL] [LOCAL ] ALLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:26.651811] [FATAL] [MAIN ] ALLY: Failed to save derivative data. [2025-10-24T00:44:26.655116] [INFO ] [MAIN ] Derivative Progress: 78/2164 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 59s. Rate: 149.1 symbols/min [2025-10-24T00:44:26.662171] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:26.671000] [DEBUG] [LOCAL ] ALUR: Loaded 9313 existing records from primary storage. [2025-10-24T00:44:26.671215] [INFO ] [MAIN ] ALUR: Loaded 9313 primary data records. [2025-10-24T00:44:26.715867] [DEBUG] [LOCAL ] ALTG: Loaded 23210 existing records from primary storage. [2025-10-24T00:44:26.743948] [INFO ] [MAIN ] ALTG: Loaded 23210 primary data records. [2025-10-24T00:44:27.173924] [DEBUG] [LOCAL ] ALV: Loaded 42508 existing records from primary storage. [2025-10-24T00:44:27.198585] [INFO ] [MAIN ] ALV: Loaded 42508 primary data records. [2025-10-24T00:44:27.736322] [DEBUG] [MAIN ] ALUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:27.750703] [DEBUG] [MAIN ] ALTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:27.838216] [INFO ] [MAIN ] ALUR: Generated 139 derivative records from 9313 primary records. [2025-10-24T00:44:27.839389] [DEBUG] [MAIN ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:27.839837] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-24T00:44:27.842025] [FATAL] [LOCAL ] ALUR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:27.855186] [FATAL] [MAIN ] ALUR: Failed to save derivative data. [2025-10-24T00:44:27.858105] [INFO ] [MAIN ] Derivative Progress: 79/2164 symbols completed. ALUR took 1.2s. Estimated remaining: 14m 20s. Rate: 145.5 symbols/min [2025-10-24T00:44:27.858950] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:27.879608] [DEBUG] [LOCAL ] ALX: Loaded 7365 existing records from primary storage. [2025-10-24T00:44:27.883799] [INFO ] [MAIN ] ALX: Loaded 7365 primary data records. [2025-10-24T00:44:27.956798] [INFO ] [MAIN ] ALTG: Generated 139 derivative records from 23210 primary records. [2025-10-24T00:44:27.973878] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-24T00:44:27.998959] [FATAL] [LOCAL ] ALTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:27.999072] [FATAL] [MAIN ] ALTG: Failed to save derivative data. [2025-10-24T00:44:28.044130] [INFO ] [MAIN ] Derivative Progress: 80/2164 symbols completed. ALTG took 1.4s. Estimated remaining: 14m 14s. Rate: 146.5 symbols/min [2025-10-24T00:44:28.193306] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:28.205954] [INFO ] [MAIN ] ALV: Generated 139 derivative records from 42508 primary records. [2025-10-24T00:44:28.206304] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-24T00:44:28.206721] [FATAL] [LOCAL ] ALV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:28.208096] [FATAL] [MAIN ] ALV: Failed to save derivative data. [2025-10-24T00:44:28.210333] [INFO ] [MAIN ] Derivative Progress: 81/2164 symbols completed. ALV took 1.5s. Estimated remaining: 14m 7s. Rate: 147.5 symbols/min [2025-10-24T00:44:28.213324] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:28.257149] [DEBUG] [MAIN ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:28.296971] [DEBUG] [LOCAL ] AMBC: Loaded 36148 existing records from primary storage. [2025-10-24T00:44:28.315596] [INFO ] [MAIN ] AMBC: Loaded 36148 primary data records. [2025-10-24T00:44:28.317552] [DEBUG] [LOCAL ] AM: Loaded 52213 existing records from primary storage. [2025-10-24T00:44:28.326223] [INFO ] [MAIN ] AM: Loaded 52213 primary data records. [2025-10-24T00:44:28.853282] [INFO ] [MAIN ] ALX: Generated 139 derivative records from 7365 primary records. [2025-10-24T00:44:28.878686] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-24T00:44:28.879367] [FATAL] [LOCAL ] ALX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:28.879825] [FATAL] [MAIN ] ALX: Failed to save derivative data. [2025-10-24T00:44:29.023079] [INFO ] [MAIN ] Derivative Progress: 82/2164 symbols completed. ALX took 1.2s. Estimated remaining: 14m 17s. Rate: 145.8 symbols/min [2025-10-24T00:44:29.023823] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:29.054847] [DEBUG] [MAIN ] AMBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:29.108114] [DEBUG] [LOCAL ] AMBP: Loaded 44670 existing records from primary storage. [2025-10-24T00:44:29.116469] [INFO ] [MAIN ] AMBP: Loaded 44670 primary data records. [2025-10-24T00:44:29.126945] [DEBUG] [MAIN ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:29.521300] [INFO ] [MAIN ] AMBC: Generated 139 derivative records from 36148 primary records. [2025-10-24T00:44:29.525015] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-24T00:44:29.527355] [FATAL] [LOCAL ] AMBC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:29.528360] [FATAL] [MAIN ] AMBC: Failed to save derivative data. [2025-10-24T00:44:29.531104] [INFO ] [MAIN ] Derivative Progress: 83/2164 symbols completed. AMBC took 1.3s. Estimated remaining: 14m 19s. Rate: 145.4 symbols/min [2025-10-24T00:44:29.531307] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:29.538507] [INFO ] [MAIN ] AM: Generated 139 derivative records from 52213 primary records. [2025-10-24T00:44:29.539074] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-24T00:44:29.539561] [FATAL] [LOCAL ] AM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:29.539843] [FATAL] [MAIN ] AM: Failed to save derivative data. [2025-10-24T00:44:29.543427] [INFO ] [MAIN ] Derivative Progress: 84/2164 symbols completed. AM took 1.4s. Estimated remaining: 14m 9s. Rate: 147.1 symbols/min [2025-10-24T00:44:29.543987] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:29.563667] [DEBUG] [MAIN ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:29.643852] [DEBUG] [LOCAL ] AMC: Loaded 54156 existing records from primary storage. [2025-10-24T00:44:29.645990] [INFO ] [MAIN ] AMBP: Generated 139 derivative records from 44670 primary records. [2025-10-24T00:44:29.646213] [INFO ] [MAIN ] AMC: Loaded 54156 primary data records. [2025-10-24T00:44:29.646489] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-24T00:44:29.646821] [FATAL] [LOCAL ] AMBP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:29.647076] [FATAL] [MAIN ] AMBP: Failed to save derivative data. [2025-10-24T00:44:29.661396] [INFO ] [MAIN ] Derivative Progress: 85/2164 symbols completed. AMBP took 0.6s. Estimated remaining: 14m 1s. Rate: 148.3 symbols/min [2025-10-24T00:44:29.688212] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:29.775259] [DEBUG] [LOCAL ] AMCR: Loaded 54060 existing records from primary storage. [2025-10-24T00:44:29.776017] [INFO ] [MAIN ] AMCR: Loaded 54060 primary data records. [2025-10-24T00:44:30.199866] [DEBUG] [LOCAL ] AME: Loaded 48787 existing records from primary storage. [2025-10-24T00:44:30.336504] [INFO ] [MAIN ] AME: Loaded 48787 primary data records. [2025-10-24T00:44:30.657424] [DEBUG] [MAIN ] AMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:30.694469] [DEBUG] [MAIN ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:30.745578] [DEBUG] [MAIN ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:30.783886] [INFO ] [MAIN ] AMC: Generated 139 derivative records from 54156 primary records. [2025-10-24T00:44:30.784783] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-24T00:44:30.785082] [FATAL] [LOCAL ] AMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:30.786697] [FATAL] [MAIN ] AMC: Failed to save derivative data. [2025-10-24T00:44:30.791520] [INFO ] [MAIN ] Derivative Progress: 86/2164 symbols completed. AMC took 1.3s. Estimated remaining: 14m 18s. Rate: 145.3 symbols/min [2025-10-24T00:44:30.791864] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:30.797571] [INFO ] [MAIN ] AMCR: Generated 139 derivative records from 54060 primary records. [2025-10-24T00:44:30.798409] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-24T00:44:30.800264] [FATAL] [LOCAL ] AMCR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:30.800444] [FATAL] [MAIN ] AMCR: Failed to save derivative data. [2025-10-24T00:44:30.804996] [INFO ] [MAIN ] Derivative Progress: 87/2164 symbols completed. AMCR took 1.3s. Estimated remaining: 14m 8s. Rate: 146.9 symbols/min [2025-10-24T00:44:30.806582] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:30.819453] [INFO ] [MAIN ] AME: Generated 139 derivative records from 48787 primary records. [2025-10-24T00:44:30.819745] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-24T00:44:30.819968] [FATAL] [LOCAL ] AME: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:30.820156] [FATAL] [MAIN ] AME: Failed to save derivative data. [2025-10-24T00:44:30.822776] [INFO ] [MAIN ] Derivative Progress: 88/2164 symbols completed. AME took 1.1s. Estimated remaining: 13m 59s. Rate: 148.5 symbols/min [2025-10-24T00:44:30.831204] [DEBUG] [LOCAL ] AMG: Loaded 20186 existing records from primary storage. [2025-10-24T00:44:30.831319] [INFO ] [MAIN ] AMG: Loaded 20186 primary data records. [2025-10-24T00:44:31.147996] [DEBUG] [LOCAL ] AMH: Loaded 52212 existing records from primary storage. [2025-10-24T00:44:31.148280] [INFO ] [MAIN ] AMH: Loaded 52212 primary data records. [2025-10-24T00:44:31.498017] [DEBUG] [MAIN ] AMG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:31.543241] [DEBUG] [MAIN ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:31.545091] [INFO ] [MAIN ] AMG: Generated 139 derivative records from 20186 primary records. [2025-10-24T00:44:31.556185] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-24T00:44:31.556413] [FATAL] [LOCAL ] AMG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:31.556508] [FATAL] [MAIN ] AMG: Failed to save derivative data. [2025-10-24T00:44:31.558565] [INFO ] [MAIN ] Derivative Progress: 89/2164 symbols completed. AMG took 0.8s. Estimated remaining: 14m 6s. Rate: 147.2 symbols/min [2025-10-24T00:44:31.573963] [INFO ] [MAIN ] AMH: Generated 139 derivative records from 52212 primary records. [2025-10-24T00:44:31.574140] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-24T00:44:31.574372] [FATAL] [LOCAL ] AMH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:31.574448] [FATAL] [MAIN ] AMH: Failed to save derivative data. [2025-10-24T00:44:31.576713] [INFO ] [MAIN ] Derivative Progress: 90/2164 symbols completed. AMH took 0.8s. Estimated remaining: 13m 57s. Rate: 148.7 symbols/min [2025-10-24T00:44:31.577102] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:31.577342] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:31.577233] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:31.631562] [DEBUG] [LOCAL ] AMP: Loaded 31992 existing records from primary storage. [2025-10-24T00:44:31.632314] [INFO ] [MAIN ] AMP: Loaded 31992 primary data records. [2025-10-24T00:44:31.749258] [DEBUG] [LOCAL ] AMN: Loaded 41883 existing records from primary storage. [2025-10-24T00:44:31.761147] [INFO ] [MAIN ] AMN: Loaded 41883 primary data records. [2025-10-24T00:44:31.760999] [DEBUG] [LOCAL ] AMPX: Loaded 52829 existing records from primary storage. [2025-10-24T00:44:31.777807] [INFO ] [MAIN ] AMPX: Loaded 52829 primary data records. [2025-10-24T00:44:32.576613] [DEBUG] [MAIN ] AMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:32.608277] [DEBUG] [MAIN ] AMPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:32.635454] [DEBUG] [MAIN ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:32.703280] [INFO ] [MAIN ] AMP: Generated 139 derivative records from 31992 primary records. [2025-10-24T00:44:32.708365] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-24T00:44:32.709182] [FATAL] [LOCAL ] AMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:32.709387] [FATAL] [MAIN ] AMP: Failed to save derivative data. [2025-10-24T00:44:32.711219] [INFO ] [MAIN ] Derivative Progress: 91/2164 symbols completed. AMP took 1.1s. Estimated remaining: 14m 13s. Rate: 145.8 symbols/min [2025-10-24T00:44:32.712822] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:32.720384] [INFO ] [MAIN ] AMN: Generated 139 derivative records from 41883 primary records. [2025-10-24T00:44:32.722761] [INFO ] [MAIN ] AMPX: Generated 139 derivative records from 52829 primary records. [2025-10-24T00:44:32.723112] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-24T00:44:32.723358] [FATAL] [LOCAL ] AMPX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:32.723455] [FATAL] [MAIN ] AMPX: Failed to save derivative data. [2025-10-24T00:44:32.723527] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-24T00:44:32.726095] [FATAL] [LOCAL ] AMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:32.726246] [FATAL] [MAIN ] AMN: Failed to save derivative data. [2025-10-24T00:44:32.725807] [INFO ] [MAIN ] Derivative Progress: 92/2164 symbols completed. AMPX took 1.1s. Estimated remaining: 14m 4s. Rate: 147.4 symbols/min [2025-10-24T00:44:32.726488] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:32.729113] [INFO ] [MAIN ] Derivative Progress: 93/2164 symbols completed. AMN took 1.2s. Estimated remaining: 13m 54s. Rate: 149.0 symbols/min [2025-10-24T00:44:32.729537] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:32.766305] [DEBUG] [LOCAL ] AMPY: Loaded 39691 existing records from primary storage. [2025-10-24T00:44:32.776461] [INFO ] [MAIN ] AMPY: Loaded 39691 primary data records. [2025-10-24T00:44:32.879534] [DEBUG] [LOCAL ] AMR: Loaded 28953 existing records from primary storage. [2025-10-24T00:44:32.890835] [INFO ] [MAIN ] AMR: Loaded 28953 primary data records. [2025-10-24T00:44:32.903010] [DEBUG] [LOCAL ] AMRC: Loaded 38781 existing records from primary storage. [2025-10-24T00:44:32.924518] [INFO ] [MAIN ] AMRC: Loaded 38781 primary data records. [2025-10-24T00:44:33.813932] [DEBUG] [MAIN ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:33.852872] [DEBUG] [MAIN ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:33.879783] [DEBUG] [MAIN ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:33.935837] [INFO ] [MAIN ] AMPY: Generated 139 derivative records from 39691 primary records. [2025-10-24T00:44:33.936354] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-24T00:44:33.936689] [FATAL] [LOCAL ] AMPY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:33.941382] [FATAL] [MAIN ] AMPY: Failed to save derivative data. [2025-10-24T00:44:33.945939] [INFO ] [MAIN ] Derivative Progress: 94/2164 symbols completed. AMPY took 1.2s. Estimated remaining: 14m 12s. Rate: 145.8 symbols/min [2025-10-24T00:44:33.946341] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:33.962992] [INFO ] [MAIN ] AMR: Generated 139 derivative records from 28953 primary records. [2025-10-24T00:44:33.964944] [INFO ] [MAIN ] AMRC: Generated 139 derivative records from 38781 primary records. [2025-10-24T00:44:33.965134] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-24T00:44:33.965249] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-24T00:44:33.965557] [FATAL] [LOCAL ] AMR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:33.965809] [FATAL] [LOCAL ] AMRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:33.965900] [FATAL] [MAIN ] AMRC: Failed to save derivative data. [2025-10-24T00:44:33.965984] [FATAL] [MAIN ] AMR: Failed to save derivative data. [2025-10-24T00:44:33.968324] [INFO ] [MAIN ] Derivative Progress: 95/2164 symbols completed. AMRC took 1.2s. Estimated remaining: 14m 3s. Rate: 147.3 symbols/min [2025-10-24T00:44:33.968543] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:33.971905] [INFO ] [MAIN ] Derivative Progress: 96/2164 symbols completed. AMR took 1.2s. Estimated remaining: 13m 54s. Rate: 148.8 symbols/min [2025-10-24T00:44:33.972766] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:33.979162] [DEBUG] [LOCAL ] AMTD: Loaded 3818 existing records from primary storage. [2025-10-24T00:44:33.979324] [INFO ] [MAIN ] AMTD: Loaded 3818 primary data records. [2025-10-24T00:44:34.115292] [DEBUG] [LOCAL ] AMTB: Loaded 20600 existing records from primary storage. [2025-10-24T00:44:34.130693] [INFO ] [MAIN ] AMTB: Loaded 20600 primary data records. [2025-10-24T00:44:34.199364] [DEBUG] [LOCAL ] AMT: Loaded 52814 existing records from primary storage. [2025-10-24T00:44:34.212390] [INFO ] [MAIN ] AMT: Loaded 52814 primary data records. [2025-10-24T00:44:35.007738] [DEBUG] [MAIN ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:35.051578] [DEBUG] [MAIN ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:35.072231] [DEBUG] [MAIN ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:35.152770] [INFO ] [MAIN ] AMTD: Generated 139 derivative records from 3818 primary records. [2025-10-24T00:44:35.153106] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-24T00:44:35.153730] [FATAL] [LOCAL ] AMTD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:35.154057] [FATAL] [MAIN ] AMTD: Failed to save derivative data. [2025-10-24T00:44:35.157842] [INFO ] [MAIN ] Derivative Progress: 97/2164 symbols completed. AMTD took 1.2s. Estimated remaining: 14m 10s. Rate: 145.9 symbols/min [2025-10-24T00:44:35.161972] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:35.170104] [INFO ] [MAIN ] AMTB: Generated 139 derivative records from 20600 primary records. [2025-10-24T00:44:35.170376] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-24T00:44:35.167913] [INFO ] [MAIN ] AMT: Generated 139 derivative records from 52814 primary records. [2025-10-24T00:44:35.170632] [FATAL] [LOCAL ] AMTB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:35.170773] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-24T00:44:35.171049] [FATAL] [MAIN ] AMTB: Failed to save derivative data. [2025-10-24T00:44:35.170993] [FATAL] [LOCAL ] AMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:35.173506] [INFO ] [MAIN ] Derivative Progress: 98/2164 symbols completed. AMTB took 1.2s. Estimated remaining: 14m 1s. Rate: 147.4 symbols/min [2025-10-24T00:44:35.173615] [FATAL] [MAIN ] AMT: Failed to save derivative data. [2025-10-24T00:44:35.177271] [INFO ] [MAIN ] Derivative Progress: 99/2164 symbols completed. AMT took 1.2s. Estimated remaining: 13m 52s. Rate: 148.8 symbols/min [2025-10-24T00:44:35.177500] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:35.173914] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:35.191116] [DEBUG] [LOCAL ] AMWL: Loaded 9907 existing records from primary storage. [2025-10-24T00:44:35.191394] [INFO ] [MAIN ] AMWL: Loaded 9907 primary data records. [2025-10-24T00:44:35.352754] [DEBUG] [LOCAL ] AMTM: Loaded 50606 existing records from primary storage. [2025-10-24T00:44:35.418146] [INFO ] [MAIN ] AMTM: Loaded 50606 primary data records. [2025-10-24T00:44:35.688903] [DEBUG] [LOCAL ] AMX: Loaded 49530 existing records from primary storage. [2025-10-24T00:44:35.695800] [INFO ] [MAIN ] AMX: Loaded 49530 primary data records. [2025-10-24T00:44:36.233501] [DEBUG] [MAIN ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:36.275734] [DEBUG] [MAIN ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:36.319587] [DEBUG] [MAIN ] AMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:36.353989] [INFO ] [MAIN ] AMWL: Generated 139 derivative records from 9907 primary records. [2025-10-24T00:44:36.357560] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-24T00:44:36.358376] [FATAL] [LOCAL ] AMWL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:36.360304] [FATAL] [MAIN ] AMWL: Failed to save derivative data. [2025-10-24T00:44:36.362511] [INFO ] [MAIN ] Derivative Progress: 100/2164 symbols completed. AMWL took 1.2s. Estimated remaining: 14m 8s. Rate: 146.0 symbols/min [2025-10-24T00:44:36.362812] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:36.381151] [INFO ] [MAIN ] AMTM: Generated 139 derivative records from 50606 primary records. [2025-10-24T00:44:36.383593] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-24T00:44:36.384474] [FATAL] [LOCAL ] AMTM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:36.384830] [FATAL] [MAIN ] AMTM: Failed to save derivative data. [2025-10-24T00:44:36.400535] [INFO ] [MAIN ] Derivative Progress: 101/2164 symbols completed. AMTM took 1.2s. Estimated remaining: 14m 0s. Rate: 147.3 symbols/min [2025-10-24T00:44:36.400995] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:36.398248] [INFO ] [MAIN ] AMX: Generated 139 derivative records from 49530 primary records. [2025-10-24T00:44:36.401673] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-24T00:44:36.402299] [FATAL] [LOCAL ] AMX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:36.402383] [FATAL] [MAIN ] AMX: Failed to save derivative data. [2025-10-24T00:44:36.404820] [INFO ] [MAIN ] Derivative Progress: 102/2164 symbols completed. AMX took 1.2s. Estimated remaining: 13m 52s. Rate: 148.8 symbols/min [2025-10-24T00:44:36.405186] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:36.417080] [DEBUG] [LOCAL ] AN: Loaded 31320 existing records from primary storage. [2025-10-24T00:44:36.417342] [INFO ] [MAIN ] AN: Loaded 31320 primary data records. [2025-10-24T00:44:36.776960] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-24T00:44:36.777347] [INFO ] [MAIN ] ANET: Loaded 54156 primary data records. [2025-10-24T00:44:36.899822] [DEBUG] [LOCAL ] ANF: Loaded 52408 existing records from primary storage. [2025-10-24T00:44:36.900440] [INFO ] [MAIN ] ANF: Loaded 52408 primary data records. [2025-10-24T00:44:37.459252] [DEBUG] [MAIN ] AN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:37.502783] [DEBUG] [MAIN ] ANET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:37.546265] [DEBUG] [MAIN ] ANF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:37.565194] [INFO ] [MAIN ] AN: Generated 139 derivative records from 31320 primary records. [2025-10-24T00:44:37.565736] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-24T00:44:37.566529] [FATAL] [LOCAL ] AN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:37.570081] [FATAL] [MAIN ] AN: Failed to save derivative data. [2025-10-24T00:44:37.572729] [INFO ] [MAIN ] Derivative Progress: 103/2164 symbols completed. AN took 1.2s. Estimated remaining: 14m 6s. Rate: 146.1 symbols/min [2025-10-24T00:44:37.587131] [INFO ] [MAIN ] ANET: Generated 139 derivative records from 54156 primary records. [2025-10-24T00:44:37.589549] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-24T00:44:37.589851] [FATAL] [LOCAL ] ANET: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:37.591076] [FATAL] [MAIN ] ANET: Failed to save derivative data. [2025-10-24T00:44:37.592947] [INFO ] [MAIN ] Derivative Progress: 104/2164 symbols completed. ANET took 1.2s. Estimated remaining: 13m 58s. Rate: 147.4 symbols/min [2025-10-24T00:44:37.597437] [INFO ] [MAIN ] ANF: Generated 139 derivative records from 52408 primary records. [2025-10-24T00:44:37.597528] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-24T00:44:37.597771] [FATAL] [LOCAL ] ANF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:37.597853] [FATAL] [MAIN ] ANF: Failed to save derivative data. [2025-10-24T00:44:37.601309] [INFO ] [MAIN ] Derivative Progress: 105/2164 symbols completed. ANF took 1.2s. Estimated remaining: 13m 50s. Rate: 148.8 symbols/min [2025-10-24T00:44:37.601773] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:37.601823] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:37.601728] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:37.626420] [DEBUG] [LOCAL ] ANRO: Loaded 19930 existing records from primary storage. [2025-10-24T00:44:37.626688] [INFO ] [MAIN ] ANRO: Loaded 19930 primary data records. [2025-10-24T00:44:37.721500] [DEBUG] [LOCAL ] ANVS: Loaded 24118 existing records from primary storage. [2025-10-24T00:44:37.756883] [INFO ] [MAIN ] ANVS: Loaded 24118 primary data records. [2025-10-24T00:44:37.758297] [DEBUG] [LOCAL ] AOD: Loaded 31093 existing records from primary storage. [2025-10-24T00:44:37.758417] [INFO ] [MAIN ] AOD: Loaded 31093 primary data records. [2025-10-24T00:44:38.580007] [DEBUG] [MAIN ] ANRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:38.585516] [DEBUG] [MAIN ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:38.634137] [DEBUG] [MAIN ] AOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:38.692530] [INFO ] [MAIN ] ANVS: Generated 139 derivative records from 24118 primary records. [2025-10-24T00:44:38.694934] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-24T00:44:38.695459] [FATAL] [LOCAL ] ANVS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:38.695572] [FATAL] [MAIN ] ANVS: Failed to save derivative data. [2025-10-24T00:44:38.695211] [INFO ] [MAIN ] ANRO: Generated 139 derivative records from 19930 primary records. [2025-10-24T00:44:38.700669] [INFO ] [MAIN ] Derivative Progress: 106/2164 symbols completed. ANVS took 1.1s. Estimated remaining: 14m 3s. Rate: 146.4 symbols/min [2025-10-24T00:44:38.701774] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:38.700836] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-24T00:44:38.704030] [FATAL] [LOCAL ] ANRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:38.704138] [FATAL] [MAIN ] ANRO: Failed to save derivative data. [2025-10-24T00:44:38.706523] [INFO ] [MAIN ] Derivative Progress: 107/2164 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 55s. Rate: 147.8 symbols/min [2025-10-24T00:44:38.706786] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:38.709583] [INFO ] [MAIN ] AOD: Generated 139 derivative records from 31093 primary records. [2025-10-24T00:44:38.709877] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-24T00:44:38.710408] [FATAL] [LOCAL ] AOD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:38.710607] [FATAL] [MAIN ] AOD: Failed to save derivative data. [2025-10-24T00:44:38.713982] [INFO ] [MAIN ] Derivative Progress: 108/2164 symbols completed. AOD took 1.1s. Estimated remaining: 13m 47s. Rate: 149.2 symbols/min [2025-10-24T00:44:38.714365] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:38.728372] [DEBUG] [LOCAL ] AOMR: Loaded 16387 existing records from primary storage. [2025-10-24T00:44:38.728535] [INFO ] [MAIN ] AOMR: Loaded 16387 primary data records. [2025-10-24T00:44:38.962422] [DEBUG] [LOCAL ] AORT: Loaded 29058 existing records from primary storage. [2025-10-24T00:44:39.045954] [DEBUG] [LOCAL ] AON: Loaded 45341 existing records from primary storage. [2025-10-24T00:44:39.078856] [INFO ] [MAIN ] AON: Loaded 45341 primary data records. [2025-10-24T00:44:39.078603] [INFO ] [MAIN ] AORT: Loaded 29058 primary data records. [2025-10-24T00:44:39.740593] [DEBUG] [MAIN ] AOMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:39.780168] [DEBUG] [MAIN ] AON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:39.814022] [DEBUG] [MAIN ] AORT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:39.839572] [INFO ] [MAIN ] AOMR: Generated 139 derivative records from 16387 primary records. [2025-10-24T00:44:39.843118] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-24T00:44:39.843634] [FATAL] [LOCAL ] AOMR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:39.843943] [FATAL] [MAIN ] AOMR: Failed to save derivative data. [2025-10-24T00:44:39.846810] [INFO ] [MAIN ] Derivative Progress: 109/2164 symbols completed. AOMR took 1.1s. Estimated remaining: 14m 0s. Rate: 146.7 symbols/min [2025-10-24T00:44:39.852462] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:39.878709] [INFO ] [MAIN ] AON: Generated 139 derivative records from 45341 primary records. [2025-10-24T00:44:39.880758] [INFO ] [MAIN ] AORT: Generated 139 derivative records from 29058 primary records. [2025-10-24T00:44:39.881061] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-24T00:44:39.881488] [FATAL] [LOCAL ] AON: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:39.881231] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-24T00:44:39.881660] [FATAL] [MAIN ] AON: Failed to save derivative data. [2025-10-24T00:44:39.884431] [INFO ] [MAIN ] Derivative Progress: 110/2164 symbols completed. AON took 1.2s. Estimated remaining: 13m 53s. Rate: 147.9 symbols/min [2025-10-24T00:44:39.884670] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:39.881983] [FATAL] [LOCAL ] AORT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:39.885201] [FATAL] [MAIN ] AORT: Failed to save derivative data. [2025-10-24T00:44:39.887907] [INFO ] [MAIN ] Derivative Progress: 111/2164 symbols completed. AORT took 1.2s. Estimated remaining: 13m 45s. Rate: 149.3 symbols/min [2025-10-24T00:44:39.888235] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:39.906231] [DEBUG] [LOCAL ] AP: Loaded 7470 existing records from primary storage. [2025-10-24T00:44:39.906379] [INFO ] [MAIN ] AP: Loaded 7470 primary data records. [2025-10-24T00:44:40.024866] [DEBUG] [LOCAL ] AOS: Loaded 49003 existing records from primary storage. [2025-10-24T00:44:40.081718] [INFO ] [MAIN ] AOS: Loaded 49003 primary data records. [2025-10-24T00:44:40.163948] [DEBUG] [LOCAL ] APAM: Loaded 35893 existing records from primary storage. [2025-10-24T00:44:40.189967] [INFO ] [MAIN ] APAM: Loaded 35893 primary data records. [2025-10-24T00:44:40.871118] [DEBUG] [MAIN ] AP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:40.905880] [DEBUG] [MAIN ] AOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:40.943494] [DEBUG] [MAIN ] APAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:40.995178] [INFO ] [MAIN ] AP: Generated 139 derivative records from 7470 primary records. [2025-10-24T00:44:41.001522] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-24T00:44:41.002958] [FATAL] [LOCAL ] AP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:41.004803] [FATAL] [MAIN ] AP: Failed to save derivative data. [2025-10-24T00:44:41.007275] [INFO ] [MAIN ] Derivative Progress: 112/2164 symbols completed. AP took 1.1s. Estimated remaining: 13m 58s. Rate: 146.9 symbols/min [2025-10-24T00:44:41.012581] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:41.013032] [INFO ] [MAIN ] AOS: Generated 139 derivative records from 49003 primary records. [2025-10-24T00:44:41.015186] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-24T00:44:41.015494] [FATAL] [LOCAL ] AOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:41.018523] [FATAL] [MAIN ] AOS: Failed to save derivative data. [2025-10-24T00:44:41.022328] [INFO ] [MAIN ] Derivative Progress: 113/2164 symbols completed. AOS took 1.2s. Estimated remaining: 13m 50s. Rate: 148.2 symbols/min [2025-10-24T00:44:41.022666] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:41.025178] [INFO ] [MAIN ] APAM: Generated 139 derivative records from 35893 primary records. [2025-10-24T00:44:41.025336] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-24T00:44:41.025541] [FATAL] [LOCAL ] APAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:41.025869] [FATAL] [MAIN ] APAM: Failed to save derivative data. [2025-10-24T00:44:41.028327] [INFO ] [MAIN ] Derivative Progress: 114/2164 symbols completed. APAM took 1.1s. Estimated remaining: 13m 43s. Rate: 149.5 symbols/min [2025-10-24T00:44:41.028605] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:41.079250] [DEBUG] [LOCAL ] APD: Loaded 45754 existing records from primary storage. [2025-10-24T00:44:41.079500] [INFO ] [MAIN ] APD: Loaded 45754 primary data records. [2025-10-24T00:44:41.213755] [DEBUG] [LOCAL ] APG: Loaded 50997 existing records from primary storage. [2025-10-24T00:44:41.248574] [INFO ] [MAIN ] APG: Loaded 50997 primary data records. [2025-10-24T00:44:41.322501] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-10-24T00:44:41.390048] [INFO ] [MAIN ] APH: Loaded 54081 primary data records. [2025-10-24T00:44:42.121531] [DEBUG] [MAIN ] APD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:42.173176] [DEBUG] [MAIN ] APG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:42.212014] [DEBUG] [MAIN ] APH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:42.244986] [INFO ] [MAIN ] APD: Generated 139 derivative records from 45754 primary records. [2025-10-24T00:44:42.248667] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-24T00:44:42.253013] [FATAL] [LOCAL ] APD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:42.255110] [FATAL] [MAIN ] APD: Failed to save derivative data. [2025-10-24T00:44:42.257342] [INFO ] [MAIN ] Derivative Progress: 115/2164 symbols completed. APD took 1.2s. Estimated remaining: 13m 57s. Rate: 146.8 symbols/min [2025-10-24T00:44:42.260743] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:42.286885] [INFO ] [MAIN ] APH: Generated 139 derivative records from 54081 primary records. [2025-10-24T00:44:42.287519] [INFO ] [MAIN ] APG: Generated 139 derivative records from 50997 primary records. [2025-10-24T00:44:42.288039] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-24T00:44:42.288201] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-24T00:44:42.288670] [FATAL] [LOCAL ] APG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:42.289103] [FATAL] [LOCAL ] APH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:42.289270] [FATAL] [MAIN ] APG: Failed to save derivative data. [2025-10-24T00:44:42.291969] [FATAL] [MAIN ] APH: Failed to save derivative data. [2025-10-24T00:44:42.291862] [INFO ] [MAIN ] Derivative Progress: 116/2164 symbols completed. APG took 1.3s. Estimated remaining: 13m 50s. Rate: 148.0 symbols/min [2025-10-24T00:44:42.294940] [INFO ] [MAIN ] Derivative Progress: 117/2164 symbols completed. APH took 1.3s. Estimated remaining: 13m 43s. Rate: 149.3 symbols/min [2025-10-24T00:44:42.294844] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:42.295675] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:42.317600] [DEBUG] [LOCAL ] APOS: Loaded 7105 existing records from primary storage. [2025-10-24T00:44:42.318116] [INFO ] [MAIN ] APOS: Loaded 7105 primary data records. [2025-10-24T00:44:42.440815] [DEBUG] [LOCAL ] APLE: Loaded 52333 existing records from primary storage. [2025-10-24T00:44:42.452025] [INFO ] [MAIN ] APLE: Loaded 52333 primary data records. [2025-10-24T00:44:42.779907] [DEBUG] [LOCAL ] APO: Loaded 53775 existing records from primary storage. [2025-10-24T00:44:42.797412] [INFO ] [MAIN ] APO: Loaded 53775 primary data records. [2025-10-24T00:44:43.313911] [DEBUG] [MAIN ] APOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:43.352313] [DEBUG] [MAIN ] APLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:43.446308] [DEBUG] [MAIN ] APO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:43.489567] [INFO ] [MAIN ] APOS: Generated 139 derivative records from 7105 primary records. [2025-10-24T00:44:43.490520] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-24T00:44:43.491047] [FATAL] [LOCAL ] APOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:43.496919] [FATAL] [MAIN ] APOS: Failed to save derivative data. [2025-10-24T00:44:43.508117] [INFO ] [MAIN ] Derivative Progress: 118/2164 symbols completed. APOS took 1.2s. Estimated remaining: 13m 56s. Rate: 146.8 symbols/min [2025-10-24T00:44:43.512180] [INFO ] [MAIN ] APLE: Generated 139 derivative records from 52333 primary records. [2025-10-24T00:44:43.513739] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-24T00:44:43.515426] [INFO ] [MAIN ] APO: Generated 139 derivative records from 53775 primary records. [2025-10-24T00:44:43.515845] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-24T00:44:43.515765] [FATAL] [LOCAL ] APLE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:43.516236] [FATAL] [MAIN ] APLE: Failed to save derivative data. [2025-10-24T00:44:43.516123] [FATAL] [LOCAL ] APO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:43.518680] [FATAL] [MAIN ] APO: Failed to save derivative data. [2025-10-24T00:44:43.518534] [INFO ] [MAIN ] Derivative Progress: 119/2164 symbols completed. APLE took 1.3s. Estimated remaining: 13m 49s. Rate: 148.0 symbols/min [2025-10-24T00:44:43.521357] [INFO ] [MAIN ] Derivative Progress: 120/2164 symbols completed. APO took 1.2s. Estimated remaining: 13m 42s. Rate: 149.2 symbols/min [2025-10-24T00:44:43.521818] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:43.521966] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:43.522450] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:43.529145] [DEBUG] [LOCAL ] AQNB: Loaded 3899 existing records from primary storage. [2025-10-24T00:44:43.529322] [INFO ] [MAIN ] AQNB: Loaded 3899 primary data records. [2025-10-24T00:44:43.877079] [DEBUG] [LOCAL ] AQN: Loaded 52016 existing records from primary storage. [2025-10-24T00:44:43.879794] [INFO ] [MAIN ] AQN: Loaded 52016 primary data records. [2025-10-24T00:44:43.880415] [DEBUG] [LOCAL ] APTV: Loaded 52199 existing records from primary storage. [2025-10-24T00:44:43.911339] [INFO ] [MAIN ] APTV: Loaded 52199 primary data records. [2025-10-24T00:44:44.488729] [DEBUG] [MAIN ] AQNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:44.539528] [DEBUG] [MAIN ] AQN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:44.572246] [DEBUG] [MAIN ] APTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:44.597546] [INFO ] [MAIN ] AQNB: Generated 139 derivative records from 3899 primary records. [2025-10-24T00:44:44.602554] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-24T00:44:44.605275] [FATAL] [LOCAL ] AQNB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:44.605421] [FATAL] [MAIN ] AQNB: Failed to save derivative data. [2025-10-24T00:44:44.608474] [INFO ] [MAIN ] Derivative Progress: 121/2164 symbols completed. AQNB took 1.1s. Estimated remaining: 13m 53s. Rate: 147.1 symbols/min [2025-10-24T00:44:44.609200] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:44.637285] [INFO ] [MAIN ] APTV: Generated 139 derivative records from 52199 primary records. [2025-10-24T00:44:44.652450] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-24T00:44:44.655423] [INFO ] [MAIN ] AQN: Generated 139 derivative records from 52016 primary records. [2025-10-24T00:44:44.655713] [FATAL] [LOCAL ] APTV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:44.655911] [FATAL] [MAIN ] APTV: Failed to save derivative data. [2025-10-24T00:44:44.656006] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-24T00:44:44.659059] [INFO ] [MAIN ] Derivative Progress: 122/2164 symbols completed. APTV took 1.1s. Estimated remaining: 13m 47s. Rate: 148.2 symbols/min [2025-10-24T00:44:44.659673] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:44.660624] [FATAL] [LOCAL ] AQN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:44.660934] [FATAL] [MAIN ] AQN: Failed to save derivative data. [2025-10-24T00:44:44.664087] [INFO ] [MAIN ] Derivative Progress: 123/2164 symbols completed. AQN took 1.1s. Estimated remaining: 13m 40s. Rate: 149.4 symbols/min [2025-10-24T00:44:44.664560] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:44.682160] [DEBUG] [LOCAL ] AR: Loaded 53980 existing records from primary storage. [2025-10-24T00:44:44.682628] [INFO ] [MAIN ] AR: Loaded 53980 primary data records. [2025-10-24T00:44:44.813067] [DEBUG] [LOCAL ] ARDC: Loaded 15301 existing records from primary storage. [2025-10-24T00:44:44.813846] [INFO ] [MAIN ] ARDC: Loaded 15301 primary data records. [2025-10-24T00:44:44.981026] [DEBUG] [LOCAL ] ARCO: Loaded 44509 existing records from primary storage. [2025-10-24T00:44:45.128582] [INFO ] [MAIN ] ARCO: Loaded 44509 primary data records. [2025-10-24T00:44:45.691792] [DEBUG] [MAIN ] AR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:45.727591] [DEBUG] [MAIN ] ARDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:45.784237] [DEBUG] [MAIN ] ARCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:45.831034] [INFO ] [MAIN ] AR: Generated 139 derivative records from 53980 primary records. [2025-10-24T00:44:45.836468] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-24T00:44:45.837116] [FATAL] [LOCAL ] AR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:45.837531] [FATAL] [MAIN ] AR: Failed to save derivative data. [2025-10-24T00:44:45.843707] [INFO ] [MAIN ] Derivative Progress: 124/2164 symbols completed. AR took 1.2s. Estimated remaining: 13m 52s. Rate: 147.1 symbols/min [2025-10-24T00:44:45.844044] [INFO ] [MAIN ] ARDC: Generated 139 derivative records from 15301 primary records. [2025-10-24T00:44:45.848489] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-24T00:44:45.848150] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:45.849698] [FATAL] [LOCAL ] ARDC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:45.849931] [FATAL] [MAIN ] ARDC: Failed to save derivative data. [2025-10-24T00:44:45.853031] [INFO ] [MAIN ] Derivative Progress: 125/2164 symbols completed. ARDC took 1.2s. Estimated remaining: 13m 45s. Rate: 148.3 symbols/min [2025-10-24T00:44:45.854751] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:45.874307] [INFO ] [MAIN ] ARCO: Generated 139 derivative records from 44509 primary records. [2025-10-24T00:44:45.874717] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-24T00:44:45.875071] [FATAL] [LOCAL ] ARCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:45.875474] [FATAL] [MAIN ] ARCO: Failed to save derivative data. [2025-10-24T00:44:45.879279] [INFO ] [MAIN ] Derivative Progress: 126/2164 symbols completed. ARCO took 1.2s. Estimated remaining: 13m 39s. Rate: 149.4 symbols/min [2025-10-24T00:44:45.879569] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:45.896631] [DEBUG] [LOCAL ] ARDT: Loaded 27612 existing records from primary storage. [2025-10-24T00:44:45.896895] [INFO ] [MAIN ] ARDT: Loaded 27612 primary data records. [2025-10-24T00:44:46.122999] [DEBUG] [LOCAL ] ARE: Loaded 51277 existing records from primary storage. [2025-10-24T00:44:46.238021] [INFO ] [MAIN ] ARE: Loaded 51277 primary data records. [2025-10-24T00:44:46.367583] [DEBUG] [LOCAL ] ARES: Loaded 50046 existing records from primary storage. [2025-10-24T00:44:46.408588] [INFO ] [MAIN ] ARES: Loaded 50046 primary data records. [2025-10-24T00:44:46.748110] [DEBUG] [MAIN ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:47.005210] [DEBUG] [MAIN ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:47.036980] [INFO ] [MAIN ] ARDT: Generated 139 derivative records from 27612 primary records. [2025-10-24T00:44:47.039547] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-24T00:44:47.042334] [FATAL] [LOCAL ] ARDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:47.046375] [FATAL] [MAIN ] ARDT: Failed to save derivative data. [2025-10-24T00:44:47.062705] [INFO ] [MAIN ] Derivative Progress: 127/2164 symbols completed. ARDT took 1.2s. Estimated remaining: 13m 51s. Rate: 147.1 symbols/min [2025-10-24T00:44:47.063162] [DEBUG] [MAIN ] ARES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:47.063294] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:47.099437] [INFO ] [MAIN ] ARE: Generated 139 derivative records from 51277 primary records. [2025-10-24T00:44:47.100180] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-24T00:44:47.102840] [FATAL] [LOCAL ] ARE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:47.102989] [FATAL] [MAIN ] ARE: Failed to save derivative data. [2025-10-24T00:44:47.105323] [INFO ] [MAIN ] Derivative Progress: 128/2164 symbols completed. ARE took 1.3s. Estimated remaining: 13m 45s. Rate: 148.2 symbols/min [2025-10-24T00:44:47.108138] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:47.134038] [INFO ] [MAIN ] ARES: Generated 139 derivative records from 50046 primary records. [2025-10-24T00:44:47.137840] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-24T00:44:47.138502] [FATAL] [LOCAL ] ARES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:47.151341] [FATAL] [MAIN ] ARES: Failed to save derivative data. [2025-10-24T00:44:47.154418] [INFO ] [MAIN ] Derivative Progress: 129/2164 symbols completed. ARES took 1.3s. Estimated remaining: 13m 38s. Rate: 149.2 symbols/min [2025-10-24T00:44:47.155530] [DEBUG] [LOCAL ] ARI: Loaded 43804 existing records from primary storage. [2025-10-24T00:44:47.155735] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:47.155988] [INFO ] [MAIN ] ARI: Loaded 43804 primary data records. [2025-10-24T00:44:47.339984] [DEBUG] [LOCAL ] ARLO: Loaded 43851 existing records from primary storage. [2025-10-24T00:44:47.366892] [INFO ] [MAIN ] ARLO: Loaded 43851 primary data records. [2025-10-24T00:44:47.609977] [DEBUG] [LOCAL ] ARMK: Loaded 50743 existing records from primary storage. [2025-10-24T00:44:47.623613] [INFO ] [MAIN ] ARMK: Loaded 50743 primary data records. [2025-10-24T00:44:48.174892] [DEBUG] [MAIN ] ARI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:48.228952] [DEBUG] [MAIN ] ARLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:48.252908] [INFO ] [MAIN ] ARI: Generated 139 derivative records from 43804 primary records. [2025-10-24T00:44:48.255675] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-24T00:44:48.271947] [FATAL] [LOCAL ] ARI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:48.272828] [FATAL] [MAIN ] ARI: Failed to save derivative data. [2025-10-24T00:44:48.276005] [INFO ] [MAIN ] Derivative Progress: 130/2164 symbols completed. ARI took 1.2s. Estimated remaining: 13m 49s. Rate: 147.2 symbols/min [2025-10-24T00:44:48.273094] [DEBUG] [MAIN ] ARMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:48.280372] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:48.324395] [INFO ] [MAIN ] ARLO: Generated 139 derivative records from 43851 primary records. [2025-10-24T00:44:48.327040] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-24T00:44:48.330095] [FATAL] [LOCAL ] ARLO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:48.330278] [FATAL] [MAIN ] ARLO: Failed to save derivative data. [2025-10-24T00:44:48.333306] [INFO ] [MAIN ] Derivative Progress: 131/2164 symbols completed. ARLO took 1.2s. Estimated remaining: 13m 43s. Rate: 148.1 symbols/min [2025-10-24T00:44:48.346446] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:48.354435] [INFO ] [MAIN ] ARMK: Generated 139 derivative records from 50743 primary records. [2025-10-24T00:44:48.354756] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-24T00:44:48.355127] [FATAL] [LOCAL ] ARMK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:48.355217] [FATAL] [MAIN ] ARMK: Failed to save derivative data. [2025-10-24T00:44:48.357917] [INFO ] [MAIN ] Derivative Progress: 132/2164 symbols completed. ARMK took 1.2s. Estimated remaining: 13m 37s. Rate: 149.2 symbols/min [2025-10-24T00:44:48.358428] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:48.375742] [DEBUG] [LOCAL ] AROC: Loaded 49443 existing records from primary storage. [2025-10-24T00:44:48.376374] [INFO ] [MAIN ] AROC: Loaded 49443 primary data records. [2025-10-24T00:44:48.606938] [DEBUG] [LOCAL ] ARW: Loaded 33415 existing records from primary storage. [2025-10-24T00:44:48.737886] [INFO ] [MAIN ] ARW: Loaded 33415 primary data records. [2025-10-24T00:44:48.738976] [DEBUG] [LOCAL ] ARR: Loaded 52475 existing records from primary storage. [2025-10-24T00:44:48.744773] [INFO ] [MAIN ] ARR: Loaded 52475 primary data records. [2025-10-24T00:44:49.399535] [DEBUG] [MAIN ] AROC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:49.475784] [DEBUG] [MAIN ] ARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:49.478755] [INFO ] [MAIN ] AROC: Generated 139 derivative records from 49443 primary records. [2025-10-24T00:44:49.478234] [DEBUG] [MAIN ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:49.490568] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-24T00:44:49.507537] [FATAL] [LOCAL ] AROC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:49.511582] [FATAL] [MAIN ] AROC: Failed to save derivative data. [2025-10-24T00:44:49.513893] [INFO ] [MAIN ] Derivative Progress: 133/2164 symbols completed. AROC took 1.2s. Estimated remaining: 13m 48s. Rate: 147.1 symbols/min [2025-10-24T00:44:49.544042] [INFO ] [MAIN ] ARW: Generated 139 derivative records from 33415 primary records. [2025-10-24T00:44:49.545631] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-24T00:44:49.545972] [FATAL] [LOCAL ] ARW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:49.546043] [FATAL] [MAIN ] ARW: Failed to save derivative data. [2025-10-24T00:44:49.550032] [INFO ] [MAIN ] Derivative Progress: 134/2164 symbols completed. ARW took 1.2s. Estimated remaining: 13m 42s. Rate: 148.1 symbols/min [2025-10-24T00:44:49.558612] [INFO ] [MAIN ] ARR: Generated 139 derivative records from 52475 primary records. [2025-10-24T00:44:49.558788] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-24T00:44:49.559031] [FATAL] [LOCAL ] ARR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:49.559102] [FATAL] [MAIN ] ARR: Failed to save derivative data. [2025-10-24T00:44:49.561771] [INFO ] [MAIN ] Derivative Progress: 135/2164 symbols completed. ARR took 1.2s. Estimated remaining: 13m 36s. Rate: 149.2 symbols/min [2025-10-24T00:44:49.562185] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:49.562265] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:49.562358] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:49.585420] [DEBUG] [LOCAL ] ASA: Loaded 15779 existing records from primary storage. [2025-10-24T00:44:49.585667] [INFO ] [MAIN ] ASA: Loaded 15779 primary data records. [2025-10-24T00:44:50.007816] [DEBUG] [LOCAL ] ASAN: Loaded 53116 existing records from primary storage. [2025-10-24T00:44:50.008329] [INFO ] [MAIN ] ASAN: Loaded 53116 primary data records. [2025-10-24T00:44:50.009481] [DEBUG] [LOCAL ] AS: Loaded 53587 existing records from primary storage. [2025-10-24T00:44:50.009787] [INFO ] [MAIN ] AS: Loaded 53587 primary data records. [2025-10-24T00:44:50.635137] [DEBUG] [MAIN ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:50.693492] [DEBUG] [MAIN ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:50.727594] [DEBUG] [MAIN ] AS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:50.746258] [INFO ] [MAIN ] ASA: Generated 139 derivative records from 15779 primary records. [2025-10-24T00:44:50.748934] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-24T00:44:50.749835] [FATAL] [LOCAL ] ASA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:50.753793] [FATAL] [MAIN ] ASA: Failed to save derivative data. [2025-10-24T00:44:50.760683] [INFO ] [MAIN ] Derivative Progress: 136/2164 symbols completed. ASA took 1.2s. Estimated remaining: 13m 47s. Rate: 147.1 symbols/min [2025-10-24T00:44:50.764924] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:50.800369] [INFO ] [MAIN ] ASAN: Generated 139 derivative records from 53116 primary records. [2025-10-24T00:44:50.803431] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-24T00:44:50.804082] [FATAL] [LOCAL ] ASAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:50.803725] [INFO ] [MAIN ] AS: Generated 139 derivative records from 53587 primary records. [2025-10-24T00:44:50.815176] [FATAL] [MAIN ] ASAN: Failed to save derivative data. [2025-10-24T00:44:50.819059] [INFO ] [MAIN ] Derivative Progress: 137/2164 symbols completed. ASAN took 1.3s. Estimated remaining: 13m 42s. Rate: 148.0 symbols/min [2025-10-24T00:44:50.815298] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-24T00:44:50.819447] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:50.819879] [FATAL] [LOCAL ] AS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:50.820566] [FATAL] [MAIN ] AS: Failed to save derivative data. [2025-10-24T00:44:50.824133] [INFO ] [MAIN ] Derivative Progress: 138/2164 symbols completed. AS took 1.3s. Estimated remaining: 13m 36s. Rate: 149.0 symbols/min [2025-10-24T00:44:50.824465] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:50.830024] [DEBUG] [LOCAL ] ASBA: Loaded 3490 existing records from primary storage. [2025-10-24T00:44:50.830937] [INFO ] [MAIN ] ASBA: Loaded 3490 primary data records. [2025-10-24T00:44:50.882007] [DEBUG] [LOCAL ] ASB: Loaded 50074 existing records from primary storage. [2025-10-24T00:44:50.904427] [INFO ] [MAIN ] ASB: Loaded 50074 primary data records. [2025-10-24T00:44:51.249043] [DEBUG] [LOCAL ] ASC: Loaded 37473 existing records from primary storage. [2025-10-24T00:44:51.464472] [INFO ] [MAIN ] ASC: Loaded 37473 primary data records. [2025-10-24T00:44:51.933548] [DEBUG] [MAIN ] ASBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:51.962171] [DEBUG] [MAIN ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:52.033697] [DEBUG] [MAIN ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:52.065588] [INFO ] [MAIN ] ASB: Generated 139 derivative records from 50074 primary records. [2025-10-24T00:44:52.070632] [INFO ] [MAIN ] ASBA: Generated 139 derivative records from 3490 primary records. [2025-10-24T00:44:52.070768] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-24T00:44:52.072964] [FATAL] [LOCAL ] ASB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:52.073129] [FATAL] [MAIN ] ASB: Failed to save derivative data. [2025-10-24T00:44:52.071353] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-24T00:44:52.073845] [FATAL] [LOCAL ] ASBA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:52.078497] [INFO ] [MAIN ] Derivative Progress: 139/2164 symbols completed. ASB took 1.3s. Estimated remaining: 13m 48s. Rate: 146.8 symbols/min [2025-10-24T00:44:52.078875] [FATAL] [MAIN ] ASBA: Failed to save derivative data. [2025-10-24T00:44:52.079075] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:52.084097] [INFO ] [MAIN ] Derivative Progress: 140/2164 symbols completed. ASBA took 1.3s. Estimated remaining: 13m 41s. Rate: 147.9 symbols/min [2025-10-24T00:44:52.084423] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:52.110360] [INFO ] [MAIN ] ASC: Generated 139 derivative records from 37473 primary records. [2025-10-24T00:44:52.117871] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-24T00:44:52.118904] [FATAL] [LOCAL ] ASC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:52.119060] [FATAL] [MAIN ] ASC: Failed to save derivative data. [2025-10-24T00:44:52.118392] [DEBUG] [LOCAL ] ASG: Loaded 19473 existing records from primary storage. [2025-10-24T00:44:52.130397] [INFO ] [MAIN ] Derivative Progress: 141/2164 symbols completed. ASC took 1.3s. Estimated remaining: 13m 36s. Rate: 148.8 symbols/min [2025-10-24T00:44:52.130835] [INFO ] [MAIN ] ASG: Loaded 19473 primary data records. [2025-10-24T00:44:52.131035] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:52.132705] [DEBUG] [LOCAL ] ASGI: Loaded 23093 existing records from primary storage. [2025-10-24T00:44:52.133295] [INFO ] [MAIN ] ASGI: Loaded 23093 primary data records. [2025-10-24T00:44:52.543520] [DEBUG] [LOCAL ] ASGN: Loaded 37036 existing records from primary storage. [2025-10-24T00:44:52.566112] [INFO ] [MAIN ] ASGN: Loaded 37036 primary data records. [2025-10-24T00:44:53.162177] [DEBUG] [MAIN ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:53.163261] [DEBUG] [MAIN ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:53.223173] [DEBUG] [MAIN ] ASGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:53.261538] [INFO ] [MAIN ] ASGI: Generated 139 derivative records from 23093 primary records. [2025-10-24T00:44:53.263981] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-24T00:44:53.264291] [FATAL] [LOCAL ] ASGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:53.264404] [FATAL] [MAIN ] ASGI: Failed to save derivative data. [2025-10-24T00:44:53.268864] [INFO ] [MAIN ] Derivative Progress: 142/2164 symbols completed. ASGI took 1.2s. Estimated remaining: 13m 46s. Rate: 146.9 symbols/min [2025-10-24T00:44:53.270168] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:53.272409] [INFO ] [MAIN ] ASG: Generated 139 derivative records from 19473 primary records. [2025-10-24T00:44:53.274349] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-24T00:44:53.274737] [FATAL] [LOCAL ] ASG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:53.275162] [FATAL] [MAIN ] ASG: Failed to save derivative data. [2025-10-24T00:44:53.279981] [INFO ] [MAIN ] Derivative Progress: 143/2164 symbols completed. ASG took 1.2s. Estimated remaining: 13m 40s. Rate: 147.9 symbols/min [2025-10-24T00:44:53.280478] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:53.290553] [INFO ] [MAIN ] ASGN: Generated 139 derivative records from 37036 primary records. [2025-10-24T00:44:53.290925] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-24T00:44:53.291239] [FATAL] [LOCAL ] ASGN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:53.291398] [FATAL] [MAIN ] ASGN: Failed to save derivative data. [2025-10-24T00:44:53.294129] [INFO ] [MAIN ] Derivative Progress: 144/2164 symbols completed. ASGN took 1.2s. Estimated remaining: 13m 34s. Rate: 148.9 symbols/min [2025-10-24T00:44:53.294459] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:53.318524] [DEBUG] [LOCAL ] ASIX: Loaded 23134 existing records from primary storage. [2025-10-24T00:44:53.318725] [INFO ] [MAIN ] ASIX: Loaded 23134 primary data records. [2025-10-24T00:44:53.483572] [DEBUG] [LOCAL ] ASH: Loaded 37640 existing records from primary storage. [2025-10-24T00:44:53.536963] [INFO ] [MAIN ] ASH: Loaded 37640 primary data records. [2025-10-24T00:44:53.650859] [DEBUG] [LOCAL ] ASPN: Loaded 50218 existing records from primary storage. [2025-10-24T00:44:53.694688] [INFO ] [MAIN ] ASPN: Loaded 50218 primary data records. [2025-10-24T00:44:54.309678] [DEBUG] [MAIN ] ASIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:54.354911] [DEBUG] [MAIN ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:54.397853] [DEBUG] [MAIN ] ASPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:54.416792] [INFO ] [MAIN ] ASIX: Generated 139 derivative records from 23134 primary records. [2025-10-24T00:44:54.421259] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-24T00:44:54.421604] [FATAL] [LOCAL ] ASIX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:54.421733] [FATAL] [MAIN ] ASIX: Failed to save derivative data. [2025-10-24T00:44:54.429409] [INFO ] [MAIN ] Derivative Progress: 145/2164 symbols completed. ASIX took 1.1s. Estimated remaining: 13m 44s. Rate: 147.1 symbols/min [2025-10-24T00:44:54.431177] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:54.458518] [DEBUG] [LOCAL ] ASR: Loaded 9477 existing records from primary storage. [2025-10-24T00:44:54.459092] [INFO ] [MAIN ] ASR: Loaded 9477 primary data records. [2025-10-24T00:44:54.495437] [INFO ] [MAIN ] ASH: Generated 139 derivative records from 37640 primary records. [2025-10-24T00:44:54.540436] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-24T00:44:54.551049] [FATAL] [LOCAL ] ASH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:54.556635] [FATAL] [MAIN ] ASH: Failed to save derivative data. [2025-10-24T00:44:54.566478] [INFO ] [MAIN ] Derivative Progress: 146/2164 symbols completed. ASH took 1.3s. Estimated remaining: 13m 40s. Rate: 147.7 symbols/min [2025-10-24T00:44:54.572502] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:54.578615] [INFO ] [MAIN ] ASPN: Generated 139 derivative records from 50218 primary records. [2025-10-24T00:44:54.589323] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-24T00:44:54.600142] [FATAL] [LOCAL ] ASPN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:54.600245] [FATAL] [MAIN ] ASPN: Failed to save derivative data. [2025-10-24T00:44:54.624866] [INFO ] [MAIN ] Derivative Progress: 147/2164 symbols completed. ASPN took 1.3s. Estimated remaining: 13m 34s. Rate: 148.6 symbols/min [2025-10-24T00:44:54.633849] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:54.842832] [DEBUG] [LOCAL ] ASX: Loaded 53258 existing records from primary storage. [2025-10-24T00:44:54.843517] [INFO ] [MAIN ] ASX: Loaded 53258 primary data records. [2025-10-24T00:44:54.843173] [DEBUG] [MAIN ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:54.929050] [DEBUG] [LOCAL ] ATEN: Loaded 37929 existing records from primary storage. [2025-10-24T00:44:54.970934] [INFO ] [MAIN ] ATEN: Loaded 37929 primary data records. [2025-10-24T00:44:55.519944] [INFO ] [MAIN ] ASR: Generated 139 derivative records from 9477 primary records. [2025-10-24T00:44:55.521215] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-24T00:44:55.523743] [FATAL] [LOCAL ] ASR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:55.525003] [FATAL] [MAIN ] ASR: Failed to save derivative data. [2025-10-24T00:44:55.530181] [INFO ] [MAIN ] Derivative Progress: 148/2164 symbols completed. ASR took 1.1s. Estimated remaining: 13m 41s. Rate: 147.4 symbols/min [2025-10-24T00:44:55.550372] [DEBUG] [MAIN ] ASX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:55.592751] [DEBUG] [MAIN ] ATEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:55.629492] [INFO ] [MAIN ] ASX: Generated 139 derivative records from 53258 primary records. [2025-10-24T00:44:55.632054] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-24T00:44:55.632575] [FATAL] [LOCAL ] ASX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:55.632986] [FATAL] [MAIN ] ASX: Failed to save derivative data. [2025-10-24T00:44:55.636014] [INFO ] [MAIN ] Derivative Progress: 149/2164 symbols completed. ASX took 1.1s. Estimated remaining: 13m 36s. Rate: 148.1 symbols/min [2025-10-24T00:44:55.640531] [INFO ] [MAIN ] ATEN: Generated 139 derivative records from 37929 primary records. [2025-10-24T00:44:55.640684] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-24T00:44:55.640902] [FATAL] [LOCAL ] ATEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:55.640982] [FATAL] [MAIN ] ATEN: Failed to save derivative data. [2025-10-24T00:44:55.643905] [INFO ] [MAIN ] Derivative Progress: 150/2164 symbols completed. ATEN took 1.0s. Estimated remaining: 13m 31s. Rate: 149.1 symbols/min [2025-10-24T00:44:55.644525] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:55.644462] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:55.644597] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:55.656745] [DEBUG] [LOCAL ] ATHS: Loaded 6531 existing records from primary storage. [2025-10-24T00:44:55.657113] [INFO ] [MAIN ] ATHS: Loaded 6531 primary data records. [2025-10-24T00:44:55.860035] [DEBUG] [LOCAL ] ATHM: Loaded 31467 existing records from primary storage. [2025-10-24T00:44:55.866233] [INFO ] [MAIN ] ATHM: Loaded 31467 primary data records. [2025-10-24T00:44:56.095264] [DEBUG] [LOCAL ] ATGE: Loaded 30576 existing records from primary storage. [2025-10-24T00:44:56.125028] [INFO ] [MAIN ] ATGE: Loaded 30576 primary data records. [2025-10-24T00:44:56.857840] [DEBUG] [MAIN ] ATHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:56.938607] [DEBUG] [MAIN ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:56.941922] [INFO ] [MAIN ] ATHS: Generated 139 derivative records from 6531 primary records. [2025-10-24T00:44:56.957691] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-24T00:44:56.958306] [FATAL] [LOCAL ] ATHS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:56.960523] [FATAL] [MAIN ] ATHS: Failed to save derivative data. [2025-10-24T00:44:56.965598] [INFO ] [MAIN ] Derivative Progress: 151/2164 symbols completed. ATHS took 1.3s. Estimated remaining: 13m 42s. Rate: 146.9 symbols/min [2025-10-24T00:44:56.969032] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:56.982948] [DEBUG] [MAIN ] ATGE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:57.038064] [INFO ] [MAIN ] ATHM: Generated 139 derivative records from 31467 primary records. [2025-10-24T00:44:57.041767] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-24T00:44:57.043363] [FATAL] [LOCAL ] ATHM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:57.043472] [FATAL] [MAIN ] ATHM: Failed to save derivative data. [2025-10-24T00:44:57.065344] [INFO ] [MAIN ] Derivative Progress: 152/2164 symbols completed. ATHM took 1.4s. Estimated remaining: 13m 38s. Rate: 147.6 symbols/min [2025-10-24T00:44:57.068864] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:57.072955] [INFO ] [MAIN ] ATGE: Generated 139 derivative records from 30576 primary records. [2025-10-24T00:44:57.073126] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-24T00:44:57.073331] [FATAL] [LOCAL ] ATGE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:57.073408] [FATAL] [MAIN ] ATGE: Failed to save derivative data. [2025-10-24T00:44:57.076167] [INFO ] [MAIN ] Derivative Progress: 153/2164 symbols completed. ATGE took 1.4s. Estimated remaining: 13m 32s. Rate: 148.5 symbols/min [2025-10-24T00:44:57.076523] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:57.100818] [DEBUG] [LOCAL ] ATI: Loaded 51668 existing records from primary storage. [2025-10-24T00:44:57.101363] [INFO ] [MAIN ] ATI: Loaded 51668 primary data records. [2025-10-24T00:44:57.273680] [DEBUG] [LOCAL ] ATKR: Loaded 35023 existing records from primary storage. [2025-10-24T00:44:57.430221] [INFO ] [MAIN ] ATKR: Loaded 35023 primary data records. [2025-10-24T00:44:57.486634] [DEBUG] [LOCAL ] ATMU: Loaded 38930 existing records from primary storage. [2025-10-24T00:44:57.499839] [INFO ] [MAIN ] ATMU: Loaded 38930 primary data records. [2025-10-24T00:44:58.130350] [DEBUG] [MAIN ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:58.172415] [DEBUG] [MAIN ] ATKR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:44:58.216080] [DEBUG] [MAIN ] ATMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:58.265869] [INFO ] [MAIN ] ATI: Generated 139 derivative records from 51668 primary records. [2025-10-24T00:44:58.270820] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-24T00:44:58.273959] [FATAL] [LOCAL ] ATI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:58.274312] [FATAL] [MAIN ] ATI: Failed to save derivative data. [2025-10-24T00:44:58.276670] [INFO ] [MAIN ] Derivative Progress: 154/2164 symbols completed. ATI took 1.3s. Estimated remaining: 13m 42s. Rate: 146.7 symbols/min [2025-10-24T00:44:58.278626] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:58.281890] [INFO ] [MAIN ] ATKR: Generated 139 derivative records from 35023 primary records. [2025-10-24T00:44:58.282097] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-24T00:44:58.282392] [FATAL] [LOCAL ] ATKR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:58.286306] [FATAL] [MAIN ] ATKR: Failed to save derivative data. [2025-10-24T00:44:58.289060] [INFO ] [MAIN ] Derivative Progress: 155/2164 symbols completed. ATKR took 1.2s. Estimated remaining: 13m 37s. Rate: 147.6 symbols/min [2025-10-24T00:44:58.289303] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:58.300037] [INFO ] [MAIN ] ATMU: Generated 139 derivative records from 38930 primary records. [2025-10-24T00:44:58.300357] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-24T00:44:58.300683] [FATAL] [LOCAL ] ATMU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:58.300783] [FATAL] [MAIN ] ATMU: Failed to save derivative data. [2025-10-24T00:44:58.303340] [INFO ] [MAIN ] Derivative Progress: 156/2164 symbols completed. ATMU took 1.2s. Estimated remaining: 13m 31s. Rate: 148.5 symbols/min [2025-10-24T00:44:58.303550] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:58.338165] [DEBUG] [LOCAL ] ATS: Loaded 17109 existing records from primary storage. [2025-10-24T00:44:58.338324] [INFO ] [MAIN ] ATS: Loaded 17109 primary data records. [2025-10-24T00:44:58.461437] [DEBUG] [LOCAL ] ATR: Loaded 30587 existing records from primary storage. [2025-10-24T00:44:58.462571] [DEBUG] [LOCAL ] ATO: Loaded 41787 existing records from primary storage. [2025-10-24T00:44:58.463008] [INFO ] [MAIN ] ATR: Loaded 30587 primary data records. [2025-10-24T00:44:58.463085] [INFO ] [MAIN ] ATO: Loaded 41787 primary data records. [2025-10-24T00:44:59.317983] [DEBUG] [MAIN ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:59.366997] [DEBUG] [MAIN ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:59.394828] [DEBUG] [MAIN ] ATR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:44:59.449295] [INFO ] [MAIN ] ATS: Generated 139 derivative records from 17109 primary records. [2025-10-24T00:44:59.451957] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-24T00:44:59.460310] [FATAL] [LOCAL ] ATS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:59.460468] [FATAL] [MAIN ] ATS: Failed to save derivative data. [2025-10-24T00:44:59.462795] [INFO ] [MAIN ] Derivative Progress: 157/2164 symbols completed. ATS took 1.2s. Estimated remaining: 13m 41s. Rate: 146.7 symbols/min [2025-10-24T00:44:59.464638] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:59.483189] [INFO ] [MAIN ] ATR: Generated 139 derivative records from 30587 primary records. [2025-10-24T00:44:59.487541] [INFO ] [MAIN ] ATO: Generated 139 derivative records from 41787 primary records. [2025-10-24T00:44:59.485351] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-24T00:44:59.488001] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-24T00:44:59.488527] [FATAL] [LOCAL ] ATR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:59.488929] [FATAL] [LOCAL ] ATO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:44:59.489272] [FATAL] [MAIN ] ATR: Failed to save derivative data. [2025-10-24T00:44:59.491997] [INFO ] [MAIN ] Derivative Progress: 158/2164 symbols completed. ATR took 1.2s. Estimated remaining: 13m 35s. Rate: 147.6 symbols/min [2025-10-24T00:44:59.492180] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:59.489370] [FATAL] [MAIN ] ATO: Failed to save derivative data. [2025-10-24T00:44:59.495272] [INFO ] [MAIN ] Derivative Progress: 159/2164 symbols completed. ATO took 1.2s. Estimated remaining: 13m 30s. Rate: 148.5 symbols/min [2025-10-24T00:44:59.496185] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:44:59.533886] [DEBUG] [LOCAL ] ATUS: Loaded 50328 existing records from primary storage. [2025-10-24T00:44:59.534835] [INFO ] [MAIN ] ATUS: Loaded 50328 primary data records. [2025-10-24T00:44:59.705689] [DEBUG] [LOCAL ] AUB: Loaded 46182 existing records from primary storage. [2025-10-24T00:44:59.728152] [INFO ] [MAIN ] AUB: Loaded 46182 primary data records. [2025-10-24T00:44:59.712613] [DEBUG] [LOCAL ] AU: Loaded 53478 existing records from primary storage. [2025-10-24T00:44:59.766717] [INFO ] [MAIN ] AU: Loaded 53478 primary data records. [2025-10-24T00:45:00.570115] [DEBUG] [MAIN ] ATUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:00.611912] [DEBUG] [MAIN ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:00.658774] [DEBUG] [MAIN ] AU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:00.696356] [INFO ] [MAIN ] ATUS: Generated 139 derivative records from 50328 primary records. [2025-10-24T00:45:00.701548] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-24T00:45:00.706492] [FATAL] [LOCAL ] ATUS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:00.707042] [FATAL] [MAIN ] ATUS: Failed to save derivative data. [2025-10-24T00:45:00.710296] [INFO ] [MAIN ] Derivative Progress: 160/2164 symbols completed. ATUS took 1.2s. Estimated remaining: 13m 40s. Rate: 146.7 symbols/min [2025-10-24T00:45:00.714982] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:00.733079] [DEBUG] [LOCAL ] AUNA: Loaded 5285 existing records from primary storage. [2025-10-24T00:45:00.726209] [INFO ] [MAIN ] AUB: Generated 139 derivative records from 46182 primary records. [2025-10-24T00:45:00.733621] [INFO ] [MAIN ] AUNA: Loaded 5285 primary data records. [2025-10-24T00:45:00.734825] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-24T00:45:00.735384] [FATAL] [LOCAL ] AUB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:00.747520] [FATAL] [MAIN ] AUB: Failed to save derivative data. [2025-10-24T00:45:00.771139] [INFO ] [MAIN ] Derivative Progress: 161/2164 symbols completed. AUB took 1.3s. Estimated remaining: 13m 35s. Rate: 147.5 symbols/min [2025-10-24T00:45:00.785965] [INFO ] [MAIN ] AU: Generated 139 derivative records from 53478 primary records. [2025-10-24T00:45:00.786221] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:00.791605] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-24T00:45:00.821135] [FATAL] [LOCAL ] AU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:00.826462] [FATAL] [MAIN ] AU: Failed to save derivative data. [2025-10-24T00:45:00.829398] [INFO ] [MAIN ] Derivative Progress: 162/2164 symbols completed. AU took 1.3s. Estimated remaining: 13m 30s. Rate: 148.3 symbols/min [2025-10-24T00:45:00.829708] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:00.910345] [DEBUG] [LOCAL ] AVAL: Loaded 8525 existing records from primary storage. [2025-10-24T00:45:00.956067] [INFO ] [MAIN ] AVAL: Loaded 8525 primary data records. [2025-10-24T00:45:01.215794] [DEBUG] [LOCAL ] AVA: Loaded 38535 existing records from primary storage. [2025-10-24T00:45:01.218284] [INFO ] [MAIN ] AVA: Loaded 38535 primary data records. [2025-10-24T00:45:01.752133] [DEBUG] [MAIN ] AUNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:01.796966] [DEBUG] [MAIN ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:01.847592] [DEBUG] [MAIN ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:01.848459] [INFO ] [MAIN ] AUNA: Generated 139 derivative records from 5285 primary records. [2025-10-24T00:45:01.862986] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-24T00:45:01.865690] [FATAL] [LOCAL ] AUNA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:01.866086] [FATAL] [MAIN ] AUNA: Failed to save derivative data. [2025-10-24T00:45:01.868729] [INFO ] [MAIN ] Derivative Progress: 163/2164 symbols completed. AUNA took 1.2s. Estimated remaining: 13m 38s. Rate: 146.9 symbols/min [2025-10-24T00:45:01.886433] [INFO ] [MAIN ] AVAL: Generated 139 derivative records from 8525 primary records. [2025-10-24T00:45:01.887593] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-24T00:45:01.888090] [FATAL] [LOCAL ] AVAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:01.890709] [FATAL] [MAIN ] AVAL: Failed to save derivative data. [2025-10-24T00:45:01.893123] [INFO ] [MAIN ] Derivative Progress: 164/2164 symbols completed. AVAL took 1.1s. Estimated remaining: 13m 32s. Rate: 147.7 symbols/min [2025-10-24T00:45:01.898978] [INFO ] [MAIN ] AVA: Generated 139 derivative records from 38535 primary records. [2025-10-24T00:45:01.899071] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-24T00:45:01.899273] [FATAL] [LOCAL ] AVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:01.899352] [FATAL] [MAIN ] AVA: Failed to save derivative data. [2025-10-24T00:45:01.901898] [INFO ] [MAIN ] Derivative Progress: 165/2164 symbols completed. AVA took 1.1s. Estimated remaining: 13m 27s. Rate: 148.6 symbols/min [2025-10-24T00:45:01.902441] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:01.902577] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:01.902621] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:01.936450] [DEBUG] [LOCAL ] AVK: Loaded 18738 existing records from primary storage. [2025-10-24T00:45:01.936064] [DEBUG] [LOCAL ] AVD: Loaded 21435 existing records from primary storage. [2025-10-24T00:45:01.936693] [INFO ] [MAIN ] AVK: Loaded 18738 primary data records. [2025-10-24T00:45:01.936826] [INFO ] [MAIN ] AVD: Loaded 21435 primary data records. [2025-10-24T00:45:02.199034] [DEBUG] [LOCAL ] AVB: Loaded 42433 existing records from primary storage. [2025-10-24T00:45:02.287225] [INFO ] [MAIN ] AVB: Loaded 42433 primary data records. [2025-10-24T00:45:02.967266] [DEBUG] [MAIN ] AVD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:02.999845] [DEBUG] [MAIN ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:03.054882] [DEBUG] [MAIN ] AVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:03.088330] [INFO ] [MAIN ] AVD: Generated 139 derivative records from 21435 primary records. [2025-10-24T00:45:03.093893] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-24T00:45:03.096376] [INFO ] [MAIN ] AVK: Generated 139 derivative records from 18738 primary records. [2025-10-24T00:45:03.096519] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-24T00:45:03.098103] [FATAL] [LOCAL ] AVK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:03.097611] [FATAL] [LOCAL ] AVD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:03.098517] [FATAL] [MAIN ] AVK: Failed to save derivative data. [2025-10-24T00:45:03.098631] [FATAL] [MAIN ] AVD: Failed to save derivative data. [2025-10-24T00:45:03.103619] [INFO ] [MAIN ] Derivative Progress: 166/2164 symbols completed. AVK took 1.2s. Estimated remaining: 13m 36s. Rate: 146.8 symbols/min [2025-10-24T00:45:03.108177] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:03.108415] [INFO ] [MAIN ] Derivative Progress: 167/2164 symbols completed. AVD took 1.2s. Estimated remaining: 13m 31s. Rate: 147.7 symbols/min [2025-10-24T00:45:03.112956] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:03.116689] [INFO ] [MAIN ] AVB: Generated 139 derivative records from 42433 primary records. [2025-10-24T00:45:03.116847] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-24T00:45:03.117053] [FATAL] [LOCAL ] AVB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:03.117130] [FATAL] [MAIN ] AVB: Failed to save derivative data. [2025-10-24T00:45:03.120079] [INFO ] [MAIN ] Derivative Progress: 168/2164 symbols completed. AVB took 1.2s. Estimated remaining: 13m 26s. Rate: 148.6 symbols/min [2025-10-24T00:45:03.120396] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:03.174551] [DEBUG] [LOCAL ] AVNS: Loaded 33758 existing records from primary storage. [2025-10-24T00:45:03.176276] [DEBUG] [LOCAL ] AVNT: Loaded 38855 existing records from primary storage. [2025-10-24T00:45:03.176684] [INFO ] [MAIN ] AVNS: Loaded 33758 primary data records. [2025-10-24T00:45:03.177000] [INFO ] [MAIN ] AVNT: Loaded 38855 primary data records. [2025-10-24T00:45:03.445923] [DEBUG] [LOCAL ] AVTR: Loaded 53961 existing records from primary storage. [2025-10-24T00:45:03.480906] [INFO ] [MAIN ] AVTR: Loaded 53961 primary data records. [2025-10-24T00:45:04.181291] [DEBUG] [MAIN ] AVNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:04.210551] [DEBUG] [MAIN ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:04.245347] [DEBUG] [MAIN ] AVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:04.302300] [INFO ] [MAIN ] AVNT: Generated 139 derivative records from 38855 primary records. [2025-10-24T00:45:04.307218] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-24T00:45:04.308297] [FATAL] [LOCAL ] AVNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:04.308458] [FATAL] [MAIN ] AVNT: Failed to save derivative data. [2025-10-24T00:45:04.316207] [INFO ] [MAIN ] Derivative Progress: 169/2164 symbols completed. AVNT took 1.2s. Estimated remaining: 13m 35s. Rate: 146.9 symbols/min [2025-10-24T00:45:04.316666] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:04.320691] [INFO ] [MAIN ] AVNS: Generated 139 derivative records from 33758 primary records. [2025-10-24T00:45:04.321086] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-24T00:45:04.321344] [FATAL] [LOCAL ] AVNS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:04.323572] [FATAL] [MAIN ] AVNS: Failed to save derivative data. [2025-10-24T00:45:04.326128] [INFO ] [MAIN ] Derivative Progress: 170/2164 symbols completed. AVNS took 1.2s. Estimated remaining: 13m 30s. Rate: 147.7 symbols/min [2025-10-24T00:45:04.326494] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:04.327203] [INFO ] [MAIN ] AVTR: Generated 139 derivative records from 53961 primary records. [2025-10-24T00:45:04.327387] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-24T00:45:04.328318] [FATAL] [LOCAL ] AVTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:04.328618] [FATAL] [MAIN ] AVTR: Failed to save derivative data. [2025-10-24T00:45:04.331293] [INFO ] [MAIN ] Derivative Progress: 171/2164 symbols completed. AVTR took 1.2s. Estimated remaining: 13m 25s. Rate: 148.6 symbols/min [2025-10-24T00:45:04.331491] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:04.371102] [DEBUG] [LOCAL ] AWF: Loaded 24216 existing records from primary storage. [2025-10-24T00:45:04.371432] [INFO ] [MAIN ] AWF: Loaded 24216 primary data records. [2025-10-24T00:45:04.474199] [DEBUG] [LOCAL ] AWI: Loaded 25291 existing records from primary storage. [2025-10-24T00:45:04.497181] [INFO ] [MAIN ] AWI: Loaded 25291 primary data records. [2025-10-24T00:45:04.497868] [DEBUG] [LOCAL ] AVY: Loaded 38485 existing records from primary storage. [2025-10-24T00:45:04.519077] [INFO ] [MAIN ] AVY: Loaded 38485 primary data records. [2025-10-24T00:45:05.402409] [DEBUG] [MAIN ] AWF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:05.439622] [DEBUG] [MAIN ] AVY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:05.481313] [DEBUG] [MAIN ] AWI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:05.546442] [INFO ] [MAIN ] AWF: Generated 139 derivative records from 24216 primary records. [2025-10-24T00:45:05.550756] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-24T00:45:05.554137] [FATAL] [LOCAL ] AWF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:05.554306] [FATAL] [MAIN ] AWF: Failed to save derivative data. [2025-10-24T00:45:05.560574] [INFO ] [MAIN ] Derivative Progress: 172/2164 symbols completed. AWF took 1.2s. Estimated remaining: 13m 34s. Rate: 146.8 symbols/min [2025-10-24T00:45:05.565516] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:05.574055] [INFO ] [MAIN ] AVY: Generated 139 derivative records from 38485 primary records. [2025-10-24T00:45:05.576175] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-24T00:45:05.577541] [FATAL] [LOCAL ] AVY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:05.576915] [INFO ] [MAIN ] AWI: Generated 139 derivative records from 25291 primary records. [2025-10-24T00:45:05.577772] [FATAL] [MAIN ] AVY: Failed to save derivative data. [2025-10-24T00:45:05.577844] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-24T00:45:05.581183] [INFO ] [MAIN ] Derivative Progress: 173/2164 symbols completed. AVY took 1.3s. Estimated remaining: 13m 29s. Rate: 147.6 symbols/min [2025-10-24T00:45:05.582024] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:05.581725] [FATAL] [LOCAL ] AWI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:05.582558] [FATAL] [MAIN ] AWI: Failed to save derivative data. [2025-10-24T00:45:05.585774] [INFO ] [MAIN ] Derivative Progress: 174/2164 symbols completed. AWI took 1.3s. Estimated remaining: 13m 24s. Rate: 148.5 symbols/min [2025-10-24T00:45:05.586509] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:05.626815] [DEBUG] [LOCAL ] AWP: Loaded 21729 existing records from primary storage. [2025-10-24T00:45:05.627105] [INFO ] [MAIN ] AWP: Loaded 21729 primary data records. [2025-10-24T00:45:05.719195] [DEBUG] [LOCAL ] AWR: Loaded 22853 existing records from primary storage. [2025-10-24T00:45:05.730394] [INFO ] [MAIN ] AWR: Loaded 22853 primary data records. [2025-10-24T00:45:05.781863] [DEBUG] [LOCAL ] AWK: Loaded 48705 existing records from primary storage. [2025-10-24T00:45:05.822818] [INFO ] [MAIN ] AWK: Loaded 48705 primary data records. [2025-10-24T00:45:06.756972] [DEBUG] [MAIN ] AWP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:06.792303] [DEBUG] [MAIN ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:06.844786] [DEBUG] [MAIN ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:06.895275] [INFO ] [MAIN ] AWP: Generated 139 derivative records from 21729 primary records. [2025-10-24T00:45:06.895888] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-24T00:45:06.898727] [FATAL] [LOCAL ] AWP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:06.902916] [FATAL] [MAIN ] AWP: Failed to save derivative data. [2025-10-24T00:45:06.905151] [INFO ] [MAIN ] Derivative Progress: 175/2164 symbols completed. AWP took 1.3s. Estimated remaining: 13m 34s. Rate: 146.6 symbols/min [2025-10-24T00:45:06.908378] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:06.917028] [INFO ] [MAIN ] AWR: Generated 139 derivative records from 22853 primary records. [2025-10-24T00:45:06.919112] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-24T00:45:06.919777] [FATAL] [LOCAL ] AWR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:06.919898] [FATAL] [MAIN ] AWR: Failed to save derivative data. [2025-10-24T00:45:06.924244] [INFO ] [MAIN ] Derivative Progress: 176/2164 symbols completed. AWR took 1.3s. Estimated remaining: 13m 29s. Rate: 147.4 symbols/min [2025-10-24T00:45:06.928209] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:06.944518] [INFO ] [MAIN ] AWK: Generated 139 derivative records from 48705 primary records. [2025-10-24T00:45:06.945060] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-24T00:45:06.945438] [FATAL] [LOCAL ] AWK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:06.945785] [FATAL] [MAIN ] AWK: Failed to save derivative data. [2025-10-24T00:45:06.948604] [INFO ] [MAIN ] Derivative Progress: 177/2164 symbols completed. AWK took 1.4s. Estimated remaining: 13m 25s. Rate: 148.2 symbols/min [2025-10-24T00:45:06.948938] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:06.964730] [DEBUG] [LOCAL ] AX: Loaded 27971 existing records from primary storage. [2025-10-24T00:45:06.965116] [INFO ] [MAIN ] AX: Loaded 27971 primary data records. [2025-10-24T00:45:07.171234] [DEBUG] [LOCAL ] AXL: Loaded 50912 existing records from primary storage. [2025-10-24T00:45:07.328077] [INFO ] [MAIN ] AXL: Loaded 50912 primary data records. [2025-10-24T00:45:07.465005] [DEBUG] [LOCAL ] AXP: Loaded 53545 existing records from primary storage. [2025-10-24T00:45:07.504601] [INFO ] [MAIN ] AXP: Loaded 53545 primary data records. [2025-10-24T00:45:08.024038] [DEBUG] [MAIN ] AX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:08.069698] [DEBUG] [MAIN ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:08.114851] [DEBUG] [MAIN ] AXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:08.153252] [INFO ] [MAIN ] AX: Generated 139 derivative records from 27971 primary records. [2025-10-24T00:45:08.155803] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-24T00:45:08.158826] [FATAL] [LOCAL ] AX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:08.159308] [FATAL] [MAIN ] AX: Failed to save derivative data. [2025-10-24T00:45:08.162744] [INFO ] [MAIN ] Derivative Progress: 178/2164 symbols completed. AX took 1.3s. Estimated remaining: 13m 33s. Rate: 146.5 symbols/min [2025-10-24T00:45:08.178809] [INFO ] [MAIN ] AXL: Generated 139 derivative records from 50912 primary records. [2025-10-24T00:45:08.180813] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-24T00:45:08.180741] [INFO ] [MAIN ] AXP: Generated 139 derivative records from 53545 primary records. [2025-10-24T00:45:08.181102] [FATAL] [LOCAL ] AXL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:08.181293] [FATAL] [MAIN ] AXL: Failed to save derivative data. [2025-10-24T00:45:08.181235] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-24T00:45:08.183977] [INFO ] [MAIN ] Derivative Progress: 179/2164 symbols completed. AXL took 1.3s. Estimated remaining: 13m 29s. Rate: 147.3 symbols/min [2025-10-24T00:45:08.184282] [FATAL] [LOCAL ] AXP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:08.184448] [FATAL] [MAIN ] AXP: Failed to save derivative data. [2025-10-24T00:45:08.187538] [INFO ] [MAIN ] Derivative Progress: 180/2164 symbols completed. AXP took 1.2s. Estimated remaining: 13m 24s. Rate: 148.1 symbols/min [2025-10-24T00:45:08.187994] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:08.188106] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:08.188173] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:08.194563] [DEBUG] [LOCAL ] AXR: Loaded 2921 existing records from primary storage. [2025-10-24T00:45:08.194981] [INFO ] [MAIN ] AXR: Loaded 2921 primary data records. [2025-10-24T00:45:08.567283] [DEBUG] [LOCAL ] AXS: Loaded 39045 existing records from primary storage. [2025-10-24T00:45:08.581210] [INFO ] [MAIN ] AXS: Loaded 39045 primary data records. [2025-10-24T00:45:08.600606] [DEBUG] [LOCAL ] AXTA: Loaded 52680 existing records from primary storage. [2025-10-24T00:45:08.633451] [INFO ] [MAIN ] AXTA: Loaded 52680 primary data records. [2025-10-24T00:45:09.244453] [DEBUG] [MAIN ] AXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:09.297126] [DEBUG] [MAIN ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:09.330732] [DEBUG] [MAIN ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:09.331145] [INFO ] [MAIN ] AXR: Generated 139 derivative records from 2921 primary records. [2025-10-24T00:45:09.347805] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-24T00:45:09.349619] [FATAL] [LOCAL ] AXR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:09.349784] [FATAL] [MAIN ] AXR: Failed to save derivative data. [2025-10-24T00:45:09.352590] [INFO ] [MAIN ] Derivative Progress: 181/2164 symbols completed. AXR took 1.2s. Estimated remaining: 13m 32s. Rate: 146.6 symbols/min [2025-10-24T00:45:09.354114] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:09.387487] [INFO ] [MAIN ] AXTA: Generated 139 derivative records from 52680 primary records. [2025-10-24T00:45:09.395482] [DEBUG] [LOCAL ] AYI: Loaded 24188 existing records from primary storage. [2025-10-24T00:45:09.395608] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-24T00:45:09.395991] [FATAL] [LOCAL ] AXTA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:09.396153] [INFO ] [MAIN ] AYI: Loaded 24188 primary data records. [2025-10-24T00:45:09.396367] [FATAL] [MAIN ] AXTA: Failed to save derivative data. [2025-10-24T00:45:09.409743] [INFO ] [MAIN ] Derivative Progress: 182/2164 symbols completed. AXTA took 1.2s. Estimated remaining: 13m 27s. Rate: 147.3 symbols/min [2025-10-24T00:45:09.481872] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:09.507271] [INFO ] [MAIN ] AXS: Generated 139 derivative records from 39045 primary records. [2025-10-24T00:45:09.523467] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-24T00:45:09.557250] [FATAL] [LOCAL ] AXS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:09.704740] [FATAL] [MAIN ] AXS: Failed to save derivative data. [2025-10-24T00:45:09.709583] [DEBUG] [LOCAL ] AZO: Loaded 10939 existing records from primary storage. [2025-10-24T00:45:09.712551] [INFO ] [MAIN ] AZO: Loaded 10939 primary data records. [2025-10-24T00:45:09.712442] [INFO ] [MAIN ] Derivative Progress: 183/2164 symbols completed. AXS took 1.5s. Estimated remaining: 13m 26s. Rate: 147.5 symbols/min [2025-10-24T00:45:09.744391] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:10.037326] [DEBUG] [LOCAL ] AZZ: Loaded 23076 existing records from primary storage. [2025-10-24T00:45:10.038791] [INFO ] [MAIN ] AZZ: Loaded 23076 primary data records. [2025-10-24T00:45:10.156913] [DEBUG] [MAIN ] AYI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:10.400422] [DEBUG] [MAIN ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:10.435763] [INFO ] [MAIN ] AYI: Generated 139 derivative records from 24188 primary records. [2025-10-24T00:45:10.437891] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-24T00:45:10.441244] [FATAL] [LOCAL ] AYI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:10.442754] [FATAL] [MAIN ] AYI: Failed to save derivative data. [2025-10-24T00:45:10.447438] [INFO ] [MAIN ] Derivative Progress: 184/2164 symbols completed. AYI took 1.1s. Estimated remaining: 13m 29s. Rate: 146.9 symbols/min [2025-10-24T00:45:10.447846] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:10.462283] [DEBUG] [MAIN ] AZZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:10.501179] [INFO ] [MAIN ] AZO: Generated 139 derivative records from 10939 primary records. [2025-10-24T00:45:10.502119] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-24T00:45:10.502382] [FATAL] [LOCAL ] AZO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:10.504089] [FATAL] [MAIN ] AZO: Failed to save derivative data. [2025-10-24T00:45:10.506759] [INFO ] [MAIN ] Derivative Progress: 185/2164 symbols completed. AZO took 1.0s. Estimated remaining: 13m 25s. Rate: 147.5 symbols/min [2025-10-24T00:45:10.510285] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:10.536439] [INFO ] [MAIN ] AZZ: Generated 139 derivative records from 23076 primary records. [2025-10-24T00:45:10.536717] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-24T00:45:10.536989] [FATAL] [LOCAL ] AZZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:10.537137] [FATAL] [MAIN ] AZZ: Failed to save derivative data. [2025-10-24T00:45:10.540313] [INFO ] [MAIN ] Derivative Progress: 186/2164 symbols completed. AZZ took 0.8s. Estimated remaining: 13m 20s. Rate: 148.3 symbols/min [2025-10-24T00:45:10.540807] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:10.560725] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-24T00:45:10.561312] [INFO ] [MAIN ] BA: Loaded 54180 primary data records. [2025-10-24T00:45:10.975917] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-24T00:45:10.976892] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-24T00:45:10.977255] [INFO ] [MAIN ] BABA: Loaded 54210 primary data records. [2025-10-24T00:45:10.977344] [INFO ] [MAIN ] BAC: Loaded 54198 primary data records. [2025-10-24T00:45:11.594689] [DEBUG] [MAIN ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:11.654863] [DEBUG] [MAIN ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:11.655209] [DEBUG] [MAIN ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:11.708473] [INFO ] [MAIN ] BA: Generated 139 derivative records from 54180 primary records. [2025-10-24T00:45:11.709137] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-24T00:45:11.709719] [FATAL] [LOCAL ] BA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:11.712100] [FATAL] [MAIN ] BA: Failed to save derivative data. [2025-10-24T00:45:11.718850] [INFO ] [MAIN ] Derivative Progress: 187/2164 symbols completed. BA took 1.3s. Estimated remaining: 13m 28s. Rate: 146.8 symbols/min [2025-10-24T00:45:11.719033] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:11.748447] [INFO ] [MAIN ] BABA: Generated 139 derivative records from 54210 primary records. [2025-10-24T00:45:11.748009] [INFO ] [MAIN ] BAC: Generated 139 derivative records from 54198 primary records. [2025-10-24T00:45:11.748817] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-24T00:45:11.749128] [FATAL] [LOCAL ] BAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:11.748720] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-24T00:45:11.749278] [FATAL] [MAIN ] BAC: Failed to save derivative data. [2025-10-24T00:45:11.752352] [INFO ] [MAIN ] Derivative Progress: 188/2164 symbols completed. BAC took 1.2s. Estimated remaining: 13m 24s. Rate: 147.5 symbols/min [2025-10-24T00:45:11.752848] [FATAL] [LOCAL ] BABA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:11.752978] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:11.766569] [FATAL] [MAIN ] BABA: Failed to save derivative data. [2025-10-24T00:45:11.769132] [INFO ] [MAIN ] Derivative Progress: 189/2164 symbols completed. BABA took 1.3s. Estimated remaining: 13m 19s. Rate: 148.2 symbols/min [2025-10-24T00:45:11.769565] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:11.791900] [DEBUG] [LOCAL ] BAH: Loaded 52022 existing records from primary storage. [2025-10-24T00:45:11.792267] [INFO ] [MAIN ] BAH: Loaded 52022 primary data records. [2025-10-24T00:45:11.932538] [DEBUG] [LOCAL ] BAK: Loaded 39731 existing records from primary storage. [2025-10-24T00:45:11.949378] [INFO ] [MAIN ] BAK: Loaded 39731 primary data records. [2025-10-24T00:45:12.160998] [DEBUG] [LOCAL ] BALL: Loaded 52314 existing records from primary storage. [2025-10-24T00:45:12.241485] [INFO ] [MAIN ] BALL: Loaded 52314 primary data records. [2025-10-24T00:45:12.814055] [DEBUG] [MAIN ] BAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:12.851851] [DEBUG] [MAIN ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:12.891266] [DEBUG] [MAIN ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:12.917856] [INFO ] [MAIN ] BAH: Generated 139 derivative records from 52022 primary records. [2025-10-24T00:45:12.918168] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-24T00:45:12.920573] [FATAL] [LOCAL ] BAH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:12.920731] [FATAL] [MAIN ] BAH: Failed to save derivative data. [2025-10-24T00:45:12.923780] [INFO ] [MAIN ] Derivative Progress: 190/2164 symbols completed. BAH took 1.2s. Estimated remaining: 13m 27s. Rate: 146.8 symbols/min [2025-10-24T00:45:12.927866] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:12.940450] [INFO ] [MAIN ] BAK: Generated 139 derivative records from 39731 primary records. [2025-10-24T00:45:12.943547] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-24T00:45:12.945151] [FATAL] [LOCAL ] BAK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:12.945459] [FATAL] [MAIN ] BAK: Failed to save derivative data. [2025-10-24T00:45:12.947988] [INFO ] [MAIN ] Derivative Progress: 191/2164 symbols completed. BAK took 1.2s. Estimated remaining: 13m 22s. Rate: 147.5 symbols/min [2025-10-24T00:45:12.948222] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:12.955291] [INFO ] [MAIN ] BALL: Generated 139 derivative records from 52314 primary records. [2025-10-24T00:45:12.955704] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-24T00:45:12.955963] [FATAL] [LOCAL ] BALL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:12.956056] [FATAL] [MAIN ] BALL: Failed to save derivative data. [2025-10-24T00:45:12.959179] [INFO ] [MAIN ] Derivative Progress: 192/2164 symbols completed. BALL took 1.2s. Estimated remaining: 13m 18s. Rate: 148.3 symbols/min [2025-10-24T00:45:12.959700] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:13.020863] [DEBUG] [LOCAL ] BAM: Loaded 52467 existing records from primary storage. [2025-10-24T00:45:13.021173] [INFO ] [MAIN ] BAM: Loaded 52467 primary data records. [2025-10-24T00:45:13.074959] [DEBUG] [LOCAL ] BAP: Loaded 25703 existing records from primary storage. [2025-10-24T00:45:13.087972] [INFO ] [MAIN ] BAP: Loaded 25703 primary data records. [2025-10-24T00:45:13.259870] [DEBUG] [LOCAL ] BANC: Loaded 51774 existing records from primary storage. [2025-10-24T00:45:13.428811] [INFO ] [MAIN ] BANC: Loaded 51774 primary data records. [2025-10-24T00:45:13.984135] [DEBUG] [MAIN ] BAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:14.021931] [DEBUG] [MAIN ] BAP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:14.071421] [DEBUG] [MAIN ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:14.109249] [INFO ] [MAIN ] BAM: Generated 139 derivative records from 52467 primary records. [2025-10-24T00:45:14.112466] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-24T00:45:14.113117] [FATAL] [LOCAL ] BAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:14.115793] [FATAL] [MAIN ] BAM: Failed to save derivative data. [2025-10-24T00:45:14.118509] [INFO ] [MAIN ] Derivative Progress: 193/2164 symbols completed. BAM took 1.2s. Estimated remaining: 13m 25s. Rate: 146.9 symbols/min [2025-10-24T00:45:14.122458] [INFO ] [MAIN ] BAP: Generated 139 derivative records from 25703 primary records. [2025-10-24T00:45:14.124831] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-24T00:45:14.125081] [FATAL] [LOCAL ] BAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:14.126385] [FATAL] [MAIN ] BAP: Failed to save derivative data. [2025-10-24T00:45:14.128854] [INFO ] [MAIN ] Derivative Progress: 194/2164 symbols completed. BAP took 1.2s. Estimated remaining: 13m 21s. Rate: 147.6 symbols/min [2025-10-24T00:45:14.133331] [INFO ] [MAIN ] BANC: Generated 139 derivative records from 51774 primary records. [2025-10-24T00:45:14.133419] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-24T00:45:14.133609] [FATAL] [LOCAL ] BANC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:14.133704] [FATAL] [MAIN ] BANC: Failed to save derivative data. [2025-10-24T00:45:14.136675] [INFO ] [MAIN ] Derivative Progress: 195/2164 symbols completed. BANC took 1.2s. Estimated remaining: 13m 16s. Rate: 148.4 symbols/min [2025-10-24T00:45:14.137019] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:14.137126] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:14.137164] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:14.198115] [DEBUG] [LOCAL ] BARK: Loaded 38445 existing records from primary storage. [2025-10-24T00:45:14.198538] [INFO ] [MAIN ] BARK: Loaded 38445 primary data records. [2025-10-24T00:45:14.375229] [DEBUG] [LOCAL ] BB: Loaded 53262 existing records from primary storage. [2025-10-24T00:45:14.412788] [INFO ] [MAIN ] BB: Loaded 53262 primary data records. [2025-10-24T00:45:14.362429] [DEBUG] [LOCAL ] BAX: Loaded 53927 existing records from primary storage. [2025-10-24T00:45:14.533714] [INFO ] [MAIN ] BAX: Loaded 53927 primary data records. [2025-10-24T00:45:15.206121] [DEBUG] [MAIN ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:15.259394] [DEBUG] [MAIN ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:15.292128] [INFO ] [MAIN ] BARK: Generated 139 derivative records from 38445 primary records. [2025-10-24T00:45:15.292725] [DEBUG] [MAIN ] BAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:15.306346] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-24T00:45:15.306887] [FATAL] [LOCAL ] BARK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:15.308414] [FATAL] [MAIN ] BARK: Failed to save derivative data. [2025-10-24T00:45:15.312022] [INFO ] [MAIN ] Derivative Progress: 196/2164 symbols completed. BARK took 1.2s. Estimated remaining: 13m 24s. Rate: 146.9 symbols/min [2025-10-24T00:45:15.315830] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:15.354842] [INFO ] [MAIN ] BAX: Generated 139 derivative records from 53927 primary records. [2025-10-24T00:45:15.356997] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-24T00:45:15.357144] [INFO ] [MAIN ] BB: Generated 139 derivative records from 53262 primary records. [2025-10-24T00:45:15.357566] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-24T00:45:15.357503] [FATAL] [LOCAL ] BAX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:15.357974] [FATAL] [LOCAL ] BB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:15.357762] [FATAL] [MAIN ] BAX: Failed to save derivative data. [2025-10-24T00:45:15.358306] [FATAL] [MAIN ] BB: Failed to save derivative data. [2025-10-24T00:45:15.361096] [INFO ] [MAIN ] Derivative Progress: 197/2164 symbols completed. BAX took 1.2s. Estimated remaining: 13m 20s. Rate: 147.6 symbols/min [2025-10-24T00:45:15.376901] [INFO ] [MAIN ] Derivative Progress: 198/2164 symbols completed. BB took 1.2s. Estimated remaining: 13m 15s. Rate: 148.3 symbols/min [2025-10-24T00:45:15.376722] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:15.377564] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:15.401890] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-24T00:45:15.402270] [INFO ] [MAIN ] BBAI: Loaded 54210 primary data records. [2025-10-24T00:45:15.588182] [DEBUG] [LOCAL ] BBAR: Loaded 42977 existing records from primary storage. [2025-10-24T00:45:15.629043] [INFO ] [MAIN ] BBAR: Loaded 42977 primary data records. [2025-10-24T00:45:15.861303] [DEBUG] [LOCAL ] BBD: Loaded 53662 existing records from primary storage. [2025-10-24T00:45:15.877842] [INFO ] [MAIN ] BBD: Loaded 53662 primary data records. [2025-10-24T00:45:16.394307] [DEBUG] [MAIN ] BBAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:16.430123] [DEBUG] [MAIN ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:16.474026] [DEBUG] [MAIN ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:16.502229] [INFO ] [MAIN ] BBAI: Generated 139 derivative records from 54210 primary records. [2025-10-24T00:45:16.502965] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-24T00:45:16.503304] [FATAL] [LOCAL ] BBAI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:16.508276] [FATAL] [MAIN ] BBAI: Failed to save derivative data. [2025-10-24T00:45:16.512255] [INFO ] [MAIN ] Derivative Progress: 199/2164 symbols completed. BBAI took 1.2s. Estimated remaining: 13m 22s. Rate: 147.0 symbols/min [2025-10-24T00:45:16.515564] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:16.530374] [INFO ] [MAIN ] BBAR: Generated 139 derivative records from 42977 primary records. [2025-10-24T00:45:16.531477] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-24T00:45:16.531836] [FATAL] [LOCAL ] BBAR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:16.532209] [FATAL] [MAIN ] BBAR: Failed to save derivative data. [2025-10-24T00:45:16.536754] [INFO ] [MAIN ] Derivative Progress: 200/2164 symbols completed. BBAR took 1.2s. Estimated remaining: 13m 18s. Rate: 147.7 symbols/min [2025-10-24T00:45:16.537375] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:16.540974] [INFO ] [MAIN ] BBD: Generated 139 derivative records from 53662 primary records. [2025-10-24T00:45:16.541174] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-24T00:45:16.541406] [FATAL] [LOCAL ] BBD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:16.541487] [FATAL] [MAIN ] BBD: Failed to save derivative data. [2025-10-24T00:45:16.544620] [INFO ] [MAIN ] Derivative Progress: 201/2164 symbols completed. BBD took 1.2s. Estimated remaining: 13m 14s. Rate: 148.4 symbols/min [2025-10-24T00:45:16.545011] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:16.560580] [DEBUG] [LOCAL ] BBU: Loaded 5819 existing records from primary storage. [2025-10-24T00:45:16.560857] [INFO ] [MAIN ] BBU: Loaded 5819 primary data records. [2025-10-24T00:45:16.671889] [DEBUG] [LOCAL ] BBN: Loaded 17906 existing records from primary storage. [2025-10-24T00:45:16.690345] [INFO ] [MAIN ] BBN: Loaded 17906 primary data records. [2025-10-24T00:45:16.684979] [DEBUG] [LOCAL ] BBDC: Loaded 33064 existing records from primary storage. [2025-10-24T00:45:16.716203] [INFO ] [MAIN ] BBDC: Loaded 33064 primary data records. [2025-10-24T00:45:17.540313] [DEBUG] [MAIN ] BBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:17.574345] [DEBUG] [MAIN ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:17.610816] [DEBUG] [MAIN ] BBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:17.650596] [INFO ] [MAIN ] BBU: Generated 139 derivative records from 5819 primary records. [2025-10-24T00:45:17.653634] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-24T00:45:17.654084] [FATAL] [LOCAL ] BBU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:17.654258] [FATAL] [MAIN ] BBU: Failed to save derivative data. [2025-10-24T00:45:17.656260] [INFO ] [MAIN ] Derivative Progress: 202/2164 symbols completed. BBU took 1.1s. Estimated remaining: 13m 20s. Rate: 147.1 symbols/min [2025-10-24T00:45:17.656411] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:17.674413] [INFO ] [MAIN ] BBN: Generated 139 derivative records from 17906 primary records. [2025-10-24T00:45:17.677361] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-24T00:45:17.677689] [INFO ] [MAIN ] BBDC: Generated 139 derivative records from 33064 primary records. [2025-10-24T00:45:17.677982] [FATAL] [LOCAL ] BBN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:17.683248] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-24T00:45:17.683484] [FATAL] [LOCAL ] BBDC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:17.683064] [DEBUG] [LOCAL ] BBUC: Loaded 14063 existing records from primary storage. [2025-10-24T00:45:17.683188] [FATAL] [MAIN ] BBN: Failed to save derivative data. [2025-10-24T00:45:17.683683] [INFO ] [MAIN ] BBUC: Loaded 14063 primary data records. [2025-10-24T00:45:17.686427] [INFO ] [MAIN ] Derivative Progress: 203/2164 symbols completed. BBN took 1.1s. Estimated remaining: 13m 16s. Rate: 147.8 symbols/min [2025-10-24T00:45:17.686564] [FATAL] [MAIN ] BBDC: Failed to save derivative data. [2025-10-24T00:45:17.686732] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:17.689254] [INFO ] [MAIN ] Derivative Progress: 204/2164 symbols completed. BBDC took 1.2s. Estimated remaining: 13m 12s. Rate: 148.5 symbols/min [2025-10-24T00:45:17.710630] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:18.016395] [DEBUG] [LOCAL ] BBW: Loaded 27371 existing records from primary storage. [2025-10-24T00:45:18.016965] [INFO ] [MAIN ] BBW: Loaded 27371 primary data records. [2025-10-24T00:45:18.135948] [DEBUG] [LOCAL ] BBVA: Loaded 49463 existing records from primary storage. [2025-10-24T00:45:18.157145] [INFO ] [MAIN ] BBVA: Loaded 49463 primary data records. [2025-10-24T00:45:18.492867] [DEBUG] [MAIN ] BBUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:18.684250] [DEBUG] [MAIN ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:18.725565] [DEBUG] [MAIN ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:18.712234] [INFO ] [MAIN ] BBUC: Generated 139 derivative records from 14063 primary records. [2025-10-24T00:45:18.738363] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-24T00:45:18.740485] [FATAL] [LOCAL ] BBUC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:18.740863] [FATAL] [MAIN ] BBUC: Failed to save derivative data. [2025-10-24T00:45:18.745603] [INFO ] [MAIN ] Derivative Progress: 205/2164 symbols completed. BBUC took 1.1s. Estimated remaining: 13m 18s. Rate: 147.3 symbols/min [2025-10-24T00:45:18.747533] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:18.772048] [INFO ] [MAIN ] BBW: Generated 139 derivative records from 27371 primary records. [2025-10-24T00:45:18.774934] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-24T00:45:18.775445] [FATAL] [LOCAL ] BBW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:18.776562] [FATAL] [MAIN ] BBW: Failed to save derivative data. [2025-10-24T00:45:18.780880] [INFO ] [MAIN ] BBVA: Generated 139 derivative records from 49463 primary records. [2025-10-24T00:45:18.780622] [INFO ] [MAIN ] Derivative Progress: 206/2164 symbols completed. BBW took 1.1s. Estimated remaining: 13m 14s. Rate: 148.0 symbols/min [2025-10-24T00:45:18.781152] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:18.781386] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-24T00:45:18.782029] [FATAL] [LOCAL ] BBVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:18.782112] [FATAL] [MAIN ] BBVA: Failed to save derivative data. [2025-10-24T00:45:18.784436] [INFO ] [MAIN ] Derivative Progress: 207/2164 symbols completed. BBVA took 1.1s. Estimated remaining: 13m 10s. Rate: 148.7 symbols/min [2025-10-24T00:45:18.784861] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:18.835855] [DEBUG] [LOCAL ] BBWI: Loaded 53981 existing records from primary storage. [2025-10-24T00:45:18.836223] [INFO ] [MAIN ] BBWI: Loaded 53981 primary data records. [2025-10-24T00:45:18.967304] [DEBUG] [LOCAL ] BC: Loaded 44257 existing records from primary storage. [2025-10-24T00:45:19.001232] [INFO ] [MAIN ] BC: Loaded 44257 primary data records. [2025-10-24T00:45:19.219873] [DEBUG] [LOCAL ] BBY: Loaded 53823 existing records from primary storage. [2025-10-24T00:45:19.295189] [INFO ] [MAIN ] BBY: Loaded 53823 primary data records. [2025-10-24T00:45:19.818516] [DEBUG] [MAIN ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:19.852388] [DEBUG] [MAIN ] BC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:19.891893] [DEBUG] [MAIN ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:19.957371] [INFO ] [MAIN ] BBWI: Generated 139 derivative records from 53981 primary records. [2025-10-24T00:45:19.959022] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-24T00:45:19.962363] [FATAL] [LOCAL ] BBWI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:19.963137] [FATAL] [MAIN ] BBWI: Failed to save derivative data. [2025-10-24T00:45:19.968048] [INFO ] [MAIN ] Derivative Progress: 208/2164 symbols completed. BBWI took 1.2s. Estimated remaining: 13m 16s. Rate: 147.3 symbols/min [2025-10-24T00:45:19.978167] [INFO ] [MAIN ] BBY: Generated 139 derivative records from 53823 primary records. [2025-10-24T00:45:19.976498] [INFO ] [MAIN ] BC: Generated 139 derivative records from 44257 primary records. [2025-10-24T00:45:19.978340] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-24T00:45:19.978390] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-24T00:45:19.978924] [FATAL] [LOCAL ] BC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:19.979023] [FATAL] [MAIN ] BC: Failed to save derivative data. [2025-10-24T00:45:19.978717] [FATAL] [LOCAL ] BBY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:19.981626] [FATAL] [MAIN ] BBY: Failed to save derivative data. [2025-10-24T00:45:19.981521] [INFO ] [MAIN ] Derivative Progress: 209/2164 symbols completed. BC took 1.2s. Estimated remaining: 13m 12s. Rate: 148.0 symbols/min [2025-10-24T00:45:19.985970] [INFO ] [MAIN ] Derivative Progress: 210/2164 symbols completed. BBY took 1.2s. Estimated remaining: 13m 8s. Rate: 148.7 symbols/min [2025-10-24T00:45:19.986501] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:19.986555] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:19.986606] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:20.024957] [DEBUG] [LOCAL ] BCC: Loaded 28829 existing records from primary storage. [2025-10-24T00:45:20.025134] [INFO ] [MAIN ] BCC: Loaded 28829 primary data records. [2025-10-24T00:45:20.112500] [DEBUG] [LOCAL ] BCAT: Loaded 34467 existing records from primary storage. [2025-10-24T00:45:20.154018] [INFO ] [MAIN ] BCAT: Loaded 34467 primary data records. [2025-10-24T00:45:20.467073] [DEBUG] [LOCAL ] BCE: Loaded 52643 existing records from primary storage. [2025-10-24T00:45:20.470879] [INFO ] [MAIN ] BCE: Loaded 52643 primary data records. [2025-10-24T00:45:21.071758] [DEBUG] [MAIN ] BCC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:21.105800] [DEBUG] [MAIN ] BCAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:21.159693] [DEBUG] [MAIN ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:21.190541] [INFO ] [MAIN ] BCC: Generated 139 derivative records from 28829 primary records. [2025-10-24T00:45:21.192781] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-24T00:45:21.193219] [FATAL] [LOCAL ] BCC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:21.196714] [FATAL] [MAIN ] BCC: Failed to save derivative data. [2025-10-24T00:45:21.198951] [INFO ] [MAIN ] Derivative Progress: 211/2164 symbols completed. BCC took 1.2s. Estimated remaining: 13m 15s. Rate: 147.3 symbols/min [2025-10-24T00:45:21.200008] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:21.204295] [INFO ] [MAIN ] BCAT: Generated 139 derivative records from 34467 primary records. [2025-10-24T00:45:21.206623] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-24T00:45:21.208332] [FATAL] [LOCAL ] BCAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:21.208699] [FATAL] [MAIN ] BCAT: Failed to save derivative data. [2025-10-24T00:45:21.211876] [INFO ] [MAIN ] Derivative Progress: 212/2164 symbols completed. BCAT took 1.2s. Estimated remaining: 13m 11s. Rate: 148.0 symbols/min [2025-10-24T00:45:21.212559] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:21.230335] [INFO ] [MAIN ] BCE: Generated 139 derivative records from 52643 primary records. [2025-10-24T00:45:21.230578] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-24T00:45:21.230923] [FATAL] [LOCAL ] BCE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:21.235828] [FATAL] [MAIN ] BCE: Failed to save derivative data. [2025-10-24T00:45:21.239299] [INFO ] [MAIN ] Derivative Progress: 213/2164 symbols completed. BCE took 1.3s. Estimated remaining: 13m 7s. Rate: 148.7 symbols/min [2025-10-24T00:45:21.239590] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:21.258424] [DEBUG] [LOCAL ] BCO: Loaded 25109 existing records from primary storage. [2025-10-24T00:45:21.259155] [DEBUG] [LOCAL ] BCH: Loaded 30215 existing records from primary storage. [2025-10-24T00:45:21.259365] [INFO ] [MAIN ] BCH: Loaded 30215 primary data records. [2025-10-24T00:45:21.259561] [INFO ] [MAIN ] BCO: Loaded 25109 primary data records. [2025-10-24T00:45:21.878099] [DEBUG] [LOCAL ] BCS: Loaded 53831 existing records from primary storage. [2025-10-24T00:45:21.878998] [INFO ] [MAIN ] BCS: Loaded 53831 primary data records. [2025-10-24T00:45:22.211412] [DEBUG] [MAIN ] BCH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:22.224691] [DEBUG] [MAIN ] BCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:22.286273] [DEBUG] [MAIN ] BCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:22.349875] [INFO ] [MAIN ] BCH: Generated 139 derivative records from 30215 primary records. [2025-10-24T00:45:22.350510] [INFO ] [MAIN ] BCO: Generated 139 derivative records from 25109 primary records. [2025-10-24T00:45:22.351888] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-24T00:45:22.352394] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-24T00:45:22.352766] [FATAL] [LOCAL ] BCH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:22.354979] [FATAL] [LOCAL ] BCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:22.355851] [FATAL] [MAIN ] BCO: Failed to save derivative data. [2025-10-24T00:45:22.358261] [INFO ] [MAIN ] Derivative Progress: 214/2164 symbols completed. BCO took 1.1s. Estimated remaining: 13m 14s. Rate: 147.4 symbols/min [2025-10-24T00:45:22.358415] [FATAL] [MAIN ] BCH: Failed to save derivative data. [2025-10-24T00:45:22.358694] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:22.361213] [INFO ] [MAIN ] Derivative Progress: 215/2164 symbols completed. BCH took 1.2s. Estimated remaining: 13m 9s. Rate: 148.1 symbols/min [2025-10-24T00:45:22.363188] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:22.366792] [INFO ] [MAIN ] BCS: Generated 139 derivative records from 53831 primary records. [2025-10-24T00:45:22.367221] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-24T00:45:22.367680] [FATAL] [LOCAL ] BCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:22.367778] [FATAL] [MAIN ] BCS: Failed to save derivative data. [2025-10-24T00:45:22.371408] [INFO ] [MAIN ] Derivative Progress: 216/2164 symbols completed. BCS took 1.1s. Estimated remaining: 13m 6s. Rate: 148.8 symbols/min [2025-10-24T00:45:22.371786] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:22.397131] [DEBUG] [LOCAL ] BCX: Loaded 22191 existing records from primary storage. [2025-10-24T00:45:22.397304] [INFO ] [MAIN ] BCX: Loaded 22191 primary data records. [2025-10-24T00:45:22.476418] [DEBUG] [LOCAL ] BCSF: Loaded 28326 existing records from primary storage. [2025-10-24T00:45:22.496005] [INFO ] [MAIN ] BCSF: Loaded 28326 primary data records. [2025-10-24T00:45:22.520021] [DEBUG] [LOCAL ] BDC: Loaded 24096 existing records from primary storage. [2025-10-24T00:45:22.536004] [INFO ] [MAIN ] BDC: Loaded 24096 primary data records. [2025-10-24T00:45:23.385301] [DEBUG] [MAIN ] BCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:23.445890] [DEBUG] [MAIN ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:23.445202] [DEBUG] [MAIN ] BDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:23.492589] [INFO ] [MAIN ] BCX: Generated 139 derivative records from 22191 primary records. [2025-10-24T00:45:23.493348] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-24T00:45:23.494827] [FATAL] [LOCAL ] BCX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:23.496923] [FATAL] [MAIN ] BCX: Failed to save derivative data. [2025-10-24T00:45:23.499542] [INFO ] [MAIN ] Derivative Progress: 217/2164 symbols completed. BCX took 1.1s. Estimated remaining: 13m 12s. Rate: 147.6 symbols/min [2025-10-24T00:45:23.500088] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:23.530240] [INFO ] [MAIN ] BCSF: Generated 139 derivative records from 28326 primary records. [2025-10-24T00:45:23.533087] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-24T00:45:23.533551] [FATAL] [LOCAL ] BCSF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:23.533833] [FATAL] [MAIN ] BCSF: Failed to save derivative data. [2025-10-24T00:45:23.546590] [INFO ] [MAIN ] Derivative Progress: 218/2164 symbols completed. BCSF took 1.2s. Estimated remaining: 13m 8s. Rate: 148.2 symbols/min [2025-10-24T00:45:23.549542] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:23.547260] [DEBUG] [LOCAL ] BDJ: Loaded 29478 existing records from primary storage. [2025-10-24T00:45:23.550085] [INFO ] [MAIN ] BDC: Generated 139 derivative records from 24096 primary records. [2025-10-24T00:45:23.550265] [INFO ] [MAIN ] BDJ: Loaded 29478 primary data records. [2025-10-24T00:45:23.550756] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-24T00:45:23.556231] [FATAL] [LOCAL ] BDC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:23.556341] [FATAL] [MAIN ] BDC: Failed to save derivative data. [2025-10-24T00:45:23.564997] [INFO ] [MAIN ] Derivative Progress: 219/2164 symbols completed. BDC took 1.2s. Estimated remaining: 13m 4s. Rate: 148.8 symbols/min [2025-10-24T00:45:23.598427] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:23.893628] [DEBUG] [LOCAL ] BDN: Loaded 47979 existing records from primary storage. [2025-10-24T00:45:23.894001] [INFO ] [MAIN ] BDN: Loaded 47979 primary data records. [2025-10-24T00:45:24.008825] [DEBUG] [LOCAL ] BDX: Loaded 52509 existing records from primary storage. [2025-10-24T00:45:24.012486] [INFO ] [MAIN ] BDX: Loaded 52509 primary data records. [2025-10-24T00:45:24.517871] [DEBUG] [MAIN ] BDJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:24.568159] [DEBUG] [MAIN ] BDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:24.592934] [INFO ] [MAIN ] BDJ: Generated 139 derivative records from 29478 primary records. [2025-10-24T00:45:24.605683] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-24T00:45:24.606363] [DEBUG] [MAIN ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:24.606026] [FATAL] [LOCAL ] BDJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:24.620605] [FATAL] [MAIN ] BDJ: Failed to save derivative data. [2025-10-24T00:45:24.628394] [INFO ] [MAIN ] Derivative Progress: 220/2164 symbols completed. BDJ took 1.1s. Estimated remaining: 13m 10s. Rate: 147.7 symbols/min [2025-10-24T00:45:24.628774] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:24.670253] [INFO ] [MAIN ] BDN: Generated 139 derivative records from 47979 primary records. [2025-10-24T00:45:24.671498] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-24T00:45:24.671823] [FATAL] [LOCAL ] BDN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:24.673597] [INFO ] [MAIN ] BDX: Generated 139 derivative records from 52509 primary records. [2025-10-24T00:45:24.673794] [FATAL] [MAIN ] BDN: Failed to save derivative data. [2025-10-24T00:45:24.673910] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-24T00:45:24.676013] [INFO ] [MAIN ] Derivative Progress: 221/2164 symbols completed. BDN took 1.1s. Estimated remaining: 13m 6s. Rate: 148.3 symbols/min [2025-10-24T00:45:24.674107] [FATAL] [LOCAL ] BDX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:24.676256] [FATAL] [MAIN ] BDX: Failed to save derivative data. [2025-10-24T00:45:24.679024] [INFO ] [MAIN ] Derivative Progress: 222/2164 symbols completed. BDX took 1.1s. Estimated remaining: 13m 2s. Rate: 149.0 symbols/min [2025-10-24T00:45:24.676328] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:24.679278] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:24.697374] [DEBUG] [LOCAL ] BE: Loaded 54051 existing records from primary storage. [2025-10-24T00:45:24.697786] [INFO ] [MAIN ] BE: Loaded 54051 primary data records. [2025-10-24T00:45:25.076125] [DEBUG] [LOCAL ] BEN: Loaded 53501 existing records from primary storage. [2025-10-24T00:45:25.076966] [INFO ] [MAIN ] BEN: Loaded 53501 primary data records. [2025-10-24T00:45:25.196010] [DEBUG] [LOCAL ] BEKE: Loaded 53575 existing records from primary storage. [2025-10-24T00:45:25.207415] [INFO ] [MAIN ] BEKE: Loaded 53575 primary data records. [2025-10-24T00:45:25.585266] [DEBUG] [MAIN ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:25.754104] [DEBUG] [MAIN ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:25.774001] [INFO ] [MAIN ] BE: Generated 139 derivative records from 54051 primary records. [2025-10-24T00:45:25.776009] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-24T00:45:25.776568] [FATAL] [LOCAL ] BE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:25.789341] [FATAL] [MAIN ] BE: Failed to save derivative data. [2025-10-24T00:45:25.789684] [DEBUG] [MAIN ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:25.793269] [INFO ] [MAIN ] Derivative Progress: 223/2164 symbols completed. BE took 1.2s. Estimated remaining: 13m 8s. Rate: 147.8 symbols/min [2025-10-24T00:45:25.839736] [INFO ] [MAIN ] BEN: Generated 139 derivative records from 53501 primary records. [2025-10-24T00:45:25.840052] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-24T00:45:25.841868] [INFO ] [MAIN ] BEKE: Generated 139 derivative records from 53575 primary records. [2025-10-24T00:45:25.842065] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-24T00:45:25.842305] [FATAL] [LOCAL ] BEKE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:25.842689] [FATAL] [MAIN ] BEKE: Failed to save derivative data. [2025-10-24T00:45:25.842588] [FATAL] [LOCAL ] BEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:25.845024] [INFO ] [MAIN ] Derivative Progress: 224/2164 symbols completed. BEKE took 1.2s. Estimated remaining: 13m 4s. Rate: 148.4 symbols/min [2025-10-24T00:45:25.845324] [FATAL] [MAIN ] BEN: Failed to save derivative data. [2025-10-24T00:45:25.848922] [INFO ] [MAIN ] Derivative Progress: 225/2164 symbols completed. BEN took 1.2s. Estimated remaining: 13m 1s. Rate: 149.0 symbols/min [2025-10-24T00:45:25.849319] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:25.849442] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:25.849525] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:25.859227] [DEBUG] [LOCAL ] BEPH: Loaded 4915 existing records from primary storage. [2025-10-24T00:45:25.859735] [INFO ] [MAIN ] BEPH: Loaded 4915 primary data records. [2025-10-24T00:45:26.205825] [DEBUG] [LOCAL ] BEP: Loaded 39180 existing records from primary storage. [2025-10-24T00:45:26.206487] [DEBUG] [LOCAL ] BEPC: Loaded 46678 existing records from primary storage. [2025-10-24T00:45:26.207366] [INFO ] [MAIN ] BEP: Loaded 39180 primary data records. [2025-10-24T00:45:26.207700] [INFO ] [MAIN ] BEPC: Loaded 46678 primary data records. [2025-10-24T00:45:26.868772] [DEBUG] [MAIN ] BEPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:26.926769] [DEBUG] [MAIN ] BEPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:26.926954] [DEBUG] [MAIN ] BEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:26.973776] [INFO ] [MAIN ] BEPH: Generated 139 derivative records from 4915 primary records. [2025-10-24T00:45:26.974697] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-24T00:45:26.977617] [FATAL] [LOCAL ] BEPH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:26.979078] [FATAL] [MAIN ] BEPH: Failed to save derivative data. [2025-10-24T00:45:26.988398] [INFO ] [MAIN ] Derivative Progress: 226/2164 symbols completed. BEPH took 1.1s. Estimated remaining: 13m 7s. Rate: 147.8 symbols/min [2025-10-24T00:45:26.989158] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:27.005557] [DEBUG] [LOCAL ] BEPI: Loaded 3579 existing records from primary storage. [2025-10-24T00:45:27.010377] [INFO ] [MAIN ] BEP: Generated 139 derivative records from 39180 primary records. [2025-10-24T00:45:27.010489] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-24T00:45:27.010989] [INFO ] [MAIN ] BEPI: Loaded 3579 primary data records. [2025-10-24T00:45:27.010817] [FATAL] [LOCAL ] BEP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:27.032804] [FATAL] [MAIN ] BEP: Failed to save derivative data. [2025-10-24T00:45:27.045211] [INFO ] [MAIN ] Derivative Progress: 227/2164 symbols completed. BEP took 1.2s. Estimated remaining: 13m 3s. Rate: 148.4 symbols/min [2025-10-24T00:45:27.102353] [INFO ] [MAIN ] BEPC: Generated 139 derivative records from 46678 primary records. [2025-10-24T00:45:27.090075] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:27.102507] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-24T00:45:27.120048] [FATAL] [LOCAL ] BEPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:27.126035] [FATAL] [MAIN ] BEPC: Failed to save derivative data. [2025-10-24T00:45:27.150425] [INFO ] [MAIN ] Derivative Progress: 228/2164 symbols completed. BEPC took 1.3s. Estimated remaining: 13m 0s. Rate: 148.9 symbols/min [2025-10-24T00:45:27.164166] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:27.206611] [DEBUG] [LOCAL ] BEPJ: Loaded 3089 existing records from primary storage. [2025-10-24T00:45:27.327757] [INFO ] [MAIN ] BEPJ: Loaded 3089 primary data records. [2025-10-24T00:45:27.660042] [DEBUG] [LOCAL ] BFAM: Loaded 34042 existing records from primary storage. [2025-10-24T00:45:27.674835] [INFO ] [MAIN ] BFAM: Loaded 34042 primary data records. [2025-10-24T00:45:28.016438] [DEBUG] [MAIN ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:28.056501] [DEBUG] [MAIN ] BEPJ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:28.106410] [DEBUG] [MAIN ] BFAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:28.126392] [INFO ] [MAIN ] BEPI: Generated 139 derivative records from 3579 primary records. [2025-10-24T00:45:28.128532] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-24T00:45:28.129354] [FATAL] [LOCAL ] BEPI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:28.131894] [FATAL] [MAIN ] BEPI: Failed to save derivative data. [2025-10-24T00:45:28.134117] [INFO ] [MAIN ] Derivative Progress: 229/2164 symbols completed. BEPI took 1.1s. Estimated remaining: 13m 5s. Rate: 148.0 symbols/min [2025-10-24T00:45:28.134424] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:28.146992] [INFO ] [MAIN ] BEPJ: Generated 139 derivative records from 3089 primary records. [2025-10-24T00:45:28.151734] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-24T00:45:28.154628] [FATAL] [LOCAL ] BEPJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:28.155043] [FATAL] [MAIN ] BEPJ: Failed to save derivative data. [2025-10-24T00:45:28.157814] [INFO ] [MAIN ] Derivative Progress: 230/2164 symbols completed. BEPJ took 1.1s. Estimated remaining: 13m 1s. Rate: 148.6 symbols/min [2025-10-24T00:45:28.160122] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:28.162756] [INFO ] [MAIN ] BFAM: Generated 139 derivative records from 34042 primary records. [2025-10-24T00:45:28.162977] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-24T00:45:28.163183] [FATAL] [LOCAL ] BFAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:28.163260] [FATAL] [MAIN ] BFAM: Failed to save derivative data. [2025-10-24T00:45:28.165672] [INFO ] [MAIN ] Derivative Progress: 231/2164 symbols completed. BFAM took 1.0s. Estimated remaining: 12m 57s. Rate: 149.2 symbols/min [2025-10-24T00:45:28.166032] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:28.187987] [DEBUG] [LOCAL ] BFK: Loaded 14005 existing records from primary storage. [2025-10-24T00:45:28.198848] [INFO ] [MAIN ] BFK: Loaded 14005 primary data records. [2025-10-24T00:45:28.237596] [DEBUG] [LOCAL ] BFH: Loaded 41734 existing records from primary storage. [2025-10-24T00:45:28.270372] [INFO ] [MAIN ] BFH: Loaded 41734 primary data records. [2025-10-24T00:45:28.655072] [DEBUG] [LOCAL ] BFLY: Loaded 52246 existing records from primary storage. [2025-10-24T00:45:28.681990] [INFO ] [MAIN ] BFLY: Loaded 52246 primary data records. [2025-10-24T00:45:29.231313] [DEBUG] [MAIN ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:29.272548] [DEBUG] [MAIN ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:29.322024] [DEBUG] [MAIN ] BFLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:29.357413] [INFO ] [MAIN ] BFK: Generated 139 derivative records from 14005 primary records. [2025-10-24T00:45:29.360763] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-24T00:45:29.363205] [FATAL] [LOCAL ] BFK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:29.366053] [INFO ] [MAIN ] BFH: Generated 139 derivative records from 41734 primary records. [2025-10-24T00:45:29.365832] [FATAL] [MAIN ] BFK: Failed to save derivative data. [2025-10-24T00:45:29.368380] [INFO ] [MAIN ] Derivative Progress: 232/2164 symbols completed. BFK took 1.2s. Estimated remaining: 13m 4s. Rate: 147.9 symbols/min [2025-10-24T00:45:29.368556] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-24T00:45:29.368680] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:29.368957] [FATAL] [LOCAL ] BFH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:29.371409] [FATAL] [MAIN ] BFH: Failed to save derivative data. [2025-10-24T00:45:29.373737] [INFO ] [MAIN ] Derivative Progress: 233/2164 symbols completed. BFH took 1.2s. Estimated remaining: 12m 60s. Rate: 148.6 symbols/min [2025-10-24T00:45:29.376467] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:29.390972] [INFO ] [MAIN ] BFLY: Generated 139 derivative records from 52246 primary records. [2025-10-24T00:45:29.394164] [DEBUG] [LOCAL ] BFS: Loaded 9613 existing records from primary storage. [2025-10-24T00:45:29.394356] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-24T00:45:29.394731] [FATAL] [LOCAL ] BFLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:29.394899] [FATAL] [MAIN ] BFLY: Failed to save derivative data. [2025-10-24T00:45:29.394998] [INFO ] [MAIN ] BFS: Loaded 9613 primary data records. [2025-10-24T00:45:29.408610] [INFO ] [MAIN ] Derivative Progress: 234/2164 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 56s. Rate: 149.1 symbols/min [2025-10-24T00:45:29.418383] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:29.475823] [DEBUG] [LOCAL ] BFZ: Loaded 12179 existing records from primary storage. [2025-10-24T00:45:29.505198] [INFO ] [MAIN ] BFZ: Loaded 12179 primary data records. [2025-10-24T00:45:30.049361] [DEBUG] [LOCAL ] BG: Loaded 50877 existing records from primary storage. [2025-10-24T00:45:30.050067] [INFO ] [MAIN ] BG: Loaded 50877 primary data records. [2025-10-24T00:45:30.377507] [DEBUG] [MAIN ] BFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:30.414127] [DEBUG] [MAIN ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:30.464197] [DEBUG] [MAIN ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:30.490950] [INFO ] [MAIN ] BFS: Generated 139 derivative records from 9613 primary records. [2025-10-24T00:45:30.491497] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-24T00:45:30.491781] [FATAL] [LOCAL ] BFS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:30.493251] [FATAL] [MAIN ] BFS: Failed to save derivative data. [2025-10-24T00:45:30.495661] [INFO ] [MAIN ] Derivative Progress: 235/2164 symbols completed. BFS took 1.1s. Estimated remaining: 13m 2s. Rate: 148.1 symbols/min [2025-10-24T00:45:30.499313] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:30.510752] [INFO ] [MAIN ] BFZ: Generated 139 derivative records from 12179 primary records. [2025-10-24T00:45:30.511451] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-24T00:45:30.511728] [FATAL] [LOCAL ] BFZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:30.517305] [FATAL] [MAIN ] BFZ: Failed to save derivative data. [2025-10-24T00:45:30.520120] [INFO ] [MAIN ] Derivative Progress: 236/2164 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 58s. Rate: 148.7 symbols/min [2025-10-24T00:45:30.520283] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:30.532331] [DEBUG] [LOCAL ] BGB: Loaded 17727 existing records from primary storage. [2025-10-24T00:45:30.535179] [INFO ] [MAIN ] BGB: Loaded 17727 primary data records. [2025-10-24T00:45:30.644206] [INFO ] [MAIN ] BG: Generated 139 derivative records from 50877 primary records. [2025-10-24T00:45:30.665952] [DEBUG] [LOCAL ] BGH: Loaded 17182 existing records from primary storage. [2025-10-24T00:45:30.665586] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-24T00:45:30.705053] [FATAL] [LOCAL ] BG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:30.704752] [INFO ] [MAIN ] BGH: Loaded 17182 primary data records. [2025-10-24T00:45:30.721693] [FATAL] [MAIN ] BG: Failed to save derivative data. [2025-10-24T00:45:30.887148] [INFO ] [MAIN ] Derivative Progress: 237/2164 symbols completed. BG took 1.5s. Estimated remaining: 12m 57s. Rate: 148.7 symbols/min [2025-10-24T00:45:30.916470] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:31.082820] [DEBUG] [LOCAL ] BGR: Loaded 13505 existing records from primary storage. [2025-10-24T00:45:31.185930] [INFO ] [MAIN ] BGR: Loaded 13505 primary data records. [2025-10-24T00:45:31.419376] [DEBUG] [MAIN ] BGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:31.590064] [DEBUG] [MAIN ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:31.635944] [DEBUG] [MAIN ] BGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:31.655833] [INFO ] [MAIN ] BGB: Generated 139 derivative records from 17727 primary records. [2025-10-24T00:45:31.657561] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-24T00:45:31.658619] [FATAL] [LOCAL ] BGB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:31.662448] [FATAL] [MAIN ] BGB: Failed to save derivative data. [2025-10-24T00:45:31.665825] [INFO ] [MAIN ] Derivative Progress: 238/2164 symbols completed. BGB took 1.2s. Estimated remaining: 13m 0s. Rate: 148.1 symbols/min [2025-10-24T00:45:31.685685] [INFO ] [MAIN ] BGH: Generated 139 derivative records from 17182 primary records. [2025-10-24T00:45:31.687149] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-24T00:45:31.690211] [FATAL] [LOCAL ] BGH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:31.690395] [FATAL] [MAIN ] BGH: Failed to save derivative data. [2025-10-24T00:45:31.692983] [INFO ] [MAIN ] Derivative Progress: 239/2164 symbols completed. BGH took 1.2s. Estimated remaining: 12m 57s. Rate: 148.7 symbols/min [2025-10-24T00:45:31.698610] [INFO ] [MAIN ] BGR: Generated 139 derivative records from 13505 primary records. [2025-10-24T00:45:31.698826] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-24T00:45:31.699042] [FATAL] [LOCAL ] BGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:31.699119] [FATAL] [MAIN ] BGR: Failed to save derivative data. [2025-10-24T00:45:31.701686] [INFO ] [MAIN ] Derivative Progress: 240/2164 symbols completed. BGR took 0.8s. Estimated remaining: 12m 53s. Rate: 149.3 symbols/min [2025-10-24T00:45:31.702211] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:31.702344] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:31.702748] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:31.714140] [DEBUG] [LOCAL ] BGSF: Loaded 8278 existing records from primary storage. [2025-10-24T00:45:31.714590] [INFO ] [MAIN ] BGSF: Loaded 8278 primary data records. [2025-10-24T00:45:31.851572] [DEBUG] [LOCAL ] BGT: Loaded 16269 existing records from primary storage. [2025-10-24T00:45:31.863387] [INFO ] [MAIN ] BGT: Loaded 16269 primary data records. [2025-10-24T00:45:32.207927] [DEBUG] [LOCAL ] BGS: Loaded 50870 existing records from primary storage. [2025-10-24T00:45:32.268410] [INFO ] [MAIN ] BGS: Loaded 50870 primary data records. [2025-10-24T00:45:32.757190] [DEBUG] [MAIN ] BGSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:32.794316] [DEBUG] [MAIN ] BGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:32.838437] [DEBUG] [MAIN ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:32.860329] [INFO ] [MAIN ] BGSF: Generated 139 derivative records from 8278 primary records. [2025-10-24T00:45:32.863073] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-24T00:45:32.867528] [FATAL] [LOCAL ] BGSF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:32.868112] [FATAL] [MAIN ] BGSF: Failed to save derivative data. [2025-10-24T00:45:32.871331] [INFO ] [MAIN ] Derivative Progress: 241/2164 symbols completed. BGSF took 1.2s. Estimated remaining: 12m 59s. Rate: 148.2 symbols/min [2025-10-24T00:45:32.871852] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:32.887542] [INFO ] [MAIN ] BGT: Generated 139 derivative records from 16269 primary records. [2025-10-24T00:45:32.888102] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-24T00:45:32.888338] [FATAL] [LOCAL ] BGT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:32.888450] [FATAL] [MAIN ] BGT: Failed to save derivative data. [2025-10-24T00:45:32.892223] [INFO ] [MAIN ] Derivative Progress: 242/2164 symbols completed. BGT took 1.2s. Estimated remaining: 12m 55s. Rate: 148.7 symbols/min [2025-10-24T00:45:32.899080] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:32.899348] [DEBUG] [LOCAL ] BGX: Loaded 11274 existing records from primary storage. [2025-10-24T00:45:32.900629] [INFO ] [MAIN ] BGX: Loaded 11274 primary data records. [2025-10-24T00:45:32.958492] [INFO ] [MAIN ] BGS: Generated 139 derivative records from 50870 primary records. [2025-10-24T00:45:32.983887] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-24T00:45:33.007452] [FATAL] [LOCAL ] BGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:33.010746] [FATAL] [MAIN ] BGS: Failed to save derivative data. [2025-10-24T00:45:33.013134] [INFO ] [MAIN ] Derivative Progress: 243/2164 symbols completed. BGS took 1.3s. Estimated remaining: 12m 53s. Rate: 149.2 symbols/min [2025-10-24T00:45:33.014106] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:33.072104] [DEBUG] [LOCAL ] BGY: Loaded 21463 existing records from primary storage. [2025-10-24T00:45:33.085096] [INFO ] [MAIN ] BGY: Loaded 21463 primary data records. [2025-10-24T00:45:33.295373] [DEBUG] [LOCAL ] BH: Loaded 16562 existing records from primary storage. [2025-10-24T00:45:33.320128] [INFO ] [MAIN ] BH: Loaded 16562 primary data records. [2025-10-24T00:45:33.891086] [DEBUG] [MAIN ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:33.937198] [DEBUG] [MAIN ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:33.970059] [DEBUG] [MAIN ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:34.009599] [INFO ] [MAIN ] BGX: Generated 139 derivative records from 11274 primary records. [2025-10-24T00:45:34.010533] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-24T00:45:34.013608] [FATAL] [LOCAL ] BGX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:34.016328] [FATAL] [MAIN ] BGX: Failed to save derivative data. [2025-10-24T00:45:34.019749] [INFO ] [MAIN ] Derivative Progress: 244/2164 symbols completed. BGX took 1.1s. Estimated remaining: 12m 57s. Rate: 148.3 symbols/min [2025-10-24T00:45:34.024327] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:34.031979] [INFO ] [MAIN ] BGY: Generated 139 derivative records from 21463 primary records. [2025-10-24T00:45:34.034522] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-24T00:45:34.035158] [FATAL] [LOCAL ] BGY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:34.035817] [FATAL] [MAIN ] BGY: Failed to save derivative data. [2025-10-24T00:45:34.038564] [INFO ] [MAIN ] Derivative Progress: 245/2164 symbols completed. BGY took 1.1s. Estimated remaining: 12m 54s. Rate: 148.8 symbols/min [2025-10-24T00:45:34.039892] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:34.042500] [INFO ] [MAIN ] BH: Generated 139 derivative records from 16562 primary records. [2025-10-24T00:45:34.042779] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-24T00:45:34.043017] [FATAL] [LOCAL ] BH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:34.043235] [FATAL] [MAIN ] BH: Failed to save derivative data. [2025-10-24T00:45:34.045892] [INFO ] [MAIN ] Derivative Progress: 246/2164 symbols completed. BH took 1.0s. Estimated remaining: 12m 50s. Rate: 149.4 symbols/min [2025-10-24T00:45:34.046122] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:34.080470] [DEBUG] [LOCAL ] BHE: Loaded 23812 existing records from primary storage. [2025-10-24T00:45:34.093736] [INFO ] [MAIN ] BHE: Loaded 23812 primary data records. [2025-10-24T00:45:34.099902] [DEBUG] [LOCAL ] BHC: Loaded 46912 existing records from primary storage. [2025-10-24T00:45:34.138440] [INFO ] [MAIN ] BHC: Loaded 46912 primary data records. [2025-10-24T00:45:34.222415] [DEBUG] [LOCAL ] BHK: Loaded 24125 existing records from primary storage. [2025-10-24T00:45:34.275732] [INFO ] [MAIN ] BHK: Loaded 24125 primary data records. [2025-10-24T00:45:35.125457] [DEBUG] [MAIN ] BHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:35.132186] [DEBUG] [MAIN ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:35.179880] [DEBUG] [MAIN ] BHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:35.254910] [INFO ] [MAIN ] BHC: Generated 139 derivative records from 46912 primary records. [2025-10-24T00:45:35.257238] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-24T00:45:35.260506] [FATAL] [LOCAL ] BHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:35.257727] [INFO ] [MAIN ] BHE: Generated 139 derivative records from 23812 primary records. [2025-10-24T00:45:35.261321] [FATAL] [MAIN ] BHC: Failed to save derivative data. [2025-10-24T00:45:35.261230] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-24T00:45:35.265519] [FATAL] [LOCAL ] BHE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:35.266013] [FATAL] [MAIN ] BHE: Failed to save derivative data. [2025-10-24T00:45:35.264081] [INFO ] [MAIN ] Derivative Progress: 247/2164 symbols completed. BHC took 1.2s. Estimated remaining: 12m 56s. Rate: 148.2 symbols/min [2025-10-24T00:45:35.266290] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:35.269343] [INFO ] [MAIN ] Derivative Progress: 248/2164 symbols completed. BHE took 1.2s. Estimated remaining: 12m 53s. Rate: 148.8 symbols/min [2025-10-24T00:45:35.271959] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:35.273185] [INFO ] [MAIN ] BHK: Generated 139 derivative records from 24125 primary records. [2025-10-24T00:45:35.273665] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-24T00:45:35.273944] [FATAL] [LOCAL ] BHK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:35.274024] [FATAL] [MAIN ] BHK: Failed to save derivative data. [2025-10-24T00:45:35.276846] [INFO ] [MAIN ] Derivative Progress: 249/2164 symbols completed. BHK took 1.2s. Estimated remaining: 12m 49s. Rate: 149.4 symbols/min [2025-10-24T00:45:35.277055] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:35.300598] [DEBUG] [LOCAL ] BHR: Loaded 22181 existing records from primary storage. [2025-10-24T00:45:35.300841] [INFO ] [MAIN ] BHR: Loaded 22181 primary data records. [2025-10-24T00:45:35.548003] [DEBUG] [LOCAL ] BHVN: Loaded 51012 existing records from primary storage. [2025-10-24T00:45:35.549059] [INFO ] [MAIN ] BHVN: Loaded 51012 primary data records. [2025-10-24T00:45:35.548838] [DEBUG] [LOCAL ] BHP: Loaded 53753 existing records from primary storage. [2025-10-24T00:45:35.661433] [INFO ] [MAIN ] BHP: Loaded 53753 primary data records. [2025-10-24T00:45:36.281452] [DEBUG] [MAIN ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:36.329587] [DEBUG] [MAIN ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:36.334634] [DEBUG] [MAIN ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:36.390281] [INFO ] [MAIN ] BHR: Generated 139 derivative records from 22181 primary records. [2025-10-24T00:45:36.395582] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-24T00:45:36.396922] [FATAL] [LOCAL ] BHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:36.404259] [FATAL] [MAIN ] BHR: Failed to save derivative data. [2025-10-24T00:45:36.409369] [INFO ] [MAIN ] Derivative Progress: 250/2164 symbols completed. BHR took 1.1s. Estimated remaining: 12m 54s. Rate: 148.3 symbols/min [2025-10-24T00:45:36.414903] [INFO ] [MAIN ] BHP: Generated 139 derivative records from 53753 primary records. [2025-10-24T00:45:36.413040] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:36.415606] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-24T00:45:36.415365] [INFO ] [MAIN ] BHVN: Generated 139 derivative records from 51012 primary records. [2025-10-24T00:45:36.415896] [FATAL] [LOCAL ] BHP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:36.416031] [FATAL] [MAIN ] BHP: Failed to save derivative data. [2025-10-24T00:45:36.419874] [INFO ] [MAIN ] Derivative Progress: 251/2164 symbols completed. BHP took 1.2s. Estimated remaining: 12m 51s. Rate: 148.9 symbols/min [2025-10-24T00:45:36.420273] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:36.420183] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-24T00:45:36.421483] [FATAL] [LOCAL ] BHVN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:36.421686] [FATAL] [MAIN ] BHVN: Failed to save derivative data. [2025-10-24T00:45:36.425961] [INFO ] [MAIN ] Derivative Progress: 252/2164 symbols completed. BHVN took 1.1s. Estimated remaining: 12m 47s. Rate: 149.5 symbols/min [2025-10-24T00:45:36.426518] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:36.450072] [DEBUG] [LOCAL ] BIO: Loaded 23969 existing records from primary storage. [2025-10-24T00:45:36.450333] [INFO ] [MAIN ] BIO: Loaded 23969 primary data records. [2025-10-24T00:45:36.641757] [DEBUG] [LOCAL ] BIP: Loaded 39164 existing records from primary storage. [2025-10-24T00:45:36.659805] [INFO ] [MAIN ] BIP: Loaded 39164 primary data records. [2025-10-24T00:45:36.660981] [DEBUG] [LOCAL ] BILL: Loaded 52879 existing records from primary storage. [2025-10-24T00:45:36.734406] [INFO ] [MAIN ] BILL: Loaded 52879 primary data records. [2025-10-24T00:45:37.447808] [DEBUG] [MAIN ] BIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:37.481512] [DEBUG] [MAIN ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:37.514626] [DEBUG] [MAIN ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:37.552066] [INFO ] [MAIN ] BIO: Generated 139 derivative records from 23969 primary records. [2025-10-24T00:45:37.554741] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-24T00:45:37.555260] [FATAL] [LOCAL ] BIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:37.555507] [FATAL] [MAIN ] BIO: Failed to save derivative data. [2025-10-24T00:45:37.560924] [INFO ] [MAIN ] Derivative Progress: 253/2164 symbols completed. BIO took 1.1s. Estimated remaining: 12m 53s. Rate: 148.4 symbols/min [2025-10-24T00:45:37.576551] [INFO ] [MAIN ] BIP: Generated 139 derivative records from 39164 primary records. [2025-10-24T00:45:37.576753] [INFO ] [MAIN ] BILL: Generated 139 derivative records from 52879 primary records. [2025-10-24T00:45:37.576812] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-24T00:45:37.576922] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-24T00:45:37.577153] [FATAL] [LOCAL ] BIP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:37.577248] [FATAL] [MAIN ] BIP: Failed to save derivative data. [2025-10-24T00:45:37.579943] [INFO ] [MAIN ] Derivative Progress: 254/2164 symbols completed. BIP took 1.2s. Estimated remaining: 12m 49s. Rate: 149.0 symbols/min [2025-10-24T00:45:37.580284] [FATAL] [LOCAL ] BILL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:37.580417] [FATAL] [MAIN ] BILL: Failed to save derivative data. [2025-10-24T00:45:37.583944] [INFO ] [MAIN ] Derivative Progress: 255/2164 symbols completed. BILL took 1.2s. Estimated remaining: 12m 46s. Rate: 149.5 symbols/min [2025-10-24T00:45:37.584284] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:37.584358] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:37.584475] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:37.594262] [DEBUG] [LOCAL ] BIPI: Loaded 2834 existing records from primary storage. [2025-10-24T00:45:37.594122] [DEBUG] [LOCAL ] BIPH: Loaded 2366 existing records from primary storage. [2025-10-24T00:45:37.594563] [INFO ] [MAIN ] BIPH: Loaded 2366 primary data records. [2025-10-24T00:45:37.594677] [INFO ] [MAIN ] BIPI: Loaded 2834 primary data records. [2025-10-24T00:45:38.206893] [DEBUG] [LOCAL ] BIPC: Loaded 41390 existing records from primary storage. [2025-10-24T00:45:38.207763] [INFO ] [MAIN ] BIPC: Loaded 41390 primary data records. [2025-10-24T00:45:38.541255] [DEBUG] [MAIN ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:38.570526] [DEBUG] [MAIN ] BIPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:38.638981] [DEBUG] [MAIN ] BIPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:38.669676] [INFO ] [MAIN ] BIPI: Generated 139 derivative records from 2834 primary records. [2025-10-24T00:45:38.674044] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-24T00:45:38.678724] [FATAL] [LOCAL ] BIPI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:38.678973] [FATAL] [MAIN ] BIPI: Failed to save derivative data. [2025-10-24T00:45:38.679560] [INFO ] [MAIN ] BIPH: Generated 139 derivative records from 2366 primary records. [2025-10-24T00:45:38.679760] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-24T00:45:38.682362] [FATAL] [LOCAL ] BIPH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:38.682070] [INFO ] [MAIN ] Derivative Progress: 256/2164 symbols completed. BIPI took 1.1s. Estimated remaining: 12m 51s. Rate: 148.5 symbols/min [2025-10-24T00:45:38.685383] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:38.685569] [FATAL] [MAIN ] BIPH: Failed to save derivative data. [2025-10-24T00:45:38.688742] [INFO ] [MAIN ] Derivative Progress: 257/2164 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 47s. Rate: 149.1 symbols/min [2025-10-24T00:45:38.693551] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:38.698262] [DEBUG] [LOCAL ] BIPJ: Loaded 3108 existing records from primary storage. [2025-10-24T00:45:38.698760] [INFO ] [MAIN ] BIPJ: Loaded 3108 primary data records. [2025-10-24T00:45:38.815477] [INFO ] [MAIN ] BIPC: Generated 139 derivative records from 41390 primary records. [2025-10-24T00:45:38.866735] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-24T00:45:38.877604] [FATAL] [LOCAL ] BIPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:38.934337] [FATAL] [MAIN ] BIPC: Failed to save derivative data. [2025-10-24T00:45:39.058381] [INFO ] [MAIN ] Derivative Progress: 258/2164 symbols completed. BIPC took 1.5s. Estimated remaining: 12m 47s. Rate: 149.2 symbols/min [2025-10-24T00:45:39.073435] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:39.096959] [DEBUG] [LOCAL ] BIRK: Loaded 51506 existing records from primary storage. [2025-10-24T00:45:39.097615] [INFO ] [MAIN ] BIRK: Loaded 51506 primary data records. [2025-10-24T00:45:39.208523] [DEBUG] [LOCAL ] BIT: Loaded 23886 existing records from primary storage. [2025-10-24T00:45:39.220920] [INFO ] [MAIN ] BIT: Loaded 23886 primary data records. [2025-10-24T00:45:39.332318] [DEBUG] [MAIN ] BIPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:39.764453] [INFO ] [MAIN ] BIPJ: Generated 139 derivative records from 3108 primary records. [2025-10-24T00:45:39.764937] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-24T00:45:39.765228] [FATAL] [LOCAL ] BIPJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:39.765453] [FATAL] [MAIN ] BIPJ: Failed to save derivative data. [2025-10-24T00:45:39.769705] [INFO ] [MAIN ] Derivative Progress: 259/2164 symbols completed. BIPJ took 1.1s. Estimated remaining: 12m 49s. Rate: 148.7 symbols/min [2025-10-24T00:45:39.771740] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:39.786072] [DEBUG] [MAIN ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:39.846341] [DEBUG] [MAIN ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:39.883416] [INFO ] [MAIN ] BIRK: Generated 139 derivative records from 51506 primary records. [2025-10-24T00:45:39.884361] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-24T00:45:39.885244] [DEBUG] [LOCAL ] BJ: Loaded 51834 existing records from primary storage. [2025-10-24T00:45:39.885673] [FATAL] [LOCAL ] BIRK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:39.885997] [INFO ] [MAIN ] BJ: Loaded 51834 primary data records. [2025-10-24T00:45:39.886099] [FATAL] [MAIN ] BIRK: Failed to save derivative data. [2025-10-24T00:45:39.912519] [INFO ] [MAIN ] Derivative Progress: 260/2164 symbols completed. BIRK took 1.2s. Estimated remaining: 12m 46s. Rate: 149.1 symbols/min [2025-10-24T00:45:39.934736] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:40.224996] [INFO ] [MAIN ] BIT: Generated 139 derivative records from 23886 primary records. [2025-10-24T00:45:40.225879] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-24T00:45:40.226982] [FATAL] [LOCAL ] BIT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:40.227234] [FATAL] [MAIN ] BIT: Failed to save derivative data. [2025-10-24T00:45:40.233300] [INFO ] [MAIN ] Derivative Progress: 261/2164 symbols completed. BIT took 1.2s. Estimated remaining: 12m 45s. Rate: 149.2 symbols/min [2025-10-24T00:45:40.233458] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:40.254768] [DEBUG] [LOCAL ] BK: Loaded 53936 existing records from primary storage. [2025-10-24T00:45:40.255397] [INFO ] [MAIN ] BK: Loaded 53936 primary data records. [2025-10-24T00:45:40.404437] [DEBUG] [MAIN ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:40.493955] [DEBUG] [LOCAL ] BKD: Loaded 50716 existing records from primary storage. [2025-10-24T00:45:40.499006] [INFO ] [MAIN ] BKD: Loaded 50716 primary data records. [2025-10-24T00:45:40.988956] [INFO ] [MAIN ] BJ: Generated 139 derivative records from 51834 primary records. [2025-10-24T00:45:40.990995] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-24T00:45:40.991406] [FATAL] [LOCAL ] BJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:40.993367] [FATAL] [MAIN ] BJ: Failed to save derivative data. [2025-10-24T00:45:40.996240] [INFO ] [MAIN ] Derivative Progress: 262/2164 symbols completed. BJ took 1.2s. Estimated remaining: 12m 48s. Rate: 148.7 symbols/min [2025-10-24T00:45:40.996536] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:41.009972] [DEBUG] [MAIN ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:41.082002] [DEBUG] [MAIN ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:41.101034] [DEBUG] [LOCAL ] BKE: Loaded 33794 existing records from primary storage. [2025-10-24T00:45:41.102069] [INFO ] [MAIN ] BKE: Loaded 33794 primary data records. [2025-10-24T00:45:41.101730] [INFO ] [MAIN ] BK: Generated 139 derivative records from 53936 primary records. [2025-10-24T00:45:41.118908] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-24T00:45:41.137577] [FATAL] [LOCAL ] BK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:41.166480] [FATAL] [MAIN ] BK: Failed to save derivative data. [2025-10-24T00:45:41.182840] [INFO ] [MAIN ] Derivative Progress: 263/2164 symbols completed. BK took 1.2s. Estimated remaining: 12m 46s. Rate: 149.0 symbols/min [2025-10-24T00:45:41.225049] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:41.473250] [INFO ] [MAIN ] BKD: Generated 139 derivative records from 50716 primary records. [2025-10-24T00:45:41.475016] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-24T00:45:41.475631] [FATAL] [LOCAL ] BKD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:41.476420] [FATAL] [MAIN ] BKD: Failed to save derivative data. [2025-10-24T00:45:41.479420] [INFO ] [MAIN ] Derivative Progress: 264/2164 symbols completed. BKD took 1.2s. Estimated remaining: 12m 44s. Rate: 149.1 symbols/min [2025-10-24T00:45:41.479695] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:41.493284] [DEBUG] [LOCAL ] BKH: Loaded 37650 existing records from primary storage. [2025-10-24T00:45:41.494196] [INFO ] [MAIN ] BKH: Loaded 37650 primary data records. [2025-10-24T00:45:41.845899] [DEBUG] [MAIN ] BKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:41.847603] [DEBUG] [LOCAL ] BKKT: Loaded 37753 existing records from primary storage. [2025-10-24T00:45:41.861047] [INFO ] [MAIN ] BKKT: Loaded 37753 primary data records. [2025-10-24T00:45:42.207127] [DEBUG] [MAIN ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:42.221165] [INFO ] [MAIN ] BKE: Generated 139 derivative records from 33794 primary records. [2025-10-24T00:45:42.221403] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-24T00:45:42.221893] [FATAL] [LOCAL ] BKE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:42.223777] [FATAL] [MAIN ] BKE: Failed to save derivative data. [2025-10-24T00:45:42.226229] [INFO ] [MAIN ] Derivative Progress: 265/2164 symbols completed. BKE took 1.2s. Estimated remaining: 12m 46s. Rate: 148.7 symbols/min [2025-10-24T00:45:42.226620] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:42.256980] [DEBUG] [MAIN ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:42.254088] [DEBUG] [LOCAL ] BKN: Loaded 7337 existing records from primary storage. [2025-10-24T00:45:42.272711] [INFO ] [MAIN ] BKN: Loaded 7337 primary data records. [2025-10-24T00:45:42.511788] [INFO ] [MAIN ] BKH: Generated 139 derivative records from 37650 primary records. [2025-10-24T00:45:42.638617] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-24T00:45:42.640279] [FATAL] [LOCAL ] BKH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:42.642848] [FATAL] [MAIN ] BKH: Failed to save derivative data. [2025-10-24T00:45:42.647711] [INFO ] [MAIN ] Derivative Progress: 266/2164 symbols completed. BKH took 1.4s. Estimated remaining: 12m 46s. Rate: 148.6 symbols/min [2025-10-24T00:45:42.648133] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:42.654697] [INFO ] [MAIN ] BKKT: Generated 139 derivative records from 37753 primary records. [2025-10-24T00:45:42.654996] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-24T00:45:42.655787] [FATAL] [LOCAL ] BKKT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:42.656007] [FATAL] [MAIN ] BKKT: Failed to save derivative data. [2025-10-24T00:45:42.658764] [INFO ] [MAIN ] Derivative Progress: 267/2164 symbols completed. BKKT took 1.2s. Estimated remaining: 12m 43s. Rate: 149.2 symbols/min [2025-10-24T00:45:42.658982] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:42.677143] [DEBUG] [LOCAL ] BKT: Loaded 12907 existing records from primary storage. [2025-10-24T00:45:42.677598] [INFO ] [MAIN ] BKT: Loaded 12907 primary data records. [2025-10-24T00:45:42.745491] [DEBUG] [MAIN ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:42.916837] [DEBUG] [LOCAL ] BKSY: Loaded 49291 existing records from primary storage. [2025-10-24T00:45:43.072418] [INFO ] [MAIN ] BKSY: Loaded 49291 primary data records. [2025-10-24T00:45:43.417428] [INFO ] [MAIN ] BKN: Generated 139 derivative records from 7337 primary records. [2025-10-24T00:45:43.421187] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-24T00:45:43.423211] [FATAL] [LOCAL ] BKN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:43.436787] [FATAL] [MAIN ] BKN: Failed to save derivative data. [2025-10-24T00:45:43.439252] [INFO ] [MAIN ] Derivative Progress: 268/2164 symbols completed. BKN took 1.2s. Estimated remaining: 12m 45s. Rate: 148.7 symbols/min [2025-10-24T00:45:43.441498] [DEBUG] [MAIN ] BKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:43.493800] [INFO ] [MAIN ] BKT: Generated 139 derivative records from 12907 primary records. [2025-10-24T00:45:43.494405] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-24T00:45:43.494700] [FATAL] [LOCAL ] BKT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:43.494794] [FATAL] [MAIN ] BKT: Failed to save derivative data. [2025-10-24T00:45:43.494264] [DEBUG] [MAIN ] BKSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:43.497207] [INFO ] [MAIN ] Derivative Progress: 269/2164 symbols completed. BKT took 0.8s. Estimated remaining: 12m 42s. Rate: 149.1 symbols/min [2025-10-24T00:45:43.523379] [INFO ] [MAIN ] BKSY: Generated 139 derivative records from 49291 primary records. [2025-10-24T00:45:43.523580] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-24T00:45:43.523814] [FATAL] [LOCAL ] BKSY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:43.523892] [FATAL] [MAIN ] BKSY: Failed to save derivative data. [2025-10-24T00:45:43.526372] [INFO ] [MAIN ] Derivative Progress: 270/2164 symbols completed. BKSY took 0.9s. Estimated remaining: 12m 39s. Rate: 149.6 symbols/min [2025-10-24T00:45:43.526851] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:43.527000] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:43.527514] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:43.574800] [DEBUG] [LOCAL ] BKV: Loaded 29546 existing records from primary storage. [2025-10-24T00:45:43.574982] [INFO ] [MAIN ] BKV: Loaded 29546 primary data records. [2025-10-24T00:45:43.646062] [DEBUG] [LOCAL ] BLCO: Loaded 35092 existing records from primary storage. [2025-10-24T00:45:43.681682] [DEBUG] [LOCAL ] BKU: Loaded 42479 existing records from primary storage. [2025-10-24T00:45:43.681931] [INFO ] [MAIN ] BKU: Loaded 42479 primary data records. [2025-10-24T00:45:43.682169] [INFO ] [MAIN ] BLCO: Loaded 35092 primary data records. [2025-10-24T00:45:44.655760] [DEBUG] [MAIN ] BKV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:44.706393] [DEBUG] [MAIN ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:44.714322] [DEBUG] [MAIN ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:44.796279] [INFO ] [MAIN ] BKV: Generated 139 derivative records from 29546 primary records. [2025-10-24T00:45:44.798378] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-24T00:45:44.802054] [FATAL] [LOCAL ] BKV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:44.804489] [FATAL] [MAIN ] BKV: Failed to save derivative data. [2025-10-24T00:45:44.804198] [INFO ] [MAIN ] BLCO: Generated 139 derivative records from 35092 primary records. [2025-10-24T00:45:44.804842] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-24T00:45:44.806211] [FATAL] [LOCAL ] BLCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:44.808366] [INFO ] [MAIN ] Derivative Progress: 271/2164 symbols completed. BKV took 1.3s. Estimated remaining: 12m 45s. Rate: 148.4 symbols/min [2025-10-24T00:45:44.808823] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:44.809101] [FATAL] [MAIN ] BLCO: Failed to save derivative data. [2025-10-24T00:45:44.811371] [INFO ] [MAIN ] Derivative Progress: 272/2164 symbols completed. BLCO took 1.3s. Estimated remaining: 12m 42s. Rate: 149.0 symbols/min [2025-10-24T00:45:44.811687] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:44.814680] [INFO ] [MAIN ] BKU: Generated 139 derivative records from 42479 primary records. [2025-10-24T00:45:44.815075] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-24T00:45:44.815290] [FATAL] [LOCAL ] BKU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:44.815685] [FATAL] [MAIN ] BKU: Failed to save derivative data. [2025-10-24T00:45:44.818210] [INFO ] [MAIN ] Derivative Progress: 273/2164 symbols completed. BKU took 1.3s. Estimated remaining: 12m 39s. Rate: 149.5 symbols/min [2025-10-24T00:45:44.818471] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:44.831755] [DEBUG] [LOCAL ] BLE: Loaded 13680 existing records from primary storage. [2025-10-24T00:45:44.831978] [INFO ] [MAIN ] BLE: Loaded 13680 primary data records. [2025-10-24T00:45:44.956872] [DEBUG] [LOCAL ] BLD: Loaded 27205 existing records from primary storage. [2025-10-24T00:45:44.960604] [INFO ] [MAIN ] BLD: Loaded 27205 primary data records. [2025-10-24T00:45:45.115443] [DEBUG] [LOCAL ] BLK: Loaded 34356 existing records from primary storage. [2025-10-24T00:45:45.127682] [INFO ] [MAIN ] BLK: Loaded 34356 primary data records. [2025-10-24T00:45:45.850132] [DEBUG] [MAIN ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:45.876321] [DEBUG] [MAIN ] BLD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:45.913862] [DEBUG] [MAIN ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:45.985189] [INFO ] [MAIN ] BLE: Generated 139 derivative records from 13680 primary records. [2025-10-24T00:45:45.990697] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-24T00:45:45.991006] [FATAL] [LOCAL ] BLE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:45.991132] [FATAL] [MAIN ] BLE: Failed to save derivative data. [2025-10-24T00:45:45.990009] [INFO ] [MAIN ] BLD: Generated 139 derivative records from 27205 primary records. [2025-10-24T00:45:45.993464] [INFO ] [MAIN ] Derivative Progress: 274/2164 symbols completed. BLE took 1.2s. Estimated remaining: 12m 44s. Rate: 148.5 symbols/min [2025-10-24T00:45:45.993992] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:45.993851] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-24T00:45:45.998517] [INFO ] [MAIN ] BLK: Generated 139 derivative records from 34356 primary records. [2025-10-24T00:45:45.996544] [FATAL] [LOCAL ] BLD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:45.999179] [FATAL] [MAIN ] BLD: Failed to save derivative data. [2025-10-24T00:45:45.999093] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-24T00:45:46.002166] [FATAL] [LOCAL ] BLK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:46.002300] [FATAL] [MAIN ] BLK: Failed to save derivative data. [2025-10-24T00:45:46.001706] [INFO ] [MAIN ] Derivative Progress: 275/2164 symbols completed. BLD took 1.2s. Estimated remaining: 12m 41s. Rate: 149.0 symbols/min [2025-10-24T00:45:46.005335] [INFO ] [MAIN ] Derivative Progress: 276/2164 symbols completed. BLK took 1.2s. Estimated remaining: 12m 37s. Rate: 149.5 symbols/min [2025-10-24T00:45:46.005677] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:46.005222] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:46.026883] [DEBUG] [LOCAL ] BLX: Loaded 15499 existing records from primary storage. [2025-10-24T00:45:46.038074] [INFO ] [MAIN ] BLX: Loaded 15499 primary data records. [2025-10-24T00:45:46.147411] [DEBUG] [LOCAL ] BLW: Loaded 13028 existing records from primary storage. [2025-10-24T00:45:46.165615] [DEBUG] [LOCAL ] BLND: Loaded 49593 existing records from primary storage. [2025-10-24T00:45:46.169832] [INFO ] [MAIN ] BLW: Loaded 13028 primary data records. [2025-10-24T00:45:46.181428] [INFO ] [MAIN ] BLND: Loaded 49593 primary data records. [2025-10-24T00:45:47.165113] [DEBUG] [MAIN ] BLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:47.166144] [DEBUG] [MAIN ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:47.211595] [DEBUG] [MAIN ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:47.271287] [INFO ] [MAIN ] BLX: Generated 139 derivative records from 15499 primary records. [2025-10-24T00:45:47.275276] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-24T00:45:47.275634] [FATAL] [LOCAL ] BLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:47.275767] [FATAL] [MAIN ] BLX: Failed to save derivative data. [2025-10-24T00:45:47.278853] [INFO ] [MAIN ] Derivative Progress: 277/2164 symbols completed. BLX took 1.3s. Estimated remaining: 12m 43s. Rate: 148.4 symbols/min [2025-10-24T00:45:47.281852] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:47.285413] [INFO ] [MAIN ] BLW: Generated 139 derivative records from 13028 primary records. [2025-10-24T00:45:47.286257] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-24T00:45:47.288066] [FATAL] [LOCAL ] BLW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:47.288402] [FATAL] [MAIN ] BLW: Failed to save derivative data. [2025-10-24T00:45:47.291177] [INFO ] [MAIN ] Derivative Progress: 278/2164 symbols completed. BLW took 1.3s. Estimated remaining: 12m 40s. Rate: 148.9 symbols/min [2025-10-24T00:45:47.291363] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:47.291827] [INFO ] [MAIN ] BLND: Generated 139 derivative records from 49593 primary records. [2025-10-24T00:45:47.292289] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-24T00:45:47.292573] [FATAL] [LOCAL ] BLND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:47.292689] [FATAL] [MAIN ] BLND: Failed to save derivative data. [2025-10-24T00:45:47.295289] [INFO ] [MAIN ] Derivative Progress: 279/2164 symbols completed. BLND took 1.3s. Estimated remaining: 12m 37s. Rate: 149.4 symbols/min [2025-10-24T00:45:47.295940] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:47.307822] [DEBUG] [LOCAL ] BME: Loaded 11273 existing records from primary storage. [2025-10-24T00:45:47.308170] [INFO ] [MAIN ] BME: Loaded 11273 primary data records. [2025-10-24T00:45:47.438905] [DEBUG] [LOCAL ] BMEZ: Loaded 25188 existing records from primary storage. [2025-10-24T00:45:47.470790] [INFO ] [MAIN ] BMEZ: Loaded 25188 primary data records. [2025-10-24T00:45:47.520823] [DEBUG] [LOCAL ] BMA: Loaded 36874 existing records from primary storage. [2025-10-24T00:45:47.667281] [INFO ] [MAIN ] BMA: Loaded 36874 primary data records. [2025-10-24T00:45:48.291157] [DEBUG] [MAIN ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:48.347012] [DEBUG] [MAIN ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:48.374930] [DEBUG] [MAIN ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:48.403257] [INFO ] [MAIN ] BME: Generated 139 derivative records from 11273 primary records. [2025-10-24T00:45:48.405174] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-24T00:45:48.407297] [FATAL] [LOCAL ] BME: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:48.407801] [FATAL] [MAIN ] BME: Failed to save derivative data. [2025-10-24T00:45:48.414898] [INFO ] [MAIN ] Derivative Progress: 280/2164 symbols completed. BME took 1.1s. Estimated remaining: 12m 41s. Rate: 148.5 symbols/min [2025-10-24T00:45:48.416406] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:48.449570] [INFO ] [MAIN ] BMEZ: Generated 139 derivative records from 25188 primary records. [2025-10-24T00:45:48.450976] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-24T00:45:48.451392] [FATAL] [LOCAL ] BMEZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:48.453452] [INFO ] [MAIN ] BMA: Generated 139 derivative records from 36874 primary records. [2025-10-24T00:45:48.453680] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-24T00:45:48.453222] [FATAL] [MAIN ] BMEZ: Failed to save derivative data. [2025-10-24T00:45:48.458174] [FATAL] [LOCAL ] BMA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:48.457870] [INFO ] [MAIN ] Derivative Progress: 281/2164 symbols completed. BMEZ took 1.2s. Estimated remaining: 12m 38s. Rate: 149.0 symbols/min [2025-10-24T00:45:48.466455] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:48.466736] [FATAL] [MAIN ] BMA: Failed to save derivative data. [2025-10-24T00:45:48.470795] [INFO ] [MAIN ] Derivative Progress: 282/2164 symbols completed. BMA took 1.2s. Estimated remaining: 12m 35s. Rate: 149.5 symbols/min [2025-10-24T00:45:48.467765] [DEBUG] [LOCAL ] BMI: Loaded 25126 existing records from primary storage. [2025-10-24T00:45:48.470999] [INFO ] [MAIN ] BMI: Loaded 25126 primary data records. [2025-10-24T00:45:48.471105] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:48.540159] [DEBUG] [LOCAL ] BMN: Loaded 2661 existing records from primary storage. [2025-10-24T00:45:48.546287] [INFO ] [MAIN ] BMN: Loaded 2661 primary data records. [2025-10-24T00:45:49.207764] [DEBUG] [LOCAL ] BMO: Loaded 41220 existing records from primary storage. [2025-10-24T00:45:49.209195] [INFO ] [MAIN ] BMO: Loaded 41220 primary data records. [2025-10-24T00:45:49.524967] [DEBUG] [MAIN ] BMI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:45:49.562306] [DEBUG] [MAIN ] BMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:49.605690] [DEBUG] [MAIN ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:49.634387] [INFO ] [MAIN ] BMI: Generated 139 derivative records from 25126 primary records. [2025-10-24T00:45:49.639829] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-24T00:45:49.640675] [FATAL] [LOCAL ] BMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:49.642758] [FATAL] [MAIN ] BMI: Failed to save derivative data. [2025-10-24T00:45:49.648491] [INFO ] [MAIN ] Derivative Progress: 283/2164 symbols completed. BMI took 1.2s. Estimated remaining: 12m 40s. Rate: 148.5 symbols/min [2025-10-24T00:45:49.655966] [INFO ] [MAIN ] BMN: Generated 139 derivative records from 2661 primary records. [2025-10-24T00:45:49.656244] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-24T00:45:49.656573] [FATAL] [LOCAL ] BMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:49.658942] [FATAL] [MAIN ] BMN: Failed to save derivative data. [2025-10-24T00:45:49.661232] [INFO ] [MAIN ] Derivative Progress: 284/2164 symbols completed. BMN took 1.2s. Estimated remaining: 12m 37s. Rate: 149.0 symbols/min [2025-10-24T00:45:49.666691] [INFO ] [MAIN ] BMO: Generated 139 derivative records from 41220 primary records. [2025-10-24T00:45:49.666801] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-24T00:45:49.667003] [FATAL] [LOCAL ] BMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:49.667080] [FATAL] [MAIN ] BMO: Failed to save derivative data. [2025-10-24T00:45:49.669587] [INFO ] [MAIN ] Derivative Progress: 285/2164 symbols completed. BMO took 1.2s. Estimated remaining: 12m 34s. Rate: 149.5 symbols/min [2025-10-24T00:45:49.670148] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:49.670027] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:49.670436] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:49.701269] [DEBUG] [LOCAL ] BNED: Loaded 28371 existing records from primary storage. [2025-10-24T00:45:49.701581] [INFO ] [MAIN ] BNED: Loaded 28371 primary data records. [2025-10-24T00:45:50.056304] [DEBUG] [LOCAL ] BN: Loaded 53372 existing records from primary storage. [2025-10-24T00:45:50.056996] [INFO ] [MAIN ] BN: Loaded 53372 primary data records. [2025-10-24T00:45:50.129878] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-24T00:45:50.139877] [INFO ] [MAIN ] BMY: Loaded 54147 primary data records. [2025-10-24T00:45:50.689833] [DEBUG] [MAIN ] BNED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:50.737748] [DEBUG] [MAIN ] BN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:50.774003] [DEBUG] [MAIN ] BMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:50.801628] [INFO ] [MAIN ] BNED: Generated 139 derivative records from 28371 primary records. [2025-10-24T00:45:50.802447] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-24T00:45:50.805148] [FATAL] [LOCAL ] BNED: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:50.805812] [FATAL] [MAIN ] BNED: Failed to save derivative data. [2025-10-24T00:45:50.811713] [INFO ] [MAIN ] Derivative Progress: 286/2164 symbols completed. BNED took 1.1s. Estimated remaining: 12m 39s. Rate: 148.5 symbols/min [2025-10-24T00:45:50.814408] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:50.833297] [DEBUG] [LOCAL ] BNH: Loaded 4720 existing records from primary storage. [2025-10-24T00:45:50.834997] [INFO ] [MAIN ] BNH: Loaded 4720 primary data records. [2025-10-24T00:45:50.971238] [INFO ] [MAIN ] BN: Generated 139 derivative records from 53372 primary records. [2025-10-24T00:45:51.028280] [INFO ] [MAIN ] BMY: Generated 139 derivative records from 54147 primary records. [2025-10-24T00:45:51.182326] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-24T00:45:51.191243] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-24T00:45:51.192350] [FATAL] [LOCAL ] BMY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:51.192841] [FATAL] [LOCAL ] BN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:51.193159] [FATAL] [MAIN ] BN: Failed to save derivative data. [2025-10-24T00:45:51.193201] [FATAL] [MAIN ] BMY: Failed to save derivative data. [2025-10-24T00:45:51.196090] [INFO ] [MAIN ] Derivative Progress: 287/2164 symbols completed. BN took 1.5s. Estimated remaining: 12m 38s. Rate: 148.5 symbols/min [2025-10-24T00:45:51.196252] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:51.201404] [INFO ] [MAIN ] Derivative Progress: 288/2164 symbols completed. BMY took 1.5s. Estimated remaining: 12m 35s. Rate: 149.1 symbols/min [2025-10-24T00:45:51.201880] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:51.207569] [DEBUG] [LOCAL ] BNJ: Loaded 2508 existing records from primary storage. [2025-10-24T00:45:51.207938] [INFO ] [MAIN ] BNJ: Loaded 2508 primary data records. [2025-10-24T00:45:51.531816] [DEBUG] [MAIN ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:51.561841] [DEBUG] [LOCAL ] BNL: Loaded 47358 existing records from primary storage. [2025-10-24T00:45:51.565317] [INFO ] [MAIN ] BNL: Loaded 47358 primary data records. [2025-10-24T00:45:51.781055] [DEBUG] [MAIN ] BNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:51.936088] [INFO ] [MAIN ] BNH: Generated 139 derivative records from 4720 primary records. [2025-10-24T00:45:51.937365] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-24T00:45:51.940725] [FATAL] [LOCAL ] BNH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:51.941264] [FATAL] [MAIN ] BNH: Failed to save derivative data. [2025-10-24T00:45:51.945042] [INFO ] [MAIN ] Derivative Progress: 289/2164 symbols completed. BNH took 1.1s. Estimated remaining: 12m 37s. Rate: 148.6 symbols/min [2025-10-24T00:45:51.945382] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:51.973463] [INFO ] [MAIN ] BNJ: Generated 139 derivative records from 2508 primary records. [2025-10-24T00:45:51.974289] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-24T00:45:51.974227] [DEBUG] [MAIN ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:51.974826] [FATAL] [LOCAL ] BNJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:51.974982] [FATAL] [MAIN ] BNJ: Failed to save derivative data. [2025-10-24T00:45:51.977099] [INFO ] [MAIN ] Derivative Progress: 290/2164 symbols completed. BNJ took 0.8s. Estimated remaining: 12m 34s. Rate: 149.1 symbols/min [2025-10-24T00:45:51.989154] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:51.999984] [DEBUG] [LOCAL ] BNT: Loaded 3545 existing records from primary storage. [2025-10-24T00:45:52.017586] [INFO ] [MAIN ] BNT: Loaded 3545 primary data records. [2025-10-24T00:45:52.145413] [DEBUG] [LOCAL ] BNS: Loaded 51760 existing records from primary storage. [2025-10-24T00:45:52.156241] [INFO ] [MAIN ] BNS: Loaded 51760 primary data records. [2025-10-24T00:45:52.506850] [INFO ] [MAIN ] BNL: Generated 139 derivative records from 47358 primary records. [2025-10-24T00:45:52.534614] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-24T00:45:52.539233] [FATAL] [LOCAL ] BNL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:52.539450] [FATAL] [MAIN ] BNL: Failed to save derivative data. [2025-10-24T00:45:52.542003] [INFO ] [MAIN ] Derivative Progress: 291/2164 symbols completed. BNL took 1.3s. Estimated remaining: 12m 35s. Rate: 148.9 symbols/min [2025-10-24T00:45:52.542607] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:52.671461] [DEBUG] [LOCAL ] BNY: Loaded 7273 existing records from primary storage. [2025-10-24T00:45:52.672116] [INFO ] [MAIN ] BNY: Loaded 7273 primary data records. [2025-10-24T00:45:52.822200] [DEBUG] [MAIN ] BNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:53.014933] [DEBUG] [MAIN ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:53.094849] [INFO ] [MAIN ] BNT: Generated 139 derivative records from 3545 primary records. [2025-10-24T00:45:53.095039] [INFO ] [MAIN ] BNS: Generated 139 derivative records from 51760 primary records. [2025-10-24T00:45:53.096230] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-24T00:45:53.095887] [DEBUG] [MAIN ] BNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:53.106609] [FATAL] [LOCAL ] BNS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:53.095966] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-24T00:45:53.107782] [FATAL] [LOCAL ] BNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:53.108179] [FATAL] [MAIN ] BNS: Failed to save derivative data. [2025-10-24T00:45:53.108441] [FATAL] [MAIN ] BNT: Failed to save derivative data. [2025-10-24T00:45:53.110688] [INFO ] [MAIN ] Derivative Progress: 292/2164 symbols completed. BNT took 1.1s. Estimated remaining: 12m 35s. Rate: 148.7 symbols/min [2025-10-24T00:45:53.115057] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:53.115190] [INFO ] [MAIN ] Derivative Progress: 293/2164 symbols completed. BNS took 1.2s. Estimated remaining: 12m 33s. Rate: 149.2 symbols/min [2025-10-24T00:45:53.120268] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:53.143850] [INFO ] [MAIN ] BNY: Generated 139 derivative records from 7273 primary records. [2025-10-24T00:45:53.144071] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-24T00:45:53.144271] [FATAL] [LOCAL ] BNY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:53.144347] [FATAL] [MAIN ] BNY: Failed to save derivative data. [2025-10-24T00:45:53.146962] [INFO ] [MAIN ] Derivative Progress: 294/2164 symbols completed. BNY took 0.6s. Estimated remaining: 12m 30s. Rate: 149.6 symbols/min [2025-10-24T00:45:53.147250] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:53.161742] [DEBUG] [LOCAL ] BOE: Loaded 18140 existing records from primary storage. [2025-10-24T00:45:53.161353] [DEBUG] [LOCAL ] BOC: Loaded 18283 existing records from primary storage. [2025-10-24T00:45:53.162221] [INFO ] [MAIN ] BOE: Loaded 18140 primary data records. [2025-10-24T00:45:53.162148] [INFO ] [MAIN ] BOC: Loaded 18283 primary data records. [2025-10-24T00:45:53.466474] [DEBUG] [LOCAL ] BOH: Loaded 30852 existing records from primary storage. [2025-10-24T00:45:53.671457] [INFO ] [MAIN ] BOH: Loaded 30852 primary data records. [2025-10-24T00:45:54.115227] [DEBUG] [MAIN ] BOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:54.127992] [DEBUG] [MAIN ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:54.183561] [DEBUG] [MAIN ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:54.237320] [INFO ] [MAIN ] BOC: Generated 139 derivative records from 18283 primary records. [2025-10-24T00:45:54.243135] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-24T00:45:54.243608] [INFO ] [MAIN ] BOE: Generated 139 derivative records from 18140 primary records. [2025-10-24T00:45:54.245330] [FATAL] [LOCAL ] BOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:54.245571] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-24T00:45:54.245697] [FATAL] [MAIN ] BOC: Failed to save derivative data. [2025-10-24T00:45:54.248819] [INFO ] [MAIN ] Derivative Progress: 295/2164 symbols completed. BOC took 1.1s. Estimated remaining: 12m 34s. Rate: 148.8 symbols/min [2025-10-24T00:45:54.249503] [FATAL] [LOCAL ] BOE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:54.249077] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:54.249949] [FATAL] [MAIN ] BOE: Failed to save derivative data. [2025-10-24T00:45:54.254908] [INFO ] [MAIN ] Derivative Progress: 296/2164 symbols completed. BOE took 1.1s. Estimated remaining: 12m 31s. Rate: 149.3 symbols/min [2025-10-24T00:45:54.256401] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:54.260812] [INFO ] [MAIN ] BOH: Generated 139 derivative records from 30852 primary records. [2025-10-24T00:45:54.261097] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-24T00:45:54.261321] [FATAL] [LOCAL ] BOH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:54.261404] [FATAL] [MAIN ] BOH: Failed to save derivative data. [2025-10-24T00:45:54.264094] [INFO ] [MAIN ] Derivative Progress: 297/2164 symbols completed. BOH took 1.1s. Estimated remaining: 12m 28s. Rate: 149.8 symbols/min [2025-10-24T00:45:54.264371] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:54.319774] [DEBUG] [LOCAL ] BOW: Loaded 22949 existing records from primary storage. [2025-10-24T00:45:54.320541] [DEBUG] [LOCAL ] BOND: Loaded 32652 existing records from primary storage. [2025-10-24T00:45:54.320875] [INFO ] [MAIN ] BOW: Loaded 22949 primary data records. [2025-10-24T00:45:54.321167] [INFO ] [MAIN ] BOND: Loaded 32652 primary data records. [2025-10-24T00:45:54.527432] [DEBUG] [LOCAL ] BORR: Loaded 51455 existing records from primary storage. [2025-10-24T00:45:54.565771] [INFO ] [MAIN ] BORR: Loaded 51455 primary data records. [2025-10-24T00:45:55.332947] [DEBUG] [MAIN ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:55.370069] [DEBUG] [MAIN ] BOND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:55.410719] [DEBUG] [MAIN ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:55.459896] [INFO ] [MAIN ] BOW: Generated 139 derivative records from 22949 primary records. [2025-10-24T00:45:55.461494] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-24T00:45:55.464610] [FATAL] [LOCAL ] BOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:55.467376] [INFO ] [MAIN ] BOND: Generated 139 derivative records from 32652 primary records. [2025-10-24T00:45:55.467605] [FATAL] [MAIN ] BOW: Failed to save derivative data. [2025-10-24T00:45:55.471386] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-24T00:45:55.474243] [FATAL] [LOCAL ] BOND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:55.473885] [INFO ] [MAIN ] Derivative Progress: 298/2164 symbols completed. BOW took 1.2s. Estimated remaining: 12m 33s. Rate: 148.7 symbols/min [2025-10-24T00:45:55.474362] [FATAL] [MAIN ] BOND: Failed to save derivative data. [2025-10-24T00:45:55.478493] [INFO ] [MAIN ] Derivative Progress: 299/2164 symbols completed. BOND took 1.2s. Estimated remaining: 12m 30s. Rate: 149.2 symbols/min [2025-10-24T00:45:55.480744] [INFO ] [MAIN ] BORR: Generated 139 derivative records from 51455 primary records. [2025-10-24T00:45:55.480841] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-24T00:45:55.481044] [FATAL] [LOCAL ] BORR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:55.481121] [FATAL] [MAIN ] BORR: Failed to save derivative data. [2025-10-24T00:45:55.483843] [INFO ] [MAIN ] Derivative Progress: 300/2164 symbols completed. BORR took 1.2s. Estimated remaining: 12m 27s. Rate: 149.7 symbols/min [2025-10-24T00:45:55.484247] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:55.484374] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:55.484976] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:55.565588] [DEBUG] [LOCAL ] BR: Loaded 34763 existing records from primary storage. [2025-10-24T00:45:55.566573] [INFO ] [MAIN ] BR: Loaded 34763 primary data records. [2025-10-24T00:45:55.672593] [DEBUG] [LOCAL ] BOX: Loaded 50435 existing records from primary storage. [2025-10-24T00:45:55.699478] [DEBUG] [LOCAL ] BP: Loaded 54096 existing records from primary storage. [2025-10-24T00:45:55.699880] [INFO ] [MAIN ] BP: Loaded 54096 primary data records. [2025-10-24T00:45:55.699789] [INFO ] [MAIN ] BOX: Loaded 50435 primary data records. [2025-10-24T00:45:56.543745] [DEBUG] [MAIN ] BR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:56.578815] [DEBUG] [MAIN ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:56.608601] [DEBUG] [MAIN ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:56.676384] [INFO ] [MAIN ] BR: Generated 139 derivative records from 34763 primary records. [2025-10-24T00:45:56.677883] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-24T00:45:56.678434] [FATAL] [LOCAL ] BR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:56.678913] [FATAL] [MAIN ] BR: Failed to save derivative data. [2025-10-24T00:45:56.680859] [INFO ] [MAIN ] Derivative Progress: 301/2164 symbols completed. BR took 1.2s. Estimated remaining: 12m 31s. Rate: 148.8 symbols/min [2025-10-24T00:45:56.684254] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:56.690897] [INFO ] [MAIN ] BOX: Generated 139 derivative records from 50435 primary records. [2025-10-24T00:45:56.691747] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-24T00:45:56.691591] [INFO ] [MAIN ] BP: Generated 139 derivative records from 54096 primary records. [2025-10-24T00:45:56.692115] [FATAL] [LOCAL ] BOX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:56.692294] [FATAL] [MAIN ] BOX: Failed to save derivative data. [2025-10-24T00:45:56.692387] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-24T00:45:56.695314] [INFO ] [MAIN ] Derivative Progress: 302/2164 symbols completed. BOX took 1.2s. Estimated remaining: 12m 29s. Rate: 149.2 symbols/min [2025-10-24T00:45:56.692718] [FATAL] [LOCAL ] BP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:56.695517] [FATAL] [MAIN ] BP: Failed to save derivative data. [2025-10-24T00:45:56.698480] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:56.698609] [INFO ] [MAIN ] Derivative Progress: 303/2164 symbols completed. BP took 1.2s. Estimated remaining: 12m 26s. Rate: 149.7 symbols/min [2025-10-24T00:45:56.699167] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:56.719292] [DEBUG] [LOCAL ] BRC: Loaded 18403 existing records from primary storage. [2025-10-24T00:45:56.732942] [INFO ] [MAIN ] BRC: Loaded 18403 primary data records. [2025-10-24T00:45:56.868221] [DEBUG] [LOCAL ] BRCC: Loaded 40288 existing records from primary storage. [2025-10-24T00:45:56.874824] [DEBUG] [LOCAL ] BRBR: Loaded 52189 existing records from primary storage. [2025-10-24T00:45:56.875120] [INFO ] [MAIN ] BRBR: Loaded 52189 primary data records. [2025-10-24T00:45:56.880348] [INFO ] [MAIN ] BRCC: Loaded 40288 primary data records. [2025-10-24T00:45:57.726499] [DEBUG] [MAIN ] BRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:57.762621] [DEBUG] [MAIN ] BRCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:57.794681] [DEBUG] [MAIN ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:57.862281] [INFO ] [MAIN ] BRC: Generated 139 derivative records from 18403 primary records. [2025-10-24T00:45:57.865324] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-24T00:45:57.865735] [FATAL] [LOCAL ] BRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:57.867709] [FATAL] [MAIN ] BRC: Failed to save derivative data. [2025-10-24T00:45:57.867930] [INFO ] [MAIN ] BRCC: Generated 139 derivative records from 40288 primary records. [2025-10-24T00:45:57.870057] [INFO ] [MAIN ] Derivative Progress: 304/2164 symbols completed. BRC took 1.2s. Estimated remaining: 12m 30s. Rate: 148.8 symbols/min [2025-10-24T00:45:57.870400] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:57.871035] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-24T00:45:57.874888] [FATAL] [LOCAL ] BRCC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:57.875106] [FATAL] [MAIN ] BRCC: Failed to save derivative data. [2025-10-24T00:45:57.877726] [INFO ] [MAIN ] Derivative Progress: 305/2164 symbols completed. BRCC took 1.2s. Estimated remaining: 12m 27s. Rate: 149.3 symbols/min [2025-10-24T00:45:57.877979] [INFO ] [MAIN ] BRBR: Generated 139 derivative records from 52189 primary records. [2025-10-24T00:45:57.878447] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-24T00:45:57.878961] [FATAL] [LOCAL ] BRBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:57.879077] [FATAL] [MAIN ] BRBR: Failed to save derivative data. [2025-10-24T00:45:57.881927] [INFO ] [MAIN ] Derivative Progress: 306/2164 symbols completed. BRBR took 1.2s. Estimated remaining: 12m 24s. Rate: 149.7 symbols/min [2025-10-24T00:45:57.878377] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:57.882567] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:57.928749] [DEBUG] [LOCAL ] BRSP: Loaded 36715 existing records from primary storage. [2025-10-24T00:45:57.928923] [INFO ] [MAIN ] BRSP: Loaded 36715 primary data records. [2025-10-24T00:45:58.098300] [DEBUG] [LOCAL ] BRO: Loaded 52483 existing records from primary storage. [2025-10-24T00:45:58.110106] [INFO ] [MAIN ] BRO: Loaded 52483 primary data records. [2025-10-24T00:45:58.198581] [DEBUG] [LOCAL ] BROS: Loaded 53688 existing records from primary storage. [2025-10-24T00:45:58.243141] [INFO ] [MAIN ] BROS: Loaded 53688 primary data records. [2025-10-24T00:45:58.971807] [DEBUG] [MAIN ] BRSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:59.011282] [DEBUG] [MAIN ] BRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:59.044038] [DEBUG] [MAIN ] BROS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:45:59.092408] [INFO ] [MAIN ] BRSP: Generated 139 derivative records from 36715 primary records. [2025-10-24T00:45:59.096629] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-24T00:45:59.100702] [FATAL] [LOCAL ] BRSP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:59.103907] [FATAL] [MAIN ] BRSP: Failed to save derivative data. [2025-10-24T00:45:59.108065] [INFO ] [MAIN ] Derivative Progress: 307/2164 symbols completed. BRSP took 1.2s. Estimated remaining: 12m 29s. Rate: 148.7 symbols/min [2025-10-24T00:45:59.109481] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:59.126225] [INFO ] [MAIN ] BROS: Generated 139 derivative records from 53688 primary records. [2025-10-24T00:45:59.125972] [INFO ] [MAIN ] BRO: Generated 139 derivative records from 52483 primary records. [2025-10-24T00:45:59.129337] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-24T00:45:59.129448] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-24T00:45:59.129761] [FATAL] [LOCAL ] BRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:59.130116] [FATAL] [LOCAL ] BROS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:45:59.129064] [DEBUG] [LOCAL ] BRT: Loaded 5310 existing records from primary storage. [2025-10-24T00:45:59.130380] [INFO ] [MAIN ] BRT: Loaded 5310 primary data records. [2025-10-24T00:45:59.130275] [FATAL] [MAIN ] BRO: Failed to save derivative data. [2025-10-24T00:45:59.135812] [FATAL] [MAIN ] BROS: Failed to save derivative data. [2025-10-24T00:45:59.154631] [INFO ] [MAIN ] Derivative Progress: 308/2164 symbols completed. BRO took 1.3s. Estimated remaining: 12m 27s. Rate: 149.2 symbols/min [2025-10-24T00:45:59.180386] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:59.180594] [INFO ] [MAIN ] Derivative Progress: 309/2164 symbols completed. BROS took 1.3s. Estimated remaining: 12m 24s. Rate: 149.6 symbols/min [2025-10-24T00:45:59.180755] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:45:59.514593] [DEBUG] [LOCAL ] BRW: Loaded 21145 existing records from primary storage. [2025-10-24T00:45:59.514813] [INFO ] [MAIN ] BRW: Loaded 21145 primary data records. [2025-10-24T00:45:59.759677] [DEBUG] [LOCAL ] BRX: Loaded 52194 existing records from primary storage. [2025-10-24T00:45:59.759954] [INFO ] [MAIN ] BRX: Loaded 52194 primary data records. [2025-10-24T00:46:00.204530] [DEBUG] [MAIN ] BRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:00.242850] [DEBUG] [MAIN ] BRW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:00.299539] [DEBUG] [MAIN ] BRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:00.321278] [INFO ] [MAIN ] BRT: Generated 139 derivative records from 5310 primary records. [2025-10-24T00:46:00.323154] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-24T00:46:00.324185] [FATAL] [LOCAL ] BRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:00.326366] [FATAL] [MAIN ] BRT: Failed to save derivative data. [2025-10-24T00:46:00.331818] [INFO ] [MAIN ] Derivative Progress: 310/2164 symbols completed. BRT took 1.2s. Estimated remaining: 12m 28s. Rate: 148.7 symbols/min [2025-10-24T00:46:00.332492] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:00.338448] [INFO ] [MAIN ] BRW: Generated 139 derivative records from 21145 primary records. [2025-10-24T00:46:00.338779] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-24T00:46:00.341631] [FATAL] [LOCAL ] BRW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:00.342009] [FATAL] [MAIN ] BRW: Failed to save derivative data. [2025-10-24T00:46:00.349326] [INFO ] [MAIN ] Derivative Progress: 311/2164 symbols completed. BRW took 1.2s. Estimated remaining: 12m 25s. Rate: 149.2 symbols/min [2025-10-24T00:46:00.352333] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:00.356797] [INFO ] [MAIN ] BRX: Generated 139 derivative records from 52194 primary records. [2025-10-24T00:46:00.357049] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-24T00:46:00.357313] [FATAL] [LOCAL ] BRX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:00.357417] [FATAL] [MAIN ] BRX: Failed to save derivative data. [2025-10-24T00:46:00.360579] [INFO ] [MAIN ] Derivative Progress: 312/2164 symbols completed. BRX took 1.2s. Estimated remaining: 12m 23s. Rate: 149.7 symbols/min [2025-10-24T00:46:00.368799] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:00.384561] [DEBUG] [LOCAL ] BSAC: Loaded 33040 existing records from primary storage. [2025-10-24T00:46:00.384896] [INFO ] [MAIN ] BSAC: Loaded 33040 primary data records. [2025-10-24T00:46:00.401260] [DEBUG] [LOCAL ] BSL: Loaded 7937 existing records from primary storage. [2025-10-24T00:46:00.444270] [INFO ] [MAIN ] BSL: Loaded 7937 primary data records. [2025-10-24T00:46:00.676924] [DEBUG] [LOCAL ] BSBR: Loaded 36041 existing records from primary storage. [2025-10-24T00:46:00.863354] [INFO ] [MAIN ] BSBR: Loaded 36041 primary data records. [2025-10-24T00:46:01.480617] [DEBUG] [MAIN ] BSAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:01.514165] [DEBUG] [MAIN ] BSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:01.562532] [DEBUG] [MAIN ] BSBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:01.608370] [INFO ] [MAIN ] BSAC: Generated 139 derivative records from 33040 primary records. [2025-10-24T00:46:01.613864] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-24T00:46:01.614708] [INFO ] [MAIN ] BSL: Generated 139 derivative records from 7937 primary records. [2025-10-24T00:46:01.615114] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-24T00:46:01.614476] [FATAL] [LOCAL ] BSAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:01.615358] [FATAL] [LOCAL ] BSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:01.617014] [FATAL] [MAIN ] BSAC: Failed to save derivative data. [2025-10-24T00:46:01.617251] [FATAL] [MAIN ] BSL: Failed to save derivative data. [2025-10-24T00:46:01.620246] [INFO ] [MAIN ] Derivative Progress: 313/2164 symbols completed. BSAC took 1.3s. Estimated remaining: 12m 27s. Rate: 148.6 symbols/min [2025-10-24T00:46:01.627103] [INFO ] [MAIN ] Derivative Progress: 314/2164 symbols completed. BSL took 1.3s. Estimated remaining: 12m 24s. Rate: 149.1 symbols/min [2025-10-24T00:46:01.633052] [INFO ] [MAIN ] BSBR: Generated 139 derivative records from 36041 primary records. [2025-10-24T00:46:01.633238] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-24T00:46:01.633450] [FATAL] [LOCAL ] BSBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:01.633529] [FATAL] [MAIN ] BSBR: Failed to save derivative data. [2025-10-24T00:46:01.636319] [INFO ] [MAIN ] Derivative Progress: 315/2164 symbols completed. BSBR took 1.3s. Estimated remaining: 12m 22s. Rate: 149.6 symbols/min [2025-10-24T00:46:01.636829] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:01.637305] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:01.637464] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:01.672317] [DEBUG] [LOCAL ] BST: Loaded 18480 existing records from primary storage. [2025-10-24T00:46:01.672570] [INFO ] [MAIN ] BST: Loaded 18480 primary data records. [2025-10-24T00:46:01.733066] [DEBUG] [LOCAL ] BSTZ: Loaded 24564 existing records from primary storage. [2025-10-24T00:46:01.796691] [INFO ] [MAIN ] BSTZ: Loaded 24564 primary data records. [2025-10-24T00:46:01.797256] [DEBUG] [LOCAL ] BSM: Loaded 32463 existing records from primary storage. [2025-10-24T00:46:01.817934] [INFO ] [MAIN ] BSM: Loaded 32463 primary data records. [2025-10-24T00:46:02.715805] [DEBUG] [MAIN ] BST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:02.745714] [DEBUG] [MAIN ] BSTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:02.779177] [DEBUG] [MAIN ] BSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:02.837513] [INFO ] [MAIN ] BST: Generated 139 derivative records from 18480 primary records. [2025-10-24T00:46:02.837170] [INFO ] [MAIN ] BSTZ: Generated 139 derivative records from 24564 primary records. [2025-10-24T00:46:02.837757] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-24T00:46:02.838005] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-24T00:46:02.838281] [FATAL] [LOCAL ] BST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:02.838511] [FATAL] [LOCAL ] BSTZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:02.838683] [FATAL] [MAIN ] BSTZ: Failed to save derivative data. [2025-10-24T00:46:02.838596] [FATAL] [MAIN ] BST: Failed to save derivative data. [2025-10-24T00:46:02.843405] [INFO ] [MAIN ] Derivative Progress: 316/2164 symbols completed. BSTZ took 1.2s. Estimated remaining: 12m 26s. Rate: 148.6 symbols/min [2025-10-24T00:46:02.846070] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:02.846136] [INFO ] [MAIN ] Derivative Progress: 317/2164 symbols completed. BST took 1.2s. Estimated remaining: 12m 23s. Rate: 149.1 symbols/min [2025-10-24T00:46:02.848804] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:02.857140] [INFO ] [MAIN ] BSM: Generated 139 derivative records from 32463 primary records. [2025-10-24T00:46:02.860334] [DEBUG] [LOCAL ] BTA: Loaded 5788 existing records from primary storage. [2025-10-24T00:46:02.860464] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-24T00:46:02.861073] [FATAL] [LOCAL ] BSM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:02.860802] [INFO ] [MAIN ] BTA: Loaded 5788 primary data records. [2025-10-24T00:46:02.872240] [FATAL] [MAIN ] BSM: Failed to save derivative data. [2025-10-24T00:46:02.893962] [INFO ] [MAIN ] Derivative Progress: 318/2164 symbols completed. BSM took 1.3s. Estimated remaining: 12m 21s. Rate: 149.5 symbols/min [2025-10-24T00:46:02.894234] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:03.186778] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-24T00:46:03.187970] [INFO ] [MAIN ] BSX: Loaded 54078 primary data records. [2025-10-24T00:46:03.388086] [DEBUG] [LOCAL ] BTE: Loaded 53081 existing records from primary storage. [2025-10-24T00:46:03.512171] [INFO ] [MAIN ] BTE: Loaded 53081 primary data records. [2025-10-24T00:46:03.697976] [DEBUG] [MAIN ] BTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:03.933319] [DEBUG] [MAIN ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:03.952716] [INFO ] [MAIN ] BTA: Generated 139 derivative records from 5788 primary records. [2025-10-24T00:46:03.953981] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-24T00:46:03.958458] [FATAL] [LOCAL ] BTA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:03.958876] [FATAL] [MAIN ] BTA: Failed to save derivative data. [2025-10-24T00:46:03.961346] [INFO ] [MAIN ] Derivative Progress: 319/2164 symbols completed. BTA took 1.1s. Estimated remaining: 12m 24s. Rate: 148.7 symbols/min [2025-10-24T00:46:03.961716] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:03.974827] [DEBUG] [MAIN ] BTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:04.019046] [INFO ] [MAIN ] BSX: Generated 139 derivative records from 54078 primary records. [2025-10-24T00:46:04.019618] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-24T00:46:04.019883] [FATAL] [LOCAL ] BSX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:04.021393] [FATAL] [MAIN ] BSX: Failed to save derivative data. [2025-10-24T00:46:04.039473] [INFO ] [MAIN ] Derivative Progress: 320/2164 symbols completed. BSX took 1.2s. Estimated remaining: 12m 22s. Rate: 149.1 symbols/min [2025-10-24T00:46:04.043213] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:04.043424] [INFO ] [MAIN ] BTE: Generated 139 derivative records from 53081 primary records. [2025-10-24T00:46:04.043855] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-24T00:46:04.044100] [FATAL] [LOCAL ] BTE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:04.044292] [FATAL] [MAIN ] BTE: Failed to save derivative data. [2025-10-24T00:46:04.046974] [INFO ] [MAIN ] Derivative Progress: 321/2164 symbols completed. BTE took 1.2s. Estimated remaining: 12m 19s. Rate: 149.6 symbols/min [2025-10-24T00:46:04.047206] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:04.068280] [DEBUG] [LOCAL ] BTI: Loaded 53980 existing records from primary storage. [2025-10-24T00:46:04.068595] [INFO ] [MAIN ] BTI: Loaded 53980 primary data records. [2025-10-24T00:46:04.139348] [DEBUG] [LOCAL ] BTO: Loaded 8744 existing records from primary storage. [2025-10-24T00:46:04.167613] [INFO ] [MAIN ] BTO: Loaded 8744 primary data records. [2025-10-24T00:46:04.196614] [DEBUG] [LOCAL ] BTT: Loaded 15457 existing records from primary storage. [2025-10-24T00:46:04.270063] [INFO ] [MAIN ] BTT: Loaded 15457 primary data records. [2025-10-24T00:46:05.008494] [DEBUG] [MAIN ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:05.035022] [DEBUG] [MAIN ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:05.060455] [DEBUG] [MAIN ] BTT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:05.119253] [INFO ] [MAIN ] BTI: Generated 139 derivative records from 53980 primary records. [2025-10-24T00:46:05.122510] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-24T00:46:05.123706] [FATAL] [LOCAL ] BTI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:05.124822] [FATAL] [MAIN ] BTI: Failed to save derivative data. [2025-10-24T00:46:05.129761] [INFO ] [MAIN ] Derivative Progress: 322/2164 symbols completed. BTI took 1.2s. Estimated remaining: 12m 23s. Rate: 148.8 symbols/min [2025-10-24T00:46:05.129988] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:05.133576] [INFO ] [MAIN ] BTO: Generated 139 derivative records from 8744 primary records. [2025-10-24T00:46:05.133760] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-24T00:46:05.134185] [FATAL] [LOCAL ] BTO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:05.134274] [FATAL] [MAIN ] BTO: Failed to save derivative data. [2025-10-24T00:46:05.136880] [INFO ] [MAIN ] Derivative Progress: 323/2164 symbols completed. BTO took 1.1s. Estimated remaining: 12m 20s. Rate: 149.2 symbols/min [2025-10-24T00:46:05.138528] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:05.139749] [INFO ] [MAIN ] BTT: Generated 139 derivative records from 15457 primary records. [2025-10-24T00:46:05.140045] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-24T00:46:05.140266] [FATAL] [LOCAL ] BTT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:05.140342] [FATAL] [MAIN ] BTT: Failed to save derivative data. [2025-10-24T00:46:05.142945] [INFO ] [MAIN ] Derivative Progress: 324/2164 symbols completed. BTT took 1.1s. Estimated remaining: 12m 18s. Rate: 149.7 symbols/min [2025-10-24T00:46:05.143214] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:05.171073] [DEBUG] [LOCAL ] BTZ: Loaded 22521 existing records from primary storage. [2025-10-24T00:46:05.184460] [INFO ] [MAIN ] BTZ: Loaded 22521 primary data records. [2025-10-24T00:46:05.370030] [DEBUG] [LOCAL ] BTU: Loaded 53724 existing records from primary storage. [2025-10-24T00:46:05.379585] [DEBUG] [LOCAL ] BUD: Loaded 52986 existing records from primary storage. [2025-10-24T00:46:05.379922] [INFO ] [MAIN ] BUD: Loaded 52986 primary data records. [2025-10-24T00:46:05.389929] [INFO ] [MAIN ] BTU: Loaded 53724 primary data records. [2025-10-24T00:46:06.169587] [DEBUG] [MAIN ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:06.217297] [DEBUG] [MAIN ] BUD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:06.240934] [DEBUG] [MAIN ] BTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:06.286392] [INFO ] [MAIN ] BTZ: Generated 139 derivative records from 22521 primary records. [2025-10-24T00:46:06.292663] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-24T00:46:06.293202] [FATAL] [LOCAL ] BTZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:06.293303] [FATAL] [MAIN ] BTZ: Failed to save derivative data. [2025-10-24T00:46:06.295709] [INFO ] [MAIN ] Derivative Progress: 325/2164 symbols completed. BTZ took 1.2s. Estimated remaining: 12m 21s. Rate: 148.8 symbols/min [2025-10-24T00:46:06.298897] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:06.320426] [INFO ] [MAIN ] BTU: Generated 139 derivative records from 53724 primary records. [2025-10-24T00:46:06.320982] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-24T00:46:06.327175] [FATAL] [LOCAL ] BTU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:06.326868] [DEBUG] [LOCAL ] BUI: Loaded 11873 existing records from primary storage. [2025-10-24T00:46:06.327359] [FATAL] [MAIN ] BTU: Failed to save derivative data. [2025-10-24T00:46:06.329909] [INFO ] [MAIN ] Derivative Progress: 326/2164 symbols completed. BTU took 1.2s. Estimated remaining: 12m 19s. Rate: 149.2 symbols/min [2025-10-24T00:46:06.331718] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:06.327547] [INFO ] [MAIN ] BUI: Loaded 11873 primary data records. [2025-10-24T00:46:06.363602] [INFO ] [MAIN ] BUD: Generated 139 derivative records from 52986 primary records. [2025-10-24T00:46:06.407541] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-24T00:46:06.408131] [FATAL] [LOCAL ] BUD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:06.408210] [FATAL] [MAIN ] BUD: Failed to save derivative data. [2025-10-24T00:46:06.414094] [INFO ] [MAIN ] Derivative Progress: 327/2164 symbols completed. BUD took 1.3s. Estimated remaining: 12m 17s. Rate: 149.6 symbols/min [2025-10-24T00:46:06.425444] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:06.685725] [DEBUG] [LOCAL ] BUR: Loaded 45815 existing records from primary storage. [2025-10-24T00:46:06.686603] [INFO ] [MAIN ] BUR: Loaded 45815 primary data records. [2025-10-24T00:46:06.832486] [DEBUG] [LOCAL ] BURL: Loaded 45718 existing records from primary storage. [2025-10-24T00:46:06.843178] [INFO ] [MAIN ] BURL: Loaded 45718 primary data records. [2025-10-24T00:46:07.228314] [DEBUG] [MAIN ] BUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:07.466073] [DEBUG] [MAIN ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:07.480275] [INFO ] [MAIN ] BUI: Generated 139 derivative records from 11873 primary records. [2025-10-24T00:46:07.485844] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-24T00:46:07.486417] [FATAL] [LOCAL ] BUI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:07.486794] [FATAL] [MAIN ] BUI: Failed to save derivative data. [2025-10-24T00:46:07.490227] [INFO ] [MAIN ] Derivative Progress: 328/2164 symbols completed. BUI took 1.2s. Estimated remaining: 12m 20s. Rate: 148.8 symbols/min [2025-10-24T00:46:07.503913] [DEBUG] [MAIN ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:07.547226] [INFO ] [MAIN ] BUR: Generated 139 derivative records from 45815 primary records. [2025-10-24T00:46:07.550170] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-24T00:46:07.550466] [FATAL] [LOCAL ] BUR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:07.551842] [FATAL] [MAIN ] BUR: Failed to save derivative data. [2025-10-24T00:46:07.554714] [INFO ] [MAIN ] Derivative Progress: 329/2164 symbols completed. BUR took 1.2s. Estimated remaining: 12m 18s. Rate: 149.2 symbols/min [2025-10-24T00:46:07.559618] [INFO ] [MAIN ] BURL: Generated 139 derivative records from 45718 primary records. [2025-10-24T00:46:07.559825] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-24T00:46:07.560039] [FATAL] [LOCAL ] BURL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:07.560119] [FATAL] [MAIN ] BURL: Failed to save derivative data. [2025-10-24T00:46:07.562851] [INFO ] [MAIN ] Derivative Progress: 330/2164 symbols completed. BURL took 1.1s. Estimated remaining: 12m 15s. Rate: 149.7 symbols/min [2025-10-24T00:46:07.563236] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:07.563771] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:07.563832] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:07.582990] [DEBUG] [LOCAL ] BUXX: Loaded 15467 existing records from primary storage. [2025-10-24T00:46:07.583153] [INFO ] [MAIN ] BUXX: Loaded 15467 primary data records. [2025-10-24T00:46:07.940041] [DEBUG] [LOCAL ] BV: Loaded 38734 existing records from primary storage. [2025-10-24T00:46:07.942459] [DEBUG] [LOCAL ] BVN: Loaded 44895 existing records from primary storage. [2025-10-24T00:46:07.943019] [INFO ] [MAIN ] BVN: Loaded 44895 primary data records. [2025-10-24T00:46:07.942928] [INFO ] [MAIN ] BV: Loaded 38734 primary data records. [2025-10-24T00:46:08.665789] [DEBUG] [MAIN ] BUXX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:46:08.723618] [DEBUG] [MAIN ] BVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:08.750532] [DEBUG] [MAIN ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:08.774416] [INFO ] [MAIN ] BUXX: Generated 139 derivative records from 15467 primary records. [2025-10-24T00:46:08.779096] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-24T00:46:08.781583] [FATAL] [LOCAL ] BUXX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:08.783134] [FATAL] [MAIN ] BUXX: Failed to save derivative data. [2025-10-24T00:46:08.786144] [INFO ] [MAIN ] Derivative Progress: 331/2164 symbols completed. BUXX took 1.2s. Estimated remaining: 12m 19s. Rate: 148.7 symbols/min [2025-10-24T00:46:08.787623] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:08.815743] [INFO ] [MAIN ] BVN: Generated 139 derivative records from 44895 primary records. [2025-10-24T00:46:08.816073] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-24T00:46:08.829755] [FATAL] [LOCAL ] BVN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:08.829446] [INFO ] [MAIN ] BV: Generated 139 derivative records from 38734 primary records. [2025-10-24T00:46:08.830144] [FATAL] [MAIN ] BVN: Failed to save derivative data. [2025-10-24T00:46:08.830270] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-24T00:46:08.833063] [INFO ] [MAIN ] Derivative Progress: 332/2164 symbols completed. BVN took 1.3s. Estimated remaining: 12m 17s. Rate: 149.1 symbols/min [2025-10-24T00:46:08.833425] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:08.834280] [FATAL] [LOCAL ] BV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:08.834363] [FATAL] [MAIN ] BV: Failed to save derivative data. [2025-10-24T00:46:08.837974] [INFO ] [MAIN ] Derivative Progress: 333/2164 symbols completed. BV took 1.3s. Estimated remaining: 12m 14s. Rate: 149.6 symbols/min [2025-10-24T00:46:08.838262] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:08.861590] [DEBUG] [LOCAL ] BW: Loaded 40674 existing records from primary storage. [2025-10-24T00:46:08.862108] [INFO ] [MAIN ] BW: Loaded 40674 primary data records. [2025-10-24T00:46:08.922399] [DEBUG] [LOCAL ] BWG: Loaded 12676 existing records from primary storage. [2025-10-24T00:46:08.963616] [INFO ] [MAIN ] BWG: Loaded 12676 primary data records. [2025-10-24T00:46:09.202877] [DEBUG] [LOCAL ] BWA: Loaded 52452 existing records from primary storage. [2025-10-24T00:46:09.203128] [INFO ] [MAIN ] BWA: Loaded 52452 primary data records. [2025-10-24T00:46:10.055839] [DEBUG] [MAIN ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:10.105980] [DEBUG] [MAIN ] BWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:10.172335] [DEBUG] [MAIN ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:10.237803] [INFO ] [MAIN ] BW: Generated 139 derivative records from 40674 primary records. [2025-10-24T00:46:10.240694] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-24T00:46:10.245748] [INFO ] [MAIN ] BWG: Generated 139 derivative records from 12676 primary records. [2025-10-24T00:46:10.246392] [FATAL] [LOCAL ] BW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:10.245993] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-24T00:46:10.250097] [FATAL] [MAIN ] BW: Failed to save derivative data. [2025-10-24T00:46:10.250547] [FATAL] [LOCAL ] BWG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:10.253383] [INFO ] [MAIN ] Derivative Progress: 334/2164 symbols completed. BW took 1.5s. Estimated remaining: 12m 20s. Rate: 148.5 symbols/min [2025-10-24T00:46:10.253739] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:10.253821] [FATAL] [MAIN ] BWG: Failed to save derivative data. [2025-10-24T00:46:10.259576] [INFO ] [MAIN ] Derivative Progress: 335/2164 symbols completed. BWG took 1.4s. Estimated remaining: 12m 17s. Rate: 148.9 symbols/min [2025-10-24T00:46:10.265635] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:10.272136] [INFO ] [MAIN ] BWA: Generated 139 derivative records from 52452 primary records. [2025-10-24T00:46:10.272744] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-24T00:46:10.273542] [FATAL] [LOCAL ] BWA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:10.273673] [FATAL] [MAIN ] BWA: Failed to save derivative data. [2025-10-24T00:46:10.277712] [INFO ] [MAIN ] Derivative Progress: 336/2164 symbols completed. BWA took 1.4s. Estimated remaining: 12m 15s. Rate: 149.3 symbols/min [2025-10-24T00:46:10.278291] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:10.291470] [DEBUG] [LOCAL ] BWMX: Loaded 7900 existing records from primary storage. [2025-10-24T00:46:10.291836] [INFO ] [MAIN ] BWMX: Loaded 7900 primary data records. [2025-10-24T00:46:10.337958] [DEBUG] [LOCAL ] BWNB: Loaded 4067 existing records from primary storage. [2025-10-24T00:46:10.363124] [INFO ] [MAIN ] BWNB: Loaded 4067 primary data records. [2025-10-24T00:46:10.519559] [DEBUG] [LOCAL ] BWLP: Loaded 32265 existing records from primary storage. [2025-10-24T00:46:10.593381] [INFO ] [MAIN ] BWLP: Loaded 32265 primary data records. [2025-10-24T00:46:11.367303] [DEBUG] [MAIN ] BWMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:11.399361] [DEBUG] [MAIN ] BWNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:11.436888] [DEBUG] [MAIN ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:11.501272] [INFO ] [MAIN ] BWMX: Generated 139 derivative records from 7900 primary records. [2025-10-24T00:46:11.504232] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-24T00:46:11.504849] [FATAL] [LOCAL ] BWMX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:11.506406] [FATAL] [MAIN ] BWMX: Failed to save derivative data. [2025-10-24T00:46:11.510084] [INFO ] [MAIN ] Derivative Progress: 337/2164 symbols completed. BWMX took 1.2s. Estimated remaining: 12m 19s. Rate: 148.4 symbols/min [2025-10-24T00:46:11.510309] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:11.517309] [INFO ] [MAIN ] BWNB: Generated 139 derivative records from 4067 primary records. [2025-10-24T00:46:11.517772] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-24T00:46:11.519885] [FATAL] [LOCAL ] BWNB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:11.519627] [INFO ] [MAIN ] BWLP: Generated 139 derivative records from 32265 primary records. [2025-10-24T00:46:11.521735] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-24T00:46:11.521693] [FATAL] [MAIN ] BWNB: Failed to save derivative data. [2025-10-24T00:46:11.524828] [FATAL] [LOCAL ] BWLP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:11.525022] [FATAL] [MAIN ] BWLP: Failed to save derivative data. [2025-10-24T00:46:11.524567] [INFO ] [MAIN ] Derivative Progress: 338/2164 symbols completed. BWNB took 1.2s. Estimated remaining: 12m 16s. Rate: 148.8 symbols/min [2025-10-24T00:46:11.528099] [INFO ] [MAIN ] Derivative Progress: 339/2164 symbols completed. BWLP took 1.3s. Estimated remaining: 12m 14s. Rate: 149.3 symbols/min [2025-10-24T00:46:11.528007] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:11.528346] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:11.532620] [DEBUG] [LOCAL ] BWSN: Loaded 5082 existing records from primary storage. [2025-10-24T00:46:11.532931] [INFO ] [MAIN ] BWSN: Loaded 5082 primary data records. [2025-10-24T00:46:11.685016] [DEBUG] [LOCAL ] BXC: Loaded 13472 existing records from primary storage. [2025-10-24T00:46:11.857478] [INFO ] [MAIN ] BXC: Loaded 13472 primary data records. [2025-10-24T00:46:12.069238] [DEBUG] [LOCAL ] BWXT: Loaded 47605 existing records from primary storage. [2025-10-24T00:46:12.087004] [INFO ] [MAIN ] BWXT: Loaded 47605 primary data records. [2025-10-24T00:46:12.539042] [DEBUG] [MAIN ] BWSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:12.593420] [DEBUG] [MAIN ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:12.643208] [INFO ] [MAIN ] BWSN: Generated 139 derivative records from 5082 primary records. [2025-10-24T00:46:12.646142] [DEBUG] [MAIN ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:12.646471] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-24T00:46:12.664119] [FATAL] [LOCAL ] BWSN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:12.666361] [FATAL] [MAIN ] BWSN: Failed to save derivative data. [2025-10-24T00:46:12.669309] [INFO ] [MAIN ] Derivative Progress: 340/2164 symbols completed. BWSN took 1.2s. Estimated remaining: 12m 17s. Rate: 148.5 symbols/min [2025-10-24T00:46:12.671454] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:12.709084] [INFO ] [MAIN ] BXC: Generated 139 derivative records from 13472 primary records. [2025-10-24T00:46:12.712257] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-24T00:46:12.712869] [FATAL] [LOCAL ] BXC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:12.713132] [FATAL] [MAIN ] BXC: Failed to save derivative data. [2025-10-24T00:46:12.716002] [INFO ] [MAIN ] Derivative Progress: 341/2164 symbols completed. BXC took 1.2s. Estimated remaining: 12m 15s. Rate: 148.9 symbols/min [2025-10-24T00:46:12.716588] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:12.732789] [INFO ] [MAIN ] BWXT: Generated 139 derivative records from 47605 primary records. [2025-10-24T00:46:12.733129] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-24T00:46:12.733376] [FATAL] [LOCAL ] BWXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:12.733460] [FATAL] [MAIN ] BWXT: Failed to save derivative data. [2025-10-24T00:46:12.738204] [INFO ] [MAIN ] Derivative Progress: 342/2164 symbols completed. BWXT took 1.2s. Estimated remaining: 12m 12s. Rate: 149.3 symbols/min [2025-10-24T00:46:12.738821] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:12.761110] [DEBUG] [LOCAL ] BXMT: Loaded 47621 existing records from primary storage. [2025-10-24T00:46:12.761580] [INFO ] [MAIN ] BXMT: Loaded 47621 primary data records. [2025-10-24T00:46:12.811060] [DEBUG] [LOCAL ] BXMX: Loaded 19294 existing records from primary storage. [2025-10-24T00:46:12.823549] [INFO ] [MAIN ] BXMX: Loaded 19294 primary data records. [2025-10-24T00:46:13.278861] [DEBUG] [LOCAL ] BXP: Loaded 50203 existing records from primary storage. [2025-10-24T00:46:13.424454] [INFO ] [MAIN ] BXP: Loaded 50203 primary data records. [2025-10-24T00:46:13.768132] [DEBUG] [MAIN ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:13.809034] [DEBUG] [MAIN ] BXMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:13.850616] [DEBUG] [MAIN ] BXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:13.876723] [INFO ] [MAIN ] BXMT: Generated 139 derivative records from 47621 primary records. [2025-10-24T00:46:13.883459] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-24T00:46:13.883846] [FATAL] [LOCAL ] BXMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:13.885183] [FATAL] [MAIN ] BXMT: Failed to save derivative data. [2025-10-24T00:46:13.889105] [INFO ] [MAIN ] Derivative Progress: 343/2164 symbols completed. BXMT took 1.2s. Estimated remaining: 12m 16s. Rate: 148.5 symbols/min [2025-10-24T00:46:13.905055] [INFO ] [MAIN ] BXMX: Generated 139 derivative records from 19294 primary records. [2025-10-24T00:46:13.907536] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-24T00:46:13.908130] [FATAL] [LOCAL ] BXMX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:13.908282] [FATAL] [MAIN ] BXMX: Failed to save derivative data. [2025-10-24T00:46:13.910880] [INFO ] [MAIN ] Derivative Progress: 344/2164 symbols completed. BXMX took 1.2s. Estimated remaining: 12m 14s. Rate: 148.9 symbols/min [2025-10-24T00:46:13.913636] [INFO ] [MAIN ] BXP: Generated 139 derivative records from 50203 primary records. [2025-10-24T00:46:13.913765] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-24T00:46:13.913962] [FATAL] [LOCAL ] BXP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:13.914038] [FATAL] [MAIN ] BXP: Failed to save derivative data. [2025-10-24T00:46:13.917341] [INFO ] [MAIN ] Derivative Progress: 345/2164 symbols completed. BXP took 1.2s. Estimated remaining: 12m 11s. Rate: 149.3 symbols/min [2025-10-24T00:46:13.917879] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:13.917989] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:13.917798] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:13.945387] [DEBUG] [LOCAL ] BY: Loaded 21757 existing records from primary storage. [2025-10-24T00:46:13.956542] [INFO ] [MAIN ] BY: Loaded 21757 primary data records. [2025-10-24T00:46:14.104984] [DEBUG] [LOCAL ] BYD: Loaded 45312 existing records from primary storage. [2025-10-24T00:46:14.111369] [DEBUG] [LOCAL ] BXSL: Loaded 48587 existing records from primary storage. [2025-10-24T00:46:14.307264] [INFO ] [MAIN ] BYD: Loaded 45312 primary data records. [2025-10-24T00:46:14.307120] [INFO ] [MAIN ] BXSL: Loaded 48587 primary data records. [2025-10-24T00:46:14.948236] [DEBUG] [MAIN ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:14.996982] [DEBUG] [MAIN ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:15.023494] [DEBUG] [MAIN ] BXSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:15.047977] [INFO ] [MAIN ] BY: Generated 139 derivative records from 21757 primary records. [2025-10-24T00:46:15.048453] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-24T00:46:15.050126] [FATAL] [LOCAL ] BY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:15.053021] [FATAL] [MAIN ] BY: Failed to save derivative data. [2025-10-24T00:46:15.058638] [INFO ] [MAIN ] Derivative Progress: 346/2164 symbols completed. BY took 1.1s. Estimated remaining: 12m 14s. Rate: 148.5 symbols/min [2025-10-24T00:46:15.059318] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:15.088022] [DEBUG] [LOCAL ] BYM: Loaded 11423 existing records from primary storage. [2025-10-24T00:46:15.091668] [INFO ] [MAIN ] BYM: Loaded 11423 primary data records. [2025-10-24T00:46:15.091966] [INFO ] [MAIN ] BYD: Generated 139 derivative records from 45312 primary records. [2025-10-24T00:46:15.144163] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-24T00:46:15.167814] [FATAL] [LOCAL ] BYD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:15.201677] [FATAL] [MAIN ] BYD: Failed to save derivative data. [2025-10-24T00:46:15.216849] [INFO ] [MAIN ] Derivative Progress: 347/2164 symbols completed. BYD took 1.3s. Estimated remaining: 12m 13s. Rate: 148.8 symbols/min [2025-10-24T00:46:15.217241] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:15.230903] [INFO ] [MAIN ] BXSL: Generated 139 derivative records from 48587 primary records. [2025-10-24T00:46:15.252279] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-24T00:46:15.279773] [FATAL] [LOCAL ] BXSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:15.299724] [FATAL] [MAIN ] BXSL: Failed to save derivative data. [2025-10-24T00:46:15.413589] [INFO ] [MAIN ] Derivative Progress: 348/2164 symbols completed. BXSL took 1.5s. Estimated remaining: 12m 11s. Rate: 149.0 symbols/min [2025-10-24T00:46:15.422942] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:15.461623] [DEBUG] [LOCAL ] BZH: Loaded 32220 existing records from primary storage. [2025-10-24T00:46:15.462105] [INFO ] [MAIN ] BZH: Loaded 32220 primary data records. [2025-10-24T00:46:15.460795] [DEBUG] [LOCAL ] CAAP: Loaded 20016 existing records from primary storage. [2025-10-24T00:46:15.484069] [INFO ] [MAIN ] CAAP: Loaded 20016 primary data records. [2025-10-24T00:46:15.953348] [DEBUG] [MAIN ] BYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:16.187351] [INFO ] [MAIN ] BYM: Generated 139 derivative records from 11423 primary records. [2025-10-24T00:46:16.187754] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-24T00:46:16.189087] [FATAL] [LOCAL ] BYM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:16.190030] [FATAL] [MAIN ] BYM: Failed to save derivative data. [2025-10-24T00:46:16.192278] [INFO ] [MAIN ] Derivative Progress: 349/2164 symbols completed. BYM took 1.1s. Estimated remaining: 12m 13s. Rate: 148.6 symbols/min [2025-10-24T00:46:16.193381] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:16.209557] [DEBUG] [MAIN ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:16.240621] [DEBUG] [MAIN ] CAAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:16.265978] [DEBUG] [LOCAL ] CABO: Loaded 16738 existing records from primary storage. [2025-10-24T00:46:16.267463] [INFO ] [MAIN ] CABO: Loaded 16738 primary data records. [2025-10-24T00:46:16.591246] [INFO ] [MAIN ] BZH: Generated 139 derivative records from 32220 primary records. [2025-10-24T00:46:16.593893] [INFO ] [MAIN ] CAAP: Generated 139 derivative records from 20016 primary records. [2025-10-24T00:46:16.594063] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-24T00:46:16.594351] [FATAL] [LOCAL ] CAAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:16.594449] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-24T00:46:16.595352] [FATAL] [MAIN ] CAAP: Failed to save derivative data. [2025-10-24T00:46:16.598449] [INFO ] [MAIN ] Derivative Progress: 350/2164 symbols completed. CAAP took 1.2s. Estimated remaining: 12m 12s. Rate: 148.6 symbols/min [2025-10-24T00:46:16.598912] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:16.598784] [FATAL] [LOCAL ] BZH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:16.599596] [FATAL] [MAIN ] BZH: Failed to save derivative data. [2025-10-24T00:46:16.602248] [INFO ] [MAIN ] Derivative Progress: 351/2164 symbols completed. BZH took 1.4s. Estimated remaining: 12m 10s. Rate: 149.0 symbols/min [2025-10-24T00:46:16.602626] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:16.621174] [DEBUG] [MAIN ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:16.653696] [DEBUG] [LOCAL ] CACI: Loaded 22671 existing records from primary storage. [2025-10-24T00:46:16.656605] [INFO ] [MAIN ] CACI: Loaded 22671 primary data records. [2025-10-24T00:46:16.871971] [DEBUG] [LOCAL ] CADE: Loaded 50063 existing records from primary storage. [2025-10-24T00:46:16.990557] [INFO ] [MAIN ] CADE: Loaded 50063 primary data records. [2025-10-24T00:46:16.989934] [INFO ] [MAIN ] CABO: Generated 139 derivative records from 16738 primary records. [2025-10-24T00:46:16.990754] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-24T00:46:16.996240] [FATAL] [LOCAL ] CABO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:17.002927] [FATAL] [MAIN ] CABO: Failed to save derivative data. [2025-10-24T00:46:17.028447] [INFO ] [MAIN ] Derivative Progress: 352/2164 symbols completed. CABO took 0.8s. Estimated remaining: 12m 10s. Rate: 149.0 symbols/min [2025-10-24T00:46:17.076526] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:17.337802] [DEBUG] [MAIN ] CACI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:46:17.367019] [DEBUG] [LOCAL ] CAE: Loaded 39307 existing records from primary storage. [2025-10-24T00:46:17.371990] [INFO ] [MAIN ] CAE: Loaded 39307 primary data records. [2025-10-24T00:46:17.674276] [DEBUG] [MAIN ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:17.732180] [INFO ] [MAIN ] CACI: Generated 139 derivative records from 22671 primary records. [2025-10-24T00:46:17.732849] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-24T00:46:17.738019] [FATAL] [LOCAL ] CACI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:17.738137] [FATAL] [MAIN ] CACI: Failed to save derivative data. [2025-10-24T00:46:17.740947] [INFO ] [MAIN ] Derivative Progress: 353/2164 symbols completed. CACI took 1.1s. Estimated remaining: 12m 11s. Rate: 148.7 symbols/min [2025-10-24T00:46:17.741345] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:17.756519] [DEBUG] [LOCAL ] CAF: Loaded 3501 existing records from primary storage. [2025-10-24T00:46:17.758426] [INFO ] [MAIN ] CAF: Loaded 3501 primary data records. [2025-10-24T00:46:17.856668] [DEBUG] [MAIN ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:17.856870] [INFO ] [MAIN ] CADE: Generated 139 derivative records from 50063 primary records. [2025-10-24T00:46:17.890163] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-24T00:46:17.908519] [FATAL] [LOCAL ] CADE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:17.918887] [FATAL] [MAIN ] CADE: Failed to save derivative data. [2025-10-24T00:46:17.934624] [INFO ] [MAIN ] Derivative Progress: 354/2164 symbols completed. CADE took 1.3s. Estimated remaining: 12m 9s. Rate: 148.9 symbols/min [2025-10-24T00:46:17.982198] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:18.160463] [INFO ] [MAIN ] CAE: Generated 139 derivative records from 39307 primary records. [2025-10-24T00:46:18.160674] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-24T00:46:18.161030] [FATAL] [LOCAL ] CAE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:18.161457] [FATAL] [MAIN ] CAE: Failed to save derivative data. [2025-10-24T00:46:18.164091] [INFO ] [MAIN ] Derivative Progress: 355/2164 symbols completed. CAE took 1.1s. Estimated remaining: 12m 8s. Rate: 149.1 symbols/min [2025-10-24T00:46:18.164771] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:18.199368] [DEBUG] [MAIN ] CAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:18.233140] [DEBUG] [LOCAL ] CAG: Loaded 54056 existing records from primary storage. [2025-10-24T00:46:18.236218] [INFO ] [MAIN ] CAG: Loaded 54056 primary data records. [2025-10-24T00:46:18.577736] [DEBUG] [LOCAL ] CAH: Loaded 51788 existing records from primary storage. [2025-10-24T00:46:18.578951] [INFO ] [MAIN ] CAH: Loaded 51788 primary data records. [2025-10-24T00:46:18.649615] [INFO ] [MAIN ] CAF: Generated 139 derivative records from 3501 primary records. [2025-10-24T00:46:18.681601] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-24T00:46:18.693838] [FATAL] [LOCAL ] CAF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:18.693993] [FATAL] [MAIN ] CAF: Failed to save derivative data. [2025-10-24T00:46:18.696287] [INFO ] [MAIN ] Derivative Progress: 356/2164 symbols completed. CAF took 1.0s. Estimated remaining: 12m 8s. Rate: 148.9 symbols/min [2025-10-24T00:46:18.696504] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:18.922249] [DEBUG] [MAIN ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:18.960081] [DEBUG] [LOCAL ] CAL: Loaded 43036 existing records from primary storage. [2025-10-24T00:46:18.961700] [INFO ] [MAIN ] CAL: Loaded 43036 primary data records. [2025-10-24T00:46:19.068619] [DEBUG] [MAIN ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:19.305854] [INFO ] [MAIN ] CAG: Generated 139 derivative records from 54056 primary records. [2025-10-24T00:46:19.309361] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-24T00:46:19.310026] [FATAL] [LOCAL ] CAG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:19.312089] [FATAL] [MAIN ] CAG: Failed to save derivative data. [2025-10-24T00:46:19.318307] [INFO ] [MAIN ] Derivative Progress: 357/2164 symbols completed. CAG took 1.3s. Estimated remaining: 12m 9s. Rate: 148.7 symbols/min [2025-10-24T00:46:19.321121] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:19.335134] [INFO ] [MAIN ] CAH: Generated 139 derivative records from 51788 primary records. [2025-10-24T00:46:19.335513] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-24T00:46:19.335818] [FATAL] [LOCAL ] CAH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:19.336084] [FATAL] [MAIN ] CAH: Failed to save derivative data. [2025-10-24T00:46:19.338627] [INFO ] [MAIN ] Derivative Progress: 358/2164 symbols completed. CAH took 1.2s. Estimated remaining: 12m 7s. Rate: 149.1 symbols/min [2025-10-24T00:46:19.364015] [DEBUG] [MAIN ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:19.395865] [DEBUG] [LOCAL ] CALX: Loaded 37506 existing records from primary storage. [2025-10-24T00:46:19.397109] [INFO ] [MAIN ] CALX: Loaded 37506 primary data records. [2025-10-24T00:46:19.565723] [INFO ] [MAIN ] CAL: Generated 139 derivative records from 43036 primary records. [2025-10-24T00:46:19.580829] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-24T00:46:19.695093] [FATAL] [LOCAL ] CAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:19.705005] [FATAL] [MAIN ] CAL: Failed to save derivative data. [2025-10-24T00:46:19.707742] [INFO ] [MAIN ] Derivative Progress: 359/2164 symbols completed. CAL took 1.0s. Estimated remaining: 12m 6s. Rate: 149.1 symbols/min [2025-10-24T00:46:19.731382] [DEBUG] [MAIN ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:19.756482] [INFO ] [MAIN ] CALX: Generated 139 derivative records from 37506 primary records. [2025-10-24T00:46:19.756685] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-24T00:46:19.756882] [FATAL] [LOCAL ] CALX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:19.756957] [FATAL] [MAIN ] CALX: Failed to save derivative data. [2025-10-24T00:46:19.759091] [INFO ] [MAIN ] Derivative Progress: 360/2164 symbols completed. CALX took 0.4s. Estimated remaining: 12m 4s. Rate: 149.5 symbols/min [2025-10-24T00:46:19.759694] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:19.759534] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:19.759609] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:19.769211] [DEBUG] [LOCAL ] CAPL: Loaded 5425 existing records from primary storage. [2025-10-24T00:46:19.769568] [INFO ] [MAIN ] CAPL: Loaded 5425 primary data records. [2025-10-24T00:46:19.984505] [DEBUG] [LOCAL ] CANG: Loaded 27174 existing records from primary storage. [2025-10-24T00:46:20.129417] [INFO ] [MAIN ] CANG: Loaded 27174 primary data records. [2025-10-24T00:46:20.190294] [DEBUG] [LOCAL ] CARR: Loaded 53993 existing records from primary storage. [2025-10-24T00:46:20.196635] [INFO ] [MAIN ] CARR: Loaded 53993 primary data records. [2025-10-24T00:46:20.790066] [DEBUG] [MAIN ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:20.839138] [DEBUG] [MAIN ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:20.852295] [DEBUG] [MAIN ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:20.888899] [INFO ] [MAIN ] CAPL: Generated 139 derivative records from 5425 primary records. [2025-10-24T00:46:20.890029] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-24T00:46:20.890621] [FATAL] [LOCAL ] CAPL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:20.890937] [FATAL] [MAIN ] CAPL: Failed to save derivative data. [2025-10-24T00:46:20.895720] [INFO ] [MAIN ] Derivative Progress: 361/2164 symbols completed. CAPL took 1.1s. Estimated remaining: 12m 7s. Rate: 148.7 symbols/min [2025-10-24T00:46:20.902751] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:20.933255] [INFO ] [MAIN ] CARR: Generated 139 derivative records from 53993 primary records. [2025-10-24T00:46:20.933615] [INFO ] [MAIN ] CANG: Generated 139 derivative records from 27174 primary records. [2025-10-24T00:46:20.943263] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-24T00:46:20.943930] [FATAL] [LOCAL ] CARR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:20.943493] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-24T00:46:20.944088] [FATAL] [MAIN ] CARR: Failed to save derivative data. [2025-10-24T00:46:20.947288] [INFO ] [MAIN ] Derivative Progress: 362/2164 symbols completed. CARR took 1.2s. Estimated remaining: 12m 5s. Rate: 149.1 symbols/min [2025-10-24T00:46:20.947574] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:20.944314] [FATAL] [LOCAL ] CANG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:20.948131] [FATAL] [MAIN ] CANG: Failed to save derivative data. [2025-10-24T00:46:20.950338] [INFO ] [MAIN ] Derivative Progress: 363/2164 symbols completed. CANG took 1.2s. Estimated remaining: 12m 3s. Rate: 149.5 symbols/min [2025-10-24T00:46:20.950575] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:20.959917] [DEBUG] [LOCAL ] CATO: Loaded 6677 existing records from primary storage. [2025-10-24T00:46:20.970221] [INFO ] [MAIN ] CATO: Loaded 6677 primary data records. [2025-10-24T00:46:20.983465] [DEBUG] [LOCAL ] CARS: Loaded 40089 existing records from primary storage. [2025-10-24T00:46:21.037140] [INFO ] [MAIN ] CARS: Loaded 40089 primary data records. [2025-10-24T00:46:21.465230] [DEBUG] [LOCAL ] CAT: Loaded 53317 existing records from primary storage. [2025-10-24T00:46:21.600103] [INFO ] [MAIN ] CAT: Loaded 53317 primary data records. [2025-10-24T00:46:21.992975] [DEBUG] [MAIN ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:22.025488] [DEBUG] [MAIN ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:22.082606] [DEBUG] [MAIN ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:22.106118] [INFO ] [MAIN ] CATO: Generated 139 derivative records from 6677 primary records. [2025-10-24T00:46:22.110272] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-24T00:46:22.110894] [FATAL] [LOCAL ] CATO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:22.111159] [INFO ] [MAIN ] CARS: Generated 139 derivative records from 40089 primary records. [2025-10-24T00:46:22.112140] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-24T00:46:22.110997] [FATAL] [MAIN ] CATO: Failed to save derivative data. [2025-10-24T00:46:22.112398] [FATAL] [LOCAL ] CARS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:22.114783] [FATAL] [MAIN ] CARS: Failed to save derivative data. [2025-10-24T00:46:22.114523] [INFO ] [MAIN ] Derivative Progress: 364/2164 symbols completed. CATO took 1.2s. Estimated remaining: 12m 6s. Rate: 148.7 symbols/min [2025-10-24T00:46:22.117952] [INFO ] [MAIN ] Derivative Progress: 365/2164 symbols completed. CARS took 1.2s. Estimated remaining: 12m 4s. Rate: 149.1 symbols/min [2025-10-24T00:46:22.118135] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:22.117865] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:22.132682] [INFO ] [MAIN ] CAT: Generated 139 derivative records from 53317 primary records. [2025-10-24T00:46:22.132855] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-24T00:46:22.133064] [FATAL] [LOCAL ] CAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:22.133142] [FATAL] [MAIN ] CAT: Failed to save derivative data. [2025-10-24T00:46:22.135922] [INFO ] [MAIN ] Derivative Progress: 366/2164 symbols completed. CAT took 1.2s. Estimated remaining: 12m 1s. Rate: 149.5 symbols/min [2025-10-24T00:46:22.136274] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:22.149282] [DEBUG] [LOCAL ] CBAN: Loaded 10233 existing records from primary storage. [2025-10-24T00:46:22.149508] [INFO ] [MAIN ] CBAN: Loaded 10233 primary data records. [2025-10-24T00:46:22.391267] [DEBUG] [LOCAL ] CAVA: Loaded 53932 existing records from primary storage. [2025-10-24T00:46:22.463728] [DEBUG] [LOCAL ] CB: Loaded 50346 existing records from primary storage. [2025-10-24T00:46:22.508826] [INFO ] [MAIN ] CAVA: Loaded 53932 primary data records. [2025-10-24T00:46:22.509136] [INFO ] [MAIN ] CB: Loaded 50346 primary data records. [2025-10-24T00:46:23.131820] [DEBUG] [MAIN ] CBAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:23.196751] [DEBUG] [MAIN ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:23.197004] [DEBUG] [MAIN ] CAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:23.210407] [INFO ] [MAIN ] CBAN: Generated 139 derivative records from 10233 primary records. [2025-10-24T00:46:23.212274] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-24T00:46:23.224058] [FATAL] [LOCAL ] CBAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:23.225288] [FATAL] [MAIN ] CBAN: Failed to save derivative data. [2025-10-24T00:46:23.229114] [INFO ] [MAIN ] Derivative Progress: 367/2164 symbols completed. CBAN took 1.1s. Estimated remaining: 12m 4s. Rate: 148.8 symbols/min [2025-10-24T00:46:23.229776] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:23.267069] [DEBUG] [LOCAL ] CBL: Loaded 16114 existing records from primary storage. [2025-10-24T00:46:23.270963] [INFO ] [MAIN ] CBL: Loaded 16114 primary data records. [2025-10-24T00:46:23.415445] [INFO ] [MAIN ] CB: Generated 139 derivative records from 50346 primary records. [2025-10-24T00:46:23.409878] [INFO ] [MAIN ] CAVA: Generated 139 derivative records from 53932 primary records. [2025-10-24T00:46:23.428407] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-24T00:46:23.444631] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-24T00:46:23.468800] [FATAL] [LOCAL ] CAVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:23.461896] [FATAL] [LOCAL ] CB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:23.580805] [FATAL] [MAIN ] CAVA: Failed to save derivative data. [2025-10-24T00:46:23.580905] [FATAL] [MAIN ] CB: Failed to save derivative data. [2025-10-24T00:46:23.585090] [INFO ] [MAIN ] Derivative Progress: 368/2164 symbols completed. CAVA took 1.5s. Estimated remaining: 12m 4s. Rate: 148.9 symbols/min [2025-10-24T00:46:23.588605] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:23.588917] [INFO ] [MAIN ] Derivative Progress: 369/2164 symbols completed. CB took 1.5s. Estimated remaining: 12m 1s. Rate: 149.3 symbols/min [2025-10-24T00:46:23.589590] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:23.616138] [DEBUG] [MAIN ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:23.673365] [DEBUG] [LOCAL ] CBT: Loaded 31110 existing records from primary storage. [2025-10-24T00:46:23.677086] [INFO ] [MAIN ] CBT: Loaded 31110 primary data records. [2025-10-24T00:46:23.780396] [DEBUG] [LOCAL ] CBRE: Loaded 50665 existing records from primary storage. [2025-10-24T00:46:23.799869] [INFO ] [MAIN ] CBRE: Loaded 50665 primary data records. [2025-10-24T00:46:24.138053] [INFO ] [MAIN ] CBL: Generated 139 derivative records from 16114 primary records. [2025-10-24T00:46:24.144326] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-24T00:46:24.144582] [FATAL] [LOCAL ] CBL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:24.149953] [FATAL] [MAIN ] CBL: Failed to save derivative data. [2025-10-24T00:46:24.162958] [INFO ] [MAIN ] Derivative Progress: 370/2164 symbols completed. CBL took 0.9s. Estimated remaining: 12m 2s. Rate: 149.1 symbols/min [2025-10-24T00:46:24.168392] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:24.356189] [DEBUG] [LOCAL ] CBU: Loaded 22766 existing records from primary storage. [2025-10-24T00:46:24.357981] [INFO ] [MAIN ] CBU: Loaded 22766 primary data records. [2025-10-24T00:46:24.498449] [DEBUG] [MAIN ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:24.726496] [DEBUG] [MAIN ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:24.789210] [INFO ] [MAIN ] CBT: Generated 139 derivative records from 31110 primary records. [2025-10-24T00:46:24.806405] [DEBUG] [MAIN ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:24.806021] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-24T00:46:24.820337] [FATAL] [LOCAL ] CBT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:24.823628] [FATAL] [MAIN ] CBT: Failed to save derivative data. [2025-10-24T00:46:24.829631] [INFO ] [MAIN ] Derivative Progress: 371/2164 symbols completed. CBT took 1.2s. Estimated remaining: 12m 3s. Rate: 148.8 symbols/min [2025-10-24T00:46:24.831196] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:24.840293] [INFO ] [MAIN ] CBRE: Generated 139 derivative records from 50665 primary records. [2025-10-24T00:46:24.840801] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-24T00:46:24.843619] [FATAL] [LOCAL ] CBRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:24.843909] [FATAL] [MAIN ] CBRE: Failed to save derivative data. [2025-10-24T00:46:24.847435] [INFO ] [MAIN ] Derivative Progress: 372/2164 symbols completed. CBRE took 1.3s. Estimated remaining: 12m 1s. Rate: 149.2 symbols/min [2025-10-24T00:46:24.847763] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:24.870006] [INFO ] [MAIN ] CBU: Generated 139 derivative records from 22766 primary records. [2025-10-24T00:46:24.870386] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-24T00:46:24.870749] [FATAL] [LOCAL ] CBU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:24.870830] [FATAL] [MAIN ] CBU: Failed to save derivative data. [2025-10-24T00:46:24.873720] [INFO ] [MAIN ] Derivative Progress: 373/2164 symbols completed. CBU took 0.7s. Estimated remaining: 11m 58s. Rate: 149.6 symbols/min [2025-10-24T00:46:24.893335] [DEBUG] [LOCAL ] CBZ: Loaded 34489 existing records from primary storage. [2025-10-24T00:46:24.893516] [INFO ] [MAIN ] CBZ: Loaded 34489 primary data records. [2025-10-24T00:46:25.223460] [DEBUG] [LOCAL ] CC: Loaded 53392 existing records from primary storage. [2025-10-24T00:46:25.224012] [INFO ] [MAIN ] CC: Loaded 53392 primary data records. [2025-10-24T00:46:25.584126] [DEBUG] [MAIN ] CBZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:25.624616] [INFO ] [MAIN ] CBZ: Generated 139 derivative records from 34489 primary records. [2025-10-24T00:46:25.626462] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-24T00:46:25.626908] [FATAL] [LOCAL ] CBZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:25.627155] [FATAL] [MAIN ] CBZ: Failed to save derivative data. [2025-10-24T00:46:25.629316] [INFO ] [MAIN ] Derivative Progress: 374/2164 symbols completed. CBZ took 0.8s. Estimated remaining: 11m 60s. Rate: 149.2 symbols/min [2025-10-24T00:46:25.642502] [DEBUG] [MAIN ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:25.670454] [INFO ] [MAIN ] CC: Generated 139 derivative records from 53392 primary records. [2025-10-24T00:46:25.670726] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-24T00:46:25.670957] [FATAL] [LOCAL ] CC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:25.671039] [FATAL] [MAIN ] CC: Failed to save derivative data. [2025-10-24T00:46:25.676286] [INFO ] [MAIN ] Derivative Progress: 375/2164 symbols completed. CC took 0.8s. Estimated remaining: 11m 58s. Rate: 149.6 symbols/min [2025-10-24T00:46:25.677348] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:25.677227] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:25.677124] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:25.695708] [DEBUG] [LOCAL ] CCIF: Loaded 15230 existing records from primary storage. [2025-10-24T00:46:25.696091] [INFO ] [MAIN ] CCIF: Loaded 15230 primary data records. [2025-10-24T00:46:26.049293] [DEBUG] [LOCAL ] CCI: Loaded 53497 existing records from primary storage. [2025-10-24T00:46:26.050082] [INFO ] [MAIN ] CCI: Loaded 53497 primary data records. [2025-10-24T00:46:26.122009] [DEBUG] [LOCAL ] CCJ: Loaded 54080 existing records from primary storage. [2025-10-24T00:46:26.136607] [INFO ] [MAIN ] CCJ: Loaded 54080 primary data records. [2025-10-24T00:46:26.745624] [DEBUG] [MAIN ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:26.799933] [DEBUG] [MAIN ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:26.835568] [DEBUG] [MAIN ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:26.837248] [INFO ] [MAIN ] CCIF: Generated 139 derivative records from 15230 primary records. [2025-10-24T00:46:26.838369] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-24T00:46:26.851009] [FATAL] [LOCAL ] CCIF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:26.853913] [FATAL] [MAIN ] CCIF: Failed to save derivative data. [2025-10-24T00:46:26.862896] [INFO ] [MAIN ] Derivative Progress: 376/2164 symbols completed. CCIF took 1.2s. Estimated remaining: 12m 1s. Rate: 148.8 symbols/min [2025-10-24T00:46:26.866868] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:26.906924] [INFO ] [MAIN ] CCI: Generated 139 derivative records from 53497 primary records. [2025-10-24T00:46:26.909152] [INFO ] [MAIN ] CCJ: Generated 139 derivative records from 54080 primary records. [2025-10-24T00:46:26.909231] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-24T00:46:26.909544] [FATAL] [LOCAL ] CCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:26.909735] [FATAL] [MAIN ] CCI: Failed to save derivative data. [2025-10-24T00:46:26.909623] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-24T00:46:26.912690] [FATAL] [LOCAL ] CCJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:26.912309] [INFO ] [MAIN ] Derivative Progress: 377/2164 symbols completed. CCI took 1.2s. Estimated remaining: 11m 59s. Rate: 149.2 symbols/min [2025-10-24T00:46:26.913015] [FATAL] [MAIN ] CCJ: Failed to save derivative data. [2025-10-24T00:46:26.923141] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:26.927346] [INFO ] [MAIN ] Derivative Progress: 378/2164 symbols completed. CCJ took 1.3s. Estimated remaining: 11m 57s. Rate: 149.5 symbols/min [2025-10-24T00:46:26.928160] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:26.949239] [DEBUG] [LOCAL ] CCK: Loaded 46879 existing records from primary storage. [2025-10-24T00:46:26.953782] [INFO ] [MAIN ] CCK: Loaded 46879 primary data records. [2025-10-24T00:46:26.953583] [DEBUG] [LOCAL ] CCRD: Loaded 9620 existing records from primary storage. [2025-10-24T00:46:26.953923] [INFO ] [MAIN ] CCRD: Loaded 9620 primary data records. [2025-10-24T00:46:27.286637] [DEBUG] [LOCAL ] CCO: Loaded 48899 existing records from primary storage. [2025-10-24T00:46:27.575220] [INFO ] [MAIN ] CCO: Loaded 48899 primary data records. [2025-10-24T00:46:27.943749] [DEBUG] [MAIN ] CCRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:27.930919] [DEBUG] [MAIN ] CCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:28.009382] [DEBUG] [MAIN ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:28.052169] [INFO ] [MAIN ] CCRD: Generated 139 derivative records from 9620 primary records. [2025-10-24T00:46:28.057546] [INFO ] [MAIN ] CCK: Generated 139 derivative records from 46879 primary records. [2025-10-24T00:46:28.057739] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-24T00:46:28.056795] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-24T00:46:28.058055] [FATAL] [LOCAL ] CCK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:28.058255] [FATAL] [LOCAL ] CCRD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:28.058386] [FATAL] [MAIN ] CCRD: Failed to save derivative data. [2025-10-24T00:46:28.061160] [INFO ] [MAIN ] Derivative Progress: 379/2164 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 60s. Rate: 148.8 symbols/min [2025-10-24T00:46:28.062222] [FATAL] [MAIN ] CCK: Failed to save derivative data. [2025-10-24T00:46:28.064628] [INFO ] [MAIN ] Derivative Progress: 380/2164 symbols completed. CCK took 1.2s. Estimated remaining: 11m 57s. Rate: 149.2 symbols/min [2025-10-24T00:46:28.065240] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:28.062684] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:28.076238] [INFO ] [MAIN ] CCO: Generated 139 derivative records from 48899 primary records. [2025-10-24T00:46:28.081975] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-24T00:46:28.082344] [FATAL] [LOCAL ] CCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:28.082431] [FATAL] [MAIN ] CCO: Failed to save derivative data. [2025-10-24T00:46:28.085335] [INFO ] [MAIN ] Derivative Progress: 381/2164 symbols completed. CCO took 1.2s. Estimated remaining: 11m 55s. Rate: 149.6 symbols/min [2025-10-24T00:46:28.085624] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:28.103040] [DEBUG] [LOCAL ] CCU: Loaded 21744 existing records from primary storage. [2025-10-24T00:46:28.103348] [INFO ] [MAIN ] CCU: Loaded 21744 primary data records. [2025-10-24T00:46:28.178872] [DEBUG] [LOCAL ] CCS: Loaded 30142 existing records from primary storage. [2025-10-24T00:46:28.218437] [INFO ] [MAIN ] CCS: Loaded 30142 primary data records. [2025-10-24T00:46:28.780051] [DEBUG] [LOCAL ] CDE: Loaded 54034 existing records from primary storage. [2025-10-24T00:46:28.782326] [INFO ] [MAIN ] CDE: Loaded 54034 primary data records. [2025-10-24T00:46:29.123698] [DEBUG] [MAIN ] CCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:29.156425] [DEBUG] [MAIN ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:29.215211] [INFO ] [MAIN ] CCU: Generated 139 derivative records from 21744 primary records. [2025-10-24T00:46:29.226314] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-24T00:46:29.233101] [FATAL] [LOCAL ] CCU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:29.232779] [DEBUG] [MAIN ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:29.247958] [FATAL] [MAIN ] CCU: Failed to save derivative data. [2025-10-24T00:46:29.253062] [INFO ] [MAIN ] Derivative Progress: 382/2164 symbols completed. CCU took 1.2s. Estimated remaining: 11m 58s. Rate: 148.8 symbols/min [2025-10-24T00:46:29.257969] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:29.257533] [INFO ] [MAIN ] CCS: Generated 139 derivative records from 30142 primary records. [2025-10-24T00:46:29.260255] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-24T00:46:29.260912] [FATAL] [LOCAL ] CCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:29.269559] [FATAL] [MAIN ] CCS: Failed to save derivative data. [2025-10-24T00:46:29.273910] [INFO ] [MAIN ] Derivative Progress: 383/2164 symbols completed. CCS took 1.2s. Estimated remaining: 11m 56s. Rate: 149.2 symbols/min [2025-10-24T00:46:29.274408] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:29.288599] [DEBUG] [LOCAL ] CDLR: Loaded 10267 existing records from primary storage. [2025-10-24T00:46:29.288760] [INFO ] [MAIN ] CDLR: Loaded 10267 primary data records. [2025-10-24T00:46:29.446913] [INFO ] [MAIN ] CDE: Generated 139 derivative records from 54034 primary records. [2025-10-24T00:46:29.482976] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-24T00:46:29.610390] [FATAL] [LOCAL ] CDE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:29.638328] [FATAL] [MAIN ] CDE: Failed to save derivative data. [2025-10-24T00:46:29.641747] [INFO ] [MAIN ] Derivative Progress: 384/2164 symbols completed. CDE took 1.6s. Estimated remaining: 11m 56s. Rate: 149.3 symbols/min [2025-10-24T00:46:29.642921] [DEBUG] [LOCAL ] CDP: Loaded 42604 existing records from primary storage. [2025-10-24T00:46:29.643246] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:29.644397] [INFO ] [MAIN ] CDP: Loaded 42604 primary data records. [2025-10-24T00:46:29.838873] [DEBUG] [LOCAL ] CDRE: Loaded 24851 existing records from primary storage. [2025-10-24T00:46:29.844447] [INFO ] [MAIN ] CDRE: Loaded 24851 primary data records. [2025-10-24T00:46:30.178724] [DEBUG] [MAIN ] CDLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:30.395616] [DEBUG] [MAIN ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:30.442812] [DEBUG] [MAIN ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:30.468089] [INFO ] [MAIN ] CDLR: Generated 139 derivative records from 10267 primary records. [2025-10-24T00:46:30.471865] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-24T00:46:30.472140] [FATAL] [LOCAL ] CDLR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:30.473330] [FATAL] [MAIN ] CDLR: Failed to save derivative data. [2025-10-24T00:46:30.477865] [INFO ] [MAIN ] Derivative Progress: 385/2164 symbols completed. CDLR took 1.2s. Estimated remaining: 11m 57s. Rate: 148.8 symbols/min [2025-10-24T00:46:30.481779] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:30.493482] [INFO ] [MAIN ] CDP: Generated 139 derivative records from 42604 primary records. [2025-10-24T00:46:30.497177] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-24T00:46:30.497424] [FATAL] [LOCAL ] CDP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:30.497892] [FATAL] [MAIN ] CDP: Failed to save derivative data. [2025-10-24T00:46:30.500276] [INFO ] [MAIN ] Derivative Progress: 386/2164 symbols completed. CDP took 1.2s. Estimated remaining: 11m 55s. Rate: 149.2 symbols/min [2025-10-24T00:46:30.500671] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:30.507465] [INFO ] [MAIN ] CDRE: Generated 139 derivative records from 24851 primary records. [2025-10-24T00:46:30.507870] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-24T00:46:30.508184] [FATAL] [LOCAL ] CDRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:30.509490] [FATAL] [MAIN ] CDRE: Failed to save derivative data. [2025-10-24T00:46:30.512310] [INFO ] [MAIN ] Derivative Progress: 387/2164 symbols completed. CDRE took 0.9s. Estimated remaining: 11m 53s. Rate: 149.6 symbols/min [2025-10-24T00:46:30.512540] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:30.531331] [DEBUG] [LOCAL ] CEE: Loaded 5144 existing records from primary storage. [2025-10-24T00:46:30.531725] [INFO ] [MAIN ] CEE: Loaded 5144 primary data records. [2025-10-24T00:46:30.657255] [DEBUG] [LOCAL ] CE: Loaded 51618 existing records from primary storage. [2025-10-24T00:46:30.673756] [INFO ] [MAIN ] CE: Loaded 51618 primary data records. [2025-10-24T00:46:30.752374] [DEBUG] [LOCAL ] CEPU: Loaded 27303 existing records from primary storage. [2025-10-24T00:46:30.872460] [INFO ] [MAIN ] CEPU: Loaded 27303 primary data records. [2025-10-24T00:46:31.534768] [DEBUG] [MAIN ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:31.607581] [DEBUG] [MAIN ] CEPU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:31.608174] [DEBUG] [MAIN ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:31.644813] [INFO ] [MAIN ] CEE: Generated 139 derivative records from 5144 primary records. [2025-10-24T00:46:31.645006] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-24T00:46:31.646753] [FATAL] [LOCAL ] CEE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:31.654396] [FATAL] [MAIN ] CEE: Failed to save derivative data. [2025-10-24T00:46:31.658220] [INFO ] [MAIN ] Derivative Progress: 388/2164 symbols completed. CEE took 1.2s. Estimated remaining: 11m 56s. Rate: 148.9 symbols/min [2025-10-24T00:46:31.693755] [INFO ] [MAIN ] CEPU: Generated 139 derivative records from 27303 primary records. [2025-10-24T00:46:31.695417] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-24T00:46:31.695845] [FATAL] [LOCAL ] CEPU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:31.697982] [FATAL] [MAIN ] CEPU: Failed to save derivative data. [2025-10-24T00:46:31.700893] [INFO ] [MAIN ] Derivative Progress: 389/2164 symbols completed. CEPU took 1.2s. Estimated remaining: 11m 54s. Rate: 149.2 symbols/min [2025-10-24T00:46:31.701186] [INFO ] [MAIN ] CE: Generated 139 derivative records from 51618 primary records. [2025-10-24T00:46:31.701536] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-24T00:46:31.701885] [FATAL] [LOCAL ] CE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:31.701965] [FATAL] [MAIN ] CE: Failed to save derivative data. [2025-10-24T00:46:31.705013] [INFO ] [MAIN ] Derivative Progress: 390/2164 symbols completed. CE took 1.2s. Estimated remaining: 11m 52s. Rate: 149.6 symbols/min [2025-10-24T00:46:31.705816] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:31.705735] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:31.706008] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:31.775998] [DEBUG] [LOCAL ] CFR: Loaded 32608 existing records from primary storage. [2025-10-24T00:46:31.776554] [INFO ] [MAIN ] CFR: Loaded 32608 primary data records. [2025-10-24T00:46:31.911619] [DEBUG] [LOCAL ] CF: Loaded 52489 existing records from primary storage. [2025-10-24T00:46:31.923724] [DEBUG] [LOCAL ] CFG: Loaded 54013 existing records from primary storage. [2025-10-24T00:46:31.924557] [INFO ] [MAIN ] CF: Loaded 52489 primary data records. [2025-10-24T00:46:31.930120] [INFO ] [MAIN ] CFG: Loaded 54013 primary data records. [2025-10-24T00:46:32.839036] [DEBUG] [MAIN ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:32.883321] [DEBUG] [MAIN ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:32.916837] [DEBUG] [MAIN ] CFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:32.988876] [INFO ] [MAIN ] CFR: Generated 139 derivative records from 32608 primary records. [2025-10-24T00:46:32.995513] [INFO ] [MAIN ] CF: Generated 139 derivative records from 52489 primary records. [2025-10-24T00:46:32.995811] [INFO ] [MAIN ] CFG: Generated 139 derivative records from 54013 primary records. [2025-10-24T00:46:32.993545] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-24T00:46:32.995968] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-24T00:46:32.996045] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-24T00:46:32.996880] [FATAL] [LOCAL ] CFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:32.997193] [FATAL] [LOCAL ] CF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:32.996501] [FATAL] [LOCAL ] CFR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:32.997396] [FATAL] [MAIN ] CFG: Failed to save derivative data. [2025-10-24T00:46:33.000398] [INFO ] [MAIN ] Derivative Progress: 391/2164 symbols completed. CFG took 1.3s. Estimated remaining: 11m 55s. Rate: 148.7 symbols/min [2025-10-24T00:46:32.997530] [FATAL] [MAIN ] CFR: Failed to save derivative data. [2025-10-24T00:46:32.997288] [FATAL] [MAIN ] CF: Failed to save derivative data. [2025-10-24T00:46:33.005832] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:33.005908] [INFO ] [MAIN ] Derivative Progress: 392/2164 symbols completed. CF took 1.3s. Estimated remaining: 11m 53s. Rate: 149.1 symbols/min [2025-10-24T00:46:33.006573] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:33.007089] [INFO ] [MAIN ] Derivative Progress: 393/2164 symbols completed. CFR took 1.3s. Estimated remaining: 11m 51s. Rate: 149.5 symbols/min [2025-10-24T00:46:33.007262] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:33.012850] [DEBUG] [LOCAL ] CGV: Loaded 1368 existing records from primary storage. [2025-10-24T00:46:33.013278] [INFO ] [MAIN ] CGV: Loaded 1368 primary data records. [2025-10-24T00:46:33.141744] [DEBUG] [LOCAL ] CHCT: Loaded 24374 existing records from primary storage. [2025-10-24T00:46:33.167615] [INFO ] [MAIN ] CHCT: Loaded 24374 primary data records. [2025-10-24T00:46:33.474956] [DEBUG] [LOCAL ] CGAU: Loaded 44258 existing records from primary storage. [2025-10-24T00:46:33.493205] [INFO ] [MAIN ] CGAU: Loaded 44258 primary data records. [2025-10-24T00:46:34.025163] [DEBUG] [MAIN ] CGV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:46:34.063702] [DEBUG] [MAIN ] CHCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:34.111331] [DEBUG] [MAIN ] CGAU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:34.129377] [INFO ] [MAIN ] CGV: Generated 139 derivative records from 1368 primary records. [2025-10-24T00:46:34.129567] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-24T00:46:34.132595] [FATAL] [LOCAL ] CGV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:34.136346] [FATAL] [MAIN ] CGV: Failed to save derivative data. [2025-10-24T00:46:34.138587] [INFO ] [MAIN ] Derivative Progress: 394/2164 symbols completed. CGV took 1.1s. Estimated remaining: 11m 54s. Rate: 148.8 symbols/min [2025-10-24T00:46:34.138930] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:34.159222] [INFO ] [MAIN ] CHCT: Generated 139 derivative records from 24374 primary records. [2025-10-24T00:46:34.163680] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-24T00:46:34.164126] [FATAL] [LOCAL ] CHCT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:34.167586] [FATAL] [MAIN ] CHCT: Failed to save derivative data. [2025-10-24T00:46:34.171703] [INFO ] [MAIN ] Derivative Progress: 395/2164 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 52s. Rate: 149.1 symbols/min [2025-10-24T00:46:34.172851] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:34.175635] [INFO ] [MAIN ] CGAU: Generated 139 derivative records from 44258 primary records. [2025-10-24T00:46:34.175836] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-24T00:46:34.176069] [FATAL] [LOCAL ] CGAU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:34.176158] [FATAL] [MAIN ] CGAU: Failed to save derivative data. [2025-10-24T00:46:34.179262] [INFO ] [MAIN ] Derivative Progress: 396/2164 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 49s. Rate: 149.5 symbols/min [2025-10-24T00:46:34.180008] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:34.208180] [DEBUG] [LOCAL ] CHE: Loaded 15444 existing records from primary storage. [2025-10-24T00:46:34.208436] [INFO ] [MAIN ] CHE: Loaded 15444 primary data records. [2025-10-24T00:46:34.346941] [DEBUG] [LOCAL ] CHD: Loaded 52693 existing records from primary storage. [2025-10-24T00:46:34.379349] [INFO ] [MAIN ] CHD: Loaded 52693 primary data records. [2025-10-24T00:46:34.620505] [DEBUG] [LOCAL ] CHGG: Loaded 47817 existing records from primary storage. [2025-10-24T00:46:34.638784] [INFO ] [MAIN ] CHGG: Loaded 47817 primary data records. [2025-10-24T00:46:35.257094] [DEBUG] [MAIN ] CHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:35.292870] [DEBUG] [MAIN ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:35.338633] [DEBUG] [MAIN ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:35.381155] [INFO ] [MAIN ] CHE: Generated 139 derivative records from 15444 primary records. [2025-10-24T00:46:35.387544] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-24T00:46:35.388287] [FATAL] [LOCAL ] CHE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:35.388757] [FATAL] [MAIN ] CHE: Failed to save derivative data. [2025-10-24T00:46:35.391166] [INFO ] [MAIN ] Derivative Progress: 397/2164 symbols completed. CHE took 1.2s. Estimated remaining: 11m 53s. Rate: 148.8 symbols/min [2025-10-24T00:46:35.392620] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:35.397452] [INFO ] [MAIN ] CHD: Generated 139 derivative records from 52693 primary records. [2025-10-24T00:46:35.400901] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-24T00:46:35.401435] [FATAL] [LOCAL ] CHD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:35.401745] [FATAL] [MAIN ] CHD: Failed to save derivative data. [2025-10-24T00:46:35.405349] [INFO ] [MAIN ] Derivative Progress: 398/2164 symbols completed. CHD took 1.3s. Estimated remaining: 11m 51s. Rate: 149.1 symbols/min [2025-10-24T00:46:35.408309] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:35.412036] [INFO ] [MAIN ] CHGG: Generated 139 derivative records from 47817 primary records. [2025-10-24T00:46:35.412543] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-24T00:46:35.412778] [FATAL] [LOCAL ] CHGG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:35.412855] [FATAL] [MAIN ] CHGG: Failed to save derivative data. [2025-10-24T00:46:35.415724] [INFO ] [MAIN ] Derivative Progress: 399/2164 symbols completed. CHGG took 1.2s. Estimated remaining: 11m 48s. Rate: 149.5 symbols/min [2025-10-24T00:46:35.415941] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:35.437181] [DEBUG] [LOCAL ] CHN: Loaded 5027 existing records from primary storage. [2025-10-24T00:46:35.445056] [INFO ] [MAIN ] CHN: Loaded 5027 primary data records. [2025-10-24T00:46:35.444919] [DEBUG] [LOCAL ] CHMI: Loaded 21277 existing records from primary storage. [2025-10-24T00:46:35.456813] [INFO ] [MAIN ] CHMI: Loaded 21277 primary data records. [2025-10-24T00:46:35.636899] [DEBUG] [LOCAL ] CHH: Loaded 32509 existing records from primary storage. [2025-10-24T00:46:35.655450] [INFO ] [MAIN ] CHH: Loaded 32509 primary data records. [2025-10-24T00:46:36.454139] [DEBUG] [MAIN ] CHMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:36.459344] [DEBUG] [MAIN ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:36.516801] [DEBUG] [MAIN ] CHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:36.563275] [INFO ] [MAIN ] CHN: Generated 139 derivative records from 5027 primary records. [2025-10-24T00:46:36.567671] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-24T00:46:36.568016] [FATAL] [LOCAL ] CHN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:36.568636] [FATAL] [MAIN ] CHN: Failed to save derivative data. [2025-10-24T00:46:36.570658] [INFO ] [MAIN ] Derivative Progress: 400/2164 symbols completed. CHN took 1.2s. Estimated remaining: 11m 51s. Rate: 148.8 symbols/min [2025-10-24T00:46:36.570822] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:36.573350] [INFO ] [MAIN ] CHMI: Generated 139 derivative records from 21277 primary records. [2025-10-24T00:46:36.573562] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-24T00:46:36.575163] [FATAL] [LOCAL ] CHMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:36.578485] [FATAL] [MAIN ] CHMI: Failed to save derivative data. [2025-10-24T00:46:36.581258] [INFO ] [MAIN ] Derivative Progress: 401/2164 symbols completed. CHMI took 1.2s. Estimated remaining: 11m 49s. Rate: 149.2 symbols/min [2025-10-24T00:46:36.582852] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:36.589565] [INFO ] [MAIN ] CHH: Generated 139 derivative records from 32509 primary records. [2025-10-24T00:46:36.589868] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-24T00:46:36.590343] [FATAL] [LOCAL ] CHH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:36.590431] [FATAL] [MAIN ] CHH: Failed to save derivative data. [2025-10-24T00:46:36.593543] [INFO ] [MAIN ] Derivative Progress: 402/2164 symbols completed. CHH took 1.2s. Estimated remaining: 11m 47s. Rate: 149.5 symbols/min [2025-10-24T00:46:36.593757] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:36.621745] [DEBUG] [LOCAL ] CHT: Loaded 19339 existing records from primary storage. [2025-10-24T00:46:36.622043] [INFO ] [MAIN ] CHT: Loaded 19339 primary data records. [2025-10-24T00:46:36.740584] [DEBUG] [LOCAL ] CHPT: Loaded 47199 existing records from primary storage. [2025-10-24T00:46:36.751975] [INFO ] [MAIN ] CHPT: Loaded 47199 primary data records. [2025-10-24T00:46:37.092802] [DEBUG] [LOCAL ] CI: Loaded 49907 existing records from primary storage. [2025-10-24T00:46:37.139267] [INFO ] [MAIN ] CI: Loaded 49907 primary data records. [2025-10-24T00:46:37.587842] [DEBUG] [MAIN ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:37.626801] [DEBUG] [MAIN ] CHPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:37.664023] [DEBUG] [MAIN ] CI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:37.707907] [INFO ] [MAIN ] CHT: Generated 139 derivative records from 19339 primary records. [2025-10-24T00:46:37.711194] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-24T00:46:37.711633] [FATAL] [LOCAL ] CHT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:37.713072] [FATAL] [MAIN ] CHT: Failed to save derivative data. [2025-10-24T00:46:37.718602] [INFO ] [MAIN ] Derivative Progress: 403/2164 symbols completed. CHT took 1.1s. Estimated remaining: 11m 50s. Rate: 148.8 symbols/min [2025-10-24T00:46:37.725569] [INFO ] [MAIN ] CHPT: Generated 139 derivative records from 47199 primary records. [2025-10-24T00:46:37.729060] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-24T00:46:37.729412] [FATAL] [LOCAL ] CHPT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:37.729808] [FATAL] [MAIN ] CHPT: Failed to save derivative data. [2025-10-24T00:46:37.732283] [INFO ] [MAIN ] Derivative Progress: 404/2164 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 48s. Rate: 149.2 symbols/min [2025-10-24T00:46:37.735401] [INFO ] [MAIN ] CI: Generated 139 derivative records from 49907 primary records. [2025-10-24T00:46:37.735484] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-24T00:46:37.735699] [FATAL] [LOCAL ] CI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:37.735776] [FATAL] [MAIN ] CI: Failed to save derivative data. [2025-10-24T00:46:37.738667] [INFO ] [MAIN ] Derivative Progress: 405/2164 symbols completed. CI took 1.1s. Estimated remaining: 11m 46s. Rate: 149.6 symbols/min [2025-10-24T00:46:37.739061] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:37.739195] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:37.739707] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:37.758818] [DEBUG] [LOCAL ] CIA: Loaded 16554 existing records from primary storage. [2025-10-24T00:46:37.759233] [INFO ] [MAIN ] CIA: Loaded 16554 primary data records. [2025-10-24T00:46:37.905374] [DEBUG] [LOCAL ] CIB: Loaded 30473 existing records from primary storage. [2025-10-24T00:46:37.945580] [INFO ] [MAIN ] CIB: Loaded 30473 primary data records. [2025-10-24T00:46:38.205388] [DEBUG] [LOCAL ] CIEN: Loaded 52498 existing records from primary storage. [2025-10-24T00:46:38.232383] [INFO ] [MAIN ] CIEN: Loaded 52498 primary data records. [2025-10-24T00:46:38.774149] [DEBUG] [MAIN ] CIA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:46:38.808549] [DEBUG] [MAIN ] CIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:38.852259] [DEBUG] [MAIN ] CIEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:38.896587] [INFO ] [MAIN ] CIA: Generated 139 derivative records from 16554 primary records. [2025-10-24T00:46:38.897196] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-24T00:46:38.898470] [FATAL] [LOCAL ] CIA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:38.898769] [FATAL] [MAIN ] CIA: Failed to save derivative data. [2025-10-24T00:46:38.902411] [INFO ] [MAIN ] Derivative Progress: 406/2164 symbols completed. CIA took 1.2s. Estimated remaining: 11m 49s. Rate: 148.9 symbols/min [2025-10-24T00:46:38.903099] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:38.909161] [INFO ] [MAIN ] CIB: Generated 139 derivative records from 30473 primary records. [2025-10-24T00:46:38.910858] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-24T00:46:38.912550] [FATAL] [LOCAL ] CIB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:38.915505] [FATAL] [MAIN ] CIB: Failed to save derivative data. [2025-10-24T00:46:38.918691] [INFO ] [MAIN ] Derivative Progress: 407/2164 symbols completed. CIB took 1.2s. Estimated remaining: 11m 46s. Rate: 149.2 symbols/min [2025-10-24T00:46:38.921038] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:38.921244] [DEBUG] [LOCAL ] CIF: Loaded 3992 existing records from primary storage. [2025-10-24T00:46:38.921874] [INFO ] [MAIN ] CIF: Loaded 3992 primary data records. [2025-10-24T00:46:39.035348] [INFO ] [MAIN ] CIEN: Generated 139 derivative records from 52498 primary records. [2025-10-24T00:46:39.051795] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-24T00:46:39.076108] [FATAL] [LOCAL ] CIEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:39.124947] [FATAL] [MAIN ] CIEN: Failed to save derivative data. [2025-10-24T00:46:39.238671] [INFO ] [MAIN ] Derivative Progress: 408/2164 symbols completed. CIEN took 1.5s. Estimated remaining: 11m 46s. Rate: 149.3 symbols/min [2025-10-24T00:46:39.247098] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:39.269917] [DEBUG] [LOCAL ] CIG: Loaded 44791 existing records from primary storage. [2025-10-24T00:46:39.270321] [INFO ] [MAIN ] CIG: Loaded 44791 primary data records. [2025-10-24T00:46:39.341323] [DEBUG] [LOCAL ] CII: Loaded 15213 existing records from primary storage. [2025-10-24T00:46:39.376467] [INFO ] [MAIN ] CII: Loaded 15213 primary data records. [2025-10-24T00:46:39.788196] [DEBUG] [MAIN ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:39.966581] [INFO ] [MAIN ] CIF: Generated 139 derivative records from 3992 primary records. [2025-10-24T00:46:39.967548] [DEBUG] [MAIN ] CIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:39.968287] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-24T00:46:39.980236] [FATAL] [LOCAL ] CIF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:39.989916] [FATAL] [MAIN ] CIF: Failed to save derivative data. [2025-10-24T00:46:39.997788] [INFO ] [MAIN ] Derivative Progress: 409/2164 symbols completed. CIF took 1.1s. Estimated remaining: 11m 47s. Rate: 149.0 symbols/min [2025-10-24T00:46:39.998414] [DEBUG] [MAIN ] CII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:39.999762] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:40.059823] [INFO ] [MAIN ] CIG: Generated 139 derivative records from 44791 primary records. [2025-10-24T00:46:40.073311] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-24T00:46:40.075734] [FATAL] [LOCAL ] CIG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:40.076157] [FATAL] [MAIN ] CIG: Failed to save derivative data. [2025-10-24T00:46:40.078569] [INFO ] [MAIN ] Derivative Progress: 410/2164 symbols completed. CIG took 1.2s. Estimated remaining: 11m 45s. Rate: 149.3 symbols/min [2025-10-24T00:46:40.076043] [INFO ] [MAIN ] CII: Generated 139 derivative records from 15213 primary records. [2025-10-24T00:46:40.079771] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-24T00:46:40.079387] [DEBUG] [LOCAL ] CIM: Loaded 37666 existing records from primary storage. [2025-10-24T00:46:40.079960] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:40.080346] [FATAL] [LOCAL ] CII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:40.081105] [INFO ] [MAIN ] CIM: Loaded 37666 primary data records. [2025-10-24T00:46:40.080959] [FATAL] [MAIN ] CII: Failed to save derivative data. [2025-10-24T00:46:40.084378] [INFO ] [MAIN ] Derivative Progress: 411/2164 symbols completed. CII took 0.8s. Estimated remaining: 11m 43s. Rate: 149.6 symbols/min [2025-10-24T00:46:40.084719] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:40.156308] [DEBUG] [LOCAL ] CIMN: Loaded 2715 existing records from primary storage. [2025-10-24T00:46:40.156494] [INFO ] [MAIN ] CIMN: Loaded 2715 primary data records. [2025-10-24T00:46:40.272343] [DEBUG] [LOCAL ] CINT: Loaded 20616 existing records from primary storage. [2025-10-24T00:46:40.303261] [INFO ] [MAIN ] CINT: Loaded 20616 primary data records. [2025-10-24T00:46:41.077745] [DEBUG] [MAIN ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:41.083012] [DEBUG] [MAIN ] CIMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:41.131022] [DEBUG] [MAIN ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:41.189464] [INFO ] [MAIN ] CIM: Generated 139 derivative records from 37666 primary records. [2025-10-24T00:46:41.190147] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-24T00:46:41.190545] [FATAL] [LOCAL ] CIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:41.193295] [FATAL] [MAIN ] CIM: Failed to save derivative data. [2025-10-24T00:46:41.198437] [INFO ] [MAIN ] Derivative Progress: 412/2164 symbols completed. CIM took 1.2s. Estimated remaining: 11m 46s. Rate: 149.0 symbols/min [2025-10-24T00:46:41.200806] [INFO ] [MAIN ] CIMN: Generated 139 derivative records from 2715 primary records. [2025-10-24T00:46:41.200589] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:41.201611] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-24T00:46:41.203391] [FATAL] [LOCAL ] CIMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:41.204070] [INFO ] [MAIN ] CINT: Generated 139 derivative records from 20616 primary records. [2025-10-24T00:46:41.204154] [FATAL] [MAIN ] CIMN: Failed to save derivative data. [2025-10-24T00:46:41.207315] [INFO ] [MAIN ] Derivative Progress: 413/2164 symbols completed. CIMN took 1.1s. Estimated remaining: 11m 44s. Rate: 149.3 symbols/min [2025-10-24T00:46:41.207484] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:41.208048] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-24T00:46:41.208277] [FATAL] [LOCAL ] CINT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:41.208400] [FATAL] [MAIN ] CINT: Failed to save derivative data. [2025-10-24T00:46:41.211412] [INFO ] [MAIN ] Derivative Progress: 414/2164 symbols completed. CINT took 1.1s. Estimated remaining: 11m 41s. Rate: 149.7 symbols/min [2025-10-24T00:46:41.211700] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:41.229503] [DEBUG] [LOCAL ] CIO: Loaded 21445 existing records from primary storage. [2025-10-24T00:46:41.229681] [INFO ] [MAIN ] CIO: Loaded 21445 primary data records. [2025-10-24T00:46:41.316681] [DEBUG] [LOCAL ] CION: Loaded 28261 existing records from primary storage. [2025-10-24T00:46:41.346904] [INFO ] [MAIN ] CION: Loaded 28261 primary data records. [2025-10-24T00:46:41.730152] [DEBUG] [LOCAL ] CIVI: Loaded 53109 existing records from primary storage. [2025-10-24T00:46:41.741755] [INFO ] [MAIN ] CIVI: Loaded 53109 primary data records. [2025-10-24T00:46:42.206230] [DEBUG] [MAIN ] CIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:42.234591] [DEBUG] [MAIN ] CION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:42.284803] [DEBUG] [MAIN ] CIVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:42.321932] [INFO ] [MAIN ] CIO: Generated 139 derivative records from 21445 primary records. [2025-10-24T00:46:42.324488] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-24T00:46:42.327931] [FATAL] [LOCAL ] CIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:42.328669] [FATAL] [MAIN ] CIO: Failed to save derivative data. [2025-10-24T00:46:42.334911] [INFO ] [MAIN ] Derivative Progress: 415/2164 symbols completed. CIO took 1.1s. Estimated remaining: 11m 44s. Rate: 149.0 symbols/min [2025-10-24T00:46:42.335097] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:42.339603] [INFO ] [MAIN ] CION: Generated 139 derivative records from 28261 primary records. [2025-10-24T00:46:42.342814] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-24T00:46:42.343250] [FATAL] [LOCAL ] CION: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:42.344820] [FATAL] [MAIN ] CION: Failed to save derivative data. [2025-10-24T00:46:42.349539] [INFO ] [MAIN ] Derivative Progress: 416/2164 symbols completed. CION took 1.1s. Estimated remaining: 11m 42s. Rate: 149.4 symbols/min [2025-10-24T00:46:42.350231] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:42.353854] [INFO ] [MAIN ] CIVI: Generated 139 derivative records from 53109 primary records. [2025-10-24T00:46:42.354109] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-24T00:46:42.354312] [FATAL] [LOCAL ] CIVI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:42.354426] [FATAL] [MAIN ] CIVI: Failed to save derivative data. [2025-10-24T00:46:42.357401] [INFO ] [MAIN ] Derivative Progress: 417/2164 symbols completed. CIVI took 1.1s. Estimated remaining: 11m 40s. Rate: 149.7 symbols/min [2025-10-24T00:46:42.357556] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:42.379811] [DEBUG] [LOCAL ] CLCO: Loaded 13277 existing records from primary storage. [2025-10-24T00:46:42.380202] [INFO ] [MAIN ] CLCO: Loaded 13277 primary data records. [2025-10-24T00:46:42.485788] [DEBUG] [LOCAL ] CLB: Loaded 33810 existing records from primary storage. [2025-10-24T00:46:42.512913] [INFO ] [MAIN ] CLB: Loaded 33810 primary data records. [2025-10-24T00:46:42.726841] [DEBUG] [LOCAL ] CL: Loaded 54039 existing records from primary storage. [2025-10-24T00:46:42.853299] [INFO ] [MAIN ] CL: Loaded 54039 primary data records. [2025-10-24T00:46:43.379328] [DEBUG] [MAIN ] CLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:43.406043] [DEBUG] [MAIN ] CLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:43.450807] [DEBUG] [MAIN ] CL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:43.477114] [INFO ] [MAIN ] CLCO: Generated 139 derivative records from 13277 primary records. [2025-10-24T00:46:43.482134] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-24T00:46:43.482435] [FATAL] [LOCAL ] CLCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:43.482682] [FATAL] [MAIN ] CLCO: Failed to save derivative data. [2025-10-24T00:46:43.484723] [INFO ] [MAIN ] Derivative Progress: 418/2164 symbols completed. CLCO took 1.1s. Estimated remaining: 11m 43s. Rate: 149.1 symbols/min [2025-10-24T00:46:43.498341] [INFO ] [MAIN ] CLB: Generated 139 derivative records from 33810 primary records. [2025-10-24T00:46:43.499845] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-24T00:46:43.500249] [FATAL] [LOCAL ] CLB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:43.502296] [FATAL] [MAIN ] CLB: Failed to save derivative data. [2025-10-24T00:46:43.505314] [INFO ] [MAIN ] Derivative Progress: 419/2164 symbols completed. CLB took 1.2s. Estimated remaining: 11m 41s. Rate: 149.4 symbols/min [2025-10-24T00:46:43.507801] [INFO ] [MAIN ] CL: Generated 139 derivative records from 54039 primary records. [2025-10-24T00:46:43.507887] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-24T00:46:43.508073] [FATAL] [LOCAL ] CL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:43.508148] [FATAL] [MAIN ] CL: Failed to save derivative data. [2025-10-24T00:46:43.511913] [INFO ] [MAIN ] Derivative Progress: 420/2164 symbols completed. CL took 1.2s. Estimated remaining: 11m 39s. Rate: 149.8 symbols/min [2025-10-24T00:46:43.512267] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:43.512451] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:43.512349] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:43.559234] [DEBUG] [LOCAL ] CLDT: Loaded 25339 existing records from primary storage. [2025-10-24T00:46:43.559912] [DEBUG] [LOCAL ] CLH: Loaded 27786 existing records from primary storage. [2025-10-24T00:46:43.559999] [INFO ] [MAIN ] CLDT: Loaded 25339 primary data records. [2025-10-24T00:46:43.560149] [INFO ] [MAIN ] CLH: Loaded 27786 primary data records. [2025-10-24T00:46:43.811979] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-24T00:46:43.854844] [INFO ] [MAIN ] CLF: Loaded 54131 primary data records. [2025-10-24T00:46:44.542587] [DEBUG] [MAIN ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:44.574451] [DEBUG] [MAIN ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:44.603987] [DEBUG] [MAIN ] CLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:44.661410] [INFO ] [MAIN ] CLH: Generated 139 derivative records from 27786 primary records. [2025-10-24T00:46:44.661548] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-24T00:46:44.662559] [FATAL] [LOCAL ] CLH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:44.663062] [FATAL] [MAIN ] CLH: Failed to save derivative data. [2025-10-24T00:46:44.665467] [INFO ] [MAIN ] Derivative Progress: 421/2164 symbols completed. CLH took 1.2s. Estimated remaining: 11m 41s. Rate: 149.1 symbols/min [2025-10-24T00:46:44.670205] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:44.674138] [INFO ] [MAIN ] CLDT: Generated 139 derivative records from 25339 primary records. [2025-10-24T00:46:44.675832] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-24T00:46:44.676301] [FATAL] [LOCAL ] CLDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:44.678845] [FATAL] [MAIN ] CLDT: Failed to save derivative data. [2025-10-24T00:46:44.682302] [INFO ] [MAIN ] Derivative Progress: 422/2164 symbols completed. CLDT took 1.2s. Estimated remaining: 11m 39s. Rate: 149.5 symbols/min [2025-10-24T00:46:44.686608] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:44.693077] [INFO ] [MAIN ] CLF: Generated 139 derivative records from 54131 primary records. [2025-10-24T00:46:44.693349] [DEBUG] [LOCAL ] CLPR: Loaded 10044 existing records from primary storage. [2025-10-24T00:46:44.693494] [INFO ] [MAIN ] CLPR: Loaded 10044 primary data records. [2025-10-24T00:46:44.704726] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-24T00:46:44.704946] [FATAL] [LOCAL ] CLF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:44.724460] [FATAL] [MAIN ] CLF: Failed to save derivative data. [2025-10-24T00:46:44.750977] [INFO ] [MAIN ] Derivative Progress: 423/2164 symbols completed. CLF took 1.2s. Estimated remaining: 11m 38s. Rate: 149.8 symbols/min [2025-10-24T00:46:44.781786] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:45.016452] [DEBUG] [LOCAL ] CLW: Loaded 21377 existing records from primary storage. [2025-10-24T00:46:45.017397] [INFO ] [MAIN ] CLW: Loaded 21377 primary data records. [2025-10-24T00:46:45.127186] [DEBUG] [LOCAL ] CLVT: Loaded 52276 existing records from primary storage. [2025-10-24T00:46:45.138309] [INFO ] [MAIN ] CLVT: Loaded 52276 primary data records. [2025-10-24T00:46:45.643546] [DEBUG] [MAIN ] CLPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:45.696967] [DEBUG] [MAIN ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:45.733035] [INFO ] [MAIN ] CLPR: Generated 139 derivative records from 10044 primary records. [2025-10-24T00:46:45.735053] [DEBUG] [MAIN ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:45.733674] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-24T00:46:45.746830] [FATAL] [LOCAL ] CLPR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:45.752175] [FATAL] [MAIN ] CLPR: Failed to save derivative data. [2025-10-24T00:46:45.755473] [INFO ] [MAIN ] Derivative Progress: 424/2164 symbols completed. CLPR took 1.1s. Estimated remaining: 11m 40s. Rate: 149.2 symbols/min [2025-10-24T00:46:45.758348] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:45.786624] [INFO ] [MAIN ] CLW: Generated 139 derivative records from 21377 primary records. [2025-10-24T00:46:45.789479] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-24T00:46:45.789915] [FATAL] [LOCAL ] CLW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:45.793009] [INFO ] [MAIN ] CLVT: Generated 139 derivative records from 52276 primary records. [2025-10-24T00:46:45.793128] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-24T00:46:45.793247] [FATAL] [MAIN ] CLW: Failed to save derivative data. [2025-10-24T00:46:45.793539] [FATAL] [LOCAL ] CLVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:45.796053] [INFO ] [MAIN ] Derivative Progress: 425/2164 symbols completed. CLW took 1.0s. Estimated remaining: 11m 38s. Rate: 149.5 symbols/min [2025-10-24T00:46:45.793675] [FATAL] [MAIN ] CLVT: Failed to save derivative data. [2025-10-24T00:46:45.799334] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:45.799530] [INFO ] [MAIN ] Derivative Progress: 426/2164 symbols completed. CLVT took 1.1s. Estimated remaining: 11m 36s. Rate: 149.9 symbols/min [2025-10-24T00:46:45.817112] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:45.844946] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-10-24T00:46:45.845225] [INFO ] [MAIN ] CLX: Loaded 52189 primary data records. [2025-10-24T00:46:46.047786] [DEBUG] [LOCAL ] CM: Loaded 48681 existing records from primary storage. [2025-10-24T00:46:46.057472] [INFO ] [MAIN ] CM: Loaded 48681 primary data records. [2025-10-24T00:46:46.057271] [DEBUG] [LOCAL ] CMA: Loaded 50557 existing records from primary storage. [2025-10-24T00:46:46.188231] [INFO ] [MAIN ] CMA: Loaded 50557 primary data records. [2025-10-24T00:46:46.881306] [DEBUG] [MAIN ] CLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:46.920460] [DEBUG] [MAIN ] CM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:46.966806] [DEBUG] [MAIN ] CMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:47.004057] [INFO ] [MAIN ] CLX: Generated 139 derivative records from 52189 primary records. [2025-10-24T00:46:47.007894] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-24T00:46:47.011460] [FATAL] [LOCAL ] CLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:47.012407] [FATAL] [MAIN ] CLX: Failed to save derivative data. [2025-10-24T00:46:47.016560] [INFO ] [MAIN ] Derivative Progress: 427/2164 symbols completed. CLX took 1.3s. Estimated remaining: 11m 39s. Rate: 149.2 symbols/min [2025-10-24T00:46:47.021045] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:47.028791] [INFO ] [MAIN ] CM: Generated 139 derivative records from 48681 primary records. [2025-10-24T00:46:47.029805] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-24T00:46:47.031698] [FATAL] [LOCAL ] CM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:47.032938] [FATAL] [MAIN ] CM: Failed to save derivative data. [2025-10-24T00:46:47.036355] [INFO ] [MAIN ] Derivative Progress: 428/2164 symbols completed. CM took 1.2s. Estimated remaining: 11m 37s. Rate: 149.5 symbols/min [2025-10-24T00:46:47.036638] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:47.040664] [INFO ] [MAIN ] CMA: Generated 139 derivative records from 50557 primary records. [2025-10-24T00:46:47.040810] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-24T00:46:47.040997] [FATAL] [LOCAL ] CMA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:47.041089] [FATAL] [MAIN ] CMA: Failed to save derivative data. [2025-10-24T00:46:47.051241] [INFO ] [MAIN ] Derivative Progress: 429/2164 symbols completed. CMA took 1.2s. Estimated remaining: 11m 35s. Rate: 149.8 symbols/min [2025-10-24T00:46:47.051546] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:47.068212] [DEBUG] [LOCAL ] CMCM: Loaded 4858 existing records from primary storage. [2025-10-24T00:46:47.065377] [DEBUG] [LOCAL ] CMBT: Loaded 27899 existing records from primary storage. [2025-10-24T00:46:47.068459] [INFO ] [MAIN ] CMBT: Loaded 27899 primary data records. [2025-10-24T00:46:47.068558] [INFO ] [MAIN ] CMCM: Loaded 4858 primary data records. [2025-10-24T00:46:47.567031] [DEBUG] [LOCAL ] CMC: Loaded 45922 existing records from primary storage. [2025-10-24T00:46:47.682778] [INFO ] [MAIN ] CMC: Loaded 45922 primary data records. [2025-10-24T00:46:48.034903] [DEBUG] [MAIN ] CMBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:48.064775] [DEBUG] [MAIN ] CMCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:48.128148] [DEBUG] [MAIN ] CMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:48.171299] [INFO ] [MAIN ] CMCM: Generated 139 derivative records from 4858 primary records. [2025-10-24T00:46:48.171556] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-24T00:46:48.172284] [FATAL] [LOCAL ] CMCM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:48.171843] [INFO ] [MAIN ] CMBT: Generated 139 derivative records from 27899 primary records. [2025-10-24T00:46:48.175171] [FATAL] [MAIN ] CMCM: Failed to save derivative data. [2025-10-24T00:46:48.175402] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-24T00:46:48.179209] [FATAL] [LOCAL ] CMBT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:48.179438] [FATAL] [MAIN ] CMBT: Failed to save derivative data. [2025-10-24T00:46:48.178567] [INFO ] [MAIN ] Derivative Progress: 430/2164 symbols completed. CMCM took 1.1s. Estimated remaining: 11m 37s. Rate: 149.2 symbols/min [2025-10-24T00:46:48.179854] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:48.182903] [INFO ] [MAIN ] Derivative Progress: 431/2164 symbols completed. CMBT took 1.2s. Estimated remaining: 11m 35s. Rate: 149.6 symbols/min [2025-10-24T00:46:48.184964] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:48.196566] [INFO ] [MAIN ] CMC: Generated 139 derivative records from 45922 primary records. [2025-10-24T00:46:48.196875] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-24T00:46:48.197507] [FATAL] [LOCAL ] CMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:48.197598] [FATAL] [MAIN ] CMC: Failed to save derivative data. [2025-10-24T00:46:48.202175] [INFO ] [MAIN ] Derivative Progress: 432/2164 symbols completed. CMC took 1.2s. Estimated remaining: 11m 33s. Rate: 149.9 symbols/min [2025-10-24T00:46:48.202848] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:48.267425] [DEBUG] [LOCAL ] CMG: Loaded 54112 existing records from primary storage. [2025-10-24T00:46:48.279835] [INFO ] [MAIN ] CMG: Loaded 54112 primary data records. [2025-10-24T00:46:48.301548] [DEBUG] [LOCAL ] CMI: Loaded 41922 existing records from primary storage. [2025-10-24T00:46:48.335729] [INFO ] [MAIN ] CMI: Loaded 41922 primary data records. [2025-10-24T00:46:48.487253] [DEBUG] [LOCAL ] CMP: Loaded 35825 existing records from primary storage. [2025-10-24T00:46:48.508820] [INFO ] [MAIN ] CMP: Loaded 35825 primary data records. [2025-10-24T00:46:49.376954] [DEBUG] [MAIN ] CMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:49.383858] [DEBUG] [MAIN ] CMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:49.454826] [DEBUG] [MAIN ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:49.524107] [INFO ] [MAIN ] CMG: Generated 139 derivative records from 54112 primary records. [2025-10-24T00:46:49.529206] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-24T00:46:49.533935] [FATAL] [LOCAL ] CMG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:49.534563] [INFO ] [MAIN ] CMI: Generated 139 derivative records from 41922 primary records. [2025-10-24T00:46:49.534701] [FATAL] [MAIN ] CMG: Failed to save derivative data. [2025-10-24T00:46:49.535031] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-24T00:46:49.541985] [FATAL] [LOCAL ] CMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:49.537755] [INFO ] [MAIN ] Derivative Progress: 433/2164 symbols completed. CMG took 1.4s. Estimated remaining: 11m 37s. Rate: 149.1 symbols/min [2025-10-24T00:46:49.542718] [FATAL] [MAIN ] CMI: Failed to save derivative data. [2025-10-24T00:46:49.547829] [INFO ] [MAIN ] Derivative Progress: 434/2164 symbols completed. CMI took 1.4s. Estimated remaining: 11m 35s. Rate: 149.4 symbols/min [2025-10-24T00:46:49.550965] [INFO ] [MAIN ] CMP: Generated 139 derivative records from 35825 primary records. [2025-10-24T00:46:49.551185] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-24T00:46:49.551447] [FATAL] [LOCAL ] CMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:49.551574] [FATAL] [MAIN ] CMP: Failed to save derivative data. [2025-10-24T00:46:49.556357] [INFO ] [MAIN ] Derivative Progress: 435/2164 symbols completed. CMP took 1.4s. Estimated remaining: 11m 33s. Rate: 149.8 symbols/min [2025-10-24T00:46:49.557107] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:49.556909] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:49.557861] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:49.650525] [DEBUG] [LOCAL ] CMRE: Loaded 35849 existing records from primary storage. [2025-10-24T00:46:49.666183] [INFO ] [MAIN ] CMRE: Loaded 35849 primary data records. [2025-10-24T00:46:49.668623] [DEBUG] [LOCAL ] CMS: Loaded 52913 existing records from primary storage. [2025-10-24T00:46:49.667563] [DEBUG] [LOCAL ] CMPO: Loaded 38603 existing records from primary storage. [2025-10-24T00:46:49.669290] [INFO ] [MAIN ] CMPO: Loaded 38603 primary data records. [2025-10-24T00:46:49.674734] [INFO ] [MAIN ] CMS: Loaded 52913 primary data records. [2025-10-24T00:46:50.746388] [DEBUG] [MAIN ] CMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:50.795860] [DEBUG] [MAIN ] CMPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:50.802183] [DEBUG] [MAIN ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:50.893521] [INFO ] [MAIN ] CMS: Generated 139 derivative records from 52913 primary records. [2025-10-24T00:46:50.894893] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-24T00:46:50.895246] [FATAL] [LOCAL ] CMS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:50.895408] [FATAL] [MAIN ] CMS: Failed to save derivative data. [2025-10-24T00:46:50.904412] [INFO ] [MAIN ] Derivative Progress: 436/2164 symbols completed. CMS took 1.3s. Estimated remaining: 11m 36s. Rate: 148.9 symbols/min [2025-10-24T00:46:50.904767] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:50.914982] [INFO ] [MAIN ] CMPO: Generated 139 derivative records from 38603 primary records. [2025-10-24T00:46:50.915374] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-24T00:46:50.917378] [FATAL] [LOCAL ] CMPO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:50.920394] [DEBUG] [LOCAL ] CMSA: Loaded 3498 existing records from primary storage. [2025-10-24T00:46:50.920226] [FATAL] [MAIN ] CMPO: Failed to save derivative data. [2025-10-24T00:46:50.924130] [INFO ] [MAIN ] Derivative Progress: 437/2164 symbols completed. CMPO took 1.4s. Estimated remaining: 11m 34s. Rate: 149.3 symbols/min [2025-10-24T00:46:50.921212] [INFO ] [MAIN ] CMSA: Loaded 3498 primary data records. [2025-10-24T00:46:50.935735] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:50.963353] [INFO ] [MAIN ] CMRE: Generated 139 derivative records from 35849 primary records. [2025-10-24T00:46:51.003022] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-24T00:46:51.031169] [FATAL] [LOCAL ] CMRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:51.047872] [FATAL] [MAIN ] CMRE: Failed to save derivative data. [2025-10-24T00:46:51.057285] [INFO ] [MAIN ] Derivative Progress: 438/2164 symbols completed. CMRE took 1.5s. Estimated remaining: 11m 33s. Rate: 149.5 symbols/min [2025-10-24T00:46:51.062774] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:51.120496] [DEBUG] [LOCAL ] CMSC: Loaded 4826 existing records from primary storage. [2025-10-24T00:46:51.239847] [INFO ] [MAIN ] CMSC: Loaded 4826 primary data records. [2025-10-24T00:46:51.315592] [DEBUG] [LOCAL ] CMSD: Loaded 7641 existing records from primary storage. [2025-10-24T00:46:51.321728] [INFO ] [MAIN ] CMSD: Loaded 7641 primary data records. [2025-10-24T00:46:51.927751] [DEBUG] [MAIN ] CMSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:51.996850] [DEBUG] [MAIN ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:52.002908] [DEBUG] [MAIN ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:52.041118] [INFO ] [MAIN ] CMSA: Generated 139 derivative records from 3498 primary records. [2025-10-24T00:46:52.045215] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-24T00:46:52.048679] [FATAL] [LOCAL ] CMSA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:52.049224] [FATAL] [MAIN ] CMSA: Failed to save derivative data. [2025-10-24T00:46:52.055615] [INFO ] [MAIN ] Derivative Progress: 439/2164 symbols completed. CMSA took 1.2s. Estimated remaining: 11m 35s. Rate: 149.0 symbols/min [2025-10-24T00:46:52.062957] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:52.090818] [INFO ] [MAIN ] CMSC: Generated 139 derivative records from 4826 primary records. [2025-10-24T00:46:52.092681] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-24T00:46:52.093124] [FATAL] [LOCAL ] CMSC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:52.093609] [FATAL] [MAIN ] CMSC: Failed to save derivative data. [2025-10-24T00:46:52.098530] [INFO ] [MAIN ] Derivative Progress: 440/2164 symbols completed. CMSC took 1.2s. Estimated remaining: 11m 33s. Rate: 149.3 symbols/min [2025-10-24T00:46:52.108042] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:52.098807] [INFO ] [MAIN ] CMSD: Generated 139 derivative records from 7641 primary records. [2025-10-24T00:46:52.108710] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-24T00:46:52.109048] [FATAL] [LOCAL ] CMSD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:52.109128] [FATAL] [MAIN ] CMSD: Failed to save derivative data. [2025-10-24T00:46:52.112076] [INFO ] [MAIN ] Derivative Progress: 441/2164 symbols completed. CMSD took 1.0s. Estimated remaining: 11m 31s. Rate: 149.6 symbols/min [2025-10-24T00:46:52.112375] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:52.128201] [DEBUG] [LOCAL ] CMTG: Loaded 35366 existing records from primary storage. [2025-10-24T00:46:52.128558] [INFO ] [MAIN ] CMTG: Loaded 35366 primary data records. [2025-10-24T00:46:52.158922] [DEBUG] [LOCAL ] CMU: Loaded 6355 existing records from primary storage. [2025-10-24T00:46:52.188756] [INFO ] [MAIN ] CMU: Loaded 6355 primary data records. [2025-10-24T00:46:52.404920] [DEBUG] [LOCAL ] CNA: Loaded 32677 existing records from primary storage. [2025-10-24T00:46:52.430296] [INFO ] [MAIN ] CNA: Loaded 32677 primary data records. [2025-10-24T00:46:53.145901] [DEBUG] [MAIN ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:53.184288] [DEBUG] [MAIN ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:53.227008] [DEBUG] [MAIN ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:53.272518] [INFO ] [MAIN ] CMTG: Generated 139 derivative records from 35366 primary records. [2025-10-24T00:46:53.274446] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-24T00:46:53.278472] [FATAL] [LOCAL ] CMTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:53.281622] [FATAL] [MAIN ] CMTG: Failed to save derivative data. [2025-10-24T00:46:53.283823] [INFO ] [MAIN ] Derivative Progress: 442/2164 symbols completed. CMTG took 1.2s. Estimated remaining: 11m 34s. Rate: 149.0 symbols/min [2025-10-24T00:46:53.287602] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:53.300688] [INFO ] [MAIN ] CMU: Generated 139 derivative records from 6355 primary records. [2025-10-24T00:46:53.305367] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-24T00:46:53.305635] [FATAL] [LOCAL ] CMU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:53.306018] [FATAL] [MAIN ] CMU: Failed to save derivative data. [2025-10-24T00:46:53.310384] [INFO ] [MAIN ] Derivative Progress: 443/2164 symbols completed. CMU took 1.2s. Estimated remaining: 11m 32s. Rate: 149.3 symbols/min [2025-10-24T00:46:53.311209] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:53.314496] [INFO ] [MAIN ] CNA: Generated 139 derivative records from 32677 primary records. [2025-10-24T00:46:53.314606] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-24T00:46:53.314895] [FATAL] [LOCAL ] CNA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:53.314999] [FATAL] [MAIN ] CNA: Failed to save derivative data. [2025-10-24T00:46:53.319422] [INFO ] [MAIN ] Derivative Progress: 444/2164 symbols completed. CNA took 1.2s. Estimated remaining: 11m 30s. Rate: 149.6 symbols/min [2025-10-24T00:46:53.320038] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:53.344804] [DEBUG] [LOCAL ] CNF: Loaded 10614 existing records from primary storage. [2025-10-24T00:46:53.345219] [INFO ] [MAIN ] CNF: Loaded 10614 primary data records. [2025-10-24T00:46:53.484297] [DEBUG] [LOCAL ] CNC: Loaded 54169 existing records from primary storage. [2025-10-24T00:46:53.539563] [INFO ] [MAIN ] CNC: Loaded 54169 primary data records. [2025-10-24T00:46:53.829580] [DEBUG] [LOCAL ] CNH: Loaded 53936 existing records from primary storage. [2025-10-24T00:46:53.891768] [INFO ] [MAIN ] CNH: Loaded 53936 primary data records. [2025-10-24T00:46:54.337554] [DEBUG] [MAIN ] CNF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:46:54.390072] [DEBUG] [MAIN ] CNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:54.428996] [INFO ] [MAIN ] CNF: Generated 139 derivative records from 10614 primary records. [2025-10-24T00:46:54.444432] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-24T00:46:54.446235] [DEBUG] [MAIN ] CNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:54.449518] [FATAL] [LOCAL ] CNF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:54.462075] [FATAL] [MAIN ] CNF: Failed to save derivative data. [2025-10-24T00:46:54.469004] [INFO ] [MAIN ] Derivative Progress: 445/2164 symbols completed. CNF took 1.2s. Estimated remaining: 11m 32s. Rate: 149.0 symbols/min [2025-10-24T00:46:54.474754] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:54.484728] [INFO ] [MAIN ] CNC: Generated 139 derivative records from 54169 primary records. [2025-10-24T00:46:54.484956] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-24T00:46:54.487909] [FATAL] [LOCAL ] CNC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:54.488011] [FATAL] [MAIN ] CNC: Failed to save derivative data. [2025-10-24T00:46:54.490700] [INFO ] [MAIN ] Derivative Progress: 446/2164 symbols completed. CNC took 1.2s. Estimated remaining: 11m 30s. Rate: 149.3 symbols/min [2025-10-24T00:46:54.492174] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:54.503464] [INFO ] [MAIN ] CNH: Generated 139 derivative records from 53936 primary records. [2025-10-24T00:46:54.503682] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-24T00:46:54.503898] [FATAL] [LOCAL ] CNH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:54.503978] [FATAL] [MAIN ] CNH: Failed to save derivative data. [2025-10-24T00:46:54.506954] [INFO ] [MAIN ] Derivative Progress: 447/2164 symbols completed. CNH took 1.2s. Estimated remaining: 11m 28s. Rate: 149.6 symbols/min [2025-10-24T00:46:54.507124] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:54.583546] [DEBUG] [LOCAL ] CNI: Loaded 52019 existing records from primary storage. [2025-10-24T00:46:54.583852] [INFO ] [MAIN ] CNI: Loaded 52019 primary data records. [2025-10-24T00:46:54.620337] [DEBUG] [LOCAL ] CNM: Loaded 51372 existing records from primary storage. [2025-10-24T00:46:54.643417] [INFO ] [MAIN ] CNM: Loaded 51372 primary data records. [2025-10-24T00:46:54.678395] [DEBUG] [LOCAL ] CNMD: Loaded 32316 existing records from primary storage. [2025-10-24T00:46:54.714755] [INFO ] [MAIN ] CNMD: Loaded 32316 primary data records. [2025-10-24T00:46:55.655958] [DEBUG] [MAIN ] CNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:55.694599] [DEBUG] [MAIN ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:55.707852] [DEBUG] [MAIN ] CNM: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:46:55.783873] [INFO ] [MAIN ] CNI: Generated 139 derivative records from 52019 primary records. [2025-10-24T00:46:55.787289] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-24T00:46:55.788355] [FATAL] [LOCAL ] CNI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:55.789692] [FATAL] [MAIN ] CNI: Failed to save derivative data. [2025-10-24T00:46:55.791854] [INFO ] [MAIN ] Derivative Progress: 448/2164 symbols completed. CNI took 1.3s. Estimated remaining: 11m 31s. Rate: 148.9 symbols/min [2025-10-24T00:46:55.802896] [INFO ] [MAIN ] CNM: Generated 139 derivative records from 51372 primary records. [2025-10-24T00:46:55.805000] [INFO ] [MAIN ] CNMD: Generated 139 derivative records from 32316 primary records. [2025-10-24T00:46:55.805159] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-24T00:46:55.805242] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-24T00:46:55.805525] [FATAL] [LOCAL ] CNMD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:55.805635] [FATAL] [MAIN ] CNMD: Failed to save derivative data. [2025-10-24T00:46:55.805881] [FATAL] [LOCAL ] CNM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:55.805980] [FATAL] [MAIN ] CNM: Failed to save derivative data. [2025-10-24T00:46:55.809136] [INFO ] [MAIN ] Derivative Progress: 449/2164 symbols completed. CNMD took 1.3s. Estimated remaining: 11m 30s. Rate: 149.2 symbols/min [2025-10-24T00:46:55.812209] [INFO ] [MAIN ] Derivative Progress: 450/2164 symbols completed. CNM took 1.3s. Estimated remaining: 11m 28s. Rate: 149.5 symbols/min [2025-10-24T00:46:55.812871] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:55.812803] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:55.812716] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:55.887930] [DEBUG] [LOCAL ] CNNE: Loaded 35966 existing records from primary storage. [2025-10-24T00:46:55.889175] [DEBUG] [LOCAL ] CNO: Loaded 40585 existing records from primary storage. [2025-10-24T00:46:55.889482] [INFO ] [MAIN ] CNO: Loaded 40585 primary data records. [2025-10-24T00:46:55.889590] [INFO ] [MAIN ] CNNE: Loaded 35966 primary data records. [2025-10-24T00:46:55.971698] [DEBUG] [LOCAL ] CNP: Loaded 53865 existing records from primary storage. [2025-10-24T00:46:56.065574] [INFO ] [MAIN ] CNP: Loaded 53865 primary data records. [2025-10-24T00:46:56.921892] [DEBUG] [MAIN ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:56.922429] [DEBUG] [MAIN ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:56.975397] [DEBUG] [MAIN ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:57.042917] [INFO ] [MAIN ] CNNE: Generated 139 derivative records from 35966 primary records. [2025-10-24T00:46:57.039840] [INFO ] [MAIN ] CNO: Generated 139 derivative records from 40585 primary records. [2025-10-24T00:46:57.045018] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-24T00:46:57.046746] [FATAL] [LOCAL ] CNO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:57.047900] [FATAL] [MAIN ] CNO: Failed to save derivative data. [2025-10-24T00:46:57.044617] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-24T00:46:57.050316] [INFO ] [MAIN ] Derivative Progress: 451/2164 symbols completed. CNO took 1.2s. Estimated remaining: 11m 30s. Rate: 148.9 symbols/min [2025-10-24T00:46:57.048492] [FATAL] [LOCAL ] CNNE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:57.051213] [FATAL] [MAIN ] CNNE: Failed to save derivative data. [2025-10-24T00:46:57.054109] [INFO ] [MAIN ] Derivative Progress: 452/2164 symbols completed. CNNE took 1.2s. Estimated remaining: 11m 29s. Rate: 149.2 symbols/min [2025-10-24T00:46:57.050826] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:57.055732] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:57.058271] [INFO ] [MAIN ] CNP: Generated 139 derivative records from 53865 primary records. [2025-10-24T00:46:57.059225] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-24T00:46:57.059444] [FATAL] [LOCAL ] CNP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:57.059525] [FATAL] [MAIN ] CNP: Failed to save derivative data. [2025-10-24T00:46:57.062660] [INFO ] [MAIN ] Derivative Progress: 453/2164 symbols completed. CNP took 1.2s. Estimated remaining: 11m 27s. Rate: 149.5 symbols/min [2025-10-24T00:46:57.062885] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:57.084826] [DEBUG] [LOCAL ] CNS: Loaded 21443 existing records from primary storage. [2025-10-24T00:46:57.085130] [INFO ] [MAIN ] CNS: Loaded 21443 primary data records. [2025-10-24T00:46:57.446422] [DEBUG] [LOCAL ] CNQ: Loaded 53972 existing records from primary storage. [2025-10-24T00:46:57.447716] [INFO ] [MAIN ] CNQ: Loaded 53972 primary data records. [2025-10-24T00:46:57.447487] [DEBUG] [LOCAL ] CNX: Loaded 51709 existing records from primary storage. [2025-10-24T00:46:57.469412] [INFO ] [MAIN ] CNX: Loaded 51709 primary data records. [2025-10-24T00:46:58.084670] [DEBUG] [MAIN ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:58.127555] [DEBUG] [MAIN ] CNQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:58.172317] [DEBUG] [MAIN ] CNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:58.174625] [INFO ] [MAIN ] CNS: Generated 139 derivative records from 21443 primary records. [2025-10-24T00:46:58.175403] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-24T00:46:58.175763] [FATAL] [LOCAL ] CNS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:58.188166] [FATAL] [MAIN ] CNS: Failed to save derivative data. [2025-10-24T00:46:58.193495] [INFO ] [MAIN ] Derivative Progress: 454/2164 symbols completed. CNS took 1.1s. Estimated remaining: 11m 29s. Rate: 148.9 symbols/min [2025-10-24T00:46:58.195751] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:58.219806] [INFO ] [MAIN ] CNQ: Generated 139 derivative records from 53972 primary records. [2025-10-24T00:46:58.220341] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-24T00:46:58.223802] [FATAL] [LOCAL ] CNQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:58.224164] [FATAL] [MAIN ] CNQ: Failed to save derivative data. [2025-10-24T00:46:58.226473] [INFO ] [MAIN ] Derivative Progress: 455/2164 symbols completed. CNQ took 1.2s. Estimated remaining: 11m 27s. Rate: 149.2 symbols/min [2025-10-24T00:46:58.237873] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:58.244709] [INFO ] [MAIN ] CNX: Generated 139 derivative records from 51709 primary records. [2025-10-24T00:46:58.244926] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-24T00:46:58.245125] [FATAL] [LOCAL ] CNX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:58.245212] [FATAL] [MAIN ] CNX: Failed to save derivative data. [2025-10-24T00:46:58.248230] [INFO ] [MAIN ] Derivative Progress: 456/2164 symbols completed. CNX took 1.2s. Estimated remaining: 11m 25s. Rate: 149.5 symbols/min [2025-10-24T00:46:58.248527] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:58.263165] [DEBUG] [LOCAL ] CODI: Loaded 42256 existing records from primary storage. [2025-10-24T00:46:58.263348] [INFO ] [MAIN ] CODI: Loaded 42256 primary data records. [2025-10-24T00:46:58.622982] [DEBUG] [LOCAL ] COF: Loaded 54015 existing records from primary storage. [2025-10-24T00:46:58.623273] [INFO ] [MAIN ] COF: Loaded 54015 primary data records. [2025-10-24T00:46:58.762387] [DEBUG] [LOCAL ] COLD: Loaded 52875 existing records from primary storage. [2025-10-24T00:46:58.780433] [INFO ] [MAIN ] COLD: Loaded 52875 primary data records. [2025-10-24T00:46:59.336843] [DEBUG] [MAIN ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:59.377125] [DEBUG] [MAIN ] COF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:59.424237] [DEBUG] [MAIN ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:46:59.455782] [INFO ] [MAIN ] CODI: Generated 139 derivative records from 42256 primary records. [2025-10-24T00:46:59.458208] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-24T00:46:59.463454] [FATAL] [LOCAL ] CODI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:59.464184] [FATAL] [MAIN ] CODI: Failed to save derivative data. [2025-10-24T00:46:59.467160] [INFO ] [MAIN ] Derivative Progress: 457/2164 symbols completed. CODI took 1.3s. Estimated remaining: 11m 28s. Rate: 148.9 symbols/min [2025-10-24T00:46:59.468715] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:59.478501] [INFO ] [MAIN ] COF: Generated 139 derivative records from 54015 primary records. [2025-10-24T00:46:59.481796] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-24T00:46:59.484601] [FATAL] [LOCAL ] COF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:59.488622] [FATAL] [MAIN ] COF: Failed to save derivative data. [2025-10-24T00:46:59.491032] [INFO ] [MAIN ] Derivative Progress: 458/2164 symbols completed. COF took 1.3s. Estimated remaining: 11m 26s. Rate: 149.2 symbols/min [2025-10-24T00:46:59.491517] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:59.495632] [INFO ] [MAIN ] COLD: Generated 139 derivative records from 52875 primary records. [2025-10-24T00:46:59.495929] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-24T00:46:59.496146] [FATAL] [LOCAL ] COLD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:46:59.496241] [FATAL] [MAIN ] COLD: Failed to save derivative data. [2025-10-24T00:46:59.499444] [INFO ] [MAIN ] Derivative Progress: 459/2164 symbols completed. COLD took 1.3s. Estimated remaining: 11m 24s. Rate: 149.5 symbols/min [2025-10-24T00:46:59.499814] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:46:59.559811] [DEBUG] [LOCAL ] COOK: Loaded 24994 existing records from primary storage. [2025-10-24T00:46:59.561150] [INFO ] [MAIN ] COOK: Loaded 24994 primary data records. [2025-10-24T00:46:59.583320] [DEBUG] [LOCAL ] COMP: Loaded 53793 existing records from primary storage. [2025-10-24T00:46:59.605855] [INFO ] [MAIN ] COMP: Loaded 53793 primary data records. [2025-10-24T00:46:59.747974] [DEBUG] [LOCAL ] CON: Loaded 39033 existing records from primary storage. [2025-10-24T00:46:59.809114] [INFO ] [MAIN ] CON: Loaded 39033 primary data records. [2025-10-24T00:47:00.514331] [DEBUG] [MAIN ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:00.543566] [DEBUG] [MAIN ] COMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:00.591814] [DEBUG] [MAIN ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:00.631012] [INFO ] [MAIN ] COOK: Generated 139 derivative records from 24994 primary records. [2025-10-24T00:47:00.634909] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-24T00:47:00.635531] [FATAL] [LOCAL ] COOK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:00.635823] [FATAL] [MAIN ] COOK: Failed to save derivative data. [2025-10-24T00:47:00.641247] [INFO ] [MAIN ] Derivative Progress: 460/2164 symbols completed. COOK took 1.1s. Estimated remaining: 11m 27s. Rate: 148.9 symbols/min [2025-10-24T00:47:00.643737] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:00.644791] [INFO ] [MAIN ] COMP: Generated 139 derivative records from 53793 primary records. [2025-10-24T00:47:00.645039] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-24T00:47:00.645353] [FATAL] [LOCAL ] COMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:00.645687] [FATAL] [MAIN ] COMP: Failed to save derivative data. [2025-10-24T00:47:00.648706] [INFO ] [MAIN ] Derivative Progress: 461/2164 symbols completed. COMP took 1.2s. Estimated remaining: 11m 25s. Rate: 149.2 symbols/min [2025-10-24T00:47:00.649243] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:00.659964] [INFO ] [MAIN ] CON: Generated 139 derivative records from 39033 primary records. [2025-10-24T00:47:00.660288] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-24T00:47:00.660497] [FATAL] [LOCAL ] CON: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:00.660620] [FATAL] [MAIN ] CON: Failed to save derivative data. [2025-10-24T00:47:00.663703] [INFO ] [MAIN ] Derivative Progress: 462/2164 symbols completed. CON took 1.2s. Estimated remaining: 11m 23s. Rate: 149.5 symbols/min [2025-10-24T00:47:00.663901] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:00.746195] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-24T00:47:00.747462] [DEBUG] [LOCAL ] COTY: Loaded 53642 existing records from primary storage. [2025-10-24T00:47:00.747852] [INFO ] [MAIN ] COP: Loaded 54117 primary data records. [2025-10-24T00:47:00.748138] [INFO ] [MAIN ] COTY: Loaded 53642 primary data records. [2025-10-24T00:47:00.981702] [DEBUG] [LOCAL ] COUR: Loaded 49789 existing records from primary storage. [2025-10-24T00:47:01.037778] [INFO ] [MAIN ] COUR: Loaded 49789 primary data records. [2025-10-24T00:47:01.764052] [DEBUG] [MAIN ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:01.764430] [DEBUG] [MAIN ] COTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:01.841216] [DEBUG] [MAIN ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:01.873114] [INFO ] [MAIN ] COP: Generated 139 derivative records from 54117 primary records. [2025-10-24T00:47:01.878079] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-24T00:47:01.883324] [FATAL] [LOCAL ] COP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:01.883506] [FATAL] [MAIN ] COP: Failed to save derivative data. [2025-10-24T00:47:01.889145] [INFO ] [MAIN ] Derivative Progress: 463/2164 symbols completed. COP took 1.2s. Estimated remaining: 11m 26s. Rate: 148.9 symbols/min [2025-10-24T00:47:01.889517] [INFO ] [MAIN ] COTY: Generated 139 derivative records from 53642 primary records. [2025-10-24T00:47:01.893326] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-24T00:47:01.894123] [FATAL] [LOCAL ] COTY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:01.895480] [FATAL] [MAIN ] COTY: Failed to save derivative data. [2025-10-24T00:47:01.898528] [INFO ] [MAIN ] Derivative Progress: 464/2164 symbols completed. COTY took 1.2s. Estimated remaining: 11m 24s. Rate: 149.2 symbols/min [2025-10-24T00:47:01.906886] [INFO ] [MAIN ] COUR: Generated 139 derivative records from 49789 primary records. [2025-10-24T00:47:01.906981] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-24T00:47:01.907176] [FATAL] [LOCAL ] COUR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:01.907294] [FATAL] [MAIN ] COUR: Failed to save derivative data. [2025-10-24T00:47:01.910760] [INFO ] [MAIN ] Derivative Progress: 465/2164 symbols completed. COUR took 1.2s. Estimated remaining: 11m 22s. Rate: 149.5 symbols/min [2025-10-24T00:47:01.911432] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:01.911351] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:01.911217] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:01.963335] [DEBUG] [LOCAL ] CPAY: Loaded 30232 existing records from primary storage. [2025-10-24T00:47:01.964182] [DEBUG] [LOCAL ] CPA: Loaded 27920 existing records from primary storage. [2025-10-24T00:47:01.964436] [INFO ] [MAIN ] CPAY: Loaded 30232 primary data records. [2025-10-24T00:47:01.964801] [INFO ] [MAIN ] CPA: Loaded 27920 primary data records. [2025-10-24T00:47:02.246065] [DEBUG] [LOCAL ] CP: Loaded 53617 existing records from primary storage. [2025-10-24T00:47:02.306463] [INFO ] [MAIN ] CP: Loaded 53617 primary data records. [2025-10-24T00:47:03.138445] [DEBUG] [MAIN ] CPAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:03.177528] [DEBUG] [MAIN ] CPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:03.255213] [DEBUG] [MAIN ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:03.279444] [INFO ] [MAIN ] CPAY: Generated 139 derivative records from 30232 primary records. [2025-10-24T00:47:03.281804] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-24T00:47:03.283948] [FATAL] [LOCAL ] CPAY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:03.287363] [FATAL] [MAIN ] CPAY: Failed to save derivative data. [2025-10-24T00:47:03.290569] [INFO ] [MAIN ] CPA: Generated 139 derivative records from 27920 primary records. [2025-10-24T00:47:03.292959] [INFO ] [MAIN ] Derivative Progress: 466/2164 symbols completed. CPAY took 1.4s. Estimated remaining: 11m 25s. Rate: 148.7 symbols/min [2025-10-24T00:47:03.295327] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:03.295534] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-24T00:47:03.296713] [FATAL] [LOCAL ] CPA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:03.297004] [FATAL] [MAIN ] CPA: Failed to save derivative data. [2025-10-24T00:47:03.301173] [INFO ] [MAIN ] Derivative Progress: 467/2164 symbols completed. CPA took 1.4s. Estimated remaining: 11m 23s. Rate: 149.0 symbols/min [2025-10-24T00:47:03.305402] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:03.325788] [INFO ] [MAIN ] CP: Generated 139 derivative records from 53617 primary records. [2025-10-24T00:47:03.331441] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-24T00:47:03.338265] [DEBUG] [LOCAL ] CPF: Loaded 15267 existing records from primary storage. [2025-10-24T00:47:03.337591] [FATAL] [LOCAL ] CP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:03.338491] [INFO ] [MAIN ] CPF: Loaded 15267 primary data records. [2025-10-24T00:47:03.338769] [FATAL] [MAIN ] CP: Failed to save derivative data. [2025-10-24T00:47:03.382769] [INFO ] [MAIN ] Derivative Progress: 468/2164 symbols completed. CP took 1.5s. Estimated remaining: 11m 22s. Rate: 149.3 symbols/min [2025-10-24T00:47:03.402933] [DEBUG] [LOCAL ] CPK: Loaded 14004 existing records from primary storage. [2025-10-24T00:47:03.426055] [INFO ] [MAIN ] CPK: Loaded 14004 primary data records. [2025-10-24T00:47:03.420759] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:04.042255] [DEBUG] [LOCAL ] CPNG: Loaded 54069 existing records from primary storage. [2025-10-24T00:47:04.043348] [INFO ] [MAIN ] CPNG: Loaded 54069 primary data records. [2025-10-24T00:47:04.242122] [DEBUG] [MAIN ] CPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:04.382541] [DEBUG] [MAIN ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:04.439151] [INFO ] [MAIN ] CPF: Generated 139 derivative records from 15267 primary records. [2025-10-24T00:47:04.451795] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-24T00:47:04.452066] [DEBUG] [MAIN ] CPNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:04.454486] [FATAL] [LOCAL ] CPF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:04.454756] [INFO ] [MAIN ] CPK: Generated 139 derivative records from 14004 primary records. [2025-10-24T00:47:04.454857] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-24T00:47:04.454616] [FATAL] [MAIN ] CPF: Failed to save derivative data. [2025-10-24T00:47:04.466421] [FATAL] [LOCAL ] CPK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:04.470328] [INFO ] [MAIN ] Derivative Progress: 469/2164 symbols completed. CPF took 1.2s. Estimated remaining: 11m 24s. Rate: 148.7 symbols/min [2025-10-24T00:47:04.470804] [FATAL] [MAIN ] CPK: Failed to save derivative data. [2025-10-24T00:47:04.471006] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:04.475467] [INFO ] [MAIN ] Derivative Progress: 470/2164 symbols completed. CPK took 1.2s. Estimated remaining: 11m 22s. Rate: 149.0 symbols/min [2025-10-24T00:47:04.479262] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:04.501858] [INFO ] [MAIN ] CPNG: Generated 139 derivative records from 54069 primary records. [2025-10-24T00:47:04.502029] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-24T00:47:04.502211] [FATAL] [LOCAL ] CPNG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:04.502331] [FATAL] [MAIN ] CPNG: Failed to save derivative data. [2025-10-24T00:47:04.504843] [INFO ] [MAIN ] Derivative Progress: 471/2164 symbols completed. CPNG took 1.1s. Estimated remaining: 11m 20s. Rate: 149.3 symbols/min [2025-10-24T00:47:04.505070] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:04.514697] [DEBUG] [LOCAL ] CPS: Loaded 25046 existing records from primary storage. [2025-10-24T00:47:04.514997] [INFO ] [MAIN ] CPS: Loaded 25046 primary data records. [2025-10-24T00:47:04.720500] [DEBUG] [LOCAL ] CPRI: Loaded 52812 existing records from primary storage. [2025-10-24T00:47:04.822449] [INFO ] [MAIN ] CPRI: Loaded 52812 primary data records. [2025-10-24T00:47:04.984769] [DEBUG] [LOCAL ] CPT: Loaded 44826 existing records from primary storage. [2025-10-24T00:47:05.038119] [INFO ] [MAIN ] CPT: Loaded 44826 primary data records. [2025-10-24T00:47:05.503948] [DEBUG] [MAIN ] CPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:05.550803] [DEBUG] [MAIN ] CPRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:05.590098] [DEBUG] [MAIN ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:05.605549] [INFO ] [MAIN ] CPS: Generated 139 derivative records from 25046 primary records. [2025-10-24T00:47:05.606040] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-24T00:47:05.607703] [FATAL] [LOCAL ] CPS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:05.611026] [FATAL] [MAIN ] CPS: Failed to save derivative data. [2025-10-24T00:47:05.613133] [INFO ] [MAIN ] Derivative Progress: 472/2164 symbols completed. CPS took 1.1s. Estimated remaining: 11m 22s. Rate: 148.8 symbols/min [2025-10-24T00:47:05.613286] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:05.643862] [DEBUG] [LOCAL ] CQP: Loaded 18778 existing records from primary storage. [2025-10-24T00:47:05.645569] [INFO ] [MAIN ] CQP: Loaded 18778 primary data records. [2025-10-24T00:47:05.693391] [INFO ] [MAIN ] CPRI: Generated 139 derivative records from 52812 primary records. [2025-10-24T00:47:05.719232] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-24T00:47:05.732284] [FATAL] [LOCAL ] CPRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:05.742869] [FATAL] [MAIN ] CPRI: Failed to save derivative data. [2025-10-24T00:47:05.752802] [INFO ] [MAIN ] Derivative Progress: 473/2164 symbols completed. CPRI took 1.3s. Estimated remaining: 11m 21s. Rate: 149.0 symbols/min [2025-10-24T00:47:05.756110] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:05.838815] [INFO ] [MAIN ] CPT: Generated 139 derivative records from 44826 primary records. [2025-10-24T00:47:05.951010] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-24T00:47:05.951918] [FATAL] [LOCAL ] CPT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:05.957777] [FATAL] [MAIN ] CPT: Failed to save derivative data. [2025-10-24T00:47:05.961057] [INFO ] [MAIN ] Derivative Progress: 474/2164 symbols completed. CPT took 1.5s. Estimated remaining: 11m 20s. Rate: 149.1 symbols/min [2025-10-24T00:47:05.962002] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:05.976400] [DEBUG] [LOCAL ] CR: Loaded 24152 existing records from primary storage. [2025-10-24T00:47:05.977790] [INFO ] [MAIN ] CR: Loaded 24152 primary data records. [2025-10-24T00:47:06.037693] [DEBUG] [LOCAL ] CRBD: Loaded 8790 existing records from primary storage. [2025-10-24T00:47:06.058874] [INFO ] [MAIN ] CRBD: Loaded 8790 primary data records. [2025-10-24T00:47:06.379092] [DEBUG] [MAIN ] CQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:06.628512] [INFO ] [MAIN ] CQP: Generated 139 derivative records from 18778 primary records. [2025-10-24T00:47:06.628832] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-24T00:47:06.629192] [FATAL] [LOCAL ] CQP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:06.636967] [FATAL] [MAIN ] CQP: Failed to save derivative data. [2025-10-24T00:47:06.641916] [DEBUG] [MAIN ] CR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:06.655186] [INFO ] [MAIN ] Derivative Progress: 475/2164 symbols completed. CQP took 1.0s. Estimated remaining: 11m 21s. Rate: 148.9 symbols/min [2025-10-24T00:47:06.658878] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:06.679537] [DEBUG] [MAIN ] CRBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:06.737353] [INFO ] [MAIN ] CR: Generated 139 derivative records from 24152 primary records. [2025-10-24T00:47:06.737766] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-24T00:47:06.740613] [FATAL] [LOCAL ] CR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:06.741122] [FATAL] [MAIN ] CR: Failed to save derivative data. [2025-10-24T00:47:06.744117] [INFO ] [MAIN ] Derivative Progress: 476/2164 symbols completed. CR took 1.0s. Estimated remaining: 11m 19s. Rate: 149.2 symbols/min [2025-10-24T00:47:06.745409] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:06.766755] [INFO ] [MAIN ] CRBD: Generated 139 derivative records from 8790 primary records. [2025-10-24T00:47:06.767986] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-24T00:47:06.767572] [DEBUG] [LOCAL ] CRBG: Loaded 52974 existing records from primary storage. [2025-10-24T00:47:06.768199] [INFO ] [MAIN ] CRBG: Loaded 52974 primary data records. [2025-10-24T00:47:06.768613] [FATAL] [LOCAL ] CRBD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:06.801013] [FATAL] [MAIN ] CRBD: Failed to save derivative data. [2025-10-24T00:47:06.828170] [INFO ] [MAIN ] Derivative Progress: 477/2164 symbols completed. CRBD took 0.9s. Estimated remaining: 11m 17s. Rate: 149.4 symbols/min [2025-10-24T00:47:06.848424] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:07.109441] [DEBUG] [LOCAL ] CRC: Loaded 44391 existing records from primary storage. [2025-10-24T00:47:07.110534] [INFO ] [MAIN ] CRC: Loaded 44391 primary data records. [2025-10-24T00:47:07.325773] [DEBUG] [LOCAL ] CRGY: Loaded 52885 existing records from primary storage. [2025-10-24T00:47:07.393030] [INFO ] [MAIN ] CRGY: Loaded 52885 primary data records. [2025-10-24T00:47:07.806445] [DEBUG] [MAIN ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:07.854939] [DEBUG] [MAIN ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:07.912036] [DEBUG] [MAIN ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:07.914597] [INFO ] [MAIN ] CRBG: Generated 139 derivative records from 52974 primary records. [2025-10-24T00:47:07.927114] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-24T00:47:07.933279] [FATAL] [LOCAL ] CRBG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:07.933920] [FATAL] [MAIN ] CRBG: Failed to save derivative data. [2025-10-24T00:47:07.936490] [INFO ] [MAIN ] Derivative Progress: 478/2164 symbols completed. CRBG took 1.3s. Estimated remaining: 11m 20s. Rate: 148.9 symbols/min [2025-10-24T00:47:07.956639] [INFO ] [MAIN ] CRC: Generated 139 derivative records from 44391 primary records. [2025-10-24T00:47:07.957224] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-24T00:47:07.958988] [FATAL] [LOCAL ] CRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:07.959527] [FATAL] [MAIN ] CRC: Failed to save derivative data. [2025-10-24T00:47:07.965313] [INFO ] [MAIN ] Derivative Progress: 479/2164 symbols completed. CRC took 1.2s. Estimated remaining: 11m 18s. Rate: 149.1 symbols/min [2025-10-24T00:47:07.971504] [INFO ] [MAIN ] CRGY: Generated 139 derivative records from 52885 primary records. [2025-10-24T00:47:07.971702] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-24T00:47:07.971908] [FATAL] [LOCAL ] CRGY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:07.971993] [FATAL] [MAIN ] CRGY: Failed to save derivative data. [2025-10-24T00:47:07.974885] [INFO ] [MAIN ] Derivative Progress: 480/2164 symbols completed. CRGY took 1.1s. Estimated remaining: 11m 16s. Rate: 149.5 symbols/min [2025-10-24T00:47:07.975491] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:07.975737] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:07.975922] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:08.087090] [DEBUG] [LOCAL ] CRI: Loaded 49854 existing records from primary storage. [2025-10-24T00:47:08.090024] [INFO ] [MAIN ] CRI: Loaded 49854 primary data records. [2025-10-24T00:47:08.089689] [DEBUG] [LOCAL ] CRH: Loaded 53784 existing records from primary storage. [2025-10-24T00:47:08.090382] [INFO ] [MAIN ] CRH: Loaded 53784 primary data records. [2025-10-24T00:47:08.091240] [DEBUG] [LOCAL ] CRK: Loaded 52603 existing records from primary storage. [2025-10-24T00:47:08.117870] [INFO ] [MAIN ] CRK: Loaded 52603 primary data records. [2025-10-24T00:47:09.085663] [DEBUG] [MAIN ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:09.130143] [DEBUG] [MAIN ] CRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:09.130628] [DEBUG] [MAIN ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:09.204133] [INFO ] [MAIN ] CRI: Generated 139 derivative records from 49854 primary records. [2025-10-24T00:47:09.206741] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-24T00:47:09.210048] [FATAL] [LOCAL ] CRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:09.213986] [FATAL] [MAIN ] CRI: Failed to save derivative data. [2025-10-24T00:47:09.217530] [INFO ] [MAIN ] Derivative Progress: 481/2164 symbols completed. CRI took 1.2s. Estimated remaining: 11m 19s. Rate: 148.8 symbols/min [2025-10-24T00:47:09.219083] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:09.222628] [INFO ] [MAIN ] CRH: Generated 139 derivative records from 53784 primary records. [2025-10-24T00:47:09.222774] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-24T00:47:09.225415] [INFO ] [MAIN ] CRK: Generated 139 derivative records from 52603 primary records. [2025-10-24T00:47:09.225606] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-24T00:47:09.226462] [FATAL] [LOCAL ] CRK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:09.226579] [FATAL] [MAIN ] CRK: Failed to save derivative data. [2025-10-24T00:47:09.226088] [FATAL] [LOCAL ] CRH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:09.229626] [FATAL] [MAIN ] CRH: Failed to save derivative data. [2025-10-24T00:47:09.229513] [INFO ] [MAIN ] Derivative Progress: 482/2164 symbols completed. CRK took 1.3s. Estimated remaining: 11m 17s. Rate: 149.1 symbols/min [2025-10-24T00:47:09.234249] [INFO ] [MAIN ] Derivative Progress: 483/2164 symbols completed. CRH took 1.3s. Estimated remaining: 11m 15s. Rate: 149.4 symbols/min [2025-10-24T00:47:09.234498] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:09.234135] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:09.246321] [DEBUG] [LOCAL ] CRT: Loaded 4832 existing records from primary storage. [2025-10-24T00:47:09.246592] [INFO ] [MAIN ] CRT: Loaded 4832 primary data records. [2025-10-24T00:47:09.421362] [DEBUG] [LOCAL ] CRL: Loaded 42952 existing records from primary storage. [2025-10-24T00:47:09.430809] [INFO ] [MAIN ] CRL: Loaded 42952 primary data records. [2025-10-24T00:47:09.759812] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-24T00:47:09.760557] [INFO ] [MAIN ] CRM: Loaded 54160 primary data records. [2025-10-24T00:47:10.310429] [DEBUG] [MAIN ] CRT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:10.355693] [DEBUG] [MAIN ] CRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:10.390263] [DEBUG] [MAIN ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:10.421685] [INFO ] [MAIN ] CRT: Generated 139 derivative records from 4832 primary records. [2025-10-24T00:47:10.428095] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-24T00:47:10.429235] [FATAL] [LOCAL ] CRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:10.433210] [FATAL] [MAIN ] CRT: Failed to save derivative data. [2025-10-24T00:47:10.438315] [INFO ] [MAIN ] Derivative Progress: 484/2164 symbols completed. CRT took 1.2s. Estimated remaining: 11m 17s. Rate: 148.8 symbols/min [2025-10-24T00:47:10.438546] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:10.448592] [INFO ] [MAIN ] CRL: Generated 139 derivative records from 42952 primary records. [2025-10-24T00:47:10.450282] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-24T00:47:10.450573] [FATAL] [LOCAL ] CRL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:10.450692] [FATAL] [MAIN ] CRL: Failed to save derivative data. [2025-10-24T00:47:10.455841] [INFO ] [MAIN ] Derivative Progress: 485/2164 symbols completed. CRL took 1.2s. Estimated remaining: 11m 16s. Rate: 149.1 symbols/min [2025-10-24T00:47:10.457223] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:10.461540] [INFO ] [MAIN ] CRM: Generated 139 derivative records from 54160 primary records. [2025-10-24T00:47:10.461868] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-24T00:47:10.462273] [FATAL] [LOCAL ] CRM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:10.462366] [FATAL] [MAIN ] CRM: Failed to save derivative data. [2025-10-24T00:47:10.465085] [INFO ] [MAIN ] Derivative Progress: 486/2164 symbols completed. CRM took 1.2s. Estimated remaining: 11m 14s. Rate: 149.4 symbols/min [2025-10-24T00:47:10.465272] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:10.506081] [DEBUG] [LOCAL ] CSAN: Loaded 42520 existing records from primary storage. [2025-10-24T00:47:10.506365] [INFO ] [MAIN ] CSAN: Loaded 42520 primary data records. [2025-10-24T00:47:10.547973] [DEBUG] [LOCAL ] CSR: Loaded 13476 existing records from primary storage. [2025-10-24T00:47:10.555038] [INFO ] [MAIN ] CSR: Loaded 13476 primary data records. [2025-10-24T00:47:10.678244] [DEBUG] [LOCAL ] CSL: Loaded 31384 existing records from primary storage. [2025-10-24T00:47:10.687603] [INFO ] [MAIN ] CSL: Loaded 31384 primary data records. [2025-10-24T00:47:11.520298] [DEBUG] [MAIN ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:11.559914] [DEBUG] [MAIN ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:11.593380] [DEBUG] [MAIN ] CSL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:11.656492] [INFO ] [MAIN ] CSR: Generated 139 derivative records from 13476 primary records. [2025-10-24T00:47:11.659842] [INFO ] [MAIN ] CSAN: Generated 139 derivative records from 42520 primary records. [2025-10-24T00:47:11.660012] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-24T00:47:11.660356] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-24T00:47:11.661115] [FATAL] [LOCAL ] CSAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:11.660598] [FATAL] [LOCAL ] CSR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:11.663555] [FATAL] [MAIN ] CSAN: Failed to save derivative data. [2025-10-24T00:47:11.663469] [FATAL] [MAIN ] CSR: Failed to save derivative data. [2025-10-24T00:47:11.666745] [INFO ] [MAIN ] Derivative Progress: 487/2164 symbols completed. CSR took 1.2s. Estimated remaining: 11m 16s. Rate: 148.8 symbols/min [2025-10-24T00:47:11.671206] [INFO ] [MAIN ] Derivative Progress: 488/2164 symbols completed. CSAN took 1.2s. Estimated remaining: 11m 15s. Rate: 149.1 symbols/min [2025-10-24T00:47:11.671084] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:11.671533] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:11.674478] [INFO ] [MAIN ] CSL: Generated 139 derivative records from 31384 primary records. [2025-10-24T00:47:11.674738] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-24T00:47:11.675321] [FATAL] [LOCAL ] CSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:11.675443] [FATAL] [MAIN ] CSL: Failed to save derivative data. [2025-10-24T00:47:11.678140] [INFO ] [MAIN ] Derivative Progress: 489/2164 symbols completed. CSL took 1.2s. Estimated remaining: 11m 13s. Rate: 149.4 symbols/min [2025-10-24T00:47:11.678481] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:11.692426] [DEBUG] [LOCAL ] CSV: Loaded 12479 existing records from primary storage. [2025-10-24T00:47:11.695816] [DEBUG] [LOCAL ] CTBB: Loaded 6424 existing records from primary storage. [2025-10-24T00:47:11.695933] [INFO ] [MAIN ] CSV: Loaded 12479 primary data records. [2025-10-24T00:47:11.696164] [INFO ] [MAIN ] CTBB: Loaded 6424 primary data records. [2025-10-24T00:47:12.035404] [DEBUG] [LOCAL ] CSTM: Loaded 47799 existing records from primary storage. [2025-10-24T00:47:12.162979] [INFO ] [MAIN ] CSTM: Loaded 47799 primary data records. [2025-10-24T00:47:12.671678] [DEBUG] [MAIN ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:12.677208] [DEBUG] [MAIN ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:12.729270] [DEBUG] [MAIN ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:12.785694] [INFO ] [MAIN ] CSV: Generated 139 derivative records from 12479 primary records. [2025-10-24T00:47:12.788702] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-24T00:47:12.788997] [FATAL] [LOCAL ] CSV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:12.789381] [FATAL] [MAIN ] CSV: Failed to save derivative data. [2025-10-24T00:47:12.794671] [INFO ] [MAIN ] Derivative Progress: 490/2164 symbols completed. CSV took 1.1s. Estimated remaining: 11m 15s. Rate: 148.8 symbols/min [2025-10-24T00:47:12.795372] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:12.795101] [INFO ] [MAIN ] CTBB: Generated 139 derivative records from 6424 primary records. [2025-10-24T00:47:12.800201] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-24T00:47:12.802215] [FATAL] [LOCAL ] CTBB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:12.805192] [FATAL] [MAIN ] CTBB: Failed to save derivative data. [2025-10-24T00:47:12.807604] [INFO ] [MAIN ] Derivative Progress: 491/2164 symbols completed. CTBB took 1.1s. Estimated remaining: 11m 13s. Rate: 149.1 symbols/min [2025-10-24T00:47:12.810369] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:12.813670] [DEBUG] [LOCAL ] CTDD: Loaded 5159 existing records from primary storage. [2025-10-24T00:47:12.810535] [INFO ] [MAIN ] CSTM: Generated 139 derivative records from 47799 primary records. [2025-10-24T00:47:12.814004] [INFO ] [MAIN ] CTDD: Loaded 5159 primary data records. [2025-10-24T00:47:12.814198] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-24T00:47:12.856934] [FATAL] [LOCAL ] CSTM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:12.900160] [FATAL] [MAIN ] CSTM: Failed to save derivative data. [2025-10-24T00:47:12.916148] [INFO ] [MAIN ] Derivative Progress: 492/2164 symbols completed. CSTM took 1.2s. Estimated remaining: 11m 12s. Rate: 149.4 symbols/min [2025-10-24T00:47:12.916430] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:13.134789] [DEBUG] [LOCAL ] CTO: Loaded 27572 existing records from primary storage. [2025-10-24T00:47:13.135353] [INFO ] [MAIN ] CTO: Loaded 27572 primary data records. [2025-10-24T00:47:13.271535] [DEBUG] [LOCAL ] CTOS: Loaded 37510 existing records from primary storage. [2025-10-24T00:47:13.294338] [INFO ] [MAIN ] CTOS: Loaded 37510 primary data records. [2025-10-24T00:47:13.904592] [DEBUG] [MAIN ] CTDD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:13.980900] [DEBUG] [MAIN ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:13.981214] [INFO ] [MAIN ] CTDD: Generated 139 derivative records from 5159 primary records. [2025-10-24T00:47:13.995039] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-24T00:47:14.011074] [FATAL] [LOCAL ] CTDD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:14.013785] [FATAL] [MAIN ] CTDD: Failed to save derivative data. [2025-10-24T00:47:14.011992] [DEBUG] [MAIN ] CTOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:14.016121] [INFO ] [MAIN ] Derivative Progress: 493/2164 symbols completed. CTDD took 1.2s. Estimated remaining: 11m 14s. Rate: 148.8 symbols/min [2025-10-24T00:47:14.068230] [INFO ] [MAIN ] CTO: Generated 139 derivative records from 27572 primary records. [2025-10-24T00:47:14.071369] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-24T00:47:14.073036] [FATAL] [LOCAL ] CTO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:14.073280] [FATAL] [MAIN ] CTO: Failed to save derivative data. [2025-10-24T00:47:14.076927] [INFO ] [MAIN ] Derivative Progress: 494/2164 symbols completed. CTO took 1.3s. Estimated remaining: 11m 12s. Rate: 149.1 symbols/min [2025-10-24T00:47:14.079331] [INFO ] [MAIN ] CTOS: Generated 139 derivative records from 37510 primary records. [2025-10-24T00:47:14.079495] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-24T00:47:14.079752] [FATAL] [LOCAL ] CTOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:14.079834] [FATAL] [MAIN ] CTOS: Failed to save derivative data. [2025-10-24T00:47:14.082720] [INFO ] [MAIN ] Derivative Progress: 495/2164 symbols completed. CTOS took 1.2s. Estimated remaining: 11m 10s. Rate: 149.4 symbols/min [2025-10-24T00:47:14.083238] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:14.083137] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:14.083548] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:14.167597] [DEBUG] [LOCAL ] CTRI: Loaded 41115 existing records from primary storage. [2025-10-24T00:47:14.183789] [INFO ] [MAIN ] CTRI: Loaded 41115 primary data records. [2025-10-24T00:47:14.185908] [DEBUG] [LOCAL ] CTRE: Loaded 49781 existing records from primary storage. [2025-10-24T00:47:14.191530] [INFO ] [MAIN ] CTRE: Loaded 49781 primary data records. [2025-10-24T00:47:14.192261] [DEBUG] [LOCAL ] CTRA: Loaded 54037 existing records from primary storage. [2025-10-24T00:47:14.204865] [INFO ] [MAIN ] CTRA: Loaded 54037 primary data records. [2025-10-24T00:47:15.211102] [DEBUG] [MAIN ] CTRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:15.210134] [DEBUG] [MAIN ] CTRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:15.211838] [DEBUG] [MAIN ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:15.310185] [INFO ] [MAIN ] CTRE: Generated 139 derivative records from 49781 primary records. [2025-10-24T00:47:15.313389] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-24T00:47:15.315046] [FATAL] [LOCAL ] CTRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:15.317118] [FATAL] [MAIN ] CTRE: Failed to save derivative data. [2025-10-24T00:47:15.321110] [INFO ] [MAIN ] Derivative Progress: 496/2164 symbols completed. CTRE took 1.2s. Estimated remaining: 11m 13s. Rate: 148.8 symbols/min [2025-10-24T00:47:15.327555] [INFO ] [MAIN ] CTRI: Generated 139 derivative records from 41115 primary records. [2025-10-24T00:47:15.328433] [INFO ] [MAIN ] CTRA: Generated 139 derivative records from 54037 primary records. [2025-10-24T00:47:15.328899] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:15.329101] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-24T00:47:15.329215] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-24T00:47:15.330382] [FATAL] [LOCAL ] CTRA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:15.330876] [FATAL] [LOCAL ] CTRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:15.330534] [FATAL] [MAIN ] CTRA: Failed to save derivative data. [2025-10-24T00:47:15.333508] [INFO ] [MAIN ] Derivative Progress: 497/2164 symbols completed. CTRA took 1.3s. Estimated remaining: 11m 11s. Rate: 149.1 symbols/min [2025-10-24T00:47:15.333882] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:15.334638] [FATAL] [MAIN ] CTRI: Failed to save derivative data. [2025-10-24T00:47:15.339764] [INFO ] [MAIN ] Derivative Progress: 498/2164 symbols completed. CTRI took 1.3s. Estimated remaining: 11m 9s. Rate: 149.3 symbols/min [2025-10-24T00:47:15.340998] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:15.366556] [DEBUG] [LOCAL ] CTS: Loaded 19655 existing records from primary storage. [2025-10-24T00:47:15.366915] [INFO ] [MAIN ] CTS: Loaded 19655 primary data records. [2025-10-24T00:47:15.584168] [DEBUG] [LOCAL ] CTVA: Loaded 53693 existing records from primary storage. [2025-10-24T00:47:15.622720] [INFO ] [MAIN ] CTVA: Loaded 53693 primary data records. [2025-10-24T00:47:15.808503] [DEBUG] [LOCAL ] CUBE: Loaded 51249 existing records from primary storage. [2025-10-24T00:47:15.830905] [INFO ] [MAIN ] CUBE: Loaded 51249 primary data records. [2025-10-24T00:47:16.520018] [DEBUG] [MAIN ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:16.578092] [DEBUG] [MAIN ] CTVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:16.599181] [DEBUG] [MAIN ] CUBE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:16.637433] [INFO ] [MAIN ] CTS: Generated 139 derivative records from 19655 primary records. [2025-10-24T00:47:16.638512] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-24T00:47:16.644088] [FATAL] [LOCAL ] CTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:16.644315] [FATAL] [MAIN ] CTS: Failed to save derivative data. [2025-10-24T00:47:16.648800] [INFO ] [MAIN ] Derivative Progress: 499/2164 symbols completed. CTS took 1.3s. Estimated remaining: 11m 12s. Rate: 148.7 symbols/min [2025-10-24T00:47:16.649264] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:16.667945] [INFO ] [MAIN ] CTVA: Generated 139 derivative records from 53693 primary records. [2025-10-24T00:47:16.669059] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-24T00:47:16.669585] [FATAL] [LOCAL ] CTVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:16.669834] [FATAL] [MAIN ] CTVA: Failed to save derivative data. [2025-10-24T00:47:16.674198] [INFO ] [MAIN ] CUBE: Generated 139 derivative records from 51249 primary records. [2025-10-24T00:47:16.673876] [INFO ] [MAIN ] Derivative Progress: 500/2164 symbols completed. CTVA took 1.3s. Estimated remaining: 11m 10s. Rate: 149.0 symbols/min [2025-10-24T00:47:16.683758] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:16.683862] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-24T00:47:16.684637] [FATAL] [LOCAL ] CUBE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:16.684947] [FATAL] [MAIN ] CUBE: Failed to save derivative data. [2025-10-24T00:47:16.687759] [INFO ] [MAIN ] Derivative Progress: 501/2164 symbols completed. CUBE took 1.3s. Estimated remaining: 11m 9s. Rate: 149.2 symbols/min [2025-10-24T00:47:16.688141] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:16.700238] [DEBUG] [LOCAL ] CUBI: Loaded 27213 existing records from primary storage. [2025-10-24T00:47:16.701838] [INFO ] [MAIN ] CUBI: Loaded 27213 primary data records. [2025-10-24T00:47:16.704914] [DEBUG] [LOCAL ] CULP: Loaded 2847 existing records from primary storage. [2025-10-24T00:47:16.717750] [INFO ] [MAIN ] CULP: Loaded 2847 primary data records. [2025-10-24T00:47:17.368338] [DEBUG] [LOCAL ] CUK: Loaded 51440 existing records from primary storage. [2025-10-24T00:47:17.369585] [INFO ] [MAIN ] CUK: Loaded 51440 primary data records. [2025-10-24T00:47:17.727768] [DEBUG] [MAIN ] CUBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:17.759495] [DEBUG] [MAIN ] CULP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:17.827942] [DEBUG] [MAIN ] CUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:17.927272] [INFO ] [MAIN ] CUBI: Generated 139 derivative records from 27213 primary records. [2025-10-24T00:47:17.934420] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-24T00:47:17.934984] [FATAL] [LOCAL ] CUBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:17.935316] [FATAL] [MAIN ] CUBI: Failed to save derivative data. [2025-10-24T00:47:17.934244] [INFO ] [MAIN ] CULP: Generated 139 derivative records from 2847 primary records. [2025-10-24T00:47:17.938941] [INFO ] [MAIN ] Derivative Progress: 502/2164 symbols completed. CUBI took 1.3s. Estimated remaining: 11m 11s. Rate: 148.6 symbols/min [2025-10-24T00:47:17.939502] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:17.939568] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-24T00:47:17.942910] [FATAL] [LOCAL ] CULP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:17.949070] [FATAL] [MAIN ] CULP: Failed to save derivative data. [2025-10-24T00:47:17.951856] [INFO ] [MAIN ] Derivative Progress: 503/2164 symbols completed. CULP took 1.3s. Estimated remaining: 11m 9s. Rate: 148.9 symbols/min [2025-10-24T00:47:17.952152] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:17.964352] [INFO ] [MAIN ] CUK: Generated 139 derivative records from 51440 primary records. [2025-10-24T00:47:17.964744] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-24T00:47:17.964974] [FATAL] [LOCAL ] CUK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:17.965183] [FATAL] [MAIN ] CUK: Failed to save derivative data. [2025-10-24T00:47:17.971873] [INFO ] [MAIN ] Derivative Progress: 504/2164 symbols completed. CUK took 1.3s. Estimated remaining: 11m 8s. Rate: 149.2 symbols/min [2025-10-24T00:47:17.972315] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:18.006566] [DEBUG] [LOCAL ] CURV: Loaded 27396 existing records from primary storage. [2025-10-24T00:47:18.017590] [INFO ] [MAIN ] CURV: Loaded 27396 primary data records. [2025-10-24T00:47:18.031321] [DEBUG] [LOCAL ] CURB: Loaded 33062 existing records from primary storage. [2025-10-24T00:47:18.062286] [INFO ] [MAIN ] CURB: Loaded 33062 primary data records. [2025-10-24T00:47:18.391869] [DEBUG] [LOCAL ] CUZ: Loaded 49765 existing records from primary storage. [2025-10-24T00:47:18.567541] [INFO ] [MAIN ] CUZ: Loaded 49765 primary data records. [2025-10-24T00:47:19.042127] [DEBUG] [MAIN ] CURV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:19.085151] [DEBUG] [MAIN ] CURB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:19.155236] [DEBUG] [MAIN ] CUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:19.173166] [INFO ] [MAIN ] CURV: Generated 139 derivative records from 27396 primary records. [2025-10-24T00:47:19.178331] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-24T00:47:19.183767] [FATAL] [LOCAL ] CURV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:19.183961] [FATAL] [MAIN ] CURV: Failed to save derivative data. [2025-10-24T00:47:19.186606] [INFO ] [MAIN ] Derivative Progress: 505/2164 symbols completed. CURV took 1.2s. Estimated remaining: 11m 10s. Rate: 148.6 symbols/min [2025-10-24T00:47:19.191617] [INFO ] [MAIN ] CURB: Generated 139 derivative records from 33062 primary records. [2025-10-24T00:47:19.192073] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:19.193977] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-24T00:47:19.194348] [FATAL] [LOCAL ] CURB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:19.194591] [FATAL] [MAIN ] CURB: Failed to save derivative data. [2025-10-24T00:47:19.198155] [INFO ] [MAIN ] Derivative Progress: 506/2164 symbols completed. CURB took 1.3s. Estimated remaining: 11m 8s. Rate: 148.9 symbols/min [2025-10-24T00:47:19.201989] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:19.215631] [INFO ] [MAIN ] CUZ: Generated 139 derivative records from 49765 primary records. [2025-10-24T00:47:19.222173] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-24T00:47:19.222490] [FATAL] [LOCAL ] CUZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:19.222735] [FATAL] [MAIN ] CUZ: Failed to save derivative data. [2025-10-24T00:47:19.225918] [INFO ] [MAIN ] Derivative Progress: 507/2164 symbols completed. CUZ took 1.3s. Estimated remaining: 11m 7s. Rate: 149.2 symbols/min [2025-10-24T00:47:19.226237] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:19.234793] [DEBUG] [LOCAL ] CVEO: Loaded 15266 existing records from primary storage. [2025-10-24T00:47:19.235174] [INFO ] [MAIN ] CVEO: Loaded 15266 primary data records. [2025-10-24T00:47:19.455324] [DEBUG] [LOCAL ] CVE: Loaded 53957 existing records from primary storage. [2025-10-24T00:47:19.478431] [INFO ] [MAIN ] CVE: Loaded 53957 primary data records. [2025-10-24T00:47:19.678002] [DEBUG] [LOCAL ] CVI: Loaded 47049 existing records from primary storage. [2025-10-24T00:47:19.700117] [INFO ] [MAIN ] CVI: Loaded 47049 primary data records. [2025-10-24T00:47:20.334542] [DEBUG] [MAIN ] CVEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:20.382043] [DEBUG] [MAIN ] CVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:20.435560] [INFO ] [MAIN ] CVEO: Generated 139 derivative records from 15266 primary records. [2025-10-24T00:47:20.434839] [DEBUG] [MAIN ] CVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:20.435923] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-24T00:47:20.455017] [FATAL] [LOCAL ] CVEO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:20.455602] [FATAL] [MAIN ] CVEO: Failed to save derivative data. [2025-10-24T00:47:20.459329] [INFO ] [MAIN ] Derivative Progress: 508/2164 symbols completed. CVEO took 1.3s. Estimated remaining: 11m 9s. Rate: 148.5 symbols/min [2025-10-24T00:47:20.495340] [INFO ] [MAIN ] CVE: Generated 139 derivative records from 53957 primary records. [2025-10-24T00:47:20.496880] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-24T00:47:20.497359] [FATAL] [LOCAL ] CVE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:20.497593] [FATAL] [MAIN ] CVE: Failed to save derivative data. [2025-10-24T00:47:20.502625] [INFO ] [MAIN ] CVI: Generated 139 derivative records from 47049 primary records. [2025-10-24T00:47:20.502069] [INFO ] [MAIN ] Derivative Progress: 509/2164 symbols completed. CVE took 1.3s. Estimated remaining: 11m 7s. Rate: 148.8 symbols/min [2025-10-24T00:47:20.503131] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-24T00:47:20.503380] [FATAL] [LOCAL ] CVI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:20.503462] [FATAL] [MAIN ] CVI: Failed to save derivative data. [2025-10-24T00:47:20.506547] [INFO ] [MAIN ] Derivative Progress: 510/2164 symbols completed. CVI took 1.3s. Estimated remaining: 11m 6s. Rate: 149.1 symbols/min [2025-10-24T00:47:20.507253] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:20.507445] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:20.507109] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:20.541323] [DEBUG] [LOCAL ] CVLG: Loaded 15392 existing records from primary storage. [2025-10-24T00:47:20.542125] [INFO ] [MAIN ] CVLG: Loaded 15392 primary data records. [2025-10-24T00:47:20.600695] [DEBUG] [LOCAL ] CW: Loaded 22064 existing records from primary storage. [2025-10-24T00:47:20.647357] [INFO ] [MAIN ] CW: Loaded 22064 primary data records. [2025-10-24T00:47:21.020629] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-24T00:47:21.032365] [INFO ] [MAIN ] CVS: Loaded 54084 primary data records. [2025-10-24T00:47:21.557754] [DEBUG] [MAIN ] CVLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:21.621821] [DEBUG] [MAIN ] CW: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:21.622276] [DEBUG] [MAIN ] CVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:21.676206] [INFO ] [MAIN ] CVLG: Generated 139 derivative records from 15392 primary records. [2025-10-24T00:47:21.678745] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-24T00:47:21.679516] [FATAL] [LOCAL ] CVLG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:21.687087] [FATAL] [MAIN ] CVLG: Failed to save derivative data. [2025-10-24T00:47:21.689598] [INFO ] [MAIN ] Derivative Progress: 511/2164 symbols completed. CVLG took 1.2s. Estimated remaining: 11m 8s. Rate: 148.5 symbols/min [2025-10-24T00:47:21.690147] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:21.724242] [INFO ] [MAIN ] CVS: Generated 139 derivative records from 54084 primary records. [2025-10-24T00:47:21.725017] [INFO ] [MAIN ] CW: Generated 139 derivative records from 22064 primary records. [2025-10-24T00:47:21.725481] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-24T00:47:21.725608] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-24T00:47:21.726387] [FATAL] [LOCAL ] CVS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:21.725983] [FATAL] [LOCAL ] CW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:21.726694] [FATAL] [MAIN ] CVS: Failed to save derivative data. [2025-10-24T00:47:21.726594] [FATAL] [MAIN ] CW: Failed to save derivative data. [2025-10-24T00:47:21.730413] [INFO ] [MAIN ] Derivative Progress: 512/2164 symbols completed. CVS took 1.2s. Estimated remaining: 11m 6s. Rate: 148.8 symbols/min [2025-10-24T00:47:21.734368] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:21.734766] [INFO ] [MAIN ] Derivative Progress: 513/2164 symbols completed. CW took 1.2s. Estimated remaining: 11m 4s. Rate: 149.1 symbols/min [2025-10-24T00:47:21.735591] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:21.778158] [DEBUG] [LOCAL ] CWAN: Loaded 53059 existing records from primary storage. [2025-10-24T00:47:21.778471] [INFO ] [MAIN ] CWAN: Loaded 53059 primary data records. [2025-10-24T00:47:21.968243] [DEBUG] [LOCAL ] CWEN: Loaded 45626 existing records from primary storage. [2025-10-24T00:47:21.990367] [INFO ] [MAIN ] CWEN: Loaded 45626 primary data records. [2025-10-24T00:47:22.076849] [DEBUG] [LOCAL ] CWH: Loaded 51624 existing records from primary storage. [2025-10-24T00:47:22.122129] [INFO ] [MAIN ] CWH: Loaded 51624 primary data records. [2025-10-24T00:47:22.942080] [DEBUG] [MAIN ] CWAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:22.985013] [DEBUG] [MAIN ] CWEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:23.032067] [DEBUG] [MAIN ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:23.068500] [INFO ] [MAIN ] CWAN: Generated 139 derivative records from 53059 primary records. [2025-10-24T00:47:23.070001] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-24T00:47:23.070865] [FATAL] [LOCAL ] CWAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:23.073790] [FATAL] [MAIN ] CWAN: Failed to save derivative data. [2025-10-24T00:47:23.077255] [INFO ] [MAIN ] Derivative Progress: 514/2164 symbols completed. CWAN took 1.4s. Estimated remaining: 11m 7s. Rate: 148.4 symbols/min [2025-10-24T00:47:23.081468] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:23.095610] [INFO ] [MAIN ] CWEN: Generated 139 derivative records from 45626 primary records. [2025-10-24T00:47:23.099381] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-24T00:47:23.099826] [FATAL] [LOCAL ] CWEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:23.099934] [FATAL] [MAIN ] CWEN: Failed to save derivative data. [2025-10-24T00:47:23.102787] [INFO ] [MAIN ] Derivative Progress: 515/2164 symbols completed. CWEN took 1.4s. Estimated remaining: 11m 5s. Rate: 148.7 symbols/min [2025-10-24T00:47:23.103071] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:23.108561] [INFO ] [MAIN ] CWH: Generated 139 derivative records from 51624 primary records. [2025-10-24T00:47:23.108729] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-24T00:47:23.109005] [FATAL] [LOCAL ] CWH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:23.109099] [FATAL] [MAIN ] CWH: Failed to save derivative data. [2025-10-24T00:47:23.112081] [INFO ] [MAIN ] Derivative Progress: 516/2164 symbols completed. CWH took 1.4s. Estimated remaining: 11m 4s. Rate: 149.0 symbols/min [2025-10-24T00:47:23.112470] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:23.164127] [DEBUG] [LOCAL ] CWK: Loaded 50023 existing records from primary storage. [2025-10-24T00:47:23.164539] [INFO ] [MAIN ] CWK: Loaded 50023 primary data records. [2025-10-24T00:47:23.165516] [DEBUG] [LOCAL ] CWT: Loaded 28287 existing records from primary storage. [2025-10-24T00:47:23.166034] [INFO ] [MAIN ] CWT: Loaded 28287 primary data records. [2025-10-24T00:47:23.495389] [DEBUG] [LOCAL ] CX: Loaded 53209 existing records from primary storage. [2025-10-24T00:47:23.632322] [INFO ] [MAIN ] CX: Loaded 53209 primary data records. [2025-10-24T00:47:24.167019] [DEBUG] [MAIN ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:24.166779] [DEBUG] [MAIN ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:24.228531] [DEBUG] [MAIN ] CX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:24.280192] [INFO ] [MAIN ] CWT: Generated 139 derivative records from 28287 primary records. [2025-10-24T00:47:24.280989] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-24T00:47:24.282739] [FATAL] [LOCAL ] CWT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:24.285109] [FATAL] [MAIN ] CWT: Failed to save derivative data. [2025-10-24T00:47:24.288099] [INFO ] [MAIN ] Derivative Progress: 517/2164 symbols completed. CWT took 1.2s. Estimated remaining: 11m 6s. Rate: 148.4 symbols/min [2025-10-24T00:47:24.288520] [INFO ] [MAIN ] CWK: Generated 139 derivative records from 50023 primary records. [2025-10-24T00:47:24.288817] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-24T00:47:24.289017] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:24.289318] [FATAL] [LOCAL ] CWK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:24.289734] [FATAL] [MAIN ] CWK: Failed to save derivative data. [2025-10-24T00:47:24.292945] [INFO ] [MAIN ] Derivative Progress: 518/2164 symbols completed. CWK took 1.2s. Estimated remaining: 11m 4s. Rate: 148.7 symbols/min [2025-10-24T00:47:24.293617] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:24.309942] [INFO ] [MAIN ] CX: Generated 139 derivative records from 53209 primary records. [2025-10-24T00:47:24.306996] [DEBUG] [LOCAL ] CXH: Loaded 4401 existing records from primary storage. [2025-10-24T00:47:24.310168] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-24T00:47:24.310394] [DEBUG] [LOCAL ] CXE: Loaded 6427 existing records from primary storage. [2025-10-24T00:47:24.310794] [FATAL] [LOCAL ] CX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:24.310873] [INFO ] [MAIN ] CXH: Loaded 4401 primary data records. [2025-10-24T00:47:24.311050] [FATAL] [MAIN ] CX: Failed to save derivative data. [2025-10-24T00:47:24.311138] [INFO ] [MAIN ] CXE: Loaded 6427 primary data records. [2025-10-24T00:47:24.356399] [INFO ] [MAIN ] Derivative Progress: 519/2164 symbols completed. CX took 1.2s. Estimated remaining: 11m 3s. Rate: 148.9 symbols/min [2025-10-24T00:47:24.412485] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:24.964385] [DEBUG] [LOCAL ] CXM: Loaded 47703 existing records from primary storage. [2025-10-24T00:47:24.965383] [INFO ] [MAIN ] CXM: Loaded 47703 primary data records. [2025-10-24T00:47:25.280567] [DEBUG] [MAIN ] CXH: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-24T00:47:25.316012] [DEBUG] [MAIN ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:25.371231] [DEBUG] [MAIN ] CXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:25.371566] [INFO ] [MAIN ] CXH: Generated 139 derivative records from 4401 primary records. [2025-10-24T00:47:25.385194] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-24T00:47:25.388958] [FATAL] [LOCAL ] CXH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:25.390870] [FATAL] [MAIN ] CXH: Failed to save derivative data. [2025-10-24T00:47:25.392883] [INFO ] [MAIN ] Derivative Progress: 520/2164 symbols completed. CXH took 1.1s. Estimated remaining: 11m 4s. Rate: 148.5 symbols/min [2025-10-24T00:47:25.393452] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:25.405907] [INFO ] [MAIN ] CXE: Generated 139 derivative records from 6427 primary records. [2025-10-24T00:47:25.406487] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-24T00:47:25.408755] [FATAL] [LOCAL ] CXE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:25.408857] [FATAL] [MAIN ] CXE: Failed to save derivative data. [2025-10-24T00:47:25.411581] [INFO ] [MAIN ] Derivative Progress: 521/2164 symbols completed. CXE took 1.1s. Estimated remaining: 11m 3s. Rate: 148.8 symbols/min [2025-10-24T00:47:25.411831] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:25.433207] [INFO ] [MAIN ] CXM: Generated 139 derivative records from 47703 primary records. [2025-10-24T00:47:25.433414] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-24T00:47:25.433726] [FATAL] [LOCAL ] CXM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:25.433820] [FATAL] [MAIN ] CXM: Failed to save derivative data. [2025-10-24T00:47:25.436754] [INFO ] [MAIN ] Derivative Progress: 522/2164 symbols completed. CXM took 1.0s. Estimated remaining: 11m 1s. Rate: 149.0 symbols/min [2025-10-24T00:47:25.437831] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:25.450265] [DEBUG] [LOCAL ] CXT: Loaded 30880 existing records from primary storage. [2025-10-24T00:47:25.450572] [INFO ] [MAIN ] CXT: Loaded 30880 primary data records. [2025-10-24T00:47:25.649948] [DEBUG] [LOCAL ] CXW: Loaded 43910 existing records from primary storage. [2025-10-24T00:47:25.672017] [INFO ] [MAIN ] CXW: Loaded 43910 primary data records. [2025-10-24T00:47:25.810331] [DEBUG] [LOCAL ] CYD: Loaded 27482 existing records from primary storage. [2025-10-24T00:47:25.845226] [INFO ] [MAIN ] CYD: Loaded 27482 primary data records. [2025-10-24T00:47:26.484109] [DEBUG] [MAIN ] CXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:26.519274] [DEBUG] [MAIN ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:26.565931] [DEBUG] [MAIN ] CYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:26.608333] [INFO ] [MAIN ] CXT: Generated 139 derivative records from 30880 primary records. [2025-10-24T00:47:26.609510] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-24T00:47:26.612936] [FATAL] [LOCAL ] CXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:26.613168] [FATAL] [MAIN ] CXT: Failed to save derivative data. [2025-10-24T00:47:26.616754] [INFO ] [MAIN ] Derivative Progress: 523/2164 symbols completed. CXT took 1.2s. Estimated remaining: 11m 3s. Rate: 148.5 symbols/min [2025-10-24T00:47:26.617252] [INFO ] [MAIN ] CXW: Generated 139 derivative records from 43910 primary records. [2025-10-24T00:47:26.617599] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-24T00:47:26.617980] [FATAL] [LOCAL ] CXW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:26.620567] [FATAL] [MAIN ] CXW: Failed to save derivative data. [2025-10-24T00:47:26.623279] [INFO ] [MAIN ] Derivative Progress: 524/2164 symbols completed. CXW took 1.2s. Estimated remaining: 11m 1s. Rate: 148.8 symbols/min [2025-10-24T00:47:26.629765] [INFO ] [MAIN ] CYD: Generated 139 derivative records from 27482 primary records. [2025-10-24T00:47:26.629867] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-24T00:47:26.630078] [FATAL] [LOCAL ] CYD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:26.630172] [FATAL] [MAIN ] CYD: Failed to save derivative data. [2025-10-24T00:47:26.632923] [INFO ] [MAIN ] Derivative Progress: 525/2164 symbols completed. CYD took 1.2s. Estimated remaining: 10m 60s. Rate: 149.0 symbols/min [2025-10-24T00:47:26.633344] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:26.633445] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:26.633832] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:26.729743] [DEBUG] [LOCAL ] CYH: Loaded 47987 existing records from primary storage. [2025-10-24T00:47:26.731293] [INFO ] [MAIN ] CYH: Loaded 47987 primary data records. [2025-10-24T00:47:26.731169] [DEBUG] [LOCAL ] DAN: Loaded 49732 existing records from primary storage. [2025-10-24T00:47:26.731633] [INFO ] [MAIN ] DAN: Loaded 49732 primary data records. [2025-10-24T00:47:26.831781] [DEBUG] [LOCAL ] D: Loaded 54039 existing records from primary storage. [2025-10-24T00:47:26.874032] [INFO ] [MAIN ] D: Loaded 54039 primary data records. [2025-10-24T00:47:27.683045] [DEBUG] [MAIN ] DAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:27.689290] [DEBUG] [MAIN ] CYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:27.731889] [DEBUG] [MAIN ] D: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:27.800952] [INFO ] [MAIN ] DAN: Generated 139 derivative records from 49732 primary records. [2025-10-24T00:47:27.805528] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-24T00:47:27.806414] [FATAL] [LOCAL ] DAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:27.806095] [INFO ] [MAIN ] CYH: Generated 139 derivative records from 47987 primary records. [2025-10-24T00:47:27.806721] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-24T00:47:27.807003] [FATAL] [MAIN ] DAN: Failed to save derivative data. [2025-10-24T00:47:27.811096] [INFO ] [MAIN ] Derivative Progress: 526/2164 symbols completed. DAN took 1.2s. Estimated remaining: 11m 2s. Rate: 148.5 symbols/min [2025-10-24T00:47:27.808469] [FATAL] [LOCAL ] CYH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:27.811544] [FATAL] [MAIN ] CYH: Failed to save derivative data. [2025-10-24T00:47:27.813681] [INFO ] [MAIN ] D: Generated 139 derivative records from 54039 primary records. [2025-10-24T00:47:27.813816] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-24T00:47:27.813957] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:27.815820] [INFO ] [MAIN ] Derivative Progress: 527/2164 symbols completed. CYH took 1.2s. Estimated remaining: 11m 0s. Rate: 148.8 symbols/min [2025-10-24T00:47:27.816743] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:27.816237] [FATAL] [LOCAL ] D: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:27.817253] [FATAL] [MAIN ] D: Failed to save derivative data. [2025-10-24T00:47:27.819874] [INFO ] [MAIN ] Derivative Progress: 528/2164 symbols completed. D took 1.2s. Estimated remaining: 10m 59s. Rate: 149.0 symbols/min [2025-10-24T00:47:27.820016] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:27.842812] [DEBUG] [LOCAL ] DAO: Loaded 19946 existing records from primary storage. [2025-10-24T00:47:27.843119] [INFO ] [MAIN ] DAO: Loaded 19946 primary data records. [2025-10-24T00:47:28.046432] [DEBUG] [LOCAL ] DAR: Loaded 52387 existing records from primary storage. [2025-10-24T00:47:28.047402] [DEBUG] [LOCAL ] DAVA: Loaded 42219 existing records from primary storage. [2025-10-24T00:47:28.070953] [INFO ] [MAIN ] DAR: Loaded 52387 primary data records. [2025-10-24T00:47:28.195517] [INFO ] [MAIN ] DAVA: Loaded 42219 primary data records. [2025-10-24T00:47:28.850214] [DEBUG] [MAIN ] DAO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:28.900291] [DEBUG] [MAIN ] DAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:28.931500] [DEBUG] [MAIN ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:28.956805] [INFO ] [MAIN ] DAO: Generated 139 derivative records from 19946 primary records. [2025-10-24T00:47:28.959557] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-24T00:47:28.959819] [FATAL] [LOCAL ] DAO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:28.960191] [FATAL] [MAIN ] DAO: Failed to save derivative data. [2025-10-24T00:47:28.965149] [INFO ] [MAIN ] Derivative Progress: 529/2164 symbols completed. DAO took 1.2s. Estimated remaining: 11m 0s. Rate: 148.5 symbols/min [2025-10-24T00:47:28.965536] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:28.991205] [INFO ] [MAIN ] DAVA: Generated 139 derivative records from 42219 primary records. [2025-10-24T00:47:28.993229] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-24T00:47:28.993790] [FATAL] [LOCAL ] DAVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:28.996134] [FATAL] [MAIN ] DAVA: Failed to save derivative data. [2025-10-24T00:47:28.998878] [INFO ] [MAIN ] Derivative Progress: 530/2164 symbols completed. DAVA took 1.2s. Estimated remaining: 10m 59s. Rate: 148.8 symbols/min [2025-10-24T00:47:28.999112] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:28.995991] [INFO ] [MAIN ] DAR: Generated 139 derivative records from 52387 primary records. [2025-10-24T00:47:28.999738] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-24T00:47:29.000009] [FATAL] [LOCAL ] DAR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:29.000263] [FATAL] [MAIN ] DAR: Failed to save derivative data. [2025-10-24T00:47:29.013106] [INFO ] [MAIN ] Derivative Progress: 531/2164 symbols completed. DAR took 1.2s. Estimated remaining: 10m 57s. Rate: 149.1 symbols/min [2025-10-24T00:47:29.013556] [INFO ] [MAIN ] DBD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:29.035424] [DEBUG] [LOCAL ] DAY: Loaded 49492 existing records from primary storage. [2025-10-24T00:47:29.035575] [INFO ] [MAIN ] DAY: Loaded 49492 primary data records. [2025-10-24T00:47:29.214958] [DEBUG] [LOCAL ] DBD: Loaded 24706 existing records from primary storage. [2025-10-24T00:47:29.313710] [INFO ] [MAIN ] DBD: Loaded 24706 primary data records. [2025-10-24T00:47:29.370758] [DEBUG] [LOCAL ] DB: Loaded 52840 existing records from primary storage. [2025-10-24T00:47:29.382784] [INFO ] [MAIN ] DB: Loaded 52840 primary data records. [2025-10-24T00:47:30.000931] [DEBUG] [MAIN ] DAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:30.048039] [DEBUG] [MAIN ] DB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:30.083194] [DEBUG] [MAIN ] DBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:30.114331] [INFO ] [MAIN ] DAY: Generated 139 derivative records from 49492 primary records. [2025-10-24T00:47:30.118929] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-24T00:47:30.123526] [FATAL] [LOCAL ] DAY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:30.123927] [FATAL] [MAIN ] DAY: Failed to save derivative data. [2025-10-24T00:47:30.129437] [INFO ] [MAIN ] Derivative Progress: 532/2164 symbols completed. DAY took 1.2s. Estimated remaining: 10m 59s. Rate: 148.6 symbols/min [2025-10-24T00:47:30.131208] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:30.144789] [INFO ] [MAIN ] DB: Generated 139 derivative records from 52840 primary records. [2025-10-24T00:47:30.148015] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-24T00:47:30.148302] [FATAL] [LOCAL ] DB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:30.148515] [FATAL] [MAIN ] DB: Failed to save derivative data. [2025-10-24T00:47:30.150988] [INFO ] [MAIN ] Derivative Progress: 533/2164 symbols completed. DB took 1.2s. Estimated remaining: 10m 58s. Rate: 148.8 symbols/min [2025-10-24T00:47:30.152365] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:30.155402] [INFO ] [MAIN ] DBD: Generated 139 derivative records from 24706 primary records. [2025-10-24T00:47:30.155670] [DEBUG] [LOCAL ] DBD: Saving derivative data. [2025-10-24T00:47:30.155913] [FATAL] [LOCAL ] DBD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:30.156107] [FATAL] [MAIN ] DBD: Failed to save derivative data. [2025-10-24T00:47:30.158344] [INFO ] [MAIN ] Derivative Progress: 534/2164 symbols completed. DBD took 1.1s. Estimated remaining: 10m 56s. Rate: 149.1 symbols/min [2025-10-24T00:47:30.158551] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:30.176365] [DEBUG] [LOCAL ] DBL: Loaded 9423 existing records from primary storage. [2025-10-24T00:47:30.176621] [INFO ] [MAIN ] DBL: Loaded 9423 primary data records. [2025-10-24T00:47:30.298294] [DEBUG] [LOCAL ] DBI: Loaded 43620 existing records from primary storage. [2025-10-24T00:47:30.330547] [INFO ] [MAIN ] DBI: Loaded 43620 primary data records. [2025-10-24T00:47:30.640501] [DEBUG] [LOCAL ] DBRG: Loaded 50364 existing records from primary storage. [2025-10-24T00:47:30.687959] [INFO ] [MAIN ] DBRG: Loaded 50364 primary data records. [2025-10-24T00:47:31.165007] [DEBUG] [MAIN ] DBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:31.202158] [DEBUG] [MAIN ] DBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:31.245508] [DEBUG] [MAIN ] DBRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:31.272347] [INFO ] [MAIN ] DBL: Generated 139 derivative records from 9423 primary records. [2025-10-24T00:47:31.279349] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-24T00:47:31.279872] [FATAL] [LOCAL ] DBL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:31.280909] [FATAL] [MAIN ] DBL: Failed to save derivative data. [2025-10-24T00:47:31.284751] [INFO ] [MAIN ] Derivative Progress: 535/2164 symbols completed. DBL took 1.1s. Estimated remaining: 10m 58s. Rate: 148.6 symbols/min [2025-10-24T00:47:31.288886] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:31.303672] [INFO ] [MAIN ] DBI: Generated 139 derivative records from 43620 primary records. [2025-10-24T00:47:31.304299] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-24T00:47:31.304878] [FATAL] [LOCAL ] DBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:31.307627] [FATAL] [MAIN ] DBI: Failed to save derivative data. [2025-10-24T00:47:31.310295] [INFO ] [MAIN ] Derivative Progress: 536/2164 symbols completed. DBI took 1.2s. Estimated remaining: 10m 56s. Rate: 148.9 symbols/min [2025-10-24T00:47:31.311864] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:31.315696] [INFO ] [MAIN ] DBRG: Generated 139 derivative records from 50364 primary records. [2025-10-24T00:47:31.316096] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-24T00:47:31.316479] [FATAL] [LOCAL ] DBRG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:31.316565] [FATAL] [MAIN ] DBRG: Failed to save derivative data. [2025-10-24T00:47:31.319326] [INFO ] [MAIN ] Derivative Progress: 537/2164 symbols completed. DBRG took 1.2s. Estimated remaining: 10m 55s. Rate: 149.1 symbols/min [2025-10-24T00:47:31.319545] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:31.341099] [DEBUG] [LOCAL ] DCO: Loaded 15051 existing records from primary storage. [2025-10-24T00:47:31.341432] [INFO ] [MAIN ] DCO: Loaded 15051 primary data records. [2025-10-24T00:47:31.447985] [DEBUG] [LOCAL ] DCI: Loaded 37136 existing records from primary storage. [2025-10-24T00:47:31.459086] [INFO ] [MAIN ] DCI: Loaded 37136 primary data records. [2025-10-24T00:47:31.838468] [DEBUG] [LOCAL ] DD: Loaded 53305 existing records from primary storage. [2025-10-24T00:47:31.987727] [INFO ] [MAIN ] DD: Loaded 53305 primary data records. [2025-10-24T00:47:32.371000] [DEBUG] [MAIN ] DCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:32.397415] [DEBUG] [MAIN ] DCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:32.460182] [DEBUG] [MAIN ] DD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:32.490631] [INFO ] [MAIN ] DCO: Generated 139 derivative records from 15051 primary records. [2025-10-24T00:47:32.495684] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-24T00:47:32.499262] [FATAL] [LOCAL ] DCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:32.500872] [FATAL] [MAIN ] DCO: Failed to save derivative data. [2025-10-24T00:47:32.504754] [INFO ] [MAIN ] Derivative Progress: 538/2164 symbols completed. DCO took 1.2s. Estimated remaining: 10m 57s. Rate: 148.6 symbols/min [2025-10-24T00:47:32.510902] [INFO ] [MAIN ] DCI: Generated 139 derivative records from 37136 primary records. [2025-10-24T00:47:32.512397] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-24T00:47:32.512865] [FATAL] [LOCAL ] DCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:32.515142] [FATAL] [MAIN ] DCI: Failed to save derivative data. [2025-10-24T00:47:32.517888] [INFO ] [MAIN ] Derivative Progress: 539/2164 symbols completed. DCI took 1.2s. Estimated remaining: 10m 55s. Rate: 148.9 symbols/min [2025-10-24T00:47:32.522956] [INFO ] [MAIN ] DD: Generated 139 derivative records from 53305 primary records. [2025-10-24T00:47:32.523076] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-24T00:47:32.523270] [FATAL] [LOCAL ] DD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:32.523348] [FATAL] [MAIN ] DD: Failed to save derivative data. [2025-10-24T00:47:32.525995] [INFO ] [MAIN ] Derivative Progress: 540/2164 symbols completed. DD took 1.2s. Estimated remaining: 10m 53s. Rate: 149.1 symbols/min [2025-10-24T00:47:32.526706] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:32.526572] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:32.526802] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:32.543674] [DEBUG] [LOCAL ] DDS: Loaded 12405 existing records from primary storage. [2025-10-24T00:47:32.544004] [INFO ] [MAIN ] DDS: Loaded 12405 primary data records. [2025-10-24T00:47:32.725007] [DEBUG] [LOCAL ] DDL: Loaded 37424 existing records from primary storage. [2025-10-24T00:47:32.872576] [INFO ] [MAIN ] DDL: Loaded 37424 primary data records. [2025-10-24T00:47:32.974370] [DEBUG] [LOCAL ] DDD: Loaded 51313 existing records from primary storage. [2025-10-24T00:47:32.992896] [INFO ] [MAIN ] DDD: Loaded 51313 primary data records. [2025-10-24T00:47:33.557769] [DEBUG] [MAIN ] DDS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:33.608670] [DEBUG] [MAIN ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:33.649394] [DEBUG] [MAIN ] DDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:33.682926] [INFO ] [MAIN ] DDS: Generated 139 derivative records from 12405 primary records. [2025-10-24T00:47:33.686832] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-24T00:47:33.689469] [FATAL] [LOCAL ] DDS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:33.691776] [FATAL] [MAIN ] DDS: Failed to save derivative data. [2025-10-24T00:47:33.695568] [INFO ] [MAIN ] Derivative Progress: 541/2164 symbols completed. DDS took 1.2s. Estimated remaining: 10m 55s. Rate: 148.6 symbols/min [2025-10-24T00:47:33.702000] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:33.714630] [DEBUG] [LOCAL ] DDT: Loaded 1876 existing records from primary storage. [2025-10-24T00:47:33.715528] [INFO ] [MAIN ] DDT: Loaded 1876 primary data records. [2025-10-24T00:47:33.780345] [INFO ] [MAIN ] DDL: Generated 139 derivative records from 37424 primary records. [2025-10-24T00:47:33.787706] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-24T00:47:33.811155] [FATAL] [LOCAL ] DDL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:33.830382] [FATAL] [MAIN ] DDL: Failed to save derivative data. [2025-10-24T00:47:33.842814] [INFO ] [MAIN ] DDD: Generated 139 derivative records from 51313 primary records. [2025-10-24T00:47:33.845138] [INFO ] [MAIN ] Derivative Progress: 542/2164 symbols completed. DDL took 1.3s. Estimated remaining: 10m 54s. Rate: 148.8 symbols/min [2025-10-24T00:47:33.860636] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-24T00:47:33.873824] [FATAL] [LOCAL ] DDD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:33.873986] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:33.874149] [FATAL] [MAIN ] DDD: Failed to save derivative data. [2025-10-24T00:47:33.886250] [INFO ] [MAIN ] Derivative Progress: 543/2164 symbols completed. DDD took 1.4s. Estimated remaining: 10m 53s. Rate: 149.0 symbols/min [2025-10-24T00:47:33.886661] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:34.098012] [DEBUG] [LOCAL ] DEA: Loaded 40311 existing records from primary storage. [2025-10-24T00:47:34.098890] [DEBUG] [LOCAL ] DE: Loaded 47878 existing records from primary storage. [2025-10-24T00:47:34.099104] [INFO ] [MAIN ] DEA: Loaded 40311 primary data records. [2025-10-24T00:47:34.099444] [INFO ] [MAIN ] DE: Loaded 47878 primary data records. [2025-10-24T00:47:34.536014] [DEBUG] [MAIN ] DDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:34.865159] [DEBUG] [MAIN ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:34.906933] [INFO ] [MAIN ] DDT: Generated 139 derivative records from 1876 primary records. [2025-10-24T00:47:34.907481] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-24T00:47:34.908899] [FATAL] [LOCAL ] DDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:34.911410] [FATAL] [MAIN ] DDT: Failed to save derivative data. [2025-10-24T00:47:34.908499] [DEBUG] [MAIN ] DEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:34.930069] [INFO ] [MAIN ] Derivative Progress: 544/2164 symbols completed. DDT took 1.2s. Estimated remaining: 10m 54s. Rate: 148.6 symbols/min [2025-10-24T00:47:34.932820] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:34.995682] [DEBUG] [LOCAL ] DEC: Loaded 30427 existing records from primary storage. [2025-10-24T00:47:35.003443] [INFO ] [MAIN ] DEC: Loaded 30427 primary data records. [2025-10-24T00:47:35.004075] [INFO ] [MAIN ] DE: Generated 139 derivative records from 47878 primary records. [2025-10-24T00:47:35.019298] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-24T00:47:35.019702] [INFO ] [MAIN ] DEA: Generated 139 derivative records from 40311 primary records. [2025-10-24T00:47:35.072680] [FATAL] [LOCAL ] DE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:35.101219] [FATAL] [MAIN ] DE: Failed to save derivative data. [2025-10-24T00:47:35.095129] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-24T00:47:35.120128] [INFO ] [MAIN ] Derivative Progress: 545/2164 symbols completed. DE took 1.2s. Estimated remaining: 10m 53s. Rate: 148.7 symbols/min [2025-10-24T00:47:35.126937] [FATAL] [LOCAL ] DEA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:35.132260] [FATAL] [MAIN ] DEA: Failed to save derivative data. [2025-10-24T00:47:35.132395] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:35.140911] [INFO ] [MAIN ] Derivative Progress: 546/2164 symbols completed. DEA took 1.3s. Estimated remaining: 10m 52s. Rate: 149.0 symbols/min [2025-10-24T00:47:35.146352] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:35.373595] [DEBUG] [MAIN ] DEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:35.404486] [DEBUG] [LOCAL ] DEI: Loaded 48643 existing records from primary storage. [2025-10-24T00:47:35.422276] [DEBUG] [LOCAL ] DECK: Loaded 53691 existing records from primary storage. [2025-10-24T00:47:35.422840] [INFO ] [MAIN ] DECK: Loaded 53691 primary data records. [2025-10-24T00:47:35.422519] [INFO ] [MAIN ] DEI: Loaded 48643 primary data records. [2025-10-24T00:47:36.057610] [INFO ] [MAIN ] DEC: Generated 139 derivative records from 30427 primary records. [2025-10-24T00:47:36.058245] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-24T00:47:36.058545] [FATAL] [LOCAL ] DEC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:36.059251] [FATAL] [MAIN ] DEC: Failed to save derivative data. [2025-10-24T00:47:36.062468] [INFO ] [MAIN ] Derivative Progress: 547/2164 symbols completed. DEC took 1.1s. Estimated remaining: 10m 53s. Rate: 148.6 symbols/min [2025-10-24T00:47:36.062933] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:36.084922] [DEBUG] [MAIN ] DECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:36.110927] [DEBUG] [MAIN ] DEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:36.168907] [DEBUG] [LOCAL ] DEO: Loaded 49560 existing records from primary storage. [2025-10-24T00:47:36.173197] [INFO ] [MAIN ] DEO: Loaded 49560 primary data records. [2025-10-24T00:47:36.314939] [INFO ] [MAIN ] DEI: Generated 139 derivative records from 48643 primary records. [2025-10-24T00:47:36.339291] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-24T00:47:36.371541] [FATAL] [LOCAL ] DEI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:36.541053] [INFO ] [MAIN ] DECK: Generated 139 derivative records from 53691 primary records. [2025-10-24T00:47:36.541783] [FATAL] [MAIN ] DEI: Failed to save derivative data. [2025-10-24T00:47:36.547109] [INFO ] [MAIN ] Derivative Progress: 548/2164 symbols completed. DEI took 1.4s. Estimated remaining: 10m 53s. Rate: 148.6 symbols/min [2025-10-24T00:47:36.547272] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-24T00:47:36.547441] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:36.547953] [FATAL] [LOCAL ] DECK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:36.548327] [FATAL] [MAIN ] DECK: Failed to save derivative data. [2025-10-24T00:47:36.552314] [INFO ] [MAIN ] Derivative Progress: 549/2164 symbols completed. DECK took 1.4s. Estimated remaining: 10m 51s. Rate: 148.9 symbols/min [2025-10-24T00:47:36.553354] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:36.587903] [DEBUG] [MAIN ] DEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:36.618905] [DEBUG] [LOCAL ] DFIN: Loaded 22540 existing records from primary storage. [2025-10-24T00:47:36.620758] [INFO ] [MAIN ] DFIN: Loaded 22540 primary data records. [2025-10-24T00:47:36.654253] [DEBUG] [LOCAL ] DFH: Loaded 31800 existing records from primary storage. [2025-10-24T00:47:36.693382] [INFO ] [MAIN ] DFH: Loaded 31800 primary data records. [2025-10-24T00:47:37.292120] [INFO ] [MAIN ] DEO: Generated 139 derivative records from 49560 primary records. [2025-10-24T00:47:37.293122] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-24T00:47:37.293488] [FATAL] [LOCAL ] DEO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:37.294063] [FATAL] [MAIN ] DEO: Failed to save derivative data. [2025-10-24T00:47:37.298588] [INFO ] [MAIN ] Derivative Progress: 550/2164 symbols completed. DEO took 1.2s. Estimated remaining: 10m 52s. Rate: 148.6 symbols/min [2025-10-24T00:47:37.299465] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:37.317239] [DEBUG] [LOCAL ] DFP: Loaded 11089 existing records from primary storage. [2025-10-24T00:47:37.319308] [INFO ] [MAIN ] DFP: Loaded 11089 primary data records. [2025-10-24T00:47:37.417771] [DEBUG] [MAIN ] DFIN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:37.686880] [DEBUG] [MAIN ] DFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:37.745431] [INFO ] [MAIN ] DFIN: Generated 139 derivative records from 22540 primary records. [2025-10-24T00:47:37.756257] [DEBUG] [MAIN ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:37.754412] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-24T00:47:37.772542] [FATAL] [LOCAL ] DFIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:37.774763] [FATAL] [MAIN ] DFIN: Failed to save derivative data. [2025-10-24T00:47:37.779680] [INFO ] [MAIN ] Derivative Progress: 551/2164 symbols completed. DFIN took 1.2s. Estimated remaining: 10m 51s. Rate: 148.6 symbols/min [2025-10-24T00:47:37.780290] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:37.787272] [INFO ] [MAIN ] DFH: Generated 139 derivative records from 31800 primary records. [2025-10-24T00:47:37.788681] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-24T00:47:37.788939] [FATAL] [LOCAL ] DFH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:37.789135] [FATAL] [MAIN ] DFH: Failed to save derivative data. [2025-10-24T00:47:37.791796] [INFO ] [MAIN ] Derivative Progress: 552/2164 symbols completed. DFH took 1.2s. Estimated remaining: 10m 50s. Rate: 148.8 symbols/min [2025-10-24T00:47:37.792007] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:37.806962] [INFO ] [MAIN ] DFP: Generated 139 derivative records from 11089 primary records. [2025-10-24T00:47:37.807233] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-24T00:47:37.807449] [FATAL] [LOCAL ] DFP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:37.807590] [FATAL] [MAIN ] DFP: Failed to save derivative data. [2025-10-24T00:47:37.809993] [INFO ] [MAIN ] Derivative Progress: 553/2164 symbols completed. DFP took 0.5s. Estimated remaining: 10m 48s. Rate: 149.1 symbols/min [2025-10-24T00:47:37.875757] [DEBUG] [LOCAL ] DG: Loaded 53630 existing records from primary storage. [2025-10-24T00:47:37.876426] [DEBUG] [LOCAL ] DGX: Loaded 44964 existing records from primary storage. [2025-10-24T00:47:37.876895] [INFO ] [MAIN ] DGX: Loaded 44964 primary data records. [2025-10-24T00:47:37.876811] [INFO ] [MAIN ] DG: Loaded 53630 primary data records. [2025-10-24T00:47:38.520773] [DEBUG] [MAIN ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:38.557939] [DEBUG] [MAIN ] DGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:38.598401] [INFO ] [MAIN ] DG: Generated 139 derivative records from 53630 primary records. [2025-10-24T00:47:38.598937] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-24T00:47:38.599322] [FATAL] [LOCAL ] DG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:38.602011] [FATAL] [MAIN ] DG: Failed to save derivative data. [2025-10-24T00:47:38.606036] [INFO ] [MAIN ] Derivative Progress: 554/2164 symbols completed. DG took 0.8s. Estimated remaining: 10m 49s. Rate: 148.8 symbols/min [2025-10-24T00:47:38.613338] [INFO ] [MAIN ] DGX: Generated 139 derivative records from 44964 primary records. [2025-10-24T00:47:38.613466] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-24T00:47:38.613733] [FATAL] [LOCAL ] DGX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:38.613844] [FATAL] [MAIN ] DGX: Failed to save derivative data. [2025-10-24T00:47:38.616209] [INFO ] [MAIN ] Derivative Progress: 555/2164 symbols completed. DGX took 0.8s. Estimated remaining: 10m 48s. Rate: 149.1 symbols/min [2025-10-24T00:47:38.616915] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:38.617028] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:38.617782] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:38.639559] [DEBUG] [LOCAL ] DHF: Loaded 20928 existing records from primary storage. [2025-10-24T00:47:38.639772] [INFO ] [MAIN ] DHF: Loaded 20928 primary data records. [2025-10-24T00:47:39.028919] [DEBUG] [LOCAL ] DHI: Loaded 53747 existing records from primary storage. [2025-10-24T00:47:39.043347] [INFO ] [MAIN ] DHI: Loaded 53747 primary data records. [2025-10-24T00:47:39.056116] [DEBUG] [LOCAL ] DHR: Loaded 53765 existing records from primary storage. [2025-10-24T00:47:39.078418] [INFO ] [MAIN ] DHR: Loaded 53765 primary data records. [2025-10-24T00:47:39.674870] [DEBUG] [MAIN ] DHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:39.725618] [DEBUG] [MAIN ] DHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:39.754269] [DEBUG] [MAIN ] DHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:39.779273] [INFO ] [MAIN ] DHF: Generated 139 derivative records from 20928 primary records. [2025-10-24T00:47:39.779981] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-24T00:47:39.786539] [FATAL] [LOCAL ] DHF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:39.787820] [FATAL] [MAIN ] DHF: Failed to save derivative data. [2025-10-24T00:47:39.792596] [INFO ] [MAIN ] Derivative Progress: 556/2164 symbols completed. DHF took 1.2s. Estimated remaining: 10m 49s. Rate: 148.6 symbols/min [2025-10-24T00:47:39.793403] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:39.823916] [INFO ] [MAIN ] DHR: Generated 139 derivative records from 53765 primary records. [2025-10-24T00:47:39.826156] [INFO ] [MAIN ] DHI: Generated 139 derivative records from 53747 primary records. [2025-10-24T00:47:39.826433] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-24T00:47:39.826476] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-24T00:47:39.826957] [FATAL] [LOCAL ] DHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:39.826780] [FATAL] [LOCAL ] DHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:39.827050] [FATAL] [MAIN ] DHR: Failed to save derivative data. [2025-10-24T00:47:39.827229] [FATAL] [MAIN ] DHI: Failed to save derivative data. [2025-10-24T00:47:39.831081] [INFO ] [MAIN ] Derivative Progress: 557/2164 symbols completed. DHR took 1.2s. Estimated remaining: 10m 48s. Rate: 148.8 symbols/min [2025-10-24T00:47:39.833423] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:39.833538] [INFO ] [MAIN ] Derivative Progress: 558/2164 symbols completed. DHI took 1.2s. Estimated remaining: 10m 46s. Rate: 149.1 symbols/min [2025-10-24T00:47:39.844687] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:39.874845] [DEBUG] [LOCAL ] DHX: Loaded 13333 existing records from primary storage. [2025-10-24T00:47:39.875051] [INFO ] [MAIN ] DHX: Loaded 13333 primary data records. [2025-10-24T00:47:39.875758] [DEBUG] [LOCAL ] DHT: Loaded 48212 existing records from primary storage. [2025-10-24T00:47:39.891714] [INFO ] [MAIN ] DHT: Loaded 48212 primary data records. [2025-10-24T00:47:39.901367] [DEBUG] [LOCAL ] DIAX: Loaded 12784 existing records from primary storage. [2025-10-24T00:47:39.923582] [INFO ] [MAIN ] DIAX: Loaded 12784 primary data records. [2025-10-24T00:47:40.869126] [DEBUG] [MAIN ] DHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:40.906160] [DEBUG] [MAIN ] DHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:40.922592] [DEBUG] [MAIN ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:40.995384] [INFO ] [MAIN ] DHX: Generated 139 derivative records from 13333 primary records. [2025-10-24T00:47:40.997591] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-24T00:47:41.004118] [FATAL] [LOCAL ] DHX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:41.006290] [FATAL] [MAIN ] DHX: Failed to save derivative data. [2025-10-24T00:47:41.009114] [INFO ] [MAIN ] Derivative Progress: 559/2164 symbols completed. DHX took 1.2s. Estimated remaining: 10m 48s. Rate: 148.6 symbols/min [2025-10-24T00:47:41.009470] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:41.016452] [INFO ] [MAIN ] DHT: Generated 139 derivative records from 48212 primary records. [2025-10-24T00:47:41.013990] [INFO ] [MAIN ] DIAX: Generated 139 derivative records from 12784 primary records. [2025-10-24T00:47:41.016590] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-24T00:47:41.017020] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-24T00:47:41.016930] [FATAL] [LOCAL ] DHT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:41.017439] [FATAL] [MAIN ] DHT: Failed to save derivative data. [2025-10-24T00:47:41.017353] [FATAL] [LOCAL ] DIAX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:41.019757] [FATAL] [MAIN ] DIAX: Failed to save derivative data. [2025-10-24T00:47:41.019392] [INFO ] [MAIN ] Derivative Progress: 560/2164 symbols completed. DHT took 1.2s. Estimated remaining: 10m 47s. Rate: 148.8 symbols/min [2025-10-24T00:47:41.023082] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:41.023201] [INFO ] [MAIN ] Derivative Progress: 561/2164 symbols completed. DIAX took 1.2s. Estimated remaining: 10m 45s. Rate: 149.1 symbols/min [2025-10-24T00:47:41.023551] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:41.063435] [DEBUG] [LOCAL ] DIN: Loaded 36981 existing records from primary storage. [2025-10-24T00:47:41.078680] [INFO ] [MAIN ] DIN: Loaded 36981 primary data records. [2025-10-24T00:47:41.231140] [DEBUG] [LOCAL ] DINO: Loaded 53214 existing records from primary storage. [2025-10-24T00:47:41.270176] [INFO ] [MAIN ] DINO: Loaded 53214 primary data records. [2025-10-24T00:47:41.299249] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-24T00:47:41.347832] [INFO ] [MAIN ] DIS: Loaded 54178 primary data records. [2025-10-24T00:47:42.098792] [DEBUG] [MAIN ] DIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:42.140959] [DEBUG] [MAIN ] DINO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:42.184784] [DEBUG] [MAIN ] DIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:42.214321] [INFO ] [MAIN ] DIN: Generated 139 derivative records from 36981 primary records. [2025-10-24T00:47:42.217204] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-24T00:47:42.221421] [FATAL] [LOCAL ] DIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:42.225044] [FATAL] [MAIN ] DIN: Failed to save derivative data. [2025-10-24T00:47:42.230910] [INFO ] [MAIN ] Derivative Progress: 562/2164 symbols completed. DIN took 1.2s. Estimated remaining: 10m 47s. Rate: 148.6 symbols/min [2025-10-24T00:47:42.238297] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:42.263505] [INFO ] [MAIN ] DINO: Generated 139 derivative records from 53214 primary records. [2025-10-24T00:47:42.264229] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-24T00:47:42.264513] [FATAL] [LOCAL ] DINO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:42.263817] [INFO ] [MAIN ] DIS: Generated 139 derivative records from 54178 primary records. [2025-10-24T00:47:42.264678] [FATAL] [MAIN ] DINO: Failed to save derivative data. [2025-10-24T00:47:42.267433] [INFO ] [MAIN ] Derivative Progress: 563/2164 symbols completed. DINO took 1.2s. Estimated remaining: 10m 46s. Rate: 148.8 symbols/min [2025-10-24T00:47:42.264769] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-24T00:47:42.268043] [FATAL] [LOCAL ] DIS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:42.268328] [FATAL] [MAIN ] DIS: Failed to save derivative data. [2025-10-24T00:47:42.267740] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:42.271006] [INFO ] [MAIN ] Derivative Progress: 564/2164 symbols completed. DIS took 1.2s. Estimated remaining: 10m 44s. Rate: 149.1 symbols/min [2025-10-24T00:47:42.271919] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:42.301455] [DEBUG] [LOCAL ] DKL: Loaded 16921 existing records from primary storage. [2025-10-24T00:47:42.301638] [INFO ] [MAIN ] DKL: Loaded 16921 primary data records. [2025-10-24T00:47:42.402983] [DEBUG] [LOCAL ] DK: Loaded 49598 existing records from primary storage. [2025-10-24T00:47:42.414620] [INFO ] [MAIN ] DK: Loaded 49598 primary data records. [2025-10-24T00:47:42.796946] [DEBUG] [LOCAL ] DKS: Loaded 49595 existing records from primary storage. [2025-10-24T00:47:42.812939] [INFO ] [MAIN ] DKS: Loaded 49595 primary data records. [2025-10-24T00:47:43.373670] [DEBUG] [MAIN ] DKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:43.403925] [DEBUG] [MAIN ] DK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:43.452712] [DEBUG] [MAIN ] DKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:43.486763] [INFO ] [MAIN ] DKL: Generated 139 derivative records from 16921 primary records. [2025-10-24T00:47:43.490516] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-24T00:47:43.496540] [FATAL] [LOCAL ] DKL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:43.496947] [FATAL] [MAIN ] DKL: Failed to save derivative data. [2025-10-24T00:47:43.500259] [INFO ] [MAIN ] Derivative Progress: 565/2164 symbols completed. DKL took 1.2s. Estimated remaining: 10m 46s. Rate: 148.5 symbols/min [2025-10-24T00:47:43.502379] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:43.507578] [INFO ] [MAIN ] DK: Generated 139 derivative records from 49598 primary records. [2025-10-24T00:47:43.508036] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-24T00:47:43.508246] [FATAL] [LOCAL ] DK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:43.508325] [FATAL] [MAIN ] DK: Failed to save derivative data. [2025-10-24T00:47:43.512401] [INFO ] [MAIN ] Derivative Progress: 566/2164 symbols completed. DK took 1.3s. Estimated remaining: 10m 44s. Rate: 148.8 symbols/min [2025-10-24T00:47:43.512809] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:43.520466] [INFO ] [MAIN ] DKS: Generated 139 derivative records from 49595 primary records. [2025-10-24T00:47:43.520928] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-24T00:47:43.521223] [FATAL] [LOCAL ] DKS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:43.521306] [FATAL] [MAIN ] DKS: Failed to save derivative data. [2025-10-24T00:47:43.524019] [INFO ] [MAIN ] Derivative Progress: 567/2164 symbols completed. DKS took 1.3s. Estimated remaining: 10m 43s. Rate: 149.0 symbols/min [2025-10-24T00:47:43.524555] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:43.564778] [DEBUG] [LOCAL ] DLB: Loaded 32462 existing records from primary storage. [2025-10-24T00:47:43.564965] [INFO ] [MAIN ] DLB: Loaded 32462 primary data records. [2025-10-24T00:47:43.728131] [DEBUG] [LOCAL ] DLX: Loaded 28240 existing records from primary storage. [2025-10-24T00:47:43.741420] [INFO ] [MAIN ] DLX: Loaded 28240 primary data records. [2025-10-24T00:47:43.728895] [DEBUG] [LOCAL ] DLR: Loaded 50985 existing records from primary storage. [2025-10-24T00:47:43.750519] [INFO ] [MAIN ] DLR: Loaded 50985 primary data records. [2025-10-24T00:47:44.556273] [DEBUG] [MAIN ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:44.622037] [DEBUG] [MAIN ] DLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:44.622375] [DEBUG] [MAIN ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:44.681496] [INFO ] [MAIN ] DLB: Generated 139 derivative records from 32462 primary records. [2025-10-24T00:47:44.682025] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-24T00:47:44.683581] [FATAL] [LOCAL ] DLB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:44.685517] [FATAL] [MAIN ] DLB: Failed to save derivative data. [2025-10-24T00:47:44.687847] [INFO ] [MAIN ] Derivative Progress: 568/2164 symbols completed. DLB took 1.2s. Estimated remaining: 10m 45s. Rate: 148.6 symbols/min [2025-10-24T00:47:44.706166] [INFO ] [MAIN ] DLR: Generated 139 derivative records from 50985 primary records. [2025-10-24T00:47:44.706632] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-24T00:47:44.707072] [FATAL] [LOCAL ] DLR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:44.707169] [FATAL] [MAIN ] DLR: Failed to save derivative data. [2025-10-24T00:47:44.710025] [INFO ] [MAIN ] Derivative Progress: 569/2164 symbols completed. DLR took 1.2s. Estimated remaining: 10m 43s. Rate: 148.8 symbols/min [2025-10-24T00:47:44.712074] [INFO ] [MAIN ] DLX: Generated 139 derivative records from 28240 primary records. [2025-10-24T00:47:44.712227] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-24T00:47:44.712437] [FATAL] [LOCAL ] DLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:44.712514] [FATAL] [MAIN ] DLX: Failed to save derivative data. [2025-10-24T00:47:44.715337] [INFO ] [MAIN ] Derivative Progress: 570/2164 symbols completed. DLX took 1.2s. Estimated remaining: 10m 42s. Rate: 149.1 symbols/min [2025-10-24T00:47:44.716006] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:44.715807] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:44.715897] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:44.726479] [DEBUG] [LOCAL ] DMA: Loaded 4725 existing records from primary storage. [2025-10-24T00:47:44.729537] [INFO ] [MAIN ] DMA: Loaded 4725 primary data records. [2025-10-24T00:47:44.821409] [DEBUG] [LOCAL ] DMB: Loaded 10554 existing records from primary storage. [2025-10-24T00:47:44.839919] [INFO ] [MAIN ] DMB: Loaded 10554 primary data records. [2025-10-24T00:47:44.904047] [DEBUG] [LOCAL ] DLY: Loaded 20880 existing records from primary storage. [2025-10-24T00:47:44.914535] [INFO ] [MAIN ] DLY: Loaded 20880 primary data records. [2025-10-24T00:47:45.723846] [DEBUG] [MAIN ] DMA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:45.768374] [DEBUG] [MAIN ] DMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:45.801078] [DEBUG] [MAIN ] DLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:45.841793] [INFO ] [MAIN ] DMA: Generated 139 derivative records from 4725 primary records. [2025-10-24T00:47:45.846427] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-24T00:47:45.848486] [FATAL] [LOCAL ] DMA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:45.848635] [FATAL] [MAIN ] DMA: Failed to save derivative data. [2025-10-24T00:47:45.853314] [INFO ] [MAIN ] Derivative Progress: 571/2164 symbols completed. DMA took 1.1s. Estimated remaining: 10m 43s. Rate: 148.6 symbols/min [2025-10-24T00:47:45.854101] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:45.881798] [DEBUG] [LOCAL ] DMO: Loaded 9835 existing records from primary storage. [2025-10-24T00:47:45.884081] [INFO ] [MAIN ] DMB: Generated 139 derivative records from 10554 primary records. [2025-10-24T00:47:45.884771] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-24T00:47:45.884418] [INFO ] [MAIN ] DMO: Loaded 9835 primary data records. [2025-10-24T00:47:45.886205] [FATAL] [LOCAL ] DMB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:45.893374] [FATAL] [MAIN ] DMB: Failed to save derivative data. [2025-10-24T00:47:45.902415] [INFO ] [MAIN ] Derivative Progress: 572/2164 symbols completed. DMB took 1.2s. Estimated remaining: 10m 42s. Rate: 148.8 symbols/min [2025-10-24T00:47:45.947423] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:45.912777] [INFO ] [MAIN ] DLY: Generated 139 derivative records from 20880 primary records. [2025-10-24T00:47:45.961797] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-24T00:47:45.985403] [FATAL] [LOCAL ] DLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:45.993358] [FATAL] [MAIN ] DLY: Failed to save derivative data. [2025-10-24T00:47:45.996215] [INFO ] [MAIN ] Derivative Progress: 573/2164 symbols completed. DLY took 1.3s. Estimated remaining: 10m 41s. Rate: 149.0 symbols/min [2025-10-24T00:47:45.996410] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:46.246493] [DEBUG] [LOCAL ] DNOW: Loaded 44058 existing records from primary storage. [2025-10-24T00:47:46.261092] [INFO ] [MAIN ] DNOW: Loaded 44058 primary data records. [2025-10-24T00:47:46.298385] [DEBUG] [LOCAL ] DNA: Loaded 48871 existing records from primary storage. [2025-10-24T00:47:46.316983] [INFO ] [MAIN ] DNA: Loaded 48871 primary data records. [2025-10-24T00:47:46.743315] [DEBUG] [MAIN ] DMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:47.044465] [INFO ] [MAIN ] DMO: Generated 139 derivative records from 9835 primary records. [2025-10-24T00:47:47.045212] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-24T00:47:47.047249] [FATAL] [LOCAL ] DMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:47.048388] [FATAL] [MAIN ] DMO: Failed to save derivative data. [2025-10-24T00:47:47.050572] [INFO ] [MAIN ] Derivative Progress: 574/2164 symbols completed. DMO took 1.2s. Estimated remaining: 10m 42s. Rate: 148.6 symbols/min [2025-10-24T00:47:47.051246] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:47.065303] [DEBUG] [MAIN ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:47.104460] [DEBUG] [MAIN ] DNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:47.151109] [DEBUG] [LOCAL ] DNP: Loaded 33207 existing records from primary storage. [2025-10-24T00:47:47.155796] [INFO ] [MAIN ] DNP: Loaded 33207 primary data records. [2025-10-24T00:47:47.289288] [INFO ] [MAIN ] DNOW: Generated 139 derivative records from 44058 primary records. [2025-10-24T00:47:47.301000] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-24T00:47:47.301322] [FATAL] [LOCAL ] DNOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:47.307018] [FATAL] [MAIN ] DNOW: Failed to save derivative data. [2025-10-24T00:47:47.309493] [INFO ] [MAIN ] Derivative Progress: 575/2164 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 41s. Rate: 148.7 symbols/min [2025-10-24T00:47:47.324596] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:47.491398] [INFO ] [MAIN ] DNA: Generated 139 derivative records from 48871 primary records. [2025-10-24T00:47:47.492255] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-24T00:47:47.494948] [FATAL] [LOCAL ] DNA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:47.495679] [FATAL] [MAIN ] DNA: Failed to save derivative data. [2025-10-24T00:47:47.499506] [INFO ] [MAIN ] Derivative Progress: 576/2164 symbols completed. DNA took 1.6s. Estimated remaining: 10m 40s. Rate: 148.8 symbols/min [2025-10-24T00:47:47.499824] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:47.541291] [DEBUG] [MAIN ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:47.574085] [DEBUG] [LOCAL ] DOC: Loaded 53944 existing records from primary storage. [2025-10-24T00:47:47.575546] [INFO ] [MAIN ] DOC: Loaded 53944 primary data records. [2025-10-24T00:47:47.729355] [DEBUG] [LOCAL ] DOCN: Loaded 51493 existing records from primary storage. [2025-10-24T00:47:47.746144] [INFO ] [MAIN ] DOCN: Loaded 51493 primary data records. [2025-10-24T00:47:48.152130] [INFO ] [MAIN ] DNP: Generated 139 derivative records from 33207 primary records. [2025-10-24T00:47:48.276395] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-24T00:47:48.277721] [FATAL] [LOCAL ] DNP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:48.277912] [FATAL] [MAIN ] DNP: Failed to save derivative data. [2025-10-24T00:47:48.281262] [INFO ] [MAIN ] Derivative Progress: 577/2164 symbols completed. DNP took 1.2s. Estimated remaining: 10m 41s. Rate: 148.6 symbols/min [2025-10-24T00:47:48.282126] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:48.307698] [DEBUG] [MAIN ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:48.372934] [DEBUG] [MAIN ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:48.420496] [DEBUG] [LOCAL ] DOCS: Loaded 50676 existing records from primary storage. [2025-10-24T00:47:48.426296] [INFO ] [MAIN ] DOCS: Loaded 50676 primary data records. [2025-10-24T00:47:48.551245] [INFO ] [MAIN ] DOC: Generated 139 derivative records from 53944 primary records. [2025-10-24T00:47:48.615540] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-24T00:47:48.739078] [FATAL] [LOCAL ] DOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:48.744070] [FATAL] [MAIN ] DOC: Failed to save derivative data. [2025-10-24T00:47:48.749722] [INFO ] [MAIN ] Derivative Progress: 578/2164 symbols completed. DOC took 1.4s. Estimated remaining: 10m 41s. Rate: 148.5 symbols/min [2025-10-24T00:47:48.753319] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:48.756378] [INFO ] [MAIN ] DOCN: Generated 139 derivative records from 51493 primary records. [2025-10-24T00:47:48.756488] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-24T00:47:48.756808] [FATAL] [LOCAL ] DOCN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:48.758048] [FATAL] [MAIN ] DOCN: Failed to save derivative data. [2025-10-24T00:47:48.762158] [INFO ] [MAIN ] Derivative Progress: 579/2164 symbols completed. DOCN took 1.3s. Estimated remaining: 10m 39s. Rate: 148.8 symbols/min [2025-10-24T00:47:48.763015] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:48.783982] [DEBUG] [MAIN ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:48.858405] [DEBUG] [LOCAL ] DOUG: Loaded 33959 existing records from primary storage. [2025-10-24T00:47:48.857121] [DEBUG] [LOCAL ] DOLE: Loaded 39389 existing records from primary storage. [2025-10-24T00:47:48.859160] [INFO ] [MAIN ] DOLE: Loaded 39389 primary data records. [2025-10-24T00:47:48.860743] [INFO ] [MAIN ] DOUG: Loaded 33959 primary data records. [2025-10-24T00:47:48.873776] [INFO ] [MAIN ] DOCS: Generated 139 derivative records from 50676 primary records. [2025-10-24T00:47:48.928502] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-24T00:47:48.974594] [FATAL] [LOCAL ] DOCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:49.023376] [FATAL] [MAIN ] DOCS: Failed to save derivative data. [2025-10-24T00:47:49.035938] [INFO ] [MAIN ] Derivative Progress: 580/2164 symbols completed. DOCS took 0.8s. Estimated remaining: 10m 38s. Rate: 148.9 symbols/min [2025-10-24T00:47:49.070258] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:49.567627] [DEBUG] [LOCAL ] DOV: Loaded 45957 existing records from primary storage. [2025-10-24T00:47:49.568419] [INFO ] [MAIN ] DOV: Loaded 45957 primary data records. [2025-10-24T00:47:49.691156] [DEBUG] [MAIN ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:49.723118] [DEBUG] [MAIN ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:50.002288] [INFO ] [MAIN ] DOUG: Generated 139 derivative records from 33959 primary records. [2025-10-24T00:47:50.006079] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-24T00:47:50.007692] [FATAL] [LOCAL ] DOUG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:50.010005] [FATAL] [MAIN ] DOUG: Failed to save derivative data. [2025-10-24T00:47:50.015711] [INFO ] [MAIN ] DOLE: Generated 139 derivative records from 39389 primary records. [2025-10-24T00:47:50.017983] [INFO ] [MAIN ] Derivative Progress: 581/2164 symbols completed. DOUG took 1.3s. Estimated remaining: 10m 40s. Rate: 148.5 symbols/min [2025-10-24T00:47:50.018388] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:50.018492] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-24T00:47:50.032062] [FATAL] [LOCAL ] DOLE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:50.032374] [DEBUG] [MAIN ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:50.032524] [FATAL] [MAIN ] DOLE: Failed to save derivative data. [2025-10-24T00:47:50.034773] [INFO ] [MAIN ] Derivative Progress: 582/2164 symbols completed. DOLE took 1.3s. Estimated remaining: 10m 38s. Rate: 148.7 symbols/min [2025-10-24T00:47:50.035074] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:50.078529] [DEBUG] [LOCAL ] DPG: Loaded 13421 existing records from primary storage. [2025-10-24T00:47:50.081369] [INFO ] [MAIN ] DPG: Loaded 13421 primary data records. [2025-10-24T00:47:50.216419] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-24T00:47:50.223062] [INFO ] [MAIN ] DOW: Loaded 54123 primary data records. [2025-10-24T00:47:50.222761] [INFO ] [MAIN ] DOV: Generated 139 derivative records from 45957 primary records. [2025-10-24T00:47:50.268959] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-24T00:47:50.280142] [FATAL] [LOCAL ] DOV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:50.298959] [FATAL] [MAIN ] DOV: Failed to save derivative data. [2025-10-24T00:47:50.352079] [INFO ] [MAIN ] Derivative Progress: 583/2164 symbols completed. DOV took 1.3s. Estimated remaining: 10m 38s. Rate: 148.8 symbols/min [2025-10-24T00:47:50.754638] [DEBUG] [MAIN ] DPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:50.794040] [DEBUG] [MAIN ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:50.835606] [INFO ] [MAIN ] DPG: Generated 139 derivative records from 13421 primary records. [2025-10-24T00:47:50.838826] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-24T00:47:50.839257] [FATAL] [LOCAL ] DPG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:50.840545] [FATAL] [MAIN ] DPG: Failed to save derivative data. [2025-10-24T00:47:50.845925] [INFO ] [MAIN ] Derivative Progress: 584/2164 symbols completed. DPG took 0.8s. Estimated remaining: 10m 37s. Rate: 148.7 symbols/min [2025-10-24T00:47:50.849041] [INFO ] [MAIN ] DOW: Generated 139 derivative records from 54123 primary records. [2025-10-24T00:47:50.849212] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-24T00:47:50.849432] [FATAL] [LOCAL ] DOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:50.849513] [FATAL] [MAIN ] DOW: Failed to save derivative data. [2025-10-24T00:47:50.851573] [INFO ] [MAIN ] Derivative Progress: 585/2164 symbols completed. DOW took 0.8s. Estimated remaining: 10m 36s. Rate: 149.0 symbols/min [2025-10-24T00:47:50.852057] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:50.852206] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:50.852331] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:50.915134] [DEBUG] [LOCAL ] DRD: Loaded 38203 existing records from primary storage. [2025-10-24T00:47:50.916707] [INFO ] [MAIN ] DRD: Loaded 38203 primary data records. [2025-10-24T00:47:51.000491] [DEBUG] [LOCAL ] DRH: Loaded 50624 existing records from primary storage. [2025-10-24T00:47:51.022102] [DEBUG] [LOCAL ] DQ: Loaded 44070 existing records from primary storage. [2025-10-24T00:47:51.027500] [INFO ] [MAIN ] DRH: Loaded 50624 primary data records. [2025-10-24T00:47:51.049788] [INFO ] [MAIN ] DQ: Loaded 44070 primary data records. [2025-10-24T00:47:51.904220] [DEBUG] [MAIN ] DRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:51.957161] [DEBUG] [MAIN ] DRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:51.976617] [DEBUG] [MAIN ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:52.025234] [INFO ] [MAIN ] DRD: Generated 139 derivative records from 38203 primary records. [2025-10-24T00:47:52.025747] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-24T00:47:52.026090] [FATAL] [LOCAL ] DRD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:52.031189] [FATAL] [MAIN ] DRD: Failed to save derivative data. [2025-10-24T00:47:52.034176] [INFO ] [MAIN ] Derivative Progress: 586/2164 symbols completed. DRD took 1.2s. Estimated remaining: 10m 38s. Rate: 148.5 symbols/min [2025-10-24T00:47:52.034376] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:52.061201] [INFO ] [MAIN ] DQ: Generated 139 derivative records from 44070 primary records. [2025-10-24T00:47:52.063883] [INFO ] [MAIN ] DRH: Generated 139 derivative records from 50624 primary records. [2025-10-24T00:47:52.062027] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-24T00:47:52.064868] [FATAL] [LOCAL ] DQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:52.064997] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-24T00:47:52.065159] [FATAL] [MAIN ] DQ: Failed to save derivative data. [2025-10-24T00:47:52.072497] [INFO ] [MAIN ] Derivative Progress: 587/2164 symbols completed. DQ took 1.2s. Estimated remaining: 10m 36s. Rate: 148.7 symbols/min [2025-10-24T00:47:52.065486] [FATAL] [LOCAL ] DRH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:52.073115] [FATAL] [MAIN ] DRH: Failed to save derivative data. [2025-10-24T00:47:52.072959] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:52.076218] [INFO ] [MAIN ] Derivative Progress: 588/2164 symbols completed. DRH took 1.2s. Estimated remaining: 10m 35s. Rate: 149.0 symbols/min [2025-10-24T00:47:52.076821] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:52.117813] [DEBUG] [LOCAL ] DRLL: Loaded 8648 existing records from primary storage. [2025-10-24T00:47:52.118092] [INFO ] [MAIN ] DRLL: Loaded 8648 primary data records. [2025-10-24T00:47:52.119191] [DEBUG] [LOCAL ] DRI: Loaded 47825 existing records from primary storage. [2025-10-24T00:47:52.124729] [INFO ] [MAIN ] DRI: Loaded 47825 primary data records. [2025-10-24T00:47:52.421116] [DEBUG] [LOCAL ] DSL: Loaded 29120 existing records from primary storage. [2025-10-24T00:47:52.486023] [INFO ] [MAIN ] DSL: Loaded 29120 primary data records. [2025-10-24T00:47:53.111272] [DEBUG] [MAIN ] DRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:53.105726] [DEBUG] [MAIN ] DRLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:53.181717] [DEBUG] [MAIN ] DSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:53.227030] [INFO ] [MAIN ] DRLL: Generated 139 derivative records from 8648 primary records. [2025-10-24T00:47:53.232031] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-24T00:47:53.232406] [FATAL] [LOCAL ] DRLL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:53.232525] [FATAL] [MAIN ] DRLL: Failed to save derivative data. [2025-10-24T00:47:53.238553] [INFO ] [MAIN ] Derivative Progress: 589/2164 symbols completed. DRLL took 1.2s. Estimated remaining: 10m 36s. Rate: 148.5 symbols/min [2025-10-24T00:47:53.235745] [INFO ] [MAIN ] DRI: Generated 139 derivative records from 47825 primary records. [2025-10-24T00:47:53.239203] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:53.239569] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-24T00:47:53.242854] [FATAL] [LOCAL ] DRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:53.246304] [FATAL] [MAIN ] DRI: Failed to save derivative data. [2025-10-24T00:47:53.249908] [INFO ] [MAIN ] Derivative Progress: 590/2164 symbols completed. DRI took 1.2s. Estimated remaining: 10m 35s. Rate: 148.8 symbols/min [2025-10-24T00:47:53.254386] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:53.265161] [INFO ] [MAIN ] DSL: Generated 139 derivative records from 29120 primary records. [2025-10-24T00:47:53.265832] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-24T00:47:53.271754] [FATAL] [LOCAL ] DSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:53.271866] [FATAL] [MAIN ] DSL: Failed to save derivative data. [2025-10-24T00:47:53.272832] [DEBUG] [LOCAL ] DSM: Loaded 14223 existing records from primary storage. [2025-10-24T00:47:53.276746] [INFO ] [MAIN ] Derivative Progress: 591/2164 symbols completed. DSL took 1.2s. Estimated remaining: 10m 33s. Rate: 149.0 symbols/min [2025-10-24T00:47:53.279235] [DEBUG] [LOCAL ] DSMC: Loaded 1780 existing records from primary storage. [2025-10-24T00:47:53.279433] [INFO ] [MAIN ] DSM: Loaded 14223 primary data records. [2025-10-24T00:47:53.279567] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:53.279678] [INFO ] [MAIN ] DSMC: Loaded 1780 primary data records. [2025-10-24T00:47:53.567447] [DEBUG] [LOCAL ] DSU: Loaded 22973 existing records from primary storage. [2025-10-24T00:47:53.793991] [INFO ] [MAIN ] DSU: Loaded 22973 primary data records. [2025-10-24T00:47:54.294698] [DEBUG] [MAIN ] DSMC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:47:54.295242] [DEBUG] [MAIN ] DSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:54.357587] [DEBUG] [MAIN ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:54.415800] [INFO ] [MAIN ] DSM: Generated 139 derivative records from 14223 primary records. [2025-10-24T00:47:54.418153] [INFO ] [MAIN ] DSMC: Generated 139 derivative records from 1780 primary records. [2025-10-24T00:47:54.418628] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-24T00:47:54.418767] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-24T00:47:54.420281] [FATAL] [LOCAL ] DSM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:54.420480] [FATAL] [LOCAL ] DSMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:54.421077] [FATAL] [MAIN ] DSM: Failed to save derivative data. [2025-10-24T00:47:54.423249] [INFO ] [MAIN ] Derivative Progress: 592/2164 symbols completed. DSM took 1.2s. Estimated remaining: 10m 35s. Rate: 148.5 symbols/min [2025-10-24T00:47:54.421177] [FATAL] [MAIN ] DSMC: Failed to save derivative data. [2025-10-24T00:47:54.427076] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:54.429955] [INFO ] [MAIN ] Derivative Progress: 593/2164 symbols completed. DSMC took 1.2s. Estimated remaining: 10m 34s. Rate: 148.8 symbols/min [2025-10-24T00:47:54.430873] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:54.436198] [INFO ] [MAIN ] DSU: Generated 139 derivative records from 22973 primary records. [2025-10-24T00:47:54.437093] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-24T00:47:54.437494] [FATAL] [LOCAL ] DSU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:54.437733] [FATAL] [MAIN ] DSU: Failed to save derivative data. [2025-10-24T00:47:54.441777] [INFO ] [MAIN ] Derivative Progress: 594/2164 symbols completed. DSU took 1.2s. Estimated remaining: 10m 32s. Rate: 149.0 symbols/min [2025-10-24T00:47:54.442166] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:54.458380] [DEBUG] [LOCAL ] DTB: Loaded 4918 existing records from primary storage. [2025-10-24T00:47:54.458953] [INFO ] [MAIN ] DTB: Loaded 4918 primary data records. [2025-10-24T00:47:54.519997] [DEBUG] [LOCAL ] DSX: Loaded 23599 existing records from primary storage. [2025-10-24T00:47:54.588618] [INFO ] [MAIN ] DSX: Loaded 23599 primary data records. [2025-10-24T00:47:54.799326] [DEBUG] [LOCAL ] DT: Loaded 53332 existing records from primary storage. [2025-10-24T00:47:54.942004] [INFO ] [MAIN ] DT: Loaded 53332 primary data records. [2025-10-24T00:47:55.691857] [DEBUG] [MAIN ] DTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:55.747210] [DEBUG] [MAIN ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:55.805198] [INFO ] [MAIN ] DTB: Generated 139 derivative records from 4918 primary records. [2025-10-24T00:47:55.805982] [DEBUG] [MAIN ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:55.806284] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-24T00:47:55.826103] [FATAL] [LOCAL ] DTB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:55.828543] [FATAL] [MAIN ] DTB: Failed to save derivative data. [2025-10-24T00:47:55.831559] [INFO ] [MAIN ] Derivative Progress: 595/2164 symbols completed. DTB took 1.4s. Estimated remaining: 10m 34s. Rate: 148.4 symbols/min [2025-10-24T00:47:55.834068] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:55.857146] [INFO ] [MAIN ] DSX: Generated 139 derivative records from 23599 primary records. [2025-10-24T00:47:55.861197] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-24T00:47:55.861532] [FATAL] [LOCAL ] DSX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:55.862899] [FATAL] [MAIN ] DSX: Failed to save derivative data. [2025-10-24T00:47:55.868097] [INFO ] [MAIN ] Derivative Progress: 596/2164 symbols completed. DSX took 1.4s. Estimated remaining: 10m 33s. Rate: 148.6 symbols/min [2025-10-24T00:47:55.868896] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:55.875723] [INFO ] [MAIN ] DT: Generated 139 derivative records from 53332 primary records. [2025-10-24T00:47:55.876324] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-24T00:47:55.876821] [FATAL] [LOCAL ] DT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:55.876921] [FATAL] [MAIN ] DT: Failed to save derivative data. [2025-10-24T00:47:55.880454] [INFO ] [MAIN ] Derivative Progress: 597/2164 symbols completed. DT took 1.4s. Estimated remaining: 10m 32s. Rate: 148.9 symbols/min [2025-10-24T00:47:55.880839] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:55.897742] [DEBUG] [LOCAL ] DTG: Loaded 5709 existing records from primary storage. [2025-10-24T00:47:55.898006] [INFO ] [MAIN ] DTG: Loaded 5709 primary data records. [2025-10-24T00:47:56.072986] [DEBUG] [LOCAL ] DTE: Loaded 47417 existing records from primary storage. [2025-10-24T00:47:56.112841] [INFO ] [MAIN ] DTE: Loaded 47417 primary data records. [2025-10-24T00:47:56.334754] [DEBUG] [LOCAL ] DTM: Loaded 44045 existing records from primary storage. [2025-10-24T00:47:56.347025] [INFO ] [MAIN ] DTM: Loaded 44045 primary data records. [2025-10-24T00:47:56.856376] [DEBUG] [MAIN ] DTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:56.898984] [DEBUG] [MAIN ] DTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:56.937883] [DEBUG] [MAIN ] DTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:56.982062] [INFO ] [MAIN ] DTG: Generated 139 derivative records from 5709 primary records. [2025-10-24T00:47:56.984775] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-24T00:47:56.985736] [FATAL] [LOCAL ] DTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:56.989363] [FATAL] [MAIN ] DTG: Failed to save derivative data. [2025-10-24T00:47:56.995917] [INFO ] [MAIN ] Derivative Progress: 598/2164 symbols completed. DTG took 1.1s. Estimated remaining: 10m 33s. Rate: 148.4 symbols/min [2025-10-24T00:47:57.002250] [INFO ] [MAIN ] DTE: Generated 139 derivative records from 47417 primary records. [2025-10-24T00:47:57.006362] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-24T00:47:57.006723] [FATAL] [LOCAL ] DTE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:57.006991] [FATAL] [MAIN ] DTE: Failed to save derivative data. [2025-10-24T00:47:57.009516] [INFO ] [MAIN ] Derivative Progress: 599/2164 symbols completed. DTE took 1.2s. Estimated remaining: 10m 32s. Rate: 148.7 symbols/min [2025-10-24T00:47:57.012484] [INFO ] [MAIN ] DTM: Generated 139 derivative records from 44045 primary records. [2025-10-24T00:47:57.012705] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-24T00:47:57.012934] [FATAL] [LOCAL ] DTM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:57.013020] [FATAL] [MAIN ] DTM: Failed to save derivative data. [2025-10-24T00:47:57.017331] [INFO ] [MAIN ] Derivative Progress: 600/2164 symbols completed. DTM took 1.1s. Estimated remaining: 10m 30s. Rate: 148.9 symbols/min [2025-10-24T00:47:57.017942] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:57.018176] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:57.018100] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:57.028558] [DEBUG] [LOCAL ] DTW: Loaded 4737 existing records from primary storage. [2025-10-24T00:47:57.031439] [DEBUG] [LOCAL ] DUKB: Loaded 6161 existing records from primary storage. [2025-10-24T00:47:57.031528] [INFO ] [MAIN ] DTW: Loaded 4737 primary data records. [2025-10-24T00:47:57.031634] [INFO ] [MAIN ] DUKB: Loaded 6161 primary data records. [2025-10-24T00:47:57.679044] [DEBUG] [LOCAL ] DUK: Loaded 53818 existing records from primary storage. [2025-10-24T00:47:57.679520] [INFO ] [MAIN ] DUK: Loaded 53818 primary data records. [2025-10-24T00:47:58.024476] [DEBUG] [MAIN ] DUKB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:58.025026] [DEBUG] [MAIN ] DTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:58.085262] [DEBUG] [MAIN ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:58.140957] [INFO ] [MAIN ] DUKB: Generated 139 derivative records from 6161 primary records. [2025-10-24T00:47:58.143032] [INFO ] [MAIN ] DTW: Generated 139 derivative records from 4737 primary records. [2025-10-24T00:47:58.144537] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-24T00:47:58.144766] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-24T00:47:58.145115] [FATAL] [LOCAL ] DTW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:58.145586] [FATAL] [MAIN ] DTW: Failed to save derivative data. [2025-10-24T00:47:58.145436] [FATAL] [LOCAL ] DUKB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:58.148534] [INFO ] [MAIN ] Derivative Progress: 601/2164 symbols completed. DTW took 1.1s. Estimated remaining: 10m 32s. Rate: 148.5 symbols/min [2025-10-24T00:47:58.145942] [FATAL] [MAIN ] DUKB: Failed to save derivative data. [2025-10-24T00:47:58.149720] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:58.154077] [INFO ] [MAIN ] Derivative Progress: 602/2164 symbols completed. DUKB took 1.1s. Estimated remaining: 10m 30s. Rate: 148.7 symbols/min [2025-10-24T00:47:58.154587] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:58.159264] [INFO ] [MAIN ] DUK: Generated 139 derivative records from 53818 primary records. [2025-10-24T00:47:58.159449] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-24T00:47:58.159686] [FATAL] [LOCAL ] DUK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:58.159779] [FATAL] [MAIN ] DUK: Failed to save derivative data. [2025-10-24T00:47:58.162602] [INFO ] [MAIN ] Derivative Progress: 603/2164 symbols completed. DUK took 1.1s. Estimated remaining: 10m 29s. Rate: 149.0 symbols/min [2025-10-24T00:47:58.162990] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:58.208763] [DEBUG] [LOCAL ] DVA: Loaded 40950 existing records from primary storage. [2025-10-24T00:47:58.208934] [INFO ] [MAIN ] DVA: Loaded 40950 primary data records. [2025-10-24T00:47:58.344419] [DEBUG] [LOCAL ] DV: Loaded 51625 existing records from primary storage. [2025-10-24T00:47:58.382316] [INFO ] [MAIN ] DV: Loaded 51625 primary data records. [2025-10-24T00:47:58.432483] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-24T00:47:58.566827] [INFO ] [MAIN ] DVN: Loaded 54089 primary data records. [2025-10-24T00:47:59.209024] [DEBUG] [MAIN ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:59.261729] [DEBUG] [MAIN ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:59.296403] [DEBUG] [MAIN ] DVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:47:59.319841] [INFO ] [MAIN ] DVA: Generated 139 derivative records from 40950 primary records. [2025-10-24T00:47:59.321934] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-24T00:47:59.322220] [FATAL] [LOCAL ] DVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:59.323841] [FATAL] [MAIN ] DVA: Failed to save derivative data. [2025-10-24T00:47:59.326289] [INFO ] [MAIN ] Derivative Progress: 604/2164 symbols completed. DVA took 1.2s. Estimated remaining: 10m 30s. Rate: 148.5 symbols/min [2025-10-24T00:47:59.326599] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:59.359613] [INFO ] [MAIN ] DV: Generated 139 derivative records from 51625 primary records. [2025-10-24T00:47:59.360123] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-24T00:47:59.359875] [INFO ] [MAIN ] DVN: Generated 139 derivative records from 54089 primary records. [2025-10-24T00:47:59.360362] [FATAL] [LOCAL ] DV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:59.360478] [FATAL] [MAIN ] DV: Failed to save derivative data. [2025-10-24T00:47:59.362851] [INFO ] [MAIN ] Derivative Progress: 605/2164 symbols completed. DV took 1.2s. Estimated remaining: 10m 29s. Rate: 148.7 symbols/min [2025-10-24T00:47:59.363048] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:59.363108] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-24T00:47:59.364020] [FATAL] [LOCAL ] DVN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:47:59.364098] [FATAL] [MAIN ] DVN: Failed to save derivative data. [2025-10-24T00:47:59.367730] [INFO ] [MAIN ] Derivative Progress: 606/2164 symbols completed. DVN took 1.2s. Estimated remaining: 10m 28s. Rate: 149.0 symbols/min [2025-10-24T00:47:59.367970] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:47:59.408199] [DEBUG] [LOCAL ] DX: Loaded 52920 existing records from primary storage. [2025-10-24T00:47:59.408472] [INFO ] [MAIN ] DX: Loaded 52920 primary data records. [2025-10-24T00:47:59.544064] [DEBUG] [LOCAL ] DXYZ: Loaded 37304 existing records from primary storage. [2025-10-24T00:47:59.555346] [INFO ] [MAIN ] DXYZ: Loaded 37304 primary data records. [2025-10-24T00:47:59.720986] [DEBUG] [LOCAL ] DXC: Loaded 50264 existing records from primary storage. [2025-10-24T00:47:59.744802] [INFO ] [MAIN ] DXC: Loaded 50264 primary data records. [2025-10-24T00:48:00.454126] [DEBUG] [MAIN ] DX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:00.497511] [DEBUG] [MAIN ] DXYZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:00.540480] [DEBUG] [MAIN ] DXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:00.578808] [INFO ] [MAIN ] DX: Generated 139 derivative records from 52920 primary records. [2025-10-24T00:48:00.584954] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-24T00:48:00.585948] [FATAL] [LOCAL ] DX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:00.588769] [FATAL] [MAIN ] DX: Failed to save derivative data. [2025-10-24T00:48:00.592161] [INFO ] [MAIN ] Derivative Progress: 607/2164 symbols completed. DX took 1.3s. Estimated remaining: 10m 29s. Rate: 148.5 symbols/min [2025-10-24T00:48:00.595336] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:00.595185] [INFO ] [MAIN ] DXYZ: Generated 139 derivative records from 37304 primary records. [2025-10-24T00:48:00.600012] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-24T00:48:00.601194] [FATAL] [LOCAL ] DXYZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:00.603028] [FATAL] [MAIN ] DXYZ: Failed to save derivative data. [2025-10-24T00:48:00.608774] [INFO ] [MAIN ] Derivative Progress: 608/2164 symbols completed. DXYZ took 1.2s. Estimated remaining: 10m 28s. Rate: 148.7 symbols/min [2025-10-24T00:48:00.609702] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:00.627204] [INFO ] [MAIN ] DXC: Generated 139 derivative records from 50264 primary records. [2025-10-24T00:48:00.627466] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-24T00:48:00.627892] [FATAL] [LOCAL ] DXC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:00.628005] [FATAL] [MAIN ] DXC: Failed to save derivative data. [2025-10-24T00:48:00.630917] [INFO ] [MAIN ] Derivative Progress: 609/2164 symbols completed. DXC took 1.3s. Estimated remaining: 10m 26s. Rate: 148.9 symbols/min [2025-10-24T00:48:00.631244] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:00.644231] [DEBUG] [LOCAL ] DY: Loaded 28151 existing records from primary storage. [2025-10-24T00:48:00.652450] [INFO ] [MAIN ] DY: Loaded 28151 primary data records. [2025-10-24T00:48:00.772599] [DEBUG] [LOCAL ] E: Loaded 33399 existing records from primary storage. [2025-10-24T00:48:00.783732] [INFO ] [MAIN ] E: Loaded 33399 primary data records. [2025-10-24T00:48:01.075571] [DEBUG] [LOCAL ] EAF: Loaded 41113 existing records from primary storage. [2025-10-24T00:48:01.093956] [INFO ] [MAIN ] EAF: Loaded 41113 primary data records. [2025-10-24T00:48:01.713970] [DEBUG] [MAIN ] DY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:01.756359] [DEBUG] [MAIN ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:01.802139] [DEBUG] [MAIN ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:01.832830] [INFO ] [MAIN ] DY: Generated 139 derivative records from 28151 primary records. [2025-10-24T00:48:01.836955] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-24T00:48:01.838377] [FATAL] [LOCAL ] DY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:01.838662] [FATAL] [MAIN ] DY: Failed to save derivative data. [2025-10-24T00:48:01.841093] [INFO ] [MAIN ] Derivative Progress: 610/2164 symbols completed. DY took 1.2s. Estimated remaining: 10m 28s. Rate: 148.4 symbols/min [2025-10-24T00:48:01.844759] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:01.866779] [DEBUG] [LOCAL ] EAI: Loaded 3938 existing records from primary storage. [2025-10-24T00:48:01.869530] [INFO ] [MAIN ] E: Generated 139 derivative records from 33399 primary records. [2025-10-24T00:48:01.872175] [INFO ] [MAIN ] EAI: Loaded 3938 primary data records. [2025-10-24T00:48:01.872546] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-24T00:48:01.911044] [FATAL] [LOCAL ] E: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:01.942198] [FATAL] [MAIN ] E: Failed to save derivative data. [2025-10-24T00:48:01.962660] [INFO ] [MAIN ] Derivative Progress: 611/2164 symbols completed. E took 1.4s. Estimated remaining: 10m 27s. Rate: 148.6 symbols/min [2025-10-24T00:48:01.975631] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:01.991729] [INFO ] [MAIN ] EAF: Generated 139 derivative records from 41113 primary records. [2025-10-24T00:48:01.992364] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-24T00:48:01.992938] [FATAL] [LOCAL ] EAF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:01.993127] [FATAL] [MAIN ] EAF: Failed to save derivative data. [2025-10-24T00:48:02.018090] [INFO ] [MAIN ] Derivative Progress: 612/2164 symbols completed. EAF took 1.4s. Estimated remaining: 10m 26s. Rate: 148.8 symbols/min [2025-10-24T00:48:02.056053] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:02.217331] [DEBUG] [LOCAL ] EARN: Loaded 27875 existing records from primary storage. [2025-10-24T00:48:02.218262] [INFO ] [MAIN ] EARN: Loaded 27875 primary data records. [2025-10-24T00:48:02.564539] [DEBUG] [LOCAL ] EAT: Loaded 50090 existing records from primary storage. [2025-10-24T00:48:02.567571] [INFO ] [MAIN ] EAT: Loaded 50090 primary data records. [2025-10-24T00:48:02.632751] [DEBUG] [MAIN ] EAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:02.953223] [DEBUG] [MAIN ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:02.981032] [INFO ] [MAIN ] EAI: Generated 139 derivative records from 3938 primary records. [2025-10-24T00:48:02.983432] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-24T00:48:02.988092] [FATAL] [LOCAL ] EAI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:02.989730] [FATAL] [MAIN ] EAI: Failed to save derivative data. [2025-10-24T00:48:03.007224] [DEBUG] [MAIN ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:03.006803] [INFO ] [MAIN ] Derivative Progress: 613/2164 symbols completed. EAI took 1.2s. Estimated remaining: 10m 27s. Rate: 148.5 symbols/min [2025-10-24T00:48:03.039607] [INFO ] [MAIN ] EARN: Generated 139 derivative records from 27875 primary records. [2025-10-24T00:48:03.041213] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-24T00:48:03.041511] [FATAL] [LOCAL ] EARN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:03.043565] [FATAL] [MAIN ] EARN: Failed to save derivative data. [2025-10-24T00:48:03.047535] [INFO ] [MAIN ] Derivative Progress: 614/2164 symbols completed. EARN took 1.1s. Estimated remaining: 10m 25s. Rate: 148.7 symbols/min [2025-10-24T00:48:03.052376] [INFO ] [MAIN ] EAT: Generated 139 derivative records from 50090 primary records. [2025-10-24T00:48:03.052466] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-24T00:48:03.052693] [FATAL] [LOCAL ] EAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:03.052772] [FATAL] [MAIN ] EAT: Failed to save derivative data. [2025-10-24T00:48:03.055406] [INFO ] [MAIN ] Derivative Progress: 615/2164 symbols completed. EAT took 1.0s. Estimated remaining: 10m 24s. Rate: 148.9 symbols/min [2025-10-24T00:48:03.055811] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:03.055916] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:03.056087] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:03.079428] [DEBUG] [LOCAL ] EBF: Loaded 19413 existing records from primary storage. [2025-10-24T00:48:03.079871] [INFO ] [MAIN ] EBF: Loaded 19413 primary data records. [2025-10-24T00:48:03.247207] [DEBUG] [LOCAL ] EB: Loaded 36426 existing records from primary storage. [2025-10-24T00:48:03.275733] [INFO ] [MAIN ] EB: Loaded 36426 primary data records. [2025-10-24T00:48:03.408261] [DEBUG] [LOCAL ] EBR: Loaded 43686 existing records from primary storage. [2025-10-24T00:48:03.497628] [INFO ] [MAIN ] EBR: Loaded 43686 primary data records. [2025-10-24T00:48:04.171006] [DEBUG] [MAIN ] EBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:04.217420] [DEBUG] [MAIN ] EB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:04.255037] [DEBUG] [MAIN ] EBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:04.280543] [INFO ] [MAIN ] EBF: Generated 139 derivative records from 19413 primary records. [2025-10-24T00:48:04.280897] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-24T00:48:04.281380] [FATAL] [LOCAL ] EBF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:04.281586] [FATAL] [MAIN ] EBF: Failed to save derivative data. [2025-10-24T00:48:04.287882] [INFO ] [MAIN ] Derivative Progress: 616/2164 symbols completed. EBF took 1.2s. Estimated remaining: 10m 26s. Rate: 148.4 symbols/min [2025-10-24T00:48:04.288204] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:04.323571] [INFO ] [MAIN ] EB: Generated 139 derivative records from 36426 primary records. [2025-10-24T00:48:04.325889] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-24T00:48:04.327131] [INFO ] [MAIN ] EBR: Generated 139 derivative records from 43686 primary records. [2025-10-24T00:48:04.326522] [FATAL] [LOCAL ] EB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:04.337746] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-24T00:48:04.338261] [FATAL] [LOCAL ] EBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:04.337868] [FATAL] [MAIN ] EB: Failed to save derivative data. [2025-10-24T00:48:04.338380] [FATAL] [MAIN ] EBR: Failed to save derivative data. [2025-10-24T00:48:04.340943] [INFO ] [MAIN ] Derivative Progress: 617/2164 symbols completed. EB took 1.3s. Estimated remaining: 10m 24s. Rate: 148.6 symbols/min [2025-10-24T00:48:04.341186] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:04.344089] [INFO ] [MAIN ] Derivative Progress: 618/2164 symbols completed. EBR took 1.3s. Estimated remaining: 10m 23s. Rate: 148.9 symbols/min [2025-10-24T00:48:04.344634] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:04.363559] [DEBUG] [LOCAL ] EBS: Loaded 46902 existing records from primary storage. [2025-10-24T00:48:04.363931] [INFO ] [MAIN ] EBS: Loaded 46902 primary data records. [2025-10-24T00:48:04.568049] [DEBUG] [LOCAL ] ECAT: Loaded 29317 existing records from primary storage. [2025-10-24T00:48:04.687000] [INFO ] [MAIN ] ECAT: Loaded 29317 primary data records. [2025-10-24T00:48:04.780375] [DEBUG] [LOCAL ] EC: Loaded 49210 existing records from primary storage. [2025-10-24T00:48:04.809183] [INFO ] [MAIN ] EC: Loaded 49210 primary data records. [2025-10-24T00:48:05.345503] [DEBUG] [MAIN ] EBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:05.392512] [DEBUG] [MAIN ] ECAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:05.426909] [INFO ] [MAIN ] EBS: Generated 139 derivative records from 46902 primary records. [2025-10-24T00:48:05.441966] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-24T00:48:05.441360] [DEBUG] [MAIN ] EC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:05.453327] [FATAL] [LOCAL ] EBS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:05.456827] [FATAL] [MAIN ] EBS: Failed to save derivative data. [2025-10-24T00:48:05.464793] [INFO ] [MAIN ] Derivative Progress: 619/2164 symbols completed. EBS took 1.2s. Estimated remaining: 10m 24s. Rate: 148.4 symbols/min [2025-10-24T00:48:05.468687] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:05.494880] [INFO ] [MAIN ] ECAT: Generated 139 derivative records from 29317 primary records. [2025-10-24T00:48:05.495357] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-24T00:48:05.496758] [FATAL] [LOCAL ] ECAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:05.497018] [FATAL] [MAIN ] ECAT: Failed to save derivative data. [2025-10-24T00:48:05.500914] [INFO ] [MAIN ] EC: Generated 139 derivative records from 49210 primary records. [2025-10-24T00:48:05.501038] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-24T00:48:05.500666] [INFO ] [MAIN ] Derivative Progress: 620/2164 symbols completed. ECAT took 1.2s. Estimated remaining: 10m 23s. Rate: 148.7 symbols/min [2025-10-24T00:48:05.501280] [FATAL] [LOCAL ] EC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:05.511107] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:05.501455] [FATAL] [MAIN ] EC: Failed to save derivative data. [2025-10-24T00:48:05.514413] [INFO ] [MAIN ] Derivative Progress: 621/2164 symbols completed. EC took 1.2s. Estimated remaining: 10m 22s. Rate: 148.9 symbols/min [2025-10-24T00:48:05.514797] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:05.518456] [DEBUG] [LOCAL ] ECCU: Loaded 2156 existing records from primary storage. [2025-10-24T00:48:05.518814] [INFO ] [MAIN ] ECCU: Loaded 2156 primary data records. [2025-10-24T00:48:05.640452] [DEBUG] [LOCAL ] ECC: Loaded 43660 existing records from primary storage. [2025-10-24T00:48:05.646464] [INFO ] [MAIN ] ECC: Loaded 43660 primary data records. [2025-10-24T00:48:05.930346] [DEBUG] [LOCAL ] ECG: Loaded 32971 existing records from primary storage. [2025-10-24T00:48:05.960980] [INFO ] [MAIN ] ECG: Loaded 32971 primary data records. [2025-10-24T00:48:06.514686] [DEBUG] [MAIN ] ECCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:06.548545] [DEBUG] [MAIN ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:06.600813] [DEBUG] [MAIN ] ECG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:06.636170] [INFO ] [MAIN ] ECCU: Generated 139 derivative records from 2156 primary records. [2025-10-24T00:48:06.637529] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-24T00:48:06.637816] [FATAL] [LOCAL ] ECCU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:06.642847] [FATAL] [MAIN ] ECCU: Failed to save derivative data. [2025-10-24T00:48:06.645183] [INFO ] [MAIN ] Derivative Progress: 622/2164 symbols completed. ECCU took 1.1s. Estimated remaining: 10m 23s. Rate: 148.5 symbols/min [2025-10-24T00:48:06.642519] [INFO ] [MAIN ] ECC: Generated 139 derivative records from 43660 primary records. [2025-10-24T00:48:06.645385] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:06.645794] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-24T00:48:06.649236] [FATAL] [LOCAL ] ECC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:06.649803] [FATAL] [MAIN ] ECC: Failed to save derivative data. [2025-10-24T00:48:06.653796] [INFO ] [MAIN ] Derivative Progress: 623/2164 symbols completed. ECC took 1.2s. Estimated remaining: 10m 22s. Rate: 148.7 symbols/min [2025-10-24T00:48:06.657100] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:06.665520] [INFO ] [MAIN ] ECG: Generated 139 derivative records from 32971 primary records. [2025-10-24T00:48:06.665861] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-24T00:48:06.666193] [FATAL] [LOCAL ] ECG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:06.666292] [FATAL] [MAIN ] ECG: Failed to save derivative data. [2025-10-24T00:48:06.669110] [INFO ] [MAIN ] Derivative Progress: 624/2164 symbols completed. ECG took 1.2s. Estimated remaining: 10m 20s. Rate: 148.9 symbols/min [2025-10-24T00:48:06.669432] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:06.694279] [DEBUG] [LOCAL ] ECO: Loaded 18178 existing records from primary storage. [2025-10-24T00:48:06.694485] [INFO ] [MAIN ] ECO: Loaded 18178 primary data records. [2025-10-24T00:48:06.813997] [DEBUG] [LOCAL ] ECL: Loaded 47048 existing records from primary storage. [2025-10-24T00:48:06.829914] [INFO ] [MAIN ] ECL: Loaded 47048 primary data records. [2025-10-24T00:48:07.146364] [DEBUG] [LOCAL ] ECVT: Loaded 43397 existing records from primary storage. [2025-10-24T00:48:07.162562] [INFO ] [MAIN ] ECVT: Loaded 43397 primary data records. [2025-10-24T00:48:07.657283] [DEBUG] [MAIN ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:07.704507] [DEBUG] [MAIN ] ECL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:07.742214] [DEBUG] [MAIN ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:07.759602] [INFO ] [MAIN ] ECO: Generated 139 derivative records from 18178 primary records. [2025-10-24T00:48:07.764679] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-24T00:48:07.766763] [FATAL] [LOCAL ] ECO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:07.767304] [FATAL] [MAIN ] ECO: Failed to save derivative data. [2025-10-24T00:48:07.769830] [INFO ] [MAIN ] Derivative Progress: 625/2164 symbols completed. ECO took 1.1s. Estimated remaining: 10m 22s. Rate: 148.5 symbols/min [2025-10-24T00:48:07.770377] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:07.798720] [INFO ] [MAIN ] ECL: Generated 139 derivative records from 47048 primary records. [2025-10-24T00:48:07.800309] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-24T00:48:07.800551] [FATAL] [LOCAL ] ECL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:07.800682] [FATAL] [MAIN ] ECL: Failed to save derivative data. [2025-10-24T00:48:07.805866] [INFO ] [MAIN ] Derivative Progress: 626/2164 symbols completed. ECL took 1.2s. Estimated remaining: 10m 20s. Rate: 148.7 symbols/min [2025-10-24T00:48:07.806074] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:07.818413] [DEBUG] [LOCAL ] EDD: Loaded 27448 existing records from primary storage. [2025-10-24T00:48:07.818845] [INFO ] [MAIN ] EDD: Loaded 27448 primary data records. [2025-10-24T00:48:07.821677] [INFO ] [MAIN ] ECVT: Generated 139 derivative records from 43397 primary records. [2025-10-24T00:48:07.833015] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-24T00:48:07.859516] [FATAL] [LOCAL ] ECVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:07.910561] [FATAL] [MAIN ] ECVT: Failed to save derivative data. [2025-10-24T00:48:07.935937] [INFO ] [MAIN ] Derivative Progress: 627/2164 symbols completed. ECVT took 1.3s. Estimated remaining: 10m 19s. Rate: 148.9 symbols/min [2025-10-24T00:48:07.941634] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:07.942602] [DEBUG] [LOCAL ] EDF: Loaded 12885 existing records from primary storage. [2025-10-24T00:48:07.948394] [INFO ] [MAIN ] EDF: Loaded 12885 primary data records. [2025-10-24T00:48:08.339102] [DEBUG] [LOCAL ] EDN: Loaded 19477 existing records from primary storage. [2025-10-24T00:48:08.365089] [INFO ] [MAIN ] EDN: Loaded 19477 primary data records. [2025-10-24T00:48:08.820150] [DEBUG] [MAIN ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:08.868073] [DEBUG] [MAIN ] EDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:08.912192] [DEBUG] [MAIN ] EDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:08.942225] [INFO ] [MAIN ] EDD: Generated 139 derivative records from 27448 primary records. [2025-10-24T00:48:08.945465] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-24T00:48:08.946922] [FATAL] [LOCAL ] EDD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:08.947344] [FATAL] [MAIN ] EDD: Failed to save derivative data. [2025-10-24T00:48:08.951023] [INFO ] [MAIN ] Derivative Progress: 628/2164 symbols completed. EDD took 1.2s. Estimated remaining: 10m 20s. Rate: 148.5 symbols/min [2025-10-24T00:48:08.965612] [INFO ] [MAIN ] EDF: Generated 139 derivative records from 12885 primary records. [2025-10-24T00:48:08.969464] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-24T00:48:08.969961] [FATAL] [LOCAL ] EDF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:08.971434] [FATAL] [MAIN ] EDF: Failed to save derivative data. [2025-10-24T00:48:08.974121] [INFO ] [MAIN ] Derivative Progress: 629/2164 symbols completed. EDF took 1.2s. Estimated remaining: 10m 19s. Rate: 148.8 symbols/min [2025-10-24T00:48:08.975964] [INFO ] [MAIN ] EDN: Generated 139 derivative records from 19477 primary records. [2025-10-24T00:48:08.976156] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-24T00:48:08.976369] [FATAL] [LOCAL ] EDN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:08.976446] [FATAL] [MAIN ] EDN: Failed to save derivative data. [2025-10-24T00:48:08.979375] [INFO ] [MAIN ] Derivative Progress: 630/2164 symbols completed. EDN took 1.0s. Estimated remaining: 10m 18s. Rate: 149.0 symbols/min [2025-10-24T00:48:08.979784] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:08.979901] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:08.980044] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:08.993048] [DEBUG] [LOCAL ] EEX: Loaded 9883 existing records from primary storage. [2025-10-24T00:48:08.993467] [INFO ] [MAIN ] EEX: Loaded 9883 primary data records. [2025-10-24T00:48:09.146422] [DEBUG] [LOCAL ] EE: Loaded 32747 existing records from primary storage. [2025-10-24T00:48:09.221601] [INFO ] [MAIN ] EE: Loaded 32747 primary data records. [2025-10-24T00:48:09.340524] [DEBUG] [LOCAL ] EDU: Loaded 45102 existing records from primary storage. [2025-10-24T00:48:09.352367] [INFO ] [MAIN ] EDU: Loaded 45102 primary data records. [2025-10-24T00:48:10.010815] [DEBUG] [MAIN ] EEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:10.072696] [DEBUG] [MAIN ] EDU: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:48:10.073571] [DEBUG] [MAIN ] EE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:10.124636] [INFO ] [MAIN ] EEX: Generated 139 derivative records from 9883 primary records. [2025-10-24T00:48:10.128061] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-24T00:48:10.128379] [FATAL] [LOCAL ] EEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:10.129740] [FATAL] [MAIN ] EEX: Failed to save derivative data. [2025-10-24T00:48:10.132817] [INFO ] [MAIN ] Derivative Progress: 631/2164 symbols completed. EEX took 1.2s. Estimated remaining: 10m 19s. Rate: 148.6 symbols/min [2025-10-24T00:48:10.133913] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:10.162273] [INFO ] [MAIN ] EE: Generated 139 derivative records from 32747 primary records. [2025-10-24T00:48:10.160627] [INFO ] [MAIN ] EDU: Generated 139 derivative records from 45102 primary records. [2025-10-24T00:48:10.162558] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-24T00:48:10.162870] [FATAL] [LOCAL ] EDU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:10.162955] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-24T00:48:10.163270] [FATAL] [LOCAL ] EE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:10.163407] [FATAL] [MAIN ] EE: Failed to save derivative data. [2025-10-24T00:48:10.166303] [INFO ] [MAIN ] Derivative Progress: 632/2164 symbols completed. EE took 1.2s. Estimated remaining: 10m 18s. Rate: 148.8 symbols/min [2025-10-24T00:48:10.163047] [FATAL] [MAIN ] EDU: Failed to save derivative data. [2025-10-24T00:48:10.168978] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:10.169205] [INFO ] [MAIN ] Derivative Progress: 633/2164 symbols completed. EDU took 1.2s. Estimated remaining: 10m 17s. Rate: 149.0 symbols/min [2025-10-24T00:48:10.180842] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:10.199135] [DEBUG] [LOCAL ] EFR: Loaded 15160 existing records from primary storage. [2025-10-24T00:48:10.213833] [INFO ] [MAIN ] EFR: Loaded 15160 primary data records. [2025-10-24T00:48:10.230072] [DEBUG] [LOCAL ] EFT: Loaded 12971 existing records from primary storage. [2025-10-24T00:48:10.275943] [DEBUG] [LOCAL ] EFC: Loaded 46626 existing records from primary storage. [2025-10-24T00:48:10.285128] [INFO ] [MAIN ] EFT: Loaded 12971 primary data records. [2025-10-24T00:48:10.307734] [INFO ] [MAIN ] EFC: Loaded 46626 primary data records. [2025-10-24T00:48:11.185105] [DEBUG] [MAIN ] EFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:11.220720] [DEBUG] [MAIN ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:11.249004] [DEBUG] [MAIN ] EFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:11.321116] [INFO ] [MAIN ] EFR: Generated 139 derivative records from 15160 primary records. [2025-10-24T00:48:11.326825] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-24T00:48:11.327350] [FATAL] [LOCAL ] EFR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:11.327469] [FATAL] [MAIN ] EFR: Failed to save derivative data. [2025-10-24T00:48:11.329859] [INFO ] [MAIN ] Derivative Progress: 634/2164 symbols completed. EFR took 1.2s. Estimated remaining: 10m 18s. Rate: 148.6 symbols/min [2025-10-24T00:48:11.332584] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:11.336677] [INFO ] [MAIN ] EFT: Generated 139 derivative records from 12971 primary records. [2025-10-24T00:48:11.337551] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-24T00:48:11.338026] [FATAL] [LOCAL ] EFT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:11.339746] [FATAL] [MAIN ] EFT: Failed to save derivative data. [2025-10-24T00:48:11.342922] [INFO ] [MAIN ] Derivative Progress: 635/2164 symbols completed. EFT took 1.2s. Estimated remaining: 10m 17s. Rate: 148.8 symbols/min [2025-10-24T00:48:11.344897] [INFO ] [MAIN ] EFC: Generated 139 derivative records from 46626 primary records. [2025-10-24T00:48:11.345128] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-24T00:48:11.345453] [FATAL] [LOCAL ] EFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:11.345876] [FATAL] [MAIN ] EFC: Failed to save derivative data. [2025-10-24T00:48:11.348877] [INFO ] [MAIN ] Derivative Progress: 636/2164 symbols completed. EFC took 1.2s. Estimated remaining: 10m 15s. Rate: 149.0 symbols/min [2025-10-24T00:48:11.349089] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:11.345829] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:11.392857] [DEBUG] [LOCAL ] EG: Loaded 27639 existing records from primary storage. [2025-10-24T00:48:11.393028] [INFO ] [MAIN ] EG: Loaded 27639 primary data records. [2025-10-24T00:48:11.459412] [DEBUG] [LOCAL ] EFXT: Loaded 29741 existing records from primary storage. [2025-10-24T00:48:11.481796] [INFO ] [MAIN ] EFXT: Loaded 29741 primary data records. [2025-10-24T00:48:11.532576] [DEBUG] [LOCAL ] EFX: Loaded 45066 existing records from primary storage. [2025-10-24T00:48:11.559289] [INFO ] [MAIN ] EFX: Loaded 45066 primary data records. [2025-10-24T00:48:12.420838] [DEBUG] [MAIN ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:12.448833] [DEBUG] [MAIN ] EFXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:12.476598] [DEBUG] [MAIN ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:12.563282] [INFO ] [MAIN ] EG: Generated 139 derivative records from 27639 primary records. [2025-10-24T00:48:12.565539] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-24T00:48:12.571400] [FATAL] [LOCAL ] EG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:12.571553] [FATAL] [MAIN ] EG: Failed to save derivative data. [2025-10-24T00:48:12.570892] [INFO ] [MAIN ] EFXT: Generated 139 derivative records from 29741 primary records. [2025-10-24T00:48:12.575215] [INFO ] [MAIN ] Derivative Progress: 637/2164 symbols completed. EG took 1.2s. Estimated remaining: 10m 17s. Rate: 148.5 symbols/min [2025-10-24T00:48:12.573023] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-24T00:48:12.575727] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:12.576235] [FATAL] [LOCAL ] EFXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:12.576611] [FATAL] [MAIN ] EFXT: Failed to save derivative data. [2025-10-24T00:48:12.584627] [INFO ] [MAIN ] Derivative Progress: 638/2164 symbols completed. EFXT took 1.2s. Estimated remaining: 10m 15s. Rate: 148.8 symbols/min [2025-10-24T00:48:12.585171] [INFO ] [MAIN ] EFX: Generated 139 derivative records from 45066 primary records. [2025-10-24T00:48:12.585706] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:12.585862] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-24T00:48:12.586715] [FATAL] [LOCAL ] EFX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:12.586854] [FATAL] [MAIN ] EFX: Failed to save derivative data. [2025-10-24T00:48:12.589816] [INFO ] [MAIN ] Derivative Progress: 639/2164 symbols completed. EFX took 1.3s. Estimated remaining: 10m 14s. Rate: 149.0 symbols/min [2025-10-24T00:48:12.590056] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:12.644482] [DEBUG] [LOCAL ] EGP: Loaded 30434 existing records from primary storage. [2025-10-24T00:48:12.644697] [INFO ] [MAIN ] EGP: Loaded 30434 primary data records. [2025-10-24T00:48:12.739219] [DEBUG] [LOCAL ] EGY: Loaded 41489 existing records from primary storage. [2025-10-24T00:48:12.752134] [INFO ] [MAIN ] EGY: Loaded 41489 primary data records. [2025-10-24T00:48:12.739997] [DEBUG] [LOCAL ] EGO: Loaded 52112 existing records from primary storage. [2025-10-24T00:48:12.773704] [INFO ] [MAIN ] EGO: Loaded 52112 primary data records. [2025-10-24T00:48:13.672170] [DEBUG] [MAIN ] EGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:13.672767] [DEBUG] [MAIN ] EGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:13.732784] [DEBUG] [MAIN ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:13.800835] [INFO ] [MAIN ] EGP: Generated 139 derivative records from 30434 primary records. [2025-10-24T00:48:13.801496] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-24T00:48:13.805601] [INFO ] [MAIN ] EGY: Generated 139 derivative records from 41489 primary records. [2025-10-24T00:48:13.806014] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-24T00:48:13.805415] [FATAL] [LOCAL ] EGP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:13.806431] [FATAL] [LOCAL ] EGY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:13.808127] [FATAL] [MAIN ] EGY: Failed to save derivative data. [2025-10-24T00:48:13.809145] [FATAL] [MAIN ] EGP: Failed to save derivative data. [2025-10-24T00:48:13.813094] [INFO ] [MAIN ] Derivative Progress: 640/2164 symbols completed. EGY took 1.2s. Estimated remaining: 10m 16s. Rate: 148.5 symbols/min [2025-10-24T00:48:13.815541] [INFO ] [MAIN ] Derivative Progress: 641/2164 symbols completed. EGP took 1.2s. Estimated remaining: 10m 14s. Rate: 148.8 symbols/min [2025-10-24T00:48:13.815418] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:13.817414] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:13.820744] [INFO ] [MAIN ] EGO: Generated 139 derivative records from 52112 primary records. [2025-10-24T00:48:13.820989] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-24T00:48:13.821209] [FATAL] [LOCAL ] EGO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:13.821286] [FATAL] [MAIN ] EGO: Failed to save derivative data. [2025-10-24T00:48:13.824222] [INFO ] [MAIN ] Derivative Progress: 642/2164 symbols completed. EGO took 1.2s. Estimated remaining: 10m 13s. Rate: 149.0 symbols/min [2025-10-24T00:48:13.824442] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:13.849444] [DEBUG] [LOCAL ] EHI: Loaded 10593 existing records from primary storage. [2025-10-24T00:48:13.858760] [INFO ] [MAIN ] EHI: Loaded 10593 primary data records. [2025-10-24T00:48:13.864631] [DEBUG] [LOCAL ] EHAB: Loaded 29510 existing records from primary storage. [2025-10-24T00:48:13.912046] [INFO ] [MAIN ] EHAB: Loaded 29510 primary data records. [2025-10-24T00:48:14.098796] [DEBUG] [LOCAL ] EHC: Loaded 41202 existing records from primary storage. [2025-10-24T00:48:14.121631] [INFO ] [MAIN ] EHC: Loaded 41202 primary data records. [2025-10-24T00:48:14.873613] [DEBUG] [MAIN ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:14.909944] [DEBUG] [MAIN ] EHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:14.945852] [DEBUG] [MAIN ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:14.994757] [INFO ] [MAIN ] EHAB: Generated 139 derivative records from 29510 primary records. [2025-10-24T00:48:14.998023] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-24T00:48:15.001239] [FATAL] [LOCAL ] EHAB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:15.002502] [FATAL] [MAIN ] EHAB: Failed to save derivative data. [2025-10-24T00:48:15.005824] [INFO ] [MAIN ] Derivative Progress: 643/2164 symbols completed. EHAB took 1.2s. Estimated remaining: 10m 14s. Rate: 148.5 symbols/min [2025-10-24T00:48:15.017939] [INFO ] [MAIN ] EHI: Generated 139 derivative records from 10593 primary records. [2025-10-24T00:48:15.019413] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-24T00:48:15.019727] [FATAL] [LOCAL ] EHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:15.019950] [FATAL] [MAIN ] EHI: Failed to save derivative data. [2025-10-24T00:48:15.022668] [INFO ] [MAIN ] Derivative Progress: 644/2164 symbols completed. EHI took 1.2s. Estimated remaining: 10m 13s. Rate: 148.8 symbols/min [2025-10-24T00:48:15.024768] [INFO ] [MAIN ] EHC: Generated 139 derivative records from 41202 primary records. [2025-10-24T00:48:15.024857] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-24T00:48:15.025048] [FATAL] [LOCAL ] EHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:15.025145] [FATAL] [MAIN ] EHC: Failed to save derivative data. [2025-10-24T00:48:15.027936] [INFO ] [MAIN ] Derivative Progress: 645/2164 symbols completed. EHC took 1.2s. Estimated remaining: 10m 12s. Rate: 149.0 symbols/min [2025-10-24T00:48:15.028390] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:15.028526] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:15.029061] [INFO ] [MAIN ] EICC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:15.040990] [DEBUG] [LOCAL ] EICC: Loaded 6220 existing records from primary storage. [2025-10-24T00:48:15.041195] [INFO ] [MAIN ] EICC: Loaded 6220 primary data records. [2025-10-24T00:48:15.170278] [DEBUG] [LOCAL ] EIG: Loaded 20163 existing records from primary storage. [2025-10-24T00:48:15.176027] [INFO ] [MAIN ] EIG: Loaded 20163 primary data records. [2025-10-24T00:48:15.169215] [DEBUG] [LOCAL ] EIC: Loaded 22532 existing records from primary storage. [2025-10-24T00:48:15.203024] [INFO ] [MAIN ] EIC: Loaded 22532 primary data records. [2025-10-24T00:48:16.085173] [DEBUG] [MAIN ] EICC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:16.134548] [DEBUG] [MAIN ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:16.163578] [DEBUG] [MAIN ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:16.201137] [INFO ] [MAIN ] EICC: Generated 139 derivative records from 6220 primary records. [2025-10-24T00:48:16.203003] [DEBUG] [LOCAL ] EICC: Saving derivative data. [2025-10-24T00:48:16.204886] [FATAL] [LOCAL ] EICC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:16.205802] [FATAL] [MAIN ] EICC: Failed to save derivative data. [2025-10-24T00:48:16.211757] [INFO ] [MAIN ] Derivative Progress: 646/2164 symbols completed. EICC took 1.2s. Estimated remaining: 10m 13s. Rate: 148.5 symbols/min [2025-10-24T00:48:16.214613] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:16.238983] [INFO ] [MAIN ] EIG: Generated 139 derivative records from 20163 primary records. [2025-10-24T00:48:16.240909] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-24T00:48:16.241185] [INFO ] [MAIN ] EIC: Generated 139 derivative records from 22532 primary records. [2025-10-24T00:48:16.241467] [FATAL] [LOCAL ] EIG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:16.241689] [FATAL] [MAIN ] EIG: Failed to save derivative data. [2025-10-24T00:48:16.244579] [INFO ] [MAIN ] Derivative Progress: 647/2164 symbols completed. EIG took 1.2s. Estimated remaining: 10m 12s. Rate: 148.8 symbols/min [2025-10-24T00:48:16.245015] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:16.245138] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-24T00:48:16.245832] [FATAL] [LOCAL ] EIC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:16.245911] [FATAL] [MAIN ] EIC: Failed to save derivative data. [2025-10-24T00:48:16.248891] [INFO ] [MAIN ] Derivative Progress: 648/2164 symbols completed. EIC took 1.2s. Estimated remaining: 10m 11s. Rate: 149.0 symbols/min [2025-10-24T00:48:16.249098] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:16.294059] [DEBUG] [LOCAL ] EIX: Loaded 53737 existing records from primary storage. [2025-10-24T00:48:16.310064] [INFO ] [MAIN ] EIX: Loaded 53737 primary data records. [2025-10-24T00:48:16.472900] [DEBUG] [LOCAL ] EL: Loaded 53769 existing records from primary storage. [2025-10-24T00:48:16.494170] [INFO ] [MAIN ] EL: Loaded 53769 primary data records. [2025-10-24T00:48:16.495123] [DEBUG] [LOCAL ] ELAN: Loaded 53699 existing records from primary storage. [2025-10-24T00:48:16.531139] [INFO ] [MAIN ] ELAN: Loaded 53699 primary data records. [2025-10-24T00:48:17.307027] [DEBUG] [MAIN ] EIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:17.344154] [DEBUG] [MAIN ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:17.396785] [DEBUG] [MAIN ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:17.445165] [INFO ] [MAIN ] EIX: Generated 139 derivative records from 53737 primary records. [2025-10-24T00:48:17.445569] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-24T00:48:17.446061] [FATAL] [LOCAL ] EIX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:17.446253] [FATAL] [MAIN ] EIX: Failed to save derivative data. [2025-10-24T00:48:17.453688] [INFO ] [MAIN ] Derivative Progress: 649/2164 symbols completed. EIX took 1.2s. Estimated remaining: 10m 12s. Rate: 148.5 symbols/min [2025-10-24T00:48:17.455380] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:17.464719] [INFO ] [MAIN ] EL: Generated 139 derivative records from 53769 primary records. [2025-10-24T00:48:17.465049] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-24T00:48:17.465383] [FATAL] [LOCAL ] EL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:17.465982] [FATAL] [MAIN ] EL: Failed to save derivative data. [2025-10-24T00:48:17.469589] [INFO ] [MAIN ] Derivative Progress: 650/2164 symbols completed. EL took 1.2s. Estimated remaining: 10m 11s. Rate: 148.7 symbols/min [2025-10-24T00:48:17.477634] [DEBUG] [LOCAL ] ELC: Loaded 3459 existing records from primary storage. [2025-10-24T00:48:17.478537] [INFO ] [MAIN ] ELC: Loaded 3459 primary data records. [2025-10-24T00:48:17.478240] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:17.560463] [INFO ] [MAIN ] ELAN: Generated 139 derivative records from 53699 primary records. [2025-10-24T00:48:17.576556] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-24T00:48:17.587937] [FATAL] [LOCAL ] ELAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:17.599210] [FATAL] [MAIN ] ELAN: Failed to save derivative data. [2025-10-24T00:48:17.612511] [INFO ] [MAIN ] Derivative Progress: 651/2164 symbols completed. ELAN took 1.4s. Estimated remaining: 10m 10s. Rate: 148.9 symbols/min [2025-10-24T00:48:17.642676] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:17.871204] [DEBUG] [LOCAL ] ELF: Loaded 52226 existing records from primary storage. [2025-10-24T00:48:17.872875] [INFO ] [MAIN ] ELF: Loaded 52226 primary data records. [2025-10-24T00:48:17.885293] [DEBUG] [LOCAL ] ELME: Loaded 39574 existing records from primary storage. [2025-10-24T00:48:17.917306] [INFO ] [MAIN ] ELME: Loaded 39574 primary data records. [2025-10-24T00:48:18.447129] [DEBUG] [MAIN ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:18.637681] [DEBUG] [MAIN ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:18.640160] [INFO ] [MAIN ] ELC: Generated 139 derivative records from 3459 primary records. [2025-10-24T00:48:18.653384] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-24T00:48:18.655954] [FATAL] [LOCAL ] ELC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:18.656781] [FATAL] [MAIN ] ELC: Failed to save derivative data. [2025-10-24T00:48:18.660705] [INFO ] [MAIN ] Derivative Progress: 652/2164 symbols completed. ELC took 1.2s. Estimated remaining: 10m 11s. Rate: 148.5 symbols/min [2025-10-24T00:48:18.662598] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:18.680890] [DEBUG] [MAIN ] ELME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:18.739525] [DEBUG] [LOCAL ] ELP: Loaded 25729 existing records from primary storage. [2025-10-24T00:48:18.743816] [INFO ] [MAIN ] ELP: Loaded 25729 primary data records. [2025-10-24T00:48:18.870926] [INFO ] [MAIN ] ELF: Generated 139 derivative records from 52226 primary records. [2025-10-24T00:48:18.913842] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-24T00:48:18.947948] [FATAL] [LOCAL ] ELF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:18.955905] [FATAL] [MAIN ] ELF: Failed to save derivative data. [2025-10-24T00:48:19.075183] [INFO ] [MAIN ] Derivative Progress: 653/2164 symbols completed. ELF took 1.6s. Estimated remaining: 10m 10s. Rate: 148.5 symbols/min [2025-10-24T00:48:19.076201] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:19.075790] [INFO ] [MAIN ] ELME: Generated 139 derivative records from 39574 primary records. [2025-10-24T00:48:19.076445] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-24T00:48:19.076782] [FATAL] [LOCAL ] ELME: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:19.076902] [FATAL] [MAIN ] ELME: Failed to save derivative data. [2025-10-24T00:48:19.081677] [INFO ] [MAIN ] Derivative Progress: 654/2164 symbols completed. ELME took 1.4s. Estimated remaining: 10m 9s. Rate: 148.7 symbols/min [2025-10-24T00:48:19.082819] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:19.109283] [DEBUG] [MAIN ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:19.200060] [INFO ] [MAIN ] ELP: Generated 139 derivative records from 25729 primary records. [2025-10-24T00:48:19.201934] [DEBUG] [LOCAL ] ELS: Loaded 50237 existing records from primary storage. [2025-10-24T00:48:19.202150] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-24T00:48:19.203801] [FATAL] [LOCAL ] ELP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:19.203956] [FATAL] [MAIN ] ELP: Failed to save derivative data. [2025-10-24T00:48:19.206477] [INFO ] [MAIN ] Derivative Progress: 655/2164 symbols completed. ELP took 0.5s. Estimated remaining: 10m 8s. Rate: 148.9 symbols/min [2025-10-24T00:48:19.203086] [DEBUG] [LOCAL ] ELV: Loaded 51124 existing records from primary storage. [2025-10-24T00:48:19.206844] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:19.203474] [INFO ] [MAIN ] ELS: Loaded 50237 primary data records. [2025-10-24T00:48:19.207353] [INFO ] [MAIN ] ELV: Loaded 51124 primary data records. [2025-10-24T00:48:19.476383] [DEBUG] [LOCAL ] EMD: Loaded 20887 existing records from primary storage. [2025-10-24T00:48:19.525271] [INFO ] [MAIN ] EMD: Loaded 20887 primary data records. [2025-10-24T00:48:20.267355] [DEBUG] [MAIN ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:20.297514] [DEBUG] [MAIN ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:20.336733] [DEBUG] [MAIN ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:20.409083] [INFO ] [MAIN ] ELS: Generated 139 derivative records from 50237 primary records. [2025-10-24T00:48:20.409876] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-24T00:48:20.410630] [FATAL] [LOCAL ] ELS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:20.412346] [FATAL] [MAIN ] ELS: Failed to save derivative data. [2025-10-24T00:48:20.418830] [INFO ] [MAIN ] Derivative Progress: 656/2164 symbols completed. ELS took 1.3s. Estimated remaining: 10m 10s. Rate: 148.4 symbols/min [2025-10-24T00:48:20.423170] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:20.424829] [INFO ] [MAIN ] ELV: Generated 139 derivative records from 51124 primary records. [2025-10-24T00:48:20.425059] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-24T00:48:20.425747] [FATAL] [LOCAL ] ELV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:20.428035] [FATAL] [MAIN ] ELV: Failed to save derivative data. [2025-10-24T00:48:20.430680] [INFO ] [MAIN ] Derivative Progress: 657/2164 symbols completed. ELV took 1.3s. Estimated remaining: 10m 8s. Rate: 148.7 symbols/min [2025-10-24T00:48:20.431045] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:20.434946] [INFO ] [MAIN ] EMD: Generated 139 derivative records from 20887 primary records. [2025-10-24T00:48:20.435179] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-24T00:48:20.435428] [FATAL] [LOCAL ] EMD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:20.436140] [FATAL] [MAIN ] EMD: Failed to save derivative data. [2025-10-24T00:48:20.441153] [INFO ] [MAIN ] Derivative Progress: 658/2164 symbols completed. EMD took 1.2s. Estimated remaining: 10m 7s. Rate: 148.9 symbols/min [2025-10-24T00:48:20.446326] [DEBUG] [LOCAL ] EMF: Loaded 3111 existing records from primary storage. [2025-10-24T00:48:20.446695] [INFO ] [MAIN ] EMF: Loaded 3111 primary data records. [2025-10-24T00:48:20.660226] [DEBUG] [LOCAL ] EME: Loaded 30969 existing records from primary storage. [2025-10-24T00:48:20.745687] [INFO ] [MAIN ] EME: Loaded 30969 primary data records. [2025-10-24T00:48:21.124862] [DEBUG] [MAIN ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:21.174682] [DEBUG] [MAIN ] EME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:21.200559] [INFO ] [MAIN ] EMF: Generated 139 derivative records from 3111 primary records. [2025-10-24T00:48:21.203746] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-24T00:48:21.204341] [FATAL] [LOCAL ] EMF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:21.205571] [FATAL] [MAIN ] EMF: Failed to save derivative data. [2025-10-24T00:48:21.211617] [INFO ] [MAIN ] Derivative Progress: 659/2164 symbols completed. EMF took 0.8s. Estimated remaining: 10m 7s. Rate: 148.7 symbols/min [2025-10-24T00:48:21.219821] [INFO ] [MAIN ] EME: Generated 139 derivative records from 30969 primary records. [2025-10-24T00:48:21.219944] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-24T00:48:21.220130] [FATAL] [LOCAL ] EME: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:21.220216] [FATAL] [MAIN ] EME: Failed to save derivative data. [2025-10-24T00:48:21.222090] [INFO ] [MAIN ] Derivative Progress: 660/2164 symbols completed. EME took 0.8s. Estimated remaining: 10m 6s. Rate: 148.9 symbols/min [2025-10-24T00:48:21.222465] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:21.222839] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:21.222579] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:21.229261] [DEBUG] [LOCAL ] EMP: Loaded 2894 existing records from primary storage. [2025-10-24T00:48:21.229772] [INFO ] [MAIN ] EMP: Loaded 2894 primary data records. [2025-10-24T00:48:21.306550] [DEBUG] [LOCAL ] EMO: Loaded 13427 existing records from primary storage. [2025-10-24T00:48:21.329205] [INFO ] [MAIN ] EMO: Loaded 13427 primary data records. [2025-10-24T00:48:21.857217] [DEBUG] [LOCAL ] EMN: Loaded 51204 existing records from primary storage. [2025-10-24T00:48:21.858213] [INFO ] [MAIN ] EMN: Loaded 51204 primary data records. [2025-10-24T00:48:22.239888] [DEBUG] [MAIN ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:22.239467] [DEBUG] [MAIN ] EMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:22.307197] [DEBUG] [MAIN ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:22.347336] [INFO ] [MAIN ] EMO: Generated 139 derivative records from 13427 primary records. [2025-10-24T00:48:22.349706] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-24T00:48:22.351731] [FATAL] [LOCAL ] EMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:22.352138] [FATAL] [MAIN ] EMO: Failed to save derivative data. [2025-10-24T00:48:22.354484] [INFO ] [MAIN ] Derivative Progress: 661/2164 symbols completed. EMO took 1.1s. Estimated remaining: 10m 7s. Rate: 148.5 symbols/min [2025-10-24T00:48:22.357603] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:22.361069] [INFO ] [MAIN ] EMP: Generated 139 derivative records from 2894 primary records. [2025-10-24T00:48:22.363083] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-24T00:48:22.363591] [FATAL] [LOCAL ] EMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:22.363844] [FATAL] [MAIN ] EMP: Failed to save derivative data. [2025-10-24T00:48:22.366163] [INFO ] [MAIN ] Derivative Progress: 662/2164 symbols completed. EMP took 1.1s. Estimated remaining: 10m 6s. Rate: 148.7 symbols/min [2025-10-24T00:48:22.369201] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:22.376800] [INFO ] [MAIN ] EMN: Generated 139 derivative records from 51204 primary records. [2025-10-24T00:48:22.377046] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-24T00:48:22.378577] [FATAL] [LOCAL ] EMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:22.378734] [FATAL] [MAIN ] EMN: Failed to save derivative data. [2025-10-24T00:48:22.381483] [INFO ] [MAIN ] Derivative Progress: 663/2164 symbols completed. EMN took 1.2s. Estimated remaining: 10m 5s. Rate: 148.9 symbols/min [2025-10-24T00:48:22.381741] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:22.386692] [DEBUG] [LOCAL ] ENO: Loaded 1746 existing records from primary storage. [2025-10-24T00:48:22.387020] [INFO ] [MAIN ] ENO: Loaded 1746 primary data records. [2025-10-24T00:48:22.601354] [DEBUG] [LOCAL ] EMR: Loaded 53551 existing records from primary storage. [2025-10-24T00:48:22.622701] [INFO ] [MAIN ] EMR: Loaded 53551 primary data records. [2025-10-24T00:48:22.834196] [DEBUG] [LOCAL ] ENB: Loaded 53901 existing records from primary storage. [2025-10-24T00:48:22.838486] [INFO ] [MAIN ] ENB: Loaded 53901 primary data records. [2025-10-24T00:48:23.359143] [DEBUG] [MAIN ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:23.399231] [DEBUG] [MAIN ] EMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:23.449701] [DEBUG] [MAIN ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:23.485621] [INFO ] [MAIN ] ENO: Generated 139 derivative records from 1746 primary records. [2025-10-24T00:48:23.488635] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-24T00:48:23.489349] [FATAL] [LOCAL ] ENO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:23.492232] [FATAL] [MAIN ] ENO: Failed to save derivative data. [2025-10-24T00:48:23.498538] [INFO ] [MAIN ] Derivative Progress: 664/2164 symbols completed. ENO took 1.1s. Estimated remaining: 10m 6s. Rate: 148.5 symbols/min [2025-10-24T00:48:23.499994] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:23.504837] [INFO ] [MAIN ] EMR: Generated 139 derivative records from 53551 primary records. [2025-10-24T00:48:23.508319] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-24T00:48:23.508967] [FATAL] [LOCAL ] EMR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:23.509058] [FATAL] [MAIN ] EMR: Failed to save derivative data. [2025-10-24T00:48:23.511221] [INFO ] [MAIN ] Derivative Progress: 665/2164 symbols completed. EMR took 1.2s. Estimated remaining: 10m 5s. Rate: 148.7 symbols/min [2025-10-24T00:48:23.511411] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:23.521756] [INFO ] [MAIN ] ENB: Generated 139 derivative records from 53901 primary records. [2025-10-24T00:48:23.522361] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-24T00:48:23.522859] [FATAL] [LOCAL ] ENB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:23.522952] [FATAL] [MAIN ] ENB: Failed to save derivative data. [2025-10-24T00:48:23.526037] [INFO ] [MAIN ] Derivative Progress: 666/2164 symbols completed. ENB took 1.2s. Estimated remaining: 10m 3s. Rate: 149.0 symbols/min [2025-10-24T00:48:23.526480] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:23.592312] [DEBUG] [LOCAL ] ENR: Loaded 44097 existing records from primary storage. [2025-10-24T00:48:23.592535] [INFO ] [MAIN ] ENR: Loaded 44097 primary data records. [2025-10-24T00:48:23.593607] [DEBUG] [LOCAL ] ENOV: Loaded 44895 existing records from primary storage. [2025-10-24T00:48:23.599728] [INFO ] [MAIN ] ENOV: Loaded 44895 primary data records. [2025-10-24T00:48:23.713516] [DEBUG] [LOCAL ] ENS: Loaded 29875 existing records from primary storage. [2025-10-24T00:48:23.769734] [INFO ] [MAIN ] ENS: Loaded 29875 primary data records. [2025-10-24T00:48:24.596239] [DEBUG] [MAIN ] ENR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:24.628784] [DEBUG] [MAIN ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:24.673669] [DEBUG] [MAIN ] ENS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:24.719746] [INFO ] [MAIN ] ENR: Generated 139 derivative records from 44097 primary records. [2025-10-24T00:48:24.720754] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-24T00:48:24.722124] [FATAL] [LOCAL ] ENR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:24.722526] [FATAL] [MAIN ] ENR: Failed to save derivative data. [2025-10-24T00:48:24.724565] [INFO ] [MAIN ] Derivative Progress: 667/2164 symbols completed. ENR took 1.2s. Estimated remaining: 10m 5s. Rate: 148.5 symbols/min [2025-10-24T00:48:24.726181] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:24.734070] [INFO ] [MAIN ] ENOV: Generated 139 derivative records from 44895 primary records. [2025-10-24T00:48:24.737251] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-24T00:48:24.738832] [FATAL] [LOCAL ] ENOV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:24.741411] [FATAL] [MAIN ] ENOV: Failed to save derivative data. [2025-10-24T00:48:24.744333] [INFO ] [MAIN ] Derivative Progress: 668/2164 symbols completed. ENOV took 1.2s. Estimated remaining: 10m 3s. Rate: 148.7 symbols/min [2025-10-24T00:48:24.744510] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:24.757364] [INFO ] [MAIN ] ENS: Generated 139 derivative records from 29875 primary records. [2025-10-24T00:48:24.757527] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-24T00:48:24.757851] [FATAL] [LOCAL ] ENS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:24.757992] [FATAL] [MAIN ] ENS: Failed to save derivative data. [2025-10-24T00:48:24.761031] [INFO ] [MAIN ] Derivative Progress: 669/2164 symbols completed. ENS took 1.2s. Estimated remaining: 10m 2s. Rate: 148.9 symbols/min [2025-10-24T00:48:24.761372] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:24.775629] [DEBUG] [LOCAL ] ENVA: Loaded 25451 existing records from primary storage. [2025-10-24T00:48:24.775880] [INFO ] [MAIN ] ENVA: Loaded 25451 primary data records. [2025-10-24T00:48:24.817239] [DEBUG] [LOCAL ] EOD: Loaded 14980 existing records from primary storage. [2025-10-24T00:48:24.844415] [INFO ] [MAIN ] EOD: Loaded 14980 primary data records. [2025-10-24T00:48:25.419456] [DEBUG] [LOCAL ] EOG: Loaded 53780 existing records from primary storage. [2025-10-24T00:48:25.420835] [INFO ] [MAIN ] EOG: Loaded 53780 primary data records. [2025-10-24T00:48:25.746892] [DEBUG] [MAIN ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:25.778387] [DEBUG] [MAIN ] EOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:25.832893] [DEBUG] [MAIN ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:25.866872] [INFO ] [MAIN ] ENVA: Generated 139 derivative records from 25451 primary records. [2025-10-24T00:48:25.870061] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-24T00:48:25.870576] [FATAL] [LOCAL ] ENVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:25.873581] [FATAL] [MAIN ] ENVA: Failed to save derivative data. [2025-10-24T00:48:25.876259] [INFO ] [MAIN ] Derivative Progress: 670/2164 symbols completed. ENVA took 1.2s. Estimated remaining: 10m 3s. Rate: 148.6 symbols/min [2025-10-24T00:48:25.876860] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:25.882853] [INFO ] [MAIN ] EOD: Generated 139 derivative records from 14980 primary records. [2025-10-24T00:48:25.885922] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-24T00:48:25.887840] [FATAL] [LOCAL ] EOD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:25.888039] [FATAL] [MAIN ] EOD: Failed to save derivative data. [2025-10-24T00:48:25.893966] [INFO ] [MAIN ] Derivative Progress: 671/2164 symbols completed. EOD took 1.1s. Estimated remaining: 10m 2s. Rate: 148.8 symbols/min [2025-10-24T00:48:25.896814] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:25.905794] [DEBUG] [LOCAL ] EOI: Loaded 10479 existing records from primary storage. [2025-10-24T00:48:25.905443] [INFO ] [MAIN ] EOG: Generated 139 derivative records from 53780 primary records. [2025-10-24T00:48:25.906116] [INFO ] [MAIN ] EOI: Loaded 10479 primary data records. [2025-10-24T00:48:25.906261] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-24T00:48:25.906498] [FATAL] [LOCAL ] EOG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:25.927278] [FATAL] [MAIN ] EOG: Failed to save derivative data. [2025-10-24T00:48:25.940043] [INFO ] [MAIN ] Derivative Progress: 672/2164 symbols completed. EOG took 1.2s. Estimated remaining: 10m 1s. Rate: 149.0 symbols/min [2025-10-24T00:48:25.950012] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:25.995881] [DEBUG] [LOCAL ] EOS: Loaded 14754 existing records from primary storage. [2025-10-24T00:48:26.012154] [INFO ] [MAIN ] EOS: Loaded 14754 primary data records. [2025-10-24T00:48:26.114453] [DEBUG] [LOCAL ] EOT: Loaded 7087 existing records from primary storage. [2025-10-24T00:48:26.157744] [INFO ] [MAIN ] EOT: Loaded 7087 primary data records. [2025-10-24T00:48:26.917583] [DEBUG] [MAIN ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:26.941910] [DEBUG] [MAIN ] EOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:26.982183] [DEBUG] [MAIN ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:27.043191] [INFO ] [MAIN ] EOI: Generated 139 derivative records from 10479 primary records. [2025-10-24T00:48:27.046873] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-24T00:48:27.047270] [FATAL] [LOCAL ] EOI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:27.047586] [FATAL] [MAIN ] EOI: Failed to save derivative data. [2025-10-24T00:48:27.049854] [INFO ] [MAIN ] Derivative Progress: 673/2164 symbols completed. EOI took 1.2s. Estimated remaining: 10m 2s. Rate: 148.6 symbols/min [2025-10-24T00:48:27.059796] [INFO ] [MAIN ] EOS: Generated 139 derivative records from 14754 primary records. [2025-10-24T00:48:27.061921] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-24T00:48:27.061803] [INFO ] [MAIN ] EOT: Generated 139 derivative records from 7087 primary records. [2025-10-24T00:48:27.062375] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-24T00:48:27.062292] [FATAL] [LOCAL ] EOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:27.062677] [FATAL] [LOCAL ] EOT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:27.062960] [FATAL] [MAIN ] EOT: Failed to save derivative data. [2025-10-24T00:48:27.062856] [FATAL] [MAIN ] EOS: Failed to save derivative data. [2025-10-24T00:48:27.065965] [INFO ] [MAIN ] Derivative Progress: 674/2164 symbols completed. EOT took 1.1s. Estimated remaining: 10m 1s. Rate: 148.8 symbols/min [2025-10-24T00:48:27.068829] [INFO ] [MAIN ] Derivative Progress: 675/2164 symbols completed. EOS took 1.2s. Estimated remaining: 9m 60s. Rate: 149.0 symbols/min [2025-10-24T00:48:27.069245] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:27.069378] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:27.069463] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:27.113613] [DEBUG] [LOCAL ] EPAC: Loaded 26571 existing records from primary storage. [2025-10-24T00:48:27.113869] [INFO ] [MAIN ] EPAC: Loaded 26571 primary data records. [2025-10-24T00:48:27.239389] [DEBUG] [LOCAL ] EPC: Loaded 40003 existing records from primary storage. [2025-10-24T00:48:27.240217] [DEBUG] [LOCAL ] EPAM: Loaded 39611 existing records from primary storage. [2025-10-24T00:48:27.256357] [INFO ] [MAIN ] EPAM: Loaded 39611 primary data records. [2025-10-24T00:48:27.240303] [INFO ] [MAIN ] EPC: Loaded 40003 primary data records. [2025-10-24T00:48:28.071990] [DEBUG] [MAIN ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:28.110163] [DEBUG] [MAIN ] EPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:28.140501] [DEBUG] [MAIN ] EPAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:28.189664] [INFO ] [MAIN ] EPAC: Generated 139 derivative records from 26571 primary records. [2025-10-24T00:48:28.190445] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-24T00:48:28.193030] [FATAL] [LOCAL ] EPAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:28.193542] [FATAL] [MAIN ] EPAC: Failed to save derivative data. [2025-10-24T00:48:28.195558] [INFO ] [MAIN ] Derivative Progress: 676/2164 symbols completed. EPAC took 1.1s. Estimated remaining: 10m 1s. Rate: 148.6 symbols/min [2025-10-24T00:48:28.195962] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:28.211921] [INFO ] [MAIN ] EPAM: Generated 139 derivative records from 39611 primary records. [2025-10-24T00:48:28.213710] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-24T00:48:28.216334] [INFO ] [MAIN ] EPC: Generated 139 derivative records from 40003 primary records. [2025-10-24T00:48:28.216433] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-24T00:48:28.216701] [FATAL] [LOCAL ] EPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:28.216783] [FATAL] [MAIN ] EPC: Failed to save derivative data. [2025-10-24T00:48:28.215730] [FATAL] [LOCAL ] EPAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:28.221462] [FATAL] [MAIN ] EPAM: Failed to save derivative data. [2025-10-24T00:48:28.221158] [INFO ] [MAIN ] Derivative Progress: 677/2164 symbols completed. EPC took 1.2s. Estimated remaining: 9m 60s. Rate: 148.8 symbols/min [2025-10-24T00:48:28.224056] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:28.224192] [INFO ] [MAIN ] Derivative Progress: 678/2164 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 58s. Rate: 149.0 symbols/min [2025-10-24T00:48:28.224907] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:28.251812] [DEBUG] [LOCAL ] EQBK: Loaded 11385 existing records from primary storage. [2025-10-24T00:48:28.251978] [INFO ] [MAIN ] EQBK: Loaded 11385 primary data records. [2025-10-24T00:48:28.382835] [DEBUG] [LOCAL ] EPD: Loaded 53998 existing records from primary storage. [2025-10-24T00:48:28.394001] [INFO ] [MAIN ] EPD: Loaded 53998 primary data records. [2025-10-24T00:48:28.722598] [DEBUG] [LOCAL ] EPRT: Loaded 48861 existing records from primary storage. [2025-10-24T00:48:28.734233] [INFO ] [MAIN ] EPRT: Loaded 48861 primary data records. [2025-10-24T00:48:29.251831] [DEBUG] [MAIN ] EQBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:29.285411] [DEBUG] [MAIN ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:29.336699] [DEBUG] [MAIN ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:29.367329] [INFO ] [MAIN ] EQBK: Generated 139 derivative records from 11385 primary records. [2025-10-24T00:48:29.373125] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-24T00:48:29.374892] [FATAL] [LOCAL ] EQBK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:29.376379] [FATAL] [MAIN ] EQBK: Failed to save derivative data. [2025-10-24T00:48:29.379234] [INFO ] [MAIN ] Derivative Progress: 679/2164 symbols completed. EQBK took 1.2s. Estimated remaining: 9m 59s. Rate: 148.6 symbols/min [2025-10-24T00:48:29.382249] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:29.390145] [INFO ] [MAIN ] EPD: Generated 139 derivative records from 53998 primary records. [2025-10-24T00:48:29.391872] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-24T00:48:29.392108] [FATAL] [LOCAL ] EPD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:29.394859] [FATAL] [MAIN ] EPD: Failed to save derivative data. [2025-10-24T00:48:29.397512] [INFO ] [MAIN ] Derivative Progress: 680/2164 symbols completed. EPD took 1.2s. Estimated remaining: 9m 58s. Rate: 148.8 symbols/min [2025-10-24T00:48:29.398996] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:29.405540] [INFO ] [MAIN ] EPRT: Generated 139 derivative records from 48861 primary records. [2025-10-24T00:48:29.405875] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-24T00:48:29.406266] [FATAL] [LOCAL ] EPRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:29.406388] [FATAL] [MAIN ] EPRT: Failed to save derivative data. [2025-10-24T00:48:29.409052] [INFO ] [MAIN ] Derivative Progress: 681/2164 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 57s. Rate: 149.0 symbols/min [2025-10-24T00:48:29.409319] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:29.457913] [DEBUG] [LOCAL ] EQH: Loaded 53065 existing records from primary storage. [2025-10-24T00:48:29.458295] [INFO ] [MAIN ] EQH: Loaded 53065 primary data records. [2025-10-24T00:48:29.597918] [DEBUG] [LOCAL ] EQNR: Loaded 53437 existing records from primary storage. [2025-10-24T00:48:29.628396] [INFO ] [MAIN ] EQNR: Loaded 53437 primary data records. [2025-10-24T00:48:29.658749] [DEBUG] [LOCAL ] EQR: Loaded 52192 existing records from primary storage. [2025-10-24T00:48:29.793594] [INFO ] [MAIN ] EQR: Loaded 52192 primary data records. [2025-10-24T00:48:30.525950] [DEBUG] [MAIN ] EQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:30.567218] [DEBUG] [MAIN ] EQNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:30.608468] [DEBUG] [MAIN ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:30.657615] [INFO ] [MAIN ] EQH: Generated 139 derivative records from 53065 primary records. [2025-10-24T00:48:30.658410] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-24T00:48:30.662548] [FATAL] [LOCAL ] EQH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:30.666467] [FATAL] [MAIN ] EQH: Failed to save derivative data. [2025-10-24T00:48:30.670038] [INFO ] [MAIN ] Derivative Progress: 682/2164 symbols completed. EQH took 1.3s. Estimated remaining: 9m 58s. Rate: 148.6 symbols/min [2025-10-24T00:48:30.672177] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:30.688366] [INFO ] [MAIN ] EQR: Generated 139 derivative records from 52192 primary records. [2025-10-24T00:48:30.688960] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-24T00:48:30.691594] [FATAL] [LOCAL ] EQR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:30.691086] [INFO ] [MAIN ] EQNR: Generated 139 derivative records from 53437 primary records. [2025-10-24T00:48:30.691785] [FATAL] [MAIN ] EQR: Failed to save derivative data. [2025-10-24T00:48:30.696281] [INFO ] [MAIN ] Derivative Progress: 683/2164 symbols completed. EQR took 1.3s. Estimated remaining: 9m 57s. Rate: 148.8 symbols/min [2025-10-24T00:48:30.696523] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-24T00:48:30.696682] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:30.697424] [FATAL] [LOCAL ] EQNR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:30.697532] [FATAL] [MAIN ] EQNR: Failed to save derivative data. [2025-10-24T00:48:30.701573] [INFO ] [MAIN ] Derivative Progress: 684/2164 symbols completed. EQNR took 1.3s. Estimated remaining: 9m 56s. Rate: 149.0 symbols/min [2025-10-24T00:48:30.702118] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:30.707854] [DEBUG] [LOCAL ] EQV: Loaded 2771 existing records from primary storage. [2025-10-24T00:48:30.708135] [INFO ] [MAIN ] EQV: Loaded 2771 primary data records. [2025-10-24T00:48:30.931893] [DEBUG] [LOCAL ] EQT: Loaded 54075 existing records from primary storage. [2025-10-24T00:48:31.047551] [INFO ] [MAIN ] EQT: Loaded 54075 primary data records. [2025-10-24T00:48:31.076990] [DEBUG] [LOCAL ] ERJ: Loaded 50666 existing records from primary storage. [2025-10-24T00:48:31.100074] [INFO ] [MAIN ] ERJ: Loaded 50666 primary data records. [2025-10-24T00:48:31.710612] [DEBUG] [MAIN ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:31.762437] [DEBUG] [MAIN ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:31.795848] [DEBUG] [MAIN ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:31.815001] [INFO ] [MAIN ] EQV: Generated 139 derivative records from 2771 primary records. [2025-10-24T00:48:31.817459] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-24T00:48:31.820512] [FATAL] [LOCAL ] EQV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:31.821101] [FATAL] [MAIN ] EQV: Failed to save derivative data. [2025-10-24T00:48:31.823821] [INFO ] [MAIN ] Derivative Progress: 685/2164 symbols completed. EQV took 1.1s. Estimated remaining: 9m 57s. Rate: 148.6 symbols/min [2025-10-24T00:48:31.825855] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:31.857680] [INFO ] [MAIN ] EQT: Generated 139 derivative records from 54075 primary records. [2025-10-24T00:48:31.858372] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-24T00:48:31.858627] [FATAL] [LOCAL ] EQT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:31.861047] [FATAL] [MAIN ] EQT: Failed to save derivative data. [2025-10-24T00:48:31.863934] [INFO ] [MAIN ] Derivative Progress: 686/2164 symbols completed. EQT took 1.2s. Estimated remaining: 9m 56s. Rate: 148.8 symbols/min [2025-10-24T00:48:31.874616] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:31.879315] [INFO ] [MAIN ] ERJ: Generated 139 derivative records from 50666 primary records. [2025-10-24T00:48:31.879524] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-24T00:48:31.879779] [FATAL] [LOCAL ] ERJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:31.879906] [FATAL] [MAIN ] ERJ: Failed to save derivative data. [2025-10-24T00:48:31.882489] [INFO ] [MAIN ] Derivative Progress: 687/2164 symbols completed. ERJ took 1.2s. Estimated remaining: 9m 55s. Rate: 149.0 symbols/min [2025-10-24T00:48:31.882792] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:31.897509] [DEBUG] [LOCAL ] ERO: Loaded 42461 existing records from primary storage. [2025-10-24T00:48:31.897837] [INFO ] [MAIN ] ERO: Loaded 42461 primary data records. [2025-10-24T00:48:32.032502] [DEBUG] [LOCAL ] ESAB: Loaded 26116 existing records from primary storage. [2025-10-24T00:48:32.012990] [DEBUG] [LOCAL ] ESE: Loaded 16534 existing records from primary storage. [2025-10-24T00:48:32.032787] [INFO ] [MAIN ] ESAB: Loaded 26116 primary data records. [2025-10-24T00:48:32.033359] [INFO ] [MAIN ] ESE: Loaded 16534 primary data records. [2025-10-24T00:48:32.927724] [DEBUG] [MAIN ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:32.976196] [DEBUG] [MAIN ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:32.994974] [DEBUG] [MAIN ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:33.050853] [INFO ] [MAIN ] ERO: Generated 139 derivative records from 42461 primary records. [2025-10-24T00:48:33.052761] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-24T00:48:33.058126] [FATAL] [LOCAL ] ERO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:33.058299] [FATAL] [MAIN ] ERO: Failed to save derivative data. [2025-10-24T00:48:33.060629] [INFO ] [MAIN ] Derivative Progress: 688/2164 symbols completed. ERO took 1.2s. Estimated remaining: 9m 56s. Rate: 148.6 symbols/min [2025-10-24T00:48:33.069608] [INFO ] [MAIN ] ESAB: Generated 139 derivative records from 26116 primary records. [2025-10-24T00:48:33.069862] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-24T00:48:33.071666] [FATAL] [LOCAL ] ESAB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:33.074085] [FATAL] [MAIN ] ESAB: Failed to save derivative data. [2025-10-24T00:48:33.076626] [INFO ] [MAIN ] Derivative Progress: 689/2164 symbols completed. ESAB took 1.2s. Estimated remaining: 9m 55s. Rate: 148.8 symbols/min [2025-10-24T00:48:33.080412] [INFO ] [MAIN ] ESE: Generated 139 derivative records from 16534 primary records. [2025-10-24T00:48:33.080502] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-24T00:48:33.080739] [FATAL] [LOCAL ] ESE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:33.080820] [FATAL] [MAIN ] ESE: Failed to save derivative data. [2025-10-24T00:48:33.083771] [INFO ] [MAIN ] Derivative Progress: 690/2164 symbols completed. ESE took 1.2s. Estimated remaining: 9m 53s. Rate: 149.0 symbols/min [2025-10-24T00:48:33.084184] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:33.084231] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:33.084272] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:33.145702] [DEBUG] [LOCAL ] ESNT: Loaded 38188 existing records from primary storage. [2025-10-24T00:48:33.146202] [INFO ] [MAIN ] ESNT: Loaded 38188 primary data records. [2025-10-24T00:48:33.284086] [DEBUG] [LOCAL ] ESI: Loaded 51006 existing records from primary storage. [2025-10-24T00:48:33.285281] [INFO ] [MAIN ] ESI: Loaded 51006 primary data records. [2025-10-24T00:48:33.284718] [DEBUG] [LOCAL ] ESRT: Loaded 46911 existing records from primary storage. [2025-10-24T00:48:33.295808] [INFO ] [MAIN ] ESRT: Loaded 46911 primary data records. [2025-10-24T00:48:34.093663] [DEBUG] [MAIN ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:34.142169] [DEBUG] [MAIN ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:34.169377] [DEBUG] [MAIN ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:34.200470] [INFO ] [MAIN ] ESNT: Generated 139 derivative records from 38188 primary records. [2025-10-24T00:48:34.202367] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-24T00:48:34.204137] [FATAL] [LOCAL ] ESNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:34.204604] [FATAL] [MAIN ] ESNT: Failed to save derivative data. [2025-10-24T00:48:34.211630] [INFO ] [MAIN ] Derivative Progress: 691/2164 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 55s. Rate: 148.6 symbols/min [2025-10-24T00:48:34.212215] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:34.233622] [INFO ] [MAIN ] ESRT: Generated 139 derivative records from 46911 primary records. [2025-10-24T00:48:34.237124] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-24T00:48:34.240940] [FATAL] [LOCAL ] ESRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:34.249208] [FATAL] [MAIN ] ESRT: Failed to save derivative data. [2025-10-24T00:48:34.240623] [INFO ] [MAIN ] ESI: Generated 139 derivative records from 51006 primary records. [2025-10-24T00:48:34.249374] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-24T00:48:34.249739] [FATAL] [LOCAL ] ESI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:34.252282] [INFO ] [MAIN ] Derivative Progress: 692/2164 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 53s. Rate: 148.8 symbols/min [2025-10-24T00:48:34.252542] [FATAL] [MAIN ] ESI: Failed to save derivative data. [2025-10-24T00:48:34.255582] [INFO ] [MAIN ] Derivative Progress: 693/2164 symbols completed. ESI took 1.2s. Estimated remaining: 9m 52s. Rate: 149.0 symbols/min [2025-10-24T00:48:34.252710] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:34.255827] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:34.268526] [DEBUG] [LOCAL ] ESS: Loaded 30386 existing records from primary storage. [2025-10-24T00:48:34.268720] [INFO ] [MAIN ] ESS: Loaded 30386 primary data records. [2025-10-24T00:48:34.655893] [DEBUG] [LOCAL ] ESTC: Loaded 50579 existing records from primary storage. [2025-10-24T00:48:34.656703] [INFO ] [MAIN ] ESTC: Loaded 50579 primary data records. [2025-10-24T00:48:34.778090] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-24T00:48:34.816291] [INFO ] [MAIN ] ET: Loaded 54179 primary data records. [2025-10-24T00:48:35.298631] [DEBUG] [MAIN ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:35.345058] [DEBUG] [MAIN ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:35.389721] [DEBUG] [MAIN ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:35.412619] [INFO ] [MAIN ] ESS: Generated 139 derivative records from 30386 primary records. [2025-10-24T00:48:35.416101] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-24T00:48:35.416436] [FATAL] [LOCAL ] ESS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:35.419293] [FATAL] [MAIN ] ESS: Failed to save derivative data. [2025-10-24T00:48:35.424753] [INFO ] [MAIN ] Derivative Progress: 694/2164 symbols completed. ESS took 1.2s. Estimated remaining: 9m 53s. Rate: 148.6 symbols/min [2025-10-24T00:48:35.426211] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:35.443355] [INFO ] [MAIN ] ESTC: Generated 139 derivative records from 50579 primary records. [2025-10-24T00:48:35.446313] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-24T00:48:35.451328] [FATAL] [LOCAL ] ESTC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:35.452778] [FATAL] [MAIN ] ESTC: Failed to save derivative data. [2025-10-24T00:48:35.451676] [DEBUG] [LOCAL ] ETB: Loaded 11826 existing records from primary storage. [2025-10-24T00:48:35.455379] [INFO ] [MAIN ] Derivative Progress: 695/2164 symbols completed. ESTC took 1.2s. Estimated remaining: 9m 52s. Rate: 148.8 symbols/min [2025-10-24T00:48:35.458443] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:35.455615] [INFO ] [MAIN ] ETB: Loaded 11826 primary data records. [2025-10-24T00:48:35.526632] [INFO ] [MAIN ] ET: Generated 139 derivative records from 54179 primary records. [2025-10-24T00:48:35.526793] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-24T00:48:35.527010] [FATAL] [LOCAL ] ET: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:35.532420] [FATAL] [MAIN ] ET: Failed to save derivative data. [2025-10-24T00:48:35.555442] [INFO ] [MAIN ] Derivative Progress: 696/2164 symbols completed. ET took 1.3s. Estimated remaining: 9m 51s. Rate: 149.0 symbols/min [2025-10-24T00:48:35.555845] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:35.660352] [DEBUG] [LOCAL ] ETD: Loaded 27262 existing records from primary storage. [2025-10-24T00:48:35.662946] [INFO ] [MAIN ] ETD: Loaded 27262 primary data records. [2025-10-24T00:48:35.721458] [DEBUG] [LOCAL ] ETG: Loaded 16587 existing records from primary storage. [2025-10-24T00:48:35.876376] [INFO ] [MAIN ] ETG: Loaded 16587 primary data records. [2025-10-24T00:48:36.488571] [DEBUG] [MAIN ] ETB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:36.528278] [DEBUG] [MAIN ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:36.561043] [DEBUG] [MAIN ] ETG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:36.599152] [INFO ] [MAIN ] ETB: Generated 139 derivative records from 11826 primary records. [2025-10-24T00:48:36.600368] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-24T00:48:36.600821] [FATAL] [LOCAL ] ETB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:36.601126] [FATAL] [MAIN ] ETB: Failed to save derivative data. [2025-10-24T00:48:36.605272] [INFO ] [MAIN ] Derivative Progress: 697/2164 symbols completed. ETB took 1.2s. Estimated remaining: 9m 52s. Rate: 148.6 symbols/min [2025-10-24T00:48:36.605875] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:36.629160] [INFO ] [MAIN ] ETD: Generated 139 derivative records from 27262 primary records. [2025-10-24T00:48:36.631205] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-24T00:48:36.631443] [FATAL] [LOCAL ] ETD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:36.631579] [FATAL] [MAIN ] ETD: Failed to save derivative data. [2025-10-24T00:48:36.633884] [INFO ] [MAIN ] Derivative Progress: 698/2164 symbols completed. ETD took 1.2s. Estimated remaining: 9m 51s. Rate: 148.8 symbols/min [2025-10-24T00:48:36.640425] [INFO ] [MAIN ] ETG: Generated 139 derivative records from 16587 primary records. [2025-10-24T00:48:36.639700] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:36.641111] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-24T00:48:36.640837] [DEBUG] [LOCAL ] ETJ: Loaded 16510 existing records from primary storage. [2025-10-24T00:48:36.641384] [INFO ] [MAIN ] ETJ: Loaded 16510 primary data records. [2025-10-24T00:48:36.641696] [FATAL] [LOCAL ] ETG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:36.641884] [FATAL] [MAIN ] ETG: Failed to save derivative data. [2025-10-24T00:48:36.656132] [INFO ] [MAIN ] Derivative Progress: 699/2164 symbols completed. ETG took 1.1s. Estimated remaining: 9m 50s. Rate: 149.0 symbols/min [2025-10-24T00:48:36.656435] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:36.749724] [DEBUG] [LOCAL ] ETO: Loaded 6917 existing records from primary storage. [2025-10-24T00:48:36.753439] [INFO ] [MAIN ] ETO: Loaded 6917 primary data records. [2025-10-24T00:48:37.265569] [DEBUG] [LOCAL ] ETN: Loaded 52954 existing records from primary storage. [2025-10-24T00:48:37.266046] [INFO ] [MAIN ] ETN: Loaded 52954 primary data records. [2025-10-24T00:48:37.581348] [DEBUG] [MAIN ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:37.615036] [DEBUG] [MAIN ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:37.672132] [DEBUG] [MAIN ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:37.696786] [INFO ] [MAIN ] ETJ: Generated 139 derivative records from 16510 primary records. [2025-10-24T00:48:37.699263] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-24T00:48:37.702602] [FATAL] [LOCAL ] ETJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:37.703098] [FATAL] [MAIN ] ETJ: Failed to save derivative data. [2025-10-24T00:48:37.707284] [INFO ] [MAIN ] Derivative Progress: 700/2164 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 51s. Rate: 148.7 symbols/min [2025-10-24T00:48:37.709429] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:37.715161] [INFO ] [MAIN ] ETO: Generated 139 derivative records from 6917 primary records. [2025-10-24T00:48:37.715917] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-24T00:48:37.716219] [FATAL] [LOCAL ] ETO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:37.717274] [FATAL] [MAIN ] ETO: Failed to save derivative data. [2025-10-24T00:48:37.719848] [INFO ] [MAIN ] Derivative Progress: 701/2164 symbols completed. ETO took 1.1s. Estimated remaining: 9m 49s. Rate: 148.9 symbols/min [2025-10-24T00:48:37.720469] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:37.729740] [INFO ] [MAIN ] ETN: Generated 139 derivative records from 52954 primary records. [2025-10-24T00:48:37.730033] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-24T00:48:37.730416] [FATAL] [LOCAL ] ETN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:37.730709] [FATAL] [MAIN ] ETN: Failed to save derivative data. [2025-10-24T00:48:37.733089] [INFO ] [MAIN ] Derivative Progress: 702/2164 symbols completed. ETN took 1.1s. Estimated remaining: 9m 48s. Rate: 149.1 symbols/min [2025-10-24T00:48:37.733437] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:37.793708] [DEBUG] [LOCAL ] ETV: Loaded 21947 existing records from primary storage. [2025-10-24T00:48:37.793917] [INFO ] [MAIN ] ETV: Loaded 21947 primary data records. [2025-10-24T00:48:37.794694] [DEBUG] [LOCAL ] ETR: Loaded 53572 existing records from primary storage. [2025-10-24T00:48:37.800262] [INFO ] [MAIN ] ETR: Loaded 53572 primary data records. [2025-10-24T00:48:37.979133] [DEBUG] [LOCAL ] ETSY: Loaded 53952 existing records from primary storage. [2025-10-24T00:48:38.016439] [INFO ] [MAIN ] ETSY: Loaded 53952 primary data records. [2025-10-24T00:48:38.778766] [DEBUG] [MAIN ] ETV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:38.806903] [DEBUG] [MAIN ] ETR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:38.833082] [DEBUG] [MAIN ] ETSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:38.912097] [INFO ] [MAIN ] ETV: Generated 139 derivative records from 21947 primary records. [2025-10-24T00:48:38.914588] [INFO ] [MAIN ] ETSY: Generated 139 derivative records from 53952 primary records. [2025-10-24T00:48:38.916812] [INFO ] [MAIN ] ETR: Generated 139 derivative records from 53572 primary records. [2025-10-24T00:48:38.917003] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-24T00:48:38.917511] [FATAL] [LOCAL ] ETV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:38.917176] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-24T00:48:38.917740] [FATAL] [MAIN ] ETV: Failed to save derivative data. [2025-10-24T00:48:38.919888] [FATAL] [LOCAL ] ETR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:38.920038] [FATAL] [MAIN ] ETR: Failed to save derivative data. [2025-10-24T00:48:38.920157] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-24T00:48:38.919608] [INFO ] [MAIN ] Derivative Progress: 703/2164 symbols completed. ETV took 1.2s. Estimated remaining: 9m 49s. Rate: 148.7 symbols/min [2025-10-24T00:48:38.923028] [FATAL] [LOCAL ] ETSY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:38.923248] [INFO ] [MAIN ] Derivative Progress: 704/2164 symbols completed. ETR took 1.2s. Estimated remaining: 9m 48s. Rate: 148.9 symbols/min [2025-10-24T00:48:38.923379] [FATAL] [MAIN ] ETSY: Failed to save derivative data. [2025-10-24T00:48:38.926514] [INFO ] [MAIN ] Derivative Progress: 705/2164 symbols completed. ETSY took 1.2s. Estimated remaining: 9m 47s. Rate: 149.1 symbols/min [2025-10-24T00:48:38.926958] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:38.927134] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:38.927054] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:38.937267] [DEBUG] [LOCAL ] ETX: Loaded 5361 existing records from primary storage. [2025-10-24T00:48:38.937752] [INFO ] [MAIN ] ETX: Loaded 5361 primary data records. [2025-10-24T00:48:39.080264] [DEBUG] [LOCAL ] ETW: Loaded 25243 existing records from primary storage. [2025-10-24T00:48:39.127732] [INFO ] [MAIN ] ETW: Loaded 25243 primary data records. [2025-10-24T00:48:39.130324] [DEBUG] [LOCAL ] ETY: Loaded 22481 existing records from primary storage. [2025-10-24T00:48:39.149836] [INFO ] [MAIN ] ETY: Loaded 22481 primary data records. [2025-10-24T00:48:39.970928] [DEBUG] [MAIN ] ETX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:40.027441] [DEBUG] [MAIN ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:40.043513] [DEBUG] [MAIN ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:40.091275] [INFO ] [MAIN ] ETX: Generated 139 derivative records from 5361 primary records. [2025-10-24T00:48:40.095212] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-24T00:48:40.098626] [FATAL] [LOCAL ] ETX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:40.102718] [FATAL] [MAIN ] ETX: Failed to save derivative data. [2025-10-24T00:48:40.105122] [INFO ] [MAIN ] Derivative Progress: 706/2164 symbols completed. ETX took 1.2s. Estimated remaining: 9m 48s. Rate: 148.7 symbols/min [2025-10-24T00:48:40.105846] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:40.129410] [INFO ] [MAIN ] ETY: Generated 139 derivative records from 22481 primary records. [2025-10-24T00:48:40.131428] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-24T00:48:40.131771] [FATAL] [LOCAL ] ETY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:40.131926] [FATAL] [MAIN ] ETY: Failed to save derivative data. [2025-10-24T00:48:40.134911] [INFO ] [MAIN ] Derivative Progress: 707/2164 symbols completed. ETY took 1.2s. Estimated remaining: 9m 47s. Rate: 148.9 symbols/min [2025-10-24T00:48:40.142963] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:40.142825] [INFO ] [MAIN ] ETW: Generated 139 derivative records from 25243 primary records. [2025-10-24T00:48:40.143387] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-24T00:48:40.144599] [FATAL] [LOCAL ] ETW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:40.144715] [FATAL] [MAIN ] ETW: Failed to save derivative data. [2025-10-24T00:48:40.147169] [INFO ] [MAIN ] Derivative Progress: 708/2164 symbols completed. ETW took 1.2s. Estimated remaining: 9m 46s. Rate: 149.1 symbols/min [2025-10-24T00:48:40.147490] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:40.148365] [DEBUG] [LOCAL ] EVC: Loaded 17929 existing records from primary storage. [2025-10-24T00:48:40.149246] [INFO ] [MAIN ] EVC: Loaded 17929 primary data records. [2025-10-24T00:48:40.261485] [DEBUG] [LOCAL ] EVF: Loaded 9771 existing records from primary storage. [2025-10-24T00:48:40.270220] [INFO ] [MAIN ] EVF: Loaded 9771 primary data records. [2025-10-24T00:48:40.449977] [DEBUG] [LOCAL ] EVEX: Loaded 33354 existing records from primary storage. [2025-10-24T00:48:40.593796] [INFO ] [MAIN ] EVEX: Loaded 33354 primary data records. [2025-10-24T00:48:41.208673] [DEBUG] [MAIN ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:41.251205] [DEBUG] [MAIN ] EVF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:48:41.286696] [DEBUG] [MAIN ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:41.328277] [INFO ] [MAIN ] EVC: Generated 139 derivative records from 17929 primary records. [2025-10-24T00:48:41.328770] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-24T00:48:41.330529] [FATAL] [LOCAL ] EVC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:41.335715] [FATAL] [MAIN ] EVC: Failed to save derivative data. [2025-10-24T00:48:41.340865] [INFO ] [MAIN ] Derivative Progress: 709/2164 symbols completed. EVC took 1.2s. Estimated remaining: 9m 47s. Rate: 148.7 symbols/min [2025-10-24T00:48:41.344600] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:41.357100] [INFO ] [MAIN ] EVF: Generated 139 derivative records from 9771 primary records. [2025-10-24T00:48:41.358721] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-24T00:48:41.359135] [FATAL] [LOCAL ] EVF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:41.363739] [DEBUG] [LOCAL ] EVG: Loaded 5779 existing records from primary storage. [2025-10-24T00:48:41.364018] [INFO ] [MAIN ] EVEX: Generated 139 derivative records from 33354 primary records. [2025-10-24T00:48:41.364168] [INFO ] [MAIN ] EVG: Loaded 5779 primary data records. [2025-10-24T00:48:41.364335] [FATAL] [MAIN ] EVF: Failed to save derivative data. [2025-10-24T00:48:41.388539] [INFO ] [MAIN ] Derivative Progress: 710/2164 symbols completed. EVF took 1.2s. Estimated remaining: 9m 46s. Rate: 148.9 symbols/min [2025-10-24T00:48:41.364254] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-24T00:48:41.437596] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:41.437951] [FATAL] [LOCAL ] EVEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:41.462249] [FATAL] [MAIN ] EVEX: Failed to save derivative data. [2025-10-24T00:48:41.476594] [INFO ] [MAIN ] Derivative Progress: 711/2164 symbols completed. EVEX took 1.3s. Estimated remaining: 9m 45s. Rate: 149.1 symbols/min [2025-10-24T00:48:41.493339] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:41.707811] [DEBUG] [LOCAL ] EVN: Loaded 10894 existing records from primary storage. [2025-10-24T00:48:41.708248] [INFO ] [MAIN ] EVN: Loaded 10894 primary data records. [2025-10-24T00:48:41.806055] [DEBUG] [LOCAL ] EVH: Loaded 49979 existing records from primary storage. [2025-10-24T00:48:41.829986] [INFO ] [MAIN ] EVH: Loaded 49979 primary data records. [2025-10-24T00:48:41.948085] [DEBUG] [MAIN ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:42.416603] [INFO ] [MAIN ] EVG: Generated 139 derivative records from 5779 primary records. [2025-10-24T00:48:42.419401] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-24T00:48:42.421156] [FATAL] [LOCAL ] EVG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:42.421556] [FATAL] [MAIN ] EVG: Failed to save derivative data. [2025-10-24T00:48:42.423792] [INFO ] [MAIN ] Derivative Progress: 712/2164 symbols completed. EVG took 1.1s. Estimated remaining: 9m 46s. Rate: 148.8 symbols/min [2025-10-24T00:48:42.423951] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:42.438271] [DEBUG] [MAIN ] EVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:42.494395] [DEBUG] [MAIN ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:42.568167] [DEBUG] [LOCAL ] EVR: Loaded 33793 existing records from primary storage. [2025-10-24T00:48:42.570339] [INFO ] [MAIN ] EVR: Loaded 33793 primary data records. [2025-10-24T00:48:42.593555] [INFO ] [MAIN ] EVN: Generated 139 derivative records from 10894 primary records. [2025-10-24T00:48:42.617767] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-24T00:48:42.655502] [FATAL] [LOCAL ] EVN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:42.666400] [FATAL] [MAIN ] EVN: Failed to save derivative data. [2025-10-24T00:48:42.679906] [INFO ] [MAIN ] Derivative Progress: 713/2164 symbols completed. EVN took 1.2s. Estimated remaining: 9m 45s. Rate: 148.8 symbols/min [2025-10-24T00:48:42.683596] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:42.905130] [DEBUG] [LOCAL ] EVT: Loaded 16606 existing records from primary storage. [2025-10-24T00:48:42.907756] [INFO ] [MAIN ] EVT: Loaded 16606 primary data records. [2025-10-24T00:48:42.922863] [INFO ] [MAIN ] EVH: Generated 139 derivative records from 49979 primary records. [2025-10-24T00:48:42.976287] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-24T00:48:42.982602] [FATAL] [LOCAL ] EVH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:43.000021] [FATAL] [MAIN ] EVH: Failed to save derivative data. [2025-10-24T00:48:43.009348] [INFO ] [MAIN ] Derivative Progress: 714/2164 symbols completed. EVH took 1.6s. Estimated remaining: 9m 44s. Rate: 148.9 symbols/min [2025-10-24T00:48:43.017318] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:43.243583] [DEBUG] [MAIN ] EVR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:48:43.273960] [DEBUG] [LOCAL ] EVTC: Loaded 26985 existing records from primary storage. [2025-10-24T00:48:43.275385] [INFO ] [MAIN ] EVTC: Loaded 26985 primary data records. [2025-10-24T00:48:43.603133] [DEBUG] [MAIN ] EVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:43.623150] [INFO ] [MAIN ] EVR: Generated 139 derivative records from 33793 primary records. [2025-10-24T00:48:43.625546] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-24T00:48:43.625930] [FATAL] [LOCAL ] EVR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:43.626037] [FATAL] [MAIN ] EVR: Failed to save derivative data. [2025-10-24T00:48:43.630953] [INFO ] [MAIN ] Derivative Progress: 715/2164 symbols completed. EVR took 1.2s. Estimated remaining: 9m 44s. Rate: 148.8 symbols/min [2025-10-24T00:48:43.631301] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:43.680030] [INFO ] [MAIN ] EVT: Generated 139 derivative records from 16606 primary records. [2025-10-24T00:48:43.680719] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-24T00:48:43.681022] [FATAL] [LOCAL ] EVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:43.680399] [DEBUG] [MAIN ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:43.693001] [FATAL] [MAIN ] EVT: Failed to save derivative data. [2025-10-24T00:48:43.698062] [INFO ] [MAIN ] Derivative Progress: 716/2164 symbols completed. EVT took 1.0s. Estimated remaining: 9m 43s. Rate: 148.9 symbols/min [2025-10-24T00:48:43.713007] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:43.719623] [DEBUG] [LOCAL ] EVTL: Loaded 41735 existing records from primary storage. [2025-10-24T00:48:43.721407] [INFO ] [MAIN ] EVTL: Loaded 41735 primary data records. [2025-10-24T00:48:43.904873] [DEBUG] [LOCAL ] EVTR: Loaded 25689 existing records from primary storage. [2025-10-24T00:48:44.048427] [INFO ] [MAIN ] EVTR: Loaded 25689 primary data records. [2025-10-24T00:48:44.139812] [INFO ] [MAIN ] EVTC: Generated 139 derivative records from 26985 primary records. [2025-10-24T00:48:44.140134] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-24T00:48:44.140386] [FATAL] [LOCAL ] EVTC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:44.145702] [FATAL] [MAIN ] EVTC: Failed to save derivative data. [2025-10-24T00:48:44.159776] [INFO ] [MAIN ] Derivative Progress: 717/2164 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 43s. Rate: 148.9 symbols/min [2025-10-24T00:48:44.166284] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:44.390306] [DEBUG] [MAIN ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:44.457156] [DEBUG] [LOCAL ] EW: Loaded 53780 existing records from primary storage. [2025-10-24T00:48:44.459313] [INFO ] [MAIN ] EW: Loaded 53780 primary data records. [2025-10-24T00:48:44.495349] [DEBUG] [MAIN ] EVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:44.629287] [INFO ] [MAIN ] EVTL: Generated 139 derivative records from 41735 primary records. [2025-10-24T00:48:44.689432] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-24T00:48:44.866927] [FATAL] [LOCAL ] EVTL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:44.867369] [FATAL] [MAIN ] EVTL: Failed to save derivative data. [2025-10-24T00:48:44.869993] [INFO ] [MAIN ] Derivative Progress: 718/2164 symbols completed. EVTL took 1.2s. Estimated remaining: 9m 43s. Rate: 148.8 symbols/min [2025-10-24T00:48:44.888909] [INFO ] [MAIN ] EVTR: Generated 139 derivative records from 25689 primary records. [2025-10-24T00:48:44.889055] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-24T00:48:44.889289] [FATAL] [LOCAL ] EVTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:44.889600] [FATAL] [MAIN ] EVTR: Failed to save derivative data. [2025-10-24T00:48:44.892042] [INFO ] [MAIN ] Derivative Progress: 719/2164 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 42s. Rate: 149.0 symbols/min [2025-10-24T00:48:44.908326] [DEBUG] [MAIN ] EW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:44.934002] [INFO ] [MAIN ] EW: Generated 139 derivative records from 53780 primary records. [2025-10-24T00:48:44.934118] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-24T00:48:44.934307] [FATAL] [LOCAL ] EW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:44.934384] [FATAL] [MAIN ] EW: Failed to save derivative data. [2025-10-24T00:48:44.936980] [INFO ] [MAIN ] Derivative Progress: 720/2164 symbols completed. EW took 0.8s. Estimated remaining: 9m 41s. Rate: 149.1 symbols/min [2025-10-24T00:48:44.937508] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:44.937600] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:44.937432] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:44.995997] [DEBUG] [LOCAL ] EXP: Loaded 29302 existing records from primary storage. [2025-10-24T00:48:44.996979] [INFO ] [MAIN ] EXP: Loaded 29302 primary data records. [2025-10-24T00:48:44.997470] [DEBUG] [LOCAL ] EXG: Loaded 33832 existing records from primary storage. [2025-10-24T00:48:45.009224] [INFO ] [MAIN ] EXG: Loaded 33832 primary data records. [2025-10-24T00:48:45.246546] [DEBUG] [LOCAL ] EXK: Loaded 53575 existing records from primary storage. [2025-10-24T00:48:45.281593] [INFO ] [MAIN ] EXK: Loaded 53575 primary data records. [2025-10-24T00:48:45.962243] [DEBUG] [MAIN ] EXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:45.987745] [DEBUG] [MAIN ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:46.025484] [DEBUG] [MAIN ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:46.095396] [INFO ] [MAIN ] EXP: Generated 139 derivative records from 29302 primary records. [2025-10-24T00:48:46.096322] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-24T00:48:46.100982] [FATAL] [LOCAL ] EXP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:46.101493] [FATAL] [MAIN ] EXP: Failed to save derivative data. [2025-10-24T00:48:46.104751] [INFO ] [MAIN ] Derivative Progress: 721/2164 symbols completed. EXP took 1.2s. Estimated remaining: 9m 42s. Rate: 148.7 symbols/min [2025-10-24T00:48:46.101854] [INFO ] [MAIN ] EXG: Generated 139 derivative records from 33832 primary records. [2025-10-24T00:48:46.105135] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-24T00:48:46.106618] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:46.105622] [FATAL] [LOCAL ] EXG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:46.107683] [FATAL] [MAIN ] EXG: Failed to save derivative data. [2025-10-24T00:48:46.110238] [INFO ] [MAIN ] Derivative Progress: 722/2164 symbols completed. EXG took 1.2s. Estimated remaining: 9m 41s. Rate: 148.9 symbols/min [2025-10-24T00:48:46.111277] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:46.114226] [INFO ] [MAIN ] EXK: Generated 139 derivative records from 53575 primary records. [2025-10-24T00:48:46.114347] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-24T00:48:46.114609] [FATAL] [LOCAL ] EXK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:46.115122] [FATAL] [MAIN ] EXK: Failed to save derivative data. [2025-10-24T00:48:46.118665] [INFO ] [MAIN ] Derivative Progress: 723/2164 symbols completed. EXK took 1.2s. Estimated remaining: 9m 40s. Rate: 149.1 symbols/min [2025-10-24T00:48:46.118900] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:46.206220] [DEBUG] [LOCAL ] EXPD: Loaded 48043 existing records from primary storage. [2025-10-24T00:48:46.218872] [INFO ] [MAIN ] EXPD: Loaded 48043 primary data records. [2025-10-24T00:48:46.219670] [DEBUG] [LOCAL ] EXR: Loaded 45770 existing records from primary storage. [2025-10-24T00:48:46.220855] [INFO ] [MAIN ] EXR: Loaded 45770 primary data records. [2025-10-24T00:48:46.220739] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-24T00:48:46.228234] [INFO ] [MAIN ] F: Loaded 54210 primary data records. [2025-10-24T00:48:47.200964] [DEBUG] [MAIN ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:47.228901] [DEBUG] [MAIN ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:47.261047] [DEBUG] [MAIN ] EXPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:47.324100] [INFO ] [MAIN ] F: Generated 139 derivative records from 54210 primary records. [2025-10-24T00:48:47.327506] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-24T00:48:47.330211] [FATAL] [LOCAL ] F: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:47.331820] [FATAL] [MAIN ] F: Failed to save derivative data. [2025-10-24T00:48:47.335775] [INFO ] [MAIN ] Derivative Progress: 724/2164 symbols completed. F took 1.2s. Estimated remaining: 9m 41s. Rate: 148.7 symbols/min [2025-10-24T00:48:47.340924] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:47.345628] [INFO ] [MAIN ] EXR: Generated 139 derivative records from 45770 primary records. [2025-10-24T00:48:47.346042] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-24T00:48:47.347893] [FATAL] [LOCAL ] EXR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:47.348400] [FATAL] [MAIN ] EXR: Failed to save derivative data. [2025-10-24T00:48:47.348340] [INFO ] [MAIN ] EXPD: Generated 139 derivative records from 48043 primary records. [2025-10-24T00:48:47.350993] [INFO ] [MAIN ] Derivative Progress: 725/2164 symbols completed. EXR took 1.2s. Estimated remaining: 9m 40s. Rate: 148.9 symbols/min [2025-10-24T00:48:47.351549] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-24T00:48:47.351325] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:47.352028] [FATAL] [LOCAL ] EXPD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:47.352474] [FATAL] [MAIN ] EXPD: Failed to save derivative data. [2025-10-24T00:48:47.355234] [INFO ] [MAIN ] Derivative Progress: 726/2164 symbols completed. EXPD took 1.2s. Estimated remaining: 9m 39s. Rate: 149.1 symbols/min [2025-10-24T00:48:47.355663] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:47.409712] [DEBUG] [LOCAL ] FBK: Loaded 27617 existing records from primary storage. [2025-10-24T00:48:47.423741] [INFO ] [MAIN ] FBK: Loaded 27617 primary data records. [2025-10-24T00:48:47.430186] [DEBUG] [LOCAL ] FAF: Loaded 41784 existing records from primary storage. [2025-10-24T00:48:47.437854] [INFO ] [MAIN ] FAF: Loaded 41784 primary data records. [2025-10-24T00:48:47.617984] [DEBUG] [LOCAL ] FBIN: Loaded 50736 existing records from primary storage. [2025-10-24T00:48:47.664436] [INFO ] [MAIN ] FBIN: Loaded 50736 primary data records. [2025-10-24T00:48:48.638675] [DEBUG] [MAIN ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:48.674561] [DEBUG] [MAIN ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:48.711026] [DEBUG] [MAIN ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:48.772848] [INFO ] [MAIN ] FBK: Generated 139 derivative records from 27617 primary records. [2025-10-24T00:48:48.778492] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-24T00:48:48.780263] [FATAL] [LOCAL ] FBK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:48.780736] [FATAL] [MAIN ] FBK: Failed to save derivative data. [2025-10-24T00:48:48.785894] [INFO ] [MAIN ] FAF: Generated 139 derivative records from 41784 primary records. [2025-10-24T00:48:48.784315] [INFO ] [MAIN ] Derivative Progress: 727/2164 symbols completed. FBK took 1.4s. Estimated remaining: 9m 40s. Rate: 148.6 symbols/min [2025-10-24T00:48:48.786196] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:48.786466] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-24T00:48:48.787106] [FATAL] [LOCAL ] FAF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:48.789661] [FATAL] [MAIN ] FAF: Failed to save derivative data. [2025-10-24T00:48:48.793682] [INFO ] [MAIN ] Derivative Progress: 728/2164 symbols completed. FAF took 1.5s. Estimated remaining: 9m 39s. Rate: 148.8 symbols/min [2025-10-24T00:48:48.794422] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:48.794317] [INFO ] [MAIN ] FBIN: Generated 139 derivative records from 50736 primary records. [2025-10-24T00:48:48.794875] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-24T00:48:48.795135] [FATAL] [LOCAL ] FBIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:48.795231] [FATAL] [MAIN ] FBIN: Failed to save derivative data. [2025-10-24T00:48:48.797880] [INFO ] [MAIN ] Derivative Progress: 729/2164 symbols completed. FBIN took 1.4s. Estimated remaining: 9m 38s. Rate: 149.0 symbols/min [2025-10-24T00:48:48.798589] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:48.820041] [DEBUG] [LOCAL ] FC: Loaded 14390 existing records from primary storage. [2025-10-24T00:48:48.820221] [INFO ] [MAIN ] FC: Loaded 14390 primary data records. [2025-10-24T00:48:48.981353] [DEBUG] [LOCAL ] FBRT: Loaded 35460 existing records from primary storage. [2025-10-24T00:48:49.034133] [INFO ] [MAIN ] FBRT: Loaded 35460 primary data records. [2025-10-24T00:48:49.204200] [DEBUG] [LOCAL ] FBP: Loaded 45946 existing records from primary storage. [2025-10-24T00:48:49.237830] [INFO ] [MAIN ] FBP: Loaded 45946 primary data records. [2025-10-24T00:48:49.814720] [DEBUG] [MAIN ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:49.863140] [DEBUG] [MAIN ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:49.875790] [DEBUG] [MAIN ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:49.925947] [INFO ] [MAIN ] FC: Generated 139 derivative records from 14390 primary records. [2025-10-24T00:48:49.929603] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-24T00:48:49.930374] [FATAL] [LOCAL ] FC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:49.931820] [FATAL] [MAIN ] FC: Failed to save derivative data. [2025-10-24T00:48:49.936422] [INFO ] [MAIN ] Derivative Progress: 730/2164 symbols completed. FC took 1.1s. Estimated remaining: 9m 39s. Rate: 148.6 symbols/min [2025-10-24T00:48:49.938230] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:49.955205] [INFO ] [MAIN ] FBRT: Generated 139 derivative records from 35460 primary records. [2025-10-24T00:48:49.957224] [INFO ] [MAIN ] FBP: Generated 139 derivative records from 45946 primary records. [2025-10-24T00:48:49.957497] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-24T00:48:49.957802] [FATAL] [LOCAL ] FBP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:49.957854] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-24T00:48:49.957935] [FATAL] [MAIN ] FBP: Failed to save derivative data. [2025-10-24T00:48:49.960989] [INFO ] [MAIN ] Derivative Progress: 731/2164 symbols completed. FBP took 1.2s. Estimated remaining: 9m 38s. Rate: 148.8 symbols/min [2025-10-24T00:48:49.961189] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:49.958141] [FATAL] [LOCAL ] FBRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:49.962108] [FATAL] [MAIN ] FBRT: Failed to save derivative data. [2025-10-24T00:48:49.964268] [INFO ] [MAIN ] Derivative Progress: 732/2164 symbols completed. FBRT took 1.2s. Estimated remaining: 9m 37s. Rate: 149.0 symbols/min [2025-10-24T00:48:49.964559] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:49.999449] [DEBUG] [LOCAL ] FCF: Loaded 39380 existing records from primary storage. [2025-10-24T00:48:49.999673] [INFO ] [MAIN ] FCF: Loaded 39380 primary data records. [2025-10-24T00:48:50.081107] [DEBUG] [LOCAL ] FCN: Loaded 26198 existing records from primary storage. [2025-10-24T00:48:50.130854] [INFO ] [MAIN ] FCN: Loaded 26198 primary data records. [2025-10-24T00:48:50.147490] [DEBUG] [LOCAL ] FCPT: Loaded 37208 existing records from primary storage. [2025-10-24T00:48:50.183194] [INFO ] [MAIN ] FCPT: Loaded 37208 primary data records. [2025-10-24T00:48:50.999192] [DEBUG] [MAIN ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:51.038945] [DEBUG] [MAIN ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:51.066881] [DEBUG] [MAIN ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:51.110016] [INFO ] [MAIN ] FCF: Generated 139 derivative records from 39380 primary records. [2025-10-24T00:48:51.113850] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-24T00:48:51.117105] [FATAL] [LOCAL ] FCF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:51.119259] [FATAL] [MAIN ] FCF: Failed to save derivative data. [2025-10-24T00:48:51.121602] [INFO ] [MAIN ] Derivative Progress: 733/2164 symbols completed. FCF took 1.2s. Estimated remaining: 9m 38s. Rate: 148.7 symbols/min [2025-10-24T00:48:51.133871] [INFO ] [MAIN ] FCPT: Generated 139 derivative records from 37208 primary records. [2025-10-24T00:48:51.134062] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-24T00:48:51.134520] [FATAL] [LOCAL ] FCPT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:51.135624] [FATAL] [MAIN ] FCPT: Failed to save derivative data. [2025-10-24T00:48:51.138570] [INFO ] [MAIN ] Derivative Progress: 734/2164 symbols completed. FCPT took 1.2s. Estimated remaining: 9m 36s. Rate: 148.9 symbols/min [2025-10-24T00:48:51.140503] [INFO ] [MAIN ] FCN: Generated 139 derivative records from 26198 primary records. [2025-10-24T00:48:51.140726] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-24T00:48:51.140923] [FATAL] [LOCAL ] FCN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:51.141023] [FATAL] [MAIN ] FCN: Failed to save derivative data. [2025-10-24T00:48:51.143375] [INFO ] [MAIN ] Derivative Progress: 735/2164 symbols completed. FCN took 1.2s. Estimated remaining: 9m 35s. Rate: 149.1 symbols/min [2025-10-24T00:48:51.143853] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:51.143966] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:51.143779] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:51.163919] [DEBUG] [LOCAL ] FCT: Loaded 14945 existing records from primary storage. [2025-10-24T00:48:51.171415] [INFO ] [MAIN ] FCT: Loaded 14945 primary data records. [2025-10-24T00:48:51.311103] [DEBUG] [LOCAL ] FDP: Loaded 29865 existing records from primary storage. [2025-10-24T00:48:51.311888] [INFO ] [MAIN ] FDP: Loaded 29865 primary data records. [2025-10-24T00:48:51.633740] [DEBUG] [LOCAL ] FCX: Loaded 54091 existing records from primary storage. [2025-10-24T00:48:51.645161] [INFO ] [MAIN ] FCX: Loaded 54091 primary data records. [2025-10-24T00:48:52.195879] [DEBUG] [MAIN ] FCT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:48:52.236860] [DEBUG] [MAIN ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:52.284297] [DEBUG] [MAIN ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:52.316392] [INFO ] [MAIN ] FCT: Generated 139 derivative records from 14945 primary records. [2025-10-24T00:48:52.319740] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-24T00:48:52.324274] [FATAL] [LOCAL ] FCT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:52.324531] [FATAL] [MAIN ] FCT: Failed to save derivative data. [2025-10-24T00:48:52.327550] [INFO ] [MAIN ] Derivative Progress: 736/2164 symbols completed. FCT took 1.2s. Estimated remaining: 9m 36s. Rate: 148.7 symbols/min [2025-10-24T00:48:52.328571] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:52.344391] [INFO ] [MAIN ] FDP: Generated 139 derivative records from 29865 primary records. [2025-10-24T00:48:52.344539] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-24T00:48:52.346989] [FATAL] [LOCAL ] FDP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:52.347269] [FATAL] [MAIN ] FDP: Failed to save derivative data. [2025-10-24T00:48:52.349527] [INFO ] [MAIN ] Derivative Progress: 737/2164 symbols completed. FDP took 1.2s. Estimated remaining: 9m 35s. Rate: 148.8 symbols/min [2025-10-24T00:48:52.351340] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:52.360872] [INFO ] [MAIN ] FCX: Generated 139 derivative records from 54091 primary records. [2025-10-24T00:48:52.360977] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-24T00:48:52.361234] [FATAL] [LOCAL ] FCX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:52.361496] [FATAL] [MAIN ] FCX: Failed to save derivative data. [2025-10-24T00:48:52.364363] [INFO ] [MAIN ] Derivative Progress: 738/2164 symbols completed. FCX took 1.2s. Estimated remaining: 9m 34s. Rate: 149.0 symbols/min [2025-10-24T00:48:52.364583] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:52.376424] [DEBUG] [LOCAL ] FDS: Loaded 28305 existing records from primary storage. [2025-10-24T00:48:52.376696] [INFO ] [MAIN ] FDS: Loaded 28305 primary data records. [2025-10-24T00:48:52.717967] [DEBUG] [LOCAL ] FDX: Loaded 51522 existing records from primary storage. [2025-10-24T00:48:52.719428] [INFO ] [MAIN ] FDX: Loaded 51522 primary data records. [2025-10-24T00:48:52.805625] [DEBUG] [LOCAL ] FE: Loaded 53821 existing records from primary storage. [2025-10-24T00:48:52.822545] [INFO ] [MAIN ] FE: Loaded 53821 primary data records. [2025-10-24T00:48:53.397219] [DEBUG] [MAIN ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:53.445722] [DEBUG] [MAIN ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:53.460092] [DEBUG] [MAIN ] FE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:53.520858] [INFO ] [MAIN ] FDS: Generated 139 derivative records from 28305 primary records. [2025-10-24T00:48:53.522813] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-24T00:48:53.529141] [FATAL] [LOCAL ] FDS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:53.531016] [FATAL] [MAIN ] FDS: Failed to save derivative data. [2025-10-24T00:48:53.535192] [INFO ] [MAIN ] Derivative Progress: 739/2164 symbols completed. FDS took 1.2s. Estimated remaining: 9m 35s. Rate: 148.7 symbols/min [2025-10-24T00:48:53.539159] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:53.555533] [INFO ] [MAIN ] FE: Generated 139 derivative records from 53821 primary records. [2025-10-24T00:48:53.556140] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-24T00:48:53.559289] [FATAL] [LOCAL ] FE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:53.559396] [FATAL] [MAIN ] FE: Failed to save derivative data. [2025-10-24T00:48:53.562103] [INFO ] [MAIN ] Derivative Progress: 740/2164 symbols completed. FE took 1.2s. Estimated remaining: 9m 34s. Rate: 148.8 symbols/min [2025-10-24T00:48:53.558868] [INFO ] [MAIN ] FDX: Generated 139 derivative records from 51522 primary records. [2025-10-24T00:48:53.562355] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:53.562752] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-24T00:48:53.563894] [FATAL] [LOCAL ] FDX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:53.563982] [FATAL] [MAIN ] FDX: Failed to save derivative data. [2025-10-24T00:48:53.565939] [INFO ] [MAIN ] Derivative Progress: 741/2164 symbols completed. FDX took 1.2s. Estimated remaining: 9m 33s. Rate: 149.0 symbols/min [2025-10-24T00:48:53.566116] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:53.591059] [DEBUG] [LOCAL ] FFA: Loaded 5602 existing records from primary storage. [2025-10-24T00:48:53.591268] [INFO ] [MAIN ] FFA: Loaded 5602 primary data records. [2025-10-24T00:48:53.707788] [DEBUG] [LOCAL ] FF: Loaded 23773 existing records from primary storage. [2025-10-24T00:48:53.715406] [INFO ] [MAIN ] FF: Loaded 23773 primary data records. [2025-10-24T00:48:53.731389] [DEBUG] [LOCAL ] FERG: Loaded 49080 existing records from primary storage. [2025-10-24T00:48:53.747256] [INFO ] [MAIN ] FERG: Loaded 49080 primary data records. [2025-10-24T00:48:54.563810] [DEBUG] [MAIN ] FFA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:48:54.612870] [DEBUG] [MAIN ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:54.612536] [DEBUG] [MAIN ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:54.682667] [INFO ] [MAIN ] FFA: Generated 139 derivative records from 5602 primary records. [2025-10-24T00:48:54.686595] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-24T00:48:54.687590] [FATAL] [LOCAL ] FFA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:54.690715] [FATAL] [MAIN ] FFA: Failed to save derivative data. [2025-10-24T00:48:54.693100] [INFO ] [MAIN ] Derivative Progress: 742/2164 symbols completed. FFA took 1.1s. Estimated remaining: 9m 34s. Rate: 148.7 symbols/min [2025-10-24T00:48:54.696589] [INFO ] [MAIN ] FERG: Generated 139 derivative records from 49080 primary records. [2025-10-24T00:48:54.696839] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:54.697002] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-24T00:48:54.699825] [INFO ] [MAIN ] FF: Generated 139 derivative records from 23773 primary records. [2025-10-24T00:48:54.697789] [FATAL] [LOCAL ] FERG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:54.700249] [FATAL] [MAIN ] FERG: Failed to save derivative data. [2025-10-24T00:48:54.703003] [INFO ] [MAIN ] Derivative Progress: 743/2164 symbols completed. FERG took 1.2s. Estimated remaining: 9m 33s. Rate: 148.9 symbols/min [2025-10-24T00:48:54.703186] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:54.703674] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-24T00:48:54.704135] [FATAL] [LOCAL ] FF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:54.704214] [FATAL] [MAIN ] FF: Failed to save derivative data. [2025-10-24T00:48:54.706873] [INFO ] [MAIN ] Derivative Progress: 744/2164 symbols completed. FF took 1.1s. Estimated remaining: 9m 32s. Rate: 149.1 symbols/min [2025-10-24T00:48:54.707138] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:54.721425] [DEBUG] [LOCAL ] FFC: Loaded 16737 existing records from primary storage. [2025-10-24T00:48:54.721689] [INFO ] [MAIN ] FFC: Loaded 16737 primary data records. [2025-10-24T00:48:54.845154] [DEBUG] [LOCAL ] FG: Loaded 21445 existing records from primary storage. [2025-10-24T00:48:54.856009] [INFO ] [MAIN ] FG: Loaded 21445 primary data records. [2025-10-24T00:48:55.027464] [DEBUG] [LOCAL ] FFWM: Loaded 35895 existing records from primary storage. [2025-10-24T00:48:55.151162] [INFO ] [MAIN ] FFWM: Loaded 35895 primary data records. [2025-10-24T00:48:55.719856] [DEBUG] [MAIN ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:55.754967] [DEBUG] [MAIN ] FG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:55.795190] [DEBUG] [MAIN ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:55.833931] [INFO ] [MAIN ] FFC: Generated 139 derivative records from 16737 primary records. [2025-10-24T00:48:55.836768] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-24T00:48:55.837844] [FATAL] [LOCAL ] FFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:55.838209] [FATAL] [MAIN ] FFC: Failed to save derivative data. [2025-10-24T00:48:55.840438] [INFO ] [MAIN ] Derivative Progress: 745/2164 symbols completed. FFC took 1.1s. Estimated remaining: 9m 32s. Rate: 148.7 symbols/min [2025-10-24T00:48:55.844509] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:55.847181] [INFO ] [MAIN ] FG: Generated 139 derivative records from 21445 primary records. [2025-10-24T00:48:55.847285] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-24T00:48:55.847505] [FATAL] [LOCAL ] FG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:55.847714] [FATAL] [MAIN ] FG: Failed to save derivative data. [2025-10-24T00:48:55.851185] [INFO ] [MAIN ] Derivative Progress: 746/2164 symbols completed. FG took 1.1s. Estimated remaining: 9m 31s. Rate: 148.9 symbols/min [2025-10-24T00:48:55.854399] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:55.860159] [DEBUG] [LOCAL ] FGN: Loaded 3575 existing records from primary storage. [2025-10-24T00:48:55.861831] [INFO ] [MAIN ] FGN: Loaded 3575 primary data records. [2025-10-24T00:48:55.862298] [INFO ] [MAIN ] FFWM: Generated 139 derivative records from 35895 primary records. [2025-10-24T00:48:55.883683] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-24T00:48:55.918632] [FATAL] [LOCAL ] FFWM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:55.932713] [FATAL] [MAIN ] FFWM: Failed to save derivative data. [2025-10-24T00:48:55.935799] [INFO ] [MAIN ] Derivative Progress: 747/2164 symbols completed. FFWM took 1.2s. Estimated remaining: 9m 30s. Rate: 149.1 symbols/min [2025-10-24T00:48:55.947779] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:56.184791] [DEBUG] [LOCAL ] FHI: Loaded 39641 existing records from primary storage. [2025-10-24T00:48:56.185169] [INFO ] [MAIN ] FHI: Loaded 39641 primary data records. [2025-10-24T00:48:56.379945] [DEBUG] [LOCAL ] FHN: Loaded 53789 existing records from primary storage. [2025-10-24T00:48:56.518136] [INFO ] [MAIN ] FHN: Loaded 53789 primary data records. [2025-10-24T00:48:56.841506] [DEBUG] [MAIN ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:56.936728] [DEBUG] [MAIN ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:56.984548] [INFO ] [MAIN ] FGN: Generated 139 derivative records from 3575 primary records. [2025-10-24T00:48:56.986243] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-24T00:48:56.986068] [DEBUG] [MAIN ] FHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:56.986945] [FATAL] [LOCAL ] FGN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:56.987157] [FATAL] [MAIN ] FGN: Failed to save derivative data. [2025-10-24T00:48:56.990136] [INFO ] [MAIN ] Derivative Progress: 748/2164 symbols completed. FGN took 1.1s. Estimated remaining: 9m 31s. Rate: 148.7 symbols/min [2025-10-24T00:48:57.033719] [INFO ] [MAIN ] FHI: Generated 139 derivative records from 39641 primary records. [2025-10-24T00:48:57.034997] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-24T00:48:57.035261] [FATAL] [LOCAL ] FHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:57.035412] [FATAL] [MAIN ] FHI: Failed to save derivative data. [2025-10-24T00:48:57.039396] [INFO ] [MAIN ] Derivative Progress: 749/2164 symbols completed. FHI took 1.2s. Estimated remaining: 9m 30s. Rate: 148.9 symbols/min [2025-10-24T00:48:57.039712] [INFO ] [MAIN ] FHN: Generated 139 derivative records from 53789 primary records. [2025-10-24T00:48:57.039934] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-24T00:48:57.040184] [FATAL] [LOCAL ] FHN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:57.040303] [FATAL] [MAIN ] FHN: Failed to save derivative data. [2025-10-24T00:48:57.043078] [INFO ] [MAIN ] Derivative Progress: 750/2164 symbols completed. FHN took 1.1s. Estimated remaining: 9m 29s. Rate: 149.1 symbols/min [2025-10-24T00:48:57.043425] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:57.043508] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:57.043635] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:57.080830] [DEBUG] [LOCAL ] FICO: Loaded 22189 existing records from primary storage. [2025-10-24T00:48:57.093085] [INFO ] [MAIN ] FICO: Loaded 22189 primary data records. [2025-10-24T00:48:57.209432] [DEBUG] [LOCAL ] FIGS: Loaded 48846 existing records from primary storage. [2025-10-24T00:48:57.223875] [INFO ] [MAIN ] FIGS: Loaded 48846 primary data records. [2025-10-24T00:48:57.235506] [DEBUG] [LOCAL ] FI: Loaded 53968 existing records from primary storage. [2025-10-24T00:48:57.252678] [INFO ] [MAIN ] FI: Loaded 53968 primary data records. [2025-10-24T00:48:58.036291] [DEBUG] [MAIN ] FICO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:58.065353] [DEBUG] [MAIN ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:58.102121] [DEBUG] [MAIN ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:58.145572] [INFO ] [MAIN ] FICO: Generated 139 derivative records from 22189 primary records. [2025-10-24T00:48:58.146141] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-24T00:48:58.148919] [FATAL] [LOCAL ] FICO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:58.149031] [FATAL] [MAIN ] FICO: Failed to save derivative data. [2025-10-24T00:48:58.151731] [INFO ] [MAIN ] Derivative Progress: 751/2164 symbols completed. FICO took 1.1s. Estimated remaining: 9m 30s. Rate: 148.8 symbols/min [2025-10-24T00:48:58.152280] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:58.156733] [INFO ] [MAIN ] FIGS: Generated 139 derivative records from 48846 primary records. [2025-10-24T00:48:58.159368] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-24T00:48:58.159744] [FATAL] [LOCAL ] FIGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:58.159853] [FATAL] [MAIN ] FIGS: Failed to save derivative data. [2025-10-24T00:48:58.163764] [INFO ] [MAIN ] Derivative Progress: 752/2164 symbols completed. FIGS took 1.1s. Estimated remaining: 9m 29s. Rate: 149.0 symbols/min [2025-10-24T00:48:58.164466] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:58.173724] [INFO ] [MAIN ] FI: Generated 139 derivative records from 53968 primary records. [2025-10-24T00:48:58.174030] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-24T00:48:58.174321] [FATAL] [LOCAL ] FI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:58.174444] [FATAL] [MAIN ] FI: Failed to save derivative data. [2025-10-24T00:48:58.177762] [INFO ] [MAIN ] Derivative Progress: 753/2164 symbols completed. FI took 1.1s. Estimated remaining: 9m 28s. Rate: 149.2 symbols/min [2025-10-24T00:48:58.177987] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:58.182855] [DEBUG] [LOCAL ] FINS: Loaded 8300 existing records from primary storage. [2025-10-24T00:48:58.182993] [INFO ] [MAIN ] FINS: Loaded 8300 primary data records. [2025-10-24T00:48:58.383981] [DEBUG] [LOCAL ] FIHL: Loaded 39341 existing records from primary storage. [2025-10-24T00:48:58.506401] [INFO ] [MAIN ] FIHL: Loaded 39341 primary data records. [2025-10-24T00:48:58.637710] [DEBUG] [LOCAL ] FINV: Loaded 45555 existing records from primary storage. [2025-10-24T00:48:58.666170] [INFO ] [MAIN ] FINV: Loaded 45555 primary data records. [2025-10-24T00:48:59.180993] [DEBUG] [MAIN ] FINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:59.231612] [DEBUG] [MAIN ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:59.280355] [DEBUG] [MAIN ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:48:59.306390] [INFO ] [MAIN ] FINS: Generated 139 derivative records from 8300 primary records. [2025-10-24T00:48:59.309901] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-24T00:48:59.310267] [FATAL] [LOCAL ] FINS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:59.313111] [FATAL] [MAIN ] FINS: Failed to save derivative data. [2025-10-24T00:48:59.315569] [INFO ] [MAIN ] Derivative Progress: 754/2164 symbols completed. FINS took 1.2s. Estimated remaining: 9m 29s. Rate: 148.8 symbols/min [2025-10-24T00:48:59.317367] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:59.324900] [INFO ] [MAIN ] FIHL: Generated 139 derivative records from 39341 primary records. [2025-10-24T00:48:59.326407] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-24T00:48:59.326723] [FATAL] [LOCAL ] FIHL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:59.326853] [FATAL] [MAIN ] FIHL: Failed to save derivative data. [2025-10-24T00:48:59.331949] [INFO ] [MAIN ] Derivative Progress: 755/2164 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 27s. Rate: 149.0 symbols/min [2025-10-24T00:48:59.332441] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:59.340751] [INFO ] [MAIN ] FINV: Generated 139 derivative records from 45555 primary records. [2025-10-24T00:48:59.341236] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-24T00:48:59.341669] [FATAL] [LOCAL ] FINV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:48:59.341752] [FATAL] [MAIN ] FINV: Failed to save derivative data. [2025-10-24T00:48:59.344510] [INFO ] [MAIN ] Derivative Progress: 756/2164 symbols completed. FINV took 1.2s. Estimated remaining: 9m 26s. Rate: 149.2 symbols/min [2025-10-24T00:48:59.344709] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:48:59.360531] [DEBUG] [LOCAL ] FLC: Loaded 5444 existing records from primary storage. [2025-10-24T00:48:59.372555] [INFO ] [MAIN ] FLC: Loaded 5444 primary data records. [2025-10-24T00:48:59.450693] [DEBUG] [LOCAL ] FIX: Loaded 28670 existing records from primary storage. [2025-10-24T00:48:59.498284] [INFO ] [MAIN ] FIX: Loaded 28670 primary data records. [2025-10-24T00:48:59.530316] [DEBUG] [LOCAL ] FIS: Loaded 53715 existing records from primary storage. [2025-10-24T00:48:59.541140] [INFO ] [MAIN ] FIS: Loaded 53715 primary data records. [2025-10-24T00:49:00.322628] [DEBUG] [MAIN ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:00.360490] [DEBUG] [MAIN ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:00.385265] [DEBUG] [MAIN ] FIX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:00.454982] [INFO ] [MAIN ] FLC: Generated 139 derivative records from 5444 primary records. [2025-10-24T00:49:00.456271] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-24T00:49:00.456763] [FATAL] [LOCAL ] FLC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:00.456953] [FATAL] [MAIN ] FLC: Failed to save derivative data. [2025-10-24T00:49:00.459335] [INFO ] [MAIN ] Derivative Progress: 757/2164 symbols completed. FLC took 1.1s. Estimated remaining: 9m 27s. Rate: 148.8 symbols/min [2025-10-24T00:49:00.462824] [INFO ] [MAIN ] FIS: Generated 139 derivative records from 53715 primary records. [2025-10-24T00:49:00.462957] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-24T00:49:00.463085] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:00.463802] [FATAL] [LOCAL ] FIS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:00.466339] [FATAL] [MAIN ] FIS: Failed to save derivative data. [2025-10-24T00:49:00.466564] [INFO ] [MAIN ] FIX: Generated 139 derivative records from 28670 primary records. [2025-10-24T00:49:00.469237] [INFO ] [MAIN ] Derivative Progress: 758/2164 symbols completed. FIS took 1.2s. Estimated remaining: 9m 26s. Rate: 149.0 symbols/min [2025-10-24T00:49:00.469455] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-24T00:49:00.470413] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:00.470103] [FATAL] [LOCAL ] FIX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:00.470769] [FATAL] [MAIN ] FIX: Failed to save derivative data. [2025-10-24T00:49:00.473767] [INFO ] [MAIN ] Derivative Progress: 759/2164 symbols completed. FIX took 1.1s. Estimated remaining: 9m 25s. Rate: 149.2 symbols/min [2025-10-24T00:49:00.474331] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:00.541698] [DEBUG] [LOCAL ] FLNG: Loaded 33502 existing records from primary storage. [2025-10-24T00:49:00.556777] [INFO ] [MAIN ] FLNG: Loaded 33502 primary data records. [2025-10-24T00:49:00.569219] [DEBUG] [LOCAL ] FLG: Loaded 53708 existing records from primary storage. [2025-10-24T00:49:00.627552] [DEBUG] [LOCAL ] FLO: Loaded 52445 existing records from primary storage. [2025-10-24T00:49:00.636416] [INFO ] [MAIN ] FLG: Loaded 53708 primary data records. [2025-10-24T00:49:00.670429] [INFO ] [MAIN ] FLO: Loaded 52445 primary data records. [2025-10-24T00:49:01.570698] [DEBUG] [MAIN ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:01.595676] [DEBUG] [MAIN ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:01.636617] [DEBUG] [MAIN ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:01.701272] [INFO ] [MAIN ] FLNG: Generated 139 derivative records from 33502 primary records. [2025-10-24T00:49:01.707546] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-24T00:49:01.708254] [FATAL] [LOCAL ] FLNG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:01.713317] [INFO ] [MAIN ] FLG: Generated 139 derivative records from 53708 primary records. [2025-10-24T00:49:01.713514] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-24T00:49:01.713780] [FATAL] [LOCAL ] FLG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:01.713881] [FATAL] [MAIN ] FLG: Failed to save derivative data. [2025-10-24T00:49:01.713156] [FATAL] [MAIN ] FLNG: Failed to save derivative data. [2025-10-24T00:49:01.717364] [INFO ] [MAIN ] Derivative Progress: 760/2164 symbols completed. FLNG took 1.2s. Estimated remaining: 9m 26s. Rate: 148.8 symbols/min [2025-10-24T00:49:01.717577] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:01.720450] [INFO ] [MAIN ] Derivative Progress: 761/2164 symbols completed. FLG took 1.3s. Estimated remaining: 9m 25s. Rate: 149.0 symbols/min [2025-10-24T00:49:01.721075] [INFO ] [MAIN ] FLO: Generated 139 derivative records from 52445 primary records. [2025-10-24T00:49:01.721670] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:01.723110] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-24T00:49:01.723500] [FATAL] [LOCAL ] FLO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:01.723874] [FATAL] [MAIN ] FLO: Failed to save derivative data. [2025-10-24T00:49:01.726892] [INFO ] [MAIN ] Derivative Progress: 762/2164 symbols completed. FLO took 1.3s. Estimated remaining: 9m 24s. Rate: 149.2 symbols/min [2025-10-24T00:49:01.727367] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:01.823326] [DEBUG] [LOCAL ] FLR: Loaded 53643 existing records from primary storage. [2025-10-24T00:49:01.824904] [INFO ] [MAIN ] FLR: Loaded 53643 primary data records. [2025-10-24T00:49:01.825627] [DEBUG] [LOCAL ] FLS: Loaded 50773 existing records from primary storage. [2025-10-24T00:49:01.862612] [INFO ] [MAIN ] FLS: Loaded 50773 primary data records. [2025-10-24T00:49:01.991152] [DEBUG] [LOCAL ] FLUT: Loaded 51016 existing records from primary storage. [2025-10-24T00:49:02.058075] [INFO ] [MAIN ] FLUT: Loaded 51016 primary data records. [2025-10-24T00:49:02.815283] [DEBUG] [MAIN ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:02.860069] [DEBUG] [MAIN ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:02.859219] [DEBUG] [MAIN ] FLS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:02.942121] [INFO ] [MAIN ] FLR: Generated 139 derivative records from 53643 primary records. [2025-10-24T00:49:02.945767] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-24T00:49:02.949548] [FATAL] [LOCAL ] FLR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:02.951411] [FATAL] [MAIN ] FLR: Failed to save derivative data. [2025-10-24T00:49:02.955707] [INFO ] [MAIN ] Derivative Progress: 763/2164 symbols completed. FLR took 1.2s. Estimated remaining: 9m 25s. Rate: 148.8 symbols/min [2025-10-24T00:49:02.959941] [INFO ] [MAIN ] FLS: Generated 139 derivative records from 50773 primary records. [2025-10-24T00:49:02.960778] [INFO ] [MAIN ] FLUT: Generated 139 derivative records from 51016 primary records. [2025-10-24T00:49:02.960876] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-24T00:49:02.961239] [FATAL] [LOCAL ] FLS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:02.961328] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-24T00:49:02.961426] [FATAL] [MAIN ] FLS: Failed to save derivative data. [2025-10-24T00:49:02.964335] [INFO ] [MAIN ] Derivative Progress: 764/2164 symbols completed. FLS took 1.2s. Estimated remaining: 9m 24s. Rate: 149.0 symbols/min [2025-10-24T00:49:02.961787] [FATAL] [LOCAL ] FLUT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:02.964755] [FATAL] [MAIN ] FLUT: Failed to save derivative data. [2025-10-24T00:49:02.968870] [INFO ] [MAIN ] Derivative Progress: 765/2164 symbols completed. FLUT took 1.2s. Estimated remaining: 9m 23s. Rate: 149.2 symbols/min [2025-10-24T00:49:02.969577] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:02.969808] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:02.969709] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:02.983014] [DEBUG] [LOCAL ] FMN: Loaded 5496 existing records from primary storage. [2025-10-24T00:49:02.983437] [INFO ] [MAIN ] FMN: Loaded 5496 primary data records. [2025-10-24T00:49:03.093150] [DEBUG] [LOCAL ] FLXR: Loaded 21596 existing records from primary storage. [2025-10-24T00:49:03.110624] [INFO ] [MAIN ] FLXR: Loaded 21596 primary data records. [2025-10-24T00:49:03.476442] [DEBUG] [LOCAL ] FMC: Loaded 52264 existing records from primary storage. [2025-10-24T00:49:03.478213] [INFO ] [MAIN ] FMC: Loaded 52264 primary data records. [2025-10-24T00:49:04.021499] [DEBUG] [MAIN ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:04.077974] [DEBUG] [MAIN ] FLXR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:04.128485] [DEBUG] [MAIN ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:04.152113] [INFO ] [MAIN ] FMN: Generated 139 derivative records from 5496 primary records. [2025-10-24T00:49:04.155508] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-24T00:49:04.159124] [FATAL] [LOCAL ] FMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:04.161166] [FATAL] [MAIN ] FMN: Failed to save derivative data. [2025-10-24T00:49:04.164454] [INFO ] [MAIN ] Derivative Progress: 766/2164 symbols completed. FMN took 1.2s. Estimated remaining: 9m 24s. Rate: 148.8 symbols/min [2025-10-24T00:49:04.164965] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:04.207107] [INFO ] [MAIN ] FLXR: Generated 139 derivative records from 21596 primary records. [2025-10-24T00:49:04.209932] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-24T00:49:04.210707] [FATAL] [LOCAL ] FLXR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:04.210912] [FATAL] [MAIN ] FLXR: Failed to save derivative data. [2025-10-24T00:49:04.213455] [INFO ] [MAIN ] Derivative Progress: 767/2164 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 23s. Rate: 149.0 symbols/min [2025-10-24T00:49:04.210110] [INFO ] [MAIN ] FMC: Generated 139 derivative records from 52264 primary records. [2025-10-24T00:49:04.213801] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:04.213978] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-24T00:49:04.214780] [FATAL] [LOCAL ] FMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:04.227105] [DEBUG] [LOCAL ] FMS: Loaded 30525 existing records from primary storage. [2025-10-24T00:49:04.226447] [FATAL] [MAIN ] FMC: Failed to save derivative data. [2025-10-24T00:49:04.231625] [INFO ] [MAIN ] Derivative Progress: 768/2164 symbols completed. FMC took 1.3s. Estimated remaining: 9m 22s. Rate: 149.1 symbols/min [2025-10-24T00:49:04.231971] [INFO ] [MAIN ] FMS: Loaded 30525 primary data records. [2025-10-24T00:49:04.232181] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:04.311875] [DEBUG] [LOCAL ] FMY: Loaded 1365 existing records from primary storage. [2025-10-24T00:49:04.329614] [INFO ] [MAIN ] FMY: Loaded 1365 primary data records. [2025-10-24T00:49:04.693169] [DEBUG] [LOCAL ] FMX: Loaded 40643 existing records from primary storage. [2025-10-24T00:49:04.721709] [INFO ] [MAIN ] FMX: Loaded 40643 primary data records. [2025-10-24T00:49:05.261531] [DEBUG] [MAIN ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:05.303637] [DEBUG] [MAIN ] FMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:05.349815] [INFO ] [MAIN ] FMS: Generated 139 derivative records from 30525 primary records. [2025-10-24T00:49:05.350902] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-24T00:49:05.352153] [FATAL] [LOCAL ] FMS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:05.350817] [DEBUG] [MAIN ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:05.352533] [FATAL] [MAIN ] FMS: Failed to save derivative data. [2025-10-24T00:49:05.365169] [INFO ] [MAIN ] Derivative Progress: 769/2164 symbols completed. FMS took 1.2s. Estimated remaining: 9m 23s. Rate: 148.8 symbols/min [2025-10-24T00:49:05.377588] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:05.390287] [INFO ] [MAIN ] FMY: Generated 139 derivative records from 1365 primary records. [2025-10-24T00:49:05.393354] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-24T00:49:05.395211] [FATAL] [LOCAL ] FMY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:05.398675] [FATAL] [MAIN ] FMY: Failed to save derivative data. [2025-10-24T00:49:05.401490] [INFO ] [MAIN ] Derivative Progress: 770/2164 symbols completed. FMY took 1.2s. Estimated remaining: 9m 21s. Rate: 149.0 symbols/min [2025-10-24T00:49:05.401759] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:05.415402] [INFO ] [MAIN ] FMX: Generated 139 derivative records from 40643 primary records. [2025-10-24T00:49:05.415796] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-24T00:49:05.416090] [FATAL] [LOCAL ] FMX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:05.416168] [FATAL] [MAIN ] FMX: Failed to save derivative data. [2025-10-24T00:49:05.419046] [INFO ] [MAIN ] Derivative Progress: 771/2164 symbols completed. FMX took 1.2s. Estimated remaining: 9m 20s. Rate: 149.2 symbols/min [2025-10-24T00:49:05.419231] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:05.436014] [DEBUG] [LOCAL ] FN: Loaded 37580 existing records from primary storage. [2025-10-24T00:49:05.436286] [INFO ] [MAIN ] FN: Loaded 37580 primary data records. [2025-10-24T00:49:05.792742] [DEBUG] [LOCAL ] FNB: Loaded 52992 existing records from primary storage. [2025-10-24T00:49:05.794354] [INFO ] [MAIN ] FNB: Loaded 52992 primary data records. [2025-10-24T00:49:05.809732] [DEBUG] [LOCAL ] FND: Loaded 52447 existing records from primary storage. [2025-10-24T00:49:05.823304] [INFO ] [MAIN ] FND: Loaded 52447 primary data records. [2025-10-24T00:49:06.482856] [DEBUG] [MAIN ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:06.551823] [DEBUG] [MAIN ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:06.552821] [DEBUG] [MAIN ] FNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:06.580506] [INFO ] [MAIN ] FN: Generated 139 derivative records from 37580 primary records. [2025-10-24T00:49:06.585723] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-24T00:49:06.586297] [FATAL] [LOCAL ] FN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:06.586570] [FATAL] [MAIN ] FN: Failed to save derivative data. [2025-10-24T00:49:06.591049] [INFO ] [MAIN ] Derivative Progress: 772/2164 symbols completed. FN took 1.2s. Estimated remaining: 9m 21s. Rate: 148.8 symbols/min [2025-10-24T00:49:06.591818] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:06.651161] [INFO ] [MAIN ] FND: Generated 139 derivative records from 52447 primary records. [2025-10-24T00:49:06.653559] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-24T00:49:06.656616] [FATAL] [LOCAL ] FND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:06.657256] [FATAL] [MAIN ] FND: Failed to save derivative data. [2025-10-24T00:49:06.656997] [INFO ] [MAIN ] FNB: Generated 139 derivative records from 52992 primary records. [2025-10-24T00:49:06.660152] [INFO ] [MAIN ] Derivative Progress: 773/2164 symbols completed. FND took 1.2s. Estimated remaining: 9m 20s. Rate: 148.9 symbols/min [2025-10-24T00:49:06.661368] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-24T00:49:06.661604] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:06.678961] [FATAL] [LOCAL ] FNB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:06.680161] [FATAL] [MAIN ] FNB: Failed to save derivative data. [2025-10-24T00:49:06.682415] [INFO ] [MAIN ] Derivative Progress: 774/2164 symbols completed. FNB took 1.3s. Estimated remaining: 9m 19s. Rate: 149.1 symbols/min [2025-10-24T00:49:06.682696] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:06.684435] [DEBUG] [LOCAL ] FNF: Loaded 49061 existing records from primary storage. [2025-10-24T00:49:06.684938] [INFO ] [MAIN ] FNF: Loaded 49061 primary data records. [2025-10-24T00:49:06.857762] [DEBUG] [LOCAL ] FOA: Loaded 13094 existing records from primary storage. [2025-10-24T00:49:06.876598] [INFO ] [MAIN ] FOA: Loaded 13094 primary data records. [2025-10-24T00:49:07.070896] [DEBUG] [LOCAL ] FNV: Loaded 46446 existing records from primary storage. [2025-10-24T00:49:07.107341] [INFO ] [MAIN ] FNV: Loaded 46446 primary data records. [2025-10-24T00:49:07.769165] [DEBUG] [MAIN ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:07.826933] [DEBUG] [MAIN ] FOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:07.853840] [INFO ] [MAIN ] FNF: Generated 139 derivative records from 49061 primary records. [2025-10-24T00:49:07.863272] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-24T00:49:07.862952] [DEBUG] [MAIN ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:07.863774] [FATAL] [LOCAL ] FNF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:07.863874] [FATAL] [MAIN ] FNF: Failed to save derivative data. [2025-10-24T00:49:07.877526] [INFO ] [MAIN ] Derivative Progress: 775/2164 symbols completed. FNF took 1.3s. Estimated remaining: 9m 20s. Rate: 148.7 symbols/min [2025-10-24T00:49:07.877738] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:07.906056] [DEBUG] [LOCAL ] FOF: Loaded 8451 existing records from primary storage. [2025-10-24T00:49:07.909949] [INFO ] [MAIN ] FOF: Loaded 8451 primary data records. [2025-10-24T00:49:08.225311] [INFO ] [MAIN ] FOA: Generated 139 derivative records from 13094 primary records. [2025-10-24T00:49:08.227402] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-24T00:49:08.229123] [FATAL] [LOCAL ] FOA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:08.229269] [FATAL] [MAIN ] FOA: Failed to save derivative data. [2025-10-24T00:49:08.234520] [INFO ] [MAIN ] Derivative Progress: 776/2164 symbols completed. FOA took 1.6s. Estimated remaining: 9m 20s. Rate: 148.8 symbols/min [2025-10-24T00:49:08.237573] [INFO ] [MAIN ] FNV: Generated 139 derivative records from 46446 primary records. [2025-10-24T00:49:08.237109] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:08.238338] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-24T00:49:08.238671] [FATAL] [LOCAL ] FNV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:08.238833] [FATAL] [MAIN ] FNV: Failed to save derivative data. [2025-10-24T00:49:08.241626] [INFO ] [MAIN ] Derivative Progress: 777/2164 symbols completed. FNV took 1.6s. Estimated remaining: 9m 19s. Rate: 149.0 symbols/min [2025-10-24T00:49:08.241913] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:08.264811] [DEBUG] [LOCAL ] FOR: Loaded 19591 existing records from primary storage. [2025-10-24T00:49:08.278081] [INFO ] [MAIN ] FOR: Loaded 19591 primary data records. [2025-10-24T00:49:08.278796] [DEBUG] [MAIN ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:08.657515] [DEBUG] [LOCAL ] FOUR: Loaded 50041 existing records from primary storage. [2025-10-24T00:49:08.662918] [INFO ] [MAIN ] FOUR: Loaded 50041 primary data records. [2025-10-24T00:49:08.822492] [INFO ] [MAIN ] FOF: Generated 139 derivative records from 8451 primary records. [2025-10-24T00:49:08.857792] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-24T00:49:08.896556] [FATAL] [LOCAL ] FOF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:09.033443] [DEBUG] [MAIN ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:09.033800] [FATAL] [MAIN ] FOF: Failed to save derivative data. [2025-10-24T00:49:09.036695] [INFO ] [MAIN ] Derivative Progress: 778/2164 symbols completed. FOF took 1.2s. Estimated remaining: 9m 19s. Rate: 148.8 symbols/min [2025-10-24T00:49:09.079205] [INFO ] [MAIN ] FOR: Generated 139 derivative records from 19591 primary records. [2025-10-24T00:49:09.080007] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-24T00:49:09.080441] [FATAL] [LOCAL ] FOR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:09.080690] [FATAL] [MAIN ] FOR: Failed to save derivative data. [2025-10-24T00:49:09.084557] [INFO ] [MAIN ] Derivative Progress: 779/2164 symbols completed. FOR took 0.8s. Estimated remaining: 9m 18s. Rate: 148.9 symbols/min [2025-10-24T00:49:09.099480] [DEBUG] [MAIN ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:09.125541] [INFO ] [MAIN ] FOUR: Generated 139 derivative records from 50041 primary records. [2025-10-24T00:49:09.125675] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-24T00:49:09.125876] [FATAL] [LOCAL ] FOUR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:09.125957] [FATAL] [MAIN ] FOUR: Failed to save derivative data. [2025-10-24T00:49:09.128555] [INFO ] [MAIN ] Derivative Progress: 780/2164 symbols completed. FOUR took 0.9s. Estimated remaining: 9m 17s. Rate: 149.1 symbols/min [2025-10-24T00:49:09.129328] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:09.129760] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:09.129208] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:09.157635] [DEBUG] [LOCAL ] FPH: Loaded 19347 existing records from primary storage. [2025-10-24T00:49:09.157981] [INFO ] [MAIN ] FPH: Loaded 19347 primary data records. [2025-10-24T00:49:09.198378] [DEBUG] [LOCAL ] FPF: Loaded 18898 existing records from primary storage. [2025-10-24T00:49:09.240607] [INFO ] [MAIN ] FPF: Loaded 18898 primary data records. [2025-10-24T00:49:09.405438] [DEBUG] [LOCAL ] FPI: Loaded 31560 existing records from primary storage. [2025-10-24T00:49:09.486334] [INFO ] [MAIN ] FPI: Loaded 31560 primary data records. [2025-10-24T00:49:10.164564] [DEBUG] [MAIN ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:10.197487] [DEBUG] [MAIN ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:10.247344] [DEBUG] [MAIN ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:10.294546] [INFO ] [MAIN ] FPH: Generated 139 derivative records from 19347 primary records. [2025-10-24T00:49:10.297067] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-24T00:49:10.297902] [FATAL] [LOCAL ] FPH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:10.298487] [FATAL] [MAIN ] FPH: Failed to save derivative data. [2025-10-24T00:49:10.305282] [INFO ] [MAIN ] FPF: Generated 139 derivative records from 18898 primary records. [2025-10-24T00:49:10.304962] [INFO ] [MAIN ] Derivative Progress: 781/2164 symbols completed. FPH took 1.2s. Estimated remaining: 9m 18s. Rate: 148.7 symbols/min [2025-10-24T00:49:10.305674] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-24T00:49:10.305867] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:10.307956] [FATAL] [LOCAL ] FPF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:10.308516] [FATAL] [MAIN ] FPF: Failed to save derivative data. [2025-10-24T00:49:10.311395] [INFO ] [MAIN ] Derivative Progress: 782/2164 symbols completed. FPF took 1.2s. Estimated remaining: 9m 17s. Rate: 148.9 symbols/min [2025-10-24T00:49:10.311621] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:10.318485] [INFO ] [MAIN ] FPI: Generated 139 derivative records from 31560 primary records. [2025-10-24T00:49:10.318678] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-24T00:49:10.318871] [FATAL] [LOCAL ] FPI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:10.318949] [FATAL] [MAIN ] FPI: Failed to save derivative data. [2025-10-24T00:49:10.321541] [INFO ] [MAIN ] Derivative Progress: 783/2164 symbols completed. FPI took 1.2s. Estimated remaining: 9m 16s. Rate: 149.1 symbols/min [2025-10-24T00:49:10.321738] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:10.335347] [DEBUG] [LOCAL ] FRA: Loaded 14116 existing records from primary storage. [2025-10-24T00:49:10.338997] [INFO ] [MAIN ] FRA: Loaded 14116 primary data records. [2025-10-24T00:49:10.453797] [DEBUG] [LOCAL ] FRGE: Loaded 15605 existing records from primary storage. [2025-10-24T00:49:10.457199] [INFO ] [MAIN ] FRGE: Loaded 15605 primary data records. [2025-10-24T00:49:10.507103] [DEBUG] [LOCAL ] FR: Loaded 46973 existing records from primary storage. [2025-10-24T00:49:10.532902] [INFO ] [MAIN ] FR: Loaded 46973 primary data records. [2025-10-24T00:49:11.361019] [DEBUG] [MAIN ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:11.397570] [DEBUG] [MAIN ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:11.434249] [DEBUG] [MAIN ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:11.477208] [INFO ] [MAIN ] FRA: Generated 139 derivative records from 14116 primary records. [2025-10-24T00:49:11.481438] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-24T00:49:11.482999] [FATAL] [LOCAL ] FRA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:11.485859] [FATAL] [MAIN ] FRA: Failed to save derivative data. [2025-10-24T00:49:11.488272] [INFO ] [MAIN ] Derivative Progress: 784/2164 symbols completed. FRA took 1.2s. Estimated remaining: 9m 17s. Rate: 148.8 symbols/min [2025-10-24T00:49:11.492575] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:11.500437] [INFO ] [MAIN ] FRGE: Generated 139 derivative records from 15605 primary records. [2025-10-24T00:49:11.502182] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-24T00:49:11.502447] [FATAL] [LOCAL ] FRGE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:11.502888] [INFO ] [MAIN ] FR: Generated 139 derivative records from 46973 primary records. [2025-10-24T00:49:11.502962] [FATAL] [MAIN ] FRGE: Failed to save derivative data. [2025-10-24T00:49:11.503065] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-24T00:49:11.505611] [INFO ] [MAIN ] Derivative Progress: 785/2164 symbols completed. FRGE took 1.2s. Estimated remaining: 9m 16s. Rate: 148.9 symbols/min [2025-10-24T00:49:11.506282] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:11.506163] [FATAL] [LOCAL ] FR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:11.506523] [FATAL] [MAIN ] FR: Failed to save derivative data. [2025-10-24T00:49:11.509803] [INFO ] [MAIN ] Derivative Progress: 786/2164 symbols completed. FR took 1.2s. Estimated remaining: 9m 14s. Rate: 149.1 symbols/min [2025-10-24T00:49:11.510070] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:11.551484] [DEBUG] [LOCAL ] FRO: Loaded 52061 existing records from primary storage. [2025-10-24T00:49:11.551676] [INFO ] [MAIN ] FRO: Loaded 52061 primary data records. [2025-10-24T00:49:11.758867] [DEBUG] [LOCAL ] FSCO: Loaded 38800 existing records from primary storage. [2025-10-24T00:49:11.869754] [INFO ] [MAIN ] FSCO: Loaded 38800 primary data records. [2025-10-24T00:49:11.911336] [DEBUG] [LOCAL ] FRT: Loaded 41727 existing records from primary storage. [2025-10-24T00:49:11.934765] [INFO ] [MAIN ] FRT: Loaded 41727 primary data records. [2025-10-24T00:49:12.563667] [DEBUG] [MAIN ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:12.616971] [DEBUG] [MAIN ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:12.649534] [DEBUG] [MAIN ] FRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:12.701567] [INFO ] [MAIN ] FRO: Generated 139 derivative records from 52061 primary records. [2025-10-24T00:49:12.706676] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-24T00:49:12.708896] [FATAL] [LOCAL ] FRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:12.709062] [FATAL] [MAIN ] FRO: Failed to save derivative data. [2025-10-24T00:49:12.713095] [INFO ] [MAIN ] Derivative Progress: 787/2164 symbols completed. FRO took 1.2s. Estimated remaining: 9m 15s. Rate: 148.8 symbols/min [2025-10-24T00:49:12.717433] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:12.722393] [INFO ] [MAIN ] FSCO: Generated 139 derivative records from 38800 primary records. [2025-10-24T00:49:12.723203] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-24T00:49:12.723689] [FATAL] [LOCAL ] FSCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:12.727339] [FATAL] [MAIN ] FSCO: Failed to save derivative data. [2025-10-24T00:49:12.730052] [INFO ] [MAIN ] Derivative Progress: 788/2164 symbols completed. FSCO took 1.2s. Estimated remaining: 9m 14s. Rate: 148.9 symbols/min [2025-10-24T00:49:12.730411] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:12.735387] [INFO ] [MAIN ] FRT: Generated 139 derivative records from 41727 primary records. [2025-10-24T00:49:12.735604] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-24T00:49:12.735894] [FATAL] [LOCAL ] FRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:12.736328] [FATAL] [MAIN ] FRT: Failed to save derivative data. [2025-10-24T00:49:12.740218] [INFO ] [MAIN ] Derivative Progress: 789/2164 symbols completed. FRT took 1.2s. Estimated remaining: 9m 13s. Rate: 149.1 symbols/min [2025-10-24T00:49:12.740790] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:12.790541] [DEBUG] [LOCAL ] FSK: Loaded 49831 existing records from primary storage. [2025-10-24T00:49:12.790810] [INFO ] [MAIN ] FSK: Loaded 49831 primary data records. [2025-10-24T00:49:12.924053] [DEBUG] [LOCAL ] FSLY: Loaded 51652 existing records from primary storage. [2025-10-24T00:49:12.928061] [INFO ] [MAIN ] FSLY: Loaded 51652 primary data records. [2025-10-24T00:49:13.250707] [DEBUG] [LOCAL ] FSM: Loaded 53690 existing records from primary storage. [2025-10-24T00:49:13.276350] [INFO ] [MAIN ] FSM: Loaded 53690 primary data records. [2025-10-24T00:49:13.838371] [DEBUG] [MAIN ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:13.875824] [DEBUG] [MAIN ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:13.915015] [DEBUG] [MAIN ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:13.961139] [INFO ] [MAIN ] FSK: Generated 139 derivative records from 49831 primary records. [2025-10-24T00:49:13.964823] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-24T00:49:13.968696] [FATAL] [LOCAL ] FSK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:13.972058] [FATAL] [MAIN ] FSK: Failed to save derivative data. [2025-10-24T00:49:13.975693] [INFO ] [MAIN ] Derivative Progress: 790/2164 symbols completed. FSK took 1.3s. Estimated remaining: 9m 14s. Rate: 148.7 symbols/min [2025-10-24T00:49:13.979973] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:13.982777] [INFO ] [MAIN ] FSLY: Generated 139 derivative records from 51652 primary records. [2025-10-24T00:49:13.984987] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-24T00:49:13.985325] [FATAL] [LOCAL ] FSLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:13.985710] [FATAL] [MAIN ] FSLY: Failed to save derivative data. [2025-10-24T00:49:13.991244] [INFO ] [MAIN ] Derivative Progress: 791/2164 symbols completed. FSLY took 1.3s. Estimated remaining: 9m 13s. Rate: 148.9 symbols/min [2025-10-24T00:49:13.992960] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:13.995589] [INFO ] [MAIN ] FSM: Generated 139 derivative records from 53690 primary records. [2025-10-24T00:49:13.995782] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-24T00:49:13.995994] [FATAL] [LOCAL ] FSM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:13.996074] [FATAL] [MAIN ] FSM: Failed to save derivative data. [2025-10-24T00:49:13.998908] [INFO ] [MAIN ] Derivative Progress: 792/2164 symbols completed. FSM took 1.3s. Estimated remaining: 9m 12s. Rate: 149.1 symbols/min [2025-10-24T00:49:14.000854] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:14.011679] [DEBUG] [LOCAL ] FT: Loaded 6885 existing records from primary storage. [2025-10-24T00:49:14.011873] [INFO ] [MAIN ] FT: Loaded 6885 primary data records. [2025-10-24T00:49:14.123101] [DEBUG] [LOCAL ] FTHY: Loaded 12371 existing records from primary storage. [2025-10-24T00:49:14.151037] [INFO ] [MAIN ] FTHY: Loaded 12371 primary data records. [2025-10-24T00:49:14.240980] [DEBUG] [LOCAL ] FSS: Loaded 33299 existing records from primary storage. [2025-10-24T00:49:14.290734] [INFO ] [MAIN ] FSS: Loaded 33299 primary data records. [2025-10-24T00:49:15.026288] [DEBUG] [MAIN ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:15.097602] [DEBUG] [MAIN ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:15.082145] [DEBUG] [MAIN ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:15.170413] [INFO ] [MAIN ] FT: Generated 139 derivative records from 6885 primary records. [2025-10-24T00:49:15.171079] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-24T00:49:15.174787] [FATAL] [LOCAL ] FT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:15.175674] [FATAL] [MAIN ] FT: Failed to save derivative data. [2025-10-24T00:49:15.182923] [INFO ] [MAIN ] Derivative Progress: 793/2164 symbols completed. FT took 1.2s. Estimated remaining: 9m 13s. Rate: 148.7 symbols/min [2025-10-24T00:49:15.198539] [INFO ] [MAIN ] FTHY: Generated 139 derivative records from 12371 primary records. [2025-10-24T00:49:15.200756] [INFO ] [MAIN ] FSS: Generated 139 derivative records from 33299 primary records. [2025-10-24T00:49:15.201053] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-24T00:49:15.201143] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-24T00:49:15.201572] [FATAL] [LOCAL ] FTHY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:15.201953] [FATAL] [LOCAL ] FSS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:15.202215] [FATAL] [MAIN ] FSS: Failed to save derivative data. [2025-10-24T00:49:15.202089] [FATAL] [MAIN ] FTHY: Failed to save derivative data. [2025-10-24T00:49:15.205172] [INFO ] [MAIN ] Derivative Progress: 794/2164 symbols completed. FSS took 1.2s. Estimated remaining: 9m 12s. Rate: 148.9 symbols/min [2025-10-24T00:49:15.209566] [INFO ] [MAIN ] Derivative Progress: 795/2164 symbols completed. FTHY took 1.2s. Estimated remaining: 9m 11s. Rate: 149.1 symbols/min [2025-10-24T00:49:15.210134] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:15.210324] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:15.210503] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:15.288886] [DEBUG] [LOCAL ] FTK: Loaded 33227 existing records from primary storage. [2025-10-24T00:49:15.289813] [INFO ] [MAIN ] FTK: Loaded 33227 primary data records. [2025-10-24T00:49:15.291639] [DEBUG] [LOCAL ] FTS: Loaded 42787 existing records from primary storage. [2025-10-24T00:49:15.297922] [INFO ] [MAIN ] FTS: Loaded 42787 primary data records. [2025-10-24T00:49:15.397878] [DEBUG] [LOCAL ] FTI: Loaded 53683 existing records from primary storage. [2025-10-24T00:49:15.438461] [INFO ] [MAIN ] FTI: Loaded 53683 primary data records. [2025-10-24T00:49:16.299764] [DEBUG] [MAIN ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:16.345569] [DEBUG] [MAIN ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:16.351330] [DEBUG] [MAIN ] FTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:16.431461] [INFO ] [MAIN ] FTS: Generated 139 derivative records from 42787 primary records. [2025-10-24T00:49:16.435221] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-24T00:49:16.439078] [FATAL] [LOCAL ] FTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:16.445250] [FATAL] [MAIN ] FTS: Failed to save derivative data. [2025-10-24T00:49:16.447392] [INFO ] [MAIN ] Derivative Progress: 796/2164 symbols completed. FTS took 1.2s. Estimated remaining: 9m 12s. Rate: 148.7 symbols/min [2025-10-24T00:49:16.447633] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:16.454359] [INFO ] [MAIN ] FTI: Generated 139 derivative records from 53683 primary records. [2025-10-24T00:49:16.456484] [INFO ] [MAIN ] FTK: Generated 139 derivative records from 33227 primary records. [2025-10-24T00:49:16.456710] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-24T00:49:16.456787] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-24T00:49:16.457174] [FATAL] [LOCAL ] FTI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:16.457489] [FATAL] [LOCAL ] FTK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:16.457688] [FATAL] [MAIN ] FTK: Failed to save derivative data. [2025-10-24T00:49:16.457845] [FATAL] [MAIN ] FTI: Failed to save derivative data. [2025-10-24T00:49:16.461385] [INFO ] [MAIN ] Derivative Progress: 797/2164 symbols completed. FTI took 1.3s. Estimated remaining: 9m 11s. Rate: 148.9 symbols/min [2025-10-24T00:49:16.464403] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:16.464617] [INFO ] [MAIN ] Derivative Progress: 798/2164 symbols completed. FTK took 1.3s. Estimated remaining: 9m 10s. Rate: 149.1 symbols/min [2025-10-24T00:49:16.465333] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:16.470816] [DEBUG] [LOCAL ] FTWO: Loaded 1966 existing records from primary storage. [2025-10-24T00:49:16.471125] [INFO ] [MAIN ] FTWO: Loaded 1966 primary data records. [2025-10-24T00:49:16.818790] [DEBUG] [LOCAL ] FTV: Loaded 53399 existing records from primary storage. [2025-10-24T00:49:16.833229] [INFO ] [MAIN ] FTV: Loaded 53399 primary data records. [2025-10-24T00:49:16.866436] [DEBUG] [LOCAL ] FUBO: Loaded 54106 existing records from primary storage. [2025-10-24T00:49:16.879388] [INFO ] [MAIN ] FUBO: Loaded 54106 primary data records. [2025-10-24T00:49:17.453021] [DEBUG] [MAIN ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:17.501758] [DEBUG] [MAIN ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:17.536594] [DEBUG] [MAIN ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:17.565421] [INFO ] [MAIN ] FTWO: Generated 139 derivative records from 1966 primary records. [2025-10-24T00:49:17.566705] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-24T00:49:17.569305] [FATAL] [LOCAL ] FTWO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:17.572169] [FATAL] [MAIN ] FTWO: Failed to save derivative data. [2025-10-24T00:49:17.574825] [INFO ] [MAIN ] Derivative Progress: 799/2164 symbols completed. FTWO took 1.1s. Estimated remaining: 9m 11s. Rate: 148.7 symbols/min [2025-10-24T00:49:17.583092] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:17.600025] [INFO ] [MAIN ] FTV: Generated 139 derivative records from 53399 primary records. [2025-10-24T00:49:17.600526] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-24T00:49:17.602970] [FATAL] [LOCAL ] FTV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:17.603507] [FATAL] [MAIN ] FTV: Failed to save derivative data. [2025-10-24T00:49:17.605689] [INFO ] [MAIN ] Derivative Progress: 800/2164 symbols completed. FTV took 1.2s. Estimated remaining: 9m 10s. Rate: 148.9 symbols/min [2025-10-24T00:49:17.605888] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:17.618767] [INFO ] [MAIN ] FUBO: Generated 139 derivative records from 54106 primary records. [2025-10-24T00:49:17.618966] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-24T00:49:17.619251] [FATAL] [LOCAL ] FUBO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:17.619428] [FATAL] [MAIN ] FUBO: Failed to save derivative data. [2025-10-24T00:49:17.622459] [INFO ] [MAIN ] Derivative Progress: 801/2164 symbols completed. FUBO took 1.2s. Estimated remaining: 9m 9s. Rate: 149.1 symbols/min [2025-10-24T00:49:17.622695] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:17.636807] [DEBUG] [LOCAL ] FUL: Loaded 32220 existing records from primary storage. [2025-10-24T00:49:17.637107] [INFO ] [MAIN ] FUL: Loaded 32220 primary data records. [2025-10-24T00:49:17.765907] [DEBUG] [LOCAL ] FVR: Loaded 20893 existing records from primary storage. [2025-10-24T00:49:17.792317] [INFO ] [MAIN ] FVR: Loaded 20893 primary data records. [2025-10-24T00:49:18.129676] [DEBUG] [LOCAL ] FUN: Loaded 52412 existing records from primary storage. [2025-10-24T00:49:18.141399] [INFO ] [MAIN ] FUN: Loaded 52412 primary data records. [2025-10-24T00:49:18.680410] [DEBUG] [MAIN ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:18.707468] [DEBUG] [MAIN ] FVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:18.763458] [DEBUG] [MAIN ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:18.798139] [INFO ] [MAIN ] FUL: Generated 139 derivative records from 32220 primary records. [2025-10-24T00:49:18.800098] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-24T00:49:18.800700] [FATAL] [LOCAL ] FUL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:18.802836] [FATAL] [MAIN ] FUL: Failed to save derivative data. [2025-10-24T00:49:18.806989] [INFO ] [MAIN ] Derivative Progress: 802/2164 symbols completed. FUL took 1.2s. Estimated remaining: 9m 9s. Rate: 148.7 symbols/min [2025-10-24T00:49:18.804866] [INFO ] [MAIN ] FVR: Generated 139 derivative records from 20893 primary records. [2025-10-24T00:49:18.810110] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:18.810738] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-24T00:49:18.811580] [FATAL] [LOCAL ] FVR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:18.812985] [FATAL] [MAIN ] FVR: Failed to save derivative data. [2025-10-24T00:49:18.817454] [INFO ] [MAIN ] Derivative Progress: 803/2164 symbols completed. FVR took 1.2s. Estimated remaining: 9m 8s. Rate: 148.9 symbols/min [2025-10-24T00:49:18.819715] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:18.832704] [INFO ] [MAIN ] FUN: Generated 139 derivative records from 52412 primary records. [2025-10-24T00:49:18.835231] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-24T00:49:18.835625] [FATAL] [LOCAL ] FUN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:18.835131] [DEBUG] [LOCAL ] FXED: Loaded 1237 existing records from primary storage. [2025-10-24T00:49:18.835767] [FATAL] [MAIN ] FUN: Failed to save derivative data. [2025-10-24T00:49:18.838898] [INFO ] [MAIN ] Derivative Progress: 804/2164 symbols completed. FUN took 1.2s. Estimated remaining: 9m 7s. Rate: 149.1 symbols/min [2025-10-24T00:49:18.839315] [INFO ] [MAIN ] FXED: Loaded 1237 primary data records. [2025-10-24T00:49:18.839064] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:19.162490] [DEBUG] [LOCAL ] FVRR: Loaded 40750 existing records from primary storage. [2025-10-24T00:49:19.174271] [INFO ] [MAIN ] FVRR: Loaded 40750 primary data records. [2025-10-24T00:49:19.321084] [DEBUG] [LOCAL ] G: Loaded 50463 existing records from primary storage. [2025-10-24T00:49:19.327238] [INFO ] [MAIN ] G: Loaded 50463 primary data records. [2025-10-24T00:49:19.891967] [DEBUG] [MAIN ] FXED: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:19.954716] [DEBUG] [MAIN ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:19.979605] [INFO ] [MAIN ] FXED: Generated 139 derivative records from 1237 primary records. [2025-10-24T00:49:19.985513] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-24T00:49:19.987556] [FATAL] [LOCAL ] FXED: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:19.991119] [FATAL] [MAIN ] FXED: Failed to save derivative data. [2025-10-24T00:49:19.993280] [INFO ] [MAIN ] Derivative Progress: 805/2164 symbols completed. FXED took 1.2s. Estimated remaining: 9m 8s. Rate: 148.7 symbols/min [2025-10-24T00:49:19.993611] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:20.009141] [DEBUG] [MAIN ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:20.049148] [INFO ] [MAIN ] FVRR: Generated 139 derivative records from 40750 primary records. [2025-10-24T00:49:20.058349] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-24T00:49:20.059572] [FATAL] [LOCAL ] FVRR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:20.059974] [FATAL] [MAIN ] FVRR: Failed to save derivative data. [2025-10-24T00:49:20.063365] [INFO ] [MAIN ] Derivative Progress: 806/2164 symbols completed. FVRR took 1.3s. Estimated remaining: 9m 7s. Rate: 148.9 symbols/min [2025-10-24T00:49:20.060509] [DEBUG] [LOCAL ] GAB: Loaded 27609 existing records from primary storage. [2025-10-24T00:49:20.063780] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:20.063896] [INFO ] [MAIN ] GAB: Loaded 27609 primary data records. [2025-10-24T00:49:20.155108] [DEBUG] [LOCAL ] GAM: Loaded 3836 existing records from primary storage. [2025-10-24T00:49:20.180415] [INFO ] [MAIN ] GAM: Loaded 3836 primary data records. [2025-10-24T00:49:20.499514] [INFO ] [MAIN ] G: Generated 139 derivative records from 50463 primary records. [2025-10-24T00:49:20.523599] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-24T00:49:20.551726] [FATAL] [LOCAL ] G: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:20.559361] [FATAL] [MAIN ] G: Failed to save derivative data. [2025-10-24T00:49:20.583080] [INFO ] [MAIN ] Derivative Progress: 807/2164 symbols completed. G took 1.7s. Estimated remaining: 9m 7s. Rate: 148.8 symbols/min [2025-10-24T00:49:20.699234] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:20.725004] [DEBUG] [MAIN ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:20.775187] [DEBUG] [MAIN ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:20.827343] [DEBUG] [LOCAL ] GAP: Loaded 54043 existing records from primary storage. [2025-10-24T00:49:20.834515] [INFO ] [MAIN ] GAP: Loaded 54043 primary data records. [2025-10-24T00:49:20.918198] [INFO ] [MAIN ] GAB: Generated 139 derivative records from 27609 primary records. [2025-10-24T00:49:20.952627] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-24T00:49:20.961706] [FATAL] [LOCAL ] GAB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:20.967898] [FATAL] [MAIN ] GAB: Failed to save derivative data. [2025-10-24T00:49:20.977765] [INFO ] [MAIN ] Derivative Progress: 808/2164 symbols completed. GAB took 1.0s. Estimated remaining: 9m 7s. Rate: 148.8 symbols/min [2025-10-24T00:49:21.161618] [INFO ] [MAIN ] GAM: Generated 139 derivative records from 3836 primary records. [2025-10-24T00:49:21.193100] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-24T00:49:21.193556] [FATAL] [LOCAL ] GAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:21.193637] [FATAL] [MAIN ] GAM: Failed to save derivative data. [2025-10-24T00:49:21.196672] [INFO ] [MAIN ] Derivative Progress: 809/2164 symbols completed. GAM took 1.1s. Estimated remaining: 9m 6s. Rate: 148.9 symbols/min [2025-10-24T00:49:21.219285] [DEBUG] [MAIN ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:21.245117] [INFO ] [MAIN ] GAP: Generated 139 derivative records from 54043 primary records. [2025-10-24T00:49:21.245290] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-24T00:49:21.245487] [FATAL] [LOCAL ] GAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:21.245562] [FATAL] [MAIN ] GAP: Failed to save derivative data. [2025-10-24T00:49:21.247711] [INFO ] [MAIN ] Derivative Progress: 810/2164 symbols completed. GAP took 0.5s. Estimated remaining: 9m 5s. Rate: 149.1 symbols/min [2025-10-24T00:49:21.248270] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:21.248169] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:21.249153] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:21.271322] [DEBUG] [LOCAL ] GBAB: Loaded 12790 existing records from primary storage. [2025-10-24T00:49:21.271699] [INFO ] [MAIN ] GBAB: Loaded 12790 primary data records. [2025-10-24T00:49:21.355871] [DEBUG] [LOCAL ] GATX: Loaded 18194 existing records from primary storage. [2025-10-24T00:49:21.394956] [INFO ] [MAIN ] GATX: Loaded 18194 primary data records. [2025-10-24T00:49:21.519388] [DEBUG] [LOCAL ] GBCI: Loaded 41514 existing records from primary storage. [2025-10-24T00:49:21.593978] [INFO ] [MAIN ] GBCI: Loaded 41514 primary data records. [2025-10-24T00:49:22.326281] [DEBUG] [MAIN ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:22.360076] [DEBUG] [MAIN ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:22.408025] [DEBUG] [MAIN ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:22.464859] [INFO ] [MAIN ] GBAB: Generated 139 derivative records from 12790 primary records. [2025-10-24T00:49:22.471477] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-24T00:49:22.475903] [FATAL] [LOCAL ] GBAB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:22.476493] [FATAL] [MAIN ] GBAB: Failed to save derivative data. [2025-10-24T00:49:22.479818] [INFO ] [MAIN ] Derivative Progress: 811/2164 symbols completed. GBAB took 1.2s. Estimated remaining: 9m 6s. Rate: 148.7 symbols/min [2025-10-24T00:49:22.487452] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:22.494950] [INFO ] [MAIN ] GBCI: Generated 139 derivative records from 41514 primary records. [2025-10-24T00:49:22.495398] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-24T00:49:22.495693] [FATAL] [LOCAL ] GBCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:22.495943] [FATAL] [MAIN ] GBCI: Failed to save derivative data. [2025-10-24T00:49:22.503500] [INFO ] [MAIN ] Derivative Progress: 812/2164 symbols completed. GBCI took 1.3s. Estimated remaining: 9m 5s. Rate: 148.9 symbols/min [2025-10-24T00:49:22.498594] [INFO ] [MAIN ] GATX: Generated 139 derivative records from 18194 primary records. [2025-10-24T00:49:22.504045] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:22.504104] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-24T00:49:22.504961] [FATAL] [LOCAL ] GATX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:22.505203] [FATAL] [MAIN ] GATX: Failed to save derivative data. [2025-10-24T00:49:22.508333] [INFO ] [MAIN ] Derivative Progress: 813/2164 symbols completed. GATX took 1.3s. Estimated remaining: 9m 4s. Rate: 149.1 symbols/min [2025-10-24T00:49:22.508779] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:22.545933] [DEBUG] [LOCAL ] GBTG: Loaded 40489 existing records from primary storage. [2025-10-24T00:49:22.546238] [INFO ] [MAIN ] GBTG: Loaded 40489 primary data records. [2025-10-24T00:49:22.619018] [DEBUG] [LOCAL ] GBX: Loaded 28356 existing records from primary storage. [2025-10-24T00:49:22.631485] [INFO ] [MAIN ] GBX: Loaded 28356 primary data records. [2025-10-24T00:49:22.815998] [DEBUG] [LOCAL ] GCI: Loaded 43883 existing records from primary storage. [2025-10-24T00:49:22.874182] [INFO ] [MAIN ] GCI: Loaded 43883 primary data records. [2025-10-24T00:49:23.564515] [DEBUG] [MAIN ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:23.611628] [DEBUG] [MAIN ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:23.647247] [DEBUG] [MAIN ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:23.692987] [INFO ] [MAIN ] GBTG: Generated 139 derivative records from 40489 primary records. [2025-10-24T00:49:23.696564] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-24T00:49:23.698760] [FATAL] [LOCAL ] GBTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:23.701271] [FATAL] [MAIN ] GBTG: Failed to save derivative data. [2025-10-24T00:49:23.703620] [INFO ] [MAIN ] Derivative Progress: 814/2164 symbols completed. GBTG took 1.2s. Estimated remaining: 9m 5s. Rate: 148.7 symbols/min [2025-10-24T00:49:23.704513] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:23.723560] [INFO ] [MAIN ] GBX: Generated 139 derivative records from 28356 primary records. [2025-10-24T00:49:23.723226] [INFO ] [MAIN ] GCI: Generated 139 derivative records from 43883 primary records. [2025-10-24T00:49:23.729876] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-24T00:49:23.730245] [FATAL] [LOCAL ] GBX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:23.730313] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-24T00:49:23.730523] [FATAL] [MAIN ] GBX: Failed to save derivative data. [2025-10-24T00:49:23.730781] [FATAL] [LOCAL ] GCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:23.730876] [FATAL] [MAIN ] GCI: Failed to save derivative data. [2025-10-24T00:49:23.734588] [INFO ] [MAIN ] Derivative Progress: 815/2164 symbols completed. GBX took 1.2s. Estimated remaining: 9m 4s. Rate: 148.9 symbols/min [2025-10-24T00:49:23.739471] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:23.739524] [INFO ] [MAIN ] Derivative Progress: 816/2164 symbols completed. GCI took 1.2s. Estimated remaining: 9m 3s. Rate: 149.1 symbols/min [2025-10-24T00:49:23.740301] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:23.749602] [DEBUG] [LOCAL ] GCO: Loaded 22941 existing records from primary storage. [2025-10-24T00:49:23.749832] [INFO ] [MAIN ] GCO: Loaded 22941 primary data records. [2025-10-24T00:49:23.856186] [DEBUG] [LOCAL ] GCV: Loaded 7854 existing records from primary storage. [2025-10-24T00:49:23.883364] [INFO ] [MAIN ] GCV: Loaded 7854 primary data records. [2025-10-24T00:49:23.884254] [DEBUG] [LOCAL ] GCTS: Loaded 20365 existing records from primary storage. [2025-10-24T00:49:23.885335] [INFO ] [MAIN ] GCTS: Loaded 20365 primary data records. [2025-10-24T00:49:24.765716] [DEBUG] [MAIN ] GCO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:24.822420] [DEBUG] [MAIN ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:24.823013] [DEBUG] [MAIN ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:24.905301] [INFO ] [MAIN ] GCO: Generated 139 derivative records from 22941 primary records. [2025-10-24T00:49:24.911604] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-24T00:49:24.915748] [FATAL] [LOCAL ] GCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:24.915930] [FATAL] [MAIN ] GCO: Failed to save derivative data. [2025-10-24T00:49:24.920303] [INFO ] [MAIN ] Derivative Progress: 817/2164 symbols completed. GCO took 1.2s. Estimated remaining: 9m 3s. Rate: 148.7 symbols/min [2025-10-24T00:49:24.922847] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:24.926103] [INFO ] [MAIN ] GCV: Generated 139 derivative records from 7854 primary records. [2025-10-24T00:49:24.928390] [INFO ] [MAIN ] GCTS: Generated 139 derivative records from 20365 primary records. [2025-10-24T00:49:24.928626] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-24T00:49:24.928992] [FATAL] [LOCAL ] GCV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:24.929174] [FATAL] [MAIN ] GCV: Failed to save derivative data. [2025-10-24T00:49:24.932307] [INFO ] [MAIN ] Derivative Progress: 818/2164 symbols completed. GCV took 1.2s. Estimated remaining: 9m 2s. Rate: 148.9 symbols/min [2025-10-24T00:49:24.932485] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-24T00:49:24.932919] [FATAL] [LOCAL ] GCTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:24.933230] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:24.933332] [FATAL] [MAIN ] GCTS: Failed to save derivative data. [2025-10-24T00:49:24.936743] [INFO ] [MAIN ] Derivative Progress: 819/2164 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 1s. Rate: 149.1 symbols/min [2025-10-24T00:49:24.937125] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:24.945564] [DEBUG] [LOCAL ] GDIV: Loaded 3522 existing records from primary storage. [2025-10-24T00:49:24.946210] [INFO ] [MAIN ] GDIV: Loaded 3522 primary data records. [2025-10-24T00:49:25.298115] [DEBUG] [LOCAL ] GDDY: Loaded 49956 existing records from primary storage. [2025-10-24T00:49:25.310855] [INFO ] [MAIN ] GDDY: Loaded 49956 primary data records. [2025-10-24T00:49:25.322048] [DEBUG] [LOCAL ] GD: Loaded 46837 existing records from primary storage. [2025-10-24T00:49:25.346114] [INFO ] [MAIN ] GD: Loaded 46837 primary data records. [2025-10-24T00:49:26.076551] [DEBUG] [MAIN ] GDIV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:26.130989] [DEBUG] [MAIN ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:26.175300] [DEBUG] [MAIN ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:26.191886] [INFO ] [MAIN ] GDIV: Generated 139 derivative records from 3522 primary records. [2025-10-24T00:49:26.196385] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-24T00:49:26.201837] [FATAL] [LOCAL ] GDIV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:26.202375] [FATAL] [MAIN ] GDIV: Failed to save derivative data. [2025-10-24T00:49:26.208209] [INFO ] [MAIN ] Derivative Progress: 820/2164 symbols completed. GDIV took 1.3s. Estimated remaining: 9m 2s. Rate: 148.7 symbols/min [2025-10-24T00:49:26.208468] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:26.233929] [DEBUG] [LOCAL ] GDO: Loaded 5905 existing records from primary storage. [2025-10-24T00:49:26.235704] [INFO ] [MAIN ] GDO: Loaded 5905 primary data records. [2025-10-24T00:49:26.261080] [INFO ] [MAIN ] GD: Generated 139 derivative records from 46837 primary records. [2025-10-24T00:49:26.280820] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-24T00:49:26.294353] [FATAL] [LOCAL ] GD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:26.322969] [FATAL] [MAIN ] GD: Failed to save derivative data. [2025-10-24T00:49:26.337136] [INFO ] [MAIN ] Derivative Progress: 821/2164 symbols completed. GD took 1.4s. Estimated remaining: 9m 2s. Rate: 148.8 symbols/min [2025-10-24T00:49:26.356634] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:26.409084] [INFO ] [MAIN ] GDDY: Generated 139 derivative records from 49956 primary records. [2025-10-24T00:49:26.445522] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-24T00:49:26.446782] [FATAL] [LOCAL ] GDDY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:26.567329] [FATAL] [MAIN ] GDDY: Failed to save derivative data. [2025-10-24T00:49:26.582340] [INFO ] [MAIN ] Derivative Progress: 822/2164 symbols completed. GDDY took 1.6s. Estimated remaining: 9m 1s. Rate: 148.9 symbols/min [2025-10-24T00:49:26.582808] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:26.612695] [DEBUG] [LOCAL ] GDOT: Loaded 37911 existing records from primary storage. [2025-10-24T00:49:26.613385] [INFO ] [MAIN ] GDOT: Loaded 37911 primary data records. [2025-10-24T00:49:26.745710] [DEBUG] [LOCAL ] GDV: Loaded 19241 existing records from primary storage. [2025-10-24T00:49:26.832001] [INFO ] [MAIN ] GDV: Loaded 19241 primary data records. [2025-10-24T00:49:26.831821] [DEBUG] [MAIN ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:27.316441] [INFO ] [MAIN ] GDO: Generated 139 derivative records from 5905 primary records. [2025-10-24T00:49:27.319098] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-24T00:49:27.320296] [FATAL] [LOCAL ] GDO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:27.320451] [FATAL] [MAIN ] GDO: Failed to save derivative data. [2025-10-24T00:49:27.324075] [INFO ] [MAIN ] Derivative Progress: 823/2164 symbols completed. GDO took 1.1s. Estimated remaining: 9m 1s. Rate: 148.7 symbols/min [2025-10-24T00:49:27.339144] [DEBUG] [MAIN ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:27.376231] [DEBUG] [MAIN ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:27.406437] [INFO ] [MAIN ] GDOT: Generated 139 derivative records from 37911 primary records. [2025-10-24T00:49:27.406704] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-24T00:49:27.406948] [FATAL] [LOCAL ] GDOT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:27.407063] [FATAL] [MAIN ] GDOT: Failed to save derivative data. [2025-10-24T00:49:27.409926] [INFO ] [MAIN ] Derivative Progress: 824/2164 symbols completed. GDOT took 1.1s. Estimated remaining: 9m 0s. Rate: 148.9 symbols/min [2025-10-24T00:49:27.420558] [INFO ] [MAIN ] GDV: Generated 139 derivative records from 19241 primary records. [2025-10-24T00:49:27.420846] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-24T00:49:27.421097] [FATAL] [LOCAL ] GDV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:27.421178] [FATAL] [MAIN ] GDV: Failed to save derivative data. [2025-10-24T00:49:27.426156] [INFO ] [MAIN ] Derivative Progress: 825/2164 symbols completed. GDV took 0.8s. Estimated remaining: 8m 59s. Rate: 149.0 symbols/min [2025-10-24T00:49:27.426764] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:27.426681] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:27.427920] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:27.451552] [DEBUG] [LOCAL ] GEF: Loaded 20824 existing records from primary storage. [2025-10-24T00:49:27.451717] [INFO ] [MAIN ] GEF: Loaded 20824 primary data records. [2025-10-24T00:49:27.588536] [DEBUG] [LOCAL ] GEL: Loaded 31358 existing records from primary storage. [2025-10-24T00:49:27.605686] [INFO ] [MAIN ] GEL: Loaded 31358 primary data records. [2025-10-24T00:49:27.804491] [DEBUG] [LOCAL ] GE: Loaded 54083 existing records from primary storage. [2025-10-24T00:49:27.943016] [INFO ] [MAIN ] GE: Loaded 54083 primary data records. [2025-10-24T00:49:28.558696] [DEBUG] [MAIN ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:28.599738] [DEBUG] [MAIN ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:28.647207] [DEBUG] [MAIN ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:28.704796] [INFO ] [MAIN ] GEF: Generated 139 derivative records from 20824 primary records. [2025-10-24T00:49:28.708316] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-24T00:49:28.709002] [FATAL] [LOCAL ] GEF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:28.710969] [FATAL] [MAIN ] GEF: Failed to save derivative data. [2025-10-24T00:49:28.718277] [INFO ] [MAIN ] Derivative Progress: 826/2164 symbols completed. GEF took 1.3s. Estimated remaining: 9m 0s. Rate: 148.6 symbols/min [2025-10-24T00:49:28.719086] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:28.731719] [INFO ] [MAIN ] GEL: Generated 139 derivative records from 31358 primary records. [2025-10-24T00:49:28.732243] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-24T00:49:28.734238] [FATAL] [LOCAL ] GEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:28.734442] [FATAL] [MAIN ] GEL: Failed to save derivative data. [2025-10-24T00:49:28.737385] [INFO ] [MAIN ] Derivative Progress: 827/2164 symbols completed. GEL took 1.3s. Estimated remaining: 8m 59s. Rate: 148.8 symbols/min [2025-10-24T00:49:28.740589] [INFO ] [MAIN ] GE: Generated 139 derivative records from 54083 primary records. [2025-10-24T00:49:28.740791] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:28.741226] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-24T00:49:28.741473] [FATAL] [LOCAL ] GE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:28.741632] [FATAL] [MAIN ] GE: Failed to save derivative data. [2025-10-24T00:49:28.745241] [INFO ] [MAIN ] Derivative Progress: 828/2164 symbols completed. GE took 1.3s. Estimated remaining: 8m 58s. Rate: 149.0 symbols/min [2025-10-24T00:49:28.745822] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:28.811960] [DEBUG] [LOCAL ] GENI: Loaded 53310 existing records from primary storage. [2025-10-24T00:49:28.813001] [INFO ] [MAIN ] GENI: Loaded 53310 primary data records. [2025-10-24T00:49:28.850880] [DEBUG] [LOCAL ] GEO: Loaded 52037 existing records from primary storage. [2025-10-24T00:49:28.897813] [INFO ] [MAIN ] GEO: Loaded 52037 primary data records. [2025-10-24T00:49:28.898633] [DEBUG] [LOCAL ] GES: Loaded 38089 existing records from primary storage. [2025-10-24T00:49:28.950802] [INFO ] [MAIN ] GES: Loaded 38089 primary data records. [2025-10-24T00:49:29.834071] [DEBUG] [MAIN ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:29.872465] [DEBUG] [MAIN ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:29.872799] [DEBUG] [MAIN ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:29.964507] [INFO ] [MAIN ] GES: Generated 139 derivative records from 38089 primary records. [2025-10-24T00:49:29.966613] [INFO ] [MAIN ] GEO: Generated 139 derivative records from 52037 primary records. [2025-10-24T00:49:29.966690] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-24T00:49:29.966858] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-24T00:49:29.970094] [FATAL] [LOCAL ] GES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:29.971667] [FATAL] [MAIN ] GES: Failed to save derivative data. [2025-10-24T00:49:29.971511] [FATAL] [LOCAL ] GEO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:29.971855] [FATAL] [MAIN ] GEO: Failed to save derivative data. [2025-10-24T00:49:29.975092] [INFO ] [MAIN ] Derivative Progress: 829/2164 symbols completed. GES took 1.2s. Estimated remaining: 8m 59s. Rate: 148.6 symbols/min [2025-10-24T00:49:29.978390] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:29.978474] [INFO ] [MAIN ] Derivative Progress: 830/2164 symbols completed. GEO took 1.2s. Estimated remaining: 8m 58s. Rate: 148.8 symbols/min [2025-10-24T00:49:29.979221] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:29.984565] [INFO ] [MAIN ] GENI: Generated 139 derivative records from 53310 primary records. [2025-10-24T00:49:29.985002] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-24T00:49:29.985258] [FATAL] [LOCAL ] GENI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:29.985444] [FATAL] [MAIN ] GENI: Failed to save derivative data. [2025-10-24T00:49:29.987382] [INFO ] [MAIN ] Derivative Progress: 831/2164 symbols completed. GENI took 1.3s. Estimated remaining: 8m 57s. Rate: 149.0 symbols/min [2025-10-24T00:49:29.987704] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:29.993241] [DEBUG] [LOCAL ] GF: Loaded 2643 existing records from primary storage. [2025-10-24T00:49:29.993444] [INFO ] [MAIN ] GF: Loaded 2643 primary data records. [2025-10-24T00:49:30.119019] [DEBUG] [LOCAL ] GETY: Loaded 35534 existing records from primary storage. [2025-10-24T00:49:30.130325] [INFO ] [MAIN ] GETY: Loaded 35534 primary data records. [2025-10-24T00:49:30.504843] [DEBUG] [LOCAL ] GEV: Loaded 53379 existing records from primary storage. [2025-10-24T00:49:30.523557] [INFO ] [MAIN ] GEV: Loaded 53379 primary data records. [2025-10-24T00:49:31.031972] [DEBUG] [MAIN ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:31.060073] [DEBUG] [MAIN ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:31.106979] [DEBUG] [MAIN ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:31.152216] [INFO ] [MAIN ] GF: Generated 139 derivative records from 2643 primary records. [2025-10-24T00:49:31.158175] [INFO ] [MAIN ] GETY: Generated 139 derivative records from 35534 primary records. [2025-10-24T00:49:31.157450] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-24T00:49:31.159476] [FATAL] [LOCAL ] GF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:31.159564] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-24T00:49:31.159837] [FATAL] [MAIN ] GF: Failed to save derivative data. [2025-10-24T00:49:31.160308] [FATAL] [LOCAL ] GETY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:31.164839] [INFO ] [MAIN ] Derivative Progress: 832/2164 symbols completed. GF took 1.2s. Estimated remaining: 8m 58s. Rate: 148.6 symbols/min [2025-10-24T00:49:31.164950] [FATAL] [MAIN ] GETY: Failed to save derivative data. [2025-10-24T00:49:31.168007] [INFO ] [MAIN ] Derivative Progress: 833/2164 symbols completed. GETY took 1.2s. Estimated remaining: 8m 57s. Rate: 148.8 symbols/min [2025-10-24T00:49:31.167906] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:31.170014] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:31.176899] [INFO ] [MAIN ] GEV: Generated 139 derivative records from 53379 primary records. [2025-10-24T00:49:31.177221] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-24T00:49:31.177467] [FATAL] [LOCAL ] GEV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:31.177545] [FATAL] [MAIN ] GEV: Failed to save derivative data. [2025-10-24T00:49:31.180531] [INFO ] [MAIN ] Derivative Progress: 834/2164 symbols completed. GEV took 1.2s. Estimated remaining: 8m 56s. Rate: 149.0 symbols/min [2025-10-24T00:49:31.180777] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:31.224843] [DEBUG] [LOCAL ] GFF: Loaded 29553 existing records from primary storage. [2025-10-24T00:49:31.225192] [INFO ] [MAIN ] GFF: Loaded 29553 primary data records. [2025-10-24T00:49:31.357322] [DEBUG] [LOCAL ] GFI: Loaded 53505 existing records from primary storage. [2025-10-24T00:49:31.368927] [INFO ] [MAIN ] GFI: Loaded 53505 primary data records. [2025-10-24T00:49:31.600925] [DEBUG] [LOCAL ] GFL: Loaded 47819 existing records from primary storage. [2025-10-24T00:49:31.643087] [INFO ] [MAIN ] GFL: Loaded 47819 primary data records. [2025-10-24T00:49:32.221608] [DEBUG] [MAIN ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:32.254800] [DEBUG] [MAIN ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:32.299176] [DEBUG] [MAIN ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:32.340016] [INFO ] [MAIN ] GFF: Generated 139 derivative records from 29553 primary records. [2025-10-24T00:49:32.341047] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-24T00:49:32.342882] [FATAL] [LOCAL ] GFF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:32.342990] [FATAL] [MAIN ] GFF: Failed to save derivative data. [2025-10-24T00:49:32.345569] [INFO ] [MAIN ] Derivative Progress: 835/2164 symbols completed. GFF took 1.2s. Estimated remaining: 8m 56s. Rate: 148.6 symbols/min [2025-10-24T00:49:32.349504] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:32.362951] [INFO ] [MAIN ] GFI: Generated 139 derivative records from 53505 primary records. [2025-10-24T00:49:32.366971] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-24T00:49:32.369863] [FATAL] [LOCAL ] GFI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:32.370962] [FATAL] [MAIN ] GFI: Failed to save derivative data. [2025-10-24T00:49:32.377616] [INFO ] [MAIN ] Derivative Progress: 836/2164 symbols completed. GFI took 1.2s. Estimated remaining: 8m 56s. Rate: 148.8 symbols/min [2025-10-24T00:49:32.378787] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:32.378010] [DEBUG] [LOCAL ] GFR: Loaded 7396 existing records from primary storage. [2025-10-24T00:49:32.379234] [INFO ] [MAIN ] GFR: Loaded 7396 primary data records. [2025-10-24T00:49:32.402638] [INFO ] [MAIN ] GFL: Generated 139 derivative records from 47819 primary records. [2025-10-24T00:49:32.448940] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-24T00:49:32.467050] [FATAL] [LOCAL ] GFL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:32.477800] [FATAL] [MAIN ] GFL: Failed to save derivative data. [2025-10-24T00:49:32.495381] [INFO ] [MAIN ] Derivative Progress: 837/2164 symbols completed. GFL took 1.3s. Estimated remaining: 8m 55s. Rate: 148.9 symbols/min [2025-10-24T00:49:32.512087] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:32.752617] [DEBUG] [LOCAL ] GGB: Loaded 51938 existing records from primary storage. [2025-10-24T00:49:32.753335] [INFO ] [MAIN ] GGB: Loaded 51938 primary data records. [2025-10-24T00:49:32.961996] [DEBUG] [MAIN ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:32.996226] [DEBUG] [LOCAL ] GGG: Loaded 40930 existing records from primary storage. [2025-10-24T00:49:33.113552] [INFO ] [MAIN ] GGG: Loaded 40930 primary data records. [2025-10-24T00:49:33.524231] [DEBUG] [MAIN ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:33.523823] [INFO ] [MAIN ] GFR: Generated 139 derivative records from 7396 primary records. [2025-10-24T00:49:33.536353] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-24T00:49:33.542344] [FATAL] [LOCAL ] GFR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:33.544792] [FATAL] [MAIN ] GFR: Failed to save derivative data. [2025-10-24T00:49:33.551798] [INFO ] [MAIN ] Derivative Progress: 838/2164 symbols completed. GFR took 1.2s. Estimated remaining: 8m 55s. Rate: 148.6 symbols/min [2025-10-24T00:49:33.583812] [DEBUG] [MAIN ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:33.585678] [INFO ] [MAIN ] GGB: Generated 139 derivative records from 51938 primary records. [2025-10-24T00:49:33.597444] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-24T00:49:33.598637] [FATAL] [LOCAL ] GGB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:33.600716] [FATAL] [MAIN ] GGB: Failed to save derivative data. [2025-10-24T00:49:33.603169] [INFO ] [MAIN ] Derivative Progress: 839/2164 symbols completed. GGB took 1.2s. Estimated remaining: 8m 54s. Rate: 148.8 symbols/min [2025-10-24T00:49:33.617072] [INFO ] [MAIN ] GGG: Generated 139 derivative records from 40930 primary records. [2025-10-24T00:49:33.617219] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-24T00:49:33.617441] [FATAL] [LOCAL ] GGG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:33.617521] [FATAL] [MAIN ] GGG: Failed to save derivative data. [2025-10-24T00:49:33.623561] [INFO ] [MAIN ] Derivative Progress: 840/2164 symbols completed. GGG took 1.1s. Estimated remaining: 8m 53s. Rate: 149.0 symbols/min [2025-10-24T00:49:33.624214] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:33.624351] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:33.625113] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:33.633478] [DEBUG] [LOCAL ] GGZ: Loaded 2357 existing records from primary storage. [2025-10-24T00:49:33.633747] [INFO ] [MAIN ] GGZ: Loaded 2357 primary data records. [2025-10-24T00:49:33.681099] [DEBUG] [LOCAL ] GHC: Loaded 2978 existing records from primary storage. [2025-10-24T00:49:33.733009] [DEBUG] [LOCAL ] GGT: Loaded 14575 existing records from primary storage. [2025-10-24T00:49:33.738636] [INFO ] [MAIN ] GGT: Loaded 14575 primary data records. [2025-10-24T00:49:33.738384] [INFO ] [MAIN ] GHC: Loaded 2978 primary data records. [2025-10-24T00:49:34.735090] [DEBUG] [MAIN ] GHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:34.750306] [DEBUG] [MAIN ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:34.787504] [DEBUG] [MAIN ] GGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:34.883519] [INFO ] [MAIN ] GGZ: Generated 139 derivative records from 2357 primary records. [2025-10-24T00:49:34.887830] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-24T00:49:34.888637] [FATAL] [LOCAL ] GGZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:34.888891] [FATAL] [MAIN ] GGZ: Failed to save derivative data. [2025-10-24T00:49:34.889416] [INFO ] [MAIN ] GHC: Generated 139 derivative records from 2978 primary records. [2025-10-24T00:49:34.891506] [INFO ] [MAIN ] Derivative Progress: 841/2164 symbols completed. GGZ took 1.3s. Estimated remaining: 8m 54s. Rate: 148.6 symbols/min [2025-10-24T00:49:34.894223] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:34.895034] [INFO ] [MAIN ] GGT: Generated 139 derivative records from 14575 primary records. [2025-10-24T00:49:34.895268] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-24T00:49:34.895845] [FATAL] [LOCAL ] GGT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:34.894595] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-24T00:49:34.895969] [FATAL] [MAIN ] GGT: Failed to save derivative data. [2025-10-24T00:49:34.900031] [INFO ] [MAIN ] Derivative Progress: 842/2164 symbols completed. GGT took 1.3s. Estimated remaining: 8m 53s. Rate: 148.8 symbols/min [2025-10-24T00:49:34.900637] [FATAL] [LOCAL ] GHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:34.900760] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:34.902320] [FATAL] [MAIN ] GHC: Failed to save derivative data. [2025-10-24T00:49:34.907484] [INFO ] [MAIN ] Derivative Progress: 843/2164 symbols completed. GHC took 1.3s. Estimated remaining: 8m 52s. Rate: 148.9 symbols/min [2025-10-24T00:49:34.911389] [DEBUG] [LOCAL ] GHG: Loaded 3296 existing records from primary storage. [2025-10-24T00:49:34.908008] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:34.912377] [INFO ] [MAIN ] GHG: Loaded 3296 primary data records. [2025-10-24T00:49:35.002563] [DEBUG] [LOCAL ] GHLD: Loaded 4346 existing records from primary storage. [2025-10-24T00:49:35.029553] [DEBUG] [LOCAL ] GHI: Loaded 7953 existing records from primary storage. [2025-10-24T00:49:35.035130] [INFO ] [MAIN ] GHLD: Loaded 4346 primary data records. [2025-10-24T00:49:35.068800] [INFO ] [MAIN ] GHI: Loaded 7953 primary data records. [2025-10-24T00:49:35.888362] [DEBUG] [MAIN ] GHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:35.946128] [DEBUG] [MAIN ] GHLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:35.948035] [DEBUG] [MAIN ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:36.011889] [INFO ] [MAIN ] GHG: Generated 139 derivative records from 3296 primary records. [2025-10-24T00:49:36.015419] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-24T00:49:36.018721] [FATAL] [LOCAL ] GHG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:36.022688] [FATAL] [MAIN ] GHG: Failed to save derivative data. [2025-10-24T00:49:36.028856] [INFO ] [MAIN ] Derivative Progress: 844/2164 symbols completed. GHG took 1.1s. Estimated remaining: 8m 53s. Rate: 148.6 symbols/min [2025-10-24T00:49:36.032369] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:36.043431] [INFO ] [MAIN ] GHLD: Generated 139 derivative records from 4346 primary records. [2025-10-24T00:49:36.051278] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-24T00:49:36.052065] [FATAL] [LOCAL ] GHLD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:36.051617] [INFO ] [MAIN ] GHI: Generated 139 derivative records from 7953 primary records. [2025-10-24T00:49:36.052226] [FATAL] [MAIN ] GHLD: Failed to save derivative data. [2025-10-24T00:49:36.052463] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-24T00:49:36.056928] [FATAL] [LOCAL ] GHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:36.056445] [INFO ] [MAIN ] Derivative Progress: 845/2164 symbols completed. GHLD took 1.1s. Estimated remaining: 8m 52s. Rate: 148.8 symbols/min [2025-10-24T00:49:36.063210] [FATAL] [MAIN ] GHI: Failed to save derivative data. [2025-10-24T00:49:36.063700] [DEBUG] [LOCAL ] GHM: Loaded 14417 existing records from primary storage. [2025-10-24T00:49:36.068559] [INFO ] [MAIN ] Derivative Progress: 846/2164 symbols completed. GHI took 1.2s. Estimated remaining: 8m 51s. Rate: 148.9 symbols/min [2025-10-24T00:49:36.063142] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:36.069157] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:36.069210] [INFO ] [MAIN ] GHM: Loaded 14417 primary data records. [2025-10-24T00:49:36.386855] [DEBUG] [LOCAL ] GHY: Loaded 21009 existing records from primary storage. [2025-10-24T00:49:36.396421] [INFO ] [MAIN ] GHY: Loaded 21009 primary data records. [2025-10-24T00:49:36.481570] [DEBUG] [LOCAL ] GIB: Loaded 31579 existing records from primary storage. [2025-10-24T00:49:36.504551] [INFO ] [MAIN ] GIB: Loaded 31579 primary data records. [2025-10-24T00:49:37.082566] [DEBUG] [MAIN ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:37.131318] [DEBUG] [MAIN ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:37.159100] [DEBUG] [MAIN ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:37.186480] [INFO ] [MAIN ] GHM: Generated 139 derivative records from 14417 primary records. [2025-10-24T00:49:37.187056] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-24T00:49:37.190212] [FATAL] [LOCAL ] GHM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:37.193417] [FATAL] [MAIN ] GHM: Failed to save derivative data. [2025-10-24T00:49:37.197119] [INFO ] [MAIN ] Derivative Progress: 847/2164 symbols completed. GHM took 1.2s. Estimated remaining: 8m 52s. Rate: 148.6 symbols/min [2025-10-24T00:49:37.197563] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:37.229852] [INFO ] [MAIN ] GHY: Generated 139 derivative records from 21009 primary records. [2025-10-24T00:49:37.227714] [DEBUG] [LOCAL ] GIC: Loaded 13240 existing records from primary storage. [2025-10-24T00:49:37.231210] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-24T00:49:37.231470] [FATAL] [LOCAL ] GHY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:37.231777] [FATAL] [MAIN ] GHY: Failed to save derivative data. [2025-10-24T00:49:37.231848] [INFO ] [MAIN ] GIC: Loaded 13240 primary data records. [2025-10-24T00:49:37.234709] [INFO ] [MAIN ] Derivative Progress: 848/2164 symbols completed. GHY took 1.2s. Estimated remaining: 8m 51s. Rate: 148.8 symbols/min [2025-10-24T00:49:37.235114] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:37.237403] [INFO ] [MAIN ] GIB: Generated 139 derivative records from 31579 primary records. [2025-10-24T00:49:37.237637] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-24T00:49:37.249318] [FATAL] [LOCAL ] GIB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:37.274388] [FATAL] [MAIN ] GIB: Failed to save derivative data. [2025-10-24T00:49:37.277475] [INFO ] [MAIN ] Derivative Progress: 849/2164 symbols completed. GIB took 1.2s. Estimated remaining: 8m 50s. Rate: 148.9 symbols/min [2025-10-24T00:49:37.284718] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:37.583406] [DEBUG] [LOCAL ] GIL: Loaded 44321 existing records from primary storage. [2025-10-24T00:49:37.585073] [INFO ] [MAIN ] GIL: Loaded 44321 primary data records. [2025-10-24T00:49:37.787299] [DEBUG] [LOCAL ] GIS: Loaded 54065 existing records from primary storage. [2025-10-24T00:49:37.811228] [INFO ] [MAIN ] GIS: Loaded 54065 primary data records. [2025-10-24T00:49:38.056017] [DEBUG] [MAIN ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:38.313602] [INFO ] [MAIN ] GIC: Generated 139 derivative records from 13240 primary records. [2025-10-24T00:49:38.317557] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-24T00:49:38.318413] [FATAL] [LOCAL ] GIC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:38.326494] [FATAL] [MAIN ] GIC: Failed to save derivative data. [2025-10-24T00:49:38.329214] [INFO ] [MAIN ] Derivative Progress: 850/2164 symbols completed. GIC took 1.1s. Estimated remaining: 8m 50s. Rate: 148.7 symbols/min [2025-10-24T00:49:38.329571] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:38.336063] [DEBUG] [MAIN ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:38.375161] [DEBUG] [MAIN ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:38.444034] [INFO ] [MAIN ] GIL: Generated 139 derivative records from 44321 primary records. [2025-10-24T00:49:38.447866] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-24T00:49:38.451421] [FATAL] [LOCAL ] GIL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:38.448324] [DEBUG] [LOCAL ] GKOS: Loaded 42738 existing records from primary storage. [2025-10-24T00:49:38.452008] [FATAL] [MAIN ] GIL: Failed to save derivative data. [2025-10-24T00:49:38.452228] [INFO ] [MAIN ] GKOS: Loaded 42738 primary data records. [2025-10-24T00:49:38.466560] [INFO ] [MAIN ] Derivative Progress: 851/2164 symbols completed. GIL took 1.2s. Estimated remaining: 8m 50s. Rate: 148.8 symbols/min [2025-10-24T00:49:38.492070] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:38.577286] [INFO ] [MAIN ] GIS: Generated 139 derivative records from 54065 primary records. [2025-10-24T00:49:38.645469] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-24T00:49:38.856762] [FATAL] [LOCAL ] GIS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:38.858335] [FATAL] [MAIN ] GIS: Failed to save derivative data. [2025-10-24T00:49:38.863424] [INFO ] [MAIN ] Derivative Progress: 852/2164 symbols completed. GIS took 1.6s. Estimated remaining: 8m 49s. Rate: 148.8 symbols/min [2025-10-24T00:49:38.873573] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:38.896992] [DEBUG] [LOCAL ] GL: Loaded 37689 existing records from primary storage. [2025-10-24T00:49:38.897760] [INFO ] [MAIN ] GL: Loaded 37689 primary data records. [2025-10-24T00:49:39.122233] [DEBUG] [MAIN ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:39.171955] [DEBUG] [LOCAL ] GLOB: Loaded 48426 existing records from primary storage. [2025-10-24T00:49:39.264720] [INFO ] [MAIN ] GLOB: Loaded 48426 primary data records. [2025-10-24T00:49:39.628267] [INFO ] [MAIN ] GKOS: Generated 139 derivative records from 42738 primary records. [2025-10-24T00:49:39.643331] [DEBUG] [MAIN ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:39.643020] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-24T00:49:39.644340] [FATAL] [LOCAL ] GKOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:39.644498] [FATAL] [MAIN ] GKOS: Failed to save derivative data. [2025-10-24T00:49:39.664086] [INFO ] [MAIN ] Derivative Progress: 853/2164 symbols completed. GKOS took 1.3s. Estimated remaining: 8m 49s. Rate: 148.6 symbols/min [2025-10-24T00:49:39.696445] [DEBUG] [MAIN ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:39.727849] [INFO ] [MAIN ] GL: Generated 139 derivative records from 37689 primary records. [2025-10-24T00:49:39.730542] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-24T00:49:39.731831] [FATAL] [LOCAL ] GL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:39.732087] [FATAL] [MAIN ] GL: Failed to save derivative data. [2025-10-24T00:49:39.735707] [INFO ] [MAIN ] Derivative Progress: 854/2164 symbols completed. GL took 1.2s. Estimated remaining: 8m 48s. Rate: 148.8 symbols/min [2025-10-24T00:49:39.743814] [INFO ] [MAIN ] GLOB: Generated 139 derivative records from 48426 primary records. [2025-10-24T00:49:39.743922] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-24T00:49:39.744114] [FATAL] [LOCAL ] GLOB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:39.744192] [FATAL] [MAIN ] GLOB: Failed to save derivative data. [2025-10-24T00:49:39.749066] [INFO ] [MAIN ] Derivative Progress: 855/2164 symbols completed. GLOB took 0.9s. Estimated remaining: 8m 47s. Rate: 148.9 symbols/min [2025-10-24T00:49:39.749968] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:39.750317] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:39.750080] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:39.769884] [DEBUG] [LOCAL ] GLP: Loaded 9259 existing records from primary storage. [2025-10-24T00:49:39.770355] [INFO ] [MAIN ] GLP: Loaded 9259 primary data records. [2025-10-24T00:49:40.155563] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-24T00:49:40.158583] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-10-24T00:49:40.161033] [INFO ] [MAIN ] GM: Loaded 54119 primary data records. [2025-10-24T00:49:40.160757] [INFO ] [MAIN ] GLW: Loaded 54025 primary data records. [2025-10-24T00:49:40.913164] [DEBUG] [MAIN ] GLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:40.980931] [DEBUG] [MAIN ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:41.010469] [DEBUG] [MAIN ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:40.996884] [INFO ] [MAIN ] GLP: Generated 139 derivative records from 9259 primary records. [2025-10-24T00:49:41.029466] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-24T00:49:41.030697] [FATAL] [LOCAL ] GLP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:41.030906] [FATAL] [MAIN ] GLP: Failed to save derivative data. [2025-10-24T00:49:41.042377] [INFO ] [MAIN ] Derivative Progress: 856/2164 symbols completed. GLP took 1.3s. Estimated remaining: 8m 48s. Rate: 148.5 symbols/min [2025-10-24T00:49:41.047740] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:41.088637] [INFO ] [MAIN ] GM: Generated 139 derivative records from 54119 primary records. [2025-10-24T00:49:41.090989] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-24T00:49:41.093596] [FATAL] [LOCAL ] GM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:41.093183] [INFO ] [MAIN ] GLW: Generated 139 derivative records from 54025 primary records. [2025-10-24T00:49:41.093732] [FATAL] [MAIN ] GM: Failed to save derivative data. [2025-10-24T00:49:41.097156] [INFO ] [MAIN ] Derivative Progress: 857/2164 symbols completed. GM took 1.3s. Estimated remaining: 8m 47s. Rate: 148.7 symbols/min [2025-10-24T00:49:41.094115] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-24T00:49:41.097793] [FATAL] [LOCAL ] GLW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:41.098103] [FATAL] [MAIN ] GLW: Failed to save derivative data. [2025-10-24T00:49:41.118067] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:41.118356] [INFO ] [MAIN ] Derivative Progress: 858/2164 symbols completed. GLW took 1.4s. Estimated remaining: 8m 46s. Rate: 148.9 symbols/min [2025-10-24T00:49:41.119334] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:41.149527] [DEBUG] [LOCAL ] GME: Loaded 54171 existing records from primary storage. [2025-10-24T00:49:41.165739] [INFO ] [MAIN ] GME: Loaded 54171 primary data records. [2025-10-24T00:49:41.319417] [DEBUG] [LOCAL ] GMED: Loaded 48462 existing records from primary storage. [2025-10-24T00:49:41.353514] [DEBUG] [LOCAL ] GMRE: Loaded 36569 existing records from primary storage. [2025-10-24T00:49:41.412176] [INFO ] [MAIN ] GMED: Loaded 48462 primary data records. [2025-10-24T00:49:41.412903] [INFO ] [MAIN ] GMRE: Loaded 36569 primary data records. [2025-10-24T00:49:42.249185] [DEBUG] [MAIN ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:42.300704] [DEBUG] [MAIN ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:42.330629] [DEBUG] [MAIN ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:42.384954] [INFO ] [MAIN ] GME: Generated 139 derivative records from 54171 primary records. [2025-10-24T00:49:42.387160] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-24T00:49:42.387630] [FATAL] [LOCAL ] GME: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:42.394520] [FATAL] [MAIN ] GME: Failed to save derivative data. [2025-10-24T00:49:42.397874] [INFO ] [MAIN ] Derivative Progress: 859/2164 symbols completed. GME took 1.4s. Estimated remaining: 8m 47s. Rate: 148.5 symbols/min [2025-10-24T00:49:42.398914] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:42.425163] [INFO ] [MAIN ] GMED: Generated 139 derivative records from 48462 primary records. [2025-10-24T00:49:42.425543] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-24T00:49:42.427467] [FATAL] [LOCAL ] GMED: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:42.430434] [FATAL] [MAIN ] GMED: Failed to save derivative data. [2025-10-24T00:49:42.430762] [INFO ] [MAIN ] GMRE: Generated 139 derivative records from 36569 primary records. [2025-10-24T00:49:42.438988] [INFO ] [MAIN ] Derivative Progress: 860/2164 symbols completed. GMED took 1.3s. Estimated remaining: 8m 46s. Rate: 148.6 symbols/min [2025-10-24T00:49:42.441146] [DEBUG] [LOCAL ] GNE: Loaded 18205 existing records from primary storage. [2025-10-24T00:49:42.440582] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-24T00:49:42.441536] [INFO ] [MAIN ] GNE: Loaded 18205 primary data records. [2025-10-24T00:49:42.442246] [FATAL] [LOCAL ] GMRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:42.441720] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:42.454229] [FATAL] [MAIN ] GMRE: Failed to save derivative data. [2025-10-24T00:49:42.484182] [INFO ] [MAIN ] Derivative Progress: 861/2164 symbols completed. GMRE took 1.4s. Estimated remaining: 8m 45s. Rate: 148.8 symbols/min [2025-10-24T00:49:42.503764] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:42.822439] [DEBUG] [LOCAL ] GNK: Loaded 39706 existing records from primary storage. [2025-10-24T00:49:42.823050] [DEBUG] [LOCAL ] GNL: Loaded 46808 existing records from primary storage. [2025-10-24T00:49:42.823431] [INFO ] [MAIN ] GNK: Loaded 39706 primary data records. [2025-10-24T00:49:42.823367] [INFO ] [MAIN ] GNL: Loaded 46808 primary data records. [2025-10-24T00:49:43.364025] [DEBUG] [MAIN ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:43.539941] [INFO ] [MAIN ] GNE: Generated 139 derivative records from 18205 primary records. [2025-10-24T00:49:43.542691] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-24T00:49:43.544298] [FATAL] [LOCAL ] GNE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:43.545139] [FATAL] [MAIN ] GNE: Failed to save derivative data. [2025-10-24T00:49:43.556266] [INFO ] [MAIN ] Derivative Progress: 862/2164 symbols completed. GNE took 1.2s. Estimated remaining: 8m 46s. Rate: 148.5 symbols/min [2025-10-24T00:49:43.562759] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:43.563800] [DEBUG] [MAIN ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:43.591221] [DEBUG] [MAIN ] GNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:43.685313] [INFO ] [MAIN ] GNK: Generated 139 derivative records from 39706 primary records. [2025-10-24T00:49:43.686459] [DEBUG] [LOCAL ] GNRC: Loaded 45673 existing records from primary storage. [2025-10-24T00:49:43.686917] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-24T00:49:43.687397] [FATAL] [LOCAL ] GNK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:43.687533] [FATAL] [MAIN ] GNK: Failed to save derivative data. [2025-10-24T00:49:43.687754] [INFO ] [MAIN ] GNRC: Loaded 45673 primary data records. [2025-10-24T00:49:43.685606] [INFO ] [MAIN ] GNL: Generated 139 derivative records from 46808 primary records. [2025-10-24T00:49:43.690877] [INFO ] [MAIN ] Derivative Progress: 863/2164 symbols completed. GNK took 1.2s. Estimated remaining: 8m 45s. Rate: 148.6 symbols/min [2025-10-24T00:49:43.703251] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-24T00:49:43.713227] [FATAL] [LOCAL ] GNL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:43.728909] [FATAL] [MAIN ] GNL: Failed to save derivative data. [2025-10-24T00:49:43.723474] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:43.792712] [INFO ] [MAIN ] Derivative Progress: 864/2164 symbols completed. GNL took 1.3s. Estimated remaining: 8m 44s. Rate: 148.7 symbols/min [2025-10-24T00:49:43.804890] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:43.874150] [DEBUG] [LOCAL ] GNT: Loaded 8683 existing records from primary storage. [2025-10-24T00:49:43.895699] [INFO ] [MAIN ] GNT: Loaded 8683 primary data records. [2025-10-24T00:49:44.203400] [DEBUG] [LOCAL ] GNW: Loaded 51738 existing records from primary storage. [2025-10-24T00:49:44.246102] [INFO ] [MAIN ] GNW: Loaded 51738 primary data records. [2025-10-24T00:49:44.697416] [DEBUG] [MAIN ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:44.765757] [DEBUG] [MAIN ] GNT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:44.814410] [INFO ] [MAIN ] GNRC: Generated 139 derivative records from 45673 primary records. [2025-10-24T00:49:44.817779] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-24T00:49:44.831403] [FATAL] [LOCAL ] GNRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:44.831805] [FATAL] [MAIN ] GNRC: Failed to save derivative data. [2025-10-24T00:49:44.834959] [INFO ] [MAIN ] Derivative Progress: 865/2164 symbols completed. GNRC took 1.3s. Estimated remaining: 8m 45s. Rate: 148.5 symbols/min [2025-10-24T00:49:44.835360] [DEBUG] [MAIN ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:44.835559] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:44.868944] [INFO ] [MAIN ] GNT: Generated 139 derivative records from 8683 primary records. [2025-10-24T00:49:44.872430] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-24T00:49:44.874003] [FATAL] [LOCAL ] GNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:44.874109] [FATAL] [MAIN ] GNT: Failed to save derivative data. [2025-10-24T00:49:44.877481] [INFO ] [MAIN ] Derivative Progress: 866/2164 symbols completed. GNT took 1.2s. Estimated remaining: 8m 44s. Rate: 148.6 symbols/min [2025-10-24T00:49:44.878163] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:44.899534] [INFO ] [MAIN ] GNW: Generated 139 derivative records from 51738 primary records. [2025-10-24T00:49:44.912988] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-24T00:49:44.915312] [FATAL] [LOCAL ] GNW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:44.916782] [DEBUG] [LOCAL ] GOF: Loaded 43072 existing records from primary storage. [2025-10-24T00:49:44.916997] [INFO ] [MAIN ] GOF: Loaded 43072 primary data records. [2025-10-24T00:49:44.915476] [FATAL] [MAIN ] GNW: Failed to save derivative data. [2025-10-24T00:49:44.934225] [INFO ] [MAIN ] Derivative Progress: 867/2164 symbols completed. GNW took 1.1s. Estimated remaining: 8m 43s. Rate: 148.8 symbols/min [2025-10-24T00:49:44.986148] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:45.104243] [DEBUG] [LOCAL ] GOLF: Loaded 30411 existing records from primary storage. [2025-10-24T00:49:45.238208] [INFO ] [MAIN ] GOLF: Loaded 30411 primary data records. [2025-10-24T00:49:45.629492] [DEBUG] [LOCAL ] GOOS: Loaded 44323 existing records from primary storage. [2025-10-24T00:49:45.630270] [INFO ] [MAIN ] GOOS: Loaded 44323 primary data records. [2025-10-24T00:49:45.970056] [DEBUG] [MAIN ] GOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:46.023018] [DEBUG] [MAIN ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:46.073882] [INFO ] [MAIN ] GOF: Generated 139 derivative records from 43072 primary records. [2025-10-24T00:49:46.074310] [DEBUG] [MAIN ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:46.076469] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-24T00:49:46.079584] [FATAL] [LOCAL ] GOF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:46.080344] [FATAL] [MAIN ] GOF: Failed to save derivative data. [2025-10-24T00:49:46.097409] [INFO ] [MAIN ] Derivative Progress: 868/2164 symbols completed. GOF took 1.3s. Estimated remaining: 8m 44s. Rate: 148.4 symbols/min [2025-10-24T00:49:46.124702] [INFO ] [MAIN ] GOLF: Generated 139 derivative records from 30411 primary records. [2025-10-24T00:49:46.125092] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-24T00:49:46.125455] [FATAL] [LOCAL ] GOLF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:46.126905] [FATAL] [MAIN ] GOLF: Failed to save derivative data. [2025-10-24T00:49:46.131769] [INFO ] [MAIN ] Derivative Progress: 869/2164 symbols completed. GOLF took 1.3s. Estimated remaining: 8m 43s. Rate: 148.6 symbols/min [2025-10-24T00:49:46.134969] [INFO ] [MAIN ] GOOS: Generated 139 derivative records from 44323 primary records. [2025-10-24T00:49:46.135248] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-24T00:49:46.135509] [FATAL] [LOCAL ] GOOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:46.135590] [FATAL] [MAIN ] GOOS: Failed to save derivative data. [2025-10-24T00:49:46.138989] [INFO ] [MAIN ] Derivative Progress: 870/2164 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 42s. Rate: 148.8 symbols/min [2025-10-24T00:49:46.139523] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:46.139930] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:46.140551] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:46.172218] [DEBUG] [LOCAL ] GPI: Loaded 14863 existing records from primary storage. [2025-10-24T00:49:46.172539] [INFO ] [MAIN ] GPI: Loaded 14863 primary data records. [2025-10-24T00:49:46.320297] [DEBUG] [LOCAL ] GOTU: Loaded 37025 existing records from primary storage. [2025-10-24T00:49:46.331445] [INFO ] [MAIN ] GOTU: Loaded 37025 primary data records. [2025-10-24T00:49:46.320474] [DEBUG] [LOCAL ] GPC: Loaded 46263 existing records from primary storage. [2025-10-24T00:49:46.366561] [INFO ] [MAIN ] GPC: Loaded 46263 primary data records. [2025-10-24T00:49:47.245449] [DEBUG] [MAIN ] GPI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:47.285472] [DEBUG] [MAIN ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:47.334779] [DEBUG] [MAIN ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:47.372126] [INFO ] [MAIN ] GPI: Generated 139 derivative records from 14863 primary records. [2025-10-24T00:49:47.377319] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-24T00:49:47.382767] [FATAL] [LOCAL ] GPI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:47.386868] [FATAL] [MAIN ] GPI: Failed to save derivative data. [2025-10-24T00:49:47.389565] [INFO ] [MAIN ] Derivative Progress: 871/2164 symbols completed. GPI took 1.2s. Estimated remaining: 8m 43s. Rate: 148.4 symbols/min [2025-10-24T00:49:47.391162] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:47.403095] [INFO ] [MAIN ] GOTU: Generated 139 derivative records from 37025 primary records. [2025-10-24T00:49:47.404686] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-24T00:49:47.407856] [FATAL] [LOCAL ] GOTU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:47.408355] [FATAL] [MAIN ] GOTU: Failed to save derivative data. [2025-10-24T00:49:47.412022] [DEBUG] [LOCAL ] GPJA: Loaded 4128 existing records from primary storage. [2025-10-24T00:49:47.414721] [INFO ] [MAIN ] Derivative Progress: 872/2164 symbols completed. GOTU took 1.3s. Estimated remaining: 8m 42s. Rate: 148.6 symbols/min [2025-10-24T00:49:47.415927] [INFO ] [MAIN ] GPJA: Loaded 4128 primary data records. [2025-10-24T00:49:47.416274] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:47.485958] [INFO ] [MAIN ] GPC: Generated 139 derivative records from 46263 primary records. [2025-10-24T00:49:47.513621] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-24T00:49:47.536578] [FATAL] [LOCAL ] GPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:47.558192] [FATAL] [MAIN ] GPC: Failed to save derivative data. [2025-10-24T00:49:47.593142] [INFO ] [MAIN ] Derivative Progress: 873/2164 symbols completed. GPC took 1.5s. Estimated remaining: 8m 41s. Rate: 148.7 symbols/min [2025-10-24T00:49:47.676125] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:47.821104] [DEBUG] [LOCAL ] GPK: Loaded 53166 existing records from primary storage. [2025-10-24T00:49:47.821892] [INFO ] [MAIN ] GPK: Loaded 53166 primary data records. [2025-10-24T00:49:47.923247] [DEBUG] [LOCAL ] GPMT: Loaded 26058 existing records from primary storage. [2025-10-24T00:49:47.944340] [INFO ] [MAIN ] GPMT: Loaded 26058 primary data records. [2025-10-24T00:49:48.088904] [DEBUG] [MAIN ] GPJA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:48.539987] [INFO ] [MAIN ] GPJA: Generated 139 derivative records from 4128 primary records. [2025-10-24T00:49:48.543017] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-24T00:49:48.543318] [FATAL] [LOCAL ] GPJA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:48.543531] [FATAL] [MAIN ] GPJA: Failed to save derivative data. [2025-10-24T00:49:48.564836] [INFO ] [MAIN ] Derivative Progress: 874/2164 symbols completed. GPJA took 1.2s. Estimated remaining: 8m 41s. Rate: 148.4 symbols/min [2025-10-24T00:49:48.565056] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:48.579613] [DEBUG] [MAIN ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:48.591411] [DEBUG] [MAIN ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:48.685137] [DEBUG] [LOCAL ] GPN: Loaded 52198 existing records from primary storage. [2025-10-24T00:49:48.688445] [INFO ] [MAIN ] GPK: Generated 139 derivative records from 53166 primary records. [2025-10-24T00:49:48.688719] [INFO ] [MAIN ] GPN: Loaded 52198 primary data records. [2025-10-24T00:49:48.690195] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-24T00:49:48.702840] [FATAL] [LOCAL ] GPK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:48.728879] [FATAL] [MAIN ] GPK: Failed to save derivative data. [2025-10-24T00:49:48.735626] [INFO ] [MAIN ] Derivative Progress: 875/2164 symbols completed. GPK took 1.3s. Estimated remaining: 8m 41s. Rate: 148.5 symbols/min [2025-10-24T00:49:48.767023] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:48.743585] [INFO ] [MAIN ] GPMT: Generated 139 derivative records from 26058 primary records. [2025-10-24T00:49:48.785816] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-24T00:49:48.806548] [FATAL] [LOCAL ] GPMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:48.806769] [FATAL] [MAIN ] GPMT: Failed to save derivative data. [2025-10-24T00:49:48.811159] [INFO ] [MAIN ] Derivative Progress: 876/2164 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 40s. Rate: 148.7 symbols/min [2025-10-24T00:49:48.815952] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:49.043963] [DEBUG] [LOCAL ] GPOR: Loaded 23577 existing records from primary storage. [2025-10-24T00:49:49.044205] [INFO ] [MAIN ] GPOR: Loaded 23577 primary data records. [2025-10-24T00:49:49.268291] [DEBUG] [LOCAL ] GPRK: Loaded 40214 existing records from primary storage. [2025-10-24T00:49:49.394234] [INFO ] [MAIN ] GPRK: Loaded 40214 primary data records. [2025-10-24T00:49:49.626414] [DEBUG] [MAIN ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:49.904419] [DEBUG] [MAIN ] GPOR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:49.945238] [INFO ] [MAIN ] GPN: Generated 139 derivative records from 52198 primary records. [2025-10-24T00:49:49.962465] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-24T00:49:49.969215] [FATAL] [LOCAL ] GPN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:49.970062] [FATAL] [MAIN ] GPN: Failed to save derivative data. [2025-10-24T00:49:49.970755] [DEBUG] [MAIN ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:49.975667] [INFO ] [MAIN ] Derivative Progress: 877/2164 symbols completed. GPN took 1.4s. Estimated remaining: 8m 41s. Rate: 148.3 symbols/min [2025-10-24T00:49:49.998129] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:50.044027] [INFO ] [MAIN ] GPOR: Generated 139 derivative records from 23577 primary records. [2025-10-24T00:49:50.044634] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-24T00:49:50.046117] [FATAL] [LOCAL ] GPOR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:50.056281] [FATAL] [MAIN ] GPOR: Failed to save derivative data. [2025-10-24T00:49:50.059151] [INFO ] [MAIN ] Derivative Progress: 878/2164 symbols completed. GPOR took 1.3s. Estimated remaining: 8m 40s. Rate: 148.5 symbols/min [2025-10-24T00:49:50.059806] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:50.062363] [DEBUG] [LOCAL ] GRBK: Loaded 26788 existing records from primary storage. [2025-10-24T00:49:50.066192] [INFO ] [MAIN ] GRBK: Loaded 26788 primary data records. [2025-10-24T00:49:50.134727] [INFO ] [MAIN ] GPRK: Generated 139 derivative records from 40214 primary records. [2025-10-24T00:49:50.149377] [DEBUG] [LOCAL ] GRC: Loaded 9356 existing records from primary storage. [2025-10-24T00:49:50.168495] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-24T00:49:50.173896] [INFO ] [MAIN ] GRC: Loaded 9356 primary data records. [2025-10-24T00:49:50.207303] [FATAL] [LOCAL ] GPRK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:50.253200] [FATAL] [MAIN ] GPRK: Failed to save derivative data. [2025-10-24T00:49:50.293992] [INFO ] [MAIN ] Derivative Progress: 879/2164 symbols completed. GPRK took 1.5s. Estimated remaining: 8m 39s. Rate: 148.6 symbols/min [2025-10-24T00:49:50.315036] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:50.811454] [DEBUG] [MAIN ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:50.813167] [DEBUG] [LOCAL ] GRMN: Loaded 40017 existing records from primary storage. [2025-10-24T00:49:50.813532] [DEBUG] [MAIN ] GRC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:50.814082] [INFO ] [MAIN ] GRMN: Loaded 40017 primary data records. [2025-10-24T00:49:51.198624] [INFO ] [MAIN ] GRC: Generated 139 derivative records from 9356 primary records. [2025-10-24T00:49:51.200192] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-24T00:49:51.201247] [FATAL] [LOCAL ] GRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:51.203848] [FATAL] [MAIN ] GRC: Failed to save derivative data. [2025-10-24T00:49:51.206814] [INFO ] [MAIN ] Derivative Progress: 880/2164 symbols completed. GRC took 1.1s. Estimated remaining: 8m 39s. Rate: 148.3 symbols/min [2025-10-24T00:49:51.204267] [INFO ] [MAIN ] GRBK: Generated 139 derivative records from 26788 primary records. [2025-10-24T00:49:51.207066] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:51.208084] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-24T00:49:51.208724] [FATAL] [LOCAL ] GRBK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:51.208812] [FATAL] [MAIN ] GRBK: Failed to save derivative data. [2025-10-24T00:49:51.211309] [INFO ] [MAIN ] Derivative Progress: 881/2164 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 38s. Rate: 148.5 symbols/min [2025-10-24T00:49:51.211732] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:51.229940] [DEBUG] [MAIN ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:51.295535] [INFO ] [MAIN ] GRMN: Generated 139 derivative records from 40017 primary records. [2025-10-24T00:49:51.297028] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-24T00:49:51.297518] [DEBUG] [LOCAL ] GRNT: Loaded 34218 existing records from primary storage. [2025-10-24T00:49:51.297903] [FATAL] [LOCAL ] GRMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:51.298105] [FATAL] [MAIN ] GRMN: Failed to save derivative data. [2025-10-24T00:49:51.298182] [INFO ] [MAIN ] GRNT: Loaded 34218 primary data records. [2025-10-24T00:49:51.303700] [INFO ] [MAIN ] Derivative Progress: 882/2164 symbols completed. GRMN took 1.0s. Estimated remaining: 8m 37s. Rate: 148.6 symbols/min [2025-10-24T00:49:51.325443] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:51.392426] [DEBUG] [LOCAL ] GRND: Loaded 50545 existing records from primary storage. [2025-10-24T00:49:51.415143] [INFO ] [MAIN ] GRND: Loaded 50545 primary data records. [2025-10-24T00:49:51.571509] [DEBUG] [LOCAL ] GROV: Loaded 8639 existing records from primary storage. [2025-10-24T00:49:51.726003] [INFO ] [MAIN ] GROV: Loaded 8639 primary data records. [2025-10-24T00:49:52.322208] [DEBUG] [MAIN ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:52.352872] [DEBUG] [MAIN ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:52.391618] [DEBUG] [MAIN ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:52.457184] [INFO ] [MAIN ] GRNT: Generated 139 derivative records from 34218 primary records. [2025-10-24T00:49:52.461562] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-24T00:49:52.465934] [FATAL] [LOCAL ] GRNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:52.466462] [FATAL] [MAIN ] GRNT: Failed to save derivative data. [2025-10-24T00:49:52.466397] [INFO ] [MAIN ] GROV: Generated 139 derivative records from 8639 primary records. [2025-10-24T00:49:52.466195] [INFO ] [MAIN ] GRND: Generated 139 derivative records from 50545 primary records. [2025-10-24T00:49:52.469025] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-24T00:49:52.469366] [FATAL] [LOCAL ] GROV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:52.468619] [INFO ] [MAIN ] Derivative Progress: 883/2164 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 38s. Rate: 148.3 symbols/min [2025-10-24T00:49:52.469713] [FATAL] [MAIN ] GROV: Failed to save derivative data. [2025-10-24T00:49:52.469800] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-24T00:49:52.472662] [INFO ] [MAIN ] Derivative Progress: 884/2164 symbols completed. GROV took 1.1s. Estimated remaining: 8m 37s. Rate: 148.5 symbols/min [2025-10-24T00:49:52.473096] [FATAL] [LOCAL ] GRND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:52.473177] [FATAL] [MAIN ] GRND: Failed to save derivative data. [2025-10-24T00:49:52.475817] [INFO ] [MAIN ] Derivative Progress: 885/2164 symbols completed. GRND took 1.3s. Estimated remaining: 8m 36s. Rate: 148.7 symbols/min [2025-10-24T00:49:52.476228] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:52.476536] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:52.476696] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:52.485090] [DEBUG] [LOCAL ] GRX: Loaded 4873 existing records from primary storage. [2025-10-24T00:49:52.485453] [INFO ] [MAIN ] GRX: Loaded 4873 primary data records. [2025-10-24T00:49:52.816718] [DEBUG] [LOCAL ] GSBD: Loaded 39823 existing records from primary storage. [2025-10-24T00:49:52.818534] [INFO ] [MAIN ] GSBD: Loaded 39823 primary data records. [2025-10-24T00:49:52.913896] [DEBUG] [LOCAL ] GS: Loaded 52152 existing records from primary storage. [2025-10-24T00:49:52.926281] [INFO ] [MAIN ] GS: Loaded 52152 primary data records. [2025-10-24T00:49:53.479152] [DEBUG] [MAIN ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:53.550179] [DEBUG] [MAIN ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:53.550759] [DEBUG] [MAIN ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:53.565116] [INFO ] [MAIN ] GRX: Generated 139 derivative records from 4873 primary records. [2025-10-24T00:49:53.578747] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-24T00:49:53.579045] [FATAL] [LOCAL ] GRX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:53.581542] [FATAL] [MAIN ] GRX: Failed to save derivative data. [2025-10-24T00:49:53.585432] [INFO ] [MAIN ] Derivative Progress: 886/2164 symbols completed. GRX took 1.1s. Estimated remaining: 8m 37s. Rate: 148.4 symbols/min [2025-10-24T00:49:53.585594] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:53.626568] [INFO ] [MAIN ] GS: Generated 139 derivative records from 52152 primary records. [2025-10-24T00:49:53.629680] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-24T00:49:53.645574] [INFO ] [MAIN ] GSBD: Generated 139 derivative records from 39823 primary records. [2025-10-24T00:49:53.646069] [FATAL] [LOCAL ] GS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:53.646444] [FATAL] [MAIN ] GS: Failed to save derivative data. [2025-10-24T00:49:53.646516] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-24T00:49:53.650086] [INFO ] [MAIN ] Derivative Progress: 887/2164 symbols completed. GS took 1.2s. Estimated remaining: 8m 36s. Rate: 148.5 symbols/min [2025-10-24T00:49:53.646909] [FATAL] [LOCAL ] GSBD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:53.650511] [FATAL] [MAIN ] GSBD: Failed to save derivative data. [2025-10-24T00:49:53.653045] [INFO ] [MAIN ] Derivative Progress: 888/2164 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 35s. Rate: 148.7 symbols/min [2025-10-24T00:49:53.650313] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:53.653263] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:53.676950] [DEBUG] [LOCAL ] GSK: Loaded 53900 existing records from primary storage. [2025-10-24T00:49:53.677352] [INFO ] [MAIN ] GSK: Loaded 53900 primary data records. [2025-10-24T00:49:53.902521] [DEBUG] [LOCAL ] GSL: Loaded 33099 existing records from primary storage. [2025-10-24T00:49:54.040688] [INFO ] [MAIN ] GSL: Loaded 33099 primary data records. [2025-10-24T00:49:54.061861] [DEBUG] [LOCAL ] GTES: Loaded 50654 existing records from primary storage. [2025-10-24T00:49:54.099600] [INFO ] [MAIN ] GTES: Loaded 50654 primary data records. [2025-10-24T00:49:54.713670] [DEBUG] [MAIN ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:54.758722] [DEBUG] [MAIN ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:54.798175] [DEBUG] [MAIN ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:54.820376] [INFO ] [MAIN ] GSK: Generated 139 derivative records from 53900 primary records. [2025-10-24T00:49:54.822469] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-24T00:49:54.824420] [FATAL] [LOCAL ] GSK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:54.825154] [FATAL] [MAIN ] GSK: Failed to save derivative data. [2025-10-24T00:49:54.827981] [INFO ] [MAIN ] Derivative Progress: 889/2164 symbols completed. GSK took 1.2s. Estimated remaining: 8m 36s. Rate: 148.3 symbols/min [2025-10-24T00:49:54.832549] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:54.855525] [INFO ] [MAIN ] GTES: Generated 139 derivative records from 50654 primary records. [2025-10-24T00:49:54.857055] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-24T00:49:54.857404] [FATAL] [LOCAL ] GTES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:54.859605] [FATAL] [MAIN ] GTES: Failed to save derivative data. [2025-10-24T00:49:54.859810] [INFO ] [MAIN ] GSL: Generated 139 derivative records from 33099 primary records. [2025-10-24T00:49:54.863020] [INFO ] [MAIN ] Derivative Progress: 890/2164 symbols completed. GTES took 1.2s. Estimated remaining: 8m 35s. Rate: 148.5 symbols/min [2025-10-24T00:49:54.863331] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:54.863830] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-24T00:49:54.864088] [FATAL] [LOCAL ] GSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:54.864193] [FATAL] [MAIN ] GSL: Failed to save derivative data. [2025-10-24T00:49:54.866503] [INFO ] [MAIN ] Derivative Progress: 891/2164 symbols completed. GSL took 1.2s. Estimated remaining: 8m 34s. Rate: 148.7 symbols/min [2025-10-24T00:49:54.866785] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:54.896845] [DEBUG] [LOCAL ] GTLS: Loaded 43429 existing records from primary storage. [2025-10-24T00:49:54.897107] [INFO ] [MAIN ] GTLS: Loaded 43429 primary data records. [2025-10-24T00:49:55.046673] [DEBUG] [LOCAL ] GTY: Loaded 30273 existing records from primary storage. [2025-10-24T00:49:55.057147] [INFO ] [MAIN ] GTY: Loaded 30273 primary data records. [2025-10-24T00:49:55.291267] [DEBUG] [LOCAL ] GTN: Loaded 45076 existing records from primary storage. [2025-10-24T00:49:55.311255] [INFO ] [MAIN ] GTN: Loaded 45076 primary data records. [2025-10-24T00:49:55.903856] [DEBUG] [MAIN ] GTLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:55.952519] [DEBUG] [MAIN ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:55.980666] [DEBUG] [MAIN ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:56.008361] [INFO ] [MAIN ] GTLS: Generated 139 derivative records from 43429 primary records. [2025-10-24T00:49:56.008937] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-24T00:49:56.009320] [FATAL] [LOCAL ] GTLS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:56.011433] [FATAL] [MAIN ] GTLS: Failed to save derivative data. [2025-10-24T00:49:56.017190] [INFO ] [MAIN ] Derivative Progress: 892/2164 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 34s. Rate: 148.4 symbols/min [2025-10-24T00:49:56.018891] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:56.047199] [INFO ] [MAIN ] GTY: Generated 139 derivative records from 30273 primary records. [2025-10-24T00:49:56.049501] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-24T00:49:56.050041] [FATAL] [LOCAL ] GTY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:56.050139] [FATAL] [MAIN ] GTY: Failed to save derivative data. [2025-10-24T00:49:56.058457] [INFO ] [MAIN ] Derivative Progress: 893/2164 symbols completed. GTY took 1.2s. Estimated remaining: 8m 34s. Rate: 148.5 symbols/min [2025-10-24T00:49:56.055419] [DEBUG] [LOCAL ] GUG: Loaded 12223 existing records from primary storage. [2025-10-24T00:49:56.061753] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:56.061561] [INFO ] [MAIN ] GUG: Loaded 12223 primary data records. [2025-10-24T00:49:56.061441] [INFO ] [MAIN ] GTN: Generated 139 derivative records from 45076 primary records. [2025-10-24T00:49:56.062689] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-24T00:49:56.085128] [FATAL] [LOCAL ] GTN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:56.121234] [FATAL] [MAIN ] GTN: Failed to save derivative data. [2025-10-24T00:49:56.145086] [INFO ] [MAIN ] Derivative Progress: 894/2164 symbols completed. GTN took 1.3s. Estimated remaining: 8m 33s. Rate: 148.6 symbols/min [2025-10-24T00:49:56.169839] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:56.198406] [DEBUG] [LOCAL ] GUT: Loaded 15608 existing records from primary storage. [2025-10-24T00:49:56.199050] [INFO ] [MAIN ] GUT: Loaded 15608 primary data records. [2025-10-24T00:49:56.648586] [DEBUG] [LOCAL ] GVA: Loaded 32845 existing records from primary storage. [2025-10-24T00:49:56.669720] [INFO ] [MAIN ] GVA: Loaded 32845 primary data records. [2025-10-24T00:49:57.263335] [DEBUG] [MAIN ] GUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:57.308751] [DEBUG] [MAIN ] GUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:57.345016] [INFO ] [MAIN ] GUG: Generated 139 derivative records from 12223 primary records. [2025-10-24T00:49:57.345383] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-24T00:49:57.353131] [FATAL] [LOCAL ] GUG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:57.360213] [FATAL] [MAIN ] GUG: Failed to save derivative data. [2025-10-24T00:49:57.362564] [INFO ] [MAIN ] Derivative Progress: 895/2164 symbols completed. GUG took 1.3s. Estimated remaining: 8m 33s. Rate: 148.3 symbols/min [2025-10-24T00:49:57.363625] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:57.363279] [DEBUG] [MAIN ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:57.410915] [DEBUG] [LOCAL ] GWH: Loaded 20423 existing records from primary storage. [2025-10-24T00:49:57.410531] [INFO ] [MAIN ] GUT: Generated 139 derivative records from 15608 primary records. [2025-10-24T00:49:57.412243] [INFO ] [MAIN ] GWH: Loaded 20423 primary data records. [2025-10-24T00:49:57.423775] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-24T00:49:57.424041] [FATAL] [LOCAL ] GUT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:57.424235] [FATAL] [MAIN ] GUT: Failed to save derivative data. [2025-10-24T00:49:57.441625] [INFO ] [MAIN ] Derivative Progress: 896/2164 symbols completed. GUT took 1.4s. Estimated remaining: 8m 33s. Rate: 148.4 symbols/min [2025-10-24T00:49:57.464798] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:57.722439] [INFO ] [MAIN ] GVA: Generated 139 derivative records from 32845 primary records. [2025-10-24T00:49:57.723347] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-24T00:49:57.733095] [FATAL] [LOCAL ] GVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:57.733217] [FATAL] [MAIN ] GVA: Failed to save derivative data. [2025-10-24T00:49:57.736067] [INFO ] [MAIN ] Derivative Progress: 897/2164 symbols completed. GVA took 1.6s. Estimated remaining: 8m 32s. Rate: 148.5 symbols/min [2025-10-24T00:49:57.736929] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:57.756383] [DEBUG] [LOCAL ] GWRE: Loaded 39790 existing records from primary storage. [2025-10-24T00:49:57.756892] [INFO ] [MAIN ] GWRE: Loaded 39790 primary data records. [2025-10-24T00:49:57.859196] [DEBUG] [LOCAL ] GWW: Loaded 19343 existing records from primary storage. [2025-10-24T00:49:57.881690] [INFO ] [MAIN ] GWW: Loaded 19343 primary data records. [2025-10-24T00:49:57.969828] [DEBUG] [MAIN ] GWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:58.460038] [INFO ] [MAIN ] GWH: Generated 139 derivative records from 20423 primary records. [2025-10-24T00:49:58.461918] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-24T00:49:58.462329] [FATAL] [LOCAL ] GWH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:58.463181] [FATAL] [MAIN ] GWH: Failed to save derivative data. [2025-10-24T00:49:58.466392] [INFO ] [MAIN ] Derivative Progress: 898/2164 symbols completed. GWH took 1.1s. Estimated remaining: 8m 32s. Rate: 148.3 symbols/min [2025-10-24T00:49:58.479796] [DEBUG] [MAIN ] GWRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:58.518134] [DEBUG] [MAIN ] GWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:58.541327] [INFO ] [MAIN ] GWRE: Generated 139 derivative records from 39790 primary records. [2025-10-24T00:49:58.541502] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-24T00:49:58.541740] [FATAL] [LOCAL ] GWRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:58.541964] [FATAL] [MAIN ] GWRE: Failed to save derivative data. [2025-10-24T00:49:58.545157] [INFO ] [MAIN ] Derivative Progress: 899/2164 symbols completed. GWRE took 1.1s. Estimated remaining: 8m 31s. Rate: 148.5 symbols/min [2025-10-24T00:49:58.555513] [INFO ] [MAIN ] GWW: Generated 139 derivative records from 19343 primary records. [2025-10-24T00:49:58.555602] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-24T00:49:58.555805] [FATAL] [LOCAL ] GWW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:58.555883] [FATAL] [MAIN ] GWW: Failed to save derivative data. [2025-10-24T00:49:58.559102] [INFO ] [MAIN ] Derivative Progress: 900/2164 symbols completed. GWW took 0.8s. Estimated remaining: 8m 30s. Rate: 148.6 symbols/min [2025-10-24T00:49:58.559611] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:58.559666] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:58.559715] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:58.564735] [DEBUG] [LOCAL ] GYLD: Loaded 1537 existing records from primary storage. [2025-10-24T00:49:58.565010] [INFO ] [MAIN ] GYLD: Loaded 1537 primary data records. [2025-10-24T00:49:58.897389] [DEBUG] [LOCAL ] GXO: Loaded 46753 existing records from primary storage. [2025-10-24T00:49:58.898602] [INFO ] [MAIN ] GXO: Loaded 46753 primary data records. [2025-10-24T00:49:58.994471] [DEBUG] [LOCAL ] H: Loaded 44693 existing records from primary storage. [2025-10-24T00:49:59.006597] [INFO ] [MAIN ] H: Loaded 44693 primary data records. [2025-10-24T00:49:59.525539] [DEBUG] [MAIN ] GYLD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:49:59.578312] [DEBUG] [MAIN ] GXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:59.619506] [INFO ] [MAIN ] GYLD: Generated 139 derivative records from 1537 primary records. [2025-10-24T00:49:59.619274] [DEBUG] [MAIN ] H: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:49:59.622810] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-24T00:49:59.623226] [FATAL] [LOCAL ] GYLD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:59.623336] [FATAL] [MAIN ] GYLD: Failed to save derivative data. [2025-10-24T00:49:59.636538] [INFO ] [MAIN ] Derivative Progress: 901/2164 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 31s. Rate: 148.4 symbols/min [2025-10-24T00:49:59.639283] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:59.678777] [INFO ] [MAIN ] GXO: Generated 139 derivative records from 46753 primary records. [2025-10-24T00:49:59.682395] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-24T00:49:59.682762] [FATAL] [LOCAL ] GXO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:59.683881] [FATAL] [MAIN ] GXO: Failed to save derivative data. [2025-10-24T00:49:59.686170] [INFO ] [MAIN ] Derivative Progress: 902/2164 symbols completed. GXO took 1.1s. Estimated remaining: 8m 30s. Rate: 148.5 symbols/min [2025-10-24T00:49:59.686402] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:49:59.705579] [DEBUG] [LOCAL ] HAE: Loaded 39587 existing records from primary storage. [2025-10-24T00:49:59.705894] [INFO ] [MAIN ] H: Generated 139 derivative records from 44693 primary records. [2025-10-24T00:49:59.706394] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-24T00:49:59.706192] [INFO ] [MAIN ] HAE: Loaded 39587 primary data records. [2025-10-24T00:49:59.706808] [FATAL] [LOCAL ] H: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:49:59.743516] [FATAL] [MAIN ] H: Failed to save derivative data. [2025-10-24T00:49:59.753382] [INFO ] [MAIN ] Derivative Progress: 903/2164 symbols completed. H took 1.2s. Estimated remaining: 8m 29s. Rate: 148.6 symbols/min [2025-10-24T00:49:59.774671] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:00.036860] [DEBUG] [LOCAL ] HAFN: Loaded 42951 existing records from primary storage. [2025-10-24T00:50:00.037742] [INFO ] [MAIN ] HAFN: Loaded 42951 primary data records. [2025-10-24T00:50:00.229789] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-24T00:50:00.257467] [INFO ] [MAIN ] HAL: Loaded 54108 primary data records. [2025-10-24T00:50:00.754939] [DEBUG] [MAIN ] HAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:00.798770] [DEBUG] [MAIN ] HAFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:00.852272] [INFO ] [MAIN ] HAE: Generated 139 derivative records from 39587 primary records. [2025-10-24T00:50:00.855632] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-24T00:50:00.852910] [DEBUG] [MAIN ] HAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:00.856177] [FATAL] [LOCAL ] HAE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:00.856361] [FATAL] [MAIN ] HAE: Failed to save derivative data. [2025-10-24T00:50:00.869929] [INFO ] [MAIN ] Derivative Progress: 904/2164 symbols completed. HAE took 1.2s. Estimated remaining: 8m 30s. Rate: 148.4 symbols/min [2025-10-24T00:50:00.872518] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:00.898901] [INFO ] [MAIN ] HAFN: Generated 139 derivative records from 42951 primary records. [2025-10-24T00:50:00.901697] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-24T00:50:00.902296] [FATAL] [LOCAL ] HAFN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:00.902611] [FATAL] [MAIN ] HAFN: Failed to save derivative data. [2025-10-24T00:50:00.906535] [INFO ] [MAIN ] Derivative Progress: 905/2164 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 29s. Rate: 148.5 symbols/min [2025-10-24T00:50:00.908087] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:00.925499] [INFO ] [MAIN ] HAL: Generated 139 derivative records from 54108 primary records. [2025-10-24T00:50:00.925973] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-24T00:50:00.926387] [FATAL] [LOCAL ] HAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:00.926477] [FATAL] [MAIN ] HAL: Failed to save derivative data. [2025-10-24T00:50:00.929790] [INFO ] [MAIN ] Derivative Progress: 906/2164 symbols completed. HAL took 1.2s. Estimated remaining: 8m 28s. Rate: 148.7 symbols/min [2025-10-24T00:50:00.930199] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:00.946329] [DEBUG] [LOCAL ] HASI: Loaded 48038 existing records from primary storage. [2025-10-24T00:50:00.946673] [INFO ] [MAIN ] HASI: Loaded 48038 primary data records. [2025-10-24T00:50:01.066276] [DEBUG] [LOCAL ] HBB: Loaded 6322 existing records from primary storage. [2025-10-24T00:50:01.070590] [INFO ] [MAIN ] HBB: Loaded 6322 primary data records. [2025-10-24T00:50:01.308813] [DEBUG] [LOCAL ] HAYW: Loaded 49174 existing records from primary storage. [2025-10-24T00:50:01.435222] [INFO ] [MAIN ] HAYW: Loaded 49174 primary data records. [2025-10-24T00:50:02.135287] [DEBUG] [MAIN ] HASI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:02.187280] [DEBUG] [MAIN ] HBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:02.257308] [DEBUG] [MAIN ] HAYW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:02.296139] [INFO ] [MAIN ] HASI: Generated 139 derivative records from 48038 primary records. [2025-10-24T00:50:02.298089] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-24T00:50:02.300350] [INFO ] [MAIN ] HBB: Generated 139 derivative records from 6322 primary records. [2025-10-24T00:50:02.303784] [FATAL] [LOCAL ] HASI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:02.303863] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-24T00:50:02.304881] [FATAL] [LOCAL ] HBB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:02.304979] [FATAL] [MAIN ] HASI: Failed to save derivative data. [2025-10-24T00:50:02.306485] [FATAL] [MAIN ] HBB: Failed to save derivative data. [2025-10-24T00:50:02.309947] [INFO ] [MAIN ] Derivative Progress: 907/2164 symbols completed. HBB took 1.4s. Estimated remaining: 8m 29s. Rate: 148.3 symbols/min [2025-10-24T00:50:02.315374] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:02.315632] [INFO ] [MAIN ] Derivative Progress: 908/2164 symbols completed. HASI took 1.4s. Estimated remaining: 8m 28s. Rate: 148.4 symbols/min [2025-10-24T00:50:02.319104] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:02.328345] [INFO ] [MAIN ] HAYW: Generated 139 derivative records from 49174 primary records. [2025-10-24T00:50:02.328545] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-24T00:50:02.328817] [FATAL] [LOCAL ] HAYW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:02.328954] [FATAL] [MAIN ] HAYW: Failed to save derivative data. [2025-10-24T00:50:02.332253] [INFO ] [MAIN ] Derivative Progress: 909/2164 symbols completed. HAYW took 1.4s. Estimated remaining: 8m 27s. Rate: 148.6 symbols/min [2025-10-24T00:50:02.332791] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:02.401026] [DEBUG] [LOCAL ] HBM: Loaded 53369 existing records from primary storage. [2025-10-24T00:50:02.401436] [INFO ] [MAIN ] HBM: Loaded 53369 primary data records. [2025-10-24T00:50:02.481615] [DEBUG] [LOCAL ] HBI: Loaded 53296 existing records from primary storage. [2025-10-24T00:50:02.532203] [INFO ] [MAIN ] HBI: Loaded 53296 primary data records. [2025-10-24T00:50:02.578532] [DEBUG] [LOCAL ] HCA: Loaded 47254 existing records from primary storage. [2025-10-24T00:50:02.703804] [INFO ] [MAIN ] HCA: Loaded 47254 primary data records. [2025-10-24T00:50:03.420546] [DEBUG] [MAIN ] HBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:03.453362] [DEBUG] [MAIN ] HBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:03.491845] [DEBUG] [MAIN ] HCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:03.544277] [INFO ] [MAIN ] HBM: Generated 139 derivative records from 53369 primary records. [2025-10-24T00:50:03.545102] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-24T00:50:03.550662] [FATAL] [LOCAL ] HBM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:03.551155] [FATAL] [MAIN ] HBM: Failed to save derivative data. [2025-10-24T00:50:03.553154] [INFO ] [MAIN ] Derivative Progress: 910/2164 symbols completed. HBM took 1.2s. Estimated remaining: 8m 28s. Rate: 148.3 symbols/min [2025-10-24T00:50:03.558550] [INFO ] [MAIN ] HBI: Generated 139 derivative records from 53296 primary records. [2025-10-24T00:50:03.558779] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-24T00:50:03.559069] [FATAL] [LOCAL ] HBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:03.558055] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:03.560144] [FATAL] [MAIN ] HBI: Failed to save derivative data. [2025-10-24T00:50:03.562758] [INFO ] [MAIN ] HCA: Generated 139 derivative records from 47254 primary records. [2025-10-24T00:50:03.565539] [INFO ] [MAIN ] Derivative Progress: 911/2164 symbols completed. HBI took 1.3s. Estimated remaining: 8m 27s. Rate: 148.4 symbols/min [2025-10-24T00:50:03.565988] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:03.565893] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-24T00:50:03.566714] [FATAL] [LOCAL ] HCA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:03.566888] [FATAL] [MAIN ] HCA: Failed to save derivative data. [2025-10-24T00:50:03.571817] [INFO ] [MAIN ] Derivative Progress: 912/2164 symbols completed. HCA took 1.2s. Estimated remaining: 8m 26s. Rate: 148.6 symbols/min [2025-10-24T00:50:03.572022] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:03.587912] [DEBUG] [LOCAL ] HCI: Loaded 14149 existing records from primary storage. [2025-10-24T00:50:03.588150] [INFO ] [MAIN ] HCI: Loaded 14149 primary data records. [2025-10-24T00:50:03.739764] [DEBUG] [LOCAL ] HCC: Loaded 45253 existing records from primary storage. [2025-10-24T00:50:03.802699] [INFO ] [MAIN ] HCC: Loaded 45253 primary data records. [2025-10-24T00:50:04.057028] [DEBUG] [LOCAL ] HD: Loaded 53854 existing records from primary storage. [2025-10-24T00:50:04.062518] [INFO ] [MAIN ] HD: Loaded 53854 primary data records. [2025-10-24T00:50:04.628559] [DEBUG] [MAIN ] HCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:04.670340] [DEBUG] [MAIN ] HCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:04.718203] [DEBUG] [MAIN ] HD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:04.725688] [INFO ] [MAIN ] HCI: Generated 139 derivative records from 14149 primary records. [2025-10-24T00:50:04.737503] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-24T00:50:04.739534] [FATAL] [LOCAL ] HCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:04.739775] [FATAL] [MAIN ] HCI: Failed to save derivative data. [2025-10-24T00:50:04.741934] [INFO ] [MAIN ] Derivative Progress: 913/2164 symbols completed. HCI took 1.2s. Estimated remaining: 8m 26s. Rate: 148.3 symbols/min [2025-10-24T00:50:04.760323] [INFO ] [MAIN ] HCC: Generated 139 derivative records from 45253 primary records. [2025-10-24T00:50:04.760444] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-24T00:50:04.761775] [FATAL] [LOCAL ] HCC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:04.764106] [FATAL] [MAIN ] HCC: Failed to save derivative data. [2025-10-24T00:50:04.766967] [INFO ] [MAIN ] Derivative Progress: 914/2164 symbols completed. HCC took 1.2s. Estimated remaining: 8m 25s. Rate: 148.4 symbols/min [2025-10-24T00:50:04.772697] [INFO ] [MAIN ] HD: Generated 139 derivative records from 53854 primary records. [2025-10-24T00:50:04.772817] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-24T00:50:04.773057] [FATAL] [LOCAL ] HD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:04.773146] [FATAL] [MAIN ] HD: Failed to save derivative data. [2025-10-24T00:50:04.777437] [INFO ] [MAIN ] Derivative Progress: 915/2164 symbols completed. HD took 1.2s. Estimated remaining: 8m 24s. Rate: 148.6 symbols/min [2025-10-24T00:50:04.777947] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:04.777868] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:04.778012] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:04.853879] [DEBUG] [LOCAL ] HEI: Loaded 30697 existing records from primary storage. [2025-10-24T00:50:04.854221] [INFO ] [MAIN ] HEI: Loaded 30697 primary data records. [2025-10-24T00:50:04.855031] [DEBUG] [LOCAL ] HE: Loaded 49115 existing records from primary storage. [2025-10-24T00:50:04.855285] [INFO ] [MAIN ] HE: Loaded 49115 primary data records. [2025-10-24T00:50:05.069208] [DEBUG] [LOCAL ] HDB: Loaded 52296 existing records from primary storage. [2025-10-24T00:50:05.104776] [INFO ] [MAIN ] HDB: Loaded 52296 primary data records. [2025-10-24T00:50:05.834008] [DEBUG] [MAIN ] HE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:05.860336] [DEBUG] [MAIN ] HEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:05.897412] [DEBUG] [MAIN ] HDB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:05.966515] [INFO ] [MAIN ] HEI: Generated 139 derivative records from 30697 primary records. [2025-10-24T00:50:05.967146] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-24T00:50:05.965157] [INFO ] [MAIN ] HE: Generated 139 derivative records from 49115 primary records. [2025-10-24T00:50:05.967430] [FATAL] [LOCAL ] HEI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:05.967631] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-24T00:50:05.967917] [FATAL] [MAIN ] HEI: Failed to save derivative data. [2025-10-24T00:50:05.971123] [INFO ] [MAIN ] Derivative Progress: 916/2164 symbols completed. HEI took 1.2s. Estimated remaining: 8m 25s. Rate: 148.3 symbols/min [2025-10-24T00:50:05.972719] [FATAL] [LOCAL ] HE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:05.972221] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:05.972826] [FATAL] [MAIN ] HE: Failed to save derivative data. [2025-10-24T00:50:05.975850] [INFO ] [MAIN ] Derivative Progress: 917/2164 symbols completed. HE took 1.2s. Estimated remaining: 8m 24s. Rate: 148.4 symbols/min [2025-10-24T00:50:05.976062] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:05.980269] [INFO ] [MAIN ] HDB: Generated 139 derivative records from 52296 primary records. [2025-10-24T00:50:05.980599] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-24T00:50:05.980970] [FATAL] [LOCAL ] HDB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:05.981051] [FATAL] [MAIN ] HDB: Failed to save derivative data. [2025-10-24T00:50:05.983792] [INFO ] [MAIN ] Derivative Progress: 918/2164 symbols completed. HDB took 1.2s. Estimated remaining: 8m 23s. Rate: 148.6 symbols/min [2025-10-24T00:50:05.983982] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:05.990852] [DEBUG] [LOCAL ] HEQ: Loaded 6802 existing records from primary storage. [2025-10-24T00:50:05.991189] [INFO ] [MAIN ] HEQ: Loaded 6802 primary data records. [2025-10-24T00:50:06.117695] [DEBUG] [LOCAL ] HFRO: Loaded 16411 existing records from primary storage. [2025-10-24T00:50:06.172795] [INFO ] [MAIN ] HFRO: Loaded 16411 primary data records. [2025-10-24T00:50:06.353275] [DEBUG] [LOCAL ] HESM: Loaded 48963 existing records from primary storage. [2025-10-24T00:50:06.402834] [INFO ] [MAIN ] HESM: Loaded 48963 primary data records. [2025-10-24T00:50:06.999782] [DEBUG] [MAIN ] HEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:07.046558] [DEBUG] [MAIN ] HFRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:07.089044] [DEBUG] [MAIN ] HESM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:07.109738] [INFO ] [MAIN ] HEQ: Generated 139 derivative records from 6802 primary records. [2025-10-24T00:50:07.112599] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-24T00:50:07.119163] [FATAL] [LOCAL ] HEQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:07.120350] [FATAL] [MAIN ] HEQ: Failed to save derivative data. [2025-10-24T00:50:07.122587] [INFO ] [MAIN ] Derivative Progress: 919/2164 symbols completed. HEQ took 1.2s. Estimated remaining: 8m 24s. Rate: 148.3 symbols/min [2025-10-24T00:50:07.128365] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:07.142597] [INFO ] [MAIN ] HFRO: Generated 139 derivative records from 16411 primary records. [2025-10-24T00:50:07.144198] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-24T00:50:07.148798] [FATAL] [LOCAL ] HFRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:07.151883] [FATAL] [MAIN ] HFRO: Failed to save derivative data. [2025-10-24T00:50:07.154487] [INFO ] [MAIN ] Derivative Progress: 920/2164 symbols completed. HFRO took 1.2s. Estimated remaining: 8m 23s. Rate: 148.4 symbols/min [2025-10-24T00:50:07.156709] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:07.167875] [DEBUG] [LOCAL ] HGER: Loaded 15736 existing records from primary storage. [2025-10-24T00:50:07.169551] [INFO ] [MAIN ] HGER: Loaded 15736 primary data records. [2025-10-24T00:50:07.255333] [INFO ] [MAIN ] HESM: Generated 139 derivative records from 48963 primary records. [2025-10-24T00:50:07.276636] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-24T00:50:07.276999] [FATAL] [LOCAL ] HESM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:07.281528] [FATAL] [MAIN ] HESM: Failed to save derivative data. [2025-10-24T00:50:07.281404] [DEBUG] [LOCAL ] HGLB: Loaded 9671 existing records from primary storage. [2025-10-24T00:50:07.285205] [INFO ] [MAIN ] Derivative Progress: 921/2164 symbols completed. HESM took 1.3s. Estimated remaining: 8m 22s. Rate: 148.5 symbols/min [2025-10-24T00:50:07.311328] [INFO ] [MAIN ] HGLB: Loaded 9671 primary data records. [2025-10-24T00:50:07.290754] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:07.637915] [DEBUG] [LOCAL ] HGTY: Loaded 13442 existing records from primary storage. [2025-10-24T00:50:07.693151] [INFO ] [MAIN ] HGTY: Loaded 13442 primary data records. [2025-10-24T00:50:08.158263] [DEBUG] [MAIN ] HGER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:08.196591] [DEBUG] [MAIN ] HGLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:08.237468] [DEBUG] [MAIN ] HGTY: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:08.271875] [INFO ] [MAIN ] HGER: Generated 139 derivative records from 15736 primary records. [2025-10-24T00:50:08.274036] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-24T00:50:08.277425] [FATAL] [LOCAL ] HGER: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:08.281966] [FATAL] [MAIN ] HGER: Failed to save derivative data. [2025-10-24T00:50:08.285197] [INFO ] [MAIN ] Derivative Progress: 922/2164 symbols completed. HGER took 1.2s. Estimated remaining: 8m 22s. Rate: 148.3 symbols/min [2025-10-24T00:50:08.287792] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:08.297780] [INFO ] [MAIN ] HGLB: Generated 139 derivative records from 9671 primary records. [2025-10-24T00:50:08.301331] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-24T00:50:08.301780] [FATAL] [LOCAL ] HGLB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:08.302355] [FATAL] [MAIN ] HGLB: Failed to save derivative data. [2025-10-24T00:50:08.304778] [INFO ] [MAIN ] Derivative Progress: 923/2164 symbols completed. HGLB took 1.1s. Estimated remaining: 8m 22s. Rate: 148.5 symbols/min [2025-10-24T00:50:08.306230] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:08.308967] [INFO ] [MAIN ] HGTY: Generated 139 derivative records from 13442 primary records. [2025-10-24T00:50:08.309146] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-24T00:50:08.309469] [FATAL] [LOCAL ] HGTY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:08.309550] [FATAL] [MAIN ] HGTY: Failed to save derivative data. [2025-10-24T00:50:08.315376] [INFO ] [MAIN ] Derivative Progress: 924/2164 symbols completed. HGTY took 1.0s. Estimated remaining: 8m 21s. Rate: 148.6 symbols/min [2025-10-24T00:50:08.315699] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:08.350115] [DEBUG] [LOCAL ] HGV: Loaded 46371 existing records from primary storage. [2025-10-24T00:50:08.364752] [INFO ] [MAIN ] HGV: Loaded 46371 primary data records. [2025-10-24T00:50:08.476154] [DEBUG] [LOCAL ] HHH: Loaded 33222 existing records from primary storage. [2025-10-24T00:50:08.479833] [INFO ] [MAIN ] HHH: Loaded 33222 primary data records. [2025-10-24T00:50:08.542104] [DEBUG] [LOCAL ] HI: Loaded 36466 existing records from primary storage. [2025-10-24T00:50:08.621523] [INFO ] [MAIN ] HI: Loaded 36466 primary data records. [2025-10-24T00:50:09.339630] [DEBUG] [MAIN ] HGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:09.374206] [DEBUG] [MAIN ] HHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:09.410344] [DEBUG] [MAIN ] HI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:09.456141] [INFO ] [MAIN ] HGV: Generated 139 derivative records from 46371 primary records. [2025-10-24T00:50:09.464671] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-24T00:50:09.465227] [FATAL] [LOCAL ] HGV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:09.468931] [FATAL] [MAIN ] HGV: Failed to save derivative data. [2025-10-24T00:50:09.472725] [INFO ] [MAIN ] Derivative Progress: 925/2164 symbols completed. HGV took 1.2s. Estimated remaining: 8m 21s. Rate: 148.3 symbols/min [2025-10-24T00:50:09.480381] [INFO ] [MAIN ] HHH: Generated 139 derivative records from 33222 primary records. [2025-10-24T00:50:09.480675] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-24T00:50:09.480907] [FATAL] [LOCAL ] HHH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:09.480108] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:09.481012] [FATAL] [MAIN ] HHH: Failed to save derivative data. [2025-10-24T00:50:09.485158] [INFO ] [MAIN ] Derivative Progress: 926/2164 symbols completed. HHH took 1.2s. Estimated remaining: 8m 20s. Rate: 148.5 symbols/min [2025-10-24T00:50:09.485411] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:09.488726] [INFO ] [MAIN ] HI: Generated 139 derivative records from 36466 primary records. [2025-10-24T00:50:09.488957] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-24T00:50:09.489176] [FATAL] [LOCAL ] HI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:09.489297] [FATAL] [MAIN ] HI: Failed to save derivative data. [2025-10-24T00:50:09.492014] [INFO ] [MAIN ] Derivative Progress: 927/2164 symbols completed. HI took 1.2s. Estimated remaining: 8m 19s. Rate: 148.6 symbols/min [2025-10-24T00:50:09.492394] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:09.550681] [DEBUG] [LOCAL ] HII: Loaded 33565 existing records from primary storage. [2025-10-24T00:50:09.550926] [INFO ] [MAIN ] HII: Loaded 33565 primary data records. [2025-10-24T00:50:09.667150] [DEBUG] [LOCAL ] HIG: Loaded 51458 existing records from primary storage. [2025-10-24T00:50:09.671079] [INFO ] [MAIN ] HIG: Loaded 51458 primary data records. [2025-10-24T00:50:09.747528] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-24T00:50:09.799414] [INFO ] [MAIN ] HIMS: Loaded 54207 primary data records. [2025-10-24T00:50:10.564158] [DEBUG] [MAIN ] HII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:10.601764] [DEBUG] [MAIN ] HIMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:10.631693] [DEBUG] [MAIN ] HIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:10.681938] [INFO ] [MAIN ] HII: Generated 139 derivative records from 33565 primary records. [2025-10-24T00:50:10.683197] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-24T00:50:10.685009] [FATAL] [LOCAL ] HII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:10.688015] [FATAL] [MAIN ] HII: Failed to save derivative data. [2025-10-24T00:50:10.691532] [INFO ] [MAIN ] Derivative Progress: 928/2164 symbols completed. HII took 1.2s. Estimated remaining: 8m 20s. Rate: 148.3 symbols/min [2025-10-24T00:50:10.693559] [INFO ] [MAIN ] HIMS: Generated 139 derivative records from 54207 primary records. [2025-10-24T00:50:10.696122] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-24T00:50:10.696693] [FATAL] [LOCAL ] HIMS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:10.696877] [FATAL] [MAIN ] HIMS: Failed to save derivative data. [2025-10-24T00:50:10.699602] [INFO ] [MAIN ] Derivative Progress: 929/2164 symbols completed. HIMS took 1.2s. Estimated remaining: 8m 19s. Rate: 148.5 symbols/min [2025-10-24T00:50:10.704902] [INFO ] [MAIN ] HIG: Generated 139 derivative records from 51458 primary records. [2025-10-24T00:50:10.705079] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-24T00:50:10.705288] [FATAL] [LOCAL ] HIG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:10.705365] [FATAL] [MAIN ] HIG: Failed to save derivative data. [2025-10-24T00:50:10.708132] [INFO ] [MAIN ] Derivative Progress: 930/2164 symbols completed. HIG took 1.2s. Estimated remaining: 8m 18s. Rate: 148.6 symbols/min [2025-10-24T00:50:10.708626] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:10.708524] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:10.709124] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:10.735740] [DEBUG] [LOCAL ] HIPO: Loaded 21492 existing records from primary storage. [2025-10-24T00:50:10.753378] [INFO ] [MAIN ] HIPO: Loaded 21492 primary data records. [2025-10-24T00:50:10.753722] [DEBUG] [LOCAL ] HIO: Loaded 24111 existing records from primary storage. [2025-10-24T00:50:10.754010] [INFO ] [MAIN ] HIO: Loaded 24111 primary data records. [2025-10-24T00:50:10.969991] [DEBUG] [LOCAL ] HIW: Loaded 44737 existing records from primary storage. [2025-10-24T00:50:11.001717] [INFO ] [MAIN ] HIW: Loaded 44737 primary data records. [2025-10-24T00:50:11.722981] [DEBUG] [MAIN ] HIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:11.757343] [DEBUG] [MAIN ] HIPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:11.817235] [DEBUG] [MAIN ] HIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:11.861668] [INFO ] [MAIN ] HIO: Generated 139 derivative records from 24111 primary records. [2025-10-24T00:50:11.863725] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-24T00:50:11.866733] [FATAL] [LOCAL ] HIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:11.867134] [INFO ] [MAIN ] HIPO: Generated 139 derivative records from 21492 primary records. [2025-10-24T00:50:11.867386] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-24T00:50:11.866975] [FATAL] [MAIN ] HIO: Failed to save derivative data. [2025-10-24T00:50:11.872421] [INFO ] [MAIN ] Derivative Progress: 931/2164 symbols completed. HIO took 1.2s. Estimated remaining: 8m 19s. Rate: 148.3 symbols/min [2025-10-24T00:50:11.867695] [FATAL] [LOCAL ] HIPO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:11.873141] [FATAL] [MAIN ] HIPO: Failed to save derivative data. [2025-10-24T00:50:11.873315] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:11.875917] [INFO ] [MAIN ] Derivative Progress: 932/2164 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 18s. Rate: 148.5 symbols/min [2025-10-24T00:50:11.878173] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:11.886581] [INFO ] [MAIN ] HIW: Generated 139 derivative records from 44737 primary records. [2025-10-24T00:50:11.886794] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-24T00:50:11.887059] [FATAL] [LOCAL ] HIW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:11.887193] [FATAL] [MAIN ] HIW: Failed to save derivative data. [2025-10-24T00:50:11.889806] [INFO ] [MAIN ] Derivative Progress: 933/2164 symbols completed. HIW took 1.2s. Estimated remaining: 8m 17s. Rate: 148.6 symbols/min [2025-10-24T00:50:11.890142] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:11.910396] [DEBUG] [LOCAL ] HIX: Loaded 20615 existing records from primary storage. [2025-10-24T00:50:11.910569] [INFO ] [MAIN ] HIX: Loaded 20615 primary data records. [2025-10-24T00:50:11.941833] [DEBUG] [LOCAL ] HKD: Loaded 18788 existing records from primary storage. [2025-10-24T00:50:11.985903] [INFO ] [MAIN ] HKD: Loaded 18788 primary data records. [2025-10-24T00:50:12.430311] [DEBUG] [LOCAL ] HL: Loaded 54066 existing records from primary storage. [2025-10-24T00:50:12.558521] [INFO ] [MAIN ] HL: Loaded 54066 primary data records. [2025-10-24T00:50:12.934983] [DEBUG] [MAIN ] HIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:12.969668] [DEBUG] [MAIN ] HKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:13.017142] [DEBUG] [MAIN ] HL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:13.041938] [INFO ] [MAIN ] HIX: Generated 139 derivative records from 20615 primary records. [2025-10-24T00:50:13.042531] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-24T00:50:13.044676] [FATAL] [LOCAL ] HIX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:13.045415] [FATAL] [MAIN ] HIX: Failed to save derivative data. [2025-10-24T00:50:13.049854] [INFO ] [MAIN ] Derivative Progress: 934/2164 symbols completed. HIX took 1.2s. Estimated remaining: 8m 18s. Rate: 148.3 symbols/min [2025-10-24T00:50:13.050325] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:13.060989] [INFO ] [MAIN ] HKD: Generated 139 derivative records from 18788 primary records. [2025-10-24T00:50:13.062326] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-24T00:50:13.062609] [FATAL] [LOCAL ] HKD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:13.065719] [FATAL] [MAIN ] HKD: Failed to save derivative data. [2025-10-24T00:50:13.068218] [INFO ] [MAIN ] Derivative Progress: 935/2164 symbols completed. HKD took 1.2s. Estimated remaining: 8m 17s. Rate: 148.5 symbols/min [2025-10-24T00:50:13.069818] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:13.076430] [INFO ] [MAIN ] HL: Generated 139 derivative records from 54066 primary records. [2025-10-24T00:50:13.076593] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-24T00:50:13.076804] [FATAL] [LOCAL ] HL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:13.076915] [FATAL] [MAIN ] HL: Failed to save derivative data. [2025-10-24T00:50:13.080587] [INFO ] [MAIN ] Derivative Progress: 936/2164 symbols completed. HL took 1.2s. Estimated remaining: 8m 16s. Rate: 148.6 symbols/min [2025-10-24T00:50:13.080866] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:13.119138] [DEBUG] [LOCAL ] HLF: Loaded 48722 existing records from primary storage. [2025-10-24T00:50:13.119381] [INFO ] [MAIN ] HLF: Loaded 48722 primary data records. [2025-10-24T00:50:13.254236] [DEBUG] [LOCAL ] HLLY: Loaded 33526 existing records from primary storage. [2025-10-24T00:50:13.253350] [DEBUG] [LOCAL ] HLIO: Loaded 28229 existing records from primary storage. [2025-10-24T00:50:13.269876] [INFO ] [MAIN ] HLLY: Loaded 33526 primary data records. [2025-10-24T00:50:13.275131] [INFO ] [MAIN ] HLIO: Loaded 28229 primary data records. [2025-10-24T00:50:14.086946] [DEBUG] [MAIN ] HLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:14.128058] [DEBUG] [MAIN ] HLIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:14.152562] [DEBUG] [MAIN ] HLLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:14.188507] [INFO ] [MAIN ] HLF: Generated 139 derivative records from 48722 primary records. [2025-10-24T00:50:14.190204] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-24T00:50:14.195013] [FATAL] [LOCAL ] HLF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:14.195470] [FATAL] [MAIN ] HLF: Failed to save derivative data. [2025-10-24T00:50:14.197863] [INFO ] [MAIN ] Derivative Progress: 937/2164 symbols completed. HLF took 1.1s. Estimated remaining: 8m 16s. Rate: 148.4 symbols/min [2025-10-24T00:50:14.200107] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:14.220844] [INFO ] [MAIN ] HLLY: Generated 139 derivative records from 33526 primary records. [2025-10-24T00:50:14.221086] [INFO ] [MAIN ] HLIO: Generated 139 derivative records from 28229 primary records. [2025-10-24T00:50:14.221232] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-24T00:50:14.221330] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-24T00:50:14.221538] [FATAL] [LOCAL ] HLIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:14.221782] [FATAL] [LOCAL ] HLLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:14.221932] [FATAL] [MAIN ] HLIO: Failed to save derivative data. [2025-10-24T00:50:14.222050] [FATAL] [MAIN ] HLLY: Failed to save derivative data. [2025-10-24T00:50:14.224710] [INFO ] [MAIN ] Derivative Progress: 938/2164 symbols completed. HLIO took 1.2s. Estimated remaining: 8m 15s. Rate: 148.5 symbols/min [2025-10-24T00:50:14.227704] [INFO ] [MAIN ] Derivative Progress: 939/2164 symbols completed. HLLY took 1.1s. Estimated remaining: 8m 14s. Rate: 148.7 symbols/min [2025-10-24T00:50:14.227614] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:14.228020] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:14.269055] [DEBUG] [LOCAL ] HLN: Loaded 53505 existing records from primary storage. [2025-10-24T00:50:14.269399] [INFO ] [MAIN ] HLN: Loaded 53505 primary data records. [2025-10-24T00:50:14.447343] [DEBUG] [LOCAL ] HLX: Loaded 47701 existing records from primary storage. [2025-10-24T00:50:14.441257] [DEBUG] [LOCAL ] HLT: Loaded 50826 existing records from primary storage. [2025-10-24T00:50:14.502887] [INFO ] [MAIN ] HLX: Loaded 47701 primary data records. [2025-10-24T00:50:14.503011] [INFO ] [MAIN ] HLT: Loaded 50826 primary data records. [2025-10-24T00:50:15.270560] [DEBUG] [MAIN ] HLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:15.309940] [DEBUG] [MAIN ] HLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:15.337749] [DEBUG] [MAIN ] HLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:15.387127] [INFO ] [MAIN ] HLN: Generated 139 derivative records from 53505 primary records. [2025-10-24T00:50:15.387816] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-24T00:50:15.393691] [FATAL] [LOCAL ] HLN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:15.393897] [FATAL] [MAIN ] HLN: Failed to save derivative data. [2025-10-24T00:50:15.396460] [INFO ] [MAIN ] Derivative Progress: 940/2164 symbols completed. HLN took 1.2s. Estimated remaining: 8m 15s. Rate: 148.4 symbols/min [2025-10-24T00:50:15.397954] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:15.410448] [INFO ] [MAIN ] HLT: Generated 139 derivative records from 50826 primary records. [2025-10-24T00:50:15.410664] [INFO ] [MAIN ] HLX: Generated 139 derivative records from 47701 primary records. [2025-10-24T00:50:15.410832] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-24T00:50:15.411110] [FATAL] [LOCAL ] HLT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:15.410928] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-24T00:50:15.411248] [FATAL] [MAIN ] HLT: Failed to save derivative data. [2025-10-24T00:50:15.414410] [INFO ] [MAIN ] Derivative Progress: 941/2164 symbols completed. HLT took 1.2s. Estimated remaining: 8m 14s. Rate: 148.5 symbols/min [2025-10-24T00:50:15.414581] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:15.411542] [FATAL] [LOCAL ] HLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:15.414814] [FATAL] [MAIN ] HLX: Failed to save derivative data. [2025-10-24T00:50:15.417615] [INFO ] [MAIN ] Derivative Progress: 942/2164 symbols completed. HLX took 1.2s. Estimated remaining: 8m 13s. Rate: 148.7 symbols/min [2025-10-24T00:50:15.418080] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:15.449576] [DEBUG] [LOCAL ] HMN: Loaded 23364 existing records from primary storage. [2025-10-24T00:50:15.462412] [INFO ] [MAIN ] HMN: Loaded 23364 primary data records. [2025-10-24T00:50:15.463166] [DEBUG] [LOCAL ] HMC: Loaded 46564 existing records from primary storage. [2025-10-24T00:50:15.494345] [INFO ] [MAIN ] HMC: Loaded 46564 primary data records. [2025-10-24T00:50:15.709787] [DEBUG] [LOCAL ] HMY: Loaded 53556 existing records from primary storage. [2025-10-24T00:50:15.776291] [INFO ] [MAIN ] HMY: Loaded 53556 primary data records. [2025-10-24T00:50:16.527170] [DEBUG] [MAIN ] HMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:16.563085] [DEBUG] [MAIN ] HMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:16.610292] [DEBUG] [MAIN ] HMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:16.645053] [INFO ] [MAIN ] HMN: Generated 139 derivative records from 23364 primary records. [2025-10-24T00:50:16.648935] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-24T00:50:16.649862] [FATAL] [LOCAL ] HMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:16.650374] [FATAL] [MAIN ] HMN: Failed to save derivative data. [2025-10-24T00:50:16.652486] [INFO ] [MAIN ] Derivative Progress: 943/2164 symbols completed. HMN took 1.2s. Estimated remaining: 8m 14s. Rate: 148.4 symbols/min [2025-10-24T00:50:16.671530] [INFO ] [MAIN ] HMC: Generated 139 derivative records from 46564 primary records. [2025-10-24T00:50:16.672017] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-24T00:50:16.672269] [FATAL] [LOCAL ] HMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:16.672538] [FATAL] [MAIN ] HMC: Failed to save derivative data. [2025-10-24T00:50:16.675431] [INFO ] [MAIN ] Derivative Progress: 944/2164 symbols completed. HMC took 1.3s. Estimated remaining: 8m 13s. Rate: 148.5 symbols/min [2025-10-24T00:50:16.678274] [INFO ] [MAIN ] HMY: Generated 139 derivative records from 53556 primary records. [2025-10-24T00:50:16.678476] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-24T00:50:16.678718] [FATAL] [LOCAL ] HMY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:16.678796] [FATAL] [MAIN ] HMY: Failed to save derivative data. [2025-10-24T00:50:16.683223] [INFO ] [MAIN ] Derivative Progress: 945/2164 symbols completed. HMY took 1.3s. Estimated remaining: 8m 12s. Rate: 148.7 symbols/min [2025-10-24T00:50:16.683670] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:16.683809] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:16.683923] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:16.732318] [DEBUG] [LOCAL ] HNI: Loaded 29986 existing records from primary storage. [2025-10-24T00:50:16.732761] [INFO ] [MAIN ] HNI: Loaded 29986 primary data records. [2025-10-24T00:50:16.874179] [DEBUG] [LOCAL ] HOG: Loaded 50975 existing records from primary storage. [2025-10-24T00:50:16.879143] [DEBUG] [LOCAL ] HOMB: Loaded 44007 existing records from primary storage. [2025-10-24T00:50:16.878045] [INFO ] [MAIN ] HOG: Loaded 50975 primary data records. [2025-10-24T00:50:16.879333] [INFO ] [MAIN ] HOMB: Loaded 44007 primary data records. [2025-10-24T00:50:17.719943] [DEBUG] [MAIN ] HNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:17.766877] [DEBUG] [MAIN ] HOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:17.801737] [DEBUG] [MAIN ] HOMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:17.841582] [INFO ] [MAIN ] HNI: Generated 139 derivative records from 29986 primary records. [2025-10-24T00:50:17.845696] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-24T00:50:17.846078] [FATAL] [LOCAL ] HNI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:17.846473] [FATAL] [MAIN ] HNI: Failed to save derivative data. [2025-10-24T00:50:17.848681] [INFO ] [MAIN ] Derivative Progress: 946/2164 symbols completed. HNI took 1.2s. Estimated remaining: 8m 13s. Rate: 148.4 symbols/min [2025-10-24T00:50:17.849204] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:17.870909] [INFO ] [MAIN ] HOG: Generated 139 derivative records from 50975 primary records. [2025-10-24T00:50:17.873036] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-24T00:50:17.873433] [FATAL] [LOCAL ] HOG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:17.875554] [FATAL] [MAIN ] HOG: Failed to save derivative data. [2025-10-24T00:50:17.878223] [INFO ] [MAIN ] Derivative Progress: 947/2164 symbols completed. HOG took 1.2s. Estimated remaining: 8m 12s. Rate: 148.5 symbols/min [2025-10-24T00:50:17.875447] [INFO ] [MAIN ] HOMB: Generated 139 derivative records from 44007 primary records. [2025-10-24T00:50:17.879683] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:17.879832] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-24T00:50:17.880418] [FATAL] [LOCAL ] HOMB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:17.880505] [FATAL] [MAIN ] HOMB: Failed to save derivative data. [2025-10-24T00:50:17.883532] [INFO ] [MAIN ] Derivative Progress: 948/2164 symbols completed. HOMB took 1.2s. Estimated remaining: 8m 11s. Rate: 148.7 symbols/min [2025-10-24T00:50:17.883836] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:17.909297] [DEBUG] [LOCAL ] HOV: Loaded 13847 existing records from primary storage. [2025-10-24T00:50:17.922951] [INFO ] [MAIN ] HOV: Loaded 13847 primary data records. [2025-10-24T00:50:17.956172] [DEBUG] [LOCAL ] HOUS: Loaded 46115 existing records from primary storage. [2025-10-24T00:50:17.991398] [INFO ] [MAIN ] HOUS: Loaded 46115 primary data records. [2025-10-24T00:50:18.440688] [DEBUG] [LOCAL ] HP: Loaded 51767 existing records from primary storage. [2025-10-24T00:50:18.581614] [INFO ] [MAIN ] HP: Loaded 51767 primary data records. [2025-10-24T00:50:18.919400] [DEBUG] [MAIN ] HOV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:18.952719] [DEBUG] [MAIN ] HOUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:18.994313] [DEBUG] [MAIN ] HP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:19.045147] [INFO ] [MAIN ] HOV: Generated 139 derivative records from 13847 primary records. [2025-10-24T00:50:19.048078] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-24T00:50:19.048530] [FATAL] [LOCAL ] HOV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:19.048745] [FATAL] [MAIN ] HOV: Failed to save derivative data. [2025-10-24T00:50:19.050885] [INFO ] [MAIN ] Derivative Progress: 949/2164 symbols completed. HOV took 1.2s. Estimated remaining: 8m 11s. Rate: 148.4 symbols/min [2025-10-24T00:50:19.054044] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:19.062191] [INFO ] [MAIN ] HOUS: Generated 139 derivative records from 46115 primary records. [2025-10-24T00:50:19.063606] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-24T00:50:19.064022] [FATAL] [LOCAL ] HOUS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:19.064164] [FATAL] [MAIN ] HOUS: Failed to save derivative data. [2025-10-24T00:50:19.066948] [INFO ] [MAIN ] Derivative Progress: 950/2164 symbols completed. HOUS took 1.2s. Estimated remaining: 8m 10s. Rate: 148.5 symbols/min [2025-10-24T00:50:19.069507] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:19.074567] [INFO ] [MAIN ] HP: Generated 139 derivative records from 51767 primary records. [2025-10-24T00:50:19.074768] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-24T00:50:19.077000] [FATAL] [LOCAL ] HP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:19.077228] [FATAL] [MAIN ] HP: Failed to save derivative data. [2025-10-24T00:50:19.081115] [INFO ] [MAIN ] Derivative Progress: 951/2164 symbols completed. HP took 1.2s. Estimated remaining: 8m 10s. Rate: 148.7 symbols/min [2025-10-24T00:50:19.081419] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:19.086307] [DEBUG] [LOCAL ] HPF: Loaded 7523 existing records from primary storage. [2025-10-24T00:50:19.086530] [INFO ] [MAIN ] HPF: Loaded 7523 primary data records. [2025-10-24T00:50:19.218062] [DEBUG] [LOCAL ] HPI: Loaded 10768 existing records from primary storage. [2025-10-24T00:50:19.238389] [INFO ] [MAIN ] HPI: Loaded 10768 primary data records. [2025-10-24T00:50:19.309958] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-24T00:50:19.337356] [INFO ] [MAIN ] HPE: Loaded 54087 primary data records. [2025-10-24T00:50:20.079084] [DEBUG] [MAIN ] HPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:20.112169] [DEBUG] [MAIN ] HPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:20.145168] [DEBUG] [MAIN ] HPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:20.208048] [INFO ] [MAIN ] HPF: Generated 139 derivative records from 7523 primary records. [2025-10-24T00:50:20.209039] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-24T00:50:20.209428] [FATAL] [LOCAL ] HPF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:20.209705] [FATAL] [MAIN ] HPF: Failed to save derivative data. [2025-10-24T00:50:20.214477] [INFO ] [MAIN ] Derivative Progress: 952/2164 symbols completed. HPF took 1.1s. Estimated remaining: 8m 10s. Rate: 148.4 symbols/min [2025-10-24T00:50:20.217575] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:20.220125] [INFO ] [MAIN ] HPI: Generated 139 derivative records from 10768 primary records. [2025-10-24T00:50:20.220486] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-24T00:50:20.220828] [FATAL] [LOCAL ] HPI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:20.224256] [FATAL] [MAIN ] HPI: Failed to save derivative data. [2025-10-24T00:50:20.227711] [INFO ] [MAIN ] Derivative Progress: 953/2164 symbols completed. HPI took 1.1s. Estimated remaining: 8m 9s. Rate: 148.5 symbols/min [2025-10-24T00:50:20.228251] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:20.228113] [INFO ] [MAIN ] HPE: Generated 139 derivative records from 54087 primary records. [2025-10-24T00:50:20.228578] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-24T00:50:20.229184] [FATAL] [LOCAL ] HPE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:20.229314] [FATAL] [MAIN ] HPE: Failed to save derivative data. [2025-10-24T00:50:20.232118] [INFO ] [MAIN ] Derivative Progress: 954/2164 symbols completed. HPE took 1.2s. Estimated remaining: 8m 8s. Rate: 148.7 symbols/min [2025-10-24T00:50:20.232343] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:20.246128] [DEBUG] [LOCAL ] HPS: Loaded 10382 existing records from primary storage. [2025-10-24T00:50:20.246568] [INFO ] [MAIN ] HPS: Loaded 10382 primary data records. [2025-10-24T00:50:20.452618] [DEBUG] [LOCAL ] HPP: Loaded 51560 existing records from primary storage. [2025-10-24T00:50:20.480518] [INFO ] [MAIN ] HPP: Loaded 51560 primary data records. [2025-10-24T00:50:20.685594] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-10-24T00:50:20.699475] [INFO ] [MAIN ] HPQ: Loaded 54059 primary data records. [2025-10-24T00:50:21.301966] [DEBUG] [MAIN ] HPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:21.332419] [DEBUG] [MAIN ] HPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:21.367284] [DEBUG] [MAIN ] HPQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:21.435253] [INFO ] [MAIN ] HPP: Generated 139 derivative records from 51560 primary records. [2025-10-24T00:50:21.438922] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-24T00:50:21.438479] [INFO ] [MAIN ] HPS: Generated 139 derivative records from 10382 primary records. [2025-10-24T00:50:21.439532] [FATAL] [LOCAL ] HPP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:21.440938] [FATAL] [MAIN ] HPP: Failed to save derivative data. [2025-10-24T00:50:21.443285] [INFO ] [MAIN ] Derivative Progress: 955/2164 symbols completed. HPP took 1.2s. Estimated remaining: 8m 9s. Rate: 148.4 symbols/min [2025-10-24T00:50:21.443823] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:21.439963] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-24T00:50:21.444808] [FATAL] [LOCAL ] HPS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:21.445067] [FATAL] [MAIN ] HPS: Failed to save derivative data. [2025-10-24T00:50:21.450507] [INFO ] [MAIN ] Derivative Progress: 956/2164 symbols completed. HPS took 1.2s. Estimated remaining: 8m 8s. Rate: 148.5 symbols/min [2025-10-24T00:50:21.450982] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:21.456013] [INFO ] [MAIN ] HPQ: Generated 139 derivative records from 54059 primary records. [2025-10-24T00:50:21.456165] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-24T00:50:21.456379] [FATAL] [LOCAL ] HPQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:21.456507] [FATAL] [MAIN ] HPQ: Failed to save derivative data. [2025-10-24T00:50:21.459716] [INFO ] [MAIN ] Derivative Progress: 957/2164 symbols completed. HPQ took 1.2s. Estimated remaining: 8m 7s. Rate: 148.7 symbols/min [2025-10-24T00:50:21.460005] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:21.480214] [DEBUG] [LOCAL ] HQL: Loaded 17005 existing records from primary storage. [2025-10-24T00:50:21.480447] [INFO ] [MAIN ] HQL: Loaded 17005 primary data records. [2025-10-24T00:50:21.564953] [DEBUG] [LOCAL ] HQH: Loaded 25921 existing records from primary storage. [2025-10-24T00:50:21.595056] [INFO ] [MAIN ] HQH: Loaded 25921 primary data records. [2025-10-24T00:50:21.930700] [DEBUG] [LOCAL ] HR: Loaded 52495 existing records from primary storage. [2025-10-24T00:50:21.981153] [INFO ] [MAIN ] HR: Loaded 52495 primary data records. [2025-10-24T00:50:22.442484] [DEBUG] [MAIN ] HQL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:22.526252] [DEBUG] [MAIN ] HQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:22.559891] [DEBUG] [MAIN ] HR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:22.603534] [INFO ] [MAIN ] HQL: Generated 139 derivative records from 17005 primary records. [2025-10-24T00:50:22.604534] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-24T00:50:22.604788] [FATAL] [LOCAL ] HQL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:22.605376] [FATAL] [MAIN ] HQL: Failed to save derivative data. [2025-10-24T00:50:22.610199] [INFO ] [MAIN ] Derivative Progress: 958/2164 symbols completed. HQL took 1.2s. Estimated remaining: 8m 8s. Rate: 148.4 symbols/min [2025-10-24T00:50:22.618855] [INFO ] [MAIN ] HQH: Generated 139 derivative records from 25921 primary records. [2025-10-24T00:50:22.619124] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-24T00:50:22.619541] [FATAL] [LOCAL ] HQH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:22.619724] [FATAL] [MAIN ] HQH: Failed to save derivative data. [2025-10-24T00:50:22.623152] [INFO ] [MAIN ] Derivative Progress: 959/2164 symbols completed. HQH took 1.2s. Estimated remaining: 8m 7s. Rate: 148.5 symbols/min [2025-10-24T00:50:22.625137] [INFO ] [MAIN ] HR: Generated 139 derivative records from 52495 primary records. [2025-10-24T00:50:22.625223] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-24T00:50:22.625414] [FATAL] [LOCAL ] HR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:22.625490] [FATAL] [MAIN ] HR: Failed to save derivative data. [2025-10-24T00:50:22.629490] [INFO ] [MAIN ] Derivative Progress: 960/2164 symbols completed. HR took 1.2s. Estimated remaining: 8m 6s. Rate: 148.7 symbols/min [2025-10-24T00:50:22.629862] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:22.629908] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:22.629950] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:22.674537] [DEBUG] [LOCAL ] HRI: Loaded 32395 existing records from primary storage. [2025-10-24T00:50:22.674788] [INFO ] [MAIN ] HRI: Loaded 32395 primary data records. [2025-10-24T00:50:22.804218] [DEBUG] [LOCAL ] HRB: Loaded 48553 existing records from primary storage. [2025-10-24T00:50:22.804950] [INFO ] [MAIN ] HRB: Loaded 48553 primary data records. [2025-10-24T00:50:22.977804] [DEBUG] [LOCAL ] HRL: Loaded 53511 existing records from primary storage. [2025-10-24T00:50:22.996185] [INFO ] [MAIN ] HRL: Loaded 53511 primary data records. [2025-10-24T00:50:23.659532] [DEBUG] [MAIN ] HRI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:23.692285] [DEBUG] [MAIN ] HRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:23.735920] [DEBUG] [MAIN ] HRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:23.774964] [INFO ] [MAIN ] HRI: Generated 139 derivative records from 32395 primary records. [2025-10-24T00:50:23.777798] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-24T00:50:23.784756] [FATAL] [LOCAL ] HRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:23.787896] [FATAL] [MAIN ] HRI: Failed to save derivative data. [2025-10-24T00:50:23.790125] [INFO ] [MAIN ] Derivative Progress: 961/2164 symbols completed. HRI took 1.2s. Estimated remaining: 8m 6s. Rate: 148.4 symbols/min [2025-10-24T00:50:23.792522] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:23.797443] [INFO ] [MAIN ] HRB: Generated 139 derivative records from 48553 primary records. [2025-10-24T00:50:23.800431] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-24T00:50:23.804158] [INFO ] [MAIN ] HRL: Generated 139 derivative records from 53511 primary records. [2025-10-24T00:50:23.802353] [FATAL] [LOCAL ] HRB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:23.804384] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-24T00:50:23.804753] [FATAL] [LOCAL ] HRL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:23.804818] [FATAL] [MAIN ] HRB: Failed to save derivative data. [2025-10-24T00:50:23.804983] [FATAL] [MAIN ] HRL: Failed to save derivative data. [2025-10-24T00:50:23.807978] [INFO ] [MAIN ] Derivative Progress: 962/2164 symbols completed. HRB took 1.2s. Estimated remaining: 8m 5s. Rate: 148.6 symbols/min [2025-10-24T00:50:23.812158] [INFO ] [MAIN ] Derivative Progress: 963/2164 symbols completed. HRL took 1.2s. Estimated remaining: 8m 5s. Rate: 148.7 symbols/min [2025-10-24T00:50:23.812047] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:23.812774] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:23.836578] [DEBUG] [LOCAL ] HSHP: Loaded 14520 existing records from primary storage. [2025-10-24T00:50:23.836842] [INFO ] [MAIN ] HSHP: Loaded 14520 primary data records. [2025-10-24T00:50:23.938995] [DEBUG] [LOCAL ] HRTG: Loaded 34749 existing records from primary storage. [2025-10-24T00:50:23.969052] [INFO ] [MAIN ] HRTG: Loaded 34749 primary data records. [2025-10-24T00:50:24.288362] [DEBUG] [LOCAL ] HSBC: Loaded 51359 existing records from primary storage. [2025-10-24T00:50:24.326821] [INFO ] [MAIN ] HSBC: Loaded 51359 primary data records. [2025-10-24T00:50:24.886634] [DEBUG] [MAIN ] HSHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:24.929351] [DEBUG] [MAIN ] HRTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:24.965763] [DEBUG] [MAIN ] HSBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:25.004834] [INFO ] [MAIN ] HSHP: Generated 139 derivative records from 14520 primary records. [2025-10-24T00:50:25.005704] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-24T00:50:25.006751] [FATAL] [LOCAL ] HSHP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:25.012404] [FATAL] [MAIN ] HSHP: Failed to save derivative data. [2025-10-24T00:50:25.015231] [INFO ] [MAIN ] Derivative Progress: 964/2164 symbols completed. HSHP took 1.2s. Estimated remaining: 8m 5s. Rate: 148.4 symbols/min [2025-10-24T00:50:25.017990] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:25.020535] [INFO ] [MAIN ] HRTG: Generated 139 derivative records from 34749 primary records. [2025-10-24T00:50:25.021067] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-24T00:50:25.021357] [FATAL] [LOCAL ] HRTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:25.024245] [FATAL] [MAIN ] HRTG: Failed to save derivative data. [2025-10-24T00:50:25.027006] [INFO ] [MAIN ] Derivative Progress: 965/2164 symbols completed. HRTG took 1.2s. Estimated remaining: 8m 4s. Rate: 148.6 symbols/min [2025-10-24T00:50:25.027355] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:25.036466] [INFO ] [MAIN ] HSBC: Generated 139 derivative records from 51359 primary records. [2025-10-24T00:50:25.036947] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-24T00:50:25.037462] [FATAL] [LOCAL ] HSBC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:25.037695] [FATAL] [MAIN ] HSBC: Failed to save derivative data. [2025-10-24T00:50:25.045116] [INFO ] [MAIN ] Derivative Progress: 966/2164 symbols completed. HSBC took 1.2s. Estimated remaining: 8m 3s. Rate: 148.7 symbols/min [2025-10-24T00:50:25.045614] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:25.052805] [DEBUG] [LOCAL ] HTD: Loaded 14322 existing records from primary storage. [2025-10-24T00:50:25.052975] [INFO ] [MAIN ] HTD: Loaded 14322 primary data records. [2025-10-24T00:50:25.255847] [DEBUG] [LOCAL ] HSY: Loaded 50734 existing records from primary storage. [2025-10-24T00:50:25.262615] [INFO ] [MAIN ] HSY: Loaded 50734 primary data records. [2025-10-24T00:50:25.560565] [DEBUG] [LOCAL ] HTGC: Loaded 48027 existing records from primary storage. [2025-10-24T00:50:25.597963] [INFO ] [MAIN ] HTGC: Loaded 48027 primary data records. [2025-10-24T00:50:26.051981] [DEBUG] [MAIN ] HTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:26.091859] [DEBUG] [MAIN ] HSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:26.145231] [DEBUG] [MAIN ] HTGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:26.177243] [INFO ] [MAIN ] HTD: Generated 139 derivative records from 14322 primary records. [2025-10-24T00:50:26.180531] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-24T00:50:26.182988] [FATAL] [LOCAL ] HTD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:26.184825] [FATAL] [MAIN ] HTD: Failed to save derivative data. [2025-10-24T00:50:26.190486] [INFO ] [MAIN ] HSY: Generated 139 derivative records from 50734 primary records. [2025-10-24T00:50:26.189825] [INFO ] [MAIN ] Derivative Progress: 967/2164 symbols completed. HTD took 1.2s. Estimated remaining: 8m 4s. Rate: 148.4 symbols/min [2025-10-24T00:50:26.193673] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-24T00:50:26.193870] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:26.195421] [FATAL] [LOCAL ] HSY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:26.195565] [FATAL] [MAIN ] HSY: Failed to save derivative data. [2025-10-24T00:50:26.201174] [INFO ] [MAIN ] Derivative Progress: 968/2164 symbols completed. HSY took 1.2s. Estimated remaining: 8m 3s. Rate: 148.6 symbols/min [2025-10-24T00:50:26.204060] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:26.212261] [INFO ] [MAIN ] HTGC: Generated 139 derivative records from 48027 primary records. [2025-10-24T00:50:26.212435] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-24T00:50:26.212668] [FATAL] [LOCAL ] HTGC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:26.212744] [FATAL] [MAIN ] HTGC: Failed to save derivative data. [2025-10-24T00:50:26.215753] [INFO ] [MAIN ] Derivative Progress: 969/2164 symbols completed. HTGC took 1.2s. Estimated remaining: 8m 2s. Rate: 148.7 symbols/min [2025-10-24T00:50:26.215928] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:26.240490] [DEBUG] [LOCAL ] HTH: Loaded 32621 existing records from primary storage. [2025-10-24T00:50:26.240756] [INFO ] [MAIN ] HTH: Loaded 32621 primary data records. [2025-10-24T00:50:26.435943] [DEBUG] [LOCAL ] HUBB: Loaded 36236 existing records from primary storage. [2025-10-24T00:50:26.566707] [INFO ] [MAIN ] HUBB: Loaded 36236 primary data records. [2025-10-24T00:50:26.580850] [DEBUG] [LOCAL ] HUBS: Loaded 40156 existing records from primary storage. [2025-10-24T00:50:26.586453] [INFO ] [MAIN ] HUBS: Loaded 40156 primary data records. [2025-10-24T00:50:27.283777] [DEBUG] [MAIN ] HTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:27.328195] [DEBUG] [MAIN ] HUBS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:27.364923] [DEBUG] [MAIN ] HUBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:27.406216] [INFO ] [MAIN ] HTH: Generated 139 derivative records from 32621 primary records. [2025-10-24T00:50:27.410381] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-24T00:50:27.411675] [FATAL] [LOCAL ] HTH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:27.414287] [FATAL] [MAIN ] HTH: Failed to save derivative data. [2025-10-24T00:50:27.418237] [INFO ] [MAIN ] Derivative Progress: 970/2164 symbols completed. HTH took 1.2s. Estimated remaining: 8m 3s. Rate: 148.4 symbols/min [2025-10-24T00:50:27.418740] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:27.431768] [INFO ] [MAIN ] HUBB: Generated 139 derivative records from 36236 primary records. [2025-10-24T00:50:27.433915] [INFO ] [MAIN ] HUBS: Generated 139 derivative records from 40156 primary records. [2025-10-24T00:50:27.434024] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-24T00:50:27.434628] [FATAL] [LOCAL ] HUBB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:27.434323] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-24T00:50:27.434741] [FATAL] [MAIN ] HUBB: Failed to save derivative data. [2025-10-24T00:50:27.435016] [FATAL] [LOCAL ] HUBS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:27.437448] [INFO ] [MAIN ] Derivative Progress: 971/2164 symbols completed. HUBB took 1.2s. Estimated remaining: 8m 2s. Rate: 148.6 symbols/min [2025-10-24T00:50:27.437881] [FATAL] [MAIN ] HUBS: Failed to save derivative data. [2025-10-24T00:50:27.441079] [INFO ] [MAIN ] Derivative Progress: 972/2164 symbols completed. HUBS took 1.2s. Estimated remaining: 8m 1s. Rate: 148.7 symbols/min [2025-10-24T00:50:27.437779] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:27.441537] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:27.505019] [DEBUG] [LOCAL ] HUYA: Loaded 43945 existing records from primary storage. [2025-10-24T00:50:27.506250] [INFO ] [MAIN ] HUYA: Loaded 43945 primary data records. [2025-10-24T00:50:27.538233] [DEBUG] [LOCAL ] HUM: Loaded 49574 existing records from primary storage. [2025-10-24T00:50:27.544486] [INFO ] [MAIN ] HUM: Loaded 49574 primary data records. [2025-10-24T00:50:27.958083] [DEBUG] [LOCAL ] HUN: Loaded 53600 existing records from primary storage. [2025-10-24T00:50:27.991150] [INFO ] [MAIN ] HUN: Loaded 53600 primary data records. [2025-10-24T00:50:28.473017] [DEBUG] [MAIN ] HUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:28.509466] [DEBUG] [MAIN ] HUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:28.550191] [DEBUG] [MAIN ] HUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:28.593221] [INFO ] [MAIN ] HUYA: Generated 139 derivative records from 43945 primary records. [2025-10-24T00:50:28.595889] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-24T00:50:28.596175] [FATAL] [LOCAL ] HUYA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:28.596403] [FATAL] [MAIN ] HUYA: Failed to save derivative data. [2025-10-24T00:50:28.599884] [INFO ] [MAIN ] Derivative Progress: 973/2164 symbols completed. HUYA took 1.2s. Estimated remaining: 8m 1s. Rate: 148.4 symbols/min [2025-10-24T00:50:28.602458] [INFO ] [MAIN ] HUM: Generated 139 derivative records from 49574 primary records. [2025-10-24T00:50:28.605327] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-24T00:50:28.605570] [FATAL] [LOCAL ] HUM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:28.606967] [FATAL] [MAIN ] HUM: Failed to save derivative data. [2025-10-24T00:50:28.609877] [INFO ] [MAIN ] Derivative Progress: 974/2164 symbols completed. HUM took 1.2s. Estimated remaining: 8m 1s. Rate: 148.6 symbols/min [2025-10-24T00:50:28.614126] [INFO ] [MAIN ] HUN: Generated 139 derivative records from 53600 primary records. [2025-10-24T00:50:28.614244] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-24T00:50:28.614438] [FATAL] [LOCAL ] HUN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:28.614513] [FATAL] [MAIN ] HUN: Failed to save derivative data. [2025-10-24T00:50:28.618753] [INFO ] [MAIN ] Derivative Progress: 975/2164 symbols completed. HUN took 1.2s. Estimated remaining: 7m 60s. Rate: 148.7 symbols/min [2025-10-24T00:50:28.619208] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:28.619158] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:28.619261] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:28.640147] [DEBUG] [LOCAL ] HVT: Loaded 14832 existing records from primary storage. [2025-10-24T00:50:28.640409] [INFO ] [MAIN ] HVT: Loaded 14832 primary data records. [2025-10-24T00:50:28.860929] [DEBUG] [LOCAL ] HXL: Loaded 46178 existing records from primary storage. [2025-10-24T00:50:28.996709] [INFO ] [MAIN ] HXL: Loaded 46178 primary data records. [2025-10-24T00:50:29.032864] [DEBUG] [LOCAL ] HWM: Loaded 53083 existing records from primary storage. [2025-10-24T00:50:29.077006] [INFO ] [MAIN ] HWM: Loaded 53083 primary data records. [2025-10-24T00:50:29.626990] [DEBUG] [MAIN ] HVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:29.682039] [DEBUG] [MAIN ] HWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:29.682332] [DEBUG] [MAIN ] HXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:29.747591] [INFO ] [MAIN ] HVT: Generated 139 derivative records from 14832 primary records. [2025-10-24T00:50:29.751305] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-24T00:50:29.759708] [FATAL] [LOCAL ] HVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:29.760142] [FATAL] [MAIN ] HVT: Failed to save derivative data. [2025-10-24T00:50:29.764630] [INFO ] [MAIN ] Derivative Progress: 976/2164 symbols completed. HVT took 1.1s. Estimated remaining: 8m 0s. Rate: 148.4 symbols/min [2025-10-24T00:50:29.765543] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:29.791103] [DEBUG] [LOCAL ] HY: Loaded 9894 existing records from primary storage. [2025-10-24T00:50:29.793459] [INFO ] [MAIN ] HY: Loaded 9894 primary data records. [2025-10-24T00:50:29.805748] [INFO ] [MAIN ] HXL: Generated 139 derivative records from 46178 primary records. [2025-10-24T00:50:29.839123] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-24T00:50:29.838851] [INFO ] [MAIN ] HWM: Generated 139 derivative records from 53083 primary records. [2025-10-24T00:50:29.865298] [FATAL] [LOCAL ] HXL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:29.864872] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-24T00:50:29.887408] [FATAL] [LOCAL ] HWM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:29.871792] [FATAL] [MAIN ] HXL: Failed to save derivative data. [2025-10-24T00:50:29.887527] [FATAL] [MAIN ] HWM: Failed to save derivative data. [2025-10-24T00:50:29.901037] [INFO ] [MAIN ] Derivative Progress: 977/2164 symbols completed. HWM took 1.3s. Estimated remaining: 7m 59s. Rate: 148.5 symbols/min [2025-10-24T00:50:29.905268] [INFO ] [MAIN ] Derivative Progress: 978/2164 symbols completed. HXL took 1.3s. Estimated remaining: 7m 59s. Rate: 148.7 symbols/min [2025-10-24T00:50:29.904769] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:29.905417] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:30.104445] [DEBUG] [LOCAL ] HYI: Loaded 9666 existing records from primary storage. [2025-10-24T00:50:30.105159] [INFO ] [MAIN ] HYI: Loaded 9666 primary data records. [2025-10-24T00:50:30.226265] [DEBUG] [LOCAL ] HYT: Loaded 33782 existing records from primary storage. [2025-10-24T00:50:30.243256] [INFO ] [MAIN ] HYT: Loaded 33782 primary data records. [2025-10-24T00:50:30.791538] [DEBUG] [MAIN ] HY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:30.835884] [DEBUG] [MAIN ] HYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:30.887946] [INFO ] [MAIN ] HY: Generated 139 derivative records from 9894 primary records. [2025-10-24T00:50:30.888250] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-24T00:50:30.891792] [FATAL] [LOCAL ] HY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:30.888801] [DEBUG] [MAIN ] HYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:30.892037] [FATAL] [MAIN ] HY: Failed to save derivative data. [2025-10-24T00:50:30.894210] [INFO ] [MAIN ] Derivative Progress: 979/2164 symbols completed. HY took 1.1s. Estimated remaining: 7m 59s. Rate: 148.5 symbols/min [2025-10-24T00:50:30.907737] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:30.916895] [INFO ] [MAIN ] HYI: Generated 139 derivative records from 9666 primary records. [2025-10-24T00:50:30.919010] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-24T00:50:30.919595] [FATAL] [LOCAL ] HYI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:30.922054] [DEBUG] [LOCAL ] HYTR: Loaded 3121 existing records from primary storage. [2025-10-24T00:50:30.922362] [INFO ] [MAIN ] HYTR: Loaded 3121 primary data records. [2025-10-24T00:50:30.922156] [FATAL] [MAIN ] HYI: Failed to save derivative data. [2025-10-24T00:50:30.938838] [INFO ] [MAIN ] Derivative Progress: 980/2164 symbols completed. HYI took 1.0s. Estimated remaining: 7m 58s. Rate: 148.6 symbols/min [2025-10-24T00:50:30.958709] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:31.255729] [DEBUG] [LOCAL ] HZO: Loaded 28679 existing records from primary storage. [2025-10-24T00:50:31.255992] [INFO ] [MAIN ] HZO: Loaded 28679 primary data records. [2025-10-24T00:50:31.336446] [INFO ] [MAIN ] HYT: Generated 139 derivative records from 33782 primary records. [2025-10-24T00:50:31.363593] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-24T00:50:31.363902] [FATAL] [LOCAL ] HYT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:31.364200] [FATAL] [MAIN ] HYT: Failed to save derivative data. [2025-10-24T00:50:31.373086] [INFO ] [MAIN ] Derivative Progress: 981/2164 symbols completed. HYT took 1.5s. Estimated remaining: 7m 58s. Rate: 148.6 symbols/min [2025-10-24T00:50:31.378575] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:31.579687] [DEBUG] [MAIN ] HYTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:31.579170] [DEBUG] [LOCAL ] IAE: Loaded 6361 existing records from primary storage. [2025-10-24T00:50:31.591181] [INFO ] [MAIN ] IAE: Loaded 6361 primary data records. [2025-10-24T00:50:31.935814] [DEBUG] [MAIN ] HZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:31.922805] [INFO ] [MAIN ] HYTR: Generated 139 derivative records from 3121 primary records. [2025-10-24T00:50:31.948629] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-24T00:50:31.951286] [FATAL] [LOCAL ] HYTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:31.951406] [FATAL] [MAIN ] HYTR: Failed to save derivative data. [2025-10-24T00:50:31.953702] [INFO ] [MAIN ] Derivative Progress: 982/2164 symbols completed. HYTR took 1.0s. Estimated remaining: 7m 57s. Rate: 148.5 symbols/min [2025-10-24T00:50:31.955857] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:31.989762] [INFO ] [MAIN ] HZO: Generated 139 derivative records from 28679 primary records. [2025-10-24T00:50:31.987851] [DEBUG] [MAIN ] IAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:32.000407] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-24T00:50:32.001905] [FATAL] [LOCAL ] HZO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:32.004606] [FATAL] [MAIN ] HZO: Failed to save derivative data. [2025-10-24T00:50:32.007523] [INFO ] [MAIN ] Derivative Progress: 983/2164 symbols completed. HZO took 1.0s. Estimated remaining: 7m 57s. Rate: 148.7 symbols/min [2025-10-24T00:50:32.008066] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:32.060080] [INFO ] [MAIN ] IAE: Generated 139 derivative records from 6361 primary records. [2025-10-24T00:50:32.060964] [DEBUG] [LOCAL ] IAG: Loaded 53882 existing records from primary storage. [2025-10-24T00:50:32.061180] [INFO ] [MAIN ] IAG: Loaded 53882 primary data records. [2025-10-24T00:50:32.072813] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-24T00:50:32.126086] [FATAL] [LOCAL ] IAE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:32.161348] [FATAL] [MAIN ] IAE: Failed to save derivative data. [2025-10-24T00:50:32.187201] [INFO ] [MAIN ] Derivative Progress: 984/2164 symbols completed. IAE took 0.8s. Estimated remaining: 7m 56s. Rate: 148.7 symbols/min [2025-10-24T00:50:32.208258] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:32.407114] [DEBUG] [LOCAL ] IBM: Loaded 54018 existing records from primary storage. [2025-10-24T00:50:32.410082] [INFO ] [MAIN ] IBM: Loaded 54018 primary data records. [2025-10-24T00:50:32.799891] [DEBUG] [LOCAL ] IBN: Loaded 53220 existing records from primary storage. [2025-10-24T00:50:32.801069] [INFO ] [MAIN ] IBN: Loaded 53220 primary data records. [2025-10-24T00:50:32.966812] [DEBUG] [MAIN ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:33.192917] [DEBUG] [MAIN ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:33.258881] [INFO ] [MAIN ] IAG: Generated 139 derivative records from 53882 primary records. [2025-10-24T00:50:33.259332] [DEBUG] [MAIN ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:33.259922] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-24T00:50:33.272267] [FATAL] [LOCAL ] IAG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:33.278999] [FATAL] [MAIN ] IAG: Failed to save derivative data. [2025-10-24T00:50:33.283045] [INFO ] [MAIN ] Derivative Progress: 985/2164 symbols completed. IAG took 1.3s. Estimated remaining: 7m 56s. Rate: 148.5 symbols/min [2025-10-24T00:50:33.283844] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:33.305927] [INFO ] [MAIN ] IBM: Generated 139 derivative records from 54018 primary records. [2025-10-24T00:50:33.306564] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-24T00:50:33.306980] [FATAL] [LOCAL ] IBM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:33.307430] [FATAL] [MAIN ] IBM: Failed to save derivative data. [2025-10-24T00:50:33.312252] [INFO ] [MAIN ] Derivative Progress: 986/2164 symbols completed. IBM took 1.3s. Estimated remaining: 7m 56s. Rate: 148.6 symbols/min [2025-10-24T00:50:33.315672] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:33.335069] [INFO ] [MAIN ] IBN: Generated 139 derivative records from 53220 primary records. [2025-10-24T00:50:33.335331] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-24T00:50:33.335593] [FATAL] [LOCAL ] IBN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:33.335817] [FATAL] [MAIN ] IBN: Failed to save derivative data. [2025-10-24T00:50:33.340573] [INFO ] [MAIN ] Derivative Progress: 987/2164 symbols completed. IBN took 1.1s. Estimated remaining: 7m 55s. Rate: 148.8 symbols/min [2025-10-24T00:50:33.341028] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:33.352303] [DEBUG] [LOCAL ] IBP: Loaded 28822 existing records from primary storage. [2025-10-24T00:50:33.352629] [INFO ] [MAIN ] IBP: Loaded 28822 primary data records. [2025-10-24T00:50:33.526388] [DEBUG] [LOCAL ] IBTA: Loaded 36287 existing records from primary storage. [2025-10-24T00:50:33.671944] [INFO ] [MAIN ] IBTA: Loaded 36287 primary data records. [2025-10-24T00:50:33.835806] [DEBUG] [LOCAL ] ICE: Loaded 53399 existing records from primary storage. [2025-10-24T00:50:33.867092] [INFO ] [MAIN ] ICE: Loaded 53399 primary data records. [2025-10-24T00:50:34.367148] [DEBUG] [MAIN ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:34.421844] [DEBUG] [MAIN ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:34.475529] [DEBUG] [MAIN ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:34.492580] [INFO ] [MAIN ] IBP: Generated 139 derivative records from 28822 primary records. [2025-10-24T00:50:34.498288] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-24T00:50:34.502353] [FATAL] [LOCAL ] IBP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:34.503152] [FATAL] [MAIN ] IBP: Failed to save derivative data. [2025-10-24T00:50:34.510879] [INFO ] [MAIN ] Derivative Progress: 988/2164 symbols completed. IBP took 1.2s. Estimated remaining: 7m 55s. Rate: 148.5 symbols/min [2025-10-24T00:50:34.528057] [INFO ] [MAIN ] IBTA: Generated 139 derivative records from 36287 primary records. [2025-10-24T00:50:34.531930] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-24T00:50:34.532421] [FATAL] [LOCAL ] IBTA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:34.532668] [FATAL] [MAIN ] IBTA: Failed to save derivative data. [2025-10-24T00:50:34.535359] [INFO ] [MAIN ] Derivative Progress: 989/2164 symbols completed. IBTA took 1.2s. Estimated remaining: 7m 54s. Rate: 148.6 symbols/min [2025-10-24T00:50:34.538202] [INFO ] [MAIN ] ICE: Generated 139 derivative records from 53399 primary records. [2025-10-24T00:50:34.538341] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-24T00:50:34.538554] [FATAL] [LOCAL ] ICE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:34.538633] [FATAL] [MAIN ] ICE: Failed to save derivative data. [2025-10-24T00:50:34.543494] [INFO ] [MAIN ] Derivative Progress: 990/2164 symbols completed. ICE took 1.2s. Estimated remaining: 7m 53s. Rate: 148.8 symbols/min [2025-10-24T00:50:34.544105] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:34.544175] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:34.544232] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:34.558406] [DEBUG] [LOCAL ] IDE: Loaded 9157 existing records from primary storage. [2025-10-24T00:50:34.558811] [INFO ] [MAIN ] IDE: Loaded 9157 primary data records. [2025-10-24T00:50:34.764165] [DEBUG] [LOCAL ] IDA: Loaded 32984 existing records from primary storage. [2025-10-24T00:50:34.932413] [INFO ] [MAIN ] IDA: Loaded 32984 primary data records. [2025-10-24T00:50:34.942637] [DEBUG] [LOCAL ] ICL: Loaded 38354 existing records from primary storage. [2025-10-24T00:50:34.954596] [INFO ] [MAIN ] ICL: Loaded 38354 primary data records. [2025-10-24T00:50:35.592744] [DEBUG] [MAIN ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:35.635497] [DEBUG] [MAIN ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:35.678547] [DEBUG] [MAIN ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:35.712238] [INFO ] [MAIN ] IDE: Generated 139 derivative records from 9157 primary records. [2025-10-24T00:50:35.718104] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-24T00:50:35.718630] [FATAL] [LOCAL ] IDE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:35.718865] [FATAL] [MAIN ] IDE: Failed to save derivative data. [2025-10-24T00:50:35.727369] [INFO ] [MAIN ] Derivative Progress: 991/2164 symbols completed. IDE took 1.2s. Estimated remaining: 7m 54s. Rate: 148.5 symbols/min [2025-10-24T00:50:35.728348] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:35.742408] [INFO ] [MAIN ] IDA: Generated 139 derivative records from 32984 primary records. [2025-10-24T00:50:35.746475] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-24T00:50:35.752454] [FATAL] [LOCAL ] IDA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:35.752918] [FATAL] [MAIN ] IDA: Failed to save derivative data. [2025-10-24T00:50:35.756862] [INFO ] [MAIN ] Derivative Progress: 992/2164 symbols completed. IDA took 1.2s. Estimated remaining: 7m 53s. Rate: 148.6 symbols/min [2025-10-24T00:50:35.759387] [INFO ] [MAIN ] ICL: Generated 139 derivative records from 38354 primary records. [2025-10-24T00:50:35.759788] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:35.760148] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-24T00:50:35.760897] [FATAL] [LOCAL ] ICL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:35.766858] [FATAL] [MAIN ] ICL: Failed to save derivative data. [2025-10-24T00:50:35.770884] [INFO ] [MAIN ] Derivative Progress: 993/2164 symbols completed. ICL took 1.2s. Estimated remaining: 7m 52s. Rate: 148.8 symbols/min [2025-10-24T00:50:35.771271] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:35.772390] [DEBUG] [LOCAL ] IDT: Loaded 18655 existing records from primary storage. [2025-10-24T00:50:35.772670] [INFO ] [MAIN ] IDT: Loaded 18655 primary data records. [2025-10-24T00:50:36.117286] [DEBUG] [LOCAL ] IEX: Loaded 38489 existing records from primary storage. [2025-10-24T00:50:36.118286] [INFO ] [MAIN ] IEX: Loaded 38489 primary data records. [2025-10-24T00:50:36.197279] [DEBUG] [LOCAL ] IFF: Loaded 51608 existing records from primary storage. [2025-10-24T00:50:36.229549] [INFO ] [MAIN ] IFF: Loaded 51608 primary data records. [2025-10-24T00:50:36.663358] [DEBUG] [MAIN ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:36.903056] [DEBUG] [MAIN ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:36.932593] [INFO ] [MAIN ] IDT: Generated 139 derivative records from 18655 primary records. [2025-10-24T00:50:36.936840] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-24T00:50:36.937512] [FATAL] [LOCAL ] IDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:36.937827] [FATAL] [MAIN ] IDT: Failed to save derivative data. [2025-10-24T00:50:36.940912] [INFO ] [MAIN ] Derivative Progress: 994/2164 symbols completed. IDT took 1.2s. Estimated remaining: 7m 53s. Rate: 148.5 symbols/min [2025-10-24T00:50:36.955144] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:36.957981] [DEBUG] [MAIN ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:37.003561] [DEBUG] [LOCAL ] IFN: Loaded 18692 existing records from primary storage. [2025-10-24T00:50:37.007592] [INFO ] [MAIN ] IFN: Loaded 18692 primary data records. [2025-10-24T00:50:37.009850] [INFO ] [MAIN ] IEX: Generated 139 derivative records from 38489 primary records. [2025-10-24T00:50:37.076317] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-24T00:50:37.094172] [FATAL] [LOCAL ] IEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:37.101394] [FATAL] [MAIN ] IEX: Failed to save derivative data. [2025-10-24T00:50:37.104174] [INFO ] [MAIN ] Derivative Progress: 995/2164 symbols completed. IEX took 1.3s. Estimated remaining: 7m 52s. Rate: 148.6 symbols/min [2025-10-24T00:50:37.105562] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:37.319806] [INFO ] [MAIN ] IFF: Generated 139 derivative records from 51608 primary records. [2025-10-24T00:50:37.328490] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-24T00:50:37.329461] [FATAL] [LOCAL ] IFF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:37.329592] [FATAL] [MAIN ] IFF: Failed to save derivative data. [2025-10-24T00:50:37.339912] [INFO ] [MAIN ] Derivative Progress: 996/2164 symbols completed. IFF took 1.6s. Estimated remaining: 7m 52s. Rate: 148.6 symbols/min [2025-10-24T00:50:37.340957] [DEBUG] [LOCAL ] IFS: Loaded 22293 existing records from primary storage. [2025-10-24T00:50:37.341352] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:37.341558] [INFO ] [MAIN ] IFS: Loaded 22293 primary data records. [2025-10-24T00:50:37.476299] [DEBUG] [LOCAL ] IGA: Loaded 10175 existing records from primary storage. [2025-10-24T00:50:37.503239] [INFO ] [MAIN ] IGA: Loaded 10175 primary data records. [2025-10-24T00:50:37.875906] [DEBUG] [MAIN ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:38.060133] [DEBUG] [MAIN ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:38.104468] [INFO ] [MAIN ] IFN: Generated 139 derivative records from 18692 primary records. [2025-10-24T00:50:38.108619] [DEBUG] [MAIN ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:38.121025] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-24T00:50:38.122138] [FATAL] [LOCAL ] IFN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:38.124176] [FATAL] [MAIN ] IFN: Failed to save derivative data. [2025-10-24T00:50:38.129336] [INFO ] [MAIN ] Derivative Progress: 997/2164 symbols completed. IFN took 1.2s. Estimated remaining: 7m 52s. Rate: 148.5 symbols/min [2025-10-24T00:50:38.129587] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:38.168745] [DEBUG] [LOCAL ] IGD: Loaded 19340 existing records from primary storage. [2025-10-24T00:50:38.173960] [INFO ] [MAIN ] IGD: Loaded 19340 primary data records. [2025-10-24T00:50:38.221455] [INFO ] [MAIN ] IFS: Generated 139 derivative records from 22293 primary records. [2025-10-24T00:50:38.255486] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-24T00:50:38.256278] [FATAL] [LOCAL ] IFS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:38.261597] [FATAL] [MAIN ] IFS: Failed to save derivative data. [2025-10-24T00:50:38.279454] [INFO ] [MAIN ] Derivative Progress: 998/2164 symbols completed. IFS took 1.2s. Estimated remaining: 7m 51s. Rate: 148.6 symbols/min [2025-10-24T00:50:38.284986] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:38.308370] [INFO ] [MAIN ] IGA: Generated 139 derivative records from 10175 primary records. [2025-10-24T00:50:38.308702] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-24T00:50:38.309015] [FATAL] [LOCAL ] IGA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:38.309875] [FATAL] [MAIN ] IGA: Failed to save derivative data. [2025-10-24T00:50:38.324949] [INFO ] [MAIN ] Derivative Progress: 999/2164 symbols completed. IGA took 1.0s. Estimated remaining: 7m 50s. Rate: 148.7 symbols/min [2025-10-24T00:50:38.353464] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:38.374228] [DEBUG] [LOCAL ] IGI: Loaded 4171 existing records from primary storage. [2025-10-24T00:50:38.399819] [INFO ] [MAIN ] IGI: Loaded 4171 primary data records. [2025-10-24T00:50:38.936239] [DEBUG] [LOCAL ] IGR: Loaded 30712 existing records from primary storage. [2025-10-24T00:50:38.938585] [INFO ] [MAIN ] IGR: Loaded 30712 primary data records. [2025-10-24T00:50:39.309632] [DEBUG] [MAIN ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:39.353478] [DEBUG] [MAIN ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:39.415457] [INFO ] [MAIN ] IGD: Generated 139 derivative records from 19340 primary records. [2025-10-24T00:50:39.416550] [DEBUG] [MAIN ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:39.416789] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-24T00:50:39.419294] [FATAL] [LOCAL ] IGD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:39.430594] [FATAL] [MAIN ] IGD: Failed to save derivative data. [2025-10-24T00:50:39.437910] [INFO ] [MAIN ] Derivative Progress: 1000/2164 symbols completed. IGD took 1.3s. Estimated remaining: 7m 50s. Rate: 148.5 symbols/min [2025-10-24T00:50:39.438363] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:39.450834] [DEBUG] [LOCAL ] IH: Loaded 2735 existing records from primary storage. [2025-10-24T00:50:39.453028] [INFO ] [MAIN ] IH: Loaded 2735 primary data records. [2025-10-24T00:50:39.511356] [INFO ] [MAIN ] IGI: Generated 139 derivative records from 4171 primary records. [2025-10-24T00:50:39.537000] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-24T00:50:39.562294] [FATAL] [LOCAL ] IGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:39.563851] [FATAL] [MAIN ] IGI: Failed to save derivative data. [2025-10-24T00:50:39.567181] [INFO ] [MAIN ] Derivative Progress: 1001/2164 symbols completed. IGI took 1.3s. Estimated remaining: 7m 50s. Rate: 148.6 symbols/min [2025-10-24T00:50:39.578338] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:39.782064] [INFO ] [MAIN ] IGR: Generated 139 derivative records from 30712 primary records. [2025-10-24T00:50:39.787481] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-24T00:50:39.788430] [DEBUG] [LOCAL ] IHD: Loaded 7400 existing records from primary storage. [2025-10-24T00:50:39.789091] [INFO ] [MAIN ] IHD: Loaded 7400 primary data records. [2025-10-24T00:50:39.790148] [FATAL] [LOCAL ] IGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:39.802077] [FATAL] [MAIN ] IGR: Failed to save derivative data. [2025-10-24T00:50:39.883924] [INFO ] [MAIN ] Derivative Progress: 1002/2164 symbols completed. IGR took 1.5s. Estimated remaining: 7m 49s. Rate: 148.6 symbols/min [2025-10-24T00:50:39.906465] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:40.174335] [DEBUG] [LOCAL ] IHG: Loaded 24115 existing records from primary storage. [2025-10-24T00:50:40.174757] [DEBUG] [MAIN ] IH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:40.187307] [INFO ] [MAIN ] IHG: Loaded 24115 primary data records. [2025-10-24T00:50:40.522585] [DEBUG] [MAIN ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:40.549900] [INFO ] [MAIN ] IH: Generated 139 derivative records from 2735 primary records. [2025-10-24T00:50:40.550590] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-24T00:50:40.551769] [FATAL] [LOCAL ] IH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:40.552263] [FATAL] [MAIN ] IH: Failed to save derivative data. [2025-10-24T00:50:40.554843] [INFO ] [MAIN ] Derivative Progress: 1003/2164 symbols completed. IH took 1.1s. Estimated remaining: 7m 49s. Rate: 148.5 symbols/min [2025-10-24T00:50:40.580288] [DEBUG] [MAIN ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:40.598698] [INFO ] [MAIN ] IHD: Generated 139 derivative records from 7400 primary records. [2025-10-24T00:50:40.600171] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-24T00:50:40.600517] [FATAL] [LOCAL ] IHD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:40.602757] [FATAL] [MAIN ] IHD: Failed to save derivative data. [2025-10-24T00:50:40.606922] [INFO ] [MAIN ] Derivative Progress: 1004/2164 symbols completed. IHD took 1.0s. Estimated remaining: 7m 48s. Rate: 148.6 symbols/min [2025-10-24T00:50:40.617883] [INFO ] [MAIN ] IHG: Generated 139 derivative records from 24115 primary records. [2025-10-24T00:50:40.618027] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-24T00:50:40.618257] [FATAL] [LOCAL ] IHG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:40.618350] [FATAL] [MAIN ] IHG: Failed to save derivative data. [2025-10-24T00:50:40.621265] [INFO ] [MAIN ] Derivative Progress: 1005/2164 symbols completed. IHG took 0.7s. Estimated remaining: 7m 47s. Rate: 148.8 symbols/min [2025-10-24T00:50:40.621826] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:40.621917] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:40.622163] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:40.632095] [DEBUG] [LOCAL ] IIF: Loaded 5300 existing records from primary storage. [2025-10-24T00:50:40.632381] [INFO ] [MAIN ] IIF: Loaded 5300 primary data records. [2025-10-24T00:50:40.758165] [DEBUG] [LOCAL ] IIIN: Loaded 16364 existing records from primary storage. [2025-10-24T00:50:40.797245] [INFO ] [MAIN ] IIIN: Loaded 16364 primary data records. [2025-10-24T00:50:40.901368] [DEBUG] [LOCAL ] IHS: Loaded 37440 existing records from primary storage. [2025-10-24T00:50:41.057280] [INFO ] [MAIN ] IHS: Loaded 37440 primary data records. [2025-10-24T00:50:41.652128] [DEBUG] [MAIN ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:41.693673] [DEBUG] [MAIN ] IIIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:41.730492] [DEBUG] [MAIN ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:41.773826] [INFO ] [MAIN ] IIF: Generated 139 derivative records from 5300 primary records. [2025-10-24T00:50:41.777190] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-24T00:50:41.780766] [FATAL] [LOCAL ] IIF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:41.783794] [FATAL] [MAIN ] IIF: Failed to save derivative data. [2025-10-24T00:50:41.786157] [INFO ] [MAIN ] Derivative Progress: 1006/2164 symbols completed. IIF took 1.2s. Estimated remaining: 7m 48s. Rate: 148.5 symbols/min [2025-10-24T00:50:41.786331] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:41.798419] [INFO ] [MAIN ] IIIN: Generated 139 derivative records from 16364 primary records. [2025-10-24T00:50:41.798796] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-24T00:50:41.799024] [FATAL] [LOCAL ] IIIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:41.799459] [FATAL] [MAIN ] IIIN: Failed to save derivative data. [2025-10-24T00:50:41.807228] [INFO ] [MAIN ] Derivative Progress: 1007/2164 symbols completed. IIIN took 1.2s. Estimated remaining: 7m 47s. Rate: 148.6 symbols/min [2025-10-24T00:50:41.807559] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:41.819764] [INFO ] [MAIN ] IHS: Generated 139 derivative records from 37440 primary records. [2025-10-24T00:50:41.820115] [DEBUG] [LOCAL ] IIM: Loaded 15593 existing records from primary storage. [2025-10-24T00:50:41.820279] [INFO ] [MAIN ] IIM: Loaded 15593 primary data records. [2025-10-24T00:50:41.825720] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-24T00:50:41.864036] [FATAL] [LOCAL ] IHS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:41.892412] [FATAL] [MAIN ] IHS: Failed to save derivative data. [2025-10-24T00:50:41.924618] [INFO ] [MAIN ] Derivative Progress: 1008/2164 symbols completed. IHS took 1.3s. Estimated remaining: 7m 46s. Rate: 148.7 symbols/min [2025-10-24T00:50:41.924828] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:41.969604] [DEBUG] [LOCAL ] IIPR: Loaded 29025 existing records from primary storage. [2025-10-24T00:50:41.996305] [INFO ] [MAIN ] IIPR: Loaded 29025 primary data records. [2025-10-24T00:50:42.501342] [DEBUG] [LOCAL ] IMAX: Loaded 43819 existing records from primary storage. [2025-10-24T00:50:42.503441] [INFO ] [MAIN ] IMAX: Loaded 43819 primary data records. [2025-10-24T00:50:42.833066] [DEBUG] [MAIN ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:42.871801] [DEBUG] [MAIN ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:42.925585] [DEBUG] [MAIN ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:42.930317] [INFO ] [MAIN ] IIM: Generated 139 derivative records from 15593 primary records. [2025-10-24T00:50:42.943733] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-24T00:50:42.945855] [FATAL] [LOCAL ] IIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:42.947823] [FATAL] [MAIN ] IIM: Failed to save derivative data. [2025-10-24T00:50:42.950243] [INFO ] [MAIN ] Derivative Progress: 1009/2164 symbols completed. IIM took 1.2s. Estimated remaining: 7m 47s. Rate: 148.5 symbols/min [2025-10-24T00:50:42.951408] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:42.966682] [INFO ] [MAIN ] IIPR: Generated 139 derivative records from 29025 primary records. [2025-10-24T00:50:42.968726] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-24T00:50:42.971186] [FATAL] [LOCAL ] IIPR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:42.971427] [FATAL] [MAIN ] IIPR: Failed to save derivative data. [2025-10-24T00:50:42.974343] [INFO ] [MAIN ] Derivative Progress: 1010/2164 symbols completed. IIPR took 1.2s. Estimated remaining: 7m 46s. Rate: 148.6 symbols/min [2025-10-24T00:50:42.974792] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:42.981909] [INFO ] [MAIN ] IMAX: Generated 139 derivative records from 43819 primary records. [2025-10-24T00:50:42.982192] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-24T00:50:42.982610] [FATAL] [LOCAL ] IMAX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:42.982788] [FATAL] [MAIN ] IMAX: Failed to save derivative data. [2025-10-24T00:50:42.985776] [INFO ] [MAIN ] Derivative Progress: 1011/2164 symbols completed. IMAX took 1.1s. Estimated remaining: 7m 45s. Rate: 148.8 symbols/min [2025-10-24T00:50:42.986216] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:43.031031] [DEBUG] [LOCAL ] INFA: Loaded 48954 existing records from primary storage. [2025-10-24T00:50:43.031375] [INFO ] [MAIN ] INFA: Loaded 48954 primary data records. [2025-10-24T00:50:43.167401] [DEBUG] [LOCAL ] INFY: Loaded 53986 existing records from primary storage. [2025-10-24T00:50:43.167972] [INFO ] [MAIN ] INFY: Loaded 53986 primary data records. [2025-10-24T00:50:43.505314] [DEBUG] [LOCAL ] ING: Loaded 51066 existing records from primary storage. [2025-10-24T00:50:43.521696] [INFO ] [MAIN ] ING: Loaded 51066 primary data records. [2025-10-24T00:50:44.009218] [DEBUG] [MAIN ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:44.041512] [DEBUG] [MAIN ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:44.077588] [DEBUG] [MAIN ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:44.125749] [INFO ] [MAIN ] INFA: Generated 139 derivative records from 48954 primary records. [2025-10-24T00:50:44.128362] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-24T00:50:44.128636] [FATAL] [LOCAL ] INFA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:44.129273] [FATAL] [MAIN ] INFA: Failed to save derivative data. [2025-10-24T00:50:44.133799] [INFO ] [MAIN ] Derivative Progress: 1012/2164 symbols completed. INFA took 1.2s. Estimated remaining: 7m 45s. Rate: 148.5 symbols/min [2025-10-24T00:50:44.136106] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:44.135947] [INFO ] [MAIN ] INFY: Generated 139 derivative records from 53986 primary records. [2025-10-24T00:50:44.137395] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-24T00:50:44.142083] [FATAL] [LOCAL ] INFY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:44.142410] [FATAL] [MAIN ] INFY: Failed to save derivative data. [2025-10-24T00:50:44.146833] [INFO ] [MAIN ] Derivative Progress: 1013/2164 symbols completed. INFY took 1.2s. Estimated remaining: 7m 45s. Rate: 148.7 symbols/min [2025-10-24T00:50:44.147563] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:44.155218] [INFO ] [MAIN ] ING: Generated 139 derivative records from 51066 primary records. [2025-10-24T00:50:44.155526] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-24T00:50:44.155822] [FATAL] [LOCAL ] ING: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:44.155917] [FATAL] [MAIN ] ING: Failed to save derivative data. [2025-10-24T00:50:44.159445] [INFO ] [MAIN ] Derivative Progress: 1014/2164 symbols completed. ING took 1.2s. Estimated remaining: 7m 44s. Rate: 148.8 symbols/min [2025-10-24T00:50:44.167160] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:44.180701] [DEBUG] [LOCAL ] INGM: Loaded 28324 existing records from primary storage. [2025-10-24T00:50:44.187781] [INFO ] [MAIN ] INGM: Loaded 28324 primary data records. [2025-10-24T00:50:44.315958] [DEBUG] [LOCAL ] INGR: Loaded 34005 existing records from primary storage. [2025-10-24T00:50:44.337585] [INFO ] [MAIN ] INGR: Loaded 34005 primary data records. [2025-10-24T00:50:44.559461] [DEBUG] [LOCAL ] INN: Loaded 41707 existing records from primary storage. [2025-10-24T00:50:44.603788] [INFO ] [MAIN ] INN: Loaded 41707 primary data records. [2025-10-24T00:50:45.190113] [DEBUG] [MAIN ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:45.229487] [DEBUG] [MAIN ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:45.271508] [DEBUG] [MAIN ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:45.306901] [INFO ] [MAIN ] INGM: Generated 139 derivative records from 28324 primary records. [2025-10-24T00:50:45.310687] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-24T00:50:45.312492] [FATAL] [LOCAL ] INGM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:45.313808] [FATAL] [MAIN ] INGM: Failed to save derivative data. [2025-10-24T00:50:45.316572] [INFO ] [MAIN ] Derivative Progress: 1015/2164 symbols completed. INGM took 1.2s. Estimated remaining: 7m 44s. Rate: 148.5 symbols/min [2025-10-24T00:50:45.321915] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:45.332578] [INFO ] [MAIN ] INGR: Generated 139 derivative records from 34005 primary records. [2025-10-24T00:50:45.332744] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-24T00:50:45.332961] [FATAL] [LOCAL ] INGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:45.334976] [FATAL] [MAIN ] INGR: Failed to save derivative data. [2025-10-24T00:50:45.335369] [INFO ] [MAIN ] INN: Generated 139 derivative records from 41707 primary records. [2025-10-24T00:50:45.338170] [INFO ] [MAIN ] Derivative Progress: 1016/2164 symbols completed. INGR took 1.2s. Estimated remaining: 7m 43s. Rate: 148.7 symbols/min [2025-10-24T00:50:45.338501] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-24T00:50:45.338687] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:45.339438] [FATAL] [LOCAL ] INN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:45.339537] [FATAL] [MAIN ] INN: Failed to save derivative data. [2025-10-24T00:50:45.343969] [INFO ] [MAIN ] Derivative Progress: 1017/2164 symbols completed. INN took 1.2s. Estimated remaining: 7m 42s. Rate: 148.8 symbols/min [2025-10-24T00:50:45.344128] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:45.373013] [DEBUG] [LOCAL ] INSP: Loaded 38813 existing records from primary storage. [2025-10-24T00:50:45.373195] [INFO ] [MAIN ] INSP: Loaded 38813 primary data records. [2025-10-24T00:50:45.582762] [DEBUG] [LOCAL ] INSW: Loaded 39476 existing records from primary storage. [2025-10-24T00:50:45.703338] [INFO ] [MAIN ] INSW: Loaded 39476 primary data records. [2025-10-24T00:50:45.762262] [DEBUG] [LOCAL ] INVH: Loaded 53583 existing records from primary storage. [2025-10-24T00:50:45.789954] [INFO ] [MAIN ] INVH: Loaded 53583 primary data records. [2025-10-24T00:50:46.355754] [DEBUG] [MAIN ] INSP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:46.394899] [DEBUG] [MAIN ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:46.428898] [DEBUG] [MAIN ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:46.468704] [INFO ] [MAIN ] INSP: Generated 139 derivative records from 38813 primary records. [2025-10-24T00:50:46.472425] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-24T00:50:46.475427] [FATAL] [LOCAL ] INSP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:46.478105] [FATAL] [MAIN ] INSP: Failed to save derivative data. [2025-10-24T00:50:46.481073] [INFO ] [MAIN ] Derivative Progress: 1018/2164 symbols completed. INSP took 1.2s. Estimated remaining: 7m 43s. Rate: 148.5 symbols/min [2025-10-24T00:50:46.491703] [INFO ] [MAIN ] INSW: Generated 139 derivative records from 39476 primary records. [2025-10-24T00:50:46.494181] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-24T00:50:46.494559] [FATAL] [LOCAL ] INSW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:46.495897] [FATAL] [MAIN ] INSW: Failed to save derivative data. [2025-10-24T00:50:46.498004] [INFO ] [MAIN ] INVH: Generated 139 derivative records from 53583 primary records. [2025-10-24T00:50:46.498138] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-24T00:50:46.501836] [INFO ] [MAIN ] Derivative Progress: 1019/2164 symbols completed. INSW took 1.2s. Estimated remaining: 7m 42s. Rate: 148.7 symbols/min [2025-10-24T00:50:46.502196] [FATAL] [LOCAL ] INVH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:46.502446] [FATAL] [MAIN ] INVH: Failed to save derivative data. [2025-10-24T00:50:46.505351] [INFO ] [MAIN ] Derivative Progress: 1020/2164 symbols completed. INVH took 1.2s. Estimated remaining: 7m 41s. Rate: 148.8 symbols/min [2025-10-24T00:50:46.505791] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:46.506178] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:46.506115] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:46.537975] [DEBUG] [LOCAL ] INVX: Loaded 29267 existing records from primary storage. [2025-10-24T00:50:46.538151] [INFO ] [MAIN ] INVX: Loaded 29267 primary data records. [2025-10-24T00:50:46.897928] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-24T00:50:46.898244] [INFO ] [MAIN ] IONQ: Loaded 54178 primary data records. [2025-10-24T00:50:46.899100] [DEBUG] [LOCAL ] IOT: Loaded 53849 existing records from primary storage. [2025-10-24T00:50:46.910674] [INFO ] [MAIN ] IOT: Loaded 53849 primary data records. [2025-10-24T00:50:47.557241] [DEBUG] [MAIN ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:47.619039] [DEBUG] [MAIN ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:47.615541] [DEBUG] [MAIN ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:47.665775] [INFO ] [MAIN ] INVX: Generated 139 derivative records from 29267 primary records. [2025-10-24T00:50:47.667892] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-24T00:50:47.668313] [FATAL] [LOCAL ] INVX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:47.668493] [FATAL] [MAIN ] INVX: Failed to save derivative data. [2025-10-24T00:50:47.673897] [INFO ] [MAIN ] Derivative Progress: 1021/2164 symbols completed. INVX took 1.2s. Estimated remaining: 7m 42s. Rate: 148.5 symbols/min [2025-10-24T00:50:47.677176] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:47.701323] [INFO ] [MAIN ] IONQ: Generated 139 derivative records from 54178 primary records. [2025-10-24T00:50:47.701111] [INFO ] [MAIN ] IOT: Generated 139 derivative records from 53849 primary records. [2025-10-24T00:50:47.701577] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-24T00:50:47.701899] [FATAL] [LOCAL ] IONQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:47.701689] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-24T00:50:47.702047] [FATAL] [MAIN ] IONQ: Failed to save derivative data. [2025-10-24T00:50:47.705586] [FATAL] [LOCAL ] IOT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:47.704968] [INFO ] [MAIN ] Derivative Progress: 1022/2164 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 41s. Rate: 148.7 symbols/min [2025-10-24T00:50:47.705966] [FATAL] [MAIN ] IOT: Failed to save derivative data. [2025-10-24T00:50:47.706176] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:47.711090] [INFO ] [MAIN ] Derivative Progress: 1023/2164 symbols completed. IOT took 1.2s. Estimated remaining: 7m 40s. Rate: 148.8 symbols/min [2025-10-24T00:50:47.711582] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:47.748473] [DEBUG] [LOCAL ] IPI: Loaded 21531 existing records from primary storage. [2025-10-24T00:50:47.764698] [INFO ] [MAIN ] IPI: Loaded 21531 primary data records. [2025-10-24T00:50:47.777709] [DEBUG] [LOCAL ] IP: Loaded 53690 existing records from primary storage. [2025-10-24T00:50:47.798170] [INFO ] [MAIN ] IP: Loaded 53690 primary data records. [2025-10-24T00:50:48.094777] [DEBUG] [LOCAL ] IPG: Loaded 53720 existing records from primary storage. [2025-10-24T00:50:48.209803] [INFO ] [MAIN ] IPG: Loaded 53720 primary data records. [2025-10-24T00:50:48.722766] [DEBUG] [MAIN ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:48.760109] [DEBUG] [MAIN ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:48.801754] [DEBUG] [MAIN ] IPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:48.859048] [INFO ] [MAIN ] IPI: Generated 139 derivative records from 21531 primary records. [2025-10-24T00:50:48.863131] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-24T00:50:48.863590] [FATAL] [LOCAL ] IPI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:48.863755] [FATAL] [MAIN ] IPI: Failed to save derivative data. [2025-10-24T00:50:48.867535] [INFO ] [MAIN ] Derivative Progress: 1024/2164 symbols completed. IPI took 1.2s. Estimated remaining: 7m 40s. Rate: 148.6 symbols/min [2025-10-24T00:50:48.871081] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:48.878867] [INFO ] [MAIN ] IP: Generated 139 derivative records from 53690 primary records. [2025-10-24T00:50:48.879032] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-24T00:50:48.881458] [FATAL] [LOCAL ] IP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:48.881684] [FATAL] [MAIN ] IP: Failed to save derivative data. [2025-10-24T00:50:48.881851] [INFO ] [MAIN ] IPG: Generated 139 derivative records from 53720 primary records. [2025-10-24T00:50:48.884712] [INFO ] [MAIN ] Derivative Progress: 1025/2164 symbols completed. IP took 1.2s. Estimated remaining: 7m 40s. Rate: 148.7 symbols/min [2025-10-24T00:50:48.884903] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-24T00:50:48.885326] [FATAL] [LOCAL ] IPG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:48.885473] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:48.885549] [FATAL] [MAIN ] IPG: Failed to save derivative data. [2025-10-24T00:50:48.889519] [INFO ] [MAIN ] Derivative Progress: 1026/2164 symbols completed. IPG took 1.2s. Estimated remaining: 7m 39s. Rate: 148.8 symbols/min [2025-10-24T00:50:48.890127] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:48.906566] [DEBUG] [LOCAL ] IQI: Loaded 17831 existing records from primary storage. [2025-10-24T00:50:48.906780] [INFO ] [MAIN ] IQI: Loaded 17831 primary data records. [2025-10-24T00:50:49.327347] [DEBUG] [LOCAL ] IQV: Loaded 50338 existing records from primary storage. [2025-10-24T00:50:49.328635] [INFO ] [MAIN ] IQV: Loaded 50338 primary data records. [2025-10-24T00:50:49.394301] [DEBUG] [LOCAL ] IR: Loaded 53119 existing records from primary storage. [2025-10-24T00:50:49.467630] [INFO ] [MAIN ] IR: Loaded 53119 primary data records. [2025-10-24T00:50:50.215499] [DEBUG] [MAIN ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:50.293212] [DEBUG] [MAIN ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:50.293851] [DEBUG] [MAIN ] IQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:50.319420] [INFO ] [MAIN ] IQI: Generated 139 derivative records from 17831 primary records. [2025-10-24T00:50:50.325627] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-24T00:50:50.327842] [FATAL] [LOCAL ] IQI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:50.329196] [FATAL] [MAIN ] IQI: Failed to save derivative data. [2025-10-24T00:50:50.334783] [INFO ] [MAIN ] Derivative Progress: 1027/2164 symbols completed. IQI took 1.5s. Estimated remaining: 7m 40s. Rate: 148.5 symbols/min [2025-10-24T00:50:50.335858] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:50.385628] [INFO ] [MAIN ] IR: Generated 139 derivative records from 53119 primary records. [2025-10-24T00:50:50.389637] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-24T00:50:50.389413] [INFO ] [MAIN ] IQV: Generated 139 derivative records from 50338 primary records. [2025-10-24T00:50:50.390107] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-24T00:50:50.390022] [FATAL] [LOCAL ] IR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:50.390553] [FATAL] [LOCAL ] IQV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:50.390793] [FATAL] [MAIN ] IQV: Failed to save derivative data. [2025-10-24T00:50:50.390664] [FATAL] [MAIN ] IR: Failed to save derivative data. [2025-10-24T00:50:50.393208] [INFO ] [MAIN ] Derivative Progress: 1028/2164 symbols completed. IQV took 1.5s. Estimated remaining: 7m 39s. Rate: 148.6 symbols/min [2025-10-24T00:50:50.396610] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:50.409398] [INFO ] [MAIN ] Derivative Progress: 1029/2164 symbols completed. IR took 1.5s. Estimated remaining: 7m 38s. Rate: 148.7 symbols/min [2025-10-24T00:50:50.411376] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:50.413884] [DEBUG] [LOCAL ] IRM: Loaded 49213 existing records from primary storage. [2025-10-24T00:50:50.414170] [INFO ] [MAIN ] IRM: Loaded 49213 primary data records. [2025-10-24T00:50:50.591480] [DEBUG] [LOCAL ] IRS: Loaded 23500 existing records from primary storage. [2025-10-24T00:50:50.624769] [INFO ] [MAIN ] IRS: Loaded 23500 primary data records. [2025-10-24T00:50:50.856819] [DEBUG] [LOCAL ] IRT: Loaded 50769 existing records from primary storage. [2025-10-24T00:50:50.857958] [INFO ] [MAIN ] IRT: Loaded 50769 primary data records. [2025-10-24T00:50:51.457484] [DEBUG] [MAIN ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:51.505374] [DEBUG] [MAIN ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:51.545100] [DEBUG] [MAIN ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:51.565696] [INFO ] [MAIN ] IRM: Generated 139 derivative records from 49213 primary records. [2025-10-24T00:50:51.567824] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-24T00:50:51.570844] [FATAL] [LOCAL ] IRM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:51.571060] [FATAL] [MAIN ] IRM: Failed to save derivative data. [2025-10-24T00:50:51.573202] [INFO ] [MAIN ] Derivative Progress: 1030/2164 symbols completed. IRM took 1.2s. Estimated remaining: 7m 38s. Rate: 148.4 symbols/min [2025-10-24T00:50:51.575934] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:51.597035] [INFO ] [MAIN ] IRS: Generated 139 derivative records from 23500 primary records. [2025-10-24T00:50:51.599637] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-24T00:50:51.606254] [FATAL] [LOCAL ] IRS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:51.606757] [FATAL] [MAIN ] IRS: Failed to save derivative data. [2025-10-24T00:50:51.606629] [DEBUG] [LOCAL ] ISD: Loaded 15726 existing records from primary storage. [2025-10-24T00:50:51.609542] [INFO ] [MAIN ] Derivative Progress: 1031/2164 symbols completed. IRS took 1.2s. Estimated remaining: 7m 38s. Rate: 148.6 symbols/min [2025-10-24T00:50:51.610095] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:51.609706] [INFO ] [MAIN ] ISD: Loaded 15726 primary data records. [2025-10-24T00:50:51.612726] [INFO ] [MAIN ] IRT: Generated 139 derivative records from 50769 primary records. [2025-10-24T00:50:51.633279] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-24T00:50:51.633599] [FATAL] [LOCAL ] IRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:51.649161] [FATAL] [MAIN ] IRT: Failed to save derivative data. [2025-10-24T00:50:51.684071] [INFO ] [MAIN ] Derivative Progress: 1032/2164 symbols completed. IRT took 1.3s. Estimated remaining: 7m 37s. Rate: 148.7 symbols/min [2025-10-24T00:50:51.684321] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:51.948225] [DEBUG] [LOCAL ] IT: Loaded 42542 existing records from primary storage. [2025-10-24T00:50:51.948820] [INFO ] [MAIN ] IT: Loaded 42542 primary data records. [2025-10-24T00:50:52.028032] [DEBUG] [LOCAL ] ITGR: Loaded 31335 existing records from primary storage. [2025-10-24T00:50:52.039956] [INFO ] [MAIN ] ITGR: Loaded 31335 primary data records. [2025-10-24T00:50:52.567322] [DEBUG] [MAIN ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:52.637468] [DEBUG] [MAIN ] IT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:50:52.663732] [DEBUG] [MAIN ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:52.683006] [INFO ] [MAIN ] ISD: Generated 139 derivative records from 15726 primary records. [2025-10-24T00:50:52.684524] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-24T00:50:52.684960] [FATAL] [LOCAL ] ISD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:52.686216] [FATAL] [MAIN ] ISD: Failed to save derivative data. [2025-10-24T00:50:52.692502] [INFO ] [MAIN ] Derivative Progress: 1033/2164 symbols completed. ISD took 1.1s. Estimated remaining: 7m 37s. Rate: 148.5 symbols/min [2025-10-24T00:50:52.721551] [INFO ] [MAIN ] ITGR: Generated 139 derivative records from 31335 primary records. [2025-10-24T00:50:52.721835] [INFO ] [MAIN ] IT: Generated 139 derivative records from 42542 primary records. [2025-10-24T00:50:52.721968] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-24T00:50:52.722200] [FATAL] [LOCAL ] ITGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:52.722296] [FATAL] [MAIN ] ITGR: Failed to save derivative data. [2025-10-24T00:50:52.725366] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-24T00:50:52.725304] [INFO ] [MAIN ] Derivative Progress: 1034/2164 symbols completed. ITGR took 1.0s. Estimated remaining: 7m 36s. Rate: 148.6 symbols/min [2025-10-24T00:50:52.725769] [FATAL] [LOCAL ] IT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:52.725845] [FATAL] [MAIN ] IT: Failed to save derivative data. [2025-10-24T00:50:52.728073] [INFO ] [MAIN ] Derivative Progress: 1035/2164 symbols completed. IT took 1.1s. Estimated remaining: 7m 35s. Rate: 148.8 symbols/min [2025-10-24T00:50:52.728482] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:52.728411] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:52.728932] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:52.799178] [DEBUG] [LOCAL ] ITT: Loaded 32539 existing records from primary storage. [2025-10-24T00:50:52.800221] [DEBUG] [LOCAL ] ITW: Loaded 45963 existing records from primary storage. [2025-10-24T00:50:52.800543] [INFO ] [MAIN ] ITW: Loaded 45963 primary data records. [2025-10-24T00:50:52.800755] [INFO ] [MAIN ] ITT: Loaded 32539 primary data records. [2025-10-24T00:50:52.977971] [DEBUG] [LOCAL ] ITUB: Loaded 53701 existing records from primary storage. [2025-10-24T00:50:53.006151] [INFO ] [MAIN ] ITUB: Loaded 53701 primary data records. [2025-10-24T00:50:53.785888] [DEBUG] [MAIN ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:53.815078] [DEBUG] [MAIN ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:53.851108] [DEBUG] [MAIN ] ITUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:53.910866] [INFO ] [MAIN ] ITW: Generated 139 derivative records from 45963 primary records. [2025-10-24T00:50:53.914138] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-24T00:50:53.916033] [FATAL] [LOCAL ] ITW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:53.917782] [FATAL] [MAIN ] ITW: Failed to save derivative data. [2025-10-24T00:50:53.922163] [INFO ] [MAIN ] Derivative Progress: 1036/2164 symbols completed. ITW took 1.2s. Estimated remaining: 7m 36s. Rate: 148.5 symbols/min [2025-10-24T00:50:53.925334] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:53.931777] [INFO ] [MAIN ] ITUB: Generated 139 derivative records from 53701 primary records. [2025-10-24T00:50:53.934366] [INFO ] [MAIN ] ITT: Generated 139 derivative records from 32539 primary records. [2025-10-24T00:50:53.934177] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-24T00:50:53.934796] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-24T00:50:53.935094] [FATAL] [LOCAL ] ITT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:53.934736] [FATAL] [LOCAL ] ITUB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:53.935300] [FATAL] [MAIN ] ITT: Failed to save derivative data. [2025-10-24T00:50:53.935439] [FATAL] [MAIN ] ITUB: Failed to save derivative data. [2025-10-24T00:50:53.938265] [INFO ] [MAIN ] Derivative Progress: 1037/2164 symbols completed. ITT took 1.2s. Estimated remaining: 7m 35s. Rate: 148.6 symbols/min [2025-10-24T00:50:53.938702] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:53.942756] [INFO ] [MAIN ] Derivative Progress: 1038/2164 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 34s. Rate: 148.8 symbols/min [2025-10-24T00:50:53.942975] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:53.989705] [DEBUG] [LOCAL ] IVR: Loaded 48202 existing records from primary storage. [2025-10-24T00:50:53.990095] [INFO ] [MAIN ] IVR: Loaded 48202 primary data records. [2025-10-24T00:50:54.117619] [DEBUG] [LOCAL ] IVT: Loaded 31625 existing records from primary storage. [2025-10-24T00:50:54.122694] [INFO ] [MAIN ] IVT: Loaded 31625 primary data records. [2025-10-24T00:50:54.156348] [DEBUG] [LOCAL ] IVZ: Loaded 53518 existing records from primary storage. [2025-10-24T00:50:54.183066] [INFO ] [MAIN ] IVZ: Loaded 53518 primary data records. [2025-10-24T00:50:55.010070] [DEBUG] [MAIN ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:55.053117] [DEBUG] [MAIN ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:55.080222] [DEBUG] [MAIN ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:55.143982] [INFO ] [MAIN ] IVR: Generated 139 derivative records from 48202 primary records. [2025-10-24T00:50:55.146069] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-24T00:50:55.146717] [FATAL] [LOCAL ] IVR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:55.155280] [FATAL] [MAIN ] IVR: Failed to save derivative data. [2025-10-24T00:50:55.158857] [INFO ] [MAIN ] Derivative Progress: 1039/2164 symbols completed. IVR took 1.2s. Estimated remaining: 7m 35s. Rate: 148.5 symbols/min [2025-10-24T00:50:55.160952] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:55.164360] [INFO ] [MAIN ] IVZ: Generated 139 derivative records from 53518 primary records. [2025-10-24T00:50:55.166696] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-24T00:50:55.166546] [INFO ] [MAIN ] IVT: Generated 139 derivative records from 31625 primary records. [2025-10-24T00:50:55.167465] [FATAL] [LOCAL ] IVZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:55.167581] [FATAL] [MAIN ] IVZ: Failed to save derivative data. [2025-10-24T00:50:55.170469] [INFO ] [MAIN ] Derivative Progress: 1040/2164 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 34s. Rate: 148.6 symbols/min [2025-10-24T00:50:55.170694] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-24T00:50:55.171080] [FATAL] [LOCAL ] IVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:55.171314] [FATAL] [MAIN ] IVT: Failed to save derivative data. [2025-10-24T00:50:55.171198] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:55.174398] [INFO ] [MAIN ] Derivative Progress: 1041/2164 symbols completed. IVT took 1.2s. Estimated remaining: 7m 33s. Rate: 148.7 symbols/min [2025-10-24T00:50:55.174817] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:55.200463] [DEBUG] [LOCAL ] IX: Loaded 22244 existing records from primary storage. [2025-10-24T00:50:55.200774] [INFO ] [MAIN ] IX: Loaded 22244 primary data records. [2025-10-24T00:50:55.426933] [DEBUG] [LOCAL ] JBGS: Loaded 41920 existing records from primary storage. [2025-10-24T00:50:55.427164] [INFO ] [MAIN ] JBGS: Loaded 41920 primary data records. [2025-10-24T00:50:55.440214] [DEBUG] [LOCAL ] J: Loaded 40852 existing records from primary storage. [2025-10-24T00:50:55.591939] [INFO ] [MAIN ] J: Loaded 40852 primary data records. [2025-10-24T00:50:56.258449] [DEBUG] [MAIN ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:56.298864] [DEBUG] [MAIN ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:56.343521] [DEBUG] [MAIN ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:56.374076] [INFO ] [MAIN ] IX: Generated 139 derivative records from 22244 primary records. [2025-10-24T00:50:56.376484] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-24T00:50:56.379268] [FATAL] [LOCAL ] IX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:56.382602] [FATAL] [MAIN ] IX: Failed to save derivative data. [2025-10-24T00:50:56.385267] [INFO ] [MAIN ] Derivative Progress: 1042/2164 symbols completed. IX took 1.2s. Estimated remaining: 7m 33s. Rate: 148.5 symbols/min [2025-10-24T00:50:56.388561] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:56.404384] [INFO ] [MAIN ] JBGS: Generated 139 derivative records from 41920 primary records. [2025-10-24T00:50:56.407740] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-24T00:50:56.408554] [FATAL] [LOCAL ] JBGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:56.412038] [FATAL] [MAIN ] JBGS: Failed to save derivative data. [2025-10-24T00:50:56.415458] [INFO ] [MAIN ] J: Generated 139 derivative records from 40852 primary records. [2025-10-24T00:50:56.418252] [INFO ] [MAIN ] Derivative Progress: 1043/2164 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 33s. Rate: 148.6 symbols/min [2025-10-24T00:50:56.418573] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-24T00:50:56.418720] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:56.419581] [FATAL] [LOCAL ] J: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:56.419693] [FATAL] [MAIN ] J: Failed to save derivative data. [2025-10-24T00:50:56.422680] [INFO ] [MAIN ] Derivative Progress: 1044/2164 symbols completed. J took 1.3s. Estimated remaining: 7m 32s. Rate: 148.7 symbols/min [2025-10-24T00:50:56.423039] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:56.454145] [DEBUG] [LOCAL ] JBI: Loaded 42829 existing records from primary storage. [2025-10-24T00:50:56.454511] [INFO ] [MAIN ] JBI: Loaded 42829 primary data records. [2025-10-24T00:50:56.604859] [DEBUG] [LOCAL ] JBND: Loaded 27627 existing records from primary storage. [2025-10-24T00:50:56.663981] [DEBUG] [LOCAL ] JBL: Loaded 48679 existing records from primary storage. [2025-10-24T00:50:56.683814] [INFO ] [MAIN ] JBND: Loaded 27627 primary data records. [2025-10-24T00:50:56.684021] [INFO ] [MAIN ] JBL: Loaded 48679 primary data records. [2025-10-24T00:50:57.551425] [DEBUG] [MAIN ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:57.595045] [DEBUG] [MAIN ] JBND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:57.626441] [DEBUG] [MAIN ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:57.670178] [INFO ] [MAIN ] JBI: Generated 139 derivative records from 42829 primary records. [2025-10-24T00:50:57.676200] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-24T00:50:57.676495] [FATAL] [LOCAL ] JBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:57.677122] [FATAL] [MAIN ] JBI: Failed to save derivative data. [2025-10-24T00:50:57.680619] [INFO ] [MAIN ] Derivative Progress: 1045/2164 symbols completed. JBI took 1.3s. Estimated remaining: 7m 32s. Rate: 148.4 symbols/min [2025-10-24T00:50:57.682905] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:57.699747] [INFO ] [MAIN ] JBND: Generated 139 derivative records from 27627 primary records. [2025-10-24T00:50:57.703960] [INFO ] [MAIN ] JBL: Generated 139 derivative records from 48679 primary records. [2025-10-24T00:50:57.704110] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-24T00:50:57.704446] [FATAL] [LOCAL ] JBND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:57.704193] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-24T00:50:57.704575] [FATAL] [MAIN ] JBND: Failed to save derivative data. [2025-10-24T00:50:57.707965] [INFO ] [MAIN ] Derivative Progress: 1046/2164 symbols completed. JBND took 1.3s. Estimated remaining: 7m 32s. Rate: 148.6 symbols/min [2025-10-24T00:50:57.704858] [FATAL] [LOCAL ] JBL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:57.708175] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:57.709003] [FATAL] [MAIN ] JBL: Failed to save derivative data. [2025-10-24T00:50:57.713050] [INFO ] [MAIN ] Derivative Progress: 1047/2164 symbols completed. JBL took 1.3s. Estimated remaining: 7m 31s. Rate: 148.7 symbols/min [2025-10-24T00:50:57.713523] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:57.730228] [DEBUG] [LOCAL ] JCE: Loaded 7275 existing records from primary storage. [2025-10-24T00:50:57.730506] [INFO ] [MAIN ] JCE: Loaded 7275 primary data records. [2025-10-24T00:50:57.852271] [DEBUG] [LOCAL ] JBTM: Loaded 33794 existing records from primary storage. [2025-10-24T00:50:57.858418] [INFO ] [MAIN ] JBTM: Loaded 33794 primary data records. [2025-10-24T00:50:58.283986] [DEBUG] [LOCAL ] JCI: Loaded 53905 existing records from primary storage. [2025-10-24T00:50:58.401436] [INFO ] [MAIN ] JCI: Loaded 53905 primary data records. [2025-10-24T00:50:58.727287] [DEBUG] [MAIN ] JCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:58.767086] [DEBUG] [MAIN ] JBTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:58.809053] [DEBUG] [MAIN ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:50:58.842868] [INFO ] [MAIN ] JCE: Generated 139 derivative records from 7275 primary records. [2025-10-24T00:50:58.846389] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-24T00:50:58.847169] [FATAL] [LOCAL ] JCE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:58.848821] [FATAL] [MAIN ] JCE: Failed to save derivative data. [2025-10-24T00:50:58.852507] [INFO ] [MAIN ] Derivative Progress: 1048/2164 symbols completed. JCE took 1.1s. Estimated remaining: 7m 31s. Rate: 148.4 symbols/min [2025-10-24T00:50:58.869631] [INFO ] [MAIN ] JBTM: Generated 139 derivative records from 33794 primary records. [2025-10-24T00:50:58.872586] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-10-24T00:50:58.873372] [FATAL] [LOCAL ] JBTM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:58.875141] [FATAL] [MAIN ] JBTM: Failed to save derivative data. [2025-10-24T00:50:58.877249] [INFO ] [MAIN ] JCI: Generated 139 derivative records from 53905 primary records. [2025-10-24T00:50:58.880080] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-24T00:50:58.879899] [INFO ] [MAIN ] Derivative Progress: 1049/2164 symbols completed. JBTM took 1.2s. Estimated remaining: 7m 30s. Rate: 148.6 symbols/min [2025-10-24T00:50:58.880512] [FATAL] [LOCAL ] JCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:50:58.880862] [FATAL] [MAIN ] JCI: Failed to save derivative data. [2025-10-24T00:50:58.883858] [INFO ] [MAIN ] Derivative Progress: 1050/2164 symbols completed. JCI took 1.2s. Estimated remaining: 7m 29s. Rate: 148.7 symbols/min [2025-10-24T00:50:58.884240] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:58.884776] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:58.884392] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:50:58.939515] [DEBUG] [LOCAL ] JFR: Loaded 31341 existing records from primary storage. [2025-10-24T00:50:58.939748] [INFO ] [MAIN ] JFR: Loaded 31341 primary data records. [2025-10-24T00:50:59.073181] [DEBUG] [LOCAL ] JEF: Loaded 50570 existing records from primary storage. [2025-10-24T00:50:59.072008] [DEBUG] [LOCAL ] JELD: Loaded 46140 existing records from primary storage. [2025-10-24T00:50:59.088886] [INFO ] [MAIN ] JELD: Loaded 46140 primary data records. [2025-10-24T00:50:59.089022] [INFO ] [MAIN ] JEF: Loaded 50570 primary data records. [2025-10-24T00:50:59.974193] [DEBUG] [MAIN ] JFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:00.025529] [DEBUG] [MAIN ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:00.032159] [DEBUG] [MAIN ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:00.085228] [INFO ] [MAIN ] JFR: Generated 139 derivative records from 31341 primary records. [2025-10-24T00:51:00.089785] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-24T00:51:00.090337] [FATAL] [LOCAL ] JFR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:00.090788] [FATAL] [MAIN ] JFR: Failed to save derivative data. [2025-10-24T00:51:00.093418] [INFO ] [MAIN ] Derivative Progress: 1051/2164 symbols completed. JFR took 1.2s. Estimated remaining: 7m 30s. Rate: 148.4 symbols/min [2025-10-24T00:51:00.094999] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:00.119794] [INFO ] [MAIN ] JEF: Generated 139 derivative records from 50570 primary records. [2025-10-24T00:51:00.120364] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-24T00:51:00.127341] [INFO ] [MAIN ] JELD: Generated 139 derivative records from 46140 primary records. [2025-10-24T00:51:00.127982] [FATAL] [LOCAL ] JEF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:00.128369] [FATAL] [MAIN ] JEF: Failed to save derivative data. [2025-10-24T00:51:00.127711] [DEBUG] [LOCAL ] JGH: Loaded 12607 existing records from primary storage. [2025-10-24T00:51:00.128295] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-24T00:51:00.131079] [INFO ] [MAIN ] Derivative Progress: 1052/2164 symbols completed. JEF took 1.2s. Estimated remaining: 7m 29s. Rate: 148.6 symbols/min [2025-10-24T00:51:00.131366] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:00.131716] [FATAL] [LOCAL ] JELD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:00.132083] [INFO ] [MAIN ] JGH: Loaded 12607 primary data records. [2025-10-24T00:51:00.132240] [FATAL] [MAIN ] JELD: Failed to save derivative data. [2025-10-24T00:51:00.135487] [INFO ] [MAIN ] Derivative Progress: 1053/2164 symbols completed. JELD took 1.3s. Estimated remaining: 7m 28s. Rate: 148.7 symbols/min [2025-10-24T00:51:00.135749] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:00.259459] [DEBUG] [LOCAL ] JHI: Loaded 4173 existing records from primary storage. [2025-10-24T00:51:00.290609] [INFO ] [MAIN ] JHI: Loaded 4173 primary data records. [2025-10-24T00:51:00.631566] [DEBUG] [LOCAL ] JHG: Loaded 47835 existing records from primary storage. [2025-10-24T00:51:00.674712] [INFO ] [MAIN ] JHG: Loaded 47835 primary data records. [2025-10-24T00:51:01.130784] [DEBUG] [MAIN ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:01.176590] [DEBUG] [MAIN ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:01.215476] [DEBUG] [MAIN ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:01.259916] [INFO ] [MAIN ] JGH: Generated 139 derivative records from 12607 primary records. [2025-10-24T00:51:01.262933] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-24T00:51:01.266747] [FATAL] [LOCAL ] JGH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:01.266973] [FATAL] [MAIN ] JGH: Failed to save derivative data. [2025-10-24T00:51:01.269855] [INFO ] [MAIN ] Derivative Progress: 1054/2164 symbols completed. JGH took 1.2s. Estimated remaining: 7m 29s. Rate: 148.5 symbols/min [2025-10-24T00:51:01.270334] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:01.282774] [DEBUG] [LOCAL ] JHS: Loaded 3034 existing records from primary storage. [2025-10-24T00:51:01.287102] [INFO ] [MAIN ] JHS: Loaded 3034 primary data records. [2025-10-24T00:51:01.294056] [INFO ] [MAIN ] JHI: Generated 139 derivative records from 4173 primary records. [2025-10-24T00:51:01.328233] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-24T00:51:01.356382] [INFO ] [MAIN ] JHG: Generated 139 derivative records from 47835 primary records. [2025-10-24T00:51:01.396515] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-24T00:51:01.379196] [FATAL] [LOCAL ] JHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:01.407518] [FATAL] [MAIN ] JHI: Failed to save derivative data. [2025-10-24T00:51:01.418285] [FATAL] [LOCAL ] JHG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:01.442496] [INFO ] [MAIN ] Derivative Progress: 1055/2164 symbols completed. JHI took 1.3s. Estimated remaining: 7m 28s. Rate: 148.5 symbols/min [2025-10-24T00:51:01.442690] [FATAL] [MAIN ] JHG: Failed to save derivative data. [2025-10-24T00:51:01.482982] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:01.483189] [INFO ] [MAIN ] Derivative Progress: 1056/2164 symbols completed. JHG took 1.3s. Estimated remaining: 7m 27s. Rate: 148.7 symbols/min [2025-10-24T00:51:01.484015] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:01.634470] [DEBUG] [LOCAL ] JILL: Loaded 15317 existing records from primary storage. [2025-10-24T00:51:01.634716] [INFO ] [MAIN ] JILL: Loaded 15317 primary data records. [2025-10-24T00:51:01.875081] [DEBUG] [LOCAL ] JHX: Loaded 53589 existing records from primary storage. [2025-10-24T00:51:01.882408] [INFO ] [MAIN ] JHX: Loaded 53589 primary data records. [2025-10-24T00:51:02.177372] [DEBUG] [MAIN ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:02.442243] [DEBUG] [MAIN ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:02.473532] [INFO ] [MAIN ] JHS: Generated 139 derivative records from 3034 primary records. [2025-10-24T00:51:02.476185] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-24T00:51:02.477416] [FATAL] [LOCAL ] JHS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:02.477549] [FATAL] [MAIN ] JHS: Failed to save derivative data. [2025-10-24T00:51:02.480119] [INFO ] [MAIN ] Derivative Progress: 1057/2164 symbols completed. JHS took 1.2s. Estimated remaining: 7m 27s. Rate: 148.5 symbols/min [2025-10-24T00:51:02.480502] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:02.503313] [DEBUG] [MAIN ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:02.529978] [INFO ] [MAIN ] JILL: Generated 139 derivative records from 15317 primary records. [2025-10-24T00:51:02.539483] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-24T00:51:02.541151] [FATAL] [LOCAL ] JILL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:02.543582] [FATAL] [MAIN ] JILL: Failed to save derivative data. [2025-10-24T00:51:02.546340] [INFO ] [MAIN ] Derivative Progress: 1058/2164 symbols completed. JILL took 1.1s. Estimated remaining: 7m 27s. Rate: 148.6 symbols/min [2025-10-24T00:51:02.546535] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:02.566161] [DEBUG] [LOCAL ] JKS: Loaded 39480 existing records from primary storage. [2025-10-24T00:51:02.569835] [INFO ] [MAIN ] JKS: Loaded 39480 primary data records. [2025-10-24T00:51:02.695731] [DEBUG] [LOCAL ] JLL: Loaded 31765 existing records from primary storage. [2025-10-24T00:51:02.694890] [INFO ] [MAIN ] JHX: Generated 139 derivative records from 53589 primary records. [2025-10-24T00:51:02.696105] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-24T00:51:02.696366] [FATAL] [LOCAL ] JHX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:02.695990] [INFO ] [MAIN ] JLL: Loaded 31765 primary data records. [2025-10-24T00:51:02.696481] [FATAL] [MAIN ] JHX: Failed to save derivative data. [2025-10-24T00:51:02.764417] [INFO ] [MAIN ] Derivative Progress: 1059/2164 symbols completed. JHX took 1.3s. Estimated remaining: 7m 26s. Rate: 148.6 symbols/min [2025-10-24T00:51:02.843395] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:03.208626] [DEBUG] [LOCAL ] JLS: Loaded 4024 existing records from primary storage. [2025-10-24T00:51:03.210396] [INFO ] [MAIN ] JLS: Loaded 4024 primary data records. [2025-10-24T00:51:03.542074] [DEBUG] [MAIN ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:03.573346] [DEBUG] [MAIN ] JLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:03.623269] [DEBUG] [MAIN ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:03.657293] [INFO ] [MAIN ] JKS: Generated 139 derivative records from 39480 primary records. [2025-10-24T00:51:03.664294] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-24T00:51:03.666173] [FATAL] [LOCAL ] JKS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:03.668189] [FATAL] [MAIN ] JKS: Failed to save derivative data. [2025-10-24T00:51:03.670166] [INFO ] [MAIN ] Derivative Progress: 1060/2164 symbols completed. JKS took 1.2s. Estimated remaining: 7m 26s. Rate: 148.5 symbols/min [2025-10-24T00:51:03.672894] [INFO ] [MAIN ] JLL: Generated 139 derivative records from 31765 primary records. [2025-10-24T00:51:03.673107] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-24T00:51:03.673283] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:03.676393] [FATAL] [LOCAL ] JLL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:03.676951] [FATAL] [MAIN ] JLL: Failed to save derivative data. [2025-10-24T00:51:03.679828] [INFO ] [MAIN ] Derivative Progress: 1061/2164 symbols completed. JLL took 1.1s. Estimated remaining: 7m 25s. Rate: 148.6 symbols/min [2025-10-24T00:51:03.680123] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:03.691291] [INFO ] [MAIN ] JLS: Generated 139 derivative records from 4024 primary records. [2025-10-24T00:51:03.691551] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-24T00:51:03.691794] [FATAL] [LOCAL ] JLS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:03.691904] [FATAL] [MAIN ] JLS: Failed to save derivative data. [2025-10-24T00:51:03.694964] [INFO ] [MAIN ] Derivative Progress: 1062/2164 symbols completed. JLS took 0.9s. Estimated remaining: 7m 25s. Rate: 148.7 symbols/min [2025-10-24T00:51:03.695189] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:03.780971] [DEBUG] [LOCAL ] JMIA: Loaded 51570 existing records from primary storage. [2025-10-24T00:51:03.781155] [INFO ] [MAIN ] JMIA: Loaded 51570 primary data records. [2025-10-24T00:51:03.781821] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-24T00:51:03.782093] [INFO ] [MAIN ] JNJ: Loaded 54143 primary data records. [2025-10-24T00:51:03.998768] [DEBUG] [LOCAL ] JOBY: Loaded 54199 existing records from primary storage. [2025-10-24T00:51:04.065303] [INFO ] [MAIN ] JOBY: Loaded 54199 primary data records. [2025-10-24T00:51:04.740442] [DEBUG] [MAIN ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:04.768420] [DEBUG] [MAIN ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:04.804074] [DEBUG] [MAIN ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:04.859929] [INFO ] [MAIN ] JMIA: Generated 139 derivative records from 51570 primary records. [2025-10-24T00:51:04.863603] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-24T00:51:04.862184] [INFO ] [MAIN ] JNJ: Generated 139 derivative records from 54143 primary records. [2025-10-24T00:51:04.864365] [FATAL] [LOCAL ] JMIA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:04.867096] [FATAL] [MAIN ] JMIA: Failed to save derivative data. [2025-10-24T00:51:04.866999] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-24T00:51:04.870955] [INFO ] [MAIN ] Derivative Progress: 1063/2164 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 25s. Rate: 148.5 symbols/min [2025-10-24T00:51:04.871601] [FATAL] [LOCAL ] JNJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:04.872078] [FATAL] [MAIN ] JNJ: Failed to save derivative data. [2025-10-24T00:51:04.874805] [INFO ] [MAIN ] Derivative Progress: 1064/2164 symbols completed. JNJ took 1.2s. Estimated remaining: 7m 24s. Rate: 148.6 symbols/min [2025-10-24T00:51:04.878099] [INFO ] [MAIN ] JOBY: Generated 139 derivative records from 54199 primary records. [2025-10-24T00:51:04.878201] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-24T00:51:04.878403] [FATAL] [LOCAL ] JOBY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:04.878480] [FATAL] [MAIN ] JOBY: Failed to save derivative data. [2025-10-24T00:51:04.881451] [INFO ] [MAIN ] Derivative Progress: 1065/2164 symbols completed. JOBY took 1.2s. Estimated remaining: 7m 23s. Rate: 148.7 symbols/min [2025-10-24T00:51:04.881911] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:04.881837] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:04.882007] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:04.894617] [DEBUG] [LOCAL ] JOF: Loaded 6978 existing records from primary storage. [2025-10-24T00:51:04.894951] [INFO ] [MAIN ] JOF: Loaded 6978 primary data records. [2025-10-24T00:51:05.036619] [DEBUG] [LOCAL ] JOE: Loaded 23818 existing records from primary storage. [2025-10-24T00:51:05.083937] [INFO ] [MAIN ] JOE: Loaded 23818 primary data records. [2025-10-24T00:51:05.375308] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-24T00:51:05.376254] [INFO ] [MAIN ] JPM: Loaded 54184 primary data records. [2025-10-24T00:51:05.948483] [DEBUG] [MAIN ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:05.993685] [DEBUG] [MAIN ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:06.028390] [DEBUG] [MAIN ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:06.055984] [INFO ] [MAIN ] JOF: Generated 139 derivative records from 6978 primary records. [2025-10-24T00:51:06.056578] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-24T00:51:06.060897] [FATAL] [LOCAL ] JOF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:06.062480] [FATAL] [MAIN ] JOF: Failed to save derivative data. [2025-10-24T00:51:06.065696] [INFO ] [MAIN ] Derivative Progress: 1066/2164 symbols completed. JOF took 1.2s. Estimated remaining: 7m 24s. Rate: 148.5 symbols/min [2025-10-24T00:51:06.065854] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:06.088793] [INFO ] [MAIN ] JOE: Generated 139 derivative records from 23818 primary records. [2025-10-24T00:51:06.098435] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-24T00:51:06.098878] [FATAL] [LOCAL ] JOE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:06.100713] [INFO ] [MAIN ] JPM: Generated 139 derivative records from 54184 primary records. [2025-10-24T00:51:06.100815] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-24T00:51:06.100902] [FATAL] [MAIN ] JOE: Failed to save derivative data. [2025-10-24T00:51:06.101105] [FATAL] [LOCAL ] JPM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:06.103632] [INFO ] [MAIN ] Derivative Progress: 1067/2164 symbols completed. JOE took 1.2s. Estimated remaining: 7m 23s. Rate: 148.6 symbols/min [2025-10-24T00:51:06.103840] [FATAL] [MAIN ] JPM: Failed to save derivative data. [2025-10-24T00:51:06.104112] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:06.108633] [INFO ] [MAIN ] Derivative Progress: 1068/2164 symbols completed. JPM took 1.2s. Estimated remaining: 7m 22s. Rate: 148.7 symbols/min [2025-10-24T00:51:06.109095] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:06.120747] [DEBUG] [LOCAL ] JQC: Loaded 34130 existing records from primary storage. [2025-10-24T00:51:06.121002] [INFO ] [MAIN ] JQC: Loaded 34130 primary data records. [2025-10-24T00:51:06.240286] [DEBUG] [LOCAL ] JRI: Loaded 15370 existing records from primary storage. [2025-10-24T00:51:06.248249] [INFO ] [MAIN ] JRI: Loaded 15370 primary data records. [2025-10-24T00:51:06.248601] [DEBUG] [LOCAL ] JRS: Loaded 11582 existing records from primary storage. [2025-10-24T00:51:06.271219] [INFO ] [MAIN ] JRS: Loaded 11582 primary data records. [2025-10-24T00:51:07.076351] [DEBUG] [MAIN ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:07.108868] [DEBUG] [MAIN ] JRS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:51:07.139065] [DEBUG] [MAIN ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:07.190116] [INFO ] [MAIN ] JQC: Generated 139 derivative records from 34130 primary records. [2025-10-24T00:51:07.195032] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-24T00:51:07.195497] [FATAL] [LOCAL ] JQC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:07.196576] [FATAL] [MAIN ] JQC: Failed to save derivative data. [2025-10-24T00:51:07.198973] [INFO ] [MAIN ] Derivative Progress: 1069/2164 symbols completed. JQC took 1.1s. Estimated remaining: 7m 22s. Rate: 148.5 symbols/min [2025-10-24T00:51:07.200687] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:07.206292] [INFO ] [MAIN ] JRS: Generated 139 derivative records from 11582 primary records. [2025-10-24T00:51:07.207496] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-24T00:51:07.207754] [FATAL] [LOCAL ] JRS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:07.207848] [FATAL] [MAIN ] JRS: Failed to save derivative data. [2025-10-24T00:51:07.210696] [INFO ] [MAIN ] Derivative Progress: 1070/2164 symbols completed. JRS took 1.1s. Estimated remaining: 7m 22s. Rate: 148.6 symbols/min [2025-10-24T00:51:07.210830] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:07.213270] [INFO ] [MAIN ] JRI: Generated 139 derivative records from 15370 primary records. [2025-10-24T00:51:07.213431] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-24T00:51:07.213671] [FATAL] [LOCAL ] JRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:07.213763] [FATAL] [MAIN ] JRI: Failed to save derivative data. [2025-10-24T00:51:07.216127] [INFO ] [MAIN ] Derivative Progress: 1071/2164 symbols completed. JRI took 1.1s. Estimated remaining: 7m 21s. Rate: 148.8 symbols/min [2025-10-24T00:51:07.216372] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:07.244936] [DEBUG] [LOCAL ] KAI: Loaded 13504 existing records from primary storage. [2025-10-24T00:51:07.245083] [INFO ] [MAIN ] KAI: Loaded 13504 primary data records. [2025-10-24T00:51:07.375835] [DEBUG] [LOCAL ] JXN: Loaded 44543 existing records from primary storage. [2025-10-24T00:51:07.392711] [INFO ] [MAIN ] JXN: Loaded 44543 primary data records. [2025-10-24T00:51:07.637330] [DEBUG] [LOCAL ] K: Loaded 50741 existing records from primary storage. [2025-10-24T00:51:07.668368] [INFO ] [MAIN ] K: Loaded 50741 primary data records. [2025-10-24T00:51:08.291904] [DEBUG] [MAIN ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:08.319308] [DEBUG] [MAIN ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:08.370156] [DEBUG] [MAIN ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:08.400667] [INFO ] [MAIN ] KAI: Generated 139 derivative records from 13504 primary records. [2025-10-24T00:51:08.400932] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-24T00:51:08.405792] [FATAL] [LOCAL ] KAI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:08.406565] [FATAL] [MAIN ] KAI: Failed to save derivative data. [2025-10-24T00:51:08.409421] [INFO ] [MAIN ] Derivative Progress: 1072/2164 symbols completed. KAI took 1.2s. Estimated remaining: 7m 21s. Rate: 148.5 symbols/min [2025-10-24T00:51:08.412269] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:08.421089] [INFO ] [MAIN ] JXN: Generated 139 derivative records from 44543 primary records. [2025-10-24T00:51:08.423874] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-24T00:51:08.425058] [FATAL] [LOCAL ] JXN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:08.428617] [FATAL] [MAIN ] JXN: Failed to save derivative data. [2025-10-24T00:51:08.430741] [INFO ] [MAIN ] Derivative Progress: 1073/2164 symbols completed. JXN took 1.2s. Estimated remaining: 7m 20s. Rate: 148.6 symbols/min [2025-10-24T00:51:08.430938] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:08.444803] [INFO ] [MAIN ] K: Generated 139 derivative records from 50741 primary records. [2025-10-24T00:51:08.445111] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-24T00:51:08.445579] [FATAL] [LOCAL ] K: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:08.445688] [FATAL] [MAIN ] K: Failed to save derivative data. [2025-10-24T00:51:08.448864] [INFO ] [MAIN ] Derivative Progress: 1074/2164 symbols completed. K took 1.2s. Estimated remaining: 7m 20s. Rate: 148.8 symbols/min [2025-10-24T00:51:08.449161] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:08.469384] [DEBUG] [LOCAL ] KAR: Loaded 40036 existing records from primary storage. [2025-10-24T00:51:08.469662] [INFO ] [MAIN ] KAR: Loaded 40036 primary data records. [2025-10-24T00:51:08.545813] [DEBUG] [LOCAL ] KB: Loaded 23127 existing records from primary storage. [2025-10-24T00:51:08.570120] [INFO ] [MAIN ] KB: Loaded 23127 primary data records. [2025-10-24T00:51:08.581352] [DEBUG] [LOCAL ] KBDC: Loaded 22805 existing records from primary storage. [2025-10-24T00:51:08.622739] [INFO ] [MAIN ] KBDC: Loaded 22805 primary data records. [2025-10-24T00:51:09.451056] [DEBUG] [MAIN ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:09.451556] [DEBUG] [MAIN ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:09.511686] [DEBUG] [MAIN ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:09.568891] [INFO ] [MAIN ] KB: Generated 139 derivative records from 23127 primary records. [2025-10-24T00:51:09.573461] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-24T00:51:09.573759] [FATAL] [LOCAL ] KB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:09.573878] [FATAL] [MAIN ] KB: Failed to save derivative data. [2025-10-24T00:51:09.579946] [INFO ] [MAIN ] Derivative Progress: 1075/2164 symbols completed. KB took 1.1s. Estimated remaining: 7m 20s. Rate: 148.5 symbols/min [2025-10-24T00:51:09.580173] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:09.580373] [INFO ] [MAIN ] KAR: Generated 139 derivative records from 40036 primary records. [2025-10-24T00:51:09.581379] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-24T00:51:09.581715] [FATAL] [LOCAL ] KAR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:09.584730] [FATAL] [MAIN ] KAR: Failed to save derivative data. [2025-10-24T00:51:09.586948] [INFO ] [MAIN ] Derivative Progress: 1076/2164 symbols completed. KAR took 1.2s. Estimated remaining: 7m 19s. Rate: 148.6 symbols/min [2025-10-24T00:51:09.588174] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:09.594684] [INFO ] [MAIN ] KBDC: Generated 139 derivative records from 22805 primary records. [2025-10-24T00:51:09.594896] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-24T00:51:09.595180] [FATAL] [LOCAL ] KBDC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:09.595315] [FATAL] [MAIN ] KBDC: Failed to save derivative data. [2025-10-24T00:51:09.598412] [INFO ] [MAIN ] Derivative Progress: 1077/2164 symbols completed. KBDC took 1.1s. Estimated remaining: 7m 18s. Rate: 148.8 symbols/min [2025-10-24T00:51:09.598673] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:09.657176] [DEBUG] [LOCAL ] KBH: Loaded 49027 existing records from primary storage. [2025-10-24T00:51:09.657396] [INFO ] [MAIN ] KBH: Loaded 49027 primary data records. [2025-10-24T00:51:09.786764] [DEBUG] [LOCAL ] KBR: Loaded 48343 existing records from primary storage. [2025-10-24T00:51:09.788236] [DEBUG] [LOCAL ] KD: Loaded 52704 existing records from primary storage. [2025-10-24T00:51:09.804523] [INFO ] [MAIN ] KBR: Loaded 48343 primary data records. [2025-10-24T00:51:09.804440] [INFO ] [MAIN ] KD: Loaded 52704 primary data records. [2025-10-24T00:51:10.658324] [DEBUG] [MAIN ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:10.700107] [DEBUG] [MAIN ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:10.736334] [DEBUG] [MAIN ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:10.802462] [INFO ] [MAIN ] KBH: Generated 139 derivative records from 49027 primary records. [2025-10-24T00:51:10.805049] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-24T00:51:10.806068] [FATAL] [LOCAL ] KBH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:10.807722] [FATAL] [MAIN ] KBH: Failed to save derivative data. [2025-10-24T00:51:10.809629] [INFO ] [MAIN ] Derivative Progress: 1078/2164 symbols completed. KBH took 1.2s. Estimated remaining: 7m 19s. Rate: 148.5 symbols/min [2025-10-24T00:51:10.811442] [INFO ] [MAIN ] KBR: Generated 139 derivative records from 48343 primary records. [2025-10-24T00:51:10.811599] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-24T00:51:10.812161] [FATAL] [LOCAL ] KBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:10.812534] [FATAL] [MAIN ] KBR: Failed to save derivative data. [2025-10-24T00:51:10.816775] [INFO ] [MAIN ] Derivative Progress: 1079/2164 symbols completed. KBR took 1.2s. Estimated remaining: 7m 18s. Rate: 148.6 symbols/min [2025-10-24T00:51:10.814299] [INFO ] [MAIN ] KD: Generated 139 derivative records from 52704 primary records. [2025-10-24T00:51:10.817241] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-24T00:51:10.817972] [FATAL] [LOCAL ] KD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:10.818064] [FATAL] [MAIN ] KD: Failed to save derivative data. [2025-10-24T00:51:10.822991] [INFO ] [MAIN ] Derivative Progress: 1080/2164 symbols completed. KD took 1.2s. Estimated remaining: 7m 17s. Rate: 148.8 symbols/min [2025-10-24T00:51:10.823551] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:10.823949] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:10.824061] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:10.834492] [DEBUG] [LOCAL ] KEN: Loaded 4616 existing records from primary storage. [2025-10-24T00:51:10.835084] [INFO ] [MAIN ] KEN: Loaded 4616 primary data records. [2025-10-24T00:51:11.001086] [DEBUG] [LOCAL ] KEP: Loaded 32795 existing records from primary storage. [2025-10-24T00:51:11.012203] [INFO ] [MAIN ] KEP: Loaded 32795 primary data records. [2025-10-24T00:51:11.279309] [DEBUG] [LOCAL ] KEX: Loaded 39000 existing records from primary storage. [2025-10-24T00:51:11.313011] [INFO ] [MAIN ] KEX: Loaded 39000 primary data records. [2025-10-24T00:51:12.010220] [DEBUG] [MAIN ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:12.064092] [DEBUG] [MAIN ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:12.119257] [DEBUG] [MAIN ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:12.142153] [INFO ] [MAIN ] KEN: Generated 139 derivative records from 4616 primary records. [2025-10-24T00:51:12.144962] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-24T00:51:12.145773] [FATAL] [LOCAL ] KEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:12.149226] [FATAL] [MAIN ] KEN: Failed to save derivative data. [2025-10-24T00:51:12.153109] [INFO ] [MAIN ] Derivative Progress: 1081/2164 symbols completed. KEN took 1.3s. Estimated remaining: 7m 18s. Rate: 148.5 symbols/min [2025-10-24T00:51:12.159234] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:12.180509] [INFO ] [MAIN ] KEP: Generated 139 derivative records from 32795 primary records. [2025-10-24T00:51:12.182693] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-24T00:51:12.183288] [FATAL] [LOCAL ] KEP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:12.183974] [FATAL] [MAIN ] KEP: Failed to save derivative data. [2025-10-24T00:51:12.190547] [INFO ] [MAIN ] Derivative Progress: 1082/2164 symbols completed. KEP took 1.4s. Estimated remaining: 7m 17s. Rate: 148.6 symbols/min [2025-10-24T00:51:12.191167] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:12.207376] [INFO ] [MAIN ] KEX: Generated 139 derivative records from 39000 primary records. [2025-10-24T00:51:12.207779] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-24T00:51:12.208050] [FATAL] [LOCAL ] KEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:12.208982] [FATAL] [MAIN ] KEX: Failed to save derivative data. [2025-10-24T00:51:12.212661] [INFO ] [MAIN ] Derivative Progress: 1083/2164 symbols completed. KEX took 1.4s. Estimated remaining: 7m 16s. Rate: 148.7 symbols/min [2025-10-24T00:51:12.213138] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:12.216252] [DEBUG] [LOCAL ] KF: Loaded 2362 existing records from primary storage. [2025-10-24T00:51:12.216618] [INFO ] [MAIN ] KF: Loaded 2362 primary data records. [2025-10-24T00:51:12.285832] [DEBUG] [LOCAL ] KEYS: Loaded 43425 existing records from primary storage. [2025-10-24T00:51:12.308198] [INFO ] [MAIN ] KEYS: Loaded 43425 primary data records. [2025-10-24T00:51:12.466436] [DEBUG] [LOCAL ] KFRC: Loaded 21004 existing records from primary storage. [2025-10-24T00:51:12.514746] [INFO ] [MAIN ] KFRC: Loaded 21004 primary data records. [2025-10-24T00:51:13.193292] [DEBUG] [MAIN ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:13.226216] [DEBUG] [MAIN ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:13.269176] [DEBUG] [MAIN ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:13.299677] [INFO ] [MAIN ] KF: Generated 139 derivative records from 2362 primary records. [2025-10-24T00:51:13.302776] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-24T00:51:13.307507] [FATAL] [LOCAL ] KF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:13.308320] [FATAL] [MAIN ] KF: Failed to save derivative data. [2025-10-24T00:51:13.311231] [INFO ] [MAIN ] Derivative Progress: 1084/2164 symbols completed. KF took 1.1s. Estimated remaining: 7m 16s. Rate: 148.5 symbols/min [2025-10-24T00:51:13.316244] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:13.324258] [INFO ] [MAIN ] KEYS: Generated 139 derivative records from 43425 primary records. [2025-10-24T00:51:13.324850] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-24T00:51:13.326947] [FATAL] [LOCAL ] KEYS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:13.329843] [FATAL] [MAIN ] KEYS: Failed to save derivative data. [2025-10-24T00:51:13.333405] [INFO ] [MAIN ] Derivative Progress: 1085/2164 symbols completed. KEYS took 1.2s. Estimated remaining: 7m 16s. Rate: 148.6 symbols/min [2025-10-24T00:51:13.337705] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:13.345454] [DEBUG] [LOCAL ] KFS: Loaded 8762 existing records from primary storage. [2025-10-24T00:51:13.347026] [INFO ] [MAIN ] KFS: Loaded 8762 primary data records. [2025-10-24T00:51:13.370267] [INFO ] [MAIN ] KFRC: Generated 139 derivative records from 21004 primary records. [2025-10-24T00:51:13.386360] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-24T00:51:13.406634] [FATAL] [LOCAL ] KFRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:13.406833] [FATAL] [MAIN ] KFRC: Failed to save derivative data. [2025-10-24T00:51:13.419048] [INFO ] [MAIN ] Derivative Progress: 1086/2164 symbols completed. KFRC took 1.2s. Estimated remaining: 7m 15s. Rate: 148.7 symbols/min [2025-10-24T00:51:13.441677] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:13.669226] [DEBUG] [LOCAL ] KFY: Loaded 29699 existing records from primary storage. [2025-10-24T00:51:13.669836] [INFO ] [MAIN ] KFY: Loaded 29699 primary data records. [2025-10-24T00:51:14.054685] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-24T00:51:14.055458] [INFO ] [MAIN ] KGC: Loaded 54089 primary data records. [2025-10-24T00:51:14.179741] [DEBUG] [MAIN ] KFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:14.428044] [DEBUG] [MAIN ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:14.452998] [INFO ] [MAIN ] KFS: Generated 139 derivative records from 8762 primary records. [2025-10-24T00:51:14.453361] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-24T00:51:14.458705] [FATAL] [LOCAL ] KFS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:14.458889] [FATAL] [MAIN ] KFS: Failed to save derivative data. [2025-10-24T00:51:14.470088] [INFO ] [MAIN ] Derivative Progress: 1087/2164 symbols completed. KFS took 1.2s. Estimated remaining: 7m 15s. Rate: 148.5 symbols/min [2025-10-24T00:51:14.475076] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:14.476006] [DEBUG] [MAIN ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:14.522623] [INFO ] [MAIN ] KFY: Generated 139 derivative records from 29699 primary records. [2025-10-24T00:51:14.523059] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-24T00:51:14.535971] [FATAL] [LOCAL ] KFY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:14.536589] [FATAL] [MAIN ] KFY: Failed to save derivative data. [2025-10-24T00:51:14.540541] [INFO ] [MAIN ] Derivative Progress: 1088/2164 symbols completed. KFY took 1.2s. Estimated remaining: 7m 14s. Rate: 148.6 symbols/min [2025-10-24T00:51:14.540986] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:14.543230] [INFO ] [MAIN ] KGC: Generated 139 derivative records from 54089 primary records. [2025-10-24T00:51:14.543719] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-24T00:51:14.544037] [FATAL] [LOCAL ] KGC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:14.544143] [FATAL] [MAIN ] KGC: Failed to save derivative data. [2025-10-24T00:51:14.547103] [INFO ] [MAIN ] Derivative Progress: 1089/2164 symbols completed. KGC took 1.1s. Estimated remaining: 7m 14s. Rate: 148.7 symbols/min [2025-10-24T00:51:14.547990] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:14.562596] [DEBUG] [LOCAL ] KGS: Loaded 46358 existing records from primary storage. [2025-10-24T00:51:14.562800] [INFO ] [MAIN ] KGS: Loaded 46358 primary data records. [2025-10-24T00:51:14.773713] [DEBUG] [LOCAL ] KIO: Loaded 21847 existing records from primary storage. [2025-10-24T00:51:14.812774] [INFO ] [MAIN ] KIO: Loaded 21847 primary data records. [2025-10-24T00:51:15.026809] [DEBUG] [LOCAL ] KIM: Loaded 53384 existing records from primary storage. [2025-10-24T00:51:15.031147] [INFO ] [MAIN ] KIM: Loaded 53384 primary data records. [2025-10-24T00:51:15.557974] [DEBUG] [MAIN ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:15.609376] [DEBUG] [MAIN ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:15.621989] [DEBUG] [MAIN ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:15.663264] [INFO ] [MAIN ] KGS: Generated 139 derivative records from 46358 primary records. [2025-10-24T00:51:15.666568] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-24T00:51:15.669776] [FATAL] [LOCAL ] KGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:15.669895] [FATAL] [MAIN ] KGS: Failed to save derivative data. [2025-10-24T00:51:15.674306] [INFO ] [MAIN ] Derivative Progress: 1090/2164 symbols completed. KGS took 1.2s. Estimated remaining: 7m 14s. Rate: 148.5 symbols/min [2025-10-24T00:51:15.675175] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:15.699475] [INFO ] [MAIN ] KIM: Generated 139 derivative records from 53384 primary records. [2025-10-24T00:51:15.697552] [INFO ] [MAIN ] KIO: Generated 139 derivative records from 21847 primary records. [2025-10-24T00:51:15.699840] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-24T00:51:15.700030] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-24T00:51:15.700365] [FATAL] [LOCAL ] KIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:15.700805] [FATAL] [LOCAL ] KIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:15.700947] [FATAL] [MAIN ] KIM: Failed to save derivative data. [2025-10-24T00:51:15.701010] [FATAL] [MAIN ] KIO: Failed to save derivative data. [2025-10-24T00:51:15.704137] [INFO ] [MAIN ] Derivative Progress: 1091/2164 symbols completed. KIM took 1.2s. Estimated remaining: 7m 13s. Rate: 148.6 symbols/min [2025-10-24T00:51:15.706608] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:15.706801] [INFO ] [MAIN ] Derivative Progress: 1092/2164 symbols completed. KIO took 1.2s. Estimated remaining: 7m 12s. Rate: 148.8 symbols/min [2025-10-24T00:51:15.707246] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:15.731208] [DEBUG] [LOCAL ] KKRS: Loaded 5564 existing records from primary storage. [2025-10-24T00:51:15.731449] [INFO ] [MAIN ] KKRS: Loaded 5564 primary data records. [2025-10-24T00:51:15.873938] [DEBUG] [LOCAL ] KKR: Loaded 53890 existing records from primary storage. [2025-10-24T00:51:15.889714] [INFO ] [MAIN ] KKR: Loaded 53890 primary data records. [2025-10-24T00:51:16.144068] [DEBUG] [LOCAL ] KLC: Loaded 36361 existing records from primary storage. [2025-10-24T00:51:16.162028] [INFO ] [MAIN ] KLC: Loaded 36361 primary data records. [2025-10-24T00:51:16.761497] [DEBUG] [MAIN ] KKRS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:51:16.818599] [DEBUG] [MAIN ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:16.879249] [DEBUG] [MAIN ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:16.914696] [INFO ] [MAIN ] KKRS: Generated 139 derivative records from 5564 primary records. [2025-10-24T00:51:16.915598] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-24T00:51:16.916049] [FATAL] [LOCAL ] KKRS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:16.917337] [FATAL] [MAIN ] KKRS: Failed to save derivative data. [2025-10-24T00:51:16.921696] [INFO ] [MAIN ] Derivative Progress: 1093/2164 symbols completed. KKRS took 1.2s. Estimated remaining: 7m 13s. Rate: 148.5 symbols/min [2025-10-24T00:51:16.949455] [INFO ] [MAIN ] KLC: Generated 139 derivative records from 36361 primary records. [2025-10-24T00:51:16.952167] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-24T00:51:16.952050] [INFO ] [MAIN ] KKR: Generated 139 derivative records from 53890 primary records. [2025-10-24T00:51:16.952708] [FATAL] [LOCAL ] KLC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:16.952965] [FATAL] [MAIN ] KLC: Failed to save derivative data. [2025-10-24T00:51:16.952812] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-24T00:51:16.956350] [INFO ] [MAIN ] Derivative Progress: 1094/2164 symbols completed. KLC took 1.2s. Estimated remaining: 7m 12s. Rate: 148.6 symbols/min [2025-10-24T00:51:16.957140] [FATAL] [LOCAL ] KKR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:16.957359] [FATAL] [MAIN ] KKR: Failed to save derivative data. [2025-10-24T00:51:16.962955] [INFO ] [MAIN ] Derivative Progress: 1095/2164 symbols completed. KKR took 1.3s. Estimated remaining: 7m 11s. Rate: 148.7 symbols/min [2025-10-24T00:51:16.963588] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:16.963684] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:16.963756] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:16.973338] [DEBUG] [LOCAL ] KMPB: Loaded 3495 existing records from primary storage. [2025-10-24T00:51:16.973948] [INFO ] [MAIN ] KMPB: Loaded 3495 primary data records. [2025-10-24T00:51:17.375167] [DEBUG] [LOCAL ] KMPR: Loaded 40795 existing records from primary storage. [2025-10-24T00:51:17.377303] [INFO ] [MAIN ] KMPR: Loaded 40795 primary data records. [2025-10-24T00:51:17.399158] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-24T00:51:17.425974] [INFO ] [MAIN ] KMI: Loaded 54083 primary data records. [2025-10-24T00:51:18.044035] [DEBUG] [MAIN ] KMPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:18.113970] [DEBUG] [MAIN ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:18.124543] [DEBUG] [MAIN ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:18.171914] [INFO ] [MAIN ] KMPB: Generated 139 derivative records from 3495 primary records. [2025-10-24T00:51:18.173614] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-24T00:51:18.176546] [FATAL] [LOCAL ] KMPB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:18.179810] [FATAL] [MAIN ] KMPB: Failed to save derivative data. [2025-10-24T00:51:18.185904] [INFO ] [MAIN ] Derivative Progress: 1096/2164 symbols completed. KMPB took 1.2s. Estimated remaining: 7m 12s. Rate: 148.5 symbols/min [2025-10-24T00:51:18.186333] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:18.210601] [INFO ] [MAIN ] KMPR: Generated 139 derivative records from 40795 primary records. [2025-10-24T00:51:18.214310] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-24T00:51:18.213930] [INFO ] [MAIN ] KMI: Generated 139 derivative records from 54083 primary records. [2025-10-24T00:51:18.214878] [FATAL] [LOCAL ] KMPR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:18.214573] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-24T00:51:18.215051] [FATAL] [MAIN ] KMPR: Failed to save derivative data. [2025-10-24T00:51:18.215578] [FATAL] [LOCAL ] KMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:18.220362] [FATAL] [MAIN ] KMI: Failed to save derivative data. [2025-10-24T00:51:18.220135] [INFO ] [MAIN ] Derivative Progress: 1097/2164 symbols completed. KMPR took 1.3s. Estimated remaining: 7m 11s. Rate: 148.6 symbols/min [2025-10-24T00:51:18.233712] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:18.234043] [INFO ] [MAIN ] Derivative Progress: 1098/2164 symbols completed. KMI took 1.3s. Estimated remaining: 7m 10s. Rate: 148.7 symbols/min [2025-10-24T00:51:18.234838] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:18.252587] [DEBUG] [LOCAL ] KMT: Loaded 43150 existing records from primary storage. [2025-10-24T00:51:18.252934] [INFO ] [MAIN ] KMT: Loaded 43150 primary data records. [2025-10-24T00:51:18.508241] [DEBUG] [LOCAL ] KN: Loaded 38737 existing records from primary storage. [2025-10-24T00:51:18.662512] [INFO ] [MAIN ] KN: Loaded 38737 primary data records. [2025-10-24T00:51:18.663349] [DEBUG] [LOCAL ] KMX: Loaded 53676 existing records from primary storage. [2025-10-24T00:51:18.676627] [INFO ] [MAIN ] KMX: Loaded 53676 primary data records. [2025-10-24T00:51:19.284744] [DEBUG] [MAIN ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:19.344503] [DEBUG] [MAIN ] KMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:19.344136] [DEBUG] [MAIN ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:19.403983] [INFO ] [MAIN ] KMT: Generated 139 derivative records from 43150 primary records. [2025-10-24T00:51:19.406068] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-24T00:51:19.406616] [FATAL] [LOCAL ] KMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:19.410939] [FATAL] [MAIN ] KMT: Failed to save derivative data. [2025-10-24T00:51:19.414567] [INFO ] [MAIN ] Derivative Progress: 1099/2164 symbols completed. KMT took 1.2s. Estimated remaining: 7m 10s. Rate: 148.5 symbols/min [2025-10-24T00:51:19.414979] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:19.437581] [INFO ] [MAIN ] KN: Generated 139 derivative records from 38737 primary records. [2025-10-24T00:51:19.439680] [INFO ] [MAIN ] KMX: Generated 139 derivative records from 53676 primary records. [2025-10-24T00:51:19.440189] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-24T00:51:19.440483] [FATAL] [LOCAL ] KMX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:19.440235] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-24T00:51:19.440608] [FATAL] [MAIN ] KMX: Failed to save derivative data. [2025-10-24T00:51:19.452865] [INFO ] [MAIN ] Derivative Progress: 1100/2164 symbols completed. KMX took 1.2s. Estimated remaining: 7m 10s. Rate: 148.6 symbols/min [2025-10-24T00:51:19.453718] [FATAL] [LOCAL ] KN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:19.453192] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:19.453878] [FATAL] [MAIN ] KN: Failed to save derivative data. [2025-10-24T00:51:19.456756] [INFO ] [MAIN ] Derivative Progress: 1101/2164 symbols completed. KN took 1.2s. Estimated remaining: 7m 9s. Rate: 148.7 symbols/min [2025-10-24T00:51:19.458388] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:19.475639] [DEBUG] [LOCAL ] KNF: Loaded 36958 existing records from primary storage. [2025-10-24T00:51:19.479813] [INFO ] [MAIN ] KNF: Loaded 36958 primary data records. [2025-10-24T00:51:19.480103] [DEBUG] [LOCAL ] KNOP: Loaded 10130 existing records from primary storage. [2025-10-24T00:51:19.511771] [INFO ] [MAIN ] KNOP: Loaded 10130 primary data records. [2025-10-24T00:51:19.689312] [DEBUG] [LOCAL ] KNSL: Loaded 18471 existing records from primary storage. [2025-10-24T00:51:19.723439] [INFO ] [MAIN ] KNSL: Loaded 18471 primary data records. [2025-10-24T00:51:20.458374] [DEBUG] [MAIN ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:20.489280] [DEBUG] [MAIN ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:20.522013] [DEBUG] [MAIN ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:20.589347] [INFO ] [MAIN ] KNF: Generated 139 derivative records from 36958 primary records. [2025-10-24T00:51:20.591800] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-24T00:51:20.594090] [FATAL] [LOCAL ] KNF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:20.598289] [FATAL] [MAIN ] KNF: Failed to save derivative data. [2025-10-24T00:51:20.598805] [INFO ] [MAIN ] KNSL: Generated 139 derivative records from 18471 primary records. [2025-10-24T00:51:20.599207] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-24T00:51:20.599097] [INFO ] [MAIN ] KNOP: Generated 139 derivative records from 10130 primary records. [2025-10-24T00:51:20.599614] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-24T00:51:20.599516] [FATAL] [LOCAL ] KNSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:20.601508] [INFO ] [MAIN ] Derivative Progress: 1102/2164 symbols completed. KNF took 1.2s. Estimated remaining: 7m 9s. Rate: 148.5 symbols/min [2025-10-24T00:51:20.601974] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:20.601795] [FATAL] [MAIN ] KNSL: Failed to save derivative data. [2025-10-24T00:51:20.605876] [INFO ] [MAIN ] Derivative Progress: 1103/2164 symbols completed. KNSL took 1.1s. Estimated remaining: 7m 8s. Rate: 148.6 symbols/min [2025-10-24T00:51:20.602211] [FATAL] [LOCAL ] KNOP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:20.606245] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:20.606406] [FATAL] [MAIN ] KNOP: Failed to save derivative data. [2025-10-24T00:51:20.610117] [INFO ] [MAIN ] Derivative Progress: 1104/2164 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 8s. Rate: 148.7 symbols/min [2025-10-24T00:51:20.610406] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:20.675777] [DEBUG] [LOCAL ] KNX: Loaded 53035 existing records from primary storage. [2025-10-24T00:51:20.676073] [INFO ] [MAIN ] KNX: Loaded 53035 primary data records. [2025-10-24T00:51:20.795995] [DEBUG] [LOCAL ] KNTK: Loaded 47587 existing records from primary storage. [2025-10-24T00:51:20.809767] [INFO ] [MAIN ] KNTK: Loaded 47587 primary data records. [2025-10-24T00:51:20.811553] [DEBUG] [LOCAL ] KODK: Loaded 44027 existing records from primary storage. [2025-10-24T00:51:20.874899] [INFO ] [MAIN ] KODK: Loaded 44027 primary data records. [2025-10-24T00:51:21.677104] [DEBUG] [MAIN ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:21.734912] [DEBUG] [MAIN ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:21.775942] [DEBUG] [MAIN ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:21.838237] [INFO ] [MAIN ] KNX: Generated 139 derivative records from 53035 primary records. [2025-10-24T00:51:21.843719] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-24T00:51:21.844075] [FATAL] [LOCAL ] KNX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:21.846200] [FATAL] [MAIN ] KNX: Failed to save derivative data. [2025-10-24T00:51:21.849123] [INFO ] [MAIN ] Derivative Progress: 1105/2164 symbols completed. KNX took 1.2s. Estimated remaining: 7m 8s. Rate: 148.5 symbols/min [2025-10-24T00:51:21.849683] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:21.858359] [INFO ] [MAIN ] KNTK: Generated 139 derivative records from 47587 primary records. [2025-10-24T00:51:21.860152] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-24T00:51:21.860456] [FATAL] [LOCAL ] KNTK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:21.860594] [FATAL] [MAIN ] KNTK: Failed to save derivative data. [2025-10-24T00:51:21.865894] [INFO ] [MAIN ] Derivative Progress: 1106/2164 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 7s. Rate: 148.6 symbols/min [2025-10-24T00:51:21.867350] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:21.870005] [INFO ] [MAIN ] KODK: Generated 139 derivative records from 44027 primary records. [2025-10-24T00:51:21.870301] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-24T00:51:21.870541] [FATAL] [LOCAL ] KODK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:21.870931] [FATAL] [MAIN ] KODK: Failed to save derivative data. [2025-10-24T00:51:21.883165] [INFO ] [MAIN ] Derivative Progress: 1107/2164 symbols completed. KODK took 1.3s. Estimated remaining: 7m 6s. Rate: 148.7 symbols/min [2025-10-24T00:51:21.883725] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:21.893382] [DEBUG] [LOCAL ] KORE: Loaded 2189 existing records from primary storage. [2025-10-24T00:51:21.903928] [INFO ] [MAIN ] KORE: Loaded 2189 primary data records. [2025-10-24T00:51:21.943397] [DEBUG] [LOCAL ] KOF: Loaded 26676 existing records from primary storage. [2025-10-24T00:51:21.956320] [INFO ] [MAIN ] KOF: Loaded 26676 primary data records. [2025-10-24T00:51:22.014612] [DEBUG] [LOCAL ] KOP: Loaded 17418 existing records from primary storage. [2025-10-24T00:51:22.068361] [INFO ] [MAIN ] KOP: Loaded 17418 primary data records. [2025-10-24T00:51:22.894470] [DEBUG] [MAIN ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:22.922042] [DEBUG] [MAIN ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:22.962099] [DEBUG] [MAIN ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:23.017108] [INFO ] [MAIN ] KORE: Generated 139 derivative records from 2189 primary records. [2025-10-24T00:51:23.018084] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-24T00:51:23.020102] [FATAL] [LOCAL ] KORE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:23.021837] [FATAL] [MAIN ] KORE: Failed to save derivative data. [2025-10-24T00:51:23.024866] [INFO ] [MAIN ] Derivative Progress: 1108/2164 symbols completed. KORE took 1.1s. Estimated remaining: 7m 7s. Rate: 148.5 symbols/min [2025-10-24T00:51:23.039150] [INFO ] [MAIN ] KOP: Generated 139 derivative records from 17418 primary records. [2025-10-24T00:51:23.039478] [INFO ] [MAIN ] KOF: Generated 139 derivative records from 26676 primary records. [2025-10-24T00:51:23.039722] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-24T00:51:23.039792] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-24T00:51:23.040066] [FATAL] [LOCAL ] KOF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:23.040482] [FATAL] [MAIN ] KOF: Failed to save derivative data. [2025-10-24T00:51:23.040369] [FATAL] [LOCAL ] KOP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:23.040622] [FATAL] [MAIN ] KOP: Failed to save derivative data. [2025-10-24T00:51:23.042741] [INFO ] [MAIN ] Derivative Progress: 1109/2164 symbols completed. KOF took 1.2s. Estimated remaining: 7m 6s. Rate: 148.6 symbols/min [2025-10-24T00:51:23.045873] [INFO ] [MAIN ] Derivative Progress: 1110/2164 symbols completed. KOP took 1.2s. Estimated remaining: 7m 5s. Rate: 148.7 symbols/min [2025-10-24T00:51:23.046375] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:23.046479] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:23.046636] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:23.131849] [DEBUG] [LOCAL ] KRC: Loaded 48386 existing records from primary storage. [2025-10-24T00:51:23.148324] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-24T00:51:23.148517] [INFO ] [MAIN ] KRC: Loaded 48386 primary data records. [2025-10-24T00:51:23.148682] [INFO ] [MAIN ] KR: Loaded 54071 primary data records. [2025-10-24T00:51:23.149503] [DEBUG] [LOCAL ] KOS: Loaded 53483 existing records from primary storage. [2025-10-24T00:51:23.150055] [INFO ] [MAIN ] KOS: Loaded 53483 primary data records. [2025-10-24T00:51:24.138581] [DEBUG] [MAIN ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:24.186271] [DEBUG] [MAIN ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:24.205607] [DEBUG] [MAIN ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:24.280049] [INFO ] [MAIN ] KR: Generated 139 derivative records from 54071 primary records. [2025-10-24T00:51:24.283592] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-24T00:51:24.286787] [FATAL] [LOCAL ] KR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:24.289051] [FATAL] [MAIN ] KR: Failed to save derivative data. [2025-10-24T00:51:24.292572] [INFO ] [MAIN ] Derivative Progress: 1111/2164 symbols completed. KR took 1.2s. Estimated remaining: 7m 6s. Rate: 148.5 symbols/min [2025-10-24T00:51:24.297639] [INFO ] [MAIN ] KRC: Generated 139 derivative records from 48386 primary records. [2025-10-24T00:51:24.298002] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:24.298122] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-24T00:51:24.298546] [FATAL] [LOCAL ] KRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:24.298965] [INFO ] [MAIN ] KOS: Generated 139 derivative records from 53483 primary records. [2025-10-24T00:51:24.299098] [FATAL] [MAIN ] KRC: Failed to save derivative data. [2025-10-24T00:51:24.302705] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-24T00:51:24.302595] [INFO ] [MAIN ] Derivative Progress: 1112/2164 symbols completed. KRC took 1.3s. Estimated remaining: 7m 5s. Rate: 148.6 symbols/min [2025-10-24T00:51:24.303688] [FATAL] [LOCAL ] KOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:24.304334] [FATAL] [MAIN ] KOS: Failed to save derivative data. [2025-10-24T00:51:24.303965] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:24.308117] [INFO ] [MAIN ] Derivative Progress: 1113/2164 symbols completed. KOS took 1.3s. Estimated remaining: 7m 4s. Rate: 148.7 symbols/min [2025-10-24T00:51:24.309093] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:24.337682] [DEBUG] [LOCAL ] KRO: Loaded 26739 existing records from primary storage. [2025-10-24T00:51:24.337971] [INFO ] [MAIN ] KRO: Loaded 26739 primary data records. [2025-10-24T00:51:24.476434] [DEBUG] [LOCAL ] KREF: Loaded 38364 existing records from primary storage. [2025-10-24T00:51:24.477176] [INFO ] [MAIN ] KREF: Loaded 38364 primary data records. [2025-10-24T00:51:24.822928] [DEBUG] [LOCAL ] KRG: Loaded 49641 existing records from primary storage. [2025-10-24T00:51:24.835932] [INFO ] [MAIN ] KRG: Loaded 49641 primary data records. [2025-10-24T00:51:25.387591] [DEBUG] [MAIN ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:25.421137] [DEBUG] [MAIN ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:25.467438] [DEBUG] [MAIN ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:25.490612] [INFO ] [MAIN ] KRO: Generated 139 derivative records from 26739 primary records. [2025-10-24T00:51:25.492050] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-24T00:51:25.492524] [FATAL] [LOCAL ] KRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:25.492939] [FATAL] [MAIN ] KRO: Failed to save derivative data. [2025-10-24T00:51:25.497262] [INFO ] [MAIN ] Derivative Progress: 1114/2164 symbols completed. KRO took 1.2s. Estimated remaining: 7m 4s. Rate: 148.5 symbols/min [2025-10-24T00:51:25.500955] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:25.514935] [INFO ] [MAIN ] KREF: Generated 139 derivative records from 38364 primary records. [2025-10-24T00:51:25.518038] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-24T00:51:25.519629] [FATAL] [LOCAL ] KREF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:25.522109] [FATAL] [MAIN ] KREF: Failed to save derivative data. [2025-10-24T00:51:25.525218] [INFO ] [MAIN ] Derivative Progress: 1115/2164 symbols completed. KREF took 1.2s. Estimated remaining: 7m 4s. Rate: 148.6 symbols/min [2025-10-24T00:51:25.527355] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:25.539879] [INFO ] [MAIN ] KRG: Generated 139 derivative records from 49641 primary records. [2025-10-24T00:51:25.540295] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-24T00:51:25.540697] [FATAL] [LOCAL ] KRG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:25.540796] [FATAL] [MAIN ] KRG: Failed to save derivative data. [2025-10-24T00:51:25.543682] [INFO ] [MAIN ] Derivative Progress: 1116/2164 symbols completed. KRG took 1.2s. Estimated remaining: 7m 3s. Rate: 148.7 symbols/min [2025-10-24T00:51:25.543871] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:25.559736] [DEBUG] [LOCAL ] KRP: Loaded 36127 existing records from primary storage. [2025-10-24T00:51:25.559977] [INFO ] [MAIN ] KRP: Loaded 36127 primary data records. [2025-10-24T00:51:25.909508] [DEBUG] [LOCAL ] KT: Loaded 45680 existing records from primary storage. [2025-10-24T00:51:25.910566] [DEBUG] [LOCAL ] KSS: Loaded 53970 existing records from primary storage. [2025-10-24T00:51:25.909892] [INFO ] [MAIN ] KT: Loaded 45680 primary data records. [2025-10-24T00:51:25.911487] [INFO ] [MAIN ] KSS: Loaded 53970 primary data records. [2025-10-24T00:51:26.579088] [DEBUG] [MAIN ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:26.637428] [DEBUG] [MAIN ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:26.642728] [DEBUG] [MAIN ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:26.690780] [INFO ] [MAIN ] KRP: Generated 139 derivative records from 36127 primary records. [2025-10-24T00:51:26.691205] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-24T00:51:26.692883] [FATAL] [LOCAL ] KRP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:26.693701] [FATAL] [MAIN ] KRP: Failed to save derivative data. [2025-10-24T00:51:26.700523] [INFO ] [MAIN ] Derivative Progress: 1117/2164 symbols completed. KRP took 1.2s. Estimated remaining: 7m 3s. Rate: 148.5 symbols/min [2025-10-24T00:51:26.706727] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:26.735986] [INFO ] [MAIN ] KT: Generated 139 derivative records from 45680 primary records. [2025-10-24T00:51:26.737218] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-24T00:51:26.738181] [FATAL] [LOCAL ] KT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:26.738547] [FATAL] [MAIN ] KT: Failed to save derivative data. [2025-10-24T00:51:26.742204] [INFO ] [MAIN ] Derivative Progress: 1118/2164 symbols completed. KT took 1.2s. Estimated remaining: 7m 2s. Rate: 148.6 symbols/min [2025-10-24T00:51:26.743149] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:26.746815] [INFO ] [MAIN ] KSS: Generated 139 derivative records from 53970 primary records. [2025-10-24T00:51:26.747426] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-24T00:51:26.747753] [FATAL] [LOCAL ] KSS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:26.747839] [FATAL] [MAIN ] KSS: Failed to save derivative data. [2025-10-24T00:51:26.752994] [INFO ] [MAIN ] Derivative Progress: 1119/2164 symbols completed. KSS took 1.2s. Estimated remaining: 7m 2s. Rate: 148.7 symbols/min [2025-10-24T00:51:26.764023] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:26.774524] [DEBUG] [LOCAL ] KTF: Loaded 11723 existing records from primary storage. [2025-10-24T00:51:26.786240] [INFO ] [MAIN ] KTF: Loaded 11723 primary data records. [2025-10-24T00:51:26.792261] [DEBUG] [LOCAL ] KTB: Loaded 40495 existing records from primary storage. [2025-10-24T00:51:26.801527] [INFO ] [MAIN ] KTB: Loaded 40495 primary data records. [2025-10-24T00:51:27.337597] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-24T00:51:27.460352] [INFO ] [MAIN ] KVUE: Loaded 54057 primary data records. [2025-10-24T00:51:27.797387] [DEBUG] [MAIN ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:27.798589] [DEBUG] [MAIN ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:27.852266] [DEBUG] [MAIN ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:27.904935] [INFO ] [MAIN ] KTF: Generated 139 derivative records from 11723 primary records. [2025-10-24T00:51:27.909630] [INFO ] [MAIN ] KTB: Generated 139 derivative records from 40495 primary records. [2025-10-24T00:51:27.907122] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-24T00:51:27.910176] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-24T00:51:27.911518] [FATAL] [LOCAL ] KTB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:27.911740] [FATAL] [MAIN ] KTB: Failed to save derivative data. [2025-10-24T00:51:27.912068] [FATAL] [LOCAL ] KTF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:27.916552] [INFO ] [MAIN ] Derivative Progress: 1120/2164 symbols completed. KTB took 1.2s. Estimated remaining: 7m 2s. Rate: 148.5 symbols/min [2025-10-24T00:51:27.916742] [FATAL] [MAIN ] KTF: Failed to save derivative data. [2025-10-24T00:51:27.919673] [INFO ] [MAIN ] Derivative Progress: 1121/2164 symbols completed. KTF took 1.2s. Estimated remaining: 7m 1s. Rate: 148.6 symbols/min [2025-10-24T00:51:27.919599] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:27.920210] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:27.925732] [INFO ] [MAIN ] KVUE: Generated 139 derivative records from 54057 primary records. [2025-10-24T00:51:27.926021] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-24T00:51:27.926331] [FATAL] [LOCAL ] KVUE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:27.926515] [FATAL] [MAIN ] KVUE: Failed to save derivative data. [2025-10-24T00:51:27.929445] [INFO ] [MAIN ] Derivative Progress: 1122/2164 symbols completed. KVUE took 1.2s. Estimated remaining: 7m 0s. Rate: 148.7 symbols/min [2025-10-24T00:51:27.929727] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:27.972595] [DEBUG] [LOCAL ] KWR: Loaded 15764 existing records from primary storage. [2025-10-24T00:51:27.972803] [INFO ] [MAIN ] KWR: Loaded 15764 primary data records. [2025-10-24T00:51:28.108990] [DEBUG] [LOCAL ] KVYO: Loaded 51270 existing records from primary storage. [2025-10-24T00:51:28.110578] [INFO ] [MAIN ] KVYO: Loaded 51270 primary data records. [2025-10-24T00:51:28.109747] [DEBUG] [LOCAL ] KW: Loaded 40548 existing records from primary storage. [2025-10-24T00:51:28.131696] [INFO ] [MAIN ] KW: Loaded 40548 primary data records. [2025-10-24T00:51:28.997076] [DEBUG] [MAIN ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:29.029615] [DEBUG] [MAIN ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:29.060011] [DEBUG] [MAIN ] KVYO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:29.139970] [INFO ] [MAIN ] KWR: Generated 139 derivative records from 15764 primary records. [2025-10-24T00:51:29.140239] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-24T00:51:29.140930] [FATAL] [LOCAL ] KWR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:29.142274] [FATAL] [MAIN ] KWR: Failed to save derivative data. [2025-10-24T00:51:29.144931] [INFO ] [MAIN ] Derivative Progress: 1123/2164 symbols completed. KWR took 1.2s. Estimated remaining: 7m 1s. Rate: 148.5 symbols/min [2025-10-24T00:51:29.148857] [INFO ] [MAIN ] KW: Generated 139 derivative records from 40548 primary records. [2025-10-24T00:51:29.149104] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-24T00:51:29.149598] [FATAL] [LOCAL ] KW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:29.152035] [FATAL] [MAIN ] KW: Failed to save derivative data. [2025-10-24T00:51:29.151916] [INFO ] [MAIN ] KVYO: Generated 139 derivative records from 51270 primary records. [2025-10-24T00:51:29.155751] [INFO ] [MAIN ] Derivative Progress: 1124/2164 symbols completed. KW took 1.2s. Estimated remaining: 6m 60s. Rate: 148.6 symbols/min [2025-10-24T00:51:29.156040] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-24T00:51:29.156319] [FATAL] [LOCAL ] KVYO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:29.156400] [FATAL] [MAIN ] KVYO: Failed to save derivative data. [2025-10-24T00:51:29.158920] [INFO ] [MAIN ] Derivative Progress: 1125/2164 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 59s. Rate: 148.7 symbols/min [2025-10-24T00:51:29.159443] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:29.159709] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:29.159542] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:29.217016] [DEBUG] [LOCAL ] KYN: Loaded 30347 existing records from primary storage. [2025-10-24T00:51:29.217206] [INFO ] [MAIN ] KYN: Loaded 30347 primary data records. [2025-10-24T00:51:29.321044] [DEBUG] [LOCAL ] L: Loaded 41436 existing records from primary storage. [2025-10-24T00:51:29.346316] [INFO ] [MAIN ] L: Loaded 41436 primary data records. [2025-10-24T00:51:29.363529] [DEBUG] [LOCAL ] LAC: Loaded 52961 existing records from primary storage. [2025-10-24T00:51:29.388975] [INFO ] [MAIN ] LAC: Loaded 52961 primary data records. [2025-10-24T00:51:30.173284] [DEBUG] [MAIN ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:30.212856] [DEBUG] [MAIN ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:30.243069] [DEBUG] [MAIN ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:30.301560] [INFO ] [MAIN ] KYN: Generated 139 derivative records from 30347 primary records. [2025-10-24T00:51:30.302230] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-24T00:51:30.302704] [FATAL] [LOCAL ] KYN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:30.303754] [FATAL] [MAIN ] KYN: Failed to save derivative data. [2025-10-24T00:51:30.309222] [INFO ] [MAIN ] Derivative Progress: 1126/2164 symbols completed. KYN took 1.1s. Estimated remaining: 6m 59s. Rate: 148.5 symbols/min [2025-10-24T00:51:30.311489] [INFO ] [MAIN ] L: Generated 139 derivative records from 41436 primary records. [2025-10-24T00:51:30.311839] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:30.311621] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-24T00:51:30.312401] [FATAL] [LOCAL ] L: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:30.312619] [FATAL] [MAIN ] L: Failed to save derivative data. [2025-10-24T00:51:30.316970] [INFO ] [MAIN ] Derivative Progress: 1127/2164 symbols completed. L took 1.2s. Estimated remaining: 6m 59s. Rate: 148.6 symbols/min [2025-10-24T00:51:30.317417] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:30.323532] [INFO ] [MAIN ] LAC: Generated 139 derivative records from 52961 primary records. [2025-10-24T00:51:30.323772] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-24T00:51:30.324230] [FATAL] [LOCAL ] LAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:30.324500] [FATAL] [MAIN ] LAC: Failed to save derivative data. [2025-10-24T00:51:30.328919] [INFO ] [MAIN ] Derivative Progress: 1128/2164 symbols completed. LAC took 1.2s. Estimated remaining: 6m 58s. Rate: 148.7 symbols/min [2025-10-24T00:51:30.329146] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:30.340092] [DEBUG] [LOCAL ] LANV: Loaded 2803 existing records from primary storage. [2025-10-24T00:51:30.340275] [INFO ] [MAIN ] LANV: Loaded 2803 primary data records. [2025-10-24T00:51:30.445667] [DEBUG] [LOCAL ] LAD: Loaded 23562 existing records from primary storage. [2025-10-24T00:51:30.462311] [INFO ] [MAIN ] LAD: Loaded 23562 primary data records. [2025-10-24T00:51:30.634380] [DEBUG] [LOCAL ] LADR: Loaded 39650 existing records from primary storage. [2025-10-24T00:51:30.746571] [INFO ] [MAIN ] LADR: Loaded 39650 primary data records. [2025-10-24T00:51:31.344694] [DEBUG] [MAIN ] LANV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:31.372935] [DEBUG] [MAIN ] LAD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:51:31.414371] [DEBUG] [MAIN ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:31.475845] [INFO ] [MAIN ] LANV: Generated 139 derivative records from 2803 primary records. [2025-10-24T00:51:31.478038] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-24T00:51:31.478593] [FATAL] [LOCAL ] LANV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:31.480853] [FATAL] [MAIN ] LANV: Failed to save derivative data. [2025-10-24T00:51:31.483683] [INFO ] [MAIN ] LAD: Generated 139 derivative records from 23562 primary records. [2025-10-24T00:51:31.485532] [INFO ] [MAIN ] Derivative Progress: 1129/2164 symbols completed. LANV took 1.2s. Estimated remaining: 6m 58s. Rate: 148.5 symbols/min [2025-10-24T00:51:31.486354] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:31.486043] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-24T00:51:31.486795] [FATAL] [LOCAL ] LAD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:31.487339] [FATAL] [MAIN ] LAD: Failed to save derivative data. [2025-10-24T00:51:31.490074] [INFO ] [MAIN ] Derivative Progress: 1130/2164 symbols completed. LAD took 1.2s. Estimated remaining: 6m 57s. Rate: 148.6 symbols/min [2025-10-24T00:51:31.491804] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:31.494624] [INFO ] [MAIN ] LADR: Generated 139 derivative records from 39650 primary records. [2025-10-24T00:51:31.494868] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-24T00:51:31.495126] [FATAL] [LOCAL ] LADR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:31.495368] [FATAL] [MAIN ] LADR: Failed to save derivative data. [2025-10-24T00:51:31.498325] [INFO ] [MAIN ] Derivative Progress: 1131/2164 symbols completed. LADR took 1.2s. Estimated remaining: 6m 57s. Rate: 148.7 symbols/min [2025-10-24T00:51:31.498613] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:31.510624] [DEBUG] [LOCAL ] LAW: Loaded 15075 existing records from primary storage. [2025-10-24T00:51:31.510813] [INFO ] [MAIN ] LAW: Loaded 15075 primary data records. [2025-10-24T00:51:31.846527] [DEBUG] [LOCAL ] LAZ: Loaded 44787 existing records from primary storage. [2025-10-24T00:51:31.857000] [INFO ] [MAIN ] LAZ: Loaded 44787 primary data records. [2025-10-24T00:51:31.857631] [DEBUG] [LOCAL ] LB: Loaded 37214 existing records from primary storage. [2025-10-24T00:51:31.879008] [INFO ] [MAIN ] LB: Loaded 37214 primary data records. [2025-10-24T00:51:32.518706] [DEBUG] [MAIN ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:32.564104] [DEBUG] [MAIN ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:32.596377] [DEBUG] [MAIN ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:32.615902] [INFO ] [MAIN ] LAW: Generated 139 derivative records from 15075 primary records. [2025-10-24T00:51:32.616169] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-24T00:51:32.618360] [FATAL] [LOCAL ] LAW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:32.618533] [FATAL] [MAIN ] LAW: Failed to save derivative data. [2025-10-24T00:51:32.622015] [INFO ] [MAIN ] Derivative Progress: 1132/2164 symbols completed. LAW took 1.1s. Estimated remaining: 6m 57s. Rate: 148.5 symbols/min [2025-10-24T00:51:32.627685] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:32.651570] [INFO ] [MAIN ] LAZ: Generated 139 derivative records from 44787 primary records. [2025-10-24T00:51:32.656769] [INFO ] [MAIN ] LB: Generated 139 derivative records from 37214 primary records. [2025-10-24T00:51:32.656905] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-24T00:51:32.657122] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-24T00:51:32.657471] [FATAL] [LOCAL ] LB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:32.657865] [FATAL] [MAIN ] LB: Failed to save derivative data. [2025-10-24T00:51:32.657774] [FATAL] [LOCAL ] LAZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:32.661013] [INFO ] [MAIN ] Derivative Progress: 1133/2164 symbols completed. LB took 1.2s. Estimated remaining: 6m 56s. Rate: 148.6 symbols/min [2025-10-24T00:51:32.661418] [FATAL] [MAIN ] LAZ: Failed to save derivative data. [2025-10-24T00:51:32.664906] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:32.665157] [INFO ] [MAIN ] Derivative Progress: 1134/2164 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 55s. Rate: 148.8 symbols/min [2025-10-24T00:51:32.665867] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:32.710328] [DEBUG] [LOCAL ] LBRT: Loaded 53393 existing records from primary storage. [2025-10-24T00:51:32.710625] [INFO ] [MAIN ] LBRT: Loaded 53393 primary data records. [2025-10-24T00:51:32.800681] [DEBUG] [LOCAL ] LCII: Loaded 26970 existing records from primary storage. [2025-10-24T00:51:32.823491] [INFO ] [MAIN ] LCII: Loaded 26970 primary data records. [2025-10-24T00:51:32.961458] [DEBUG] [LOCAL ] LC: Loaded 48645 existing records from primary storage. [2025-10-24T00:51:33.019973] [INFO ] [MAIN ] LC: Loaded 48645 primary data records. [2025-10-24T00:51:33.654004] [DEBUG] [MAIN ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:33.686991] [DEBUG] [MAIN ] LCII: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:51:33.722846] [DEBUG] [MAIN ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:33.761985] [INFO ] [MAIN ] LBRT: Generated 139 derivative records from 53393 primary records. [2025-10-24T00:51:33.764157] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-24T00:51:33.764688] [FATAL] [LOCAL ] LBRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:33.767355] [FATAL] [MAIN ] LBRT: Failed to save derivative data. [2025-10-24T00:51:33.769721] [INFO ] [MAIN ] Derivative Progress: 1135/2164 symbols completed. LBRT took 1.1s. Estimated remaining: 6m 56s. Rate: 148.5 symbols/min [2025-10-24T00:51:33.772448] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:33.791438] [INFO ] [MAIN ] LC: Generated 139 derivative records from 48645 primary records. [2025-10-24T00:51:33.791024] [INFO ] [MAIN ] LCII: Generated 139 derivative records from 26970 primary records. [2025-10-24T00:51:33.791680] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-24T00:51:33.792039] [FATAL] [LOCAL ] LC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:33.792158] [FATAL] [MAIN ] LC: Failed to save derivative data. [2025-10-24T00:51:33.791796] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-24T00:51:33.795138] [INFO ] [MAIN ] Derivative Progress: 1136/2164 symbols completed. LC took 1.1s. Estimated remaining: 6m 55s. Rate: 148.7 symbols/min [2025-10-24T00:51:33.795725] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:33.795597] [FATAL] [LOCAL ] LCII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:33.795931] [FATAL] [MAIN ] LCII: Failed to save derivative data. [2025-10-24T00:51:33.798600] [INFO ] [MAIN ] Derivative Progress: 1137/2164 symbols completed. LCII took 1.1s. Estimated remaining: 6m 54s. Rate: 148.8 symbols/min [2025-10-24T00:51:33.799141] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:33.828969] [DEBUG] [LOCAL ] LDI: Loaded 45498 existing records from primary storage. [2025-10-24T00:51:33.829133] [INFO ] [MAIN ] LDI: Loaded 45498 primary data records. [2025-10-24T00:51:34.168819] [DEBUG] [LOCAL ] LEA: Loaded 41368 existing records from primary storage. [2025-10-24T00:51:34.169118] [INFO ] [MAIN ] LEA: Loaded 41368 primary data records. [2025-10-24T00:51:34.169758] [DEBUG] [LOCAL ] LDOS: Loaded 44903 existing records from primary storage. [2025-10-24T00:51:34.170614] [INFO ] [MAIN ] LDOS: Loaded 44903 primary data records. [2025-10-24T00:51:34.824687] [DEBUG] [MAIN ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:34.870787] [DEBUG] [MAIN ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:34.903927] [DEBUG] [MAIN ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:34.932358] [INFO ] [MAIN ] LDI: Generated 139 derivative records from 45498 primary records. [2025-10-24T00:51:34.933369] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-24T00:51:34.936337] [FATAL] [LOCAL ] LDI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:34.936736] [FATAL] [MAIN ] LDI: Failed to save derivative data. [2025-10-24T00:51:34.941449] [INFO ] [MAIN ] Derivative Progress: 1138/2164 symbols completed. LDI took 1.2s. Estimated remaining: 6m 54s. Rate: 148.5 symbols/min [2025-10-24T00:51:34.958255] [INFO ] [MAIN ] LEA: Generated 139 derivative records from 41368 primary records. [2025-10-24T00:51:34.960460] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-24T00:51:34.960761] [FATAL] [LOCAL ] LEA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:34.960992] [FATAL] [MAIN ] LEA: Failed to save derivative data. [2025-10-24T00:51:34.963261] [INFO ] [MAIN ] Derivative Progress: 1139/2164 symbols completed. LEA took 1.2s. Estimated remaining: 6m 54s. Rate: 148.7 symbols/min [2025-10-24T00:51:34.965893] [INFO ] [MAIN ] LDOS: Generated 139 derivative records from 44903 primary records. [2025-10-24T00:51:34.965986] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-24T00:51:34.966193] [FATAL] [LOCAL ] LDOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:34.966287] [FATAL] [MAIN ] LDOS: Failed to save derivative data. [2025-10-24T00:51:34.969083] [INFO ] [MAIN ] Derivative Progress: 1140/2164 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 53s. Rate: 148.8 symbols/min [2025-10-24T00:51:34.969770] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:34.969627] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:34.970105] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:34.988662] [DEBUG] [LOCAL ] LEO: Loaded 16918 existing records from primary storage. [2025-10-24T00:51:34.988845] [INFO ] [MAIN ] LEO: Loaded 16918 primary data records. [2025-10-24T00:51:35.334586] [DEBUG] [LOCAL ] LEG: Loaded 50311 existing records from primary storage. [2025-10-24T00:51:35.335631] [INFO ] [MAIN ] LEG: Loaded 50311 primary data records. [2025-10-24T00:51:35.335515] [DEBUG] [LOCAL ] LEN: Loaded 53586 existing records from primary storage. [2025-10-24T00:51:35.336472] [INFO ] [MAIN ] LEN: Loaded 53586 primary data records. [2025-10-24T00:51:35.951951] [DEBUG] [MAIN ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:36.002520] [DEBUG] [MAIN ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:36.030343] [DEBUG] [MAIN ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:36.046184] [INFO ] [MAIN ] LEO: Generated 139 derivative records from 16918 primary records. [2025-10-24T00:51:36.046663] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-24T00:51:36.049480] [FATAL] [LOCAL ] LEO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:36.051061] [FATAL] [MAIN ] LEO: Failed to save derivative data. [2025-10-24T00:51:36.054328] [INFO ] [MAIN ] Derivative Progress: 1141/2164 symbols completed. LEO took 1.1s. Estimated remaining: 6m 53s. Rate: 148.6 symbols/min [2025-10-24T00:51:36.056982] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:36.086515] [INFO ] [MAIN ] LEG: Generated 139 derivative records from 50311 primary records. [2025-10-24T00:51:36.088598] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-24T00:51:36.090319] [FATAL] [LOCAL ] LEG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:36.091320] [FATAL] [MAIN ] LEG: Failed to save derivative data. [2025-10-24T00:51:36.093750] [INFO ] [MAIN ] Derivative Progress: 1142/2164 symbols completed. LEG took 1.1s. Estimated remaining: 6m 52s. Rate: 148.7 symbols/min [2025-10-24T00:51:36.093978] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:36.096448] [INFO ] [MAIN ] LEN: Generated 139 derivative records from 53586 primary records. [2025-10-24T00:51:36.096768] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-24T00:51:36.097042] [FATAL] [LOCAL ] LEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:36.097135] [FATAL] [MAIN ] LEN: Failed to save derivative data. [2025-10-24T00:51:36.100681] [INFO ] [MAIN ] Derivative Progress: 1143/2164 symbols completed. LEN took 1.1s. Estimated remaining: 6m 52s. Rate: 148.8 symbols/min [2025-10-24T00:51:36.100919] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:36.151024] [DEBUG] [LOCAL ] LFT: Loaded 18234 existing records from primary storage. [2025-10-24T00:51:36.152087] [INFO ] [MAIN ] LFT: Loaded 18234 primary data records. [2025-10-24T00:51:36.130493] [DEBUG] [LOCAL ] LGI: Loaded 10003 existing records from primary storage. [2025-10-24T00:51:36.152342] [INFO ] [MAIN ] LGI: Loaded 10003 primary data records. [2025-10-24T00:51:36.164932] [DEBUG] [LOCAL ] LEVI: Loaded 52204 existing records from primary storage. [2025-10-24T00:51:36.226405] [INFO ] [MAIN ] LEVI: Loaded 52204 primary data records. [2025-10-24T00:51:37.116613] [DEBUG] [MAIN ] LEVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:37.141298] [DEBUG] [MAIN ] LGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:37.166950] [DEBUG] [MAIN ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:37.233492] [INFO ] [MAIN ] LGI: Generated 139 derivative records from 10003 primary records. [2025-10-24T00:51:37.240374] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-24T00:51:37.240567] [INFO ] [MAIN ] LFT: Generated 139 derivative records from 18234 primary records. [2025-10-24T00:51:37.241042] [FATAL] [LOCAL ] LGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:37.240698] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-24T00:51:37.241312] [FATAL] [LOCAL ] LFT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:37.241404] [FATAL] [MAIN ] LFT: Failed to save derivative data. [2025-10-24T00:51:37.244846] [INFO ] [MAIN ] Derivative Progress: 1144/2164 symbols completed. LFT took 1.2s. Estimated remaining: 6m 52s. Rate: 148.6 symbols/min [2025-10-24T00:51:37.242776] [FATAL] [MAIN ] LGI: Failed to save derivative data. [2025-10-24T00:51:37.250075] [INFO ] [MAIN ] Derivative Progress: 1145/2164 symbols completed. LGI took 1.1s. Estimated remaining: 6m 51s. Rate: 148.7 symbols/min [2025-10-24T00:51:37.249872] [INFO ] [MAIN ] LEVI: Generated 139 derivative records from 52204 primary records. [2025-10-24T00:51:37.249993] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:37.250572] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-24T00:51:37.250329] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:37.251333] [FATAL] [LOCAL ] LEVI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:37.251733] [FATAL] [MAIN ] LEVI: Failed to save derivative data. [2025-10-24T00:51:37.254443] [INFO ] [MAIN ] Derivative Progress: 1146/2164 symbols completed. LEVI took 1.2s. Estimated remaining: 6m 50s. Rate: 148.8 symbols/min [2025-10-24T00:51:37.254769] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:37.292790] [DEBUG] [LOCAL ] LII: Loaded 28039 existing records from primary storage. [2025-10-24T00:51:37.302089] [INFO ] [MAIN ] LII: Loaded 28039 primary data records. [2025-10-24T00:51:37.434040] [DEBUG] [LOCAL ] LH: Loaded 37267 existing records from primary storage. [2025-10-24T00:51:37.440039] [INFO ] [MAIN ] LH: Loaded 37267 primary data records. [2025-10-24T00:51:37.476876] [DEBUG] [LOCAL ] LHX: Loaded 48769 existing records from primary storage. [2025-10-24T00:51:37.525705] [INFO ] [MAIN ] LHX: Loaded 48769 primary data records. [2025-10-24T00:51:38.277957] [DEBUG] [MAIN ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:38.309080] [DEBUG] [MAIN ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:38.351689] [DEBUG] [MAIN ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:38.402730] [INFO ] [MAIN ] LII: Generated 139 derivative records from 28039 primary records. [2025-10-24T00:51:38.405847] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-24T00:51:38.409782] [FATAL] [LOCAL ] LII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:38.413198] [FATAL] [MAIN ] LII: Failed to save derivative data. [2025-10-24T00:51:38.413411] [INFO ] [MAIN ] LH: Generated 139 derivative records from 37267 primary records. [2025-10-24T00:51:38.416876] [INFO ] [MAIN ] Derivative Progress: 1147/2164 symbols completed. LII took 1.2s. Estimated remaining: 6m 51s. Rate: 148.6 symbols/min [2025-10-24T00:51:38.417154] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:38.417741] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-24T00:51:38.420195] [FATAL] [LOCAL ] LH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:38.420350] [FATAL] [MAIN ] LH: Failed to save derivative data. [2025-10-24T00:51:38.425525] [INFO ] [MAIN ] Derivative Progress: 1148/2164 symbols completed. LH took 1.2s. Estimated remaining: 6m 50s. Rate: 148.7 symbols/min [2025-10-24T00:51:38.426052] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:38.430920] [INFO ] [MAIN ] LHX: Generated 139 derivative records from 48769 primary records. [2025-10-24T00:51:38.431379] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-24T00:51:38.431723] [FATAL] [LOCAL ] LHX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:38.431849] [FATAL] [MAIN ] LHX: Failed to save derivative data. [2025-10-24T00:51:38.438164] [INFO ] [MAIN ] Derivative Progress: 1149/2164 symbols completed. LHX took 1.2s. Estimated remaining: 6m 49s. Rate: 148.8 symbols/min [2025-10-24T00:51:38.434997] [DEBUG] [LOCAL ] LITB: Loaded 3886 existing records from primary storage. [2025-10-24T00:51:38.438491] [INFO ] [MAIN ] LITB: Loaded 3886 primary data records. [2025-10-24T00:51:38.438661] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:38.623160] [DEBUG] [LOCAL ] LION: Loaded 47284 existing records from primary storage. [2025-10-24T00:51:38.643709] [INFO ] [MAIN ] LION: Loaded 47284 primary data records. [2025-10-24T00:51:38.948387] [DEBUG] [LOCAL ] LLY: Loaded 53575 existing records from primary storage. [2025-10-24T00:51:38.986306] [INFO ] [MAIN ] LLY: Loaded 53575 primary data records. [2025-10-24T00:51:39.382271] [DEBUG] [MAIN ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:39.552636] [DEBUG] [MAIN ] LION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:39.597143] [INFO ] [MAIN ] LITB: Generated 139 derivative records from 3886 primary records. [2025-10-24T00:51:39.608359] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-24T00:51:39.614066] [FATAL] [LOCAL ] LITB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:39.613599] [DEBUG] [MAIN ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:39.615291] [FATAL] [MAIN ] LITB: Failed to save derivative data. [2025-10-24T00:51:39.632380] [INFO ] [MAIN ] Derivative Progress: 1150/2164 symbols completed. LITB took 1.2s. Estimated remaining: 6m 49s. Rate: 148.6 symbols/min [2025-10-24T00:51:39.635231] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:39.645879] [INFO ] [MAIN ] LION: Generated 139 derivative records from 47284 primary records. [2025-10-24T00:51:39.648807] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-24T00:51:39.649252] [FATAL] [LOCAL ] LION: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:39.649548] [FATAL] [MAIN ] LION: Failed to save derivative data. [2025-10-24T00:51:39.653751] [INFO ] [MAIN ] Derivative Progress: 1151/2164 symbols completed. LION took 1.2s. Estimated remaining: 6m 49s. Rate: 148.7 symbols/min [2025-10-24T00:51:39.653962] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:39.665308] [INFO ] [MAIN ] LLY: Generated 139 derivative records from 53575 primary records. [2025-10-24T00:51:39.665477] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-24T00:51:39.665722] [FATAL] [LOCAL ] LLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:39.665803] [FATAL] [MAIN ] LLY: Failed to save derivative data. [2025-10-24T00:51:39.669435] [INFO ] [MAIN ] Derivative Progress: 1152/2164 symbols completed. LLY took 1.2s. Estimated remaining: 6m 48s. Rate: 148.8 symbols/min [2025-10-24T00:51:39.669688] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:39.722550] [DEBUG] [LOCAL ] LMND: Loaded 52502 existing records from primary storage. [2025-10-24T00:51:39.722902] [INFO ] [MAIN ] LMND: Loaded 52502 primary data records. [2025-10-24T00:51:39.871471] [DEBUG] [LOCAL ] LMT: Loaded 49977 existing records from primary storage. [2025-10-24T00:51:39.893308] [INFO ] [MAIN ] LMT: Loaded 49977 primary data records. [2025-10-24T00:51:39.964291] [DEBUG] [LOCAL ] LNC: Loaded 51801 existing records from primary storage. [2025-10-24T00:51:40.030922] [INFO ] [MAIN ] LNC: Loaded 51801 primary data records. [2025-10-24T00:51:40.788001] [DEBUG] [MAIN ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:40.823428] [DEBUG] [MAIN ] LMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:40.859039] [DEBUG] [MAIN ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:40.921782] [INFO ] [MAIN ] LMND: Generated 139 derivative records from 52502 primary records. [2025-10-24T00:51:40.925602] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-24T00:51:40.927201] [FATAL] [LOCAL ] LMND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:40.927710] [FATAL] [MAIN ] LMND: Failed to save derivative data. [2025-10-24T00:51:40.930845] [INFO ] [MAIN ] Derivative Progress: 1153/2164 symbols completed. LMND took 1.3s. Estimated remaining: 6m 48s. Rate: 148.6 symbols/min [2025-10-24T00:51:40.940123] [INFO ] [MAIN ] LMT: Generated 139 derivative records from 49977 primary records. [2025-10-24T00:51:40.941602] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-24T00:51:40.942013] [FATAL] [LOCAL ] LMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:40.942117] [FATAL] [MAIN ] LMT: Failed to save derivative data. [2025-10-24T00:51:40.944216] [INFO ] [MAIN ] LNC: Generated 139 derivative records from 51801 primary records. [2025-10-24T00:51:40.948216] [INFO ] [MAIN ] Derivative Progress: 1154/2164 symbols completed. LMT took 1.3s. Estimated remaining: 6m 48s. Rate: 148.7 symbols/min [2025-10-24T00:51:40.948392] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-24T00:51:40.948984] [FATAL] [LOCAL ] LNC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:40.949069] [FATAL] [MAIN ] LNC: Failed to save derivative data. [2025-10-24T00:51:40.954370] [INFO ] [MAIN ] Derivative Progress: 1155/2164 symbols completed. LNC took 1.3s. Estimated remaining: 6m 47s. Rate: 148.8 symbols/min [2025-10-24T00:51:40.955054] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:40.954931] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:40.955489] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:40.969387] [DEBUG] [LOCAL ] LND: Loaded 4995 existing records from primary storage. [2025-10-24T00:51:40.969682] [INFO ] [MAIN ] LND: Loaded 4995 primary data records. [2025-10-24T00:51:41.019998] [DEBUG] [LOCAL ] LNN: Loaded 11727 existing records from primary storage. [2025-10-24T00:51:41.058462] [INFO ] [MAIN ] LNN: Loaded 11727 primary data records. [2025-10-24T00:51:41.495285] [DEBUG] [LOCAL ] LNG: Loaded 51448 existing records from primary storage. [2025-10-24T00:51:41.563969] [INFO ] [MAIN ] LNG: Loaded 51448 primary data records. [2025-10-24T00:51:42.186480] [DEBUG] [MAIN ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:42.260000] [DEBUG] [MAIN ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:42.313807] [INFO ] [MAIN ] LND: Generated 139 derivative records from 4995 primary records. [2025-10-24T00:51:42.316762] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-24T00:51:42.333184] [DEBUG] [MAIN ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:42.330301] [FATAL] [LOCAL ] LND: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:42.350611] [FATAL] [MAIN ] LND: Failed to save derivative data. [2025-10-24T00:51:42.357711] [INFO ] [MAIN ] Derivative Progress: 1156/2164 symbols completed. LND took 1.4s. Estimated remaining: 6m 47s. Rate: 148.5 symbols/min [2025-10-24T00:51:42.366331] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:42.379062] [INFO ] [MAIN ] LNN: Generated 139 derivative records from 11727 primary records. [2025-10-24T00:51:42.382673] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-24T00:51:42.383271] [FATAL] [LOCAL ] LNN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:42.383861] [FATAL] [MAIN ] LNN: Failed to save derivative data. [2025-10-24T00:51:42.387823] [INFO ] [MAIN ] Derivative Progress: 1157/2164 symbols completed. LNN took 1.4s. Estimated remaining: 6m 47s. Rate: 148.6 symbols/min [2025-10-24T00:51:42.391440] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:42.396582] [INFO ] [MAIN ] LNG: Generated 139 derivative records from 51448 primary records. [2025-10-24T00:51:42.396925] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-24T00:51:42.397188] [FATAL] [LOCAL ] LNG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:42.397276] [FATAL] [MAIN ] LNG: Failed to save derivative data. [2025-10-24T00:51:42.400466] [INFO ] [MAIN ] Derivative Progress: 1158/2164 symbols completed. LNG took 1.4s. Estimated remaining: 6m 46s. Rate: 148.7 symbols/min [2025-10-24T00:51:42.400897] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:42.418335] [DEBUG] [LOCAL ] LOCL: Loaded 3523 existing records from primary storage. [2025-10-24T00:51:42.418691] [INFO ] [MAIN ] LOCL: Loaded 3523 primary data records. [2025-10-24T00:51:42.514227] [DEBUG] [LOCAL ] LOAR: Loaded 42355 existing records from primary storage. [2025-10-24T00:51:42.535057] [INFO ] [MAIN ] LOAR: Loaded 42355 primary data records. [2025-10-24T00:51:42.621674] [DEBUG] [LOCAL ] LOB: Loaded 26868 existing records from primary storage. [2025-10-24T00:51:42.664634] [INFO ] [MAIN ] LOB: Loaded 26868 primary data records. [2025-10-24T00:51:43.464173] [DEBUG] [MAIN ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:43.502173] [DEBUG] [MAIN ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:43.535968] [DEBUG] [MAIN ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:43.599117] [INFO ] [MAIN ] LOCL: Generated 139 derivative records from 3523 primary records. [2025-10-24T00:51:43.601227] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-24T00:51:43.601670] [FATAL] [LOCAL ] LOCL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:43.606700] [FATAL] [MAIN ] LOCL: Failed to save derivative data. [2025-10-24T00:51:43.606584] [INFO ] [MAIN ] LOAR: Generated 139 derivative records from 42355 primary records. [2025-10-24T00:51:43.608788] [INFO ] [MAIN ] Derivative Progress: 1159/2164 symbols completed. LOCL took 1.2s. Estimated remaining: 6m 46s. Rate: 148.5 symbols/min [2025-10-24T00:51:43.609537] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-24T00:51:43.610046] [FATAL] [LOCAL ] LOAR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:43.610187] [FATAL] [MAIN ] LOAR: Failed to save derivative data. [2025-10-24T00:51:43.613084] [INFO ] [MAIN ] Derivative Progress: 1160/2164 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 45s. Rate: 148.6 symbols/min [2025-10-24T00:51:43.609444] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:43.615432] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:43.624299] [INFO ] [MAIN ] LOB: Generated 139 derivative records from 26868 primary records. [2025-10-24T00:51:43.624571] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-24T00:51:43.624812] [FATAL] [LOCAL ] LOB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:43.624891] [FATAL] [MAIN ] LOB: Failed to save derivative data. [2025-10-24T00:51:43.627782] [INFO ] [MAIN ] Derivative Progress: 1161/2164 symbols completed. LOB took 1.2s. Estimated remaining: 6m 45s. Rate: 148.7 symbols/min [2025-10-24T00:51:43.628017] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:43.659518] [DEBUG] [LOCAL ] LOMA: Loaded 33036 existing records from primary storage. [2025-10-24T00:51:43.659839] [INFO ] [MAIN ] LOMA: Loaded 33036 primary data records. [2025-10-24T00:51:43.820463] [DEBUG] [LOCAL ] LPG: Loaded 39472 existing records from primary storage. [2025-10-24T00:51:43.831949] [DEBUG] [LOCAL ] LOW: Loaded 53351 existing records from primary storage. [2025-10-24T00:51:43.857771] [INFO ] [MAIN ] LOW: Loaded 53351 primary data records. [2025-10-24T00:51:43.866394] [INFO ] [MAIN ] LPG: Loaded 39472 primary data records. [2025-10-24T00:51:44.647593] [DEBUG] [MAIN ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:44.698231] [DEBUG] [MAIN ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:44.735591] [DEBUG] [MAIN ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:44.774580] [INFO ] [MAIN ] LOMA: Generated 139 derivative records from 33036 primary records. [2025-10-24T00:51:44.778327] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-24T00:51:44.779201] [FATAL] [LOCAL ] LOMA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:44.779408] [FATAL] [MAIN ] LOMA: Failed to save derivative data. [2025-10-24T00:51:44.785409] [INFO ] [MAIN ] Derivative Progress: 1162/2164 symbols completed. LOMA took 1.2s. Estimated remaining: 6m 45s. Rate: 148.5 symbols/min [2025-10-24T00:51:44.791761] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:44.796998] [INFO ] [MAIN ] LOW: Generated 139 derivative records from 53351 primary records. [2025-10-24T00:51:44.800593] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-24T00:51:44.801455] [FATAL] [LOCAL ] LOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:44.803084] [FATAL] [MAIN ] LOW: Failed to save derivative data. [2025-10-24T00:51:44.805131] [INFO ] [MAIN ] LPG: Generated 139 derivative records from 39472 primary records. [2025-10-24T00:51:44.808197] [INFO ] [MAIN ] Derivative Progress: 1163/2164 symbols completed. LOW took 1.2s. Estimated remaining: 6m 44s. Rate: 148.6 symbols/min [2025-10-24T00:51:44.808494] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-24T00:51:44.809123] [FATAL] [LOCAL ] LPG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:44.808629] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:44.809591] [FATAL] [MAIN ] LPG: Failed to save derivative data. [2025-10-24T00:51:44.812930] [INFO ] [MAIN ] Derivative Progress: 1164/2164 symbols completed. LPG took 1.2s. Estimated remaining: 6m 43s. Rate: 148.7 symbols/min [2025-10-24T00:51:44.813197] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:44.836511] [DEBUG] [LOCAL ] LPL: Loaded 29271 existing records from primary storage. [2025-10-24T00:51:44.836999] [INFO ] [MAIN ] LPL: Loaded 29271 primary data records. [2025-10-24T00:51:45.029589] [DEBUG] [LOCAL ] LPX: Loaded 40357 existing records from primary storage. [2025-10-24T00:51:45.200222] [INFO ] [MAIN ] LPX: Loaded 40357 primary data records. [2025-10-24T00:51:45.266379] [DEBUG] [LOCAL ] LRN: Loaded 39569 existing records from primary storage. [2025-10-24T00:51:45.290768] [INFO ] [MAIN ] LRN: Loaded 39569 primary data records. [2025-10-24T00:51:45.853618] [DEBUG] [MAIN ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:45.896338] [DEBUG] [MAIN ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:45.933466] [DEBUG] [MAIN ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:45.963927] [INFO ] [MAIN ] LPL: Generated 139 derivative records from 29271 primary records. [2025-10-24T00:51:45.967034] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-24T00:51:45.969929] [FATAL] [LOCAL ] LPL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:45.970942] [FATAL] [MAIN ] LPL: Failed to save derivative data. [2025-10-24T00:51:45.974622] [INFO ] [MAIN ] Derivative Progress: 1165/2164 symbols completed. LPL took 1.2s. Estimated remaining: 6m 44s. Rate: 148.5 symbols/min [2025-10-24T00:51:45.974876] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:45.985826] [INFO ] [MAIN ] LPX: Generated 139 derivative records from 40357 primary records. [2025-10-24T00:51:45.988797] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-24T00:51:45.989828] [FATAL] [LOCAL ] LPX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:45.990310] [FATAL] [MAIN ] LPX: Failed to save derivative data. [2025-10-24T00:51:45.994787] [INFO ] [MAIN ] Derivative Progress: 1166/2164 symbols completed. LPX took 1.2s. Estimated remaining: 6m 43s. Rate: 148.6 symbols/min [2025-10-24T00:51:45.995249] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:46.000493] [INFO ] [MAIN ] LRN: Generated 139 derivative records from 39569 primary records. [2025-10-24T00:51:46.000721] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-24T00:51:46.001027] [FATAL] [LOCAL ] LRN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:46.001122] [FATAL] [MAIN ] LRN: Failed to save derivative data. [2025-10-24T00:51:46.004226] [INFO ] [MAIN ] Derivative Progress: 1167/2164 symbols completed. LRN took 1.2s. Estimated remaining: 6m 42s. Rate: 148.7 symbols/min [2025-10-24T00:51:46.004569] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:46.039888] [DEBUG] [LOCAL ] LSPD: Loaded 42619 existing records from primary storage. [2025-10-24T00:51:46.040101] [INFO ] [MAIN ] LSPD: Loaded 42619 primary data records. [2025-10-24T00:51:46.129023] [DEBUG] [LOCAL ] LTC: Loaded 30851 existing records from primary storage. [2025-10-24T00:51:46.170227] [INFO ] [MAIN ] LTC: Loaded 30851 primary data records. [2025-10-24T00:51:46.488266] [DEBUG] [LOCAL ] LTH: Loaded 51990 existing records from primary storage. [2025-10-24T00:51:46.523293] [INFO ] [MAIN ] LTH: Loaded 51990 primary data records. [2025-10-24T00:51:47.082592] [DEBUG] [MAIN ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:47.114539] [DEBUG] [MAIN ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:47.163749] [DEBUG] [MAIN ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:47.222579] [INFO ] [MAIN ] LSPD: Generated 139 derivative records from 42619 primary records. [2025-10-24T00:51:47.229979] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-24T00:51:47.231563] [FATAL] [LOCAL ] LSPD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:47.229299] [INFO ] [MAIN ] LTC: Generated 139 derivative records from 30851 primary records. [2025-10-24T00:51:47.231927] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-24T00:51:47.232060] [FATAL] [MAIN ] LSPD: Failed to save derivative data. [2025-10-24T00:51:47.234847] [INFO ] [MAIN ] Derivative Progress: 1168/2164 symbols completed. LSPD took 1.3s. Estimated remaining: 6m 42s. Rate: 148.5 symbols/min [2025-10-24T00:51:47.235475] [FATAL] [LOCAL ] LTC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:47.236258] [FATAL] [MAIN ] LTC: Failed to save derivative data. [2025-10-24T00:51:47.238960] [INFO ] [MAIN ] Derivative Progress: 1169/2164 symbols completed. LTC took 1.2s. Estimated remaining: 6m 42s. Rate: 148.6 symbols/min [2025-10-24T00:51:47.244369] [INFO ] [MAIN ] LTH: Generated 139 derivative records from 51990 primary records. [2025-10-24T00:51:47.244478] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-24T00:51:47.244724] [FATAL] [LOCAL ] LTH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:47.244803] [FATAL] [MAIN ] LTH: Failed to save derivative data. [2025-10-24T00:51:47.248769] [INFO ] [MAIN ] Derivative Progress: 1170/2164 symbols completed. LTH took 1.2s. Estimated remaining: 6m 41s. Rate: 148.7 symbols/min [2025-10-24T00:51:47.249207] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:47.249337] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:47.249411] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:47.286527] [DEBUG] [LOCAL ] LUCK: Loaded 23995 existing records from primary storage. [2025-10-24T00:51:47.286766] [INFO ] [MAIN ] LUCK: Loaded 23995 primary data records. [2025-10-24T00:51:47.427745] [DEBUG] [LOCAL ] LTM: Loaded 39574 existing records from primary storage. [2025-10-24T00:51:47.434316] [INFO ] [MAIN ] LTM: Loaded 39574 primary data records. [2025-10-24T00:51:47.428477] [DEBUG] [LOCAL ] LU: Loaded 49548 existing records from primary storage. [2025-10-24T00:51:47.480761] [INFO ] [MAIN ] LU: Loaded 49548 primary data records. [2025-10-24T00:51:48.259884] [DEBUG] [MAIN ] LUCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:48.302109] [DEBUG] [MAIN ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:48.337833] [DEBUG] [MAIN ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:48.363526] [INFO ] [MAIN ] LUCK: Generated 139 derivative records from 23995 primary records. [2025-10-24T00:51:48.365571] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-24T00:51:48.370717] [FATAL] [LOCAL ] LUCK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:48.371539] [FATAL] [MAIN ] LUCK: Failed to save derivative data. [2025-10-24T00:51:48.375062] [INFO ] [MAIN ] Derivative Progress: 1171/2164 symbols completed. LUCK took 1.1s. Estimated remaining: 6m 41s. Rate: 148.5 symbols/min [2025-10-24T00:51:48.376191] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:48.400255] [INFO ] [MAIN ] LTM: Generated 139 derivative records from 39574 primary records. [2025-10-24T00:51:48.400867] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-24T00:51:48.400454] [INFO ] [MAIN ] LU: Generated 139 derivative records from 49548 primary records. [2025-10-24T00:51:48.401345] [FATAL] [LOCAL ] LTM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:48.401507] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-24T00:51:48.401451] [FATAL] [MAIN ] LTM: Failed to save derivative data. [2025-10-24T00:51:48.404217] [INFO ] [MAIN ] Derivative Progress: 1172/2164 symbols completed. LTM took 1.2s. Estimated remaining: 6m 40s. Rate: 148.6 symbols/min [2025-10-24T00:51:48.404370] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:48.404898] [FATAL] [LOCAL ] LU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:48.405015] [FATAL] [MAIN ] LU: Failed to save derivative data. [2025-10-24T00:51:48.408274] [INFO ] [MAIN ] Derivative Progress: 1173/2164 symbols completed. LU took 1.2s. Estimated remaining: 6m 40s. Rate: 148.8 symbols/min [2025-10-24T00:51:48.408526] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:48.446981] [DEBUG] [LOCAL ] LUMN: Loaded 54035 existing records from primary storage. [2025-10-24T00:51:48.447370] [INFO ] [MAIN ] LUMN: Loaded 54035 primary data records. [2025-10-24T00:51:48.691631] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-24T00:51:48.690396] [DEBUG] [LOCAL ] LVS: Loaded 53959 existing records from primary storage. [2025-10-24T00:51:48.807728] [INFO ] [MAIN ] LUV: Loaded 54079 primary data records. [2025-10-24T00:51:48.807848] [INFO ] [MAIN ] LVS: Loaded 53959 primary data records. [2025-10-24T00:51:49.460916] [DEBUG] [MAIN ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:49.522106] [DEBUG] [MAIN ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:49.521847] [DEBUG] [MAIN ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:49.552452] [INFO ] [MAIN ] LUMN: Generated 139 derivative records from 54035 primary records. [2025-10-24T00:51:49.554907] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-24T00:51:49.560744] [FATAL] [LOCAL ] LUMN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:49.561997] [FATAL] [MAIN ] LUMN: Failed to save derivative data. [2025-10-24T00:51:49.565960] [INFO ] [MAIN ] Derivative Progress: 1174/2164 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 40s. Rate: 148.5 symbols/min [2025-10-24T00:51:49.566635] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:49.598171] [INFO ] [MAIN ] LUV: Generated 139 derivative records from 54079 primary records. [2025-10-24T00:51:49.605125] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-24T00:51:49.605745] [FATAL] [LOCAL ] LUV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:49.605494] [DEBUG] [LOCAL ] LVWR: Loaded 18696 existing records from primary storage. [2025-10-24T00:51:49.606162] [FATAL] [MAIN ] LUV: Failed to save derivative data. [2025-10-24T00:51:49.609282] [INFO ] [MAIN ] Derivative Progress: 1175/2164 symbols completed. LUV took 1.2s. Estimated remaining: 6m 39s. Rate: 148.6 symbols/min [2025-10-24T00:51:49.606228] [INFO ] [MAIN ] LVWR: Loaded 18696 primary data records. [2025-10-24T00:51:49.609540] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:49.623354] [INFO ] [MAIN ] LVS: Generated 139 derivative records from 53959 primary records. [2025-10-24T00:51:49.633198] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-24T00:51:49.667637] [FATAL] [LOCAL ] LVS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:49.667843] [FATAL] [MAIN ] LVS: Failed to save derivative data. [2025-10-24T00:51:49.681186] [INFO ] [MAIN ] Derivative Progress: 1176/2164 symbols completed. LVS took 1.3s. Estimated remaining: 6m 39s. Rate: 148.7 symbols/min [2025-10-24T00:51:49.717241] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:49.921230] [DEBUG] [LOCAL ] LXFR: Loaded 16511 existing records from primary storage. [2025-10-24T00:51:49.921397] [INFO ] [MAIN ] LXFR: Loaded 16511 primary data records. [2025-10-24T00:51:50.056476] [DEBUG] [LOCAL ] LW: Loaded 51535 existing records from primary storage. [2025-10-24T00:51:50.072752] [INFO ] [MAIN ] LW: Loaded 51535 primary data records. [2025-10-24T00:51:50.596245] [DEBUG] [MAIN ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:50.643747] [DEBUG] [MAIN ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:50.685460] [DEBUG] [MAIN ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:50.714179] [INFO ] [MAIN ] LVWR: Generated 139 derivative records from 18696 primary records. [2025-10-24T00:51:50.716410] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-24T00:51:50.716876] [FATAL] [LOCAL ] LVWR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:50.716985] [FATAL] [MAIN ] LVWR: Failed to save derivative data. [2025-10-24T00:51:50.723725] [INFO ] [MAIN ] Derivative Progress: 1177/2164 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 39s. Rate: 148.5 symbols/min [2025-10-24T00:51:50.724072] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:50.748492] [INFO ] [MAIN ] LXFR: Generated 139 derivative records from 16511 primary records. [2025-10-24T00:51:50.748772] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-24T00:51:50.749400] [FATAL] [LOCAL ] LXFR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:50.752411] [FATAL] [MAIN ] LXFR: Failed to save derivative data. [2025-10-24T00:51:50.755746] [INFO ] [MAIN ] Derivative Progress: 1178/2164 symbols completed. LXFR took 1.0s. Estimated remaining: 6m 38s. Rate: 148.6 symbols/min [2025-10-24T00:51:50.758100] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:50.760508] [INFO ] [MAIN ] LW: Generated 139 derivative records from 51535 primary records. [2025-10-24T00:51:50.761105] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-24T00:51:50.761337] [FATAL] [LOCAL ] LW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:50.761435] [FATAL] [MAIN ] LW: Failed to save derivative data. [2025-10-24T00:51:50.765046] [INFO ] [MAIN ] Derivative Progress: 1179/2164 symbols completed. LW took 1.2s. Estimated remaining: 6m 37s. Rate: 148.8 symbols/min [2025-10-24T00:51:50.765490] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:50.807766] [DEBUG] [LOCAL ] LXP: Loaded 51121 existing records from primary storage. [2025-10-24T00:51:50.807979] [INFO ] [MAIN ] LXP: Loaded 51121 primary data records. [2025-10-24T00:51:50.919712] [DEBUG] [LOCAL ] LXU: Loaded 31710 existing records from primary storage. [2025-10-24T00:51:50.935310] [INFO ] [MAIN ] LXU: Loaded 31710 primary data records. [2025-10-24T00:51:51.251151] [DEBUG] [LOCAL ] LYB: Loaded 54011 existing records from primary storage. [2025-10-24T00:51:51.309961] [INFO ] [MAIN ] LYB: Loaded 54011 primary data records. [2025-10-24T00:51:51.808565] [DEBUG] [MAIN ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:51.835077] [DEBUG] [MAIN ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:51.886148] [DEBUG] [MAIN ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:51.925515] [INFO ] [MAIN ] LXP: Generated 139 derivative records from 51121 primary records. [2025-10-24T00:51:51.925922] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-24T00:51:51.926768] [FATAL] [LOCAL ] LXP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:51.928303] [FATAL] [MAIN ] LXP: Failed to save derivative data. [2025-10-24T00:51:51.940269] [INFO ] [MAIN ] Derivative Progress: 1180/2164 symbols completed. LXP took 1.2s. Estimated remaining: 6m 37s. Rate: 148.5 symbols/min [2025-10-24T00:51:51.942112] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:51.951190] [INFO ] [MAIN ] LXU: Generated 139 derivative records from 31710 primary records. [2025-10-24T00:51:51.952878] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-24T00:51:51.955926] [FATAL] [LOCAL ] LXU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:51.956385] [FATAL] [MAIN ] LXU: Failed to save derivative data. [2025-10-24T00:51:51.959740] [INFO ] [MAIN ] Derivative Progress: 1181/2164 symbols completed. LXU took 1.2s. Estimated remaining: 6m 37s. Rate: 148.7 symbols/min [2025-10-24T00:51:51.960176] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:51.965260] [INFO ] [MAIN ] LYB: Generated 139 derivative records from 54011 primary records. [2025-10-24T00:51:51.965874] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-24T00:51:51.966125] [FATAL] [LOCAL ] LYB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:51.966208] [FATAL] [MAIN ] LYB: Failed to save derivative data. [2025-10-24T00:51:51.969534] [INFO ] [MAIN ] Derivative Progress: 1182/2164 symbols completed. LYB took 1.2s. Estimated remaining: 6m 36s. Rate: 148.8 symbols/min [2025-10-24T00:51:51.969947] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:52.025506] [DEBUG] [LOCAL ] LYG: Loaded 53036 existing records from primary storage. [2025-10-24T00:51:52.037077] [INFO ] [MAIN ] LYG: Loaded 53036 primary data records. [2025-10-24T00:51:52.161393] [DEBUG] [LOCAL ] LZB: Loaded 35281 existing records from primary storage. [2025-10-24T00:51:52.180839] [INFO ] [MAIN ] LZB: Loaded 35281 primary data records. [2025-10-24T00:51:52.192662] [DEBUG] [LOCAL ] LYV: Loaded 51383 existing records from primary storage. [2025-10-24T00:51:52.203483] [INFO ] [MAIN ] LYV: Loaded 51383 primary data records. [2025-10-24T00:51:53.044949] [DEBUG] [MAIN ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:53.157345] [DEBUG] [MAIN ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:53.160604] [DEBUG] [MAIN ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:53.233628] [INFO ] [MAIN ] LYG: Generated 139 derivative records from 53036 primary records. [2025-10-24T00:51:53.239591] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-24T00:51:53.241411] [FATAL] [LOCAL ] LYG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:53.245077] [FATAL] [MAIN ] LYG: Failed to save derivative data. [2025-10-24T00:51:53.248059] [INFO ] [MAIN ] LYV: Generated 139 derivative records from 51383 primary records. [2025-10-24T00:51:53.250086] [INFO ] [MAIN ] Derivative Progress: 1183/2164 symbols completed. LYG took 1.3s. Estimated remaining: 6m 36s. Rate: 148.5 symbols/min [2025-10-24T00:51:53.251521] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-24T00:51:53.251949] [FATAL] [LOCAL ] LYV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:53.252054] [FATAL] [MAIN ] LYV: Failed to save derivative data. [2025-10-24T00:51:53.255451] [INFO ] [MAIN ] Derivative Progress: 1184/2164 symbols completed. LYV took 1.3s. Estimated remaining: 6m 36s. Rate: 148.6 symbols/min [2025-10-24T00:51:53.257182] [INFO ] [MAIN ] LZB: Generated 139 derivative records from 35281 primary records. [2025-10-24T00:51:53.257267] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-24T00:51:53.257464] [FATAL] [LOCAL ] LZB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:53.257541] [FATAL] [MAIN ] LZB: Failed to save derivative data. [2025-10-24T00:51:53.260796] [INFO ] [MAIN ] Derivative Progress: 1185/2164 symbols completed. LZB took 1.3s. Estimated remaining: 6m 35s. Rate: 148.7 symbols/min [2025-10-24T00:51:53.261357] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:53.261493] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:53.261615] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:53.279334] [DEBUG] [LOCAL ] LZM: Loaded 14964 existing records from primary storage. [2025-10-24T00:51:53.279475] [INFO ] [MAIN ] LZM: Loaded 14964 primary data records. [2025-10-24T00:51:53.619083] [DEBUG] [LOCAL ] M: Loaded 53934 existing records from primary storage. [2025-10-24T00:51:53.620431] [INFO ] [MAIN ] M: Loaded 53934 primary data records. [2025-10-24T00:51:53.719101] [DEBUG] [LOCAL ] MA: Loaded 52828 existing records from primary storage. [2025-10-24T00:51:53.742150] [INFO ] [MAIN ] MA: Loaded 52828 primary data records. [2025-10-24T00:51:54.268839] [DEBUG] [MAIN ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:54.314593] [DEBUG] [MAIN ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:54.362058] [DEBUG] [MAIN ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:54.389347] [INFO ] [MAIN ] LZM: Generated 139 derivative records from 14964 primary records. [2025-10-24T00:51:54.392799] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-24T00:51:54.396037] [FATAL] [LOCAL ] LZM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:54.397623] [FATAL] [MAIN ] LZM: Failed to save derivative data. [2025-10-24T00:51:54.400774] [INFO ] [MAIN ] Derivative Progress: 1186/2164 symbols completed. LZM took 1.1s. Estimated remaining: 6m 35s. Rate: 148.5 symbols/min [2025-10-24T00:51:54.400940] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:54.414402] [INFO ] [MAIN ] M: Generated 139 derivative records from 53934 primary records. [2025-10-24T00:51:54.415063] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-24T00:51:54.415342] [FATAL] [LOCAL ] M: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:54.415822] [FATAL] [MAIN ] M: Failed to save derivative data. [2025-10-24T00:51:54.417894] [INFO ] [MAIN ] Derivative Progress: 1187/2164 symbols completed. M took 1.2s. Estimated remaining: 6m 34s. Rate: 148.6 symbols/min [2025-10-24T00:51:54.420495] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:54.428308] [INFO ] [MAIN ] MA: Generated 139 derivative records from 52828 primary records. [2025-10-24T00:51:54.428536] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-24T00:51:54.428774] [FATAL] [LOCAL ] MA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:54.428853] [FATAL] [MAIN ] MA: Failed to save derivative data. [2025-10-24T00:51:54.431853] [INFO ] [MAIN ] Derivative Progress: 1188/2164 symbols completed. MA took 1.2s. Estimated remaining: 6m 34s. Rate: 148.8 symbols/min [2025-10-24T00:51:54.432079] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:54.464245] [DEBUG] [LOCAL ] MAA: Loaded 43322 existing records from primary storage. [2025-10-24T00:51:54.464480] [INFO ] [MAIN ] MAA: Loaded 43322 primary data records. [2025-10-24T00:51:54.615108] [DEBUG] [LOCAL ] MAGN: Loaded 36410 existing records from primary storage. [2025-10-24T00:51:54.656260] [INFO ] [MAIN ] MAGN: Loaded 36410 primary data records. [2025-10-24T00:51:54.709565] [DEBUG] [LOCAL ] MAC: Loaded 49975 existing records from primary storage. [2025-10-24T00:51:54.874771] [INFO ] [MAIN ] MAC: Loaded 49975 primary data records. [2025-10-24T00:51:55.522018] [DEBUG] [MAIN ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:55.561836] [DEBUG] [MAIN ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:55.602585] [DEBUG] [MAIN ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:55.632074] [INFO ] [MAIN ] MAA: Generated 139 derivative records from 43322 primary records. [2025-10-24T00:51:55.632850] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-24T00:51:55.636167] [FATAL] [LOCAL ] MAA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:55.636678] [FATAL] [MAIN ] MAA: Failed to save derivative data. [2025-10-24T00:51:55.642140] [INFO ] [MAIN ] Derivative Progress: 1189/2164 symbols completed. MAA took 1.2s. Estimated remaining: 6m 34s. Rate: 148.5 symbols/min [2025-10-24T00:51:55.644972] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:55.666209] [INFO ] [MAIN ] MAGN: Generated 139 derivative records from 36410 primary records. [2025-10-24T00:51:55.666842] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-24T00:51:55.669366] [FATAL] [LOCAL ] MAGN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:55.669918] [FATAL] [MAIN ] MAGN: Failed to save derivative data. [2025-10-24T00:51:55.672908] [INFO ] [MAIN ] Derivative Progress: 1190/2164 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 33s. Rate: 148.6 symbols/min [2025-10-24T00:51:55.673105] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:55.686534] [INFO ] [MAIN ] MAC: Generated 139 derivative records from 49975 primary records. [2025-10-24T00:51:55.686883] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-24T00:51:55.687093] [FATAL] [LOCAL ] MAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:55.687293] [FATAL] [MAIN ] MAC: Failed to save derivative data. [2025-10-24T00:51:55.690796] [INFO ] [MAIN ] Derivative Progress: 1191/2164 symbols completed. MAC took 1.3s. Estimated remaining: 6m 32s. Rate: 148.7 symbols/min [2025-10-24T00:51:55.691157] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:55.706455] [DEBUG] [LOCAL ] MAIN: Loaded 42219 existing records from primary storage. [2025-10-24T00:51:55.706845] [INFO ] [MAIN ] MAIN: Loaded 42219 primary data records. [2025-10-24T00:51:55.893873] [DEBUG] [LOCAL ] MANU: Loaded 27359 existing records from primary storage. [2025-10-24T00:51:56.041880] [DEBUG] [LOCAL ] MAN: Loaded 44638 existing records from primary storage. [2025-10-24T00:51:56.042172] [INFO ] [MAIN ] MAN: Loaded 44638 primary data records. [2025-10-24T00:51:56.041996] [INFO ] [MAIN ] MANU: Loaded 27359 primary data records. [2025-10-24T00:51:56.668535] [DEBUG] [MAIN ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:56.740461] [INFO ] [MAIN ] MAIN: Generated 139 derivative records from 42219 primary records. [2025-10-24T00:51:56.742200] [DEBUG] [MAIN ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:56.743678] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-24T00:51:56.754215] [FATAL] [LOCAL ] MAIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:56.742562] [DEBUG] [MAIN ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:56.755215] [FATAL] [MAIN ] MAIN: Failed to save derivative data. [2025-10-24T00:51:56.775859] [INFO ] [MAIN ] Derivative Progress: 1192/2164 symbols completed. MAIN took 1.1s. Estimated remaining: 6m 33s. Rate: 148.5 symbols/min [2025-10-24T00:51:56.778718] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:56.818597] [INFO ] [MAIN ] MANU: Generated 139 derivative records from 27359 primary records. [2025-10-24T00:51:56.818407] [INFO ] [MAIN ] MAN: Generated 139 derivative records from 44638 primary records. [2025-10-24T00:51:56.819243] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-24T00:51:56.819346] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-24T00:51:56.819607] [FATAL] [LOCAL ] MANU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:56.833931] [FATAL] [LOCAL ] MAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:56.834147] [FATAL] [MAIN ] MAN: Failed to save derivative data. [2025-10-24T00:51:56.836631] [INFO ] [MAIN ] Derivative Progress: 1193/2164 symbols completed. MAN took 1.2s. Estimated remaining: 6m 32s. Rate: 148.6 symbols/min [2025-10-24T00:51:56.836883] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:56.833385] [FATAL] [MAIN ] MANU: Failed to save derivative data. [2025-10-24T00:51:56.841174] [INFO ] [MAIN ] Derivative Progress: 1194/2164 symbols completed. MANU took 1.2s. Estimated remaining: 6m 31s. Rate: 148.8 symbols/min [2025-10-24T00:51:56.841443] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:56.872544] [DEBUG] [LOCAL ] MAS: Loaded 52573 existing records from primary storage. [2025-10-24T00:51:56.873285] [INFO ] [MAIN ] MAS: Loaded 52573 primary data records. [2025-10-24T00:51:57.020094] [DEBUG] [LOCAL ] MATV: Loaded 35246 existing records from primary storage. [2025-10-24T00:51:57.062527] [INFO ] [MAIN ] MATV: Loaded 35246 primary data records. [2025-10-24T00:51:57.105024] [DEBUG] [LOCAL ] MATX: Loaded 32093 existing records from primary storage. [2025-10-24T00:51:57.269639] [INFO ] [MAIN ] MATX: Loaded 32093 primary data records. [2025-10-24T00:51:57.912507] [DEBUG] [MAIN ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:57.955319] [DEBUG] [MAIN ] MATV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:57.980871] [DEBUG] [MAIN ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:58.030329] [INFO ] [MAIN ] MAS: Generated 139 derivative records from 52573 primary records. [2025-10-24T00:51:58.033189] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-24T00:51:58.033496] [FATAL] [LOCAL ] MAS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:58.033931] [FATAL] [MAIN ] MAS: Failed to save derivative data. [2025-10-24T00:51:58.035902] [INFO ] [MAIN ] Derivative Progress: 1195/2164 symbols completed. MAS took 1.3s. Estimated remaining: 6m 31s. Rate: 148.5 symbols/min [2025-10-24T00:51:58.040099] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:58.057889] [INFO ] [MAIN ] MATV: Generated 139 derivative records from 35246 primary records. [2025-10-24T00:51:58.060135] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-24T00:51:58.060028] [INFO ] [MAIN ] MATX: Generated 139 derivative records from 32093 primary records. [2025-10-24T00:51:58.060439] [FATAL] [LOCAL ] MATV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:58.060600] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-24T00:51:58.060805] [FATAL] [MAIN ] MATV: Failed to save derivative data. [2025-10-24T00:51:58.064028] [INFO ] [MAIN ] Derivative Progress: 1196/2164 symbols completed. MATV took 1.2s. Estimated remaining: 6m 31s. Rate: 148.6 symbols/min [2025-10-24T00:51:58.064213] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:58.061054] [FATAL] [LOCAL ] MATX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:58.064521] [FATAL] [MAIN ] MATX: Failed to save derivative data. [2025-10-24T00:51:58.067949] [INFO ] [MAIN ] Derivative Progress: 1197/2164 symbols completed. MATX took 1.2s. Estimated remaining: 6m 30s. Rate: 148.8 symbols/min [2025-10-24T00:51:58.068207] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:58.099829] [DEBUG] [LOCAL ] MAX: Loaded 30905 existing records from primary storage. [2025-10-24T00:51:58.100210] [INFO ] [MAIN ] MAX: Loaded 30905 primary data records. [2025-10-24T00:51:58.197263] [DEBUG] [LOCAL ] MBI: Loaded 24075 existing records from primary storage. [2025-10-24T00:51:58.220414] [INFO ] [MAIN ] MBI: Loaded 24075 primary data records. [2025-10-24T00:51:58.383358] [DEBUG] [LOCAL ] MBC: Loaded 44219 existing records from primary storage. [2025-10-24T00:51:58.424092] [INFO ] [MAIN ] MBC: Loaded 44219 primary data records. [2025-10-24T00:51:59.097954] [DEBUG] [MAIN ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:59.124142] [DEBUG] [MAIN ] MBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:59.171977] [DEBUG] [MAIN ] MBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:51:59.224923] [INFO ] [MAIN ] MAX: Generated 139 derivative records from 30905 primary records. [2025-10-24T00:51:59.227076] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-24T00:51:59.227342] [INFO ] [MAIN ] MBI: Generated 139 derivative records from 24075 primary records. [2025-10-24T00:51:59.227577] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-24T00:51:59.227915] [FATAL] [LOCAL ] MAX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:59.228212] [FATAL] [MAIN ] MAX: Failed to save derivative data. [2025-10-24T00:51:59.228574] [FATAL] [LOCAL ] MBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:59.233567] [INFO ] [MAIN ] Derivative Progress: 1198/2164 symbols completed. MAX took 1.2s. Estimated remaining: 6m 30s. Rate: 148.5 symbols/min [2025-10-24T00:51:59.230153] [FATAL] [MAIN ] MBI: Failed to save derivative data. [2025-10-24T00:51:59.236391] [INFO ] [MAIN ] Derivative Progress: 1199/2164 symbols completed. MBI took 1.2s. Estimated remaining: 6m 30s. Rate: 148.6 symbols/min [2025-10-24T00:51:59.241892] [INFO ] [MAIN ] MBC: Generated 139 derivative records from 44219 primary records. [2025-10-24T00:51:59.242057] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-24T00:51:59.242263] [FATAL] [LOCAL ] MBC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:51:59.242340] [FATAL] [MAIN ] MBC: Failed to save derivative data. [2025-10-24T00:51:59.245434] [INFO ] [MAIN ] Derivative Progress: 1200/2164 symbols completed. MBC took 1.2s. Estimated remaining: 6m 29s. Rate: 148.8 symbols/min [2025-10-24T00:51:59.245880] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:59.246094] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:59.246011] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:51:59.259783] [DEBUG] [LOCAL ] MCI: Loaded 6219 existing records from primary storage. [2025-10-24T00:51:59.260062] [INFO ] [MAIN ] MCI: Loaded 6219 primary data records. [2025-10-24T00:51:59.300505] [DEBUG] [LOCAL ] MCB: Loaded 11348 existing records from primary storage. [2025-10-24T00:51:59.339573] [INFO ] [MAIN ] MCB: Loaded 11348 primary data records. [2025-10-24T00:51:59.747743] [DEBUG] [LOCAL ] MC: Loaded 43947 existing records from primary storage. [2025-10-24T00:51:59.895824] [INFO ] [MAIN ] MC: Loaded 43947 primary data records. [2025-10-24T00:52:00.258056] [DEBUG] [MAIN ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:00.262430] [DEBUG] [MAIN ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:00.331073] [DEBUG] [MAIN ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:00.371324] [INFO ] [MAIN ] MCB: Generated 139 derivative records from 11348 primary records. [2025-10-24T00:52:00.373077] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-24T00:52:00.374810] [FATAL] [LOCAL ] MCB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:00.375145] [FATAL] [MAIN ] MCB: Failed to save derivative data. [2025-10-24T00:52:00.380493] [INFO ] [MAIN ] Derivative Progress: 1201/2164 symbols completed. MCB took 1.1s. Estimated remaining: 6m 29s. Rate: 148.5 symbols/min [2025-10-24T00:52:00.383039] [INFO ] [MAIN ] MCI: Generated 139 derivative records from 6219 primary records. [2025-10-24T00:52:00.383718] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-24T00:52:00.383382] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:00.384175] [FATAL] [LOCAL ] MCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:00.384286] [FATAL] [MAIN ] MCI: Failed to save derivative data. [2025-10-24T00:52:00.387254] [INFO ] [MAIN ] Derivative Progress: 1202/2164 symbols completed. MCI took 1.1s. Estimated remaining: 6m 28s. Rate: 148.7 symbols/min [2025-10-24T00:52:00.388811] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:00.395913] [INFO ] [MAIN ] MC: Generated 139 derivative records from 43947 primary records. [2025-10-24T00:52:00.398291] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-24T00:52:00.398718] [FATAL] [LOCAL ] MC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:00.399032] [FATAL] [MAIN ] MC: Failed to save derivative data. [2025-10-24T00:52:00.402249] [INFO ] [MAIN ] Derivative Progress: 1203/2164 symbols completed. MC took 1.2s. Estimated remaining: 6m 28s. Rate: 148.8 symbols/min [2025-10-24T00:52:00.402437] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:00.406790] [DEBUG] [LOCAL ] MCN: Loaded 8036 existing records from primary storage. [2025-10-24T00:52:00.406977] [INFO ] [MAIN ] MCN: Loaded 8036 primary data records. [2025-10-24T00:52:00.538223] [DEBUG] [LOCAL ] MCR: Loaded 8908 existing records from primary storage. [2025-10-24T00:52:00.544996] [INFO ] [MAIN ] MCR: Loaded 8908 primary data records. [2025-10-24T00:52:00.572659] [DEBUG] [LOCAL ] MCK: Loaded 38261 existing records from primary storage. [2025-10-24T00:52:00.618552] [INFO ] [MAIN ] MCK: Loaded 38261 primary data records. [2025-10-24T00:52:01.413377] [DEBUG] [MAIN ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:01.442333] [DEBUG] [MAIN ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:01.475908] [DEBUG] [MAIN ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:01.540631] [INFO ] [MAIN ] MCN: Generated 139 derivative records from 8036 primary records. [2025-10-24T00:52:01.546637] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-24T00:52:01.548466] [FATAL] [LOCAL ] MCN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:01.550187] [FATAL] [MAIN ] MCN: Failed to save derivative data. [2025-10-24T00:52:01.552481] [INFO ] [MAIN ] Derivative Progress: 1204/2164 symbols completed. MCN took 1.2s. Estimated remaining: 6m 28s. Rate: 148.6 symbols/min [2025-10-24T00:52:01.552776] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:01.559484] [INFO ] [MAIN ] MCR: Generated 139 derivative records from 8908 primary records. [2025-10-24T00:52:01.562407] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-24T00:52:01.563064] [FATAL] [LOCAL ] MCR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:01.563213] [FATAL] [MAIN ] MCR: Failed to save derivative data. [2025-10-24T00:52:01.566264] [INFO ] [MAIN ] Derivative Progress: 1205/2164 symbols completed. MCR took 1.2s. Estimated remaining: 6m 27s. Rate: 148.7 symbols/min [2025-10-24T00:52:01.566522] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:01.562585] [INFO ] [MAIN ] MCK: Generated 139 derivative records from 38261 primary records. [2025-10-24T00:52:01.567072] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-24T00:52:01.567321] [FATAL] [LOCAL ] MCK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:01.567443] [FATAL] [MAIN ] MCK: Failed to save derivative data. [2025-10-24T00:52:01.570703] [INFO ] [MAIN ] Derivative Progress: 1206/2164 symbols completed. MCK took 1.2s. Estimated remaining: 6m 26s. Rate: 148.8 symbols/min [2025-10-24T00:52:01.570974] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:01.590972] [DEBUG] [LOCAL ] MCS: Loaded 21310 existing records from primary storage. [2025-10-24T00:52:01.597733] [INFO ] [MAIN ] MCS: Loaded 21310 primary data records. [2025-10-24T00:52:01.698115] [DEBUG] [LOCAL ] MCY: Loaded 23681 existing records from primary storage. [2025-10-24T00:52:01.721887] [INFO ] [MAIN ] MCY: Loaded 23681 primary data records. [2025-10-24T00:52:01.822889] [DEBUG] [LOCAL ] MD: Loaded 38809 existing records from primary storage. [2025-10-24T00:52:01.865929] [INFO ] [MAIN ] MD: Loaded 38809 primary data records. [2025-10-24T00:52:02.578454] [DEBUG] [MAIN ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:02.614664] [DEBUG] [MAIN ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:02.660832] [DEBUG] [MAIN ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:02.695286] [INFO ] [MAIN ] MCS: Generated 139 derivative records from 21310 primary records. [2025-10-24T00:52:02.697130] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-24T00:52:02.700375] [FATAL] [LOCAL ] MCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:02.702910] [FATAL] [MAIN ] MCS: Failed to save derivative data. [2025-10-24T00:52:02.705559] [INFO ] [MAIN ] Derivative Progress: 1207/2164 symbols completed. MCS took 1.2s. Estimated remaining: 6m 26s. Rate: 148.6 symbols/min [2025-10-24T00:52:02.708127] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:02.713544] [INFO ] [MAIN ] MCY: Generated 139 derivative records from 23681 primary records. [2025-10-24T00:52:02.713692] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-24T00:52:02.714417] [FATAL] [LOCAL ] MCY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:02.714543] [FATAL] [MAIN ] MCY: Failed to save derivative data. [2025-10-24T00:52:02.719008] [INFO ] [MAIN ] Derivative Progress: 1208/2164 symbols completed. MCY took 1.2s. Estimated remaining: 6m 26s. Rate: 148.7 symbols/min [2025-10-24T00:52:02.723314] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:02.728467] [INFO ] [MAIN ] MD: Generated 139 derivative records from 38809 primary records. [2025-10-24T00:52:02.731770] [DEBUG] [LOCAL ] MDST: Loaded 6167 existing records from primary storage. [2025-10-24T00:52:02.731921] [INFO ] [MAIN ] MDST: Loaded 6167 primary data records. [2025-10-24T00:52:02.731868] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-24T00:52:02.768501] [FATAL] [LOCAL ] MD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:02.812760] [FATAL] [MAIN ] MD: Failed to save derivative data. [2025-10-24T00:52:02.832335] [INFO ] [MAIN ] Derivative Progress: 1209/2164 symbols completed. MD took 1.3s. Estimated remaining: 6m 25s. Rate: 148.8 symbols/min [2025-10-24T00:52:02.843720] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:03.073039] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-24T00:52:03.073668] [INFO ] [MAIN ] MDT: Loaded 54068 primary data records. [2025-10-24T00:52:03.305796] [DEBUG] [MAIN ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:03.270343] [DEBUG] [LOCAL ] MDU: Loaded 48379 existing records from primary storage. [2025-10-24T00:52:03.317202] [INFO ] [MAIN ] MDU: Loaded 48379 primary data records. [2025-10-24T00:52:03.833794] [DEBUG] [MAIN ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:03.832814] [INFO ] [MAIN ] MDST: Generated 139 derivative records from 6167 primary records. [2025-10-24T00:52:03.846669] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-24T00:52:03.850376] [FATAL] [LOCAL ] MDST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:03.851288] [FATAL] [MAIN ] MDST: Failed to save derivative data. [2025-10-24T00:52:03.856470] [INFO ] [MAIN ] Derivative Progress: 1210/2164 symbols completed. MDST took 1.1s. Estimated remaining: 6m 25s. Rate: 148.6 symbols/min [2025-10-24T00:52:03.858029] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:03.885341] [DEBUG] [MAIN ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:03.909081] [DEBUG] [LOCAL ] MDV: Loaded 8334 existing records from primary storage. [2025-10-24T00:52:03.911444] [INFO ] [MAIN ] MDV: Loaded 8334 primary data records. [2025-10-24T00:52:04.041317] [INFO ] [MAIN ] MDT: Generated 139 derivative records from 54068 primary records. [2025-10-24T00:52:04.106855] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-24T00:52:04.218380] [FATAL] [LOCAL ] MDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:04.232412] [FATAL] [MAIN ] MDT: Failed to save derivative data. [2025-10-24T00:52:04.235338] [INFO ] [MAIN ] Derivative Progress: 1211/2164 symbols completed. MDT took 1.5s. Estimated remaining: 6m 25s. Rate: 148.6 symbols/min [2025-10-24T00:52:04.236046] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:04.249348] [INFO ] [MAIN ] MDU: Generated 139 derivative records from 48379 primary records. [2025-10-24T00:52:04.255303] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-24T00:52:04.256673] [FATAL] [LOCAL ] MDU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:04.257060] [FATAL] [MAIN ] MDU: Failed to save derivative data. [2025-10-24T00:52:04.263705] [INFO ] [MAIN ] Derivative Progress: 1212/2164 symbols completed. MDU took 1.4s. Estimated remaining: 6m 24s. Rate: 148.7 symbols/min [2025-10-24T00:52:04.264279] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:04.272316] [DEBUG] [LOCAL ] MEC: Loaded 17069 existing records from primary storage. [2025-10-24T00:52:04.273066] [INFO ] [MAIN ] MEC: Loaded 17069 primary data records. [2025-10-24T00:52:04.445229] [DEBUG] [MAIN ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:04.445758] [DEBUG] [LOCAL ] MED: Loaded 21092 existing records from primary storage. [2025-10-24T00:52:04.523406] [INFO ] [MAIN ] MED: Loaded 21092 primary data records. [2025-10-24T00:52:04.976639] [INFO ] [MAIN ] MDV: Generated 139 derivative records from 8334 primary records. [2025-10-24T00:52:04.977563] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-24T00:52:04.977919] [FATAL] [LOCAL ] MDV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:04.978141] [FATAL] [MAIN ] MDV: Failed to save derivative data. [2025-10-24T00:52:04.992071] [DEBUG] [MAIN ] MEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:04.994420] [INFO ] [MAIN ] Derivative Progress: 1213/2164 symbols completed. MDV took 1.1s. Estimated remaining: 6m 24s. Rate: 148.6 symbols/min [2025-10-24T00:52:05.044137] [DEBUG] [MAIN ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:05.073454] [INFO ] [MAIN ] MEC: Generated 139 derivative records from 17069 primary records. [2025-10-24T00:52:05.076314] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-24T00:52:05.076866] [FATAL] [LOCAL ] MEC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:05.077966] [FATAL] [MAIN ] MEC: Failed to save derivative data. [2025-10-24T00:52:05.080699] [INFO ] [MAIN ] Derivative Progress: 1214/2164 symbols completed. MEC took 0.8s. Estimated remaining: 6m 23s. Rate: 148.7 symbols/min [2025-10-24T00:52:05.089467] [INFO ] [MAIN ] MED: Generated 139 derivative records from 21092 primary records. [2025-10-24T00:52:05.089744] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-24T00:52:05.089999] [FATAL] [LOCAL ] MED: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:05.090083] [FATAL] [MAIN ] MED: Failed to save derivative data. [2025-10-24T00:52:05.095176] [INFO ] [MAIN ] Derivative Progress: 1215/2164 symbols completed. MED took 0.8s. Estimated remaining: 6m 23s. Rate: 148.8 symbols/min [2025-10-24T00:52:05.095681] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:05.095745] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:05.095824] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:05.144618] [DEBUG] [LOCAL ] MEGI: Loaded 19865 existing records from primary storage. [2025-10-24T00:52:05.144020] [DEBUG] [LOCAL ] MEG: Loaded 31806 existing records from primary storage. [2025-10-24T00:52:05.144979] [INFO ] [MAIN ] MEGI: Loaded 19865 primary data records. [2025-10-24T00:52:05.145095] [INFO ] [MAIN ] MEG: Loaded 31806 primary data records. [2025-10-24T00:52:05.359733] [DEBUG] [LOCAL ] MEI: Loaded 31496 existing records from primary storage. [2025-10-24T00:52:05.383744] [INFO ] [MAIN ] MEI: Loaded 31496 primary data records. [2025-10-24T00:52:06.195929] [DEBUG] [MAIN ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:06.227902] [DEBUG] [MAIN ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:06.271158] [DEBUG] [MAIN ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:06.310952] [INFO ] [MAIN ] MEGI: Generated 139 derivative records from 19865 primary records. [2025-10-24T00:52:06.314139] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-24T00:52:06.318381] [FATAL] [LOCAL ] MEGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:06.318625] [FATAL] [MAIN ] MEGI: Failed to save derivative data. [2025-10-24T00:52:06.320838] [INFO ] [MAIN ] Derivative Progress: 1216/2164 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 23s. Rate: 148.6 symbols/min [2025-10-24T00:52:06.324820] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:06.339077] [INFO ] [MAIN ] MEI: Generated 139 derivative records from 31496 primary records. [2025-10-24T00:52:06.337293] [INFO ] [MAIN ] MEG: Generated 139 derivative records from 31806 primary records. [2025-10-24T00:52:06.339261] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-24T00:52:06.339568] [FATAL] [LOCAL ] MEI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:06.339713] [FATAL] [MAIN ] MEI: Failed to save derivative data. [2025-10-24T00:52:06.339360] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-24T00:52:06.342830] [INFO ] [MAIN ] Derivative Progress: 1217/2164 symbols completed. MEI took 1.2s. Estimated remaining: 6m 22s. Rate: 148.7 symbols/min [2025-10-24T00:52:06.343320] [FATAL] [LOCAL ] MEG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:06.343567] [FATAL] [MAIN ] MEG: Failed to save derivative data. [2025-10-24T00:52:06.343444] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:06.346369] [INFO ] [MAIN ] Derivative Progress: 1218/2164 symbols completed. MEG took 1.3s. Estimated remaining: 6m 21s. Rate: 148.8 symbols/min [2025-10-24T00:52:06.347131] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:06.356940] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-10-24T00:52:06.357186] [INFO ] [MAIN ] MFAN: Loaded 4331 primary data records. [2025-10-24T00:52:06.572894] [DEBUG] [LOCAL ] MET: Loaded 53677 existing records from primary storage. [2025-10-24T00:52:06.694674] [INFO ] [MAIN ] MET: Loaded 53677 primary data records. [2025-10-24T00:52:06.823634] [DEBUG] [LOCAL ] MFA: Loaded 45870 existing records from primary storage. [2025-10-24T00:52:06.828384] [INFO ] [MAIN ] MFA: Loaded 45870 primary data records. [2025-10-24T00:52:07.413323] [DEBUG] [MAIN ] MFAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:07.459304] [DEBUG] [MAIN ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:07.502486] [DEBUG] [MAIN ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:07.525504] [INFO ] [MAIN ] MFAN: Generated 139 derivative records from 4331 primary records. [2025-10-24T00:52:07.525720] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-24T00:52:07.526057] [FATAL] [LOCAL ] MFAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:07.528562] [FATAL] [MAIN ] MFAN: Failed to save derivative data. [2025-10-24T00:52:07.532382] [INFO ] [MAIN ] Derivative Progress: 1219/2164 symbols completed. MFAN took 1.2s. Estimated remaining: 6m 22s. Rate: 148.6 symbols/min [2025-10-24T00:52:07.532878] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:07.549070] [DEBUG] [LOCAL ] MFAO: Loaded 3900 existing records from primary storage. [2025-10-24T00:52:07.549949] [INFO ] [MAIN ] MFAO: Loaded 3900 primary data records. [2025-10-24T00:52:07.890552] [INFO ] [MAIN ] MET: Generated 139 derivative records from 53677 primary records. [2025-10-24T00:52:07.893998] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-24T00:52:07.894931] [FATAL] [LOCAL ] MET: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:07.895524] [FATAL] [MAIN ] MET: Failed to save derivative data. [2025-10-24T00:52:07.898072] [INFO ] [MAIN ] Derivative Progress: 1220/2164 symbols completed. MET took 1.6s. Estimated remaining: 6m 21s. Rate: 148.6 symbols/min [2025-10-24T00:52:07.901194] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:07.904072] [INFO ] [MAIN ] MFA: Generated 139 derivative records from 45870 primary records. [2025-10-24T00:52:07.905869] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-24T00:52:07.906540] [FATAL] [LOCAL ] MFA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:07.906628] [FATAL] [MAIN ] MFA: Failed to save derivative data. [2025-10-24T00:52:07.909897] [INFO ] [MAIN ] Derivative Progress: 1221/2164 symbols completed. MFA took 1.6s. Estimated remaining: 6m 20s. Rate: 148.7 symbols/min [2025-10-24T00:52:07.910160] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:07.934171] [DEBUG] [MAIN ] MFAO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:08.007530] [DEBUG] [LOCAL ] MFC: Loaded 51351 existing records from primary storage. [2025-10-24T00:52:08.025039] [INFO ] [MAIN ] MFC: Loaded 51351 primary data records. [2025-10-24T00:52:08.026903] [DEBUG] [LOCAL ] MFG: Loaded 49876 existing records from primary storage. [2025-10-24T00:52:08.027299] [INFO ] [MAIN ] MFG: Loaded 49876 primary data records. [2025-10-24T00:52:08.093713] [INFO ] [MAIN ] MFAO: Generated 139 derivative records from 3900 primary records. [2025-10-24T00:52:08.156664] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-24T00:52:08.168483] [FATAL] [LOCAL ] MFAO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:08.173723] [FATAL] [MAIN ] MFAO: Failed to save derivative data. [2025-10-24T00:52:08.205906] [INFO ] [MAIN ] Derivative Progress: 1222/2164 symbols completed. MFAO took 0.7s. Estimated remaining: 6m 20s. Rate: 148.7 symbols/min [2025-10-24T00:52:08.252835] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:08.642774] [DEBUG] [LOCAL ] MFM: Loaded 14129 existing records from primary storage. [2025-10-24T00:52:08.644533] [INFO ] [MAIN ] MFM: Loaded 14129 primary data records. [2025-10-24T00:52:08.988264] [DEBUG] [MAIN ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:08.994448] [DEBUG] [MAIN ] MFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:09.069241] [DEBUG] [MAIN ] MFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:09.104991] [INFO ] [MAIN ] MFC: Generated 139 derivative records from 51351 primary records. [2025-10-24T00:52:09.107832] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-24T00:52:09.109734] [FATAL] [LOCAL ] MFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:09.109840] [FATAL] [MAIN ] MFC: Failed to save derivative data. [2025-10-24T00:52:09.112335] [INFO ] [MAIN ] Derivative Progress: 1223/2164 symbols completed. MFC took 1.2s. Estimated remaining: 6m 20s. Rate: 148.6 symbols/min [2025-10-24T00:52:09.113672] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:09.124590] [INFO ] [MAIN ] MFG: Generated 139 derivative records from 49876 primary records. [2025-10-24T00:52:09.125358] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-24T00:52:09.127426] [FATAL] [LOCAL ] MFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:09.130738] [FATAL] [MAIN ] MFG: Failed to save derivative data. [2025-10-24T00:52:09.134107] [DEBUG] [LOCAL ] MFSG: Loaded 5990 existing records from primary storage. [2025-10-24T00:52:09.134421] [INFO ] [MAIN ] MFSG: Loaded 5990 primary data records. [2025-10-24T00:52:09.133579] [INFO ] [MAIN ] Derivative Progress: 1224/2164 symbols completed. MFG took 1.2s. Estimated remaining: 6m 19s. Rate: 148.7 symbols/min [2025-10-24T00:52:09.166687] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:09.251541] [INFO ] [MAIN ] MFM: Generated 139 derivative records from 14129 primary records. [2025-10-24T00:52:09.330110] [DEBUG] [LOCAL ] MFSI: Loaded 12771 existing records from primary storage. [2025-10-24T00:52:09.290487] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-24T00:52:09.335943] [INFO ] [MAIN ] MFSI: Loaded 12771 primary data records. [2025-10-24T00:52:09.336385] [FATAL] [LOCAL ] MFM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:09.501127] [FATAL] [MAIN ] MFM: Failed to save derivative data. [2025-10-24T00:52:09.562708] [INFO ] [MAIN ] Derivative Progress: 1225/2164 symbols completed. MFM took 1.3s. Estimated remaining: 6m 19s. Rate: 148.7 symbols/min [2025-10-24T00:52:09.579779] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:09.655488] [DEBUG] [LOCAL ] MFSV: Loaded 2986 existing records from primary storage. [2025-10-24T00:52:09.685556] [INFO ] [MAIN ] MFSV: Loaded 2986 primary data records. [2025-10-24T00:52:10.151463] [DEBUG] [MAIN ] MFSG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:52:10.195242] [DEBUG] [MAIN ] MFSI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:52:10.240678] [DEBUG] [MAIN ] MFSV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-24T00:52:10.258200] [INFO ] [MAIN ] MFSG: Generated 139 derivative records from 5990 primary records. [2025-10-24T00:52:10.260217] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-24T00:52:10.262057] [FATAL] [LOCAL ] MFSG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:10.262352] [FATAL] [MAIN ] MFSG: Failed to save derivative data. [2025-10-24T00:52:10.268349] [INFO ] [MAIN ] Derivative Progress: 1226/2164 symbols completed. MFSG took 1.2s. Estimated remaining: 6m 19s. Rate: 148.6 symbols/min [2025-10-24T00:52:10.271627] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:10.291665] [INFO ] [MAIN ] MFSI: Generated 139 derivative records from 12771 primary records. [2025-10-24T00:52:10.298932] [DEBUG] [LOCAL ] MG: Loaded 15462 existing records from primary storage. [2025-10-24T00:52:10.298358] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-24T00:52:10.299419] [INFO ] [MAIN ] MG: Loaded 15462 primary data records. [2025-10-24T00:52:10.299845] [FATAL] [LOCAL ] MFSI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:10.346251] [FATAL] [MAIN ] MFSI: Failed to save derivative data. [2025-10-24T00:52:10.349241] [INFO ] [MAIN ] Derivative Progress: 1227/2164 symbols completed. MFSI took 1.2s. Estimated remaining: 6m 18s. Rate: 148.7 symbols/min [2025-10-24T00:52:10.361687] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:10.417129] [INFO ] [MAIN ] MFSV: Generated 139 derivative records from 2986 primary records. [2025-10-24T00:52:10.433423] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-24T00:52:10.444399] [FATAL] [LOCAL ] MFSV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:10.444757] [FATAL] [MAIN ] MFSV: Failed to save derivative data. [2025-10-24T00:52:10.465313] [INFO ] [MAIN ] Derivative Progress: 1228/2164 symbols completed. MFSV took 0.9s. Estimated remaining: 6m 17s. Rate: 148.8 symbols/min [2025-10-24T00:52:10.651087] [DEBUG] [LOCAL ] MGA: Loaded 50758 existing records from primary storage. [2025-10-24T00:52:10.651589] [INFO ] [MAIN ] MGA: Loaded 50758 primary data records. [2025-10-24T00:52:10.862321] [DEBUG] [MAIN ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:11.033422] [INFO ] [MAIN ] MG: Generated 139 derivative records from 15462 primary records. [2025-10-24T00:52:11.033747] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-24T00:52:11.033970] [FATAL] [LOCAL ] MG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:11.034122] [FATAL] [MAIN ] MG: Failed to save derivative data. [2025-10-24T00:52:11.036354] [INFO ] [MAIN ] Derivative Progress: 1229/2164 symbols completed. MG took 0.8s. Estimated remaining: 6m 17s. Rate: 148.7 symbols/min [2025-10-24T00:52:11.053091] [DEBUG] [MAIN ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:11.078429] [INFO ] [MAIN ] MGA: Generated 139 derivative records from 50758 primary records. [2025-10-24T00:52:11.078557] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-24T00:52:11.078768] [FATAL] [LOCAL ] MGA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:11.078844] [FATAL] [MAIN ] MGA: Failed to save derivative data. [2025-10-24T00:52:11.081393] [INFO ] [MAIN ] Derivative Progress: 1230/2164 symbols completed. MGA took 0.7s. Estimated remaining: 6m 16s. Rate: 148.8 symbols/min [2025-10-24T00:52:11.081804] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:11.082040] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:11.081960] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:11.090692] [DEBUG] [LOCAL ] MGF: Loaded 4146 existing records from primary storage. [2025-10-24T00:52:11.093536] [DEBUG] [LOCAL ] MGR: Loaded 5552 existing records from primary storage. [2025-10-24T00:52:11.093600] [INFO ] [MAIN ] MGF: Loaded 4146 primary data records. [2025-10-24T00:52:11.105806] [INFO ] [MAIN ] MGR: Loaded 5552 primary data records. [2025-10-24T00:52:11.805331] [DEBUG] [LOCAL ] MGM: Loaded 53993 existing records from primary storage. [2025-10-24T00:52:11.807781] [INFO ] [MAIN ] MGM: Loaded 53993 primary data records. [2025-10-24T00:52:12.143148] [DEBUG] [MAIN ] MGF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:12.143374] [DEBUG] [MAIN ] MGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:12.214451] [DEBUG] [MAIN ] MGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:12.246289] [INFO ] [MAIN ] MGF: Generated 139 derivative records from 4146 primary records. [2025-10-24T00:52:12.249300] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-24T00:52:12.250523] [FATAL] [LOCAL ] MGF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:12.250718] [FATAL] [MAIN ] MGF: Failed to save derivative data. [2025-10-24T00:52:12.253480] [INFO ] [MAIN ] Derivative Progress: 1231/2164 symbols completed. MGF took 1.2s. Estimated remaining: 6m 17s. Rate: 148.6 symbols/min [2025-10-24T00:52:12.254780] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:12.263511] [INFO ] [MAIN ] MGR: Generated 139 derivative records from 5552 primary records. [2025-10-24T00:52:12.269063] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-24T00:52:12.270318] [DEBUG] [LOCAL ] MGRB: Loaded 4007 existing records from primary storage. [2025-10-24T00:52:12.270811] [FATAL] [LOCAL ] MGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:12.271069] [INFO ] [MAIN ] MGRB: Loaded 4007 primary data records. [2025-10-24T00:52:12.282624] [FATAL] [MAIN ] MGR: Failed to save derivative data. [2025-10-24T00:52:12.304840] [INFO ] [MAIN ] Derivative Progress: 1232/2164 symbols completed. MGR took 1.2s. Estimated remaining: 6m 16s. Rate: 148.7 symbols/min [2025-10-24T00:52:12.330199] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:12.399665] [DEBUG] [LOCAL ] MGRD: Loaded 2213 existing records from primary storage. [2025-10-24T00:52:12.431786] [INFO ] [MAIN ] MGRD: Loaded 2213 primary data records. [2025-10-24T00:52:12.614255] [INFO ] [MAIN ] MGM: Generated 139 derivative records from 53993 primary records. [2025-10-24T00:52:12.646447] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-24T00:52:12.647336] [FATAL] [LOCAL ] MGM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:12.659852] [FATAL] [MAIN ] MGM: Failed to save derivative data. [2025-10-24T00:52:12.681483] [INFO ] [MAIN ] Derivative Progress: 1233/2164 symbols completed. MGM took 1.6s. Estimated remaining: 6m 16s. Rate: 148.7 symbols/min [2025-10-24T00:52:12.696059] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:12.880543] [DEBUG] [LOCAL ] MGRE: Loaded 6452 existing records from primary storage. [2025-10-24T00:52:12.880731] [INFO ] [MAIN ] MGRE: Loaded 6452 primary data records. [2025-10-24T00:52:13.053343] [DEBUG] [MAIN ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:13.245784] [DEBUG] [MAIN ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:13.279419] [INFO ] [MAIN ] MGRB: Generated 139 derivative records from 4007 primary records. [2025-10-24T00:52:13.291823] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-24T00:52:13.292272] [DEBUG] [MAIN ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:13.292809] [FATAL] [LOCAL ] MGRB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:13.294952] [FATAL] [MAIN ] MGRB: Failed to save derivative data. [2025-10-24T00:52:13.312875] [INFO ] [MAIN ] Derivative Progress: 1234/2164 symbols completed. MGRB took 1.1s. Estimated remaining: 6m 15s. Rate: 148.7 symbols/min [2025-10-24T00:52:13.315763] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:13.340892] [INFO ] [MAIN ] MGRD: Generated 139 derivative records from 2213 primary records. [2025-10-24T00:52:13.344089] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-24T00:52:13.344458] [FATAL] [LOCAL ] MGRD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:13.345663] [FATAL] [MAIN ] MGRD: Failed to save derivative data. [2025-10-24T00:52:13.348232] [INFO ] [MAIN ] Derivative Progress: 1235/2164 symbols completed. MGRD took 1.0s. Estimated remaining: 6m 15s. Rate: 148.8 symbols/min [2025-10-24T00:52:13.348492] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:13.351134] [INFO ] [MAIN ] MGRE: Generated 139 derivative records from 6452 primary records. [2025-10-24T00:52:13.351292] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-24T00:52:13.351501] [FATAL] [LOCAL ] MGRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:13.351578] [FATAL] [MAIN ] MGRE: Failed to save derivative data. [2025-10-24T00:52:13.354741] [INFO ] [MAIN ] Derivative Progress: 1236/2164 symbols completed. MGRE took 0.7s. Estimated remaining: 6m 14s. Rate: 148.9 symbols/min [2025-10-24T00:52:13.355065] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:13.385874] [DEBUG] [LOCAL ] MHD: Loaded 11963 existing records from primary storage. [2025-10-24T00:52:13.381175] [DEBUG] [LOCAL ] MHF: Loaded 9083 existing records from primary storage. [2025-10-24T00:52:13.386222] [INFO ] [MAIN ] MHD: Loaded 11963 primary data records. [2025-10-24T00:52:13.407581] [INFO ] [MAIN ] MHF: Loaded 9083 primary data records. [2025-10-24T00:52:13.551189] [DEBUG] [LOCAL ] MGY: Loaded 52808 existing records from primary storage. [2025-10-24T00:52:13.599715] [INFO ] [MAIN ] MGY: Loaded 52808 primary data records. [2025-10-24T00:52:14.350142] [DEBUG] [MAIN ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:14.363918] [DEBUG] [MAIN ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:14.408100] [DEBUG] [MAIN ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:14.476754] [INFO ] [MAIN ] MHF: Generated 139 derivative records from 9083 primary records. [2025-10-24T00:52:14.479251] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-24T00:52:14.483503] [FATAL] [LOCAL ] MHF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:14.483199] [INFO ] [MAIN ] MHD: Generated 139 derivative records from 11963 primary records. [2025-10-24T00:52:14.484158] [FATAL] [MAIN ] MHF: Failed to save derivative data. [2025-10-24T00:52:14.487006] [INFO ] [MAIN ] Derivative Progress: 1237/2164 symbols completed. MHF took 1.1s. Estimated remaining: 6m 14s. Rate: 148.7 symbols/min [2025-10-24T00:52:14.487164] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-24T00:52:14.491112] [FATAL] [LOCAL ] MHD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:14.491230] [FATAL] [MAIN ] MHD: Failed to save derivative data. [2025-10-24T00:52:14.493431] [INFO ] [MAIN ] Derivative Progress: 1238/2164 symbols completed. MHD took 1.1s. Estimated remaining: 6m 13s. Rate: 148.8 symbols/min [2025-10-24T00:52:14.490595] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:14.495390] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:14.498746] [INFO ] [MAIN ] MGY: Generated 139 derivative records from 52808 primary records. [2025-10-24T00:52:14.499319] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-24T00:52:14.499620] [FATAL] [LOCAL ] MGY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:14.499779] [FATAL] [MAIN ] MGY: Failed to save derivative data. [2025-10-24T00:52:14.502820] [INFO ] [MAIN ] Derivative Progress: 1239/2164 symbols completed. MGY took 1.2s. Estimated remaining: 6m 13s. Rate: 148.9 symbols/min [2025-10-24T00:52:14.503199] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:14.511393] [DEBUG] [LOCAL ] MHN: Loaded 7408 existing records from primary storage. [2025-10-24T00:52:14.511550] [INFO ] [MAIN ] MHN: Loaded 7408 primary data records. [2025-10-24T00:52:14.823777] [DEBUG] [LOCAL ] MHO: Loaded 23852 existing records from primary storage. [2025-10-24T00:52:14.838500] [DEBUG] [LOCAL ] MHK: Loaded 42331 existing records from primary storage. [2025-10-24T00:52:14.837244] [INFO ] [MAIN ] MHO: Loaded 23852 primary data records. [2025-10-24T00:52:14.838783] [INFO ] [MAIN ] MHK: Loaded 42331 primary data records. [2025-10-24T00:52:15.489726] [DEBUG] [MAIN ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:15.535129] [DEBUG] [MAIN ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:15.570527] [DEBUG] [MAIN ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:15.590522] [INFO ] [MAIN ] MHN: Generated 139 derivative records from 7408 primary records. [2025-10-24T00:52:15.592796] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-24T00:52:15.593281] [FATAL] [LOCAL ] MHN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:15.593779] [FATAL] [MAIN ] MHN: Failed to save derivative data. [2025-10-24T00:52:15.598996] [INFO ] [MAIN ] Derivative Progress: 1240/2164 symbols completed. MHN took 1.1s. Estimated remaining: 6m 13s. Rate: 148.7 symbols/min [2025-10-24T00:52:15.599307] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:15.629370] [INFO ] [MAIN ] MHO: Generated 139 derivative records from 23852 primary records. [2025-10-24T00:52:15.631158] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-24T00:52:15.636373] [DEBUG] [LOCAL ] MIN: Loaded 13984 existing records from primary storage. [2025-10-24T00:52:15.636498] [INFO ] [MAIN ] MIN: Loaded 13984 primary data records. [2025-10-24T00:52:15.636746] [FATAL] [LOCAL ] MHO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:15.636944] [INFO ] [MAIN ] MHK: Generated 139 derivative records from 42331 primary records. [2025-10-24T00:52:15.637091] [FATAL] [MAIN ] MHO: Failed to save derivative data. [2025-10-24T00:52:15.642358] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-24T00:52:15.649270] [FATAL] [LOCAL ] MHK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:15.671383] [FATAL] [MAIN ] MHK: Failed to save derivative data. [2025-10-24T00:52:15.661238] [INFO ] [MAIN ] Derivative Progress: 1241/2164 symbols completed. MHO took 1.2s. Estimated remaining: 6m 12s. Rate: 148.8 symbols/min [2025-10-24T00:52:15.683385] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:15.696550] [INFO ] [MAIN ] Derivative Progress: 1242/2164 symbols completed. MHK took 1.2s. Estimated remaining: 6m 11s. Rate: 148.9 symbols/min [2025-10-24T00:52:15.713599] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:15.754866] [DEBUG] [LOCAL ] MITP: Loaded 2207 existing records from primary storage. [2025-10-24T00:52:15.765465] [INFO ] [MAIN ] MITP: Loaded 2207 primary data records. [2025-10-24T00:52:16.250759] [DEBUG] [LOCAL ] MIR: Loaded 51787 existing records from primary storage. [2025-10-24T00:52:16.260107] [INFO ] [MAIN ] MIR: Loaded 51787 primary data records. [2025-10-24T00:52:16.575959] [DEBUG] [MAIN ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:16.611161] [DEBUG] [MAIN ] MITP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:16.658397] [DEBUG] [MAIN ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:16.683437] [INFO ] [MAIN ] MIN: Generated 139 derivative records from 13984 primary records. [2025-10-24T00:52:16.683690] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-24T00:52:16.684056] [FATAL] [LOCAL ] MIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:16.684932] [FATAL] [MAIN ] MIN: Failed to save derivative data. [2025-10-24T00:52:16.687347] [INFO ] [MAIN ] Derivative Progress: 1243/2164 symbols completed. MIN took 1.1s. Estimated remaining: 6m 12s. Rate: 148.7 symbols/min [2025-10-24T00:52:16.698956] [INFO ] [MAIN ] MITP: Generated 139 derivative records from 2207 primary records. [2025-10-24T00:52:16.699099] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-24T00:52:16.699316] [FATAL] [LOCAL ] MITP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:16.700416] [FATAL] [MAIN ] MITP: Failed to save derivative data. [2025-10-24T00:52:16.703243] [INFO ] [MAIN ] Derivative Progress: 1244/2164 symbols completed. MITP took 1.0s. Estimated remaining: 6m 11s. Rate: 148.9 symbols/min [2025-10-24T00:52:16.710962] [INFO ] [MAIN ] MIR: Generated 139 derivative records from 51787 primary records. [2025-10-24T00:52:16.711050] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-24T00:52:16.711235] [FATAL] [LOCAL ] MIR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:16.711310] [FATAL] [MAIN ] MIR: Failed to save derivative data. [2025-10-24T00:52:16.713680] [INFO ] [MAIN ] Derivative Progress: 1245/2164 symbols completed. MIR took 1.0s. Estimated remaining: 6m 10s. Rate: 149.0 symbols/min [2025-10-24T00:52:16.714014] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:16.714122] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:16.714217] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:16.723990] [DEBUG] [LOCAL ] MIY: Loaded 6252 existing records from primary storage. [2025-10-24T00:52:16.724138] [INFO ] [MAIN ] MIY: Loaded 6252 primary data records. [2025-10-24T00:52:16.840337] [DEBUG] [LOCAL ] MITT: Loaded 22373 existing records from primary storage. [2025-10-24T00:52:16.840814] [INFO ] [MAIN ] MITT: Loaded 22373 primary data records. [2025-10-24T00:52:17.181854] [DEBUG] [LOCAL ] MKC: Loaded 52909 existing records from primary storage. [2025-10-24T00:52:17.200009] [INFO ] [MAIN ] MKC: Loaded 52909 primary data records. [2025-10-24T00:52:17.701333] [DEBUG] [MAIN ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:17.735417] [DEBUG] [MAIN ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:17.780154] [DEBUG] [MAIN ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:17.821400] [INFO ] [MAIN ] MIY: Generated 139 derivative records from 6252 primary records. [2025-10-24T00:52:17.821689] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-24T00:52:17.825420] [FATAL] [LOCAL ] MIY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:17.825832] [FATAL] [MAIN ] MIY: Failed to save derivative data. [2025-10-24T00:52:17.829163] [INFO ] [MAIN ] Derivative Progress: 1246/2164 symbols completed. MIY took 1.1s. Estimated remaining: 6m 10s. Rate: 148.8 symbols/min [2025-10-24T00:52:17.832429] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:17.843496] [INFO ] [MAIN ] MITT: Generated 139 derivative records from 22373 primary records. [2025-10-24T00:52:17.843931] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-24T00:52:17.845505] [FATAL] [LOCAL ] MITT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:17.845612] [FATAL] [MAIN ] MITT: Failed to save derivative data. [2025-10-24T00:52:17.850751] [INFO ] [MAIN ] Derivative Progress: 1247/2164 symbols completed. MITT took 1.1s. Estimated remaining: 6m 10s. Rate: 148.9 symbols/min [2025-10-24T00:52:17.848199] [INFO ] [MAIN ] MKC: Generated 139 derivative records from 52909 primary records. [2025-10-24T00:52:17.850970] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-24T00:52:17.851248] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:17.851516] [FATAL] [LOCAL ] MKC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:17.851973] [FATAL] [MAIN ] MKC: Failed to save derivative data. [2025-10-24T00:52:17.855281] [INFO ] [MAIN ] Derivative Progress: 1248/2164 symbols completed. MKC took 1.1s. Estimated remaining: 6m 9s. Rate: 149.0 symbols/min [2025-10-24T00:52:17.855573] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:17.905779] [DEBUG] [LOCAL ] MKL: Loaded 33977 existing records from primary storage. [2025-10-24T00:52:17.906426] [INFO ] [MAIN ] MKL: Loaded 33977 primary data records. [2025-10-24T00:52:18.018931] [DEBUG] [LOCAL ] MLM: Loaded 28771 existing records from primary storage. [2025-10-24T00:52:17.996107] [DEBUG] [LOCAL ] MLI: Loaded 43734 existing records from primary storage. [2025-10-24T00:52:18.026769] [INFO ] [MAIN ] MLI: Loaded 43734 primary data records. [2025-10-24T00:52:18.026633] [INFO ] [MAIN ] MLM: Loaded 28771 primary data records. [2025-10-24T00:52:18.835070] [DEBUG] [MAIN ] MKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:18.884738] [DEBUG] [MAIN ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:18.884410] [DEBUG] [MAIN ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:18.956494] [INFO ] [MAIN ] MKL: Generated 139 derivative records from 33977 primary records. [2025-10-24T00:52:18.957197] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-24T00:52:18.961032] [FATAL] [LOCAL ] MKL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:18.964248] [INFO ] [MAIN ] MLI: Generated 139 derivative records from 43734 primary records. [2025-10-24T00:52:18.961464] [FATAL] [MAIN ] MKL: Failed to save derivative data. [2025-10-24T00:52:18.968711] [INFO ] [MAIN ] MLM: Generated 139 derivative records from 28771 primary records. [2025-10-24T00:52:18.966266] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-24T00:52:18.968394] [INFO ] [MAIN ] Derivative Progress: 1249/2164 symbols completed. MKL took 1.1s. Estimated remaining: 6m 9s. Rate: 148.8 symbols/min [2025-10-24T00:52:18.968873] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-24T00:52:18.969444] [FATAL] [LOCAL ] MLM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:18.969118] [FATAL] [LOCAL ] MLI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:18.969606] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:18.969705] [FATAL] [MAIN ] MLI: Failed to save derivative data. [2025-10-24T00:52:18.972537] [INFO ] [MAIN ] Derivative Progress: 1250/2164 symbols completed. MLI took 1.1s. Estimated remaining: 6m 8s. Rate: 148.9 symbols/min [2025-10-24T00:52:18.969879] [FATAL] [MAIN ] MLM: Failed to save derivative data. [2025-10-24T00:52:18.976063] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:18.976188] [INFO ] [MAIN ] Derivative Progress: 1251/2164 symbols completed. MLM took 1.1s. Estimated remaining: 6m 8s. Rate: 149.0 symbols/min [2025-10-24T00:52:18.976904] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:18.982539] [DEBUG] [LOCAL ] MLP: Loaded 3014 existing records from primary storage. [2025-10-24T00:52:18.982928] [INFO ] [MAIN ] MLP: Loaded 3014 primary data records. [2025-10-24T00:52:19.088002] [DEBUG] [LOCAL ] MLR: Loaded 12181 existing records from primary storage. [2025-10-24T00:52:19.105740] [INFO ] [MAIN ] MLR: Loaded 12181 primary data records. [2025-10-24T00:52:19.229767] [DEBUG] [LOCAL ] MLNK: Loaded 27685 existing records from primary storage. [2025-10-24T00:52:19.389045] [INFO ] [MAIN ] MLNK: Loaded 27685 primary data records. [2025-10-24T00:52:19.958914] [DEBUG] [MAIN ] MLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:20.001736] [DEBUG] [MAIN ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:20.032158] [DEBUG] [MAIN ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:20.059605] [INFO ] [MAIN ] MLP: Generated 139 derivative records from 3014 primary records. [2025-10-24T00:52:20.059866] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-24T00:52:20.060200] [FATAL] [LOCAL ] MLP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:20.063929] [FATAL] [MAIN ] MLP: Failed to save derivative data. [2025-10-24T00:52:20.069196] [INFO ] [MAIN ] Derivative Progress: 1252/2164 symbols completed. MLP took 1.1s. Estimated remaining: 6m 8s. Rate: 148.8 symbols/min [2025-10-24T00:52:20.069480] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:20.096997] [INFO ] [MAIN ] MLNK: Generated 139 derivative records from 27685 primary records. [2025-10-24T00:52:20.096788] [INFO ] [MAIN ] MLR: Generated 139 derivative records from 12181 primary records. [2025-10-24T00:52:20.097224] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-24T00:52:20.097327] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-24T00:52:20.097578] [FATAL] [LOCAL ] MLNK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:20.097968] [FATAL] [MAIN ] MLNK: Failed to save derivative data. [2025-10-24T00:52:20.101361] [INFO ] [MAIN ] Derivative Progress: 1253/2164 symbols completed. MLNK took 1.1s. Estimated remaining: 6m 7s. Rate: 148.9 symbols/min [2025-10-24T00:52:20.097791] [FATAL] [LOCAL ] MLR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:20.101699] [FATAL] [MAIN ] MLR: Failed to save derivative data. [2025-10-24T00:52:20.101793] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:20.105271] [INFO ] [MAIN ] Derivative Progress: 1254/2164 symbols completed. MLR took 1.1s. Estimated remaining: 6m 6s. Rate: 149.0 symbols/min [2025-10-24T00:52:20.105448] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:20.129363] [DEBUG] [LOCAL ] MMD: Loaded 10792 existing records from primary storage. [2025-10-24T00:52:20.132729] [INFO ] [MAIN ] MMD: Loaded 10792 primary data records. [2025-10-24T00:52:20.193255] [DEBUG] [LOCAL ] MMI: Loaded 15494 existing records from primary storage. [2025-10-24T00:52:20.221944] [INFO ] [MAIN ] MMI: Loaded 15494 primary data records. [2025-10-24T00:52:20.255701] [DEBUG] [LOCAL ] MMC: Loaded 52316 existing records from primary storage. [2025-10-24T00:52:20.266719] [INFO ] [MAIN ] MMC: Loaded 52316 primary data records. [2025-10-24T00:52:21.141250] [DEBUG] [MAIN ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:21.200386] [DEBUG] [MAIN ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:21.203414] [DEBUG] [MAIN ] MMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:21.293227] [INFO ] [MAIN ] MMD: Generated 139 derivative records from 10792 primary records. [2025-10-24T00:52:21.297307] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-24T00:52:21.298182] [FATAL] [LOCAL ] MMD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:21.300870] [FATAL] [MAIN ] MMD: Failed to save derivative data. [2025-10-24T00:52:21.301211] [INFO ] [MAIN ] MMI: Generated 139 derivative records from 15494 primary records. [2025-10-24T00:52:21.304540] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-24T00:52:21.306485] [INFO ] [MAIN ] Derivative Progress: 1255/2164 symbols completed. MMD took 1.2s. Estimated remaining: 6m 7s. Rate: 148.8 symbols/min [2025-10-24T00:52:21.307026] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:21.307445] [FATAL] [LOCAL ] MMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:21.310183] [FATAL] [MAIN ] MMI: Failed to save derivative data. [2025-10-24T00:52:21.313442] [INFO ] [MAIN ] Derivative Progress: 1256/2164 symbols completed. MMI took 1.2s. Estimated remaining: 6m 6s. Rate: 148.9 symbols/min [2025-10-24T00:52:21.314147] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:21.316874] [INFO ] [MAIN ] MMC: Generated 139 derivative records from 52316 primary records. [2025-10-24T00:52:21.317526] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-24T00:52:21.317817] [FATAL] [LOCAL ] MMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:21.317903] [FATAL] [MAIN ] MMC: Failed to save derivative data. [2025-10-24T00:52:21.320963] [INFO ] [MAIN ] Derivative Progress: 1257/2164 symbols completed. MMC took 1.3s. Estimated remaining: 6m 5s. Rate: 149.0 symbols/min [2025-10-24T00:52:21.321486] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:21.335898] [DEBUG] [LOCAL ] MMT: Loaded 10170 existing records from primary storage. [2025-10-24T00:52:21.336333] [INFO ] [MAIN ] MMT: Loaded 10170 primary data records. [2025-10-24T00:52:21.481826] [DEBUG] [LOCAL ] MMS: Loaded 33605 existing records from primary storage. [2025-10-24T00:52:21.488391] [INFO ] [MAIN ] MMS: Loaded 33605 primary data records. [2025-10-24T00:52:21.574430] [DEBUG] [LOCAL ] MMM: Loaded 53501 existing records from primary storage. [2025-10-24T00:52:21.800065] [INFO ] [MAIN ] MMM: Loaded 53501 primary data records. [2025-10-24T00:52:22.318460] [DEBUG] [MAIN ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:22.359068] [DEBUG] [MAIN ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:22.400752] [DEBUG] [MAIN ] MMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:22.435372] [INFO ] [MAIN ] MMT: Generated 139 derivative records from 10170 primary records. [2025-10-24T00:52:22.436253] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-24T00:52:22.439336] [FATAL] [LOCAL ] MMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:22.441007] [FATAL] [MAIN ] MMT: Failed to save derivative data. [2025-10-24T00:52:22.443187] [INFO ] [MAIN ] Derivative Progress: 1258/2164 symbols completed. MMT took 1.1s. Estimated remaining: 6m 5s. Rate: 148.8 symbols/min [2025-10-24T00:52:22.457348] [INFO ] [MAIN ] MMS: Generated 139 derivative records from 33605 primary records. [2025-10-24T00:52:22.459041] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-24T00:52:22.459331] [FATAL] [LOCAL ] MMS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:22.461392] [FATAL] [MAIN ] MMS: Failed to save derivative data. [2025-10-24T00:52:22.461248] [INFO ] [MAIN ] MMM: Generated 139 derivative records from 53501 primary records. [2025-10-24T00:52:22.464371] [INFO ] [MAIN ] Derivative Progress: 1259/2164 symbols completed. MMS took 1.2s. Estimated remaining: 6m 5s. Rate: 148.9 symbols/min [2025-10-24T00:52:22.464457] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-24T00:52:22.464929] [FATAL] [LOCAL ] MMM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:22.465011] [FATAL] [MAIN ] MMM: Failed to save derivative data. [2025-10-24T00:52:22.468237] [INFO ] [MAIN ] Derivative Progress: 1260/2164 symbols completed. MMM took 1.2s. Estimated remaining: 6m 4s. Rate: 149.1 symbols/min [2025-10-24T00:52:22.468672] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:22.468810] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:22.468860] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:22.488776] [DEBUG] [LOCAL ] MMU: Loaded 16875 existing records from primary storage. [2025-10-24T00:52:22.488914] [INFO ] [MAIN ] MMU: Loaded 16875 primary data records. [2025-10-24T00:52:22.614355] [DEBUG] [LOCAL ] MNR: Loaded 25198 existing records from primary storage. [2025-10-24T00:52:22.636071] [INFO ] [MAIN ] MNR: Loaded 25198 primary data records. [2025-10-24T00:52:22.864024] [DEBUG] [LOCAL ] MNSO: Loaded 44260 existing records from primary storage. [2025-10-24T00:52:22.883948] [INFO ] [MAIN ] MNSO: Loaded 44260 primary data records. [2025-10-24T00:52:23.499119] [DEBUG] [MAIN ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:23.539242] [DEBUG] [MAIN ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:23.581008] [DEBUG] [MAIN ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:23.614728] [INFO ] [MAIN ] MMU: Generated 139 derivative records from 16875 primary records. [2025-10-24T00:52:23.618926] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-24T00:52:23.619187] [FATAL] [LOCAL ] MMU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:23.619283] [FATAL] [MAIN ] MMU: Failed to save derivative data. [2025-10-24T00:52:23.626822] [INFO ] [MAIN ] Derivative Progress: 1261/2164 symbols completed. MMU took 1.2s. Estimated remaining: 6m 4s. Rate: 148.8 symbols/min [2025-10-24T00:52:23.627085] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:23.645407] [INFO ] [MAIN ] MNR: Generated 139 derivative records from 25198 primary records. [2025-10-24T00:52:23.647341] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-24T00:52:23.649811] [FATAL] [LOCAL ] MNR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:23.649476] [INFO ] [MAIN ] MNSO: Generated 139 derivative records from 44260 primary records. [2025-10-24T00:52:23.650018] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-24T00:52:23.650236] [FATAL] [LOCAL ] MNSO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:23.650292] [FATAL] [MAIN ] MNR: Failed to save derivative data. [2025-10-24T00:52:23.650369] [FATAL] [MAIN ] MNSO: Failed to save derivative data. [2025-10-24T00:52:23.652850] [INFO ] [MAIN ] Derivative Progress: 1262/2164 symbols completed. MNR took 1.2s. Estimated remaining: 6m 3s. Rate: 148.9 symbols/min [2025-10-24T00:52:23.656042] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:23.656277] [INFO ] [MAIN ] Derivative Progress: 1263/2164 symbols completed. MNSO took 1.2s. Estimated remaining: 6m 3s. Rate: 149.1 symbols/min [2025-10-24T00:52:23.656802] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:23.691314] [DEBUG] [LOCAL ] MOD: Loaded 44795 existing records from primary storage. [2025-10-24T00:52:23.691593] [INFO ] [MAIN ] MOD: Loaded 44795 primary data records. [2025-10-24T00:52:23.851757] [DEBUG] [LOCAL ] MODG: Loaded 51898 existing records from primary storage. [2025-10-24T00:52:23.889723] [INFO ] [MAIN ] MODG: Loaded 51898 primary data records. [2025-10-24T00:52:23.906003] [DEBUG] [LOCAL ] MOH: Loaded 43431 existing records from primary storage. [2025-10-24T00:52:24.098215] [INFO ] [MAIN ] MOH: Loaded 43431 primary data records. [2025-10-24T00:52:24.734287] [DEBUG] [MAIN ] MOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:24.773997] [DEBUG] [MAIN ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:24.806957] [DEBUG] [MAIN ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:24.874666] [INFO ] [MAIN ] MOD: Generated 139 derivative records from 44795 primary records. [2025-10-24T00:52:24.877543] [INFO ] [MAIN ] MODG: Generated 139 derivative records from 51898 primary records. [2025-10-24T00:52:24.879208] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-24T00:52:24.879319] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-24T00:52:24.880248] [FATAL] [LOCAL ] MODG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:24.879704] [FATAL] [LOCAL ] MOD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:24.881850] [FATAL] [MAIN ] MOD: Failed to save derivative data. [2025-10-24T00:52:24.881985] [FATAL] [MAIN ] MODG: Failed to save derivative data. [2025-10-24T00:52:24.885432] [INFO ] [MAIN ] Derivative Progress: 1264/2164 symbols completed. MOD took 1.3s. Estimated remaining: 6m 3s. Rate: 148.8 symbols/min [2025-10-24T00:52:24.889915] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:24.890066] [INFO ] [MAIN ] Derivative Progress: 1265/2164 symbols completed. MODG took 1.2s. Estimated remaining: 6m 2s. Rate: 148.9 symbols/min [2025-10-24T00:52:24.890386] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:24.895238] [INFO ] [MAIN ] MOH: Generated 139 derivative records from 43431 primary records. [2025-10-24T00:52:24.895859] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-24T00:52:24.896084] [FATAL] [LOCAL ] MOH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:24.896162] [FATAL] [MAIN ] MOH: Failed to save derivative data. [2025-10-24T00:52:24.899132] [INFO ] [MAIN ] Derivative Progress: 1266/2164 symbols completed. MOH took 1.2s. Estimated remaining: 6m 1s. Rate: 149.0 symbols/min [2025-10-24T00:52:24.899347] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:24.919583] [DEBUG] [LOCAL ] MOV: Loaded 21238 existing records from primary storage. [2025-10-24T00:52:24.919777] [INFO ] [MAIN ] MOV: Loaded 21238 primary data records. [2025-10-24T00:52:25.295906] [DEBUG] [LOCAL ] MOS: Loaded 53900 existing records from primary storage. [2025-10-24T00:52:25.311420] [INFO ] [MAIN ] MOS: Loaded 53900 primary data records. [2025-10-24T00:52:25.312468] [DEBUG] [LOCAL ] MP: Loaded 54134 existing records from primary storage. [2025-10-24T00:52:25.313203] [INFO ] [MAIN ] MP: Loaded 54134 primary data records. [2025-10-24T00:52:25.935376] [DEBUG] [MAIN ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:25.979736] [DEBUG] [MAIN ] MP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:26.005807] [DEBUG] [MAIN ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:26.053888] [INFO ] [MAIN ] MOV: Generated 139 derivative records from 21238 primary records. [2025-10-24T00:52:26.055738] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-24T00:52:26.056024] [FATAL] [LOCAL ] MOV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:26.058977] [FATAL] [MAIN ] MOV: Failed to save derivative data. [2025-10-24T00:52:26.061811] [INFO ] [MAIN ] Derivative Progress: 1267/2164 symbols completed. MOV took 1.2s. Estimated remaining: 6m 2s. Rate: 148.8 symbols/min [2025-10-24T00:52:26.067846] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:26.087880] [DEBUG] [LOCAL ] MPA: Loaded 5223 existing records from primary storage. [2025-10-24T00:52:26.088331] [INFO ] [MAIN ] MPA: Loaded 5223 primary data records. [2025-10-24T00:52:26.182045] [INFO ] [MAIN ] MP: Generated 139 derivative records from 54134 primary records. [2025-10-24T00:52:26.187426] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-24T00:52:26.194282] [FATAL] [LOCAL ] MP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:26.205430] [FATAL] [MAIN ] MP: Failed to save derivative data. [2025-10-24T00:52:26.211215] [INFO ] [MAIN ] Derivative Progress: 1268/2164 symbols completed. MP took 1.3s. Estimated remaining: 6m 1s. Rate: 148.9 symbols/min [2025-10-24T00:52:26.222297] [INFO ] [MAIN ] MOS: Generated 139 derivative records from 53900 primary records. [2025-10-24T00:52:26.227813] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:26.239170] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-24T00:52:26.266221] [FATAL] [LOCAL ] MOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:26.288469] [FATAL] [MAIN ] MOS: Failed to save derivative data. [2025-10-24T00:52:26.406286] [INFO ] [MAIN ] Derivative Progress: 1269/2164 symbols completed. MOS took 1.5s. Estimated remaining: 6m 0s. Rate: 149.0 symbols/min [2025-10-24T00:52:26.415837] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:26.456869] [DEBUG] [MAIN ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:26.508021] [DEBUG] [LOCAL ] MPC: Loaded 52270 existing records from primary storage. [2025-10-24T00:52:26.511383] [INFO ] [MAIN ] MPC: Loaded 52270 primary data records. [2025-10-24T00:52:26.600053] [DEBUG] [LOCAL ] MPLX: Loaded 51157 existing records from primary storage. [2025-10-24T00:52:26.624444] [INFO ] [MAIN ] MPLX: Loaded 51157 primary data records. [2025-10-24T00:52:26.951566] [INFO ] [MAIN ] MPA: Generated 139 derivative records from 5223 primary records. [2025-10-24T00:52:26.952312] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-24T00:52:26.970505] [FATAL] [LOCAL ] MPA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:27.009750] [FATAL] [MAIN ] MPA: Failed to save derivative data. [2025-10-24T00:52:27.013751] [INFO ] [MAIN ] Derivative Progress: 1270/2164 symbols completed. MPA took 0.9s. Estimated remaining: 6m 0s. Rate: 148.9 symbols/min [2025-10-24T00:52:27.030965] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:27.161196] [DEBUG] [LOCAL ] MPV: Loaded 4393 existing records from primary storage. [2025-10-24T00:52:27.163311] [INFO ] [MAIN ] MPV: Loaded 4393 primary data records. [2025-10-24T00:52:27.551857] [DEBUG] [MAIN ] MPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:27.590551] [DEBUG] [MAIN ] MPLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:27.654839] [DEBUG] [MAIN ] MPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:27.659639] [INFO ] [MAIN ] MPC: Generated 139 derivative records from 52270 primary records. [2025-10-24T00:52:27.675035] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-24T00:52:27.679676] [FATAL] [LOCAL ] MPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:27.679961] [FATAL] [MAIN ] MPC: Failed to save derivative data. [2025-10-24T00:52:27.686341] [INFO ] [MAIN ] Derivative Progress: 1271/2164 symbols completed. MPC took 1.5s. Estimated remaining: 6m 0s. Rate: 148.8 symbols/min [2025-10-24T00:52:27.688780] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:27.692219] [INFO ] [MAIN ] MPLX: Generated 139 derivative records from 51157 primary records. [2025-10-24T00:52:27.695690] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-24T00:52:27.696465] [FATAL] [LOCAL ] MPLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:27.696617] [FATAL] [MAIN ] MPLX: Failed to save derivative data. [2025-10-24T00:52:27.701265] [INFO ] [MAIN ] Derivative Progress: 1272/2164 symbols completed. MPLX took 1.3s. Estimated remaining: 5m 59s. Rate: 148.9 symbols/min [2025-10-24T00:52:27.701705] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:27.717405] [DEBUG] [LOCAL ] MPX: Loaded 3981 existing records from primary storage. [2025-10-24T00:52:27.721106] [INFO ] [MAIN ] MPX: Loaded 3981 primary data records. [2025-10-24T00:52:27.801683] [INFO ] [MAIN ] MPV: Generated 139 derivative records from 4393 primary records. [2025-10-24T00:52:27.853116] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-24T00:52:27.875866] [FATAL] [LOCAL ] MPV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:27.929565] [FATAL] [MAIN ] MPV: Failed to save derivative data. [2025-10-24T00:52:28.071165] [INFO ] [MAIN ] Derivative Progress: 1273/2164 symbols completed. MPV took 1.0s. Estimated remaining: 5m 59s. Rate: 148.9 symbols/min [2025-10-24T00:52:28.073099] [DEBUG] [LOCAL ] MPW: Loaded 53872 existing records from primary storage. [2025-10-24T00:52:28.074387] [INFO ] [MAIN ] MPW: Loaded 53872 primary data records. [2025-10-24T00:52:28.419444] [DEBUG] [MAIN ] MPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:28.472990] [DEBUG] [MAIN ] MPW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:28.496382] [INFO ] [MAIN ] MPX: Generated 139 derivative records from 3981 primary records. [2025-10-24T00:52:28.498199] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-24T00:52:28.498838] [FATAL] [LOCAL ] MPX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:28.499093] [FATAL] [MAIN ] MPX: Failed to save derivative data. [2025-10-24T00:52:28.505163] [INFO ] [MAIN ] Derivative Progress: 1274/2164 symbols completed. MPX took 0.8s. Estimated remaining: 5m 59s. Rate: 148.9 symbols/min [2025-10-24T00:52:28.517219] [INFO ] [MAIN ] MPW: Generated 139 derivative records from 53872 primary records. [2025-10-24T00:52:28.517429] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-24T00:52:28.517712] [FATAL] [LOCAL ] MPW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:28.517795] [FATAL] [MAIN ] MPW: Failed to save derivative data. [2025-10-24T00:52:28.520734] [INFO ] [MAIN ] Derivative Progress: 1275/2164 symbols completed. MPW took 0.8s. Estimated remaining: 5m 58s. Rate: 149.1 symbols/min [2025-10-24T00:52:28.521229] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:28.521764] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:28.521407] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:28.533480] [DEBUG] [LOCAL ] MQT: Loaded 8068 existing records from primary storage. [2025-10-24T00:52:28.533725] [INFO ] [MAIN ] MQT: Loaded 8068 primary data records. [2025-10-24T00:52:28.675960] [DEBUG] [LOCAL ] MQY: Loaded 16740 existing records from primary storage. [2025-10-24T00:52:28.714300] [INFO ] [MAIN ] MQY: Loaded 16740 primary data records. [2025-10-24T00:52:28.801285] [DEBUG] [LOCAL ] MRC: Loaded 37336 existing records from primary storage. [2025-10-24T00:52:28.944213] [INFO ] [MAIN ] MRC: Loaded 37336 primary data records. [2025-10-24T00:52:29.610941] [DEBUG] [MAIN ] MQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:29.655517] [DEBUG] [MAIN ] MQY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:29.699098] [DEBUG] [MAIN ] MRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:29.737415] [INFO ] [MAIN ] MQT: Generated 139 derivative records from 8068 primary records. [2025-10-24T00:52:29.739526] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-24T00:52:29.743391] [FATAL] [LOCAL ] MQT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:29.743799] [FATAL] [MAIN ] MQT: Failed to save derivative data. [2025-10-24T00:52:29.748675] [INFO ] [MAIN ] Derivative Progress: 1276/2164 symbols completed. MQT took 1.2s. Estimated remaining: 5m 58s. Rate: 148.8 symbols/min [2025-10-24T00:52:29.751523] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:29.762689] [INFO ] [MAIN ] MQY: Generated 139 derivative records from 16740 primary records. [2025-10-24T00:52:29.763457] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-24T00:52:29.764032] [FATAL] [LOCAL ] MQY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:29.764231] [FATAL] [MAIN ] MQY: Failed to save derivative data. [2025-10-24T00:52:29.773108] [INFO ] [MAIN ] Derivative Progress: 1277/2164 symbols completed. MQY took 1.3s. Estimated remaining: 5m 57s. Rate: 148.9 symbols/min [2025-10-24T00:52:29.773413] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:29.784402] [INFO ] [MAIN ] MRC: Generated 139 derivative records from 37336 primary records. [2025-10-24T00:52:29.784613] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-24T00:52:29.784898] [FATAL] [LOCAL ] MRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:29.785101] [FATAL] [MAIN ] MRC: Failed to save derivative data. [2025-10-24T00:52:29.788189] [INFO ] [MAIN ] Derivative Progress: 1278/2164 symbols completed. MRC took 1.3s. Estimated remaining: 5m 57s. Rate: 149.0 symbols/min [2025-10-24T00:52:29.788480] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:29.853593] [DEBUG] [LOCAL ] MSA: Loaded 18945 existing records from primary storage. [2025-10-24T00:52:29.854538] [DEBUG] [LOCAL ] MRK: Loaded 54180 existing records from primary storage. [2025-10-24T00:52:29.854859] [INFO ] [MAIN ] MSA: Loaded 18945 primary data records. [2025-10-24T00:52:29.855019] [INFO ] [MAIN ] MRK: Loaded 54180 primary data records. [2025-10-24T00:52:30.110396] [DEBUG] [LOCAL ] MS: Loaded 54077 existing records from primary storage. [2025-10-24T00:52:30.132017] [INFO ] [MAIN ] MS: Loaded 54077 primary data records. [2025-10-24T00:52:30.934151] [DEBUG] [MAIN ] MSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:30.963918] [DEBUG] [MAIN ] MRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:31.018218] [DEBUG] [MAIN ] MS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:31.055061] [INFO ] [MAIN ] MSA: Generated 139 derivative records from 18945 primary records. [2025-10-24T00:52:31.056829] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-24T00:52:31.059680] [FATAL] [LOCAL ] MSA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:31.059979] [FATAL] [MAIN ] MSA: Failed to save derivative data. [2025-10-24T00:52:31.061905] [INFO ] [MAIN ] Derivative Progress: 1279/2164 symbols completed. MSA took 1.3s. Estimated remaining: 5m 57s. Rate: 148.8 symbols/min [2025-10-24T00:52:31.062335] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:31.071908] [INFO ] [MAIN ] MRK: Generated 139 derivative records from 54180 primary records. [2025-10-24T00:52:31.072854] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-10-24T00:52:31.075466] [FATAL] [LOCAL ] MRK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:31.075632] [FATAL] [MAIN ] MRK: Failed to save derivative data. [2025-10-24T00:52:31.080325] [INFO ] [MAIN ] Derivative Progress: 1280/2164 symbols completed. MRK took 1.3s. Estimated remaining: 5m 56s. Rate: 148.9 symbols/min [2025-10-24T00:52:31.080921] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:31.088636] [DEBUG] [LOCAL ] MSB: Loaded 8024 existing records from primary storage. [2025-10-24T00:52:31.089638] [INFO ] [MAIN ] MSB: Loaded 8024 primary data records. [2025-10-24T00:52:31.232061] [INFO ] [MAIN ] MS: Generated 139 derivative records from 54077 primary records. [2025-10-24T00:52:31.280171] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-24T00:52:31.300732] [DEBUG] [LOCAL ] MSCI: Loaded 34366 existing records from primary storage. [2025-10-24T00:52:31.407977] [FATAL] [LOCAL ] MS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:31.417290] [INFO ] [MAIN ] MSCI: Loaded 34366 primary data records. [2025-10-24T00:52:31.417530] [FATAL] [MAIN ] MS: Failed to save derivative data. [2025-10-24T00:52:31.420941] [INFO ] [MAIN ] Derivative Progress: 1281/2164 symbols completed. MS took 1.6s. Estimated remaining: 5m 56s. Rate: 148.9 symbols/min [2025-10-24T00:52:31.421405] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:31.614988] [DEBUG] [LOCAL ] MSD: Loaded 16719 existing records from primary storage. [2025-10-24T00:52:31.620564] [INFO ] [MAIN ] MSD: Loaded 16719 primary data records. [2025-10-24T00:52:31.968522] [DEBUG] [MAIN ] MSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:32.159856] [DEBUG] [MAIN ] MSCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:32.197866] [INFO ] [MAIN ] MSB: Generated 139 derivative records from 8024 primary records. [2025-10-24T00:52:32.200944] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-24T00:52:32.201504] [FATAL] [LOCAL ] MSB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:32.203137] [FATAL] [MAIN ] MSB: Failed to save derivative data. [2025-10-24T00:52:32.203024] [DEBUG] [MAIN ] MSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:32.205342] [INFO ] [MAIN ] Derivative Progress: 1282/2164 symbols completed. MSB took 1.1s. Estimated remaining: 5m 56s. Rate: 148.8 symbols/min [2025-10-24T00:52:32.216406] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:32.262899] [INFO ] [MAIN ] MSCI: Generated 139 derivative records from 34366 primary records. [2025-10-24T00:52:32.263115] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-24T00:52:32.266542] [FATAL] [LOCAL ] MSCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:32.266837] [FATAL] [MAIN ] MSCI: Failed to save derivative data. [2025-10-24T00:52:32.272857] [INFO ] [MAIN ] Derivative Progress: 1283/2164 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 55s. Rate: 148.9 symbols/min [2025-10-24T00:52:32.273288] [INFO ] [MAIN ] MSD: Generated 139 derivative records from 16719 primary records. [2025-10-24T00:52:32.273467] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:32.273703] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-24T00:52:32.274322] [FATAL] [LOCAL ] MSD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:32.274400] [FATAL] [MAIN ] MSD: Failed to save derivative data. [2025-10-24T00:52:32.277358] [INFO ] [MAIN ] Derivative Progress: 1284/2164 symbols completed. MSD took 0.9s. Estimated remaining: 5m 54s. Rate: 149.0 symbols/min [2025-10-24T00:52:32.277608] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:32.293668] [DEBUG] [LOCAL ] MSDL: Loaded 38893 existing records from primary storage. [2025-10-24T00:52:32.294178] [INFO ] [MAIN ] MSDL: Loaded 38893 primary data records. [2025-10-24T00:52:32.438075] [DEBUG] [LOCAL ] MSGE: Loaded 27255 existing records from primary storage. [2025-10-24T00:52:32.438707] [INFO ] [MAIN ] MSGE: Loaded 27255 primary data records. [2025-10-24T00:52:32.438836] [DEBUG] [LOCAL ] MSGS: Loaded 17313 existing records from primary storage. [2025-10-24T00:52:32.520933] [INFO ] [MAIN ] MSGS: Loaded 17313 primary data records. [2025-10-24T00:52:33.293404] [DEBUG] [MAIN ] MSDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:33.334722] [DEBUG] [MAIN ] MSGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:33.366422] [DEBUG] [MAIN ] MSGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:33.438617] [INFO ] [MAIN ] MSDL: Generated 139 derivative records from 38893 primary records. [2025-10-24T00:52:33.439311] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-24T00:52:33.441136] [FATAL] [LOCAL ] MSDL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:33.443255] [FATAL] [MAIN ] MSDL: Failed to save derivative data. [2025-10-24T00:52:33.447253] [INFO ] [MAIN ] Derivative Progress: 1285/2164 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 54s. Rate: 148.8 symbols/min [2025-10-24T00:52:33.447520] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:33.450042] [INFO ] [MAIN ] MSGE: Generated 139 derivative records from 27255 primary records. [2025-10-24T00:52:33.452562] [INFO ] [MAIN ] MSGS: Generated 139 derivative records from 17313 primary records. [2025-10-24T00:52:33.452698] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-24T00:52:33.452951] [FATAL] [LOCAL ] MSGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:33.453157] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-24T00:52:33.453399] [FATAL] [LOCAL ] MSGE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:33.453115] [FATAL] [MAIN ] MSGS: Failed to save derivative data. [2025-10-24T00:52:33.456606] [INFO ] [MAIN ] Derivative Progress: 1286/2164 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 54s. Rate: 148.9 symbols/min [2025-10-24T00:52:33.456776] [FATAL] [MAIN ] MSGE: Failed to save derivative data. [2025-10-24T00:52:33.456943] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:33.459996] [INFO ] [MAIN ] Derivative Progress: 1287/2164 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 53s. Rate: 149.0 symbols/min [2025-10-24T00:52:33.460673] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:33.503418] [DEBUG] [LOCAL ] MSI: Loaded 39876 existing records from primary storage. [2025-10-24T00:52:33.503586] [INFO ] [MAIN ] MSI: Loaded 39876 primary data records. [2025-10-24T00:52:33.604061] [DEBUG] [LOCAL ] MSM: Loaded 35752 existing records from primary storage. [2025-10-24T00:52:33.644200] [INFO ] [MAIN ] MSM: Loaded 35752 primary data records. [2025-10-24T00:52:33.693570] [DEBUG] [LOCAL ] MT: Loaded 50743 existing records from primary storage. [2025-10-24T00:52:33.815373] [INFO ] [MAIN ] MT: Loaded 50743 primary data records. [2025-10-24T00:52:34.787594] [DEBUG] [MAIN ] MSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:34.836903] [DEBUG] [MAIN ] MSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:34.886164] [DEBUG] [MAIN ] MT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:34.912257] [INFO ] [MAIN ] MSI: Generated 139 derivative records from 39876 primary records. [2025-10-24T00:52:34.920338] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-24T00:52:34.924587] [FATAL] [LOCAL ] MSI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:34.931015] [FATAL] [MAIN ] MSI: Failed to save derivative data. [2025-10-24T00:52:34.933314] [INFO ] [MAIN ] Derivative Progress: 1288/2164 symbols completed. MSI took 1.5s. Estimated remaining: 5m 53s. Rate: 148.7 symbols/min [2025-10-24T00:52:34.945109] [INFO ] [MAIN ] MSM: Generated 139 derivative records from 35752 primary records. [2025-10-24T00:52:34.947437] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-24T00:52:34.950453] [FATAL] [LOCAL ] MSM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:34.950977] [FATAL] [MAIN ] MSM: Failed to save derivative data. [2025-10-24T00:52:34.954813] [INFO ] [MAIN ] Derivative Progress: 1289/2164 symbols completed. MSM took 1.5s. Estimated remaining: 5m 53s. Rate: 148.8 symbols/min [2025-10-24T00:52:34.958495] [INFO ] [MAIN ] MT: Generated 139 derivative records from 50743 primary records. [2025-10-24T00:52:34.958598] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-24T00:52:34.958829] [FATAL] [LOCAL ] MT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:34.958908] [FATAL] [MAIN ] MT: Failed to save derivative data. [2025-10-24T00:52:34.961811] [INFO ] [MAIN ] Derivative Progress: 1290/2164 symbols completed. MT took 1.5s. Estimated remaining: 5m 52s. Rate: 148.9 symbols/min [2025-10-24T00:52:34.962435] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:34.962357] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:34.962279] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:34.985513] [DEBUG] [LOCAL ] MTD: Loaded 15251 existing records from primary storage. [2025-10-24T00:52:34.985811] [INFO ] [MAIN ] MTD: Loaded 15251 primary data records. [2025-10-24T00:52:35.167131] [DEBUG] [LOCAL ] MTB: Loaded 46978 existing records from primary storage. [2025-10-24T00:52:35.204765] [INFO ] [MAIN ] MTB: Loaded 46978 primary data records. [2025-10-24T00:52:35.270408] [DEBUG] [LOCAL ] MTDR: Loaded 52152 existing records from primary storage. [2025-10-24T00:52:35.435732] [INFO ] [MAIN ] MTDR: Loaded 52152 primary data records. [2025-10-24T00:52:36.108260] [DEBUG] [MAIN ] MTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:36.157007] [DEBUG] [MAIN ] MTB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:52:36.190413] [DEBUG] [MAIN ] MTDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:36.239370] [INFO ] [MAIN ] MTD: Generated 139 derivative records from 15251 primary records. [2025-10-24T00:52:36.242007] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-24T00:52:36.242557] [FATAL] [LOCAL ] MTD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:36.245383] [FATAL] [MAIN ] MTD: Failed to save derivative data. [2025-10-24T00:52:36.247953] [INFO ] [MAIN ] Derivative Progress: 1291/2164 symbols completed. MTD took 1.3s. Estimated remaining: 5m 52s. Rate: 148.7 symbols/min [2025-10-24T00:52:36.250493] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:36.256572] [INFO ] [MAIN ] MTB: Generated 139 derivative records from 46978 primary records. [2025-10-24T00:52:36.257005] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-24T00:52:36.257281] [FATAL] [LOCAL ] MTB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:36.257494] [FATAL] [MAIN ] MTB: Failed to save derivative data. [2025-10-24T00:52:36.260621] [INFO ] [MAIN ] Derivative Progress: 1292/2164 symbols completed. MTB took 1.3s. Estimated remaining: 5m 52s. Rate: 148.8 symbols/min [2025-10-24T00:52:36.264240] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:36.264838] [INFO ] [MAIN ] MTDR: Generated 139 derivative records from 52152 primary records. [2025-10-24T00:52:36.265415] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-24T00:52:36.265619] [FATAL] [LOCAL ] MTDR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:36.265723] [FATAL] [MAIN ] MTDR: Failed to save derivative data. [2025-10-24T00:52:36.268638] [INFO ] [MAIN ] Derivative Progress: 1293/2164 symbols completed. MTDR took 1.3s. Estimated remaining: 5m 51s. Rate: 148.9 symbols/min [2025-10-24T00:52:36.268912] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:36.328390] [DEBUG] [LOCAL ] MTN: Loaded 39602 existing records from primary storage. [2025-10-24T00:52:36.328566] [INFO ] [MAIN ] MTN: Loaded 39602 primary data records. [2025-10-24T00:52:36.456971] [DEBUG] [LOCAL ] MTH: Loaded 44086 existing records from primary storage. [2025-10-24T00:52:36.473520] [DEBUG] [LOCAL ] MTG: Loaded 51417 existing records from primary storage. [2025-10-24T00:52:36.529030] [INFO ] [MAIN ] MTG: Loaded 51417 primary data records. [2025-10-24T00:52:36.514738] [INFO ] [MAIN ] MTH: Loaded 44086 primary data records. [2025-10-24T00:52:37.285500] [DEBUG] [MAIN ] MTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:37.347223] [DEBUG] [MAIN ] MTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:37.346846] [DEBUG] [MAIN ] MTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:37.386903] [INFO ] [MAIN ] MTN: Generated 139 derivative records from 39602 primary records. [2025-10-24T00:52:37.392596] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-24T00:52:37.394369] [FATAL] [LOCAL ] MTN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:37.401425] [FATAL] [MAIN ] MTN: Failed to save derivative data. [2025-10-24T00:52:37.403478] [INFO ] [MAIN ] Derivative Progress: 1294/2164 symbols completed. MTN took 1.1s. Estimated remaining: 5m 51s. Rate: 148.7 symbols/min [2025-10-24T00:52:37.403955] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:37.418693] [INFO ] [MAIN ] MTH: Generated 139 derivative records from 44086 primary records. [2025-10-24T00:52:37.421555] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-24T00:52:37.422178] [FATAL] [LOCAL ] MTH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:37.422467] [FATAL] [MAIN ] MTH: Failed to save derivative data. [2025-10-24T00:52:37.426698] [INFO ] [MAIN ] Derivative Progress: 1295/2164 symbols completed. MTH took 1.2s. Estimated remaining: 5m 50s. Rate: 148.8 symbols/min [2025-10-24T00:52:37.432948] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:37.433845] [INFO ] [MAIN ] MTG: Generated 139 derivative records from 51417 primary records. [2025-10-24T00:52:37.433984] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-24T00:52:37.434237] [FATAL] [LOCAL ] MTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:37.434326] [FATAL] [MAIN ] MTG: Failed to save derivative data. [2025-10-24T00:52:37.437138] [INFO ] [MAIN ] Derivative Progress: 1296/2164 symbols completed. MTG took 1.2s. Estimated remaining: 5m 50s. Rate: 148.9 symbols/min [2025-10-24T00:52:37.437994] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:37.445970] [DEBUG] [LOCAL ] MTRN: Loaded 18229 existing records from primary storage. [2025-10-24T00:52:37.446206] [INFO ] [MAIN ] MTRN: Loaded 18229 primary data records. [2025-10-24T00:52:37.650900] [DEBUG] [LOCAL ] MTUS: Loaded 27624 existing records from primary storage. [2025-10-24T00:52:37.764082] [INFO ] [MAIN ] MTUS: Loaded 27624 primary data records. [2025-10-24T00:52:37.774291] [DEBUG] [LOCAL ] MTW: Loaded 26615 existing records from primary storage. [2025-10-24T00:52:37.799825] [INFO ] [MAIN ] MTW: Loaded 26615 primary data records. [2025-10-24T00:52:38.439750] [DEBUG] [MAIN ] MTRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:38.506987] [DEBUG] [MAIN ] MTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:38.507325] [DEBUG] [MAIN ] MTUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:38.539734] [INFO ] [MAIN ] MTRN: Generated 139 derivative records from 18229 primary records. [2025-10-24T00:52:38.540956] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-24T00:52:38.541250] [FATAL] [LOCAL ] MTRN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:38.542749] [FATAL] [MAIN ] MTRN: Failed to save derivative data. [2025-10-24T00:52:38.545003] [INFO ] [MAIN ] Derivative Progress: 1297/2164 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 50s. Rate: 148.7 symbols/min [2025-10-24T00:52:38.545435] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:38.591942] [INFO ] [MAIN ] MTW: Generated 139 derivative records from 26615 primary records. [2025-10-24T00:52:38.591293] [DEBUG] [LOCAL ] MTX: Loaded 22713 existing records from primary storage. [2025-10-24T00:52:38.593360] [INFO ] [MAIN ] MTX: Loaded 22713 primary data records. [2025-10-24T00:52:38.593290] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-24T00:52:38.605206] [FATAL] [LOCAL ] MTW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:38.658626] [FATAL] [MAIN ] MTW: Failed to save derivative data. [2025-10-24T00:52:38.661441] [INFO ] [MAIN ] Derivative Progress: 1298/2164 symbols completed. MTW took 1.2s. Estimated remaining: 5m 49s. Rate: 148.8 symbols/min [2025-10-24T00:52:38.661731] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:38.669422] [INFO ] [MAIN ] MTUS: Generated 139 derivative records from 27624 primary records. [2025-10-24T00:52:38.676731] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-24T00:52:38.682083] [FATAL] [LOCAL ] MTUS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:38.687559] [FATAL] [MAIN ] MTUS: Failed to save derivative data. [2025-10-24T00:52:38.690342] [INFO ] [MAIN ] Derivative Progress: 1299/2164 symbols completed. MTUS took 1.3s. Estimated remaining: 5m 49s. Rate: 148.9 symbols/min [2025-10-24T00:52:38.696725] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:38.911357] [DEBUG] [LOCAL ] MUA: Loaded 11632 existing records from primary storage. [2025-10-24T00:52:38.911604] [INFO ] [MAIN ] MUA: Loaded 11632 primary data records. [2025-10-24T00:52:39.062697] [DEBUG] [LOCAL ] MTZ: Loaded 43006 existing records from primary storage. [2025-10-24T00:52:39.083550] [INFO ] [MAIN ] MTZ: Loaded 43006 primary data records. [2025-10-24T00:52:39.555730] [DEBUG] [MAIN ] MTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:39.605071] [DEBUG] [MAIN ] MUA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:39.646845] [DEBUG] [MAIN ] MTZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:52:39.678394] [INFO ] [MAIN ] MTX: Generated 139 derivative records from 22713 primary records. [2025-10-24T00:52:39.683739] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-24T00:52:39.686748] [FATAL] [LOCAL ] MTX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:39.687377] [FATAL] [MAIN ] MTX: Failed to save derivative data. [2025-10-24T00:52:39.690137] [INFO ] [MAIN ] Derivative Progress: 1300/2164 symbols completed. MTX took 1.1s. Estimated remaining: 5m 49s. Rate: 148.7 symbols/min [2025-10-24T00:52:39.692081] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:39.705925] [INFO ] [MAIN ] MUA: Generated 139 derivative records from 11632 primary records. [2025-10-24T00:52:39.708502] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-24T00:52:39.708886] [FATAL] [LOCAL ] MUA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:39.710273] [FATAL] [MAIN ] MUA: Failed to save derivative data. [2025-10-24T00:52:39.712918] [INFO ] [MAIN ] Derivative Progress: 1301/2164 symbols completed. MUA took 1.0s. Estimated remaining: 5m 48s. Rate: 148.8 symbols/min [2025-10-24T00:52:39.718566] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:39.721478] [INFO ] [MAIN ] MTZ: Generated 139 derivative records from 43006 primary records. [2025-10-24T00:52:39.721563] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-24T00:52:39.721803] [FATAL] [LOCAL ] MTZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:39.721896] [FATAL] [MAIN ] MTZ: Failed to save derivative data. [2025-10-24T00:52:39.724326] [INFO ] [MAIN ] Derivative Progress: 1302/2164 symbols completed. MTZ took 1.1s. Estimated remaining: 5m 47s. Rate: 149.0 symbols/min [2025-10-24T00:52:39.724527] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:39.734313] [DEBUG] [LOCAL ] MUC: Loaded 20783 existing records from primary storage. [2025-10-24T00:52:39.734565] [INFO ] [MAIN ] MUC: Loaded 20783 primary data records. [2025-10-24T00:52:39.820829] [DEBUG] [LOCAL ] MUE: Loaded 12258 existing records from primary storage. [2025-10-24T00:52:39.840288] [INFO ] [MAIN ] MUE: Loaded 12258 primary data records. [2025-10-24T00:52:40.293772] [DEBUG] [LOCAL ] MUFG: Loaded 52806 existing records from primary storage. [2025-10-24T00:52:40.294609] [INFO ] [MAIN ] MUFG: Loaded 52806 primary data records. [2025-10-24T00:52:40.735743] [DEBUG] [MAIN ] MUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:40.778515] [DEBUG] [MAIN ] MUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:40.820917] [DEBUG] [MAIN ] MUFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:40.854859] [INFO ] [MAIN ] MUC: Generated 139 derivative records from 20783 primary records. [2025-10-24T00:52:40.856252] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-24T00:52:40.861236] [FATAL] [LOCAL ] MUC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:40.864326] [FATAL] [MAIN ] MUC: Failed to save derivative data. [2025-10-24T00:52:40.866887] [INFO ] [MAIN ] Derivative Progress: 1303/2164 symbols completed. MUC took 1.2s. Estimated remaining: 5m 47s. Rate: 148.7 symbols/min [2025-10-24T00:52:40.879578] [INFO ] [MAIN ] MUE: Generated 139 derivative records from 12258 primary records. [2025-10-24T00:52:40.882015] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-24T00:52:40.882592] [FATAL] [LOCAL ] MUE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:40.883908] [FATAL] [MAIN ] MUE: Failed to save derivative data. [2025-10-24T00:52:40.886526] [INFO ] [MAIN ] Derivative Progress: 1304/2164 symbols completed. MUE took 1.2s. Estimated remaining: 5m 47s. Rate: 148.9 symbols/min [2025-10-24T00:52:40.888313] [INFO ] [MAIN ] MUFG: Generated 139 derivative records from 52806 primary records. [2025-10-24T00:52:40.888419] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-24T00:52:40.888621] [FATAL] [LOCAL ] MUFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:40.888729] [FATAL] [MAIN ] MUFG: Failed to save derivative data. [2025-10-24T00:52:40.891719] [INFO ] [MAIN ] Derivative Progress: 1305/2164 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 46s. Rate: 149.0 symbols/min [2025-10-24T00:52:40.892183] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:40.892116] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:40.892270] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:40.914748] [DEBUG] [LOCAL ] MUJ: Loaded 13954 existing records from primary storage. [2025-10-24T00:52:40.915039] [INFO ] [MAIN ] MUJ: Loaded 13954 primary data records. [2025-10-24T00:52:41.004774] [DEBUG] [LOCAL ] MUSA: Loaded 24766 existing records from primary storage. [2025-10-24T00:52:41.027682] [INFO ] [MAIN ] MUSA: Loaded 24766 primary data records. [2025-10-24T00:52:41.367956] [DEBUG] [LOCAL ] MUR: Loaded 53250 existing records from primary storage. [2025-10-24T00:52:41.549973] [INFO ] [MAIN ] MUR: Loaded 53250 primary data records. [2025-10-24T00:52:41.946941] [DEBUG] [MAIN ] MUJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:41.952674] [DEBUG] [MAIN ] MUSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:42.026340] [DEBUG] [MAIN ] MUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:42.054150] [INFO ] [MAIN ] MUJ: Generated 139 derivative records from 13954 primary records. [2025-10-24T00:52:42.058415] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-24T00:52:42.059299] [FATAL] [LOCAL ] MUJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:42.059595] [FATAL] [MAIN ] MUJ: Failed to save derivative data. [2025-10-24T00:52:42.063455] [INFO ] [MAIN ] MUSA: Generated 139 derivative records from 24766 primary records. [2025-10-24T00:52:42.063982] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-24T00:52:42.064250] [FATAL] [LOCAL ] MUSA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:42.068931] [INFO ] [MAIN ] Derivative Progress: 1306/2164 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 46s. Rate: 148.7 symbols/min [2025-10-24T00:52:42.066459] [FATAL] [MAIN ] MUSA: Failed to save derivative data. [2025-10-24T00:52:42.072726] [INFO ] [MAIN ] Derivative Progress: 1307/2164 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 45s. Rate: 148.9 symbols/min [2025-10-24T00:52:42.074995] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:42.072592] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:42.088939] [INFO ] [MAIN ] MUR: Generated 139 derivative records from 53250 primary records. [2025-10-24T00:52:42.089126] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-24T00:52:42.092952] [FATAL] [LOCAL ] MUR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:42.093126] [FATAL] [MAIN ] MUR: Failed to save derivative data. [2025-10-24T00:52:42.095916] [INFO ] [MAIN ] Derivative Progress: 1308/2164 symbols completed. MUR took 1.2s. Estimated remaining: 5m 45s. Rate: 149.0 symbols/min [2025-10-24T00:52:42.096820] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:42.102774] [DEBUG] [LOCAL ] MVF: Loaded 12832 existing records from primary storage. [2025-10-24T00:52:42.104030] [INFO ] [MAIN ] MVF: Loaded 12832 primary data records. [2025-10-24T00:52:42.200275] [DEBUG] [LOCAL ] MVO: Loaded 9083 existing records from primary storage. [2025-10-24T00:52:42.228031] [INFO ] [MAIN ] MVO: Loaded 9083 primary data records. [2025-10-24T00:52:42.423596] [DEBUG] [LOCAL ] MUX: Loaded 44187 existing records from primary storage. [2025-10-24T00:52:42.543033] [INFO ] [MAIN ] MUX: Loaded 44187 primary data records. [2025-10-24T00:52:43.061050] [DEBUG] [MAIN ] MVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:43.090853] [DEBUG] [MAIN ] MVO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:52:43.123917] [DEBUG] [MAIN ] MUX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:43.170029] [INFO ] [MAIN ] MVF: Generated 139 derivative records from 12832 primary records. [2025-10-24T00:52:43.173304] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-24T00:52:43.177108] [FATAL] [LOCAL ] MVF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:43.177570] [FATAL] [MAIN ] MVF: Failed to save derivative data. [2025-10-24T00:52:43.180057] [INFO ] [MAIN ] Derivative Progress: 1309/2164 symbols completed. MVF took 1.1s. Estimated remaining: 5m 45s. Rate: 148.8 symbols/min [2025-10-24T00:52:43.183083] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:43.191939] [INFO ] [MAIN ] MVO: Generated 139 derivative records from 9083 primary records. [2025-10-24T00:52:43.193676] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-24T00:52:43.194054] [FATAL] [LOCAL ] MVO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:43.196168] [FATAL] [MAIN ] MVO: Failed to save derivative data. [2025-10-24T00:52:43.199061] [INFO ] [MAIN ] Derivative Progress: 1310/2164 symbols completed. MVO took 1.1s. Estimated remaining: 5m 44s. Rate: 148.9 symbols/min [2025-10-24T00:52:43.199314] [INFO ] [MAIN ] MUX: Generated 139 derivative records from 44187 primary records. [2025-10-24T00:52:43.199556] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-24T00:52:43.199481] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:43.200058] [FATAL] [LOCAL ] MUX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:43.203061] [FATAL] [MAIN ] MUX: Failed to save derivative data. [2025-10-24T00:52:43.205772] [INFO ] [MAIN ] Derivative Progress: 1311/2164 symbols completed. MUX took 1.1s. Estimated remaining: 5m 44s. Rate: 149.0 symbols/min [2025-10-24T00:52:43.206216] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:43.211530] [DEBUG] [LOCAL ] MVT: Loaded 9850 existing records from primary storage. [2025-10-24T00:52:43.211773] [INFO ] [MAIN ] MVT: Loaded 9850 primary data records. [2025-10-24T00:52:43.417907] [DEBUG] [LOCAL ] MX: Loaded 22387 existing records from primary storage. [2025-10-24T00:52:43.527037] [INFO ] [MAIN ] MX: Loaded 22387 primary data records. [2025-10-24T00:52:43.622721] [DEBUG] [LOCAL ] MWA: Loaded 46053 existing records from primary storage. [2025-10-24T00:52:43.640601] [INFO ] [MAIN ] MWA: Loaded 46053 primary data records. [2025-10-24T00:52:44.233228] [DEBUG] [MAIN ] MVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:44.281716] [DEBUG] [MAIN ] MX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:44.324141] [DEBUG] [MAIN ] MWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:44.351678] [INFO ] [MAIN ] MVT: Generated 139 derivative records from 9850 primary records. [2025-10-24T00:52:44.352759] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-24T00:52:44.353045] [FATAL] [LOCAL ] MVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:44.353223] [FATAL] [MAIN ] MVT: Failed to save derivative data. [2025-10-24T00:52:44.359825] [INFO ] [MAIN ] Derivative Progress: 1312/2164 symbols completed. MVT took 1.2s. Estimated remaining: 5m 44s. Rate: 148.8 symbols/min [2025-10-24T00:52:44.363035] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:44.379037] [DEBUG] [LOCAL ] MXF: Loaded 5580 existing records from primary storage. [2025-10-24T00:52:44.381718] [INFO ] [MAIN ] MX: Generated 139 derivative records from 22387 primary records. [2025-10-24T00:52:44.382243] [INFO ] [MAIN ] MXF: Loaded 5580 primary data records. [2025-10-24T00:52:44.382320] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-24T00:52:44.385342] [FATAL] [LOCAL ] MX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:44.423042] [FATAL] [MAIN ] MX: Failed to save derivative data. [2025-10-24T00:52:44.467210] [INFO ] [MAIN ] Derivative Progress: 1313/2164 symbols completed. MX took 1.3s. Estimated remaining: 5m 43s. Rate: 148.9 symbols/min [2025-10-24T00:52:44.497600] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:44.522132] [INFO ] [MAIN ] MWA: Generated 139 derivative records from 46053 primary records. [2025-10-24T00:52:44.615765] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-24T00:52:44.699248] [FATAL] [LOCAL ] MWA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:44.699581] [FATAL] [MAIN ] MWA: Failed to save derivative data. [2025-10-24T00:52:44.702261] [INFO ] [MAIN ] Derivative Progress: 1314/2164 symbols completed. MWA took 1.5s. Estimated remaining: 5m 42s. Rate: 148.9 symbols/min [2025-10-24T00:52:44.702879] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:44.708957] [DEBUG] [LOCAL ] MYD: Loaded 13242 existing records from primary storage. [2025-10-24T00:52:44.710144] [INFO ] [MAIN ] MYD: Loaded 13242 primary data records. [2025-10-24T00:52:44.911412] [DEBUG] [LOCAL ] MYE: Loaded 24133 existing records from primary storage. [2025-10-24T00:52:44.982737] [INFO ] [MAIN ] MYE: Loaded 24133 primary data records. [2025-10-24T00:52:45.224619] [DEBUG] [MAIN ] MXF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:45.399193] [DEBUG] [MAIN ] MYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:45.415462] [INFO ] [MAIN ] MXF: Generated 139 derivative records from 5580 primary records. [2025-10-24T00:52:45.418564] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-24T00:52:45.418935] [FATAL] [LOCAL ] MXF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:45.419082] [FATAL] [MAIN ] MXF: Failed to save derivative data. [2025-10-24T00:52:45.422544] [INFO ] [MAIN ] Derivative Progress: 1315/2164 symbols completed. MXF took 1.1s. Estimated remaining: 5m 42s. Rate: 148.8 symbols/min [2025-10-24T00:52:45.424069] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:45.443072] [DEBUG] [MAIN ] MYE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:45.478623] [DEBUG] [LOCAL ] MYI: Loaded 19487 existing records from primary storage. [2025-10-24T00:52:45.481763] [INFO ] [MAIN ] MYI: Loaded 19487 primary data records. [2025-10-24T00:52:45.672028] [INFO ] [MAIN ] MYD: Generated 139 derivative records from 13242 primary records. [2025-10-24T00:52:45.791981] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-24T00:52:45.792635] [FATAL] [LOCAL ] MYD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:45.794014] [FATAL] [MAIN ] MYD: Failed to save derivative data. [2025-10-24T00:52:45.797449] [INFO ] [MAIN ] Derivative Progress: 1316/2164 symbols completed. MYD took 1.3s. Estimated remaining: 5m 42s. Rate: 148.8 symbols/min [2025-10-24T00:52:45.801539] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:45.802336] [INFO ] [MAIN ] MYE: Generated 139 derivative records from 24133 primary records. [2025-10-24T00:52:45.802868] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-24T00:52:45.803235] [FATAL] [LOCAL ] MYE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:45.803347] [FATAL] [MAIN ] MYE: Failed to save derivative data. [2025-10-24T00:52:45.806241] [INFO ] [MAIN ] Derivative Progress: 1317/2164 symbols completed. MYE took 1.1s. Estimated remaining: 5m 41s. Rate: 148.9 symbols/min [2025-10-24T00:52:45.806632] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:45.816671] [DEBUG] [LOCAL ] MYN: Loaded 10063 existing records from primary storage. [2025-10-24T00:52:45.816834] [INFO ] [MAIN ] MYN: Loaded 10063 primary data records. [2025-10-24T00:52:45.962722] [DEBUG] [MAIN ] MYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:46.190424] [DEBUG] [LOCAL ] NABL: Loaded 39110 existing records from primary storage. [2025-10-24T00:52:46.202248] [INFO ] [MAIN ] NABL: Loaded 39110 primary data records. [2025-10-24T00:52:46.427142] [INFO ] [MAIN ] MYI: Generated 139 derivative records from 19487 primary records. [2025-10-24T00:52:46.556296] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-24T00:52:46.556706] [FATAL] [LOCAL ] MYI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:46.565698] [FATAL] [MAIN ] MYI: Failed to save derivative data. [2025-10-24T00:52:46.568622] [INFO ] [MAIN ] Derivative Progress: 1318/2164 symbols completed. MYI took 1.1s. Estimated remaining: 5m 41s. Rate: 148.8 symbols/min [2025-10-24T00:52:46.581894] [DEBUG] [MAIN ] MYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:46.618957] [INFO ] [MAIN ] MYN: Generated 139 derivative records from 10063 primary records. [2025-10-24T00:52:46.620520] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-24T00:52:46.620750] [FATAL] [LOCAL ] MYN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:46.620934] [FATAL] [MAIN ] MYN: Failed to save derivative data. [2025-10-24T00:52:46.623888] [INFO ] [MAIN ] Derivative Progress: 1319/2164 symbols completed. MYN took 0.8s. Estimated remaining: 5m 40s. Rate: 148.9 symbols/min [2025-10-24T00:52:46.636790] [DEBUG] [MAIN ] NABL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:46.663173] [INFO ] [MAIN ] NABL: Generated 139 derivative records from 39110 primary records. [2025-10-24T00:52:46.663310] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-24T00:52:46.663514] [FATAL] [LOCAL ] NABL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:46.663593] [FATAL] [MAIN ] NABL: Failed to save derivative data. [2025-10-24T00:52:46.666477] [INFO ] [MAIN ] Derivative Progress: 1320/2164 symbols completed. NABL took 0.9s. Estimated remaining: 5m 40s. Rate: 149.0 symbols/min [2025-10-24T00:52:46.666898] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:46.667333] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:46.667423] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:46.678857] [DEBUG] [LOCAL ] NAN: Loaded 8556 existing records from primary storage. [2025-10-24T00:52:46.679109] [INFO ] [MAIN ] NAN: Loaded 8556 primary data records. [2025-10-24T00:52:46.807720] [DEBUG] [LOCAL ] NAC: Loaded 24674 existing records from primary storage. [2025-10-24T00:52:46.834296] [DEBUG] [LOCAL ] NAD: Loaded 33735 existing records from primary storage. [2025-10-24T00:52:46.839597] [INFO ] [MAIN ] NAC: Loaded 24674 primary data records. [2025-10-24T00:52:46.859628] [INFO ] [MAIN ] NAD: Loaded 33735 primary data records. [2025-10-24T00:52:47.633067] [DEBUG] [MAIN ] NAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:47.673880] [DEBUG] [MAIN ] NAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:47.703577] [DEBUG] [MAIN ] NAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:47.750887] [INFO ] [MAIN ] NAN: Generated 139 derivative records from 8556 primary records. [2025-10-24T00:52:47.755903] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-24T00:52:47.758445] [FATAL] [LOCAL ] NAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:47.758566] [FATAL] [MAIN ] NAN: Failed to save derivative data. [2025-10-24T00:52:47.762592] [INFO ] [MAIN ] Derivative Progress: 1321/2164 symbols completed. NAN took 1.1s. Estimated remaining: 5m 40s. Rate: 148.8 symbols/min [2025-10-24T00:52:47.764927] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:47.776195] [INFO ] [MAIN ] NAC: Generated 139 derivative records from 24674 primary records. [2025-10-24T00:52:47.778978] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-24T00:52:47.779365] [FATAL] [LOCAL ] NAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:47.780610] [FATAL] [MAIN ] NAC: Failed to save derivative data. [2025-10-24T00:52:47.784404] [INFO ] [MAIN ] Derivative Progress: 1322/2164 symbols completed. NAC took 1.1s. Estimated remaining: 5m 39s. Rate: 149.0 symbols/min [2025-10-24T00:52:47.787323] [INFO ] [MAIN ] NAD: Generated 139 derivative records from 33735 primary records. [2025-10-24T00:52:47.787536] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:47.787734] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-24T00:52:47.788211] [FATAL] [LOCAL ] NAD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:47.788509] [FATAL] [MAIN ] NAD: Failed to save derivative data. [2025-10-24T00:52:47.791147] [INFO ] [MAIN ] Derivative Progress: 1323/2164 symbols completed. NAD took 1.1s. Estimated remaining: 5m 39s. Rate: 149.1 symbols/min [2025-10-24T00:52:47.791367] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:47.807620] [DEBUG] [LOCAL ] NAZ: Loaded 2688 existing records from primary storage. [2025-10-24T00:52:47.807982] [INFO ] [MAIN ] NAZ: Loaded 2688 primary data records. [2025-10-24T00:52:47.939581] [DEBUG] [LOCAL ] NAT: Loaded 49578 existing records from primary storage. [2025-10-24T00:52:47.939875] [INFO ] [MAIN ] NAT: Loaded 49578 primary data records. [2025-10-24T00:52:48.037057] [DEBUG] [LOCAL ] NATL: Loaded 32261 existing records from primary storage. [2025-10-24T00:52:48.241935] [INFO ] [MAIN ] NATL: Loaded 32261 primary data records. [2025-10-24T00:52:48.780731] [DEBUG] [MAIN ] NAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:48.817325] [DEBUG] [MAIN ] NAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:48.859245] [DEBUG] [MAIN ] NATL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:48.893787] [INFO ] [MAIN ] NAZ: Generated 139 derivative records from 2688 primary records. [2025-10-24T00:52:48.897814] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-24T00:52:48.899162] [FATAL] [LOCAL ] NAZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:48.901885] [FATAL] [MAIN ] NAZ: Failed to save derivative data. [2025-10-24T00:52:48.903739] [INFO ] [MAIN ] NAT: Generated 139 derivative records from 49578 primary records. [2025-10-24T00:52:48.905779] [INFO ] [MAIN ] Derivative Progress: 1324/2164 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 39s. Rate: 148.9 symbols/min [2025-10-24T00:52:48.906310] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:48.906210] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-24T00:52:48.908154] [FATAL] [LOCAL ] NAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:48.908511] [FATAL] [MAIN ] NAT: Failed to save derivative data. [2025-10-24T00:52:48.914517] [INFO ] [MAIN ] Derivative Progress: 1325/2164 symbols completed. NAT took 1.1s. Estimated remaining: 5m 38s. Rate: 149.0 symbols/min [2025-10-24T00:52:48.916225] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:48.928549] [DEBUG] [LOCAL ] NBB: Loaded 9081 existing records from primary storage. [2025-10-24T00:52:48.924713] [INFO ] [MAIN ] NATL: Generated 139 derivative records from 32261 primary records. [2025-10-24T00:52:48.928796] [INFO ] [MAIN ] NBB: Loaded 9081 primary data records. [2025-10-24T00:52:48.928852] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-24T00:52:48.949747] [FATAL] [LOCAL ] NATL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:48.954839] [FATAL] [MAIN ] NATL: Failed to save derivative data. [2025-10-24T00:52:48.957518] [INFO ] [MAIN ] Derivative Progress: 1326/2164 symbols completed. NATL took 1.2s. Estimated remaining: 5m 37s. Rate: 149.1 symbols/min [2025-10-24T00:52:48.957709] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:49.080517] [DEBUG] [LOCAL ] NBHC: Loaded 23975 existing records from primary storage. [2025-10-24T00:52:49.134056] [INFO ] [MAIN ] NBHC: Loaded 23975 primary data records. [2025-10-24T00:52:49.360483] [DEBUG] [LOCAL ] NBR: Loaded 34642 existing records from primary storage. [2025-10-24T00:52:49.360764] [INFO ] [MAIN ] NBR: Loaded 34642 primary data records. [2025-10-24T00:52:49.926276] [DEBUG] [MAIN ] NBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:49.966557] [DEBUG] [MAIN ] NBHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:50.009506] [DEBUG] [MAIN ] NBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:50.036722] [INFO ] [MAIN ] NBB: Generated 139 derivative records from 9081 primary records. [2025-10-24T00:52:50.037100] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-24T00:52:50.037437] [FATAL] [LOCAL ] NBB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:50.038959] [FATAL] [MAIN ] NBB: Failed to save derivative data. [2025-10-24T00:52:50.042705] [INFO ] [MAIN ] Derivative Progress: 1327/2164 symbols completed. NBB took 1.1s. Estimated remaining: 5m 37s. Rate: 148.9 symbols/min [2025-10-24T00:52:50.043072] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:50.072880] [INFO ] [MAIN ] NBHC: Generated 139 derivative records from 23975 primary records. [2025-10-24T00:52:50.075865] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-24T00:52:50.077360] [FATAL] [LOCAL ] NBHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:50.077456] [FATAL] [MAIN ] NBHC: Failed to save derivative data. [2025-10-24T00:52:50.082420] [INFO ] [MAIN ] Derivative Progress: 1328/2164 symbols completed. NBHC took 1.2s. Estimated remaining: 5m 37s. Rate: 149.0 symbols/min [2025-10-24T00:52:50.090554] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:50.091400] [DEBUG] [LOCAL ] NBXG: Loaded 21773 existing records from primary storage. [2025-10-24T00:52:50.092026] [INFO ] [MAIN ] NBXG: Loaded 21773 primary data records. [2025-10-24T00:52:50.161146] [INFO ] [MAIN ] NBR: Generated 139 derivative records from 34642 primary records. [2025-10-24T00:52:50.175447] [DEBUG] [LOCAL ] NC: Loaded 2009 existing records from primary storage. [2025-10-24T00:52:50.180741] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-24T00:52:50.192338] [INFO ] [MAIN ] NC: Loaded 2009 primary data records. [2025-10-24T00:52:50.192246] [FATAL] [LOCAL ] NBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:50.235723] [FATAL] [MAIN ] NBR: Failed to save derivative data. [2025-10-24T00:52:50.278269] [INFO ] [MAIN ] Derivative Progress: 1329/2164 symbols completed. NBR took 1.3s. Estimated remaining: 5m 36s. Rate: 149.0 symbols/min [2025-10-24T00:52:50.302917] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:50.707560] [DEBUG] [LOCAL ] NCA: Loaded 9801 existing records from primary storage. [2025-10-24T00:52:50.708825] [INFO ] [MAIN ] NCA: Loaded 9801 primary data records. [2025-10-24T00:52:51.043132] [DEBUG] [MAIN ] NBXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:51.037860] [DEBUG] [MAIN ] NC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:51.117804] [DEBUG] [MAIN ] NCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:51.153843] [INFO ] [MAIN ] NBXG: Generated 139 derivative records from 21773 primary records. [2025-10-24T00:52:51.153519] [INFO ] [MAIN ] NC: Generated 139 derivative records from 2009 primary records. [2025-10-24T00:52:51.155151] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-24T00:52:51.155256] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-24T00:52:51.155995] [FATAL] [LOCAL ] NC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:51.156133] [FATAL] [MAIN ] NC: Failed to save derivative data. [2025-10-24T00:52:51.155701] [FATAL] [LOCAL ] NBXG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:51.159021] [INFO ] [MAIN ] Derivative Progress: 1330/2164 symbols completed. NC took 1.1s. Estimated remaining: 5m 36s. Rate: 148.9 symbols/min [2025-10-24T00:52:51.159219] [FATAL] [MAIN ] NBXG: Failed to save derivative data. [2025-10-24T00:52:51.161848] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:51.164516] [INFO ] [MAIN ] Derivative Progress: 1331/2164 symbols completed. NBXG took 1.1s. Estimated remaining: 5m 35s. Rate: 149.0 symbols/min [2025-10-24T00:52:51.165086] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:51.182536] [INFO ] [MAIN ] NCA: Generated 139 derivative records from 9801 primary records. [2025-10-24T00:52:51.182725] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-24T00:52:51.182923] [FATAL] [LOCAL ] NCA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:51.183012] [FATAL] [MAIN ] NCA: Failed to save derivative data. [2025-10-24T00:52:51.185768] [INFO ] [MAIN ] Derivative Progress: 1332/2164 symbols completed. NCA took 0.9s. Estimated remaining: 5m 35s. Rate: 149.1 symbols/min [2025-10-24T00:52:51.186003] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:51.195223] [DEBUG] [LOCAL ] NCDL: Loaded 21793 existing records from primary storage. [2025-10-24T00:52:51.195549] [INFO ] [MAIN ] NCDL: Loaded 21793 primary data records. [2025-10-24T00:52:51.288922] [DEBUG] [LOCAL ] NCZ: Loaded 12391 existing records from primary storage. [2025-10-24T00:52:51.325174] [INFO ] [MAIN ] NCZ: Loaded 12391 primary data records. [2025-10-24T00:52:51.671815] [DEBUG] [LOCAL ] NCLH: Loaded 54143 existing records from primary storage. [2025-10-24T00:52:51.702153] [INFO ] [MAIN ] NCLH: Loaded 54143 primary data records. [2025-10-24T00:52:52.202930] [DEBUG] [MAIN ] NCDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:52.236517] [DEBUG] [MAIN ] NCZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:52.296723] [DEBUG] [MAIN ] NCLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:52.340136] [INFO ] [MAIN ] NCDL: Generated 139 derivative records from 21793 primary records. [2025-10-24T00:52:52.342566] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-24T00:52:52.344113] [FATAL] [LOCAL ] NCDL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:52.344360] [FATAL] [MAIN ] NCDL: Failed to save derivative data. [2025-10-24T00:52:52.351022] [INFO ] [MAIN ] NCZ: Generated 139 derivative records from 12391 primary records. [2025-10-24T00:52:52.356213] [INFO ] [MAIN ] Derivative Progress: 1333/2164 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 35s. Rate: 148.9 symbols/min [2025-10-24T00:52:52.357152] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-24T00:52:52.357460] [FATAL] [LOCAL ] NCZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:52.359094] [FATAL] [MAIN ] NCZ: Failed to save derivative data. [2025-10-24T00:52:52.361919] [INFO ] [MAIN ] Derivative Progress: 1334/2164 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 34s. Rate: 149.0 symbols/min [2025-10-24T00:52:52.370572] [INFO ] [MAIN ] NCLH: Generated 139 derivative records from 54143 primary records. [2025-10-24T00:52:52.370849] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-10-24T00:52:52.371094] [FATAL] [LOCAL ] NCLH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:52.371178] [FATAL] [MAIN ] NCLH: Failed to save derivative data. [2025-10-24T00:52:52.375474] [INFO ] [MAIN ] Derivative Progress: 1335/2164 symbols completed. NCLH took 1.2s. Estimated remaining: 5m 34s. Rate: 149.1 symbols/min [2025-10-24T00:52:52.376119] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:52.376013] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:52.376199] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:52.399778] [DEBUG] [LOCAL ] NDMO: Loaded 17101 existing records from primary storage. [2025-10-24T00:52:52.400071] [INFO ] [MAIN ] NDMO: Loaded 17101 primary data records. [2025-10-24T00:52:52.529573] [DEBUG] [LOCAL ] NEA: Loaded 35402 existing records from primary storage. [2025-10-24T00:52:52.559820] [INFO ] [MAIN ] NEA: Loaded 35402 primary data records. [2025-10-24T00:52:52.855624] [DEBUG] [LOCAL ] NE: Loaded 52682 existing records from primary storage. [2025-10-24T00:52:52.878199] [INFO ] [MAIN ] NE: Loaded 52682 primary data records. [2025-10-24T00:52:53.377479] [DEBUG] [MAIN ] NDMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:53.420000] [DEBUG] [MAIN ] NEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:53.456783] [DEBUG] [MAIN ] NE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:53.493070] [INFO ] [MAIN ] NDMO: Generated 139 derivative records from 17101 primary records. [2025-10-24T00:52:53.495077] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-24T00:52:53.496859] [FATAL] [LOCAL ] NDMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:53.497024] [FATAL] [MAIN ] NDMO: Failed to save derivative data. [2025-10-24T00:52:53.502177] [INFO ] [MAIN ] Derivative Progress: 1336/2164 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 34s. Rate: 148.9 symbols/min [2025-10-24T00:52:53.502436] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:53.521275] [INFO ] [MAIN ] NEA: Generated 139 derivative records from 35402 primary records. [2025-10-24T00:52:53.524358] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-24T00:52:53.525940] [FATAL] [LOCAL ] NEA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:53.526244] [FATAL] [MAIN ] NEA: Failed to save derivative data. [2025-10-24T00:52:53.529233] [INFO ] [MAIN ] Derivative Progress: 1337/2164 symbols completed. NEA took 1.2s. Estimated remaining: 5m 33s. Rate: 149.0 symbols/min [2025-10-24T00:52:53.531361] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:53.531208] [INFO ] [MAIN ] NE: Generated 139 derivative records from 52682 primary records. [2025-10-24T00:52:53.532024] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-24T00:52:53.532319] [FATAL] [LOCAL ] NE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:53.532470] [FATAL] [MAIN ] NE: Failed to save derivative data. [2025-10-24T00:52:53.535336] [INFO ] [MAIN ] Derivative Progress: 1338/2164 symbols completed. NE took 1.2s. Estimated remaining: 5m 32s. Rate: 149.1 symbols/min [2025-10-24T00:52:53.535783] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:53.578211] [DEBUG] [LOCAL ] NEE: Loaded 54097 existing records from primary storage. [2025-10-24T00:52:53.578617] [INFO ] [MAIN ] NEE: Loaded 54097 primary data records. [2025-10-24T00:52:53.962843] [DEBUG] [LOCAL ] NET: Loaded 53162 existing records from primary storage. [2025-10-24T00:52:53.963966] [DEBUG] [LOCAL ] NEM: Loaded 54098 existing records from primary storage. [2025-10-24T00:52:53.974594] [INFO ] [MAIN ] NEM: Loaded 54098 primary data records. [2025-10-24T00:52:53.974825] [INFO ] [MAIN ] NET: Loaded 53162 primary data records. [2025-10-24T00:52:54.599668] [DEBUG] [MAIN ] NEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:54.660786] [DEBUG] [MAIN ] NEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:54.691580] [INFO ] [MAIN ] NEE: Generated 139 derivative records from 54097 primary records. [2025-10-24T00:52:54.690218] [DEBUG] [MAIN ] NET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:54.702602] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-24T00:52:54.708877] [FATAL] [LOCAL ] NEE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:54.710191] [FATAL] [MAIN ] NEE: Failed to save derivative data. [2025-10-24T00:52:54.714183] [INFO ] [MAIN ] Derivative Progress: 1339/2164 symbols completed. NEE took 1.2s. Estimated remaining: 5m 32s. Rate: 148.9 symbols/min [2025-10-24T00:52:54.714426] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:54.752878] [DEBUG] [LOCAL ] NEU: Loaded 8671 existing records from primary storage. [2025-10-24T00:52:54.756950] [INFO ] [MAIN ] NEM: Generated 139 derivative records from 54098 primary records. [2025-10-24T00:52:54.756733] [INFO ] [MAIN ] NEU: Loaded 8671 primary data records. [2025-10-24T00:52:54.763895] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-24T00:52:54.766143] [INFO ] [MAIN ] NET: Generated 139 derivative records from 53162 primary records. [2025-10-24T00:52:54.766272] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-24T00:52:54.781884] [FATAL] [LOCAL ] NET: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:54.792576] [FATAL] [LOCAL ] NEM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:54.843544] [FATAL] [MAIN ] NET: Failed to save derivative data. [2025-10-24T00:52:54.862727] [FATAL] [MAIN ] NEM: Failed to save derivative data. [2025-10-24T00:52:54.869450] [INFO ] [MAIN ] Derivative Progress: 1340/2164 symbols completed. NET took 1.3s. Estimated remaining: 5m 32s. Rate: 149.0 symbols/min [2025-10-24T00:52:54.873385] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:54.878758] [INFO ] [MAIN ] Derivative Progress: 1341/2164 symbols completed. NEM took 1.3s. Estimated remaining: 5m 31s. Rate: 149.1 symbols/min [2025-10-24T00:52:54.913514] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:55.076275] [DEBUG] [LOCAL ] NEXA: Loaded 5766 existing records from primary storage. [2025-10-24T00:52:55.076443] [INFO ] [MAIN ] NEXA: Loaded 5766 primary data records. [2025-10-24T00:52:55.399730] [DEBUG] [LOCAL ] NFG: Loaded 38484 existing records from primary storage. [2025-10-24T00:52:55.400054] [INFO ] [MAIN ] NFG: Loaded 38484 primary data records. [2025-10-24T00:52:55.601823] [DEBUG] [MAIN ] NEU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:55.824875] [DEBUG] [MAIN ] NEXA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:55.867792] [INFO ] [MAIN ] NEU: Generated 139 derivative records from 8671 primary records. [2025-10-24T00:52:55.872515] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-24T00:52:55.888066] [DEBUG] [MAIN ] NFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:55.881395] [FATAL] [LOCAL ] NEU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:55.900562] [FATAL] [MAIN ] NEU: Failed to save derivative data. [2025-10-24T00:52:55.907727] [INFO ] [MAIN ] Derivative Progress: 1342/2164 symbols completed. NEU took 1.2s. Estimated remaining: 5m 31s. Rate: 148.9 symbols/min [2025-10-24T00:52:55.910414] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:55.925404] [INFO ] [MAIN ] NEXA: Generated 139 derivative records from 5766 primary records. [2025-10-24T00:52:55.929811] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-24T00:52:55.930843] [FATAL] [LOCAL ] NEXA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:55.934092] [FATAL] [MAIN ] NEXA: Failed to save derivative data. [2025-10-24T00:52:55.945516] [INFO ] [MAIN ] Derivative Progress: 1343/2164 symbols completed. NEXA took 1.1s. Estimated remaining: 5m 31s. Rate: 149.0 symbols/min [2025-10-24T00:52:55.947309] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:55.958543] [DEBUG] [LOCAL ] NFJ: Loaded 19799 existing records from primary storage. [2025-10-24T00:52:55.960156] [INFO ] [MAIN ] NFJ: Loaded 19799 primary data records. [2025-10-24T00:52:56.010210] [INFO ] [MAIN ] NFG: Generated 139 derivative records from 38484 primary records. [2025-10-24T00:52:56.037757] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-24T00:52:56.060805] [FATAL] [LOCAL ] NFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:56.076256] [FATAL] [MAIN ] NFG: Failed to save derivative data. [2025-10-24T00:52:56.081023] [INFO ] [MAIN ] Derivative Progress: 1344/2164 symbols completed. NFG took 1.2s. Estimated remaining: 5m 30s. Rate: 149.1 symbols/min [2025-10-24T00:52:56.081442] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:56.303242] [DEBUG] [LOCAL ] NGG: Loaded 47110 existing records from primary storage. [2025-10-24T00:52:56.304343] [INFO ] [MAIN ] NGG: Loaded 47110 primary data records. [2025-10-24T00:52:56.428015] [DEBUG] [LOCAL ] NGL: Loaded 30035 existing records from primary storage. [2025-10-24T00:52:56.428233] [INFO ] [MAIN ] NGL: Loaded 30035 primary data records. [2025-10-24T00:52:56.973958] [DEBUG] [MAIN ] NFJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:57.025736] [DEBUG] [MAIN ] NGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:57.057534] [DEBUG] [MAIN ] NGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:57.093794] [INFO ] [MAIN ] NFJ: Generated 139 derivative records from 19799 primary records. [2025-10-24T00:52:57.094314] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-24T00:52:57.094559] [FATAL] [LOCAL ] NFJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:57.095964] [FATAL] [MAIN ] NFJ: Failed to save derivative data. [2025-10-24T00:52:57.101441] [INFO ] [MAIN ] Derivative Progress: 1345/2164 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 30s. Rate: 148.9 symbols/min [2025-10-24T00:52:57.106480] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:57.121275] [INFO ] [MAIN ] NGG: Generated 139 derivative records from 47110 primary records. [2025-10-24T00:52:57.121601] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-24T00:52:57.128495] [FATAL] [LOCAL ] NGG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:57.129016] [FATAL] [MAIN ] NGG: Failed to save derivative data. [2025-10-24T00:52:57.131819] [INFO ] [MAIN ] Derivative Progress: 1346/2164 symbols completed. NGG took 1.2s. Estimated remaining: 5m 29s. Rate: 149.0 symbols/min [2025-10-24T00:52:57.133300] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:57.140102] [DEBUG] [LOCAL ] NGS: Loaded 10918 existing records from primary storage. [2025-10-24T00:52:57.140325] [INFO ] [MAIN ] NGL: Generated 139 derivative records from 30035 primary records. [2025-10-24T00:52:57.140472] [INFO ] [MAIN ] NGS: Loaded 10918 primary data records. [2025-10-24T00:52:57.152068] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-24T00:52:57.173039] [FATAL] [LOCAL ] NGL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:57.205910] [FATAL] [MAIN ] NGL: Failed to save derivative data. [2025-10-24T00:52:57.220904] [INFO ] [MAIN ] Derivative Progress: 1347/2164 symbols completed. NGL took 1.1s. Estimated remaining: 5m 29s. Rate: 149.1 symbols/min [2025-10-24T00:52:57.231376] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:57.345275] [DEBUG] [LOCAL ] NGVC: Loaded 22904 existing records from primary storage. [2025-10-24T00:52:57.445873] [INFO ] [MAIN ] NGVC: Loaded 22904 primary data records. [2025-10-24T00:52:57.511253] [DEBUG] [LOCAL ] NGVT: Loaded 23895 existing records from primary storage. [2025-10-24T00:52:57.532346] [INFO ] [MAIN ] NGVT: Loaded 23895 primary data records. [2025-10-24T00:52:58.137686] [DEBUG] [MAIN ] NGS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:52:58.186836] [DEBUG] [MAIN ] NGVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:58.222151] [DEBUG] [MAIN ] NGVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:58.269784] [INFO ] [MAIN ] NGS: Generated 139 derivative records from 10918 primary records. [2025-10-24T00:52:58.275695] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-24T00:52:58.276076] [FATAL] [LOCAL ] NGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:58.276479] [FATAL] [MAIN ] NGS: Failed to save derivative data. [2025-10-24T00:52:58.282718] [INFO ] [MAIN ] Derivative Progress: 1348/2164 symbols completed. NGS took 1.2s. Estimated remaining: 5m 29s. Rate: 148.9 symbols/min [2025-10-24T00:52:58.296274] [INFO ] [MAIN ] NGVC: Generated 139 derivative records from 22904 primary records. [2025-10-24T00:52:58.298095] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-24T00:52:58.300136] [INFO ] [MAIN ] NGVT: Generated 139 derivative records from 23895 primary records. [2025-10-24T00:52:58.300715] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-24T00:52:58.300511] [FATAL] [LOCAL ] NGVC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:58.301020] [FATAL] [LOCAL ] NGVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:58.301184] [FATAL] [MAIN ] NGVT: Failed to save derivative data. [2025-10-24T00:52:58.304322] [INFO ] [MAIN ] Derivative Progress: 1349/2164 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 28s. Rate: 149.1 symbols/min [2025-10-24T00:52:58.304456] [FATAL] [MAIN ] NGVC: Failed to save derivative data. [2025-10-24T00:52:58.308797] [INFO ] [MAIN ] Derivative Progress: 1350/2164 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 27s. Rate: 149.2 symbols/min [2025-10-24T00:52:58.309321] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:58.309494] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:58.310010] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:58.322248] [DEBUG] [LOCAL ] NIC: Loaded 8934 existing records from primary storage. [2025-10-24T00:52:58.322489] [INFO ] [MAIN ] NIC: Loaded 8934 primary data records. [2025-10-24T00:52:58.430383] [DEBUG] [LOCAL ] NHI: Loaded 21978 existing records from primary storage. [2025-10-24T00:52:58.441927] [INFO ] [MAIN ] NHI: Loaded 21978 primary data records. [2025-10-24T00:52:58.859960] [DEBUG] [LOCAL ] NI: Loaded 53798 existing records from primary storage. [2025-10-24T00:52:58.860787] [INFO ] [MAIN ] NI: Loaded 53798 primary data records. [2025-10-24T00:52:59.329140] [DEBUG] [MAIN ] NIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:59.364781] [DEBUG] [MAIN ] NHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:59.413058] [DEBUG] [MAIN ] NI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:52:59.457813] [INFO ] [MAIN ] NIC: Generated 139 derivative records from 8934 primary records. [2025-10-24T00:52:59.462443] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-24T00:52:59.464546] [FATAL] [LOCAL ] NIC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:59.464689] [FATAL] [MAIN ] NIC: Failed to save derivative data. [2025-10-24T00:52:59.467980] [INFO ] [MAIN ] Derivative Progress: 1351/2164 symbols completed. NIC took 1.2s. Estimated remaining: 5m 27s. Rate: 149.0 symbols/min [2025-10-24T00:52:59.471042] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:59.485073] [INFO ] [MAIN ] NHI: Generated 139 derivative records from 21978 primary records. [2025-10-24T00:52:59.490264] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-24T00:52:59.491022] [FATAL] [LOCAL ] NHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:59.499868] [INFO ] [MAIN ] NI: Generated 139 derivative records from 53798 primary records. [2025-10-24T00:52:59.499324] [FATAL] [MAIN ] NHI: Failed to save derivative data. [2025-10-24T00:52:59.500118] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-24T00:52:59.504463] [INFO ] [MAIN ] Derivative Progress: 1352/2164 symbols completed. NHI took 1.2s. Estimated remaining: 5m 27s. Rate: 149.1 symbols/min [2025-10-24T00:52:59.504818] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:59.505265] [FATAL] [LOCAL ] NI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:52:59.506501] [DEBUG] [LOCAL ] NIE: Loaded 11861 existing records from primary storage. [2025-10-24T00:52:59.506696] [FATAL] [MAIN ] NI: Failed to save derivative data. [2025-10-24T00:52:59.506899] [INFO ] [MAIN ] NIE: Loaded 11861 primary data records. [2025-10-24T00:52:59.521543] [INFO ] [MAIN ] Derivative Progress: 1353/2164 symbols completed. NI took 1.2s. Estimated remaining: 5m 26s. Rate: 149.2 symbols/min [2025-10-24T00:52:59.566385] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:52:59.600810] [DEBUG] [LOCAL ] NIM: Loaded 3546 existing records from primary storage. [2025-10-24T00:52:59.617907] [INFO ] [MAIN ] NIM: Loaded 3546 primary data records. [2025-10-24T00:53:00.089556] [DEBUG] [LOCAL ] NINE: Loaded 29054 existing records from primary storage. [2025-10-24T00:53:00.123793] [INFO ] [MAIN ] NINE: Loaded 29054 primary data records. [2025-10-24T00:53:00.557692] [DEBUG] [MAIN ] NIE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:00.595754] [DEBUG] [MAIN ] NIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:00.649736] [DEBUG] [MAIN ] NINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:00.673434] [INFO ] [MAIN ] NIE: Generated 139 derivative records from 11861 primary records. [2025-10-24T00:53:00.673989] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-24T00:53:00.674227] [FATAL] [LOCAL ] NIE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:00.676423] [FATAL] [MAIN ] NIE: Failed to save derivative data. [2025-10-24T00:53:00.679257] [INFO ] [MAIN ] Derivative Progress: 1354/2164 symbols completed. NIE took 1.2s. Estimated remaining: 5m 26s. Rate: 149.0 symbols/min [2025-10-24T00:53:00.682946] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:00.690958] [INFO ] [MAIN ] NIM: Generated 139 derivative records from 3546 primary records. [2025-10-24T00:53:00.692704] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-24T00:53:00.695936] [FATAL] [LOCAL ] NIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:00.696638] [FATAL] [MAIN ] NIM: Failed to save derivative data. [2025-10-24T00:53:00.703020] [INFO ] [MAIN ] Derivative Progress: 1355/2164 symbols completed. NIM took 1.2s. Estimated remaining: 5m 26s. Rate: 149.1 symbols/min [2025-10-24T00:53:00.703768] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:00.711404] [INFO ] [MAIN ] NINE: Generated 139 derivative records from 29054 primary records. [2025-10-24T00:53:00.711601] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-24T00:53:00.711868] [FATAL] [LOCAL ] NINE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:00.711947] [FATAL] [MAIN ] NINE: Failed to save derivative data. [2025-10-24T00:53:00.716374] [INFO ] [MAIN ] Derivative Progress: 1356/2164 symbols completed. NINE took 1.1s. Estimated remaining: 5m 25s. Rate: 149.2 symbols/min [2025-10-24T00:53:00.716605] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:00.745990] [DEBUG] [LOCAL ] NKX: Loaded 13725 existing records from primary storage. [2025-10-24T00:53:00.746399] [INFO ] [MAIN ] NKX: Loaded 13725 primary data records. [2025-10-24T00:53:00.885638] [DEBUG] [LOCAL ] NJR: Loaded 38100 existing records from primary storage. [2025-10-24T00:53:00.884935] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-10-24T00:53:00.886358] [INFO ] [MAIN ] NJR: Loaded 38100 primary data records. [2025-10-24T00:53:00.897012] [INFO ] [MAIN ] NIO: Loaded 54192 primary data records. [2025-10-24T00:53:01.703547] [DEBUG] [MAIN ] NKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:01.740802] [DEBUG] [MAIN ] NIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:01.773585] [DEBUG] [MAIN ] NJR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:01.873337] [INFO ] [MAIN ] NKX: Generated 139 derivative records from 13725 primary records. [2025-10-24T00:53:01.875539] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-24T00:53:01.878781] [FATAL] [LOCAL ] NKX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:01.881084] [FATAL] [MAIN ] NKX: Failed to save derivative data. [2025-10-24T00:53:01.884331] [INFO ] [MAIN ] Derivative Progress: 1357/2164 symbols completed. NKX took 1.2s. Estimated remaining: 5m 25s. Rate: 149.0 symbols/min [2025-10-24T00:53:01.885989] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:01.908345] [DEBUG] [LOCAL ] NLOP: Loaded 11532 existing records from primary storage. [2025-10-24T00:53:01.908006] [INFO ] [MAIN ] NJR: Generated 139 derivative records from 38100 primary records. [2025-10-24T00:53:01.910304] [INFO ] [MAIN ] NLOP: Loaded 11532 primary data records. [2025-10-24T00:53:01.910459] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-24T00:53:01.910198] [INFO ] [MAIN ] NIO: Generated 139 derivative records from 54192 primary records. [2025-10-24T00:53:01.922247] [FATAL] [LOCAL ] NJR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:01.922397] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-24T00:53:01.932080] [FATAL] [MAIN ] NJR: Failed to save derivative data. [2025-10-24T00:53:01.932299] [FATAL] [LOCAL ] NIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:01.945309] [INFO ] [MAIN ] Derivative Progress: 1358/2164 symbols completed. NJR took 1.2s. Estimated remaining: 5m 24s. Rate: 149.0 symbols/min [2025-10-24T00:53:01.950569] [FATAL] [MAIN ] NIO: Failed to save derivative data. [2025-10-24T00:53:01.969186] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:01.972218] [INFO ] [MAIN ] Derivative Progress: 1359/2164 symbols completed. NIO took 1.3s. Estimated remaining: 5m 24s. Rate: 149.1 symbols/min [2025-10-24T00:53:02.019048] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:02.219233] [DEBUG] [LOCAL ] NMAI: Loaded 12639 existing records from primary storage. [2025-10-24T00:53:02.228096] [INFO ] [MAIN ] NMAI: Loaded 12639 primary data records. [2025-10-24T00:53:02.561634] [DEBUG] [LOCAL ] NLY: Loaded 53954 existing records from primary storage. [2025-10-24T00:53:02.562101] [INFO ] [MAIN ] NLY: Loaded 53954 primary data records. [2025-10-24T00:53:02.737892] [DEBUG] [MAIN ] NLOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:02.925984] [DEBUG] [MAIN ] NMAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:02.971741] [DEBUG] [MAIN ] NLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:02.992083] [INFO ] [MAIN ] NLOP: Generated 139 derivative records from 11532 primary records. [2025-10-24T00:53:02.993284] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-24T00:53:02.995116] [FATAL] [LOCAL ] NLOP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:02.995727] [FATAL] [MAIN ] NLOP: Failed to save derivative data. [2025-10-24T00:53:03.001843] [INFO ] [MAIN ] Derivative Progress: 1360/2164 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 24s. Rate: 149.0 symbols/min [2025-10-24T00:53:03.003040] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:03.025561] [INFO ] [MAIN ] NMAI: Generated 139 derivative records from 12639 primary records. [2025-10-24T00:53:03.026357] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-24T00:53:03.026637] [FATAL] [LOCAL ] NMAI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:03.028081] [FATAL] [MAIN ] NMAI: Failed to save derivative data. [2025-10-24T00:53:03.040794] [INFO ] [MAIN ] Derivative Progress: 1361/2164 symbols completed. NMAI took 1.0s. Estimated remaining: 5m 23s. Rate: 149.1 symbols/min [2025-10-24T00:53:03.041477] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:03.042340] [DEBUG] [LOCAL ] NMCO: Loaded 16776 existing records from primary storage. [2025-10-24T00:53:03.044301] [INFO ] [MAIN ] NMCO: Loaded 16776 primary data records. [2025-10-24T00:53:03.093769] [INFO ] [MAIN ] NLY: Generated 139 derivative records from 53954 primary records. [2025-10-24T00:53:03.121241] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-24T00:53:03.143051] [FATAL] [LOCAL ] NLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:03.152952] [DEBUG] [LOCAL ] NMG: Loaded 12292 existing records from primary storage. [2025-10-24T00:53:03.158372] [INFO ] [MAIN ] NMG: Loaded 12292 primary data records. [2025-10-24T00:53:03.153098] [FATAL] [MAIN ] NLY: Failed to save derivative data. [2025-10-24T00:53:03.167868] [INFO ] [MAIN ] Derivative Progress: 1362/2164 symbols completed. NLY took 1.2s. Estimated remaining: 5m 23s. Rate: 149.2 symbols/min [2025-10-24T00:53:03.235929] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:03.401546] [DEBUG] [LOCAL ] NMI: Loaded 4059 existing records from primary storage. [2025-10-24T00:53:03.561915] [INFO ] [MAIN ] NMI: Loaded 4059 primary data records. [2025-10-24T00:53:04.105157] [DEBUG] [MAIN ] NMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:04.110752] [DEBUG] [MAIN ] NMCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:04.179505] [DEBUG] [MAIN ] NMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:04.224281] [INFO ] [MAIN ] NMCO: Generated 139 derivative records from 16776 primary records. [2025-10-24T00:53:04.226340] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-24T00:53:04.232216] [FATAL] [LOCAL ] NMCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:04.232427] [FATAL] [MAIN ] NMCO: Failed to save derivative data. [2025-10-24T00:53:04.231536] [INFO ] [MAIN ] NMG: Generated 139 derivative records from 12292 primary records. [2025-10-24T00:53:04.234577] [INFO ] [MAIN ] Derivative Progress: 1363/2164 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 23s. Rate: 149.0 symbols/min [2025-10-24T00:53:04.236395] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-24T00:53:04.237108] [FATAL] [LOCAL ] NMG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:04.239371] [FATAL] [MAIN ] NMG: Failed to save derivative data. [2025-10-24T00:53:04.242284] [INFO ] [MAIN ] Derivative Progress: 1364/2164 symbols completed. NMG took 1.2s. Estimated remaining: 5m 22s. Rate: 149.1 symbols/min [2025-10-24T00:53:04.247922] [INFO ] [MAIN ] NMI: Generated 139 derivative records from 4059 primary records. [2025-10-24T00:53:04.248062] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-24T00:53:04.248279] [FATAL] [LOCAL ] NMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:04.248358] [FATAL] [MAIN ] NMI: Failed to save derivative data. [2025-10-24T00:53:04.251289] [INFO ] [MAIN ] Derivative Progress: 1365/2164 symbols completed. NMI took 1.0s. Estimated remaining: 5m 21s. Rate: 149.2 symbols/min [2025-10-24T00:53:04.251956] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:04.251882] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:04.252111] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:04.258993] [DEBUG] [LOCAL ] NMS: Loaded 2935 existing records from primary storage. [2025-10-24T00:53:04.259192] [INFO ] [MAIN ] NMS: Loaded 2935 primary data records. [2025-10-24T00:53:04.350809] [DEBUG] [LOCAL ] NMM: Loaded 14355 existing records from primary storage. [2025-10-24T00:53:04.379911] [INFO ] [MAIN ] NMM: Loaded 14355 primary data records. [2025-10-24T00:53:04.713786] [DEBUG] [LOCAL ] NMR: Loaded 35672 existing records from primary storage. [2025-10-24T00:53:04.730804] [INFO ] [MAIN ] NMR: Loaded 35672 primary data records. [2025-10-24T00:53:05.246923] [DEBUG] [MAIN ] NMS: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-24T00:53:05.277103] [DEBUG] [MAIN ] NMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:05.324572] [DEBUG] [MAIN ] NMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:05.366205] [INFO ] [MAIN ] NMS: Generated 139 derivative records from 2935 primary records. [2025-10-24T00:53:05.372318] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-24T00:53:05.373173] [FATAL] [LOCAL ] NMS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:05.378982] [INFO ] [MAIN ] NMM: Generated 139 derivative records from 14355 primary records. [2025-10-24T00:53:05.378217] [FATAL] [MAIN ] NMS: Failed to save derivative data. [2025-10-24T00:53:05.383447] [INFO ] [MAIN ] Derivative Progress: 1366/2164 symbols completed. NMS took 1.1s. Estimated remaining: 5m 21s. Rate: 149.0 symbols/min [2025-10-24T00:53:05.380809] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-24T00:53:05.386144] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:05.386977] [FATAL] [LOCAL ] NMM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:05.387497] [FATAL] [MAIN ] NMM: Failed to save derivative data. [2025-10-24T00:53:05.390186] [INFO ] [MAIN ] Derivative Progress: 1367/2164 symbols completed. NMM took 1.1s. Estimated remaining: 5m 21s. Rate: 149.1 symbols/min [2025-10-24T00:53:05.391403] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:05.400076] [INFO ] [MAIN ] NMR: Generated 139 derivative records from 35672 primary records. [2025-10-24T00:53:05.402466] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-24T00:53:05.402877] [FATAL] [LOCAL ] NMR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:05.402237] [DEBUG] [LOCAL ] NMT: Loaded 2826 existing records from primary storage. [2025-10-24T00:53:05.403052] [INFO ] [MAIN ] NMT: Loaded 2826 primary data records. [2025-10-24T00:53:05.408377] [FATAL] [MAIN ] NMR: Failed to save derivative data. [2025-10-24T00:53:05.418223] [INFO ] [MAIN ] Derivative Progress: 1368/2164 symbols completed. NMR took 1.2s. Estimated remaining: 5m 20s. Rate: 149.2 symbols/min [2025-10-24T00:53:05.451604] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:05.522162] [DEBUG] [LOCAL ] NMZ: Loaded 21507 existing records from primary storage. [2025-10-24T00:53:05.526152] [INFO ] [MAIN ] NMZ: Loaded 21507 primary data records. [2025-10-24T00:53:05.693161] [DEBUG] [LOCAL ] NNI: Loaded 10530 existing records from primary storage. [2025-10-24T00:53:05.831037] [INFO ] [MAIN ] NNI: Loaded 10530 primary data records. [2025-10-24T00:53:06.400618] [DEBUG] [MAIN ] NMT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:06.438413] [DEBUG] [MAIN ] NMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:06.476038] [DEBUG] [MAIN ] NNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:06.515618] [INFO ] [MAIN ] NMT: Generated 139 derivative records from 2826 primary records. [2025-10-24T00:53:06.517381] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-24T00:53:06.519023] [FATAL] [LOCAL ] NMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:06.522118] [FATAL] [MAIN ] NMT: Failed to save derivative data. [2025-10-24T00:53:06.528373] [INFO ] [MAIN ] Derivative Progress: 1369/2164 symbols completed. NMT took 1.1s. Estimated remaining: 5m 20s. Rate: 149.0 symbols/min [2025-10-24T00:53:06.528661] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:06.537383] [INFO ] [MAIN ] NMZ: Generated 139 derivative records from 21507 primary records. [2025-10-24T00:53:06.538120] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-24T00:53:06.541237] [FATAL] [LOCAL ] NMZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:06.542188] [FATAL] [MAIN ] NMZ: Failed to save derivative data. [2025-10-24T00:53:06.545020] [INFO ] [MAIN ] Derivative Progress: 1370/2164 symbols completed. NMZ took 1.2s. Estimated remaining: 5m 19s. Rate: 149.1 symbols/min [2025-10-24T00:53:06.545263] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:06.547825] [INFO ] [MAIN ] NNI: Generated 139 derivative records from 10530 primary records. [2025-10-24T00:53:06.548376] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-24T00:53:06.548930] [FATAL] [LOCAL ] NNI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:06.549229] [FATAL] [MAIN ] NNI: Failed to save derivative data. [2025-10-24T00:53:06.552142] [INFO ] [MAIN ] Derivative Progress: 1371/2164 symbols completed. NNI took 1.1s. Estimated remaining: 5m 19s. Rate: 149.2 symbols/min [2025-10-24T00:53:06.552381] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:06.558525] [DEBUG] [LOCAL ] NNY: Loaded 5814 existing records from primary storage. [2025-10-24T00:53:06.558745] [INFO ] [MAIN ] NNY: Loaded 5814 primary data records. [2025-10-24T00:53:06.687395] [DEBUG] [LOCAL ] NNN: Loaded 48512 existing records from primary storage. [2025-10-24T00:53:06.688042] [INFO ] [MAIN ] NNN: Loaded 48512 primary data records. [2025-10-24T00:53:06.719405] [DEBUG] [LOCAL ] NOA: Loaded 15889 existing records from primary storage. [2025-10-24T00:53:06.903669] [INFO ] [MAIN ] NOA: Loaded 15889 primary data records. [2025-10-24T00:53:07.510369] [DEBUG] [MAIN ] NNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:07.552416] [DEBUG] [MAIN ] NNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:07.592201] [DEBUG] [MAIN ] NOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:07.624627] [INFO ] [MAIN ] NNY: Generated 139 derivative records from 5814 primary records. [2025-10-24T00:53:07.631814] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-24T00:53:07.632294] [FATAL] [LOCAL ] NNY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:07.632527] [FATAL] [MAIN ] NNY: Failed to save derivative data. [2025-10-24T00:53:07.637388] [INFO ] [MAIN ] Derivative Progress: 1372/2164 symbols completed. NNY took 1.1s. Estimated remaining: 5m 19s. Rate: 149.0 symbols/min [2025-10-24T00:53:07.638151] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:07.653537] [INFO ] [MAIN ] NNN: Generated 139 derivative records from 48512 primary records. [2025-10-24T00:53:07.660154] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-24T00:53:07.660485] [FATAL] [LOCAL ] NNN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:07.660775] [FATAL] [MAIN ] NNN: Failed to save derivative data. [2025-10-24T00:53:07.663828] [INFO ] [MAIN ] Derivative Progress: 1373/2164 symbols completed. NNN took 1.1s. Estimated remaining: 5m 18s. Rate: 149.1 symbols/min [2025-10-24T00:53:07.666685] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:07.676586] [DEBUG] [LOCAL ] NOAH: Loaded 19894 existing records from primary storage. [2025-10-24T00:53:07.679510] [INFO ] [MAIN ] NOA: Generated 139 derivative records from 15889 primary records. [2025-10-24T00:53:07.679623] [INFO ] [MAIN ] NOAH: Loaded 19894 primary data records. [2025-10-24T00:53:07.700621] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-24T00:53:07.717105] [FATAL] [LOCAL ] NOA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:07.723251] [FATAL] [MAIN ] NOA: Failed to save derivative data. [2025-10-24T00:53:07.726219] [INFO ] [MAIN ] Derivative Progress: 1374/2164 symbols completed. NOA took 1.2s. Estimated remaining: 5m 18s. Rate: 149.2 symbols/min [2025-10-24T00:53:07.726463] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:08.041876] [DEBUG] [LOCAL ] NOC: Loaded 41909 existing records from primary storage. [2025-10-24T00:53:08.042043] [INFO ] [MAIN ] NOC: Loaded 41909 primary data records. [2025-10-24T00:53:08.166454] [DEBUG] [LOCAL ] NOG: Loaded 51729 existing records from primary storage. [2025-10-24T00:53:08.166686] [INFO ] [MAIN ] NOG: Loaded 51729 primary data records. [2025-10-24T00:53:08.691986] [DEBUG] [MAIN ] NOAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:08.729223] [DEBUG] [MAIN ] NOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:08.781171] [DEBUG] [MAIN ] NOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:08.824407] [INFO ] [MAIN ] NOAH: Generated 139 derivative records from 19894 primary records. [2025-10-24T00:53:08.829596] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-24T00:53:08.835708] [FATAL] [LOCAL ] NOAH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:08.836068] [FATAL] [MAIN ] NOAH: Failed to save derivative data. [2025-10-24T00:53:08.841791] [INFO ] [MAIN ] Derivative Progress: 1375/2164 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 18s. Rate: 149.0 symbols/min [2025-10-24T00:53:08.846019] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:08.849945] [INFO ] [MAIN ] NOC: Generated 139 derivative records from 41909 primary records. [2025-10-24T00:53:08.852399] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-24T00:53:08.853232] [FATAL] [LOCAL ] NOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:08.856216] [FATAL] [MAIN ] NOC: Failed to save derivative data. [2025-10-24T00:53:08.858978] [INFO ] [MAIN ] Derivative Progress: 1376/2164 symbols completed. NOC took 1.2s. Estimated remaining: 5m 17s. Rate: 149.1 symbols/min [2025-10-24T00:53:08.859291] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:08.864099] [INFO ] [MAIN ] NOG: Generated 139 derivative records from 51729 primary records. [2025-10-24T00:53:08.864313] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-24T00:53:08.864586] [FATAL] [LOCAL ] NOG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:08.864920] [FATAL] [MAIN ] NOG: Failed to save derivative data. [2025-10-24T00:53:08.872552] [INFO ] [MAIN ] Derivative Progress: 1377/2164 symbols completed. NOG took 1.1s. Estimated remaining: 5m 16s. Rate: 149.2 symbols/min [2025-10-24T00:53:08.873194] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:08.936967] [DEBUG] [LOCAL ] NOK: Loaded 54012 existing records from primary storage. [2025-10-24T00:53:08.949569] [INFO ] [MAIN ] NOK: Loaded 54012 primary data records. [2025-10-24T00:53:08.993572] [DEBUG] [LOCAL ] NOMD: Loaded 43545 existing records from primary storage. [2025-10-24T00:53:09.042704] [INFO ] [MAIN ] NOMD: Loaded 43545 primary data records. [2025-10-24T00:53:09.064801] [DEBUG] [LOCAL ] NOTE: Loaded 39696 existing records from primary storage. [2025-10-24T00:53:09.085468] [INFO ] [MAIN ] NOTE: Loaded 39696 primary data records. [2025-10-24T00:53:10.018932] [DEBUG] [MAIN ] NOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:10.024970] [DEBUG] [MAIN ] NOMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:10.090462] [DEBUG] [MAIN ] NOTE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:10.145222] [INFO ] [MAIN ] NOK: Generated 139 derivative records from 54012 primary records. [2025-10-24T00:53:10.150428] [INFO ] [MAIN ] NOMD: Generated 139 derivative records from 43545 primary records. [2025-10-24T00:53:10.150794] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-24T00:53:10.154215] [FATAL] [LOCAL ] NOK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:10.150862] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-24T00:53:10.154362] [FATAL] [MAIN ] NOK: Failed to save derivative data. [2025-10-24T00:53:10.157205] [INFO ] [MAIN ] Derivative Progress: 1378/2164 symbols completed. NOK took 1.3s. Estimated remaining: 5m 17s. Rate: 149.0 symbols/min [2025-10-24T00:53:10.158066] [FATAL] [LOCAL ] NOMD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:10.159838] [FATAL] [MAIN ] NOMD: Failed to save derivative data. [2025-10-24T00:53:10.164457] [INFO ] [MAIN ] Derivative Progress: 1379/2164 symbols completed. NOMD took 1.3s. Estimated remaining: 5m 16s. Rate: 149.1 symbols/min [2025-10-24T00:53:10.170144] [INFO ] [MAIN ] NOTE: Generated 139 derivative records from 39696 primary records. [2025-10-24T00:53:10.170372] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-24T00:53:10.170625] [FATAL] [LOCAL ] NOTE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:10.170728] [FATAL] [MAIN ] NOTE: Failed to save derivative data. [2025-10-24T00:53:10.173521] [INFO ] [MAIN ] Derivative Progress: 1380/2164 symbols completed. NOTE took 1.3s. Estimated remaining: 5m 15s. Rate: 149.2 symbols/min [2025-10-24T00:53:10.174064] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:10.174320] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:10.174993] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:10.200110] [DEBUG] [LOCAL ] NPCT: Loaded 16524 existing records from primary storage. [2025-10-24T00:53:10.200350] [INFO ] [MAIN ] NPCT: Loaded 16524 primary data records. [2025-10-24T00:53:10.432158] [DEBUG] [LOCAL ] NOW: Loaded 48142 existing records from primary storage. [2025-10-24T00:53:10.548740] [INFO ] [MAIN ] NOW: Loaded 48142 primary data records. [2025-10-24T00:53:10.586881] [DEBUG] [LOCAL ] NOV: Loaded 53551 existing records from primary storage. [2025-10-24T00:53:10.610508] [INFO ] [MAIN ] NOV: Loaded 53551 primary data records. [2025-10-24T00:53:11.204411] [DEBUG] [MAIN ] NPCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:11.260799] [DEBUG] [MAIN ] NOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:11.292183] [DEBUG] [MAIN ] NOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:11.331829] [INFO ] [MAIN ] NPCT: Generated 139 derivative records from 16524 primary records. [2025-10-24T00:53:11.332993] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-24T00:53:11.334626] [FATAL] [LOCAL ] NPCT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:11.335104] [FATAL] [MAIN ] NPCT: Failed to save derivative data. [2025-10-24T00:53:11.339036] [INFO ] [MAIN ] Derivative Progress: 1381/2164 symbols completed. NPCT took 1.2s. Estimated remaining: 5m 15s. Rate: 149.0 symbols/min [2025-10-24T00:53:11.339497] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:11.369862] [DEBUG] [LOCAL ] NPFD: Loaded 10132 existing records from primary storage. [2025-10-24T00:53:11.370366] [INFO ] [MAIN ] NPFD: Loaded 10132 primary data records. [2025-10-24T00:53:11.376391] [INFO ] [MAIN ] NOW: Generated 139 derivative records from 48142 primary records. [2025-10-24T00:53:11.394890] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-24T00:53:11.418971] [FATAL] [LOCAL ] NOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:11.469991] [INFO ] [MAIN ] NOV: Generated 139 derivative records from 53551 primary records. [2025-10-24T00:53:11.475378] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-24T00:53:11.475715] [FATAL] [LOCAL ] NOV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:11.463253] [FATAL] [MAIN ] NOW: Failed to save derivative data. [2025-10-24T00:53:11.481063] [FATAL] [MAIN ] NOV: Failed to save derivative data. [2025-10-24T00:53:11.494402] [INFO ] [MAIN ] Derivative Progress: 1382/2164 symbols completed. NOV took 1.3s. Estimated remaining: 5m 15s. Rate: 149.1 symbols/min [2025-10-24T00:53:11.505584] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:11.505852] [INFO ] [MAIN ] Derivative Progress: 1383/2164 symbols completed. NOW took 1.3s. Estimated remaining: 5m 14s. Rate: 149.2 symbols/min [2025-10-24T00:53:11.520462] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:11.725233] [DEBUG] [LOCAL ] NPK: Loaded 8417 existing records from primary storage. [2025-10-24T00:53:11.726840] [INFO ] [MAIN ] NPK: Loaded 8417 primary data records. [2025-10-24T00:53:11.886966] [DEBUG] [LOCAL ] NPKI: Loaded 40736 existing records from primary storage. [2025-10-24T00:53:11.897576] [INFO ] [MAIN ] NPKI: Loaded 40736 primary data records. [2025-10-24T00:53:12.456373] [DEBUG] [MAIN ] NPFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:12.510910] [DEBUG] [MAIN ] NPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:12.546716] [INFO ] [MAIN ] NPFD: Generated 139 derivative records from 10132 primary records. [2025-10-24T00:53:12.546473] [DEBUG] [MAIN ] NPKI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:12.558856] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-24T00:53:12.565392] [FATAL] [LOCAL ] NPFD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:12.565744] [FATAL] [MAIN ] NPFD: Failed to save derivative data. [2025-10-24T00:53:12.568145] [INFO ] [MAIN ] Derivative Progress: 1384/2164 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 14s. Rate: 149.0 symbols/min [2025-10-24T00:53:12.569824] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:12.604519] [DEBUG] [LOCAL ] NPO: Loaded 13600 existing records from primary storage. [2025-10-24T00:53:12.606731] [INFO ] [MAIN ] NPO: Loaded 13600 primary data records. [2025-10-24T00:53:12.607039] [INFO ] [MAIN ] NPK: Generated 139 derivative records from 8417 primary records. [2025-10-24T00:53:12.631917] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-24T00:53:12.654233] [FATAL] [LOCAL ] NPK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:12.666175] [FATAL] [MAIN ] NPK: Failed to save derivative data. [2025-10-24T00:53:12.682062] [INFO ] [MAIN ] Derivative Progress: 1385/2164 symbols completed. NPK took 1.2s. Estimated remaining: 5m 14s. Rate: 149.1 symbols/min [2025-10-24T00:53:12.689755] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:12.730233] [INFO ] [MAIN ] NPKI: Generated 139 derivative records from 40736 primary records. [2025-10-24T00:53:12.760934] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-24T00:53:12.798377] [FATAL] [LOCAL ] NPKI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:12.798499] [FATAL] [MAIN ] NPKI: Failed to save derivative data. [2025-10-24T00:53:12.802106] [DEBUG] [LOCAL ] NPV: Loaded 5400 existing records from primary storage. [2025-10-24T00:53:12.918951] [INFO ] [MAIN ] Derivative Progress: 1386/2164 symbols completed. NPKI took 1.4s. Estimated remaining: 5m 13s. Rate: 149.1 symbols/min [2025-10-24T00:53:12.919691] [INFO ] [MAIN ] NPV: Loaded 5400 primary data records. [2025-10-24T00:53:12.919152] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:13.260059] [DEBUG] [LOCAL ] NPWR: Loaded 43826 existing records from primary storage. [2025-10-24T00:53:13.260476] [INFO ] [MAIN ] NPWR: Loaded 43826 primary data records. [2025-10-24T00:53:13.318446] [DEBUG] [MAIN ] NPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:13.425336] [DEBUG] [MAIN ] NPV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:13.685158] [INFO ] [MAIN ] NPO: Generated 139 derivative records from 13600 primary records. [2025-10-24T00:53:13.687439] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-24T00:53:13.688111] [FATAL] [LOCAL ] NPO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:13.687614] [INFO ] [MAIN ] NPV: Generated 139 derivative records from 5400 primary records. [2025-10-24T00:53:13.688405] [FATAL] [MAIN ] NPO: Failed to save derivative data. [2025-10-24T00:53:13.688526] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-24T00:53:13.690592] [INFO ] [MAIN ] Derivative Progress: 1387/2164 symbols completed. NPO took 1.1s. Estimated remaining: 5m 13s. Rate: 149.0 symbols/min [2025-10-24T00:53:13.691064] [FATAL] [LOCAL ] NPV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:13.691465] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:13.692208] [FATAL] [MAIN ] NPV: Failed to save derivative data. [2025-10-24T00:53:13.695097] [INFO ] [MAIN ] Derivative Progress: 1388/2164 symbols completed. NPV took 1.0s. Estimated remaining: 5m 12s. Rate: 149.1 symbols/min [2025-10-24T00:53:13.695843] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:13.714340] [DEBUG] [MAIN ] NPWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:13.732624] [DEBUG] [LOCAL ] NQP: Loaded 9104 existing records from primary storage. [2025-10-24T00:53:13.733809] [INFO ] [MAIN ] NQP: Loaded 9104 primary data records. [2025-10-24T00:53:13.880234] [DEBUG] [LOCAL ] NRDY: Loaded 32344 existing records from primary storage. [2025-10-24T00:53:13.888531] [INFO ] [MAIN ] NRDY: Loaded 32344 primary data records. [2025-10-24T00:53:14.316220] [INFO ] [MAIN ] NPWR: Generated 139 derivative records from 43826 primary records. [2025-10-24T00:53:14.343744] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-24T00:53:14.344094] [FATAL] [LOCAL ] NPWR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:14.344464] [FATAL] [MAIN ] NPWR: Failed to save derivative data. [2025-10-24T00:53:14.454626] [INFO ] [MAIN ] Derivative Progress: 1389/2164 symbols completed. NPWR took 1.5s. Estimated remaining: 5m 12s. Rate: 149.0 symbols/min [2025-10-24T00:53:14.470802] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:14.485813] [DEBUG] [LOCAL ] NREF: Loaded 7848 existing records from primary storage. [2025-10-24T00:53:14.486196] [INFO ] [MAIN ] NREF: Loaded 7848 primary data records. [2025-10-24T00:53:14.805799] [DEBUG] [MAIN ] NQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:14.848549] [DEBUG] [MAIN ] NRDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:14.923196] [DEBUG] [MAIN ] NREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:14.939089] [INFO ] [MAIN ] NQP: Generated 139 derivative records from 9104 primary records. [2025-10-24T00:53:14.943696] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-24T00:53:14.941950] [INFO ] [MAIN ] NRDY: Generated 139 derivative records from 32344 primary records. [2025-10-24T00:53:14.946103] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-24T00:53:14.946735] [FATAL] [LOCAL ] NQP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:14.947465] [FATAL] [MAIN ] NQP: Failed to save derivative data. [2025-10-24T00:53:14.947381] [FATAL] [LOCAL ] NRDY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:14.950479] [INFO ] [MAIN ] Derivative Progress: 1390/2164 symbols completed. NQP took 1.3s. Estimated remaining: 5m 12s. Rate: 149.0 symbols/min [2025-10-24T00:53:14.950617] [FATAL] [MAIN ] NRDY: Failed to save derivative data. [2025-10-24T00:53:14.951202] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:14.957816] [INFO ] [MAIN ] Derivative Progress: 1391/2164 symbols completed. NRDY took 1.3s. Estimated remaining: 5m 11s. Rate: 149.1 symbols/min [2025-10-24T00:53:14.958883] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:14.974630] [INFO ] [MAIN ] NREF: Generated 139 derivative records from 7848 primary records. [2025-10-24T00:53:14.975597] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-24T00:53:14.975845] [FATAL] [LOCAL ] NREF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:14.975925] [FATAL] [MAIN ] NREF: Failed to save derivative data. [2025-10-24T00:53:14.978750] [INFO ] [MAIN ] Derivative Progress: 1392/2164 symbols completed. NREF took 0.5s. Estimated remaining: 5m 10s. Rate: 149.2 symbols/min [2025-10-24T00:53:14.979027] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:15.027498] [DEBUG] [LOCAL ] NRGV: Loaded 44291 existing records from primary storage. [2025-10-24T00:53:15.027914] [INFO ] [MAIN ] NRGV: Loaded 44291 primary data records. [2025-10-24T00:53:15.072828] [DEBUG] [LOCAL ] NRK: Loaded 20613 existing records from primary storage. [2025-10-24T00:53:15.086273] [INFO ] [MAIN ] NRK: Loaded 20613 primary data records. [2025-10-24T00:53:15.220380] [DEBUG] [LOCAL ] NRG: Loaded 53197 existing records from primary storage. [2025-10-24T00:53:15.263616] [INFO ] [MAIN ] NRG: Loaded 53197 primary data records. [2025-10-24T00:53:16.075837] [DEBUG] [MAIN ] NRGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:16.130048] [DEBUG] [MAIN ] NRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:16.163522] [DEBUG] [MAIN ] NRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:16.213994] [INFO ] [MAIN ] NRGV: Generated 139 derivative records from 44291 primary records. [2025-10-24T00:53:16.214568] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-24T00:53:16.219239] [FATAL] [LOCAL ] NRGV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:16.220406] [FATAL] [MAIN ] NRGV: Failed to save derivative data. [2025-10-24T00:53:16.222890] [INFO ] [MAIN ] Derivative Progress: 1393/2164 symbols completed. NRGV took 1.3s. Estimated remaining: 5m 10s. Rate: 149.0 symbols/min [2025-10-24T00:53:16.245711] [INFO ] [MAIN ] NRK: Generated 139 derivative records from 20613 primary records. [2025-10-24T00:53:16.246198] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-24T00:53:16.248552] [FATAL] [LOCAL ] NRK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:16.248710] [FATAL] [MAIN ] NRK: Failed to save derivative data. [2025-10-24T00:53:16.248182] [INFO ] [MAIN ] NRG: Generated 139 derivative records from 53197 primary records. [2025-10-24T00:53:16.251175] [INFO ] [MAIN ] Derivative Progress: 1394/2164 symbols completed. NRK took 1.3s. Estimated remaining: 5m 10s. Rate: 149.1 symbols/min [2025-10-24T00:53:16.251608] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-10-24T00:53:16.251977] [FATAL] [LOCAL ] NRG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:16.252066] [FATAL] [MAIN ] NRG: Failed to save derivative data. [2025-10-24T00:53:16.257068] [INFO ] [MAIN ] Derivative Progress: 1395/2164 symbols completed. NRG took 1.3s. Estimated remaining: 5m 9s. Rate: 149.2 symbols/min [2025-10-24T00:53:16.257768] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:16.257579] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:16.257938] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:16.269623] [DEBUG] [LOCAL ] NRP: Loaded 4185 existing records from primary storage. [2025-10-24T00:53:16.269898] [INFO ] [MAIN ] NRP: Loaded 4185 primary data records. [2025-10-24T00:53:16.296577] [DEBUG] [LOCAL ] NRT: Loaded 4930 existing records from primary storage. [2025-10-24T00:53:16.326399] [INFO ] [MAIN ] NRT: Loaded 4930 primary data records. [2025-10-24T00:53:16.798205] [DEBUG] [LOCAL ] NSA: Loaded 45453 existing records from primary storage. [2025-10-24T00:53:16.924752] [INFO ] [MAIN ] NSA: Loaded 45453 primary data records. [2025-10-24T00:53:17.286088] [DEBUG] [MAIN ] NRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:17.318218] [DEBUG] [MAIN ] NRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:17.386789] [DEBUG] [MAIN ] NSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:17.431209] [INFO ] [MAIN ] NRP: Generated 139 derivative records from 4185 primary records. [2025-10-24T00:53:17.430837] [INFO ] [MAIN ] NRT: Generated 139 derivative records from 4930 primary records. [2025-10-24T00:53:17.433403] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-24T00:53:17.436056] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-24T00:53:17.436751] [FATAL] [LOCAL ] NRP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:17.437304] [FATAL] [MAIN ] NRP: Failed to save derivative data. [2025-10-24T00:53:17.441082] [INFO ] [MAIN ] Derivative Progress: 1396/2164 symbols completed. NRP took 1.2s. Estimated remaining: 5m 9s. Rate: 149.0 symbols/min [2025-10-24T00:53:17.441523] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:17.437565] [FATAL] [LOCAL ] NRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:17.443429] [FATAL] [MAIN ] NRT: Failed to save derivative data. [2025-10-24T00:53:17.447392] [INFO ] [MAIN ] Derivative Progress: 1397/2164 symbols completed. NRT took 1.2s. Estimated remaining: 5m 9s. Rate: 149.1 symbols/min [2025-10-24T00:53:17.451124] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:17.458766] [INFO ] [MAIN ] NSA: Generated 139 derivative records from 45453 primary records. [2025-10-24T00:53:17.459068] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-24T00:53:17.459707] [FATAL] [LOCAL ] NSA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:17.459869] [FATAL] [MAIN ] NSA: Failed to save derivative data. [2025-10-24T00:53:17.464754] [INFO ] [MAIN ] Derivative Progress: 1398/2164 symbols completed. NSA took 1.2s. Estimated remaining: 5m 8s. Rate: 149.2 symbols/min [2025-10-24T00:53:17.465114] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:17.498050] [DEBUG] [LOCAL ] NTB: Loaded 20317 existing records from primary storage. [2025-10-24T00:53:17.498501] [INFO ] [MAIN ] NTB: Loaded 20317 primary data records. [2025-10-24T00:53:17.623347] [DEBUG] [LOCAL ] NSC: Loaded 49001 existing records from primary storage. [2025-10-24T00:53:17.639073] [INFO ] [MAIN ] NSC: Loaded 49001 primary data records. [2025-10-24T00:53:17.645782] [DEBUG] [LOCAL ] NSP: Loaded 36010 existing records from primary storage. [2025-10-24T00:53:17.701894] [INFO ] [MAIN ] NSP: Loaded 36010 primary data records. [2025-10-24T00:53:18.602638] [DEBUG] [MAIN ] NTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:18.637837] [DEBUG] [MAIN ] NSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:18.686421] [DEBUG] [MAIN ] NSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:18.717370] [INFO ] [MAIN ] NTB: Generated 139 derivative records from 20317 primary records. [2025-10-24T00:53:18.720300] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-24T00:53:18.724680] [FATAL] [LOCAL ] NTB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:18.728286] [FATAL] [MAIN ] NTB: Failed to save derivative data. [2025-10-24T00:53:18.730995] [INFO ] [MAIN ] Derivative Progress: 1399/2164 symbols completed. NTB took 1.3s. Estimated remaining: 5m 8s. Rate: 149.0 symbols/min [2025-10-24T00:53:18.737908] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:18.746913] [INFO ] [MAIN ] NSC: Generated 139 derivative records from 49001 primary records. [2025-10-24T00:53:18.747886] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-10-24T00:53:18.748184] [FATAL] [LOCAL ] NSC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:18.749463] [FATAL] [MAIN ] NSC: Failed to save derivative data. [2025-10-24T00:53:18.752273] [INFO ] [MAIN ] Derivative Progress: 1400/2164 symbols completed. NSC took 1.3s. Estimated remaining: 5m 8s. Rate: 149.1 symbols/min [2025-10-24T00:53:18.753005] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:18.756712] [INFO ] [MAIN ] NSP: Generated 139 derivative records from 36010 primary records. [2025-10-24T00:53:18.757382] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-24T00:53:18.757918] [FATAL] [LOCAL ] NSP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:18.758052] [FATAL] [MAIN ] NSP: Failed to save derivative data. [2025-10-24T00:53:18.760991] [INFO ] [MAIN ] Derivative Progress: 1401/2164 symbols completed. NSP took 1.3s. Estimated remaining: 5m 7s. Rate: 149.2 symbols/min [2025-10-24T00:53:18.761949] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:18.832684] [DEBUG] [LOCAL ] NTST: Loaded 44366 existing records from primary storage. [2025-10-24T00:53:18.833057] [INFO ] [MAIN ] NTST: Loaded 44366 primary data records. [2025-10-24T00:53:18.830726] [DEBUG] [LOCAL ] NTR: Loaded 53001 existing records from primary storage. [2025-10-24T00:53:18.845213] [INFO ] [MAIN ] NTR: Loaded 53001 primary data records. [2025-10-24T00:53:19.158625] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-10-24T00:53:19.164845] [INFO ] [MAIN ] NU: Loaded 54136 primary data records. [2025-10-24T00:53:19.802983] [DEBUG] [MAIN ] NTST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:19.834184] [DEBUG] [MAIN ] NTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:19.887158] [DEBUG] [MAIN ] NU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:19.944162] [INFO ] [MAIN ] NTR: Generated 139 derivative records from 53001 primary records. [2025-10-24T00:53:19.944878] [INFO ] [MAIN ] NTST: Generated 139 derivative records from 44366 primary records. [2025-10-24T00:53:19.945269] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-24T00:53:19.945893] [FATAL] [LOCAL ] NTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:19.945993] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-24T00:53:19.946185] [FATAL] [MAIN ] NTR: Failed to save derivative data. [2025-10-24T00:53:19.949062] [INFO ] [MAIN ] Derivative Progress: 1402/2164 symbols completed. NTR took 1.2s. Estimated remaining: 5m 7s. Rate: 149.0 symbols/min [2025-10-24T00:53:19.950441] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:19.950753] [FATAL] [LOCAL ] NTST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:19.951870] [FATAL] [MAIN ] NTST: Failed to save derivative data. [2025-10-24T00:53:19.957303] [INFO ] [MAIN ] Derivative Progress: 1403/2164 symbols completed. NTST took 1.2s. Estimated remaining: 5m 6s. Rate: 149.1 symbols/min [2025-10-24T00:53:19.957834] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:19.962029] [INFO ] [MAIN ] NU: Generated 139 derivative records from 54136 primary records. [2025-10-24T00:53:19.962387] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-24T00:53:19.962692] [FATAL] [LOCAL ] NU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:19.962787] [FATAL] [MAIN ] NU: Failed to save derivative data. [2025-10-24T00:53:19.965551] [INFO ] [MAIN ] Derivative Progress: 1404/2164 symbols completed. NU took 1.2s. Estimated remaining: 5m 6s. Rate: 149.2 symbols/min [2025-10-24T00:53:19.965781] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:19.998556] [DEBUG] [LOCAL ] NUV: Loaded 23426 existing records from primary storage. [2025-10-24T00:53:19.998746] [INFO ] [MAIN ] NUV: Loaded 23426 primary data records. [2025-10-24T00:53:20.119246] [DEBUG] [LOCAL ] NUS: Loaded 36280 existing records from primary storage. [2025-10-24T00:53:20.123362] [INFO ] [MAIN ] NUS: Loaded 36280 primary data records. [2025-10-24T00:53:20.488355] [DEBUG] [LOCAL ] NUVB: Loaded 52098 existing records from primary storage. [2025-10-24T00:53:20.497792] [INFO ] [MAIN ] NUVB: Loaded 52098 primary data records. [2025-10-24T00:53:21.040615] [DEBUG] [MAIN ] NUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:21.039972] [DEBUG] [MAIN ] NUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:21.086761] [DEBUG] [MAIN ] NUVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:21.145268] [INFO ] [MAIN ] NUV: Generated 139 derivative records from 23426 primary records. [2025-10-24T00:53:21.147435] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-24T00:53:21.149187] [FATAL] [LOCAL ] NUV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:21.154432] [INFO ] [MAIN ] NUS: Generated 139 derivative records from 36280 primary records. [2025-10-24T00:53:21.154055] [FATAL] [MAIN ] NUV: Failed to save derivative data. [2025-10-24T00:53:21.156826] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-24T00:53:21.156604] [INFO ] [MAIN ] Derivative Progress: 1405/2164 symbols completed. NUV took 1.2s. Estimated remaining: 5m 6s. Rate: 149.0 symbols/min [2025-10-24T00:53:21.157426] [FATAL] [LOCAL ] NUS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:21.157163] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:21.157618] [FATAL] [MAIN ] NUS: Failed to save derivative data. [2025-10-24T00:53:21.162453] [INFO ] [MAIN ] Derivative Progress: 1406/2164 symbols completed. NUS took 1.2s. Estimated remaining: 5m 5s. Rate: 149.1 symbols/min [2025-10-24T00:53:21.162780] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:21.172080] [INFO ] [MAIN ] NUVB: Generated 139 derivative records from 52098 primary records. [2025-10-24T00:53:21.172269] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-24T00:53:21.172493] [FATAL] [LOCAL ] NUVB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:21.172802] [FATAL] [MAIN ] NUVB: Failed to save derivative data. [2025-10-24T00:53:21.176382] [DEBUG] [LOCAL ] NUW: Loaded 6664 existing records from primary storage. [2025-10-24T00:53:21.179743] [INFO ] [MAIN ] NUW: Loaded 6664 primary data records. [2025-10-24T00:53:21.179591] [INFO ] [MAIN ] Derivative Progress: 1407/2164 symbols completed. NUVB took 1.2s. Estimated remaining: 5m 4s. Rate: 149.2 symbols/min [2025-10-24T00:53:21.191228] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:21.317204] [DEBUG] [LOCAL ] NVG: Loaded 27531 existing records from primary storage. [2025-10-24T00:53:21.496743] [INFO ] [MAIN ] NVG: Loaded 27531 primary data records. [2025-10-24T00:53:21.536150] [DEBUG] [LOCAL ] NVGS: Loaded 30091 existing records from primary storage. [2025-10-24T00:53:21.536392] [INFO ] [MAIN ] NVGS: Loaded 30091 primary data records. [2025-10-24T00:53:22.170718] [DEBUG] [MAIN ] NUW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:22.221471] [DEBUG] [MAIN ] NVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:22.226774] [DEBUG] [MAIN ] NVGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:22.293145] [INFO ] [MAIN ] NUW: Generated 139 derivative records from 6664 primary records. [2025-10-24T00:53:22.293831] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-24T00:53:22.295090] [FATAL] [LOCAL ] NUW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:22.295620] [FATAL] [MAIN ] NUW: Failed to save derivative data. [2025-10-24T00:53:22.303710] [INFO ] [MAIN ] Derivative Progress: 1408/2164 symbols completed. NUW took 1.1s. Estimated remaining: 5m 4s. Rate: 149.0 symbols/min [2025-10-24T00:53:22.310505] [INFO ] [MAIN ] NVG: Generated 139 derivative records from 27531 primary records. [2025-10-24T00:53:22.313789] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-24T00:53:22.314087] [FATAL] [LOCAL ] NVG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:22.315411] [FATAL] [MAIN ] NVG: Failed to save derivative data. [2025-10-24T00:53:22.318572] [INFO ] [MAIN ] Derivative Progress: 1409/2164 symbols completed. NVG took 1.2s. Estimated remaining: 5m 4s. Rate: 149.1 symbols/min [2025-10-24T00:53:22.320269] [INFO ] [MAIN ] NVGS: Generated 139 derivative records from 30091 primary records. [2025-10-24T00:53:22.320367] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-24T00:53:22.320561] [FATAL] [LOCAL ] NVGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:22.320637] [FATAL] [MAIN ] NVGS: Failed to save derivative data. [2025-10-24T00:53:22.323625] [INFO ] [MAIN ] Derivative Progress: 1410/2164 symbols completed. NVGS took 1.1s. Estimated remaining: 5m 3s. Rate: 149.2 symbols/min [2025-10-24T00:53:22.324022] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:22.324238] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:22.324150] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:22.348538] [DEBUG] [LOCAL ] NVR: Loaded 18511 existing records from primary storage. [2025-10-24T00:53:22.348718] [INFO ] [MAIN ] NVR: Loaded 18511 primary data records. [2025-10-24T00:53:22.568374] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-10-24T00:53:22.613555] [INFO ] [MAIN ] NVO: Loaded 54174 primary data records. [2025-10-24T00:53:22.733680] [DEBUG] [LOCAL ] NVRI: Loaded 39257 existing records from primary storage. [2025-10-24T00:53:22.765481] [INFO ] [MAIN ] NVRI: Loaded 39257 primary data records. [2025-10-24T00:53:23.390921] [DEBUG] [MAIN ] NVR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:23.441952] [DEBUG] [MAIN ] NVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:23.485264] [INFO ] [MAIN ] NVR: Generated 139 derivative records from 18511 primary records. [2025-10-24T00:53:23.485837] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-24T00:53:23.487545] [DEBUG] [MAIN ] NVRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:23.488125] [FATAL] [LOCAL ] NVR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:23.501102] [FATAL] [MAIN ] NVR: Failed to save derivative data. [2025-10-24T00:53:23.504312] [INFO ] [MAIN ] Derivative Progress: 1411/2164 symbols completed. NVR took 1.2s. Estimated remaining: 5m 3s. Rate: 149.0 symbols/min [2025-10-24T00:53:23.505186] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:23.562007] [INFO ] [MAIN ] NVO: Generated 139 derivative records from 54174 primary records. [2025-10-24T00:53:23.563979] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-24T00:53:23.568905] [FATAL] [LOCAL ] NVO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:23.569119] [FATAL] [MAIN ] NVO: Failed to save derivative data. [2025-10-24T00:53:23.571829] [INFO ] [MAIN ] Derivative Progress: 1412/2164 symbols completed. NVO took 1.2s. Estimated remaining: 5m 3s. Rate: 149.1 symbols/min [2025-10-24T00:53:23.574048] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:23.574338] [INFO ] [MAIN ] NVRI: Generated 139 derivative records from 39257 primary records. [2025-10-24T00:53:23.575693] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-24T00:53:23.589884] [FATAL] [LOCAL ] NVRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:23.590223] [FATAL] [MAIN ] NVRI: Failed to save derivative data. [2025-10-24T00:53:23.593222] [INFO ] [MAIN ] Derivative Progress: 1413/2164 symbols completed. NVRI took 1.3s. Estimated remaining: 5m 2s. Rate: 149.2 symbols/min [2025-10-24T00:53:23.593570] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:23.594438] [DEBUG] [LOCAL ] NVS: Loaded 51660 existing records from primary storage. [2025-10-24T00:53:23.595163] [INFO ] [MAIN ] NVS: Loaded 51660 primary data records. [2025-10-24T00:53:23.987571] [DEBUG] [LOCAL ] NVST: Loaded 51815 existing records from primary storage. [2025-10-24T00:53:23.990553] [INFO ] [MAIN ] NVST: Loaded 51815 primary data records. [2025-10-24T00:53:23.996978] [DEBUG] [LOCAL ] NVT: Loaded 51798 existing records from primary storage. [2025-10-24T00:53:24.005226] [INFO ] [MAIN ] NVT: Loaded 51798 primary data records. [2025-10-24T00:53:24.492459] [DEBUG] [MAIN ] NVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:24.813995] [DEBUG] [MAIN ] NVST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:24.836202] [INFO ] [MAIN ] NVS: Generated 139 derivative records from 51660 primary records. [2025-10-24T00:53:24.836970] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-24T00:53:24.837263] [FATAL] [LOCAL ] NVS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:24.838860] [FATAL] [MAIN ] NVS: Failed to save derivative data. [2025-10-24T00:53:24.842915] [INFO ] [MAIN ] Derivative Progress: 1414/2164 symbols completed. NVS took 1.3s. Estimated remaining: 5m 2s. Rate: 149.0 symbols/min [2025-10-24T00:53:24.843677] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:24.874561] [DEBUG] [MAIN ] NVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:24.907362] [INFO ] [MAIN ] NVST: Generated 139 derivative records from 51815 primary records. [2025-10-24T00:53:24.907953] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-24T00:53:24.910787] [FATAL] [LOCAL ] NVST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:24.911214] [FATAL] [MAIN ] NVST: Failed to save derivative data. [2025-10-24T00:53:24.914326] [INFO ] [MAIN ] Derivative Progress: 1415/2164 symbols completed. NVST took 1.3s. Estimated remaining: 5m 2s. Rate: 149.0 symbols/min [2025-10-24T00:53:24.914777] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:24.942432] [INFO ] [MAIN ] NVT: Generated 139 derivative records from 51798 primary records. [2025-10-24T00:53:24.942697] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-24T00:53:24.942934] [FATAL] [LOCAL ] NVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:24.943087] [FATAL] [MAIN ] NVT: Failed to save derivative data. [2025-10-24T00:53:24.946790] [INFO ] [MAIN ] Derivative Progress: 1416/2164 symbols completed. NVT took 1.4s. Estimated remaining: 5m 1s. Rate: 149.1 symbols/min [2025-10-24T00:53:24.948176] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:24.964887] [DEBUG] [LOCAL ] NWG: Loaded 51774 existing records from primary storage. [2025-10-24T00:53:24.965413] [INFO ] [MAIN ] NWG: Loaded 51774 primary data records. [2025-10-24T00:53:25.153196] [DEBUG] [LOCAL ] NWN: Loaded 26582 existing records from primary storage. [2025-10-24T00:53:25.163452] [INFO ] [MAIN ] NWN: Loaded 26582 primary data records. [2025-10-24T00:53:25.378347] [DEBUG] [LOCAL ] NX: Loaded 33545 existing records from primary storage. [2025-10-24T00:53:25.395682] [INFO ] [MAIN ] NX: Loaded 33545 primary data records. [2025-10-24T00:53:26.000330] [DEBUG] [MAIN ] NWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:26.043578] [DEBUG] [MAIN ] NWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:26.082769] [DEBUG] [MAIN ] NX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:26.143260] [INFO ] [MAIN ] NWG: Generated 139 derivative records from 51774 primary records. [2025-10-24T00:53:26.147061] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-24T00:53:26.152321] [FATAL] [LOCAL ] NWG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:26.152437] [FATAL] [MAIN ] NWG: Failed to save derivative data. [2025-10-24T00:53:26.152787] [INFO ] [MAIN ] NWN: Generated 139 derivative records from 26582 primary records. [2025-10-24T00:53:26.159416] [INFO ] [MAIN ] Derivative Progress: 1417/2164 symbols completed. NWG took 1.3s. Estimated remaining: 5m 1s. Rate: 148.9 symbols/min [2025-10-24T00:53:26.159789] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-24T00:53:26.163362] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:26.164269] [FATAL] [LOCAL ] NWN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:26.164477] [FATAL] [MAIN ] NWN: Failed to save derivative data. [2025-10-24T00:53:26.168136] [INFO ] [MAIN ] Derivative Progress: 1418/2164 symbols completed. NWN took 1.3s. Estimated remaining: 5m 0s. Rate: 149.0 symbols/min [2025-10-24T00:53:26.168562] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:26.175592] [INFO ] [MAIN ] NX: Generated 139 derivative records from 33545 primary records. [2025-10-24T00:53:26.176191] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-24T00:53:26.176504] [FATAL] [LOCAL ] NX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:26.176613] [FATAL] [MAIN ] NX: Failed to save derivative data. [2025-10-24T00:53:26.186498] [INFO ] [MAIN ] Derivative Progress: 1419/2164 symbols completed. NX took 1.2s. Estimated remaining: 4m 60s. Rate: 149.1 symbols/min [2025-10-24T00:53:26.187184] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:26.196128] [DEBUG] [LOCAL ] NXC: Loaded 4096 existing records from primary storage. [2025-10-24T00:53:26.196483] [INFO ] [MAIN ] NXC: Loaded 4096 primary data records. [2025-10-24T00:53:26.310255] [DEBUG] [LOCAL ] NXDT: Loaded 14863 existing records from primary storage. [2025-10-24T00:53:26.314867] [INFO ] [MAIN ] NXDT: Loaded 14863 primary data records. [2025-10-24T00:53:26.718201] [DEBUG] [LOCAL ] NXE: Loaded 53454 existing records from primary storage. [2025-10-24T00:53:26.906238] [INFO ] [MAIN ] NXE: Loaded 53454 primary data records. [2025-10-24T00:53:27.267341] [DEBUG] [MAIN ] NXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:27.305057] [DEBUG] [MAIN ] NXDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:27.374243] [DEBUG] [MAIN ] NXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:27.401174] [INFO ] [MAIN ] NXC: Generated 139 derivative records from 4096 primary records. [2025-10-24T00:53:27.404966] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-24T00:53:27.405634] [FATAL] [LOCAL ] NXC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:27.406087] [FATAL] [MAIN ] NXC: Failed to save derivative data. [2025-10-24T00:53:27.413011] [INFO ] [MAIN ] NXDT: Generated 139 derivative records from 14863 primary records. [2025-10-24T00:53:27.412414] [INFO ] [MAIN ] Derivative Progress: 1420/2164 symbols completed. NXC took 1.2s. Estimated remaining: 4m 60s. Rate: 148.9 symbols/min [2025-10-24T00:53:27.416364] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-24T00:53:27.413536] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:27.417090] [FATAL] [LOCAL ] NXDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:27.417807] [FATAL] [MAIN ] NXDT: Failed to save derivative data. [2025-10-24T00:53:27.421744] [INFO ] [MAIN ] Derivative Progress: 1421/2164 symbols completed. NXDT took 1.3s. Estimated remaining: 4m 59s. Rate: 149.0 symbols/min [2025-10-24T00:53:27.424015] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:27.444555] [INFO ] [MAIN ] NXE: Generated 139 derivative records from 53454 primary records. [2025-10-24T00:53:27.445006] [DEBUG] [LOCAL ] NXG: Loaded 10567 existing records from primary storage. [2025-10-24T00:53:27.449354] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-24T00:53:27.449432] [INFO ] [MAIN ] NXG: Loaded 10567 primary data records. [2025-10-24T00:53:27.449733] [FATAL] [LOCAL ] NXE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:27.449880] [FATAL] [MAIN ] NXE: Failed to save derivative data. [2025-10-24T00:53:27.504802] [INFO ] [MAIN ] Derivative Progress: 1422/2164 symbols completed. NXE took 1.3s. Estimated remaining: 4m 59s. Rate: 149.1 symbols/min [2025-10-24T00:53:27.572048] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:27.573626] [DEBUG] [LOCAL ] NXJ: Loaded 14866 existing records from primary storage. [2025-10-24T00:53:27.584938] [INFO ] [MAIN ] NXJ: Loaded 14866 primary data records. [2025-10-24T00:53:27.830326] [DEBUG] [LOCAL ] NXN: Loaded 2313 existing records from primary storage. [2025-10-24T00:53:27.871872] [INFO ] [MAIN ] NXN: Loaded 2313 primary data records. [2025-10-24T00:53:28.437360] [DEBUG] [MAIN ] NXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:28.483966] [DEBUG] [MAIN ] NXJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:28.524948] [DEBUG] [MAIN ] NXN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:28.549818] [INFO ] [MAIN ] NXG: Generated 139 derivative records from 10567 primary records. [2025-10-24T00:53:28.553058] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-24T00:53:28.553926] [FATAL] [LOCAL ] NXG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:28.557106] [FATAL] [MAIN ] NXG: Failed to save derivative data. [2025-10-24T00:53:28.560677] [INFO ] [MAIN ] Derivative Progress: 1423/2164 symbols completed. NXG took 1.1s. Estimated remaining: 4m 59s. Rate: 148.9 symbols/min [2025-10-24T00:53:28.583868] [INFO ] [MAIN ] NXJ: Generated 139 derivative records from 14866 primary records. [2025-10-24T00:53:28.585092] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-24T00:53:28.585490] [FATAL] [LOCAL ] NXJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:28.585589] [FATAL] [MAIN ] NXJ: Failed to save derivative data. [2025-10-24T00:53:28.589353] [INFO ] [MAIN ] Derivative Progress: 1424/2164 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 58s. Rate: 149.0 symbols/min [2025-10-24T00:53:28.591344] [INFO ] [MAIN ] NXN: Generated 139 derivative records from 2313 primary records. [2025-10-24T00:53:28.591437] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-24T00:53:28.591670] [FATAL] [LOCAL ] NXN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:28.591783] [FATAL] [MAIN ] NXN: Failed to save derivative data. [2025-10-24T00:53:28.596050] [INFO ] [MAIN ] Derivative Progress: 1425/2164 symbols completed. NXN took 1.0s. Estimated remaining: 4m 57s. Rate: 149.1 symbols/min [2025-10-24T00:53:28.596571] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:28.597335] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:28.596787] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:28.622599] [DEBUG] [LOCAL ] NXP: Loaded 12306 existing records from primary storage. [2025-10-24T00:53:28.622873] [INFO ] [MAIN ] NXP: Loaded 12306 primary data records. [2025-10-24T00:53:28.695602] [DEBUG] [LOCAL ] NXRT: Loaded 19039 existing records from primary storage. [2025-10-24T00:53:28.717725] [INFO ] [MAIN ] NXRT: Loaded 19039 primary data records. [2025-10-24T00:53:29.232498] [DEBUG] [LOCAL ] NYT: Loaded 49803 existing records from primary storage. [2025-10-24T00:53:29.358889] [INFO ] [MAIN ] NYT: Loaded 49803 primary data records. [2025-10-24T00:53:29.706981] [DEBUG] [MAIN ] NXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:29.753235] [DEBUG] [MAIN ] NXRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:29.800818] [DEBUG] [MAIN ] NYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:29.840418] [INFO ] [MAIN ] NXP: Generated 139 derivative records from 12306 primary records. [2025-10-24T00:53:29.841093] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-24T00:53:29.841419] [FATAL] [LOCAL ] NXP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:29.844041] [FATAL] [MAIN ] NXP: Failed to save derivative data. [2025-10-24T00:53:29.848817] [INFO ] [MAIN ] Derivative Progress: 1426/2164 symbols completed. NXP took 1.3s. Estimated remaining: 4m 57s. Rate: 148.9 symbols/min [2025-10-24T00:53:29.850205] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:29.856136] [INFO ] [MAIN ] NXRT: Generated 139 derivative records from 19039 primary records. [2025-10-24T00:53:29.857896] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-24T00:53:29.858336] [FATAL] [LOCAL ] NXRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:29.858435] [FATAL] [MAIN ] NXRT: Failed to save derivative data. [2025-10-24T00:53:29.860952] [INFO ] [MAIN ] Derivative Progress: 1427/2164 symbols completed. NXRT took 1.3s. Estimated remaining: 4m 57s. Rate: 149.0 symbols/min [2025-10-24T00:53:29.861348] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:29.873353] [INFO ] [MAIN ] NYT: Generated 139 derivative records from 49803 primary records. [2025-10-24T00:53:29.873563] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-24T00:53:29.873829] [FATAL] [LOCAL ] NYT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:29.873912] [FATAL] [MAIN ] NYT: Failed to save derivative data. [2025-10-24T00:53:29.876962] [INFO ] [MAIN ] Derivative Progress: 1428/2164 symbols completed. NYT took 1.3s. Estimated remaining: 4m 56s. Rate: 149.1 symbols/min [2025-10-24T00:53:29.877588] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:29.904091] [DEBUG] [LOCAL ] NZF: Loaded 28909 existing records from primary storage. [2025-10-24T00:53:29.904527] [INFO ] [MAIN ] NZF: Loaded 28909 primary data records. [2025-10-24T00:53:30.033710] [DEBUG] [LOCAL ] OBK: Loaded 16495 existing records from primary storage. [2025-10-24T00:53:30.059522] [INFO ] [MAIN ] OBK: Loaded 16495 primary data records. [2025-10-24T00:53:30.060369] [DEBUG] [LOCAL ] OBDC: Loaded 52109 existing records from primary storage. [2025-10-24T00:53:30.083150] [INFO ] [MAIN ] OBDC: Loaded 52109 primary data records. [2025-10-24T00:53:31.015148] [DEBUG] [MAIN ] NZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:31.043809] [DEBUG] [MAIN ] OBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:31.099122] [DEBUG] [MAIN ] OBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:31.152345] [INFO ] [MAIN ] OBDC: Generated 139 derivative records from 52109 primary records. [2025-10-24T00:53:31.150113] [INFO ] [MAIN ] NZF: Generated 139 derivative records from 28909 primary records. [2025-10-24T00:53:31.157534] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-24T00:53:31.157389] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-24T00:53:31.158813] [FATAL] [LOCAL ] OBDC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:31.159005] [FATAL] [MAIN ] OBDC: Failed to save derivative data. [2025-10-24T00:53:31.158491] [FATAL] [LOCAL ] NZF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:31.161599] [INFO ] [MAIN ] Derivative Progress: 1429/2164 symbols completed. OBDC took 1.3s. Estimated remaining: 4m 56s. Rate: 148.9 symbols/min [2025-10-24T00:53:31.161741] [FATAL] [MAIN ] NZF: Failed to save derivative data. [2025-10-24T00:53:31.161972] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:31.166169] [INFO ] [MAIN ] Derivative Progress: 1430/2164 symbols completed. NZF took 1.3s. Estimated remaining: 4m 56s. Rate: 149.0 symbols/min [2025-10-24T00:53:31.167324] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:31.186421] [DEBUG] [LOCAL ] OCFT: Loaded 7130 existing records from primary storage. [2025-10-24T00:53:31.186836] [INFO ] [MAIN ] OBK: Generated 139 derivative records from 16495 primary records. [2025-10-24T00:53:31.187492] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-24T00:53:31.187200] [INFO ] [MAIN ] OCFT: Loaded 7130 primary data records. [2025-10-24T00:53:31.187858] [FATAL] [LOCAL ] OBK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:31.225317] [FATAL] [MAIN ] OBK: Failed to save derivative data. [2025-10-24T00:53:31.272955] [INFO ] [MAIN ] Derivative Progress: 1431/2164 symbols completed. OBK took 1.4s. Estimated remaining: 4m 55s. Rate: 149.1 symbols/min [2025-10-24T00:53:31.294523] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:31.533022] [DEBUG] [LOCAL ] OC: Loaded 45203 existing records from primary storage. [2025-10-24T00:53:31.533689] [INFO ] [MAIN ] OC: Loaded 45203 primary data records. [2025-10-24T00:53:31.533426] [DEBUG] [LOCAL ] ODC: Loaded 8741 existing records from primary storage. [2025-10-24T00:53:31.534132] [INFO ] [MAIN ] ODC: Loaded 8741 primary data records. [2025-10-24T00:53:32.224743] [DEBUG] [MAIN ] OCFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:32.278013] [DEBUG] [MAIN ] ODC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:32.307871] [DEBUG] [MAIN ] OC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:32.348861] [INFO ] [MAIN ] OCFT: Generated 139 derivative records from 7130 primary records. [2025-10-24T00:53:32.349514] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-24T00:53:32.349845] [FATAL] [LOCAL ] OCFT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:32.350763] [FATAL] [MAIN ] OCFT: Failed to save derivative data. [2025-10-24T00:53:32.354994] [INFO ] [MAIN ] Derivative Progress: 1432/2164 symbols completed. OCFT took 1.2s. Estimated remaining: 4m 55s. Rate: 148.9 symbols/min [2025-10-24T00:53:32.355417] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:32.383691] [INFO ] [MAIN ] ODC: Generated 139 derivative records from 8741 primary records. [2025-10-24T00:53:32.384037] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-24T00:53:32.395248] [FATAL] [LOCAL ] ODC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:32.397014] [FATAL] [MAIN ] ODC: Failed to save derivative data. [2025-10-24T00:53:32.400457] [INFO ] [MAIN ] Derivative Progress: 1433/2164 symbols completed. ODC took 1.1s. Estimated remaining: 4m 54s. Rate: 149.0 symbols/min [2025-10-24T00:53:32.402594] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:32.402892] [INFO ] [MAIN ] OC: Generated 139 derivative records from 45203 primary records. [2025-10-24T00:53:32.403803] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-24T00:53:32.404062] [FATAL] [LOCAL ] OC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:32.404507] [FATAL] [MAIN ] OC: Failed to save derivative data. [2025-10-24T00:53:32.407367] [INFO ] [MAIN ] Derivative Progress: 1434/2164 symbols completed. OC took 1.2s. Estimated remaining: 4m 54s. Rate: 149.1 symbols/min [2025-10-24T00:53:32.407802] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:32.420134] [DEBUG] [LOCAL ] ODV: Loaded 30299 existing records from primary storage. [2025-10-24T00:53:32.420560] [INFO ] [MAIN ] ODV: Loaded 30299 primary data records. [2025-10-24T00:53:32.653069] [DEBUG] [LOCAL ] OFG: Loaded 20730 existing records from primary storage. [2025-10-24T00:53:32.654137] [DEBUG] [LOCAL ] OEC: Loaded 37414 existing records from primary storage. [2025-10-24T00:53:32.657736] [INFO ] [MAIN ] OFG: Loaded 20730 primary data records. [2025-10-24T00:53:32.654600] [INFO ] [MAIN ] OEC: Loaded 37414 primary data records. [2025-10-24T00:53:33.485744] [DEBUG] [MAIN ] ODV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:33.531481] [DEBUG] [MAIN ] OFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:33.568432] [DEBUG] [MAIN ] OEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:33.605127] [INFO ] [MAIN ] ODV: Generated 139 derivative records from 30299 primary records. [2025-10-24T00:53:33.606299] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-24T00:53:33.606594] [FATAL] [LOCAL ] ODV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:33.607901] [FATAL] [MAIN ] ODV: Failed to save derivative data. [2025-10-24T00:53:33.611938] [INFO ] [MAIN ] Derivative Progress: 1435/2164 symbols completed. ODV took 1.3s. Estimated remaining: 4m 54s. Rate: 148.9 symbols/min [2025-10-24T00:53:33.612177] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:33.648720] [INFO ] [MAIN ] OFG: Generated 139 derivative records from 20730 primary records. [2025-10-24T00:53:33.651389] [INFO ] [MAIN ] OEC: Generated 139 derivative records from 37414 primary records. [2025-10-24T00:53:33.651734] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-24T00:53:33.652170] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-24T00:53:33.652442] [FATAL] [LOCAL ] OEC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:33.652102] [FATAL] [LOCAL ] OFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:33.652711] [FATAL] [MAIN ] OEC: Failed to save derivative data. [2025-10-24T00:53:33.655879] [FATAL] [MAIN ] OFG: Failed to save derivative data. [2025-10-24T00:53:33.655744] [INFO ] [MAIN ] Derivative Progress: 1436/2164 symbols completed. OEC took 1.3s. Estimated remaining: 4m 53s. Rate: 149.0 symbols/min [2025-10-24T00:53:33.656244] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:33.660553] [INFO ] [MAIN ] Derivative Progress: 1437/2164 symbols completed. OFG took 1.3s. Estimated remaining: 4m 53s. Rate: 149.1 symbols/min [2025-10-24T00:53:33.661465] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:33.690444] [DEBUG] [LOCAL ] OGE: Loaded 46128 existing records from primary storage. [2025-10-24T00:53:33.690798] [INFO ] [MAIN ] OGE: Loaded 46128 primary data records. [2025-10-24T00:53:33.855774] [DEBUG] [LOCAL ] OGS: Loaded 34115 existing records from primary storage. [2025-10-24T00:53:33.887513] [INFO ] [MAIN ] OGS: Loaded 34115 primary data records. [2025-10-24T00:53:34.145758] [DEBUG] [LOCAL ] OGN: Loaded 53494 existing records from primary storage. [2025-10-24T00:53:34.146136] [INFO ] [MAIN ] OGN: Loaded 53494 primary data records. [2025-10-24T00:53:34.685885] [DEBUG] [MAIN ] OGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:34.725500] [DEBUG] [MAIN ] OGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:34.776382] [DEBUG] [MAIN ] OGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:34.804322] [INFO ] [MAIN ] OGE: Generated 139 derivative records from 46128 primary records. [2025-10-24T00:53:34.805053] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-24T00:53:34.809241] [FATAL] [LOCAL ] OGE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:34.810894] [FATAL] [MAIN ] OGE: Failed to save derivative data. [2025-10-24T00:53:34.814802] [INFO ] [MAIN ] Derivative Progress: 1438/2164 symbols completed. OGE took 1.2s. Estimated remaining: 4m 53s. Rate: 148.9 symbols/min [2025-10-24T00:53:34.821136] [INFO ] [MAIN ] OGS: Generated 139 derivative records from 34115 primary records. [2025-10-24T00:53:34.821574] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-24T00:53:34.821888] [FATAL] [LOCAL ] OGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:34.823104] [FATAL] [MAIN ] OGS: Failed to save derivative data. [2025-10-24T00:53:34.825385] [INFO ] [MAIN ] Derivative Progress: 1439/2164 symbols completed. OGS took 1.2s. Estimated remaining: 4m 52s. Rate: 149.0 symbols/min [2025-10-24T00:53:34.832889] [INFO ] [MAIN ] OGN: Generated 139 derivative records from 53494 primary records. [2025-10-24T00:53:34.833078] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-24T00:53:34.833293] [FATAL] [LOCAL ] OGN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:34.833371] [FATAL] [MAIN ] OGN: Failed to save derivative data. [2025-10-24T00:53:34.837189] [INFO ] [MAIN ] Derivative Progress: 1440/2164 symbols completed. OGN took 1.2s. Estimated remaining: 4m 51s. Rate: 149.1 symbols/min [2025-10-24T00:53:34.837634] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:34.837791] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:34.837895] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:34.857851] [DEBUG] [LOCAL ] OIA: Loaded 13127 existing records from primary storage. [2025-10-24T00:53:34.858206] [INFO ] [MAIN ] OIA: Loaded 13127 primary data records. [2025-10-24T00:53:35.083289] [DEBUG] [LOCAL ] OI: Loaded 47371 existing records from primary storage. [2025-10-24T00:53:35.243734] [INFO ] [MAIN ] OI: Loaded 47371 primary data records. [2025-10-24T00:53:35.258180] [DEBUG] [LOCAL ] OHI: Loaded 52179 existing records from primary storage. [2025-10-24T00:53:35.285058] [INFO ] [MAIN ] OHI: Loaded 52179 primary data records. [2025-10-24T00:53:35.903672] [DEBUG] [MAIN ] OIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:35.970260] [DEBUG] [MAIN ] OHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:35.971148] [DEBUG] [MAIN ] OI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:36.001682] [INFO ] [MAIN ] OIA: Generated 139 derivative records from 13127 primary records. [2025-10-24T00:53:36.002863] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-24T00:53:36.004483] [FATAL] [LOCAL ] OIA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:36.005877] [FATAL] [MAIN ] OIA: Failed to save derivative data. [2025-10-24T00:53:36.008571] [INFO ] [MAIN ] Derivative Progress: 1441/2164 symbols completed. OIA took 1.2s. Estimated remaining: 4m 51s. Rate: 148.9 symbols/min [2025-10-24T00:53:36.011676] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:36.052565] [INFO ] [MAIN ] OHI: Generated 139 derivative records from 52179 primary records. [2025-10-24T00:53:36.055333] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-24T00:53:36.055617] [FATAL] [LOCAL ] OHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:36.057217] [FATAL] [MAIN ] OHI: Failed to save derivative data. [2025-10-24T00:53:36.061150] [INFO ] [MAIN ] Derivative Progress: 1442/2164 symbols completed. OHI took 1.2s. Estimated remaining: 4m 51s. Rate: 149.0 symbols/min [2025-10-24T00:53:36.074266] [INFO ] [MAIN ] OI: Generated 139 derivative records from 47371 primary records. [2025-10-24T00:53:36.075539] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:36.075855] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-24T00:53:36.076452] [FATAL] [LOCAL ] OI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:36.076541] [FATAL] [MAIN ] OI: Failed to save derivative data. [2025-10-24T00:53:36.081634] [INFO ] [MAIN ] Derivative Progress: 1443/2164 symbols completed. OI took 1.2s. Estimated remaining: 4m 50s. Rate: 149.1 symbols/min [2025-10-24T00:53:36.078188] [DEBUG] [LOCAL ] OII: Loaded 42179 existing records from primary storage. [2025-10-24T00:53:36.081989] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:36.082231] [INFO ] [MAIN ] OII: Loaded 42179 primary data records. [2025-10-24T00:53:36.406389] [DEBUG] [LOCAL ] OIS: Loaded 40115 existing records from primary storage. [2025-10-24T00:53:36.406682] [INFO ] [MAIN ] OIS: Loaded 40115 primary data records. [2025-10-24T00:53:36.553074] [DEBUG] [LOCAL ] OKE: Loaded 53966 existing records from primary storage. [2025-10-24T00:53:36.553302] [INFO ] [MAIN ] OKE: Loaded 53966 primary data records. [2025-10-24T00:53:37.083072] [DEBUG] [MAIN ] OII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:37.186508] [DEBUG] [MAIN ] OIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:37.227469] [DEBUG] [MAIN ] OKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:37.254441] [INFO ] [MAIN ] OII: Generated 139 derivative records from 42179 primary records. [2025-10-24T00:53:37.256105] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-24T00:53:37.259689] [FATAL] [LOCAL ] OII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:37.260482] [FATAL] [MAIN ] OII: Failed to save derivative data. [2025-10-24T00:53:37.262928] [INFO ] [MAIN ] Derivative Progress: 1444/2164 symbols completed. OII took 1.3s. Estimated remaining: 4m 50s. Rate: 148.9 symbols/min [2025-10-24T00:53:37.263095] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:37.284215] [INFO ] [MAIN ] OIS: Generated 139 derivative records from 40115 primary records. [2025-10-24T00:53:37.284563] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-24T00:53:37.284874] [FATAL] [LOCAL ] OIS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:37.287757] [FATAL] [MAIN ] OIS: Failed to save derivative data. [2025-10-24T00:53:37.290548] [INFO ] [MAIN ] Derivative Progress: 1445/2164 symbols completed. OIS took 1.2s. Estimated remaining: 4m 50s. Rate: 149.0 symbols/min [2025-10-24T00:53:37.290949] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:37.300163] [INFO ] [MAIN ] OKE: Generated 139 derivative records from 53966 primary records. [2025-10-24T00:53:37.300396] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-24T00:53:37.300603] [FATAL] [LOCAL ] OKE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:37.300712] [FATAL] [MAIN ] OKE: Failed to save derivative data. [2025-10-24T00:53:37.303684] [INFO ] [MAIN ] Derivative Progress: 1446/2164 symbols completed. OKE took 1.2s. Estimated remaining: 4m 49s. Rate: 149.1 symbols/min [2025-10-24T00:53:37.303938] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:37.328307] [DEBUG] [LOCAL ] OLP: Loaded 10133 existing records from primary storage. [2025-10-24T00:53:37.328575] [INFO ] [MAIN ] OLP: Loaded 10133 primary data records. [2025-10-24T00:53:37.439292] [DEBUG] [LOCAL ] OKLO: Loaded 54209 existing records from primary storage. [2025-10-24T00:53:37.461087] [INFO ] [MAIN ] OKLO: Loaded 54209 primary data records. [2025-10-24T00:53:37.596959] [DEBUG] [LOCAL ] OLN: Loaded 52381 existing records from primary storage. [2025-10-24T00:53:37.617004] [INFO ] [MAIN ] OLN: Loaded 52381 primary data records. [2025-10-24T00:53:38.313861] [DEBUG] [MAIN ] OLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:38.343331] [DEBUG] [MAIN ] OKLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:38.393443] [DEBUG] [MAIN ] OLN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:38.438712] [INFO ] [MAIN ] OLP: Generated 139 derivative records from 10133 primary records. [2025-10-24T00:53:38.441109] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-24T00:53:38.445247] [FATAL] [LOCAL ] OLP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:38.449030] [FATAL] [MAIN ] OLP: Failed to save derivative data. [2025-10-24T00:53:38.452110] [INFO ] [MAIN ] OKLO: Generated 139 derivative records from 54209 primary records. [2025-10-24T00:53:38.455334] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-10-24T00:53:38.457434] [INFO ] [MAIN ] Derivative Progress: 1447/2164 symbols completed. OLP took 1.2s. Estimated remaining: 4m 49s. Rate: 148.9 symbols/min [2025-10-24T00:53:38.458112] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:38.459757] [FATAL] [LOCAL ] OKLO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:38.460425] [FATAL] [MAIN ] OKLO: Failed to save derivative data. [2025-10-24T00:53:38.463670] [INFO ] [MAIN ] Derivative Progress: 1448/2164 symbols completed. OKLO took 1.2s. Estimated remaining: 4m 48s. Rate: 149.0 symbols/min [2025-10-24T00:53:38.463961] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:38.471355] [INFO ] [MAIN ] OLN: Generated 139 derivative records from 52381 primary records. [2025-10-24T00:53:38.471455] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-24T00:53:38.471625] [FATAL] [LOCAL ] OLN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:38.471719] [FATAL] [MAIN ] OLN: Failed to save derivative data. [2025-10-24T00:53:38.474716] [INFO ] [MAIN ] Derivative Progress: 1449/2164 symbols completed. OLN took 1.2s. Estimated remaining: 4m 48s. Rate: 149.1 symbols/min [2025-10-24T00:53:38.475083] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:38.486745] [DEBUG] [LOCAL ] ONIT: Loaded 7548 existing records from primary storage. [2025-10-24T00:53:38.487022] [INFO ] [MAIN ] ONIT: Loaded 7548 primary data records. [2025-10-24T00:53:38.679754] [DEBUG] [LOCAL ] OMF: Loaded 46802 existing records from primary storage. [2025-10-24T00:53:38.690573] [INFO ] [MAIN ] OMF: Loaded 46802 primary data records. [2025-10-24T00:53:38.691216] [DEBUG] [LOCAL ] OMC: Loaded 53682 existing records from primary storage. [2025-10-24T00:53:38.696609] [INFO ] [MAIN ] OMC: Loaded 53682 primary data records. [2025-10-24T00:53:39.592944] [DEBUG] [MAIN ] ONIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:39.634999] [DEBUG] [MAIN ] OMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:39.648908] [DEBUG] [MAIN ] OMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:39.716417] [INFO ] [MAIN ] ONIT: Generated 139 derivative records from 7548 primary records. [2025-10-24T00:53:39.719670] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-24T00:53:39.721419] [FATAL] [LOCAL ] ONIT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:39.721621] [FATAL] [MAIN ] ONIT: Failed to save derivative data. [2025-10-24T00:53:39.723806] [INFO ] [MAIN ] Derivative Progress: 1450/2164 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 48s. Rate: 148.9 symbols/min [2025-10-24T00:53:39.726797] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:39.735615] [INFO ] [MAIN ] OMF: Generated 139 derivative records from 46802 primary records. [2025-10-24T00:53:39.737964] [INFO ] [MAIN ] OMC: Generated 139 derivative records from 53682 primary records. [2025-10-24T00:53:39.738236] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-24T00:53:39.738346] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-24T00:53:39.739029] [FATAL] [LOCAL ] OMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:39.739136] [FATAL] [MAIN ] OMC: Failed to save derivative data. [2025-10-24T00:53:39.738694] [FATAL] [LOCAL ] OMF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:39.742007] [INFO ] [MAIN ] Derivative Progress: 1451/2164 symbols completed. OMC took 1.3s. Estimated remaining: 4m 47s. Rate: 149.0 symbols/min [2025-10-24T00:53:39.742199] [FATAL] [MAIN ] OMF: Failed to save derivative data. [2025-10-24T00:53:39.745255] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:39.745378] [INFO ] [MAIN ] Derivative Progress: 1452/2164 symbols completed. OMF took 1.3s. Estimated remaining: 4m 47s. Rate: 149.1 symbols/min [2025-10-24T00:53:39.746028] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:39.773856] [DEBUG] [LOCAL ] ONL: Loaded 29013 existing records from primary storage. [2025-10-24T00:53:39.774098] [INFO ] [MAIN ] ONL: Loaded 29013 primary data records. [2025-10-24T00:53:39.837385] [DEBUG] [LOCAL ] ONTF: Loaded 22692 existing records from primary storage. [2025-10-24T00:53:39.881354] [INFO ] [MAIN ] ONTF: Loaded 22692 primary data records. [2025-10-24T00:53:40.209433] [DEBUG] [LOCAL ] ONON: Loaded 54003 existing records from primary storage. [2025-10-24T00:53:40.225183] [INFO ] [MAIN ] ONON: Loaded 54003 primary data records. [2025-10-24T00:53:40.798588] [DEBUG] [MAIN ] ONL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:40.835973] [DEBUG] [MAIN ] ONTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:40.888979] [DEBUG] [MAIN ] ONON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:40.941456] [INFO ] [MAIN ] ONL: Generated 139 derivative records from 29013 primary records. [2025-10-24T00:53:40.947982] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-24T00:53:40.948573] [FATAL] [LOCAL ] ONL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:40.955359] [FATAL] [MAIN ] ONL: Failed to save derivative data. [2025-10-24T00:53:40.958049] [INFO ] [MAIN ] Derivative Progress: 1453/2164 symbols completed. ONL took 1.2s. Estimated remaining: 4m 47s. Rate: 148.9 symbols/min [2025-10-24T00:53:40.967131] [INFO ] [MAIN ] ONTF: Generated 139 derivative records from 22692 primary records. [2025-10-24T00:53:40.968748] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-24T00:53:40.970767] [FATAL] [LOCAL ] ONTF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:40.971192] [FATAL] [MAIN ] ONTF: Failed to save derivative data. [2025-10-24T00:53:40.971346] [INFO ] [MAIN ] ONON: Generated 139 derivative records from 54003 primary records. [2025-10-24T00:53:40.974176] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-24T00:53:40.974482] [FATAL] [LOCAL ] ONON: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:40.974052] [INFO ] [MAIN ] Derivative Progress: 1454/2164 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 46s. Rate: 148.9 symbols/min [2025-10-24T00:53:40.974618] [FATAL] [MAIN ] ONON: Failed to save derivative data. [2025-10-24T00:53:40.979886] [INFO ] [MAIN ] Derivative Progress: 1455/2164 symbols completed. ONON took 1.2s. Estimated remaining: 4m 45s. Rate: 149.0 symbols/min [2025-10-24T00:53:40.980476] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:40.981072] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:40.980614] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:41.009807] [DEBUG] [LOCAL ] OOMA: Loaded 18375 existing records from primary storage. [2025-10-24T00:53:41.010013] [INFO ] [MAIN ] OOMA: Loaded 18375 primary data records. [2025-10-24T00:53:41.089350] [DEBUG] [LOCAL ] OPAD: Loaded 26687 existing records from primary storage. [2025-10-24T00:53:41.107037] [INFO ] [MAIN ] OPAD: Loaded 26687 primary data records. [2025-10-24T00:53:41.461502] [DEBUG] [LOCAL ] ONTO: Loaded 47505 existing records from primary storage. [2025-10-24T00:53:41.474171] [INFO ] [MAIN ] ONTO: Loaded 47505 primary data records. [2025-10-24T00:53:42.045737] [DEBUG] [MAIN ] OOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:42.085393] [DEBUG] [MAIN ] OPAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:42.122550] [DEBUG] [MAIN ] ONTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:42.165749] [INFO ] [MAIN ] OOMA: Generated 139 derivative records from 18375 primary records. [2025-10-24T00:53:42.167052] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-24T00:53:42.169505] [FATAL] [LOCAL ] OOMA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:42.172998] [FATAL] [MAIN ] OOMA: Failed to save derivative data. [2025-10-24T00:53:42.180152] [INFO ] [MAIN ] Derivative Progress: 1456/2164 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 45s. Rate: 148.8 symbols/min [2025-10-24T00:53:42.183161] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:42.195790] [INFO ] [MAIN ] OPAD: Generated 139 derivative records from 26687 primary records. [2025-10-24T00:53:42.198868] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-24T00:53:42.199537] [FATAL] [LOCAL ] OPAD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:42.199750] [FATAL] [MAIN ] OPAD: Failed to save derivative data. [2025-10-24T00:53:42.203539] [INFO ] [MAIN ] Derivative Progress: 1457/2164 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 45s. Rate: 148.9 symbols/min [2025-10-24T00:53:42.204108] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:42.207187] [INFO ] [MAIN ] ONTO: Generated 139 derivative records from 47505 primary records. [2025-10-24T00:53:42.207580] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-24T00:53:42.208223] [FATAL] [LOCAL ] ONTO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:42.208314] [FATAL] [MAIN ] ONTO: Failed to save derivative data. [2025-10-24T00:53:42.211462] [INFO ] [MAIN ] Derivative Progress: 1458/2164 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 44s. Rate: 149.0 symbols/min [2025-10-24T00:53:42.211765] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:42.228899] [DEBUG] [LOCAL ] OPP: Loaded 12463 existing records from primary storage. [2025-10-24T00:53:42.229149] [INFO ] [MAIN ] OPP: Loaded 12463 primary data records. [2025-10-24T00:53:42.433130] [DEBUG] [LOCAL ] OPFI: Loaded 46281 existing records from primary storage. [2025-10-24T00:53:42.462440] [INFO ] [MAIN ] OPFI: Loaded 46281 primary data records. [2025-10-24T00:53:42.680151] [DEBUG] [LOCAL ] OR: Loaded 47206 existing records from primary storage. [2025-10-24T00:53:42.710819] [INFO ] [MAIN ] OR: Loaded 47206 primary data records. [2025-10-24T00:53:43.465053] [DEBUG] [MAIN ] OPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:43.509963] [DEBUG] [MAIN ] OPFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:43.554096] [DEBUG] [MAIN ] OR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:43.570822] [INFO ] [MAIN ] OPP: Generated 139 derivative records from 12463 primary records. [2025-10-24T00:53:43.571556] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-24T00:53:43.572996] [FATAL] [LOCAL ] OPP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:43.575820] [FATAL] [MAIN ] OPP: Failed to save derivative data. [2025-10-24T00:53:43.578493] [INFO ] [MAIN ] Derivative Progress: 1459/2164 symbols completed. OPP took 1.4s. Estimated remaining: 4m 44s. Rate: 148.8 symbols/min [2025-10-24T00:53:43.580072] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:43.603175] [INFO ] [MAIN ] OPFI: Generated 139 derivative records from 46281 primary records. [2025-10-24T00:53:43.607293] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-24T00:53:43.608822] [FATAL] [LOCAL ] OPFI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:43.608953] [FATAL] [MAIN ] OPFI: Failed to save derivative data. [2025-10-24T00:53:43.619847] [INFO ] [MAIN ] Derivative Progress: 1460/2164 symbols completed. OPFI took 1.4s. Estimated remaining: 4m 44s. Rate: 148.9 symbols/min [2025-10-24T00:53:43.620062] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:43.622316] [INFO ] [MAIN ] OR: Generated 139 derivative records from 47206 primary records. [2025-10-24T00:53:43.622527] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-24T00:53:43.622756] [FATAL] [LOCAL ] OR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:43.622882] [FATAL] [MAIN ] OR: Failed to save derivative data. [2025-10-24T00:53:43.625796] [INFO ] [MAIN ] Derivative Progress: 1461/2164 symbols completed. OR took 1.4s. Estimated remaining: 4m 43s. Rate: 149.0 symbols/min [2025-10-24T00:53:43.626016] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:43.637514] [DEBUG] [LOCAL ] ORA: Loaded 33371 existing records from primary storage. [2025-10-24T00:53:43.637728] [INFO ] [MAIN ] ORA: Loaded 33371 primary data records. [2025-10-24T00:53:43.994955] [DEBUG] [LOCAL ] ORN: Loaded 30896 existing records from primary storage. [2025-10-24T00:53:43.996485] [INFO ] [MAIN ] ORN: Loaded 30896 primary data records. [2025-10-24T00:53:43.997221] [DEBUG] [LOCAL ] ORC: Loaded 52861 existing records from primary storage. [2025-10-24T00:53:44.009492] [INFO ] [MAIN ] ORC: Loaded 52861 primary data records. [2025-10-24T00:53:44.633894] [DEBUG] [MAIN ] ORA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:44.682673] [DEBUG] [MAIN ] ORN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:44.718441] [DEBUG] [MAIN ] ORC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:44.736979] [INFO ] [MAIN ] ORA: Generated 139 derivative records from 33371 primary records. [2025-10-24T00:53:44.741406] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-24T00:53:44.741968] [FATAL] [LOCAL ] ORA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:44.745074] [FATAL] [MAIN ] ORA: Failed to save derivative data. [2025-10-24T00:53:44.748674] [INFO ] [MAIN ] Derivative Progress: 1462/2164 symbols completed. ORA took 1.2s. Estimated remaining: 4m 43s. Rate: 148.8 symbols/min [2025-10-24T00:53:44.749089] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:44.775031] [INFO ] [MAIN ] ORN: Generated 139 derivative records from 30896 primary records. [2025-10-24T00:53:44.776466] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-24T00:53:44.777012] [FATAL] [LOCAL ] ORN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:44.780009] [FATAL] [MAIN ] ORN: Failed to save derivative data. [2025-10-24T00:53:44.782496] [INFO ] [MAIN ] Derivative Progress: 1463/2164 symbols completed. ORN took 1.2s. Estimated remaining: 4m 42s. Rate: 148.9 symbols/min [2025-10-24T00:53:44.782740] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:44.799812] [INFO ] [MAIN ] ORC: Generated 139 derivative records from 52861 primary records. [2025-10-24T00:53:44.800109] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-24T00:53:44.800347] [FATAL] [LOCAL ] ORC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:44.800623] [FATAL] [MAIN ] ORC: Failed to save derivative data. [2025-10-24T00:53:44.803729] [INFO ] [MAIN ] Derivative Progress: 1464/2164 symbols completed. ORC took 1.2s. Estimated remaining: 4m 42s. Rate: 149.0 symbols/min [2025-10-24T00:53:44.804002] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:44.826273] [DEBUG] [LOCAL ] OSCR: Loaded 54159 existing records from primary storage. [2025-10-24T00:53:44.826684] [INFO ] [MAIN ] OSCR: Loaded 54159 primary data records. [2025-10-24T00:53:45.182950] [DEBUG] [LOCAL ] OTIS: Loaded 53082 existing records from primary storage. [2025-10-24T00:53:45.185232] [INFO ] [MAIN ] OTIS: Loaded 53082 primary data records. [2025-10-24T00:53:45.185909] [DEBUG] [LOCAL ] OUT: Loaded 48059 existing records from primary storage. [2025-10-24T00:53:45.198513] [INFO ] [MAIN ] OUT: Loaded 48059 primary data records. [2025-10-24T00:53:45.873466] [DEBUG] [MAIN ] OSCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:45.939147] [DEBUG] [MAIN ] OTIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:45.946593] [INFO ] [MAIN ] OSCR: Generated 139 derivative records from 54159 primary records. [2025-10-24T00:53:45.947044] [DEBUG] [MAIN ] OUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:45.947166] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-24T00:53:45.960727] [FATAL] [LOCAL ] OSCR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:45.961191] [FATAL] [MAIN ] OSCR: Failed to save derivative data. [2025-10-24T00:53:45.975151] [INFO ] [MAIN ] Derivative Progress: 1465/2164 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 42s. Rate: 148.8 symbols/min [2025-10-24T00:53:45.975333] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:46.013706] [INFO ] [MAIN ] OUT: Generated 139 derivative records from 48059 primary records. [2025-10-24T00:53:46.014269] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-24T00:53:46.016806] [FATAL] [LOCAL ] OUT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:46.017294] [FATAL] [MAIN ] OUT: Failed to save derivative data. [2025-10-24T00:53:46.020517] [INFO ] [MAIN ] Derivative Progress: 1466/2164 symbols completed. OUT took 1.2s. Estimated remaining: 4m 41s. Rate: 148.9 symbols/min [2025-10-24T00:53:46.034096] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:46.038056] [INFO ] [MAIN ] OTIS: Generated 139 derivative records from 53082 primary records. [2025-10-24T00:53:46.038259] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-24T00:53:46.038517] [FATAL] [LOCAL ] OTIS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:46.038610] [FATAL] [MAIN ] OTIS: Failed to save derivative data. [2025-10-24T00:53:46.041092] [INFO ] [MAIN ] Derivative Progress: 1467/2164 symbols completed. OTIS took 1.3s. Estimated remaining: 4m 41s. Rate: 149.0 symbols/min [2025-10-24T00:53:46.041372] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:46.059993] [DEBUG] [LOCAL ] OVV: Loaded 53884 existing records from primary storage. [2025-10-24T00:53:46.062925] [INFO ] [MAIN ] OVV: Loaded 53884 primary data records. [2025-10-24T00:53:46.152725] [DEBUG] [LOCAL ] OWLT: Loaded 9966 existing records from primary storage. [2025-10-24T00:53:46.169537] [INFO ] [MAIN ] OWLT: Loaded 9966 primary data records. [2025-10-24T00:53:46.518303] [DEBUG] [LOCAL ] OWL: Loaded 53950 existing records from primary storage. [2025-10-24T00:53:46.555863] [INFO ] [MAIN ] OWL: Loaded 53950 primary data records. [2025-10-24T00:53:47.062704] [DEBUG] [MAIN ] OVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:47.096671] [DEBUG] [MAIN ] OWLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:47.158527] [DEBUG] [MAIN ] OWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:47.179638] [INFO ] [MAIN ] OVV: Generated 139 derivative records from 53884 primary records. [2025-10-24T00:53:47.184557] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-24T00:53:47.185394] [FATAL] [LOCAL ] OVV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:47.185524] [FATAL] [MAIN ] OVV: Failed to save derivative data. [2025-10-24T00:53:47.188488] [INFO ] [MAIN ] Derivative Progress: 1468/2164 symbols completed. OVV took 1.2s. Estimated remaining: 4m 41s. Rate: 148.8 symbols/min [2025-10-24T00:53:47.208564] [INFO ] [MAIN ] OWLT: Generated 139 derivative records from 9966 primary records. [2025-10-24T00:53:47.209061] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-24T00:53:47.210386] [FATAL] [LOCAL ] OWLT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:47.210669] [FATAL] [MAIN ] OWLT: Failed to save derivative data. [2025-10-24T00:53:47.213242] [INFO ] [MAIN ] Derivative Progress: 1469/2164 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 40s. Rate: 148.9 symbols/min [2025-10-24T00:53:47.217777] [INFO ] [MAIN ] OWL: Generated 139 derivative records from 53950 primary records. [2025-10-24T00:53:47.217929] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-24T00:53:47.218148] [FATAL] [LOCAL ] OWL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:47.218230] [FATAL] [MAIN ] OWL: Failed to save derivative data. [2025-10-24T00:53:47.221030] [INFO ] [MAIN ] Derivative Progress: 1470/2164 symbols completed. OWL took 1.2s. Estimated remaining: 4m 39s. Rate: 149.0 symbols/min [2025-10-24T00:53:47.221531] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:47.222007] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:47.222526] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:47.237500] [DEBUG] [LOCAL ] PAC: Loaded 11602 existing records from primary storage. [2025-10-24T00:53:47.237887] [INFO ] [MAIN ] PAC: Loaded 11602 primary data records. [2025-10-24T00:53:47.590821] [DEBUG] [LOCAL ] OXM: Loaded 33367 existing records from primary storage. [2025-10-24T00:53:47.603184] [INFO ] [MAIN ] OXM: Loaded 33367 primary data records. [2025-10-24T00:53:47.604138] [DEBUG] [LOCAL ] PAAS: Loaded 54015 existing records from primary storage. [2025-10-24T00:53:47.617222] [INFO ] [MAIN ] PAAS: Loaded 54015 primary data records. [2025-10-24T00:53:48.318210] [DEBUG] [MAIN ] PAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:48.376902] [DEBUG] [MAIN ] OXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:48.408594] [DEBUG] [MAIN ] PAAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:48.437369] [INFO ] [MAIN ] PAC: Generated 139 derivative records from 11602 primary records. [2025-10-24T00:53:48.442052] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-24T00:53:48.442572] [FATAL] [LOCAL ] PAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:48.444350] [FATAL] [MAIN ] PAC: Failed to save derivative data. [2025-10-24T00:53:48.447189] [INFO ] [MAIN ] Derivative Progress: 1471/2164 symbols completed. PAC took 1.2s. Estimated remaining: 4m 39s. Rate: 148.8 symbols/min [2025-10-24T00:53:48.449234] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:48.491267] [INFO ] [MAIN ] OXM: Generated 139 derivative records from 33367 primary records. [2025-10-24T00:53:48.493455] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-24T00:53:48.495581] [FATAL] [LOCAL ] OXM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:48.496373] [FATAL] [MAIN ] OXM: Failed to save derivative data. [2025-10-24T00:53:48.496176] [INFO ] [MAIN ] PAAS: Generated 139 derivative records from 54015 primary records. [2025-10-24T00:53:48.500876] [INFO ] [MAIN ] Derivative Progress: 1472/2164 symbols completed. OXM took 1.3s. Estimated remaining: 4m 39s. Rate: 148.9 symbols/min [2025-10-24T00:53:48.500994] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-24T00:53:48.502145] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:48.514217] [FATAL] [LOCAL ] PAAS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:48.515432] [DEBUG] [LOCAL ] PACK: Loaded 32108 existing records from primary storage. [2025-10-24T00:53:48.515552] [FATAL] [MAIN ] PAAS: Failed to save derivative data. [2025-10-24T00:53:48.515803] [INFO ] [MAIN ] PACK: Loaded 32108 primary data records. [2025-10-24T00:53:48.521856] [INFO ] [MAIN ] Derivative Progress: 1473/2164 symbols completed. PAAS took 1.3s. Estimated remaining: 4m 38s. Rate: 149.0 symbols/min [2025-10-24T00:53:48.546701] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:48.846348] [DEBUG] [LOCAL ] PAG: Loaded 21424 existing records from primary storage. [2025-10-24T00:53:48.856357] [INFO ] [MAIN ] PAG: Loaded 21424 primary data records. [2025-10-24T00:53:48.892699] [DEBUG] [LOCAL ] PACS: Loaded 34973 existing records from primary storage. [2025-10-24T00:53:48.963310] [INFO ] [MAIN ] PACS: Loaded 34973 primary data records. [2025-10-24T00:53:49.527875] [DEBUG] [MAIN ] PACK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:49.583705] [DEBUG] [MAIN ] PAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:49.609990] [DEBUG] [MAIN ] PACS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:49.638538] [INFO ] [MAIN ] PACK: Generated 139 derivative records from 32108 primary records. [2025-10-24T00:53:49.639240] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-24T00:53:49.641740] [FATAL] [LOCAL ] PACK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:49.644222] [FATAL] [MAIN ] PACK: Failed to save derivative data. [2025-10-24T00:53:49.646930] [INFO ] [MAIN ] Derivative Progress: 1474/2164 symbols completed. PACK took 1.2s. Estimated remaining: 4m 38s. Rate: 148.8 symbols/min [2025-10-24T00:53:49.649244] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:49.675825] [INFO ] [MAIN ] PAG: Generated 139 derivative records from 21424 primary records. [2025-10-24T00:53:49.678539] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-24T00:53:49.679613] [FATAL] [LOCAL ] PAG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:49.680579] [FATAL] [MAIN ] PAG: Failed to save derivative data. [2025-10-24T00:53:49.684190] [INFO ] [MAIN ] Derivative Progress: 1475/2164 symbols completed. PAG took 1.1s. Estimated remaining: 4m 38s. Rate: 148.9 symbols/min [2025-10-24T00:53:49.685065] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:49.687764] [INFO ] [MAIN ] PACS: Generated 139 derivative records from 34973 primary records. [2025-10-24T00:53:49.688316] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-24T00:53:49.702478] [FATAL] [LOCAL ] PACS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:49.702739] [FATAL] [MAIN ] PACS: Failed to save derivative data. [2025-10-24T00:53:49.705810] [INFO ] [MAIN ] Derivative Progress: 1476/2164 symbols completed. PACS took 1.2s. Estimated remaining: 4m 37s. Rate: 149.0 symbols/min [2025-10-24T00:53:49.706771] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:49.710548] [DEBUG] [LOCAL ] PAI: Loaded 2872 existing records from primary storage. [2025-10-24T00:53:49.710951] [INFO ] [MAIN ] PAI: Loaded 2872 primary data records. [2025-10-24T00:53:49.834798] [DEBUG] [LOCAL ] PAGS: Loaded 53193 existing records from primary storage. [2025-10-24T00:53:49.852301] [INFO ] [MAIN ] PAGS: Loaded 53193 primary data records. [2025-10-24T00:53:49.993083] [DEBUG] [LOCAL ] PAM: Loaded 29368 existing records from primary storage. [2025-10-24T00:53:50.037044] [INFO ] [MAIN ] PAM: Loaded 29368 primary data records. [2025-10-24T00:53:50.737916] [DEBUG] [MAIN ] PAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:50.770427] [DEBUG] [MAIN ] PAGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:50.812580] [DEBUG] [MAIN ] PAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:50.855840] [INFO ] [MAIN ] PAI: Generated 139 derivative records from 2872 primary records. [2025-10-24T00:53:50.857969] [INFO ] [MAIN ] PAGS: Generated 139 derivative records from 53193 primary records. [2025-10-24T00:53:50.860491] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-24T00:53:50.860695] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-24T00:53:50.861102] [FATAL] [LOCAL ] PAI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:50.862547] [FATAL] [MAIN ] PAI: Failed to save derivative data. [2025-10-24T00:53:50.862275] [FATAL] [LOCAL ] PAGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:50.865355] [FATAL] [MAIN ] PAGS: Failed to save derivative data. [2025-10-24T00:53:50.865146] [INFO ] [MAIN ] Derivative Progress: 1477/2164 symbols completed. PAI took 1.2s. Estimated remaining: 4m 37s. Rate: 148.8 symbols/min [2025-10-24T00:53:50.871104] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:50.871330] [INFO ] [MAIN ] Derivative Progress: 1478/2164 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 36s. Rate: 148.9 symbols/min [2025-10-24T00:53:50.871920] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:50.881460] [INFO ] [MAIN ] PAM: Generated 139 derivative records from 29368 primary records. [2025-10-24T00:53:50.881805] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-24T00:53:50.882053] [FATAL] [LOCAL ] PAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:50.882141] [FATAL] [MAIN ] PAM: Failed to save derivative data. [2025-10-24T00:53:50.885239] [INFO ] [MAIN ] Derivative Progress: 1479/2164 symbols completed. PAM took 1.2s. Estimated remaining: 4m 36s. Rate: 149.0 symbols/min [2025-10-24T00:53:50.885475] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:50.926543] [DEBUG] [LOCAL ] PAR: Loaded 34604 existing records from primary storage. [2025-10-24T00:53:50.939973] [INFO ] [MAIN ] PAR: Loaded 34604 primary data records. [2025-10-24T00:53:50.940991] [DEBUG] [LOCAL ] PARR: Loaded 48324 existing records from primary storage. [2025-10-24T00:53:50.961905] [INFO ] [MAIN ] PARR: Loaded 48324 primary data records. [2025-10-24T00:53:51.208382] [DEBUG] [LOCAL ] PATH: Loaded 54070 existing records from primary storage. [2025-10-24T00:53:51.340818] [INFO ] [MAIN ] PATH: Loaded 54070 primary data records. [2025-10-24T00:53:51.986236] [DEBUG] [MAIN ] PAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:52.025547] [DEBUG] [MAIN ] PARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:52.073736] [DEBUG] [MAIN ] PATH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:52.093590] [INFO ] [MAIN ] PAR: Generated 139 derivative records from 34604 primary records. [2025-10-24T00:53:52.096235] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-24T00:53:52.102686] [FATAL] [LOCAL ] PAR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:52.104025] [FATAL] [MAIN ] PAR: Failed to save derivative data. [2025-10-24T00:53:52.109562] [INFO ] [MAIN ] Derivative Progress: 1480/2164 symbols completed. PAR took 1.2s. Estimated remaining: 4m 36s. Rate: 148.8 symbols/min [2025-10-24T00:53:52.110055] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:52.121277] [INFO ] [MAIN ] PARR: Generated 139 derivative records from 48324 primary records. [2025-10-24T00:53:52.121752] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-24T00:53:52.123169] [FATAL] [LOCAL ] PARR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:52.128460] [FATAL] [MAIN ] PARR: Failed to save derivative data. [2025-10-24T00:53:52.131862] [INFO ] [MAIN ] Derivative Progress: 1481/2164 symbols completed. PARR took 1.3s. Estimated remaining: 4m 35s. Rate: 148.9 symbols/min [2025-10-24T00:53:52.132170] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:52.139025] [INFO ] [MAIN ] PATH: Generated 139 derivative records from 54070 primary records. [2025-10-24T00:53:52.139338] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-24T00:53:52.139589] [FATAL] [LOCAL ] PATH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:52.139696] [FATAL] [MAIN ] PATH: Failed to save derivative data. [2025-10-24T00:53:52.142476] [INFO ] [MAIN ] Derivative Progress: 1482/2164 symbols completed. PATH took 1.3s. Estimated remaining: 4m 35s. Rate: 149.0 symbols/min [2025-10-24T00:53:52.149823] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:52.150427] [DEBUG] [LOCAL ] PAXS: Loaded 21019 existing records from primary storage. [2025-10-24T00:53:52.151005] [INFO ] [MAIN ] PAXS: Loaded 21019 primary data records. [2025-10-24T00:53:52.361393] [DEBUG] [LOCAL ] PAY: Loaded 38809 existing records from primary storage. [2025-10-24T00:53:52.479687] [INFO ] [MAIN ] PAY: Loaded 38809 primary data records. [2025-10-24T00:53:52.565185] [DEBUG] [LOCAL ] PAYC: Loaded 36283 existing records from primary storage. [2025-10-24T00:53:52.599737] [INFO ] [MAIN ] PAYC: Loaded 36283 primary data records. [2025-10-24T00:53:53.113188] [DEBUG] [MAIN ] PAXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:53.169936] [DEBUG] [MAIN ] PAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:53.189708] [INFO ] [MAIN ] PAXS: Generated 139 derivative records from 21019 primary records. [2025-10-24T00:53:53.199246] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-24T00:53:53.199522] [FATAL] [LOCAL ] PAXS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:53.204574] [FATAL] [MAIN ] PAXS: Failed to save derivative data. [2025-10-24T00:53:53.207876] [INFO ] [MAIN ] Derivative Progress: 1483/2164 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 35s. Rate: 148.8 symbols/min [2025-10-24T00:53:53.209962] [DEBUG] [MAIN ] PAYC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:53.250533] [INFO ] [MAIN ] PAY: Generated 139 derivative records from 38809 primary records. [2025-10-24T00:53:53.253519] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-24T00:53:53.254064] [FATAL] [LOCAL ] PAY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:53.255205] [FATAL] [MAIN ] PAY: Failed to save derivative data. [2025-10-24T00:53:53.258468] [INFO ] [MAIN ] Derivative Progress: 1484/2164 symbols completed. PAY took 1.1s. Estimated remaining: 4m 34s. Rate: 148.9 symbols/min [2025-10-24T00:53:53.263382] [INFO ] [MAIN ] PAYC: Generated 139 derivative records from 36283 primary records. [2025-10-24T00:53:53.263517] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-24T00:53:53.263746] [FATAL] [LOCAL ] PAYC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:53.263824] [FATAL] [MAIN ] PAYC: Failed to save derivative data. [2025-10-24T00:53:53.266890] [INFO ] [MAIN ] Derivative Progress: 1485/2164 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 33s. Rate: 149.0 symbols/min [2025-10-24T00:53:53.267335] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:53.267445] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:53.267806] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:53.327981] [DEBUG] [LOCAL ] PB: Loaded 42660 existing records from primary storage. [2025-10-24T00:53:53.328792] [INFO ] [MAIN ] PB: Loaded 42660 primary data records. [2025-10-24T00:53:53.425352] [DEBUG] [LOCAL ] PBF: Loaded 53493 existing records from primary storage. [2025-10-24T00:53:53.442816] [DEBUG] [LOCAL ] PBA: Loaded 49535 existing records from primary storage. [2025-10-24T00:53:53.459960] [INFO ] [MAIN ] PBF: Loaded 53493 primary data records. [2025-10-24T00:53:53.460239] [INFO ] [MAIN ] PBA: Loaded 49535 primary data records. [2025-10-24T00:53:54.344001] [DEBUG] [MAIN ] PB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:54.370449] [DEBUG] [MAIN ] PBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:54.370101] [DEBUG] [MAIN ] PBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:54.506175] [INFO ] [MAIN ] PBF: Generated 139 derivative records from 53493 primary records. [2025-10-24T00:53:54.506496] [INFO ] [MAIN ] PBA: Generated 139 derivative records from 49535 primary records. [2025-10-24T00:53:54.508804] [INFO ] [MAIN ] PB: Generated 139 derivative records from 42660 primary records. [2025-10-24T00:53:54.509339] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-24T00:53:54.509425] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-24T00:53:54.509881] [FATAL] [LOCAL ] PBF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:54.510202] [FATAL] [LOCAL ] PB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:54.510294] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-24T00:53:54.510454] [FATAL] [MAIN ] PB: Failed to save derivative data. [2025-10-24T00:53:54.511031] [FATAL] [LOCAL ] PBA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:54.510527] [FATAL] [MAIN ] PBF: Failed to save derivative data. [2025-10-24T00:53:54.513146] [INFO ] [MAIN ] Derivative Progress: 1486/2164 symbols completed. PB took 1.2s. Estimated remaining: 4m 33s. Rate: 148.8 symbols/min [2025-10-24T00:53:54.515948] [FATAL] [MAIN ] PBA: Failed to save derivative data. [2025-10-24T00:53:54.516070] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:54.516223] [INFO ] [MAIN ] Derivative Progress: 1487/2164 symbols completed. PBF took 1.2s. Estimated remaining: 4m 33s. Rate: 148.9 symbols/min [2025-10-24T00:53:54.522624] [INFO ] [MAIN ] Derivative Progress: 1488/2164 symbols completed. PBA took 1.3s. Estimated remaining: 4m 32s. Rate: 149.0 symbols/min [2025-10-24T00:53:54.522532] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:54.523417] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:54.573732] [DEBUG] [LOCAL ] PBH: Loaded 32673 existing records from primary storage. [2025-10-24T00:53:54.574322] [INFO ] [MAIN ] PBH: Loaded 32673 primary data records. [2025-10-24T00:53:54.781731] [DEBUG] [LOCAL ] PBI: Loaded 50327 existing records from primary storage. [2025-10-24T00:53:54.790864] [DEBUG] [LOCAL ] PBR: Loaded 54103 existing records from primary storage. [2025-10-24T00:53:54.925210] [INFO ] [MAIN ] PBR: Loaded 54103 primary data records. [2025-10-24T00:53:54.926092] [INFO ] [MAIN ] PBI: Loaded 50327 primary data records. [2025-10-24T00:53:55.597029] [DEBUG] [MAIN ] PBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:55.646385] [DEBUG] [MAIN ] PBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:55.681838] [DEBUG] [MAIN ] PBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:55.714155] [INFO ] [MAIN ] PBH: Generated 139 derivative records from 32673 primary records. [2025-10-24T00:53:55.718340] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-24T00:53:55.719269] [FATAL] [LOCAL ] PBH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:55.721920] [FATAL] [MAIN ] PBH: Failed to save derivative data. [2025-10-24T00:53:55.723922] [INFO ] [MAIN ] Derivative Progress: 1489/2164 symbols completed. PBH took 1.2s. Estimated remaining: 4m 32s. Rate: 148.8 symbols/min [2025-10-24T00:53:55.725827] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:55.752458] [INFO ] [MAIN ] PBI: Generated 139 derivative records from 50327 primary records. [2025-10-24T00:53:55.752695] [INFO ] [MAIN ] PBR: Generated 139 derivative records from 54103 primary records. [2025-10-24T00:53:55.752990] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-24T00:53:55.752937] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-24T00:53:55.753275] [FATAL] [LOCAL ] PBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:55.759414] [DEBUG] [LOCAL ] PBT: Loaded 17415 existing records from primary storage. [2025-10-24T00:53:55.759753] [INFO ] [MAIN ] PBT: Loaded 17415 primary data records. [2025-10-24T00:53:55.759107] [FATAL] [MAIN ] PBR: Failed to save derivative data. [2025-10-24T00:53:55.773554] [INFO ] [MAIN ] Derivative Progress: 1490/2164 symbols completed. PBR took 1.3s. Estimated remaining: 4m 32s. Rate: 148.9 symbols/min [2025-10-24T00:53:55.759694] [FATAL] [LOCAL ] PBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:55.795426] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:55.800812] [FATAL] [MAIN ] PBI: Failed to save derivative data. [2025-10-24T00:53:55.817061] [INFO ] [MAIN ] Derivative Progress: 1491/2164 symbols completed. PBI took 1.3s. Estimated remaining: 4m 31s. Rate: 149.0 symbols/min [2025-10-24T00:53:55.817391] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:55.909015] [DEBUG] [LOCAL ] PCF: Loaded 9131 existing records from primary storage. [2025-10-24T00:53:55.967447] [INFO ] [MAIN ] PCF: Loaded 9131 primary data records. [2025-10-24T00:53:56.452560] [DEBUG] [LOCAL ] PCG: Loaded 54109 existing records from primary storage. [2025-10-24T00:53:56.453401] [INFO ] [MAIN ] PCG: Loaded 54109 primary data records. [2025-10-24T00:53:56.768986] [DEBUG] [MAIN ] PBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:56.815167] [DEBUG] [MAIN ] PCF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:53:56.880989] [DEBUG] [MAIN ] PCG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:56.896817] [INFO ] [MAIN ] PBT: Generated 139 derivative records from 17415 primary records. [2025-10-24T00:53:56.897221] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-24T00:53:56.894806] [INFO ] [MAIN ] PCF: Generated 139 derivative records from 9131 primary records. [2025-10-24T00:53:56.898980] [FATAL] [LOCAL ] PBT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:56.899320] [FATAL] [MAIN ] PBT: Failed to save derivative data. [2025-10-24T00:53:56.899396] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-24T00:53:56.901339] [INFO ] [MAIN ] Derivative Progress: 1492/2164 symbols completed. PBT took 1.2s. Estimated remaining: 4m 31s. Rate: 148.8 symbols/min [2025-10-24T00:53:56.901765] [FATAL] [LOCAL ] PCF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:56.902196] [FATAL] [MAIN ] PCF: Failed to save derivative data. [2025-10-24T00:53:56.904772] [INFO ] [MAIN ] Derivative Progress: 1493/2164 symbols completed. PCF took 1.1s. Estimated remaining: 4m 30s. Rate: 148.9 symbols/min [2025-10-24T00:53:56.901536] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:56.909165] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:56.922906] [DEBUG] [LOCAL ] PCM: Loaded 6946 existing records from primary storage. [2025-10-24T00:53:56.924430] [INFO ] [MAIN ] PCM: Loaded 6946 primary data records. [2025-10-24T00:53:57.023892] [INFO ] [MAIN ] PCG: Generated 139 derivative records from 54109 primary records. [2025-10-24T00:53:57.044540] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-10-24T00:53:57.055535] [FATAL] [LOCAL ] PCG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:57.055687] [FATAL] [MAIN ] PCG: Failed to save derivative data. [2025-10-24T00:53:57.059668] [INFO ] [MAIN ] Derivative Progress: 1494/2164 symbols completed. PCG took 1.2s. Estimated remaining: 4m 30s. Rate: 149.0 symbols/min [2025-10-24T00:53:57.059934] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:57.062223] [DEBUG] [LOCAL ] PCN: Loaded 25543 existing records from primary storage. [2025-10-24T00:53:57.073632] [INFO ] [MAIN ] PCN: Loaded 25543 primary data records. [2025-10-24T00:53:57.581231] [DEBUG] [LOCAL ] PCOR: Loaded 47684 existing records from primary storage. [2025-10-24T00:53:57.583434] [INFO ] [MAIN ] PCOR: Loaded 47684 primary data records. [2025-10-24T00:53:57.898535] [DEBUG] [MAIN ] PCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:57.930613] [DEBUG] [MAIN ] PCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:58.000328] [DEBUG] [MAIN ] PCOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:58.074120] [INFO ] [MAIN ] PCN: Generated 139 derivative records from 25543 primary records. [2025-10-24T00:53:58.074293] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-24T00:53:58.074576] [FATAL] [LOCAL ] PCN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:58.070666] [INFO ] [MAIN ] PCM: Generated 139 derivative records from 6946 primary records. [2025-10-24T00:53:58.074880] [FATAL] [MAIN ] PCN: Failed to save derivative data. [2025-10-24T00:53:58.074960] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-24T00:53:58.080602] [INFO ] [MAIN ] Derivative Progress: 1495/2164 symbols completed. PCN took 1.2s. Estimated remaining: 4m 30s. Rate: 148.8 symbols/min [2025-10-24T00:53:58.081308] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:58.083841] [FATAL] [LOCAL ] PCM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:58.084846] [FATAL] [MAIN ] PCM: Failed to save derivative data. [2025-10-24T00:53:58.087926] [INFO ] [MAIN ] Derivative Progress: 1496/2164 symbols completed. PCM took 1.2s. Estimated remaining: 4m 29s. Rate: 148.9 symbols/min [2025-10-24T00:53:58.088569] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:58.108095] [INFO ] [MAIN ] PCOR: Generated 139 derivative records from 47684 primary records. [2025-10-24T00:53:58.114288] [DEBUG] [LOCAL ] PCQ: Loaded 12163 existing records from primary storage. [2025-10-24T00:53:58.114389] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-24T00:53:58.114986] [FATAL] [LOCAL ] PCOR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:58.115190] [FATAL] [MAIN ] PCOR: Failed to save derivative data. [2025-10-24T00:53:58.121108] [INFO ] [MAIN ] Derivative Progress: 1497/2164 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 29s. Rate: 149.0 symbols/min [2025-10-24T00:53:58.121342] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:58.121194] [INFO ] [MAIN ] PCQ: Loaded 12163 primary data records. [2025-10-24T00:53:58.439100] [DEBUG] [LOCAL ] PD: Loaded 48648 existing records from primary storage. [2025-10-24T00:53:58.439304] [INFO ] [MAIN ] PD: Loaded 48648 primary data records. [2025-10-24T00:53:58.627260] [DEBUG] [LOCAL ] PDI: Loaded 50572 existing records from primary storage. [2025-10-24T00:53:58.644017] [INFO ] [MAIN ] PDI: Loaded 50572 primary data records. [2025-10-24T00:53:59.123915] [DEBUG] [MAIN ] PCQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:59.169498] [DEBUG] [MAIN ] PD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:59.209836] [DEBUG] [MAIN ] PDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:53:59.235941] [INFO ] [MAIN ] PCQ: Generated 139 derivative records from 12163 primary records. [2025-10-24T00:53:59.237851] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-24T00:53:59.240093] [FATAL] [LOCAL ] PCQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:59.245421] [FATAL] [MAIN ] PCQ: Failed to save derivative data. [2025-10-24T00:53:59.248244] [INFO ] [MAIN ] Derivative Progress: 1498/2164 symbols completed. PCQ took 1.2s. Estimated remaining: 4m 29s. Rate: 148.8 symbols/min [2025-10-24T00:53:59.264866] [INFO ] [MAIN ] PD: Generated 139 derivative records from 48648 primary records. [2025-10-24T00:53:59.265334] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-24T00:53:59.267024] [FATAL] [LOCAL ] PD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:59.269404] [FATAL] [MAIN ] PD: Failed to save derivative data. [2025-10-24T00:53:59.272103] [INFO ] [MAIN ] Derivative Progress: 1499/2164 symbols completed. PD took 1.2s. Estimated remaining: 4m 28s. Rate: 148.9 symbols/min [2025-10-24T00:53:59.274907] [INFO ] [MAIN ] PDI: Generated 139 derivative records from 50572 primary records. [2025-10-24T00:53:59.275094] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-24T00:53:59.275323] [FATAL] [LOCAL ] PDI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:53:59.275422] [FATAL] [MAIN ] PDI: Failed to save derivative data. [2025-10-24T00:53:59.278483] [INFO ] [MAIN ] Derivative Progress: 1500/2164 symbols completed. PDI took 1.2s. Estimated remaining: 4m 27s. Rate: 149.0 symbols/min [2025-10-24T00:53:59.278961] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:59.279395] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:59.279319] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:53:59.303184] [DEBUG] [LOCAL ] PDS: Loaded 16766 existing records from primary storage. [2025-10-24T00:53:59.311886] [INFO ] [MAIN ] PDS: Loaded 16766 primary data records. [2025-10-24T00:53:59.460400] [DEBUG] [LOCAL ] PDM: Loaded 40001 existing records from primary storage. [2025-10-24T00:53:59.476452] [DEBUG] [LOCAL ] PDO: Loaded 31605 existing records from primary storage. [2025-10-24T00:53:59.476703] [INFO ] [MAIN ] PDM: Loaded 40001 primary data records. [2025-10-24T00:53:59.476911] [INFO ] [MAIN ] PDO: Loaded 31605 primary data records. [2025-10-24T00:54:00.344816] [DEBUG] [MAIN ] PDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:00.379951] [DEBUG] [MAIN ] PDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:00.407848] [DEBUG] [MAIN ] PDM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:00.469036] [INFO ] [MAIN ] PDS: Generated 139 derivative records from 16766 primary records. [2025-10-24T00:54:00.470638] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-24T00:54:00.471149] [FATAL] [LOCAL ] PDS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:00.471702] [FATAL] [MAIN ] PDS: Failed to save derivative data. [2025-10-24T00:54:00.477481] [INFO ] [MAIN ] Derivative Progress: 1501/2164 symbols completed. PDS took 1.2s. Estimated remaining: 4m 27s. Rate: 148.8 symbols/min [2025-10-24T00:54:00.477983] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:00.486857] [INFO ] [MAIN ] PDM: Generated 139 derivative records from 40001 primary records. [2025-10-24T00:54:00.489001] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-24T00:54:00.489351] [FATAL] [LOCAL ] PDM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:00.489532] [FATAL] [MAIN ] PDM: Failed to save derivative data. [2025-10-24T00:54:00.492490] [INFO ] [MAIN ] Derivative Progress: 1502/2164 symbols completed. PDM took 1.2s. Estimated remaining: 4m 27s. Rate: 148.9 symbols/min [2025-10-24T00:54:00.492828] [INFO ] [MAIN ] PDO: Generated 139 derivative records from 31605 primary records. [2025-10-24T00:54:00.493052] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:00.493321] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-24T00:54:00.493602] [FATAL] [LOCAL ] PDO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:00.498492] [FATAL] [MAIN ] PDO: Failed to save derivative data. [2025-10-24T00:54:00.500999] [INFO ] [MAIN ] Derivative Progress: 1503/2164 symbols completed. PDO took 1.2s. Estimated remaining: 4m 26s. Rate: 149.0 symbols/min [2025-10-24T00:54:00.501288] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:00.511204] [DEBUG] [LOCAL ] PDT: Loaded 17588 existing records from primary storage. [2025-10-24T00:54:00.511353] [INFO ] [MAIN ] PDT: Loaded 17588 primary data records. [2025-10-24T00:54:00.622865] [DEBUG] [LOCAL ] PDX: Loaded 14236 existing records from primary storage. [2025-10-24T00:54:00.632239] [INFO ] [MAIN ] PDX: Loaded 14236 primary data records. [2025-10-24T00:54:01.144345] [DEBUG] [LOCAL ] PEB: Loaded 51098 existing records from primary storage. [2025-10-24T00:54:01.145061] [INFO ] [MAIN ] PEB: Loaded 51098 primary data records. [2025-10-24T00:54:01.483623] [DEBUG] [MAIN ] PDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:01.515322] [DEBUG] [MAIN ] PDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:01.570857] [DEBUG] [MAIN ] PEB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:01.606588] [INFO ] [MAIN ] PDT: Generated 139 derivative records from 17588 primary records. [2025-10-24T00:54:01.608746] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-24T00:54:01.610923] [FATAL] [LOCAL ] PDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:01.614350] [FATAL] [MAIN ] PDT: Failed to save derivative data. [2025-10-24T00:54:01.617229] [INFO ] [MAIN ] Derivative Progress: 1504/2164 symbols completed. PDT took 1.1s. Estimated remaining: 4m 26s. Rate: 148.8 symbols/min [2025-10-24T00:54:01.617461] [INFO ] [MAIN ] PDX: Generated 139 derivative records from 14236 primary records. [2025-10-24T00:54:01.617890] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:01.618264] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-24T00:54:01.618537] [FATAL] [LOCAL ] PDX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:01.620294] [FATAL] [MAIN ] PDX: Failed to save derivative data. [2025-10-24T00:54:01.623111] [INFO ] [MAIN ] Derivative Progress: 1505/2164 symbols completed. PDX took 1.1s. Estimated remaining: 4m 26s. Rate: 148.9 symbols/min [2025-10-24T00:54:01.623545] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:01.634434] [INFO ] [MAIN ] PEB: Generated 139 derivative records from 51098 primary records. [2025-10-24T00:54:01.634599] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-24T00:54:01.634833] [FATAL] [LOCAL ] PEB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:01.634913] [FATAL] [MAIN ] PEB: Failed to save derivative data. [2025-10-24T00:54:01.638660] [INFO ] [MAIN ] Derivative Progress: 1506/2164 symbols completed. PEB took 1.1s. Estimated remaining: 4m 25s. Rate: 149.0 symbols/min [2025-10-24T00:54:01.638853] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:01.656191] [DEBUG] [LOCAL ] PERF: Loaded 14582 existing records from primary storage. [2025-10-24T00:54:01.656556] [INFO ] [MAIN ] PERF: Loaded 14582 primary data records. [2025-10-24T00:54:01.810207] [DEBUG] [LOCAL ] PEN: Loaded 29706 existing records from primary storage. [2025-10-24T00:54:01.815931] [INFO ] [MAIN ] PEN: Loaded 29706 primary data records. [2025-10-24T00:54:01.844202] [DEBUG] [LOCAL ] PEG: Loaded 53508 existing records from primary storage. [2025-10-24T00:54:01.936509] [INFO ] [MAIN ] PEG: Loaded 53508 primary data records. [2025-10-24T00:54:02.684632] [DEBUG] [MAIN ] PERF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:02.728107] [DEBUG] [MAIN ] PEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:02.757328] [DEBUG] [MAIN ] PEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:02.802066] [INFO ] [MAIN ] PERF: Generated 139 derivative records from 14582 primary records. [2025-10-24T00:54:02.804227] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-24T00:54:02.804666] [FATAL] [LOCAL ] PERF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:02.807484] [FATAL] [MAIN ] PERF: Failed to save derivative data. [2025-10-24T00:54:02.809871] [INFO ] [MAIN ] Derivative Progress: 1507/2164 symbols completed. PERF took 1.2s. Estimated remaining: 4m 25s. Rate: 148.8 symbols/min [2025-10-24T00:54:02.811301] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:02.828772] [INFO ] [MAIN ] PEN: Generated 139 derivative records from 29706 primary records. [2025-10-24T00:54:02.831869] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-24T00:54:02.828971] [DEBUG] [LOCAL ] PFD: Loaded 5392 existing records from primary storage. [2025-10-24T00:54:02.832178] [INFO ] [MAIN ] PFD: Loaded 5392 primary data records. [2025-10-24T00:54:02.833115] [FATAL] [LOCAL ] PEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:02.864567] [FATAL] [MAIN ] PEN: Failed to save derivative data. [2025-10-24T00:54:02.872510] [INFO ] [MAIN ] Derivative Progress: 1508/2164 symbols completed. PEN took 1.2s. Estimated remaining: 4m 24s. Rate: 148.9 symbols/min [2025-10-24T00:54:02.872697] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:02.885215] [INFO ] [MAIN ] PEG: Generated 139 derivative records from 53508 primary records. [2025-10-24T00:54:02.914764] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-10-24T00:54:02.915059] [FATAL] [LOCAL ] PEG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:02.931384] [FATAL] [MAIN ] PEG: Failed to save derivative data. [2025-10-24T00:54:02.945103] [INFO ] [MAIN ] Derivative Progress: 1509/2164 symbols completed. PEG took 1.3s. Estimated remaining: 4m 24s. Rate: 149.0 symbols/min [2025-10-24T00:54:02.945404] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:03.194490] [DEBUG] [LOCAL ] PFE: Loaded 54203 existing records from primary storage. [2025-10-24T00:54:03.194984] [INFO ] [MAIN ] PFE: Loaded 54203 primary data records. [2025-10-24T00:54:03.195930] [DEBUG] [LOCAL ] PFGC: Loaded 47021 existing records from primary storage. [2025-10-24T00:54:03.227040] [INFO ] [MAIN ] PFGC: Loaded 47021 primary data records. [2025-10-24T00:54:03.397367] [DEBUG] [MAIN ] PFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:03.853427] [INFO ] [MAIN ] PFD: Generated 139 derivative records from 5392 primary records. [2025-10-24T00:54:03.854586] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-24T00:54:03.855514] [FATAL] [LOCAL ] PFD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:03.855795] [FATAL] [MAIN ] PFD: Failed to save derivative data. [2025-10-24T00:54:03.858254] [INFO ] [MAIN ] Derivative Progress: 1510/2164 symbols completed. PFD took 1.0s. Estimated remaining: 4m 24s. Rate: 148.9 symbols/min [2025-10-24T00:54:03.858596] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:03.872566] [DEBUG] [MAIN ] PFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:03.896209] [DEBUG] [LOCAL ] PFH: Loaded 6448 existing records from primary storage. [2025-10-24T00:54:03.904121] [INFO ] [MAIN ] PFH: Loaded 6448 primary data records. [2025-10-24T00:54:03.922050] [DEBUG] [MAIN ] PFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:04.327853] [INFO ] [MAIN ] PFE: Generated 139 derivative records from 54203 primary records. [2025-10-24T00:54:04.332668] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-10-24T00:54:04.333756] [FATAL] [LOCAL ] PFE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:04.335418] [FATAL] [MAIN ] PFE: Failed to save derivative data. [2025-10-24T00:54:04.337732] [INFO ] [MAIN ] Derivative Progress: 1511/2164 symbols completed. PFE took 1.5s. Estimated remaining: 4m 23s. Rate: 148.9 symbols/min [2025-10-24T00:54:04.338195] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:04.338452] [INFO ] [MAIN ] PFGC: Generated 139 derivative records from 47021 primary records. [2025-10-24T00:54:04.339198] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-24T00:54:04.339735] [FATAL] [LOCAL ] PFGC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:04.339847] [FATAL] [MAIN ] PFGC: Failed to save derivative data. [2025-10-24T00:54:04.342600] [INFO ] [MAIN ] Derivative Progress: 1512/2164 symbols completed. PFGC took 1.4s. Estimated remaining: 4m 23s. Rate: 148.9 symbols/min [2025-10-24T00:54:04.342986] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:04.364738] [DEBUG] [MAIN ] PFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:04.384069] [DEBUG] [LOCAL ] PFL: Loaded 14547 existing records from primary storage. [2025-10-24T00:54:04.385847] [INFO ] [MAIN ] PFL: Loaded 14547 primary data records. [2025-10-24T00:54:04.588281] [DEBUG] [LOCAL ] PFLT: Loaded 44559 existing records from primary storage. [2025-10-24T00:54:04.617927] [INFO ] [MAIN ] PFLT: Loaded 44559 primary data records. [2025-10-24T00:54:04.890623] [INFO ] [MAIN ] PFH: Generated 139 derivative records from 6448 primary records. [2025-10-24T00:54:04.925517] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-24T00:54:04.926603] [FATAL] [LOCAL ] PFH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:05.039683] [FATAL] [MAIN ] PFH: Failed to save derivative data. [2025-10-24T00:54:05.056156] [INFO ] [MAIN ] Derivative Progress: 1513/2164 symbols completed. PFH took 1.2s. Estimated remaining: 4m 22s. Rate: 148.9 symbols/min [2025-10-24T00:54:05.075726] [DEBUG] [MAIN ] PFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:05.121287] [DEBUG] [MAIN ] PFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:05.123159] [INFO ] [MAIN ] PFL: Generated 139 derivative records from 14547 primary records. [2025-10-24T00:54:05.133751] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-24T00:54:05.135031] [FATAL] [LOCAL ] PFL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:05.136497] [FATAL] [MAIN ] PFL: Failed to save derivative data. [2025-10-24T00:54:05.138745] [INFO ] [MAIN ] Derivative Progress: 1514/2164 symbols completed. PFL took 0.8s. Estimated remaining: 4m 22s. Rate: 149.0 symbols/min [2025-10-24T00:54:05.152236] [INFO ] [MAIN ] PFLT: Generated 139 derivative records from 44559 primary records. [2025-10-24T00:54:05.152338] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-24T00:54:05.152539] [FATAL] [LOCAL ] PFLT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:05.152616] [FATAL] [MAIN ] PFLT: Failed to save derivative data. [2025-10-24T00:54:05.157164] [INFO ] [MAIN ] Derivative Progress: 1515/2164 symbols completed. PFLT took 0.8s. Estimated remaining: 4m 21s. Rate: 149.0 symbols/min [2025-10-24T00:54:05.157629] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:05.157805] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:05.157919] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:05.167340] [DEBUG] [LOCAL ] PFO: Loaded 6133 existing records from primary storage. [2025-10-24T00:54:05.167592] [INFO ] [MAIN ] PFO: Loaded 6133 primary data records. [2025-10-24T00:54:05.319284] [DEBUG] [LOCAL ] PFN: Loaded 22319 existing records from primary storage. [2025-10-24T00:54:05.484505] [INFO ] [MAIN ] PFN: Loaded 22319 primary data records. [2025-10-24T00:54:05.566562] [DEBUG] [LOCAL ] PFS: Loaded 35957 existing records from primary storage. [2025-10-24T00:54:05.598896] [INFO ] [MAIN ] PFS: Loaded 35957 primary data records. [2025-10-24T00:54:06.167409] [DEBUG] [MAIN ] PFO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:06.211186] [DEBUG] [MAIN ] PFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:06.254845] [DEBUG] [MAIN ] PFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:06.271836] [INFO ] [MAIN ] PFO: Generated 139 derivative records from 6133 primary records. [2025-10-24T00:54:06.278041] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-24T00:54:06.279309] [FATAL] [LOCAL ] PFO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:06.279834] [FATAL] [MAIN ] PFO: Failed to save derivative data. [2025-10-24T00:54:06.284444] [INFO ] [MAIN ] Derivative Progress: 1516/2164 symbols completed. PFO took 1.1s. Estimated remaining: 4m 21s. Rate: 148.9 symbols/min [2025-10-24T00:54:06.287620] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:06.303190] [INFO ] [MAIN ] PFN: Generated 139 derivative records from 22319 primary records. [2025-10-24T00:54:06.304471] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-24T00:54:06.305010] [FATAL] [LOCAL ] PFN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:06.305197] [FATAL] [MAIN ] PFN: Failed to save derivative data. [2025-10-24T00:54:06.310422] [INFO ] [MAIN ] Derivative Progress: 1517/2164 symbols completed. PFN took 1.2s. Estimated remaining: 4m 21s. Rate: 149.0 symbols/min [2025-10-24T00:54:06.310634] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:06.322970] [INFO ] [MAIN ] PFS: Generated 139 derivative records from 35957 primary records. [2025-10-24T00:54:06.323247] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-24T00:54:06.323501] [FATAL] [LOCAL ] PFS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:06.323580] [FATAL] [MAIN ] PFS: Failed to save derivative data. [2025-10-24T00:54:06.326190] [INFO ] [MAIN ] Derivative Progress: 1518/2164 symbols completed. PFS took 1.2s. Estimated remaining: 4m 20s. Rate: 149.1 symbols/min [2025-10-24T00:54:06.326380] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:06.337799] [DEBUG] [LOCAL ] PFSI: Loaded 29349 existing records from primary storage. [2025-10-24T00:54:06.339247] [INFO ] [MAIN ] PFSI: Loaded 29349 primary data records. [2025-10-24T00:54:06.381983] [DEBUG] [LOCAL ] PGP: Loaded 5713 existing records from primary storage. [2025-10-24T00:54:06.426180] [INFO ] [MAIN ] PGP: Loaded 5713 primary data records. [2025-10-24T00:54:06.963307] [DEBUG] [LOCAL ] PG: Loaded 54143 existing records from primary storage. [2025-10-24T00:54:06.963559] [INFO ] [MAIN ] PG: Loaded 54143 primary data records. [2025-10-24T00:54:07.291836] [DEBUG] [MAIN ] PFSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:07.330727] [DEBUG] [MAIN ] PGP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:07.386548] [DEBUG] [MAIN ] PG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:07.393006] [INFO ] [MAIN ] PFSI: Generated 139 derivative records from 29349 primary records. [2025-10-24T00:54:07.404393] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-24T00:54:07.411445] [FATAL] [LOCAL ] PFSI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:07.411925] [FATAL] [MAIN ] PFSI: Failed to save derivative data. [2025-10-24T00:54:07.417060] [INFO ] [MAIN ] Derivative Progress: 1519/2164 symbols completed. PFSI took 1.1s. Estimated remaining: 4m 20s. Rate: 148.9 symbols/min [2025-10-24T00:54:07.417352] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:07.432902] [INFO ] [MAIN ] PGP: Generated 139 derivative records from 5713 primary records. [2025-10-24T00:54:07.434441] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-24T00:54:07.436982] [FATAL] [LOCAL ] PGP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:07.437262] [FATAL] [MAIN ] PGP: Failed to save derivative data. [2025-10-24T00:54:07.439669] [INFO ] [MAIN ] Derivative Progress: 1520/2164 symbols completed. PGP took 1.1s. Estimated remaining: 4m 19s. Rate: 149.0 symbols/min [2025-10-24T00:54:07.439954] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:07.449106] [INFO ] [MAIN ] PG: Generated 139 derivative records from 54143 primary records. [2025-10-24T00:54:07.449290] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-10-24T00:54:07.449505] [FATAL] [LOCAL ] PG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:07.449585] [FATAL] [MAIN ] PG: Failed to save derivative data. [2025-10-24T00:54:07.452146] [INFO ] [MAIN ] Derivative Progress: 1521/2164 symbols completed. PG took 1.1s. Estimated remaining: 4m 19s. Rate: 149.1 symbols/min [2025-10-24T00:54:07.452413] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:07.487132] [DEBUG] [LOCAL ] PGZ: Loaded 5521 existing records from primary storage. [2025-10-24T00:54:07.487488] [INFO ] [MAIN ] PGZ: Loaded 5521 primary data records. [2025-10-24T00:54:07.623121] [DEBUG] [LOCAL ] PGRE: Loaded 47324 existing records from primary storage. [2025-10-24T00:54:07.624497] [DEBUG] [LOCAL ] PGR: Loaded 53254 existing records from primary storage. [2025-10-24T00:54:07.630109] [INFO ] [MAIN ] PGR: Loaded 53254 primary data records. [2025-10-24T00:54:07.629831] [INFO ] [MAIN ] PGRE: Loaded 47324 primary data records. [2025-10-24T00:54:08.478587] [DEBUG] [MAIN ] PGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:08.516435] [DEBUG] [MAIN ] PGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:08.544980] [DEBUG] [MAIN ] PGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:08.607773] [INFO ] [MAIN ] PGZ: Generated 139 derivative records from 5521 primary records. [2025-10-24T00:54:08.610695] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-24T00:54:08.611404] [FATAL] [LOCAL ] PGZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:08.612602] [FATAL] [MAIN ] PGZ: Failed to save derivative data. [2025-10-24T00:54:08.615991] [INFO ] [MAIN ] Derivative Progress: 1522/2164 symbols completed. PGZ took 1.2s. Estimated remaining: 4m 19s. Rate: 148.9 symbols/min [2025-10-24T00:54:08.619260] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:08.622540] [INFO ] [MAIN ] PGRE: Generated 139 derivative records from 47324 primary records. [2025-10-24T00:54:08.622813] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-24T00:54:08.623234] [FATAL] [LOCAL ] PGRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:08.624466] [FATAL] [MAIN ] PGRE: Failed to save derivative data. [2025-10-24T00:54:08.627067] [INFO ] [MAIN ] Derivative Progress: 1523/2164 symbols completed. PGRE took 1.2s. Estimated remaining: 4m 18s. Rate: 149.0 symbols/min [2025-10-24T00:54:08.627732] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:08.629981] [INFO ] [MAIN ] PGR: Generated 139 derivative records from 53254 primary records. [2025-10-24T00:54:08.630221] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-24T00:54:08.630441] [FATAL] [LOCAL ] PGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:08.630520] [FATAL] [MAIN ] PGR: Failed to save derivative data. [2025-10-24T00:54:08.634136] [INFO ] [MAIN ] Derivative Progress: 1524/2164 symbols completed. PGR took 1.2s. Estimated remaining: 4m 18s. Rate: 149.1 symbols/min [2025-10-24T00:54:08.634402] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:08.658980] [DEBUG] [LOCAL ] PHI: Loaded 15292 existing records from primary storage. [2025-10-24T00:54:08.659134] [INFO ] [MAIN ] PHI: Loaded 15292 primary data records. [2025-10-24T00:54:08.738073] [DEBUG] [LOCAL ] PH: Loaded 36710 existing records from primary storage. [2025-10-24T00:54:08.759177] [INFO ] [MAIN ] PH: Loaded 36710 primary data records. [2025-10-24T00:54:08.842036] [DEBUG] [LOCAL ] PHG: Loaded 45790 existing records from primary storage. [2025-10-24T00:54:08.925354] [INFO ] [MAIN ] PHG: Loaded 45790 primary data records. [2025-10-24T00:54:09.701357] [DEBUG] [MAIN ] PHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:09.735673] [DEBUG] [MAIN ] PH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:09.778136] [DEBUG] [MAIN ] PHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:09.829055] [INFO ] [MAIN ] PHI: Generated 139 derivative records from 15292 primary records. [2025-10-24T00:54:09.830443] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-24T00:54:09.831245] [FATAL] [LOCAL ] PHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:09.831763] [FATAL] [MAIN ] PHI: Failed to save derivative data. [2025-10-24T00:54:09.834001] [INFO ] [MAIN ] Derivative Progress: 1525/2164 symbols completed. PHI took 1.2s. Estimated remaining: 4m 18s. Rate: 148.9 symbols/min [2025-10-24T00:54:09.834251] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:09.856142] [INFO ] [MAIN ] PH: Generated 139 derivative records from 36710 primary records. [2025-10-24T00:54:09.856483] [INFO ] [MAIN ] PHG: Generated 139 derivative records from 45790 primary records. [2025-10-24T00:54:09.856937] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-24T00:54:09.856766] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-24T00:54:09.857758] [FATAL] [LOCAL ] PH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:09.857388] [FATAL] [LOCAL ] PHG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:09.857861] [FATAL] [MAIN ] PH: Failed to save derivative data. [2025-10-24T00:54:09.860384] [INFO ] [MAIN ] Derivative Progress: 1526/2164 symbols completed. PH took 1.2s. Estimated remaining: 4m 17s. Rate: 149.0 symbols/min [2025-10-24T00:54:09.860791] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:09.860587] [FATAL] [MAIN ] PHG: Failed to save derivative data. [2025-10-24T00:54:09.867698] [INFO ] [MAIN ] Derivative Progress: 1527/2164 symbols completed. PHG took 1.2s. Estimated remaining: 4m 16s. Rate: 149.1 symbols/min [2025-10-24T00:54:09.868088] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:09.892183] [DEBUG] [LOCAL ] PHIN: Loaded 31596 existing records from primary storage. [2025-10-24T00:54:09.892360] [INFO ] [MAIN ] PHIN: Loaded 31596 primary data records. [2025-10-24T00:54:10.276862] [DEBUG] [LOCAL ] PHR: Loaded 38203 existing records from primary storage. [2025-10-24T00:54:10.277306] [INFO ] [MAIN ] PHR: Loaded 38203 primary data records. [2025-10-24T00:54:10.289594] [DEBUG] [LOCAL ] PHM: Loaded 52071 existing records from primary storage. [2025-10-24T00:54:10.315340] [INFO ] [MAIN ] PHM: Loaded 52071 primary data records. [2025-10-24T00:54:10.926425] [DEBUG] [MAIN ] PHIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:10.976107] [DEBUG] [MAIN ] PHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:11.013694] [INFO ] [MAIN ] PHIN: Generated 139 derivative records from 31596 primary records. [2025-10-24T00:54:11.016472] [DEBUG] [MAIN ] PHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:11.019676] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-24T00:54:11.028832] [FATAL] [LOCAL ] PHIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:11.029133] [FATAL] [MAIN ] PHIN: Failed to save derivative data. [2025-10-24T00:54:11.033096] [INFO ] [MAIN ] Derivative Progress: 1528/2164 symbols completed. PHIN took 1.2s. Estimated remaining: 4m 16s. Rate: 148.9 symbols/min [2025-10-24T00:54:11.061064] [INFO ] [MAIN ] PHR: Generated 139 derivative records from 38203 primary records. [2025-10-24T00:54:11.062505] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-24T00:54:11.062746] [FATAL] [LOCAL ] PHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:11.064317] [INFO ] [MAIN ] PHM: Generated 139 derivative records from 52071 primary records. [2025-10-24T00:54:11.064455] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-10-24T00:54:11.064682] [FATAL] [LOCAL ] PHM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:11.064376] [FATAL] [MAIN ] PHR: Failed to save derivative data. [2025-10-24T00:54:11.066722] [INFO ] [MAIN ] Derivative Progress: 1529/2164 symbols completed. PHR took 1.2s. Estimated remaining: 4m 16s. Rate: 149.0 symbols/min [2025-10-24T00:54:11.066837] [FATAL] [MAIN ] PHM: Failed to save derivative data. [2025-10-24T00:54:11.071018] [INFO ] [MAIN ] Derivative Progress: 1530/2164 symbols completed. PHM took 1.2s. Estimated remaining: 4m 15s. Rate: 149.1 symbols/min [2025-10-24T00:54:11.071472] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:11.071429] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:11.071516] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:11.080451] [DEBUG] [LOCAL ] PIM: Loaded 4876 existing records from primary storage. [2025-10-24T00:54:11.080795] [INFO ] [MAIN ] PIM: Loaded 4876 primary data records. [2025-10-24T00:54:11.177400] [DEBUG] [LOCAL ] PINE: Loaded 14507 existing records from primary storage. [2025-10-24T00:54:11.194152] [INFO ] [MAIN ] PINE: Loaded 14507 primary data records. [2025-10-24T00:54:11.574174] [DEBUG] [LOCAL ] PII: Loaded 49002 existing records from primary storage. [2025-10-24T00:54:11.596412] [INFO ] [MAIN ] PII: Loaded 49002 primary data records. [2025-10-24T00:54:12.180868] [DEBUG] [MAIN ] PIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:12.221195] [DEBUG] [MAIN ] PINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:12.273791] [DEBUG] [MAIN ] PII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:12.277045] [INFO ] [MAIN ] PIM: Generated 139 derivative records from 4876 primary records. [2025-10-24T00:54:12.293219] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-24T00:54:12.293986] [FATAL] [LOCAL ] PIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:12.295861] [FATAL] [MAIN ] PIM: Failed to save derivative data. [2025-10-24T00:54:12.298257] [INFO ] [MAIN ] Derivative Progress: 1531/2164 symbols completed. PIM took 1.2s. Estimated remaining: 4m 15s. Rate: 148.9 symbols/min [2025-10-24T00:54:12.298428] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:12.309340] [INFO ] [MAIN ] PINE: Generated 139 derivative records from 14507 primary records. [2025-10-24T00:54:12.311195] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-24T00:54:12.313334] [FATAL] [LOCAL ] PINE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:12.313919] [FATAL] [MAIN ] PINE: Failed to save derivative data. [2025-10-24T00:54:12.316888] [INFO ] [MAIN ] Derivative Progress: 1532/2164 symbols completed. PINE took 1.2s. Estimated remaining: 4m 15s. Rate: 149.0 symbols/min [2025-10-24T00:54:12.317689] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:12.334040] [INFO ] [MAIN ] PII: Generated 139 derivative records from 49002 primary records. [2025-10-24T00:54:12.334233] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-24T00:54:12.338447] [FATAL] [LOCAL ] PII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:12.338593] [FATAL] [MAIN ] PII: Failed to save derivative data. [2025-10-24T00:54:12.341334] [INFO ] [MAIN ] Derivative Progress: 1533/2164 symbols completed. PII took 1.3s. Estimated remaining: 4m 14s. Rate: 149.1 symbols/min [2025-10-24T00:54:12.354054] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:12.362078] [DEBUG] [LOCAL ] PIPR: Loaded 15051 existing records from primary storage. [2025-10-24T00:54:12.362262] [INFO ] [MAIN ] PIPR: Loaded 15051 primary data records. [2025-10-24T00:54:12.516217] [DEBUG] [LOCAL ] PJT: Loaded 21297 existing records from primary storage. [2025-10-24T00:54:12.510050] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-10-24T00:54:12.521591] [INFO ] [MAIN ] PINS: Loaded 54083 primary data records. [2025-10-24T00:54:12.542452] [INFO ] [MAIN ] PJT: Loaded 21297 primary data records. [2025-10-24T00:54:13.322820] [DEBUG] [MAIN ] PIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:13.357773] [DEBUG] [MAIN ] PINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:13.399415] [DEBUG] [MAIN ] PJT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:13.441718] [INFO ] [MAIN ] PIPR: Generated 139 derivative records from 15051 primary records. [2025-10-24T00:54:13.442459] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-24T00:54:13.447511] [FATAL] [LOCAL ] PIPR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:13.447795] [FATAL] [MAIN ] PIPR: Failed to save derivative data. [2025-10-24T00:54:13.453231] [INFO ] [MAIN ] Derivative Progress: 1534/2164 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 14s. Rate: 148.9 symbols/min [2025-10-24T00:54:13.453998] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:13.468998] [INFO ] [MAIN ] PINS: Generated 139 derivative records from 54083 primary records. [2025-10-24T00:54:13.469813] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-24T00:54:13.470045] [FATAL] [LOCAL ] PINS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:13.472370] [INFO ] [MAIN ] PJT: Generated 139 derivative records from 21297 primary records. [2025-10-24T00:54:13.470284] [FATAL] [MAIN ] PINS: Failed to save derivative data. [2025-10-24T00:54:13.475061] [INFO ] [MAIN ] Derivative Progress: 1535/2164 symbols completed. PINS took 1.2s. Estimated remaining: 4m 13s. Rate: 149.0 symbols/min [2025-10-24T00:54:13.475202] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-24T00:54:13.475300] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:13.475862] [FATAL] [LOCAL ] PJT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:13.476361] [FATAL] [MAIN ] PJT: Failed to save derivative data. [2025-10-24T00:54:13.479072] [INFO ] [MAIN ] Derivative Progress: 1536/2164 symbols completed. PJT took 1.1s. Estimated remaining: 4m 13s. Rate: 149.1 symbols/min [2025-10-24T00:54:13.479370] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:13.509834] [DEBUG] [LOCAL ] PKE: Loaded 14380 existing records from primary storage. [2025-10-24T00:54:13.510137] [INFO ] [MAIN ] PKE: Loaded 14380 primary data records. [2025-10-24T00:54:13.636574] [DEBUG] [LOCAL ] PK: Loaded 53137 existing records from primary storage. [2025-10-24T00:54:13.658255] [INFO ] [MAIN ] PK: Loaded 53137 primary data records. [2025-10-24T00:54:13.921024] [DEBUG] [LOCAL ] PKG: Loaded 38951 existing records from primary storage. [2025-10-24T00:54:13.946754] [INFO ] [MAIN ] PKG: Loaded 38951 primary data records. [2025-10-24T00:54:14.509919] [DEBUG] [MAIN ] PKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:14.540063] [DEBUG] [MAIN ] PK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:14.575786] [DEBUG] [MAIN ] PKG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:14.633964] [INFO ] [MAIN ] PKE: Generated 139 derivative records from 14380 primary records. [2025-10-24T00:54:14.634299] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-24T00:54:14.636372] [FATAL] [LOCAL ] PKE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:14.636471] [FATAL] [MAIN ] PKE: Failed to save derivative data. [2025-10-24T00:54:14.641916] [INFO ] [MAIN ] Derivative Progress: 1537/2164 symbols completed. PKE took 1.2s. Estimated remaining: 4m 13s. Rate: 148.9 symbols/min [2025-10-24T00:54:14.636717] [INFO ] [MAIN ] PK: Generated 139 derivative records from 53137 primary records. [2025-10-24T00:54:14.643426] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:14.643789] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-24T00:54:14.644573] [FATAL] [LOCAL ] PK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:14.646949] [FATAL] [MAIN ] PK: Failed to save derivative data. [2025-10-24T00:54:14.646780] [INFO ] [MAIN ] PKG: Generated 139 derivative records from 38951 primary records. [2025-10-24T00:54:14.650502] [INFO ] [MAIN ] Derivative Progress: 1538/2164 symbols completed. PK took 1.2s. Estimated remaining: 4m 12s. Rate: 149.0 symbols/min [2025-10-24T00:54:14.650752] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:14.650630] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-24T00:54:14.651363] [FATAL] [LOCAL ] PKG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:14.651777] [FATAL] [MAIN ] PKG: Failed to save derivative data. [2025-10-24T00:54:14.654476] [INFO ] [MAIN ] Derivative Progress: 1539/2164 symbols completed. PKG took 1.2s. Estimated remaining: 4m 12s. Rate: 149.1 symbols/min [2025-10-24T00:54:14.654750] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:14.671816] [DEBUG] [LOCAL ] PKST: Loaded 18267 existing records from primary storage. [2025-10-24T00:54:14.671986] [INFO ] [MAIN ] PKST: Loaded 18267 primary data records. [2025-10-24T00:54:14.843900] [DEBUG] [LOCAL ] PKX: Loaded 22749 existing records from primary storage. [2025-10-24T00:54:15.011214] [INFO ] [MAIN ] PKX: Loaded 22749 primary data records. [2025-10-24T00:54:15.026177] [DEBUG] [LOCAL ] PL: Loaded 53602 existing records from primary storage. [2025-10-24T00:54:15.059416] [INFO ] [MAIN ] PL: Loaded 53602 primary data records. [2025-10-24T00:54:15.687368] [DEBUG] [MAIN ] PKST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:15.737718] [DEBUG] [MAIN ] PKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:15.783381] [DEBUG] [MAIN ] PL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:15.786044] [INFO ] [MAIN ] PKST: Generated 139 derivative records from 18267 primary records. [2025-10-24T00:54:15.803120] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-24T00:54:15.805613] [FATAL] [LOCAL ] PKST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:15.806419] [FATAL] [MAIN ] PKST: Failed to save derivative data. [2025-10-24T00:54:15.815041] [INFO ] [MAIN ] Derivative Progress: 1540/2164 symbols completed. PKST took 1.2s. Estimated remaining: 4m 11s. Rate: 148.9 symbols/min [2025-10-24T00:54:15.815591] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:15.843384] [INFO ] [MAIN ] PKX: Generated 139 derivative records from 22749 primary records. [2025-10-24T00:54:15.843740] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-24T00:54:15.844282] [FATAL] [LOCAL ] PKX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:15.844424] [FATAL] [MAIN ] PKX: Failed to save derivative data. [2025-10-24T00:54:15.846882] [INFO ] [MAIN ] Derivative Progress: 1541/2164 symbols completed. PKX took 1.2s. Estimated remaining: 4m 11s. Rate: 149.0 symbols/min [2025-10-24T00:54:15.848175] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:15.850726] [INFO ] [MAIN ] PL: Generated 139 derivative records from 53602 primary records. [2025-10-24T00:54:15.851040] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-24T00:54:15.851715] [FATAL] [LOCAL ] PL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:15.851922] [FATAL] [MAIN ] PL: Failed to save derivative data. [2025-10-24T00:54:15.854710] [INFO ] [MAIN ] Derivative Progress: 1542/2164 symbols completed. PL took 1.2s. Estimated remaining: 4m 10s. Rate: 149.1 symbols/min [2025-10-24T00:54:15.854994] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:15.887826] [DEBUG] [LOCAL ] PLOW: Loaded 19740 existing records from primary storage. [2025-10-24T00:54:15.897715] [INFO ] [MAIN ] PLOW: Loaded 19740 primary data records. [2025-10-24T00:54:15.963274] [DEBUG] [LOCAL ] PLD: Loaded 53803 existing records from primary storage. [2025-10-24T00:54:15.999055] [INFO ] [MAIN ] PLD: Loaded 53803 primary data records. [2025-10-24T00:54:16.004917] [DEBUG] [LOCAL ] PLNT: Loaded 48347 existing records from primary storage. [2025-10-24T00:54:16.022385] [INFO ] [MAIN ] PLNT: Loaded 48347 primary data records. [2025-10-24T00:54:16.937147] [DEBUG] [MAIN ] PLOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:16.936782] [DEBUG] [MAIN ] PLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:16.983120] [DEBUG] [MAIN ] PLNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:17.036618] [INFO ] [MAIN ] PLOW: Generated 139 derivative records from 19740 primary records. [2025-10-24T00:54:17.038662] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-24T00:54:17.039346] [FATAL] [LOCAL ] PLOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:17.043302] [FATAL] [MAIN ] PLOW: Failed to save derivative data. [2025-10-24T00:54:17.045678] [INFO ] [MAIN ] Derivative Progress: 1543/2164 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 10s. Rate: 148.9 symbols/min [2025-10-24T00:54:17.050156] [INFO ] [MAIN ] PLD: Generated 139 derivative records from 53803 primary records. [2025-10-24T00:54:17.050530] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-24T00:54:17.050779] [FATAL] [LOCAL ] PLD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:17.050871] [FATAL] [MAIN ] PLD: Failed to save derivative data. [2025-10-24T00:54:17.053497] [INFO ] [MAIN ] Derivative Progress: 1544/2164 symbols completed. PLD took 1.2s. Estimated remaining: 4m 10s. Rate: 149.0 symbols/min [2025-10-24T00:54:17.056486] [INFO ] [MAIN ] PLNT: Generated 139 derivative records from 48347 primary records. [2025-10-24T00:54:17.056574] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-24T00:54:17.056803] [FATAL] [LOCAL ] PLNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:17.056899] [FATAL] [MAIN ] PLNT: Failed to save derivative data. [2025-10-24T00:54:17.059690] [INFO ] [MAIN ] Derivative Progress: 1545/2164 symbols completed. PLNT took 1.2s. Estimated remaining: 4m 9s. Rate: 149.1 symbols/min [2025-10-24T00:54:17.060044] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:17.060412] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:17.060149] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:17.083696] [DEBUG] [LOCAL ] PML: Loaded 22040 existing records from primary storage. [2025-10-24T00:54:17.083954] [INFO ] [MAIN ] PML: Loaded 22040 primary data records. [2025-10-24T00:54:17.248998] [DEBUG] [LOCAL ] PLYM: Loaded 34660 existing records from primary storage. [2025-10-24T00:54:17.309750] [INFO ] [MAIN ] PLYM: Loaded 34660 primary data records. [2025-10-24T00:54:17.462172] [DEBUG] [LOCAL ] PM: Loaded 54064 existing records from primary storage. [2025-10-24T00:54:17.503028] [INFO ] [MAIN ] PM: Loaded 54064 primary data records. [2025-10-24T00:54:18.074582] [DEBUG] [MAIN ] PML: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:18.138778] [DEBUG] [MAIN ] PLYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:18.142221] [DEBUG] [MAIN ] PM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:18.176627] [INFO ] [MAIN ] PML: Generated 139 derivative records from 22040 primary records. [2025-10-24T00:54:18.179033] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-24T00:54:18.182949] [FATAL] [LOCAL ] PML: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:18.185936] [FATAL] [MAIN ] PML: Failed to save derivative data. [2025-10-24T00:54:18.188572] [INFO ] [MAIN ] Derivative Progress: 1546/2164 symbols completed. PML took 1.1s. Estimated remaining: 4m 9s. Rate: 148.9 symbols/min [2025-10-24T00:54:18.190128] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:18.214624] [DEBUG] [LOCAL ] PMM: Loaded 10151 existing records from primary storage. [2025-10-24T00:54:18.215064] [INFO ] [MAIN ] PMM: Loaded 10151 primary data records. [2025-10-24T00:54:18.381056] [INFO ] [MAIN ] PLYM: Generated 139 derivative records from 34660 primary records. [2025-10-24T00:54:18.583063] [INFO ] [MAIN ] PM: Generated 139 derivative records from 54064 primary records. [2025-10-24T00:54:18.569089] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-24T00:54:18.583602] [FATAL] [LOCAL ] PLYM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:18.583727] [FATAL] [MAIN ] PLYM: Failed to save derivative data. [2025-10-24T00:54:18.583231] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-24T00:54:18.586080] [INFO ] [MAIN ] Derivative Progress: 1547/2164 symbols completed. PLYM took 1.5s. Estimated remaining: 4m 9s. Rate: 148.9 symbols/min [2025-10-24T00:54:18.586370] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:18.583967] [FATAL] [LOCAL ] PM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:18.587505] [FATAL] [MAIN ] PM: Failed to save derivative data. [2025-10-24T00:54:18.590534] [INFO ] [MAIN ] Derivative Progress: 1548/2164 symbols completed. PM took 1.5s. Estimated remaining: 4m 8s. Rate: 149.0 symbols/min [2025-10-24T00:54:18.591478] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:18.602597] [DEBUG] [LOCAL ] PMO: Loaded 9477 existing records from primary storage. [2025-10-24T00:54:18.603097] [INFO ] [MAIN ] PMO: Loaded 9477 primary data records. [2025-10-24T00:54:18.811795] [DEBUG] [MAIN ] PMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:18.956449] [DEBUG] [LOCAL ] PMT: Loaded 41066 existing records from primary storage. [2025-10-24T00:54:18.959464] [INFO ] [MAIN ] PMT: Loaded 41066 primary data records. [2025-10-24T00:54:19.284374] [INFO ] [MAIN ] PMM: Generated 139 derivative records from 10151 primary records. [2025-10-24T00:54:19.297241] [DEBUG] [MAIN ] PMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:19.309109] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-24T00:54:19.313941] [FATAL] [LOCAL ] PMM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:19.314219] [FATAL] [MAIN ] PMM: Failed to save derivative data. [2025-10-24T00:54:19.317307] [INFO ] [MAIN ] Derivative Progress: 1549/2164 symbols completed. PMM took 1.1s. Estimated remaining: 4m 8s. Rate: 148.9 symbols/min [2025-10-24T00:54:19.317487] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:19.340163] [INFO ] [MAIN ] PMO: Generated 139 derivative records from 9477 primary records. [2025-10-24T00:54:19.352742] [DEBUG] [MAIN ] PMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:19.352468] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-24T00:54:19.366384] [FATAL] [LOCAL ] PMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:19.366626] [FATAL] [MAIN ] PMO: Failed to save derivative data. [2025-10-24T00:54:19.369058] [INFO ] [MAIN ] Derivative Progress: 1550/2164 symbols completed. PMO took 0.8s. Estimated remaining: 4m 7s. Rate: 149.0 symbols/min [2025-10-24T00:54:19.372810] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:19.402347] [DEBUG] [LOCAL ] PNI: Loaded 6914 existing records from primary storage. [2025-10-24T00:54:19.418884] [INFO ] [MAIN ] PNI: Loaded 6914 primary data records. [2025-10-24T00:54:19.421297] [INFO ] [MAIN ] PMT: Generated 139 derivative records from 41066 primary records. [2025-10-24T00:54:19.435254] [DEBUG] [LOCAL ] PNC: Loaded 52438 existing records from primary storage. [2025-10-24T00:54:19.460576] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-24T00:54:19.460727] [INFO ] [MAIN ] PNC: Loaded 52438 primary data records. [2025-10-24T00:54:19.461008] [FATAL] [LOCAL ] PMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:19.467959] [FATAL] [MAIN ] PMT: Failed to save derivative data. [2025-10-24T00:54:19.552145] [INFO ] [MAIN ] Derivative Progress: 1551/2164 symbols completed. PMT took 1.0s. Estimated remaining: 4m 7s. Rate: 149.1 symbols/min [2025-10-24T00:54:19.588454] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:20.081584] [DEBUG] [LOCAL ] PNNT: Loaded 33582 existing records from primary storage. [2025-10-24T00:54:20.082763] [INFO ] [MAIN ] PNNT: Loaded 33582 primary data records. [2025-10-24T00:54:20.466058] [DEBUG] [MAIN ] PNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:20.466873] [DEBUG] [MAIN ] PNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:20.560737] [DEBUG] [MAIN ] PNNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:20.577313] [INFO ] [MAIN ] PNC: Generated 139 derivative records from 52438 primary records. [2025-10-24T00:54:20.579510] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-10-24T00:54:20.579417] [INFO ] [MAIN ] PNI: Generated 139 derivative records from 6914 primary records. [2025-10-24T00:54:20.581616] [FATAL] [LOCAL ] PNC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:20.581736] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-24T00:54:20.582147] [FATAL] [LOCAL ] PNI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:20.582301] [FATAL] [MAIN ] PNI: Failed to save derivative data. [2025-10-24T00:54:20.584985] [INFO ] [MAIN ] Derivative Progress: 1552/2164 symbols completed. PNI took 1.2s. Estimated remaining: 4m 7s. Rate: 148.9 symbols/min [2025-10-24T00:54:20.585417] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:20.585302] [FATAL] [MAIN ] PNC: Failed to save derivative data. [2025-10-24T00:54:20.590402] [INFO ] [MAIN ] Derivative Progress: 1553/2164 symbols completed. PNC took 1.3s. Estimated remaining: 4m 6s. Rate: 149.0 symbols/min [2025-10-24T00:54:20.591061] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:20.606806] [INFO ] [MAIN ] PNNT: Generated 139 derivative records from 33582 primary records. [2025-10-24T00:54:20.607156] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-24T00:54:20.607437] [FATAL] [LOCAL ] PNNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:20.607580] [FATAL] [MAIN ] PNNT: Failed to save derivative data. [2025-10-24T00:54:20.610714] [INFO ] [MAIN ] Derivative Progress: 1554/2164 symbols completed. PNNT took 1.0s. Estimated remaining: 4m 5s. Rate: 149.1 symbols/min [2025-10-24T00:54:20.610905] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:20.668924] [DEBUG] [LOCAL ] PNW: Loaded 45849 existing records from primary storage. [2025-10-24T00:54:20.669233] [INFO ] [MAIN ] PNW: Loaded 45849 primary data records. [2025-10-24T00:54:20.668106] [DEBUG] [LOCAL ] PNR: Loaded 47863 existing records from primary storage. [2025-10-24T00:54:20.680810] [INFO ] [MAIN ] PNR: Loaded 47863 primary data records. [2025-10-24T00:54:20.983537] [DEBUG] [LOCAL ] POR: Loaded 47087 existing records from primary storage. [2025-10-24T00:54:21.009580] [INFO ] [MAIN ] POR: Loaded 47087 primary data records. [2025-10-24T00:54:21.637154] [DEBUG] [MAIN ] PNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:21.676193] [DEBUG] [MAIN ] PNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:21.714527] [DEBUG] [MAIN ] POR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:21.759099] [INFO ] [MAIN ] PNW: Generated 139 derivative records from 45849 primary records. [2025-10-24T00:54:21.764111] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-24T00:54:21.766318] [FATAL] [LOCAL ] PNW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:21.771040] [FATAL] [MAIN ] PNW: Failed to save derivative data. [2025-10-24T00:54:21.777339] [INFO ] [MAIN ] Derivative Progress: 1555/2164 symbols completed. PNW took 1.2s. Estimated remaining: 4m 5s. Rate: 148.9 symbols/min [2025-10-24T00:54:21.780708] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:21.788710] [INFO ] [MAIN ] PNR: Generated 139 derivative records from 47863 primary records. [2025-10-24T00:54:21.790164] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-10-24T00:54:21.792836] [FATAL] [LOCAL ] PNR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:21.792506] [INFO ] [MAIN ] POR: Generated 139 derivative records from 47087 primary records. [2025-10-24T00:54:21.793176] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-24T00:54:21.793459] [FATAL] [MAIN ] PNR: Failed to save derivative data. [2025-10-24T00:54:21.793406] [FATAL] [LOCAL ] POR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:21.796215] [INFO ] [MAIN ] Derivative Progress: 1556/2164 symbols completed. PNR took 1.2s. Estimated remaining: 4m 5s. Rate: 149.0 symbols/min [2025-10-24T00:54:21.796397] [FATAL] [MAIN ] POR: Failed to save derivative data. [2025-10-24T00:54:21.796810] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:21.799915] [INFO ] [MAIN ] Derivative Progress: 1557/2164 symbols completed. POR took 1.2s. Estimated remaining: 4m 4s. Rate: 149.1 symbols/min [2025-10-24T00:54:21.800140] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:21.837104] [DEBUG] [LOCAL ] POST: Loaded 38731 existing records from primary storage. [2025-10-24T00:54:21.837427] [INFO ] [MAIN ] POST: Loaded 38731 primary data records. [2025-10-24T00:54:22.004591] [DEBUG] [LOCAL ] PPL: Loaded 53894 existing records from primary storage. [2025-10-24T00:54:22.071028] [INFO ] [MAIN ] PPL: Loaded 53894 primary data records. [2025-10-24T00:54:22.047272] [DEBUG] [LOCAL ] PPG: Loaded 50853 existing records from primary storage. [2025-10-24T00:54:22.081792] [INFO ] [MAIN ] PPG: Loaded 50853 primary data records. [2025-10-24T00:54:22.901969] [DEBUG] [MAIN ] POST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:22.953134] [DEBUG] [MAIN ] PPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:22.990487] [DEBUG] [MAIN ] PPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:23.022225] [INFO ] [MAIN ] POST: Generated 139 derivative records from 38731 primary records. [2025-10-24T00:54:23.025525] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-24T00:54:23.026050] [FATAL] [LOCAL ] POST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:23.026708] [FATAL] [MAIN ] POST: Failed to save derivative data. [2025-10-24T00:54:23.031203] [INFO ] [MAIN ] Derivative Progress: 1558/2164 symbols completed. POST took 1.3s. Estimated remaining: 4m 4s. Rate: 148.9 symbols/min [2025-10-24T00:54:23.059257] [INFO ] [MAIN ] PPL: Generated 139 derivative records from 53894 primary records. [2025-10-24T00:54:23.062902] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-10-24T00:54:23.064506] [FATAL] [LOCAL ] PPL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:23.066425] [FATAL] [MAIN ] PPL: Failed to save derivative data. [2025-10-24T00:54:23.066983] [INFO ] [MAIN ] PPG: Generated 139 derivative records from 50853 primary records. [2025-10-24T00:54:23.070245] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-24T00:54:23.070102] [INFO ] [MAIN ] Derivative Progress: 1559/2164 symbols completed. PPL took 1.3s. Estimated remaining: 4m 4s. Rate: 149.0 symbols/min [2025-10-24T00:54:23.070564] [FATAL] [LOCAL ] PPG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:23.070710] [FATAL] [MAIN ] PPG: Failed to save derivative data. [2025-10-24T00:54:23.074369] [INFO ] [MAIN ] Derivative Progress: 1560/2164 symbols completed. PPG took 1.3s. Estimated remaining: 4m 3s. Rate: 149.1 symbols/min [2025-10-24T00:54:23.074845] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:23.074893] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:23.074946] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:23.101957] [DEBUG] [LOCAL ] PPT: Loaded 19765 existing records from primary storage. [2025-10-24T00:54:23.102142] [INFO ] [MAIN ] PPT: Loaded 19765 primary data records. [2025-10-24T00:54:23.253434] [DEBUG] [LOCAL ] PRA: Loaded 34625 existing records from primary storage. [2025-10-24T00:54:23.292162] [INFO ] [MAIN ] PRA: Loaded 34625 primary data records. [2025-10-24T00:54:23.382494] [DEBUG] [LOCAL ] PR: Loaded 54001 existing records from primary storage. [2025-10-24T00:54:23.396844] [INFO ] [MAIN ] PR: Loaded 54001 primary data records. [2025-10-24T00:54:24.175783] [DEBUG] [MAIN ] PPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:24.214194] [DEBUG] [MAIN ] PRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:24.243697] [DEBUG] [MAIN ] PR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:24.304191] [INFO ] [MAIN ] PPT: Generated 139 derivative records from 19765 primary records. [2025-10-24T00:54:24.306147] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-24T00:54:24.307044] [FATAL] [LOCAL ] PPT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:24.308200] [FATAL] [MAIN ] PPT: Failed to save derivative data. [2025-10-24T00:54:24.311824] [INFO ] [MAIN ] Derivative Progress: 1561/2164 symbols completed. PPT took 1.2s. Estimated remaining: 4m 3s. Rate: 148.9 symbols/min [2025-10-24T00:54:24.311996] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:24.325098] [DEBUG] [LOCAL ] PRCS: Loaded 2802 existing records from primary storage. [2025-10-24T00:54:24.325333] [INFO ] [MAIN ] PRCS: Loaded 2802 primary data records. [2025-10-24T00:54:24.358607] [INFO ] [MAIN ] PR: Generated 139 derivative records from 54001 primary records. [2025-10-24T00:54:24.378616] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-24T00:54:24.401150] [INFO ] [MAIN ] PRA: Generated 139 derivative records from 34625 primary records. [2025-10-24T00:54:24.408350] [FATAL] [LOCAL ] PR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:24.407945] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-24T00:54:24.414049] [FATAL] [LOCAL ] PRA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:24.419297] [FATAL] [MAIN ] PR: Failed to save derivative data. [2025-10-24T00:54:24.436591] [FATAL] [MAIN ] PRA: Failed to save derivative data. [2025-10-24T00:54:24.422120] [INFO ] [MAIN ] Derivative Progress: 1562/2164 symbols completed. PR took 1.3s. Estimated remaining: 4m 2s. Rate: 149.0 symbols/min [2025-10-24T00:54:24.440194] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:24.449454] [INFO ] [MAIN ] Derivative Progress: 1563/2164 symbols completed. PRA took 1.4s. Estimated remaining: 4m 2s. Rate: 149.1 symbols/min [2025-10-24T00:54:24.465519] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:24.700306] [DEBUG] [LOCAL ] PRG: Loaded 29965 existing records from primary storage. [2025-10-24T00:54:24.702213] [INFO ] [MAIN ] PRG: Loaded 29965 primary data records. [2025-10-24T00:54:24.847207] [DEBUG] [LOCAL ] PRGO: Loaded 47472 existing records from primary storage. [2025-10-24T00:54:24.858438] [INFO ] [MAIN ] PRGO: Loaded 47472 primary data records. [2025-10-24T00:54:25.000376] [DEBUG] [MAIN ] PRCS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:25.425662] [INFO ] [MAIN ] PRCS: Generated 139 derivative records from 2802 primary records. [2025-10-24T00:54:25.425991] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-24T00:54:25.427135] [FATAL] [LOCAL ] PRCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:25.429836] [FATAL] [MAIN ] PRCS: Failed to save derivative data. [2025-10-24T00:54:25.431983] [INFO ] [MAIN ] Derivative Progress: 1564/2164 symbols completed. PRCS took 1.1s. Estimated remaining: 4m 2s. Rate: 148.9 symbols/min [2025-10-24T00:54:25.432688] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:25.449033] [DEBUG] [MAIN ] PRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:25.470012] [DEBUG] [LOCAL ] PRH: Loaded 4702 existing records from primary storage. [2025-10-24T00:54:25.484937] [INFO ] [MAIN ] PRH: Loaded 4702 primary data records. [2025-10-24T00:54:25.485248] [DEBUG] [MAIN ] PRGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:25.842768] [INFO ] [MAIN ] PRGO: Generated 139 derivative records from 47472 primary records. [2025-10-24T00:54:25.843420] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-24T00:54:25.845297] [FATAL] [LOCAL ] PRGO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:25.845544] [FATAL] [MAIN ] PRGO: Failed to save derivative data. [2025-10-24T00:54:25.850244] [INFO ] [MAIN ] Derivative Progress: 1565/2164 symbols completed. PRGO took 1.4s. Estimated remaining: 4m 1s. Rate: 148.9 symbols/min [2025-10-24T00:54:25.850674] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:25.850932] [INFO ] [MAIN ] PRG: Generated 139 derivative records from 29965 primary records. [2025-10-24T00:54:25.851742] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-24T00:54:25.852044] [FATAL] [LOCAL ] PRG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:25.852123] [FATAL] [MAIN ] PRG: Failed to save derivative data. [2025-10-24T00:54:25.854820] [INFO ] [MAIN ] Derivative Progress: 1566/2164 symbols completed. PRG took 1.4s. Estimated remaining: 4m 1s. Rate: 149.0 symbols/min [2025-10-24T00:54:25.855061] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:25.870857] [DEBUG] [MAIN ] PRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:25.906371] [DEBUG] [LOCAL ] PRI: Loaded 17835 existing records from primary storage. [2025-10-24T00:54:25.908385] [INFO ] [MAIN ] PRI: Loaded 17835 primary data records. [2025-10-24T00:54:26.131930] [DEBUG] [LOCAL ] PRIM: Loaded 44369 existing records from primary storage. [2025-10-24T00:54:26.132602] [INFO ] [MAIN ] PRIM: Loaded 44369 primary data records. [2025-10-24T00:54:26.341119] [INFO ] [MAIN ] PRH: Generated 139 derivative records from 4702 primary records. [2025-10-24T00:54:26.383159] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-24T00:54:26.394931] [FATAL] [LOCAL ] PRH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:26.400168] [FATAL] [MAIN ] PRH: Failed to save derivative data. [2025-10-24T00:54:26.616551] [INFO ] [MAIN ] Derivative Progress: 1567/2164 symbols completed. PRH took 1.2s. Estimated remaining: 4m 1s. Rate: 148.9 symbols/min [2025-10-24T00:54:26.631439] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:26.655856] [DEBUG] [MAIN ] PRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:26.719717] [DEBUG] [LOCAL ] PRKS: Loaded 42500 existing records from primary storage. [2025-10-24T00:54:26.734889] [INFO ] [MAIN ] PRKS: Loaded 42500 primary data records. [2025-10-24T00:54:26.749272] [DEBUG] [MAIN ] PRIM: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:26.861897] [INFO ] [MAIN ] PRI: Generated 139 derivative records from 17835 primary records. [2025-10-24T00:54:26.867087] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-24T00:54:26.870717] [FATAL] [LOCAL ] PRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:26.881345] [FATAL] [MAIN ] PRI: Failed to save derivative data. [2025-10-24T00:54:26.889150] [INFO ] [MAIN ] Derivative Progress: 1568/2164 symbols completed. PRI took 1.0s. Estimated remaining: 4m 0s. Rate: 149.0 symbols/min [2025-10-24T00:54:26.930469] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:27.104492] [DEBUG] [LOCAL ] PRLB: Loaded 20478 existing records from primary storage. [2025-10-24T00:54:27.109003] [INFO ] [MAIN ] PRLB: Loaded 20478 primary data records. [2025-10-24T00:54:27.107991] [INFO ] [MAIN ] PRIM: Generated 139 derivative records from 44369 primary records. [2025-10-24T00:54:27.109574] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-24T00:54:27.130937] [FATAL] [LOCAL ] PRIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:27.141465] [FATAL] [MAIN ] PRIM: Failed to save derivative data. [2025-10-24T00:54:27.149780] [INFO ] [MAIN ] Derivative Progress: 1569/2164 symbols completed. PRIM took 1.3s. Estimated remaining: 3m 60s. Rate: 149.0 symbols/min [2025-10-24T00:54:27.169325] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:27.319722] [DEBUG] [MAIN ] PRKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:27.489978] [DEBUG] [LOCAL ] PRM: Loaded 44667 existing records from primary storage. [2025-10-24T00:54:27.493746] [INFO ] [MAIN ] PRM: Loaded 44667 primary data records. [2025-10-24T00:54:27.604147] [INFO ] [MAIN ] PRKS: Generated 139 derivative records from 42500 primary records. [2025-10-24T00:54:27.610057] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-24T00:54:27.618937] [FATAL] [LOCAL ] PRKS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:27.633427] [FATAL] [MAIN ] PRKS: Failed to save derivative data. [2025-10-24T00:54:27.636304] [INFO ] [MAIN ] Derivative Progress: 1570/2164 symbols completed. PRKS took 1.0s. Estimated remaining: 3m 59s. Rate: 149.0 symbols/min [2025-10-24T00:54:27.693484] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:27.703731] [DEBUG] [MAIN ] PRLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:27.908634] [INFO ] [MAIN ] PRLB: Generated 139 derivative records from 20478 primary records. [2025-10-24T00:54:27.908844] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-24T00:54:27.909147] [FATAL] [LOCAL ] PRLB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:27.909303] [FATAL] [MAIN ] PRLB: Failed to save derivative data. [2025-10-24T00:54:27.912672] [INFO ] [MAIN ] Derivative Progress: 1571/2164 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 59s. Rate: 149.0 symbols/min [2025-10-24T00:54:27.914153] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:27.929548] [DEBUG] [MAIN ] PRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:27.959113] [DEBUG] [LOCAL ] PRMB: Loaded 53483 existing records from primary storage. [2025-10-24T00:54:27.961218] [INFO ] [MAIN ] PRMB: Loaded 53483 primary data records. [2025-10-24T00:54:28.111950] [DEBUG] [LOCAL ] PRO: Loaded 40426 existing records from primary storage. [2025-10-24T00:54:28.147294] [INFO ] [MAIN ] PRO: Loaded 40426 primary data records. [2025-10-24T00:54:28.467389] [INFO ] [MAIN ] PRM: Generated 139 derivative records from 44667 primary records. [2025-10-24T00:54:28.670336] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-24T00:54:28.670989] [FATAL] [LOCAL ] PRM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:28.671274] [FATAL] [MAIN ] PRM: Failed to save derivative data. [2025-10-24T00:54:28.674013] [INFO ] [MAIN ] Derivative Progress: 1572/2164 symbols completed. PRM took 1.5s. Estimated remaining: 3m 59s. Rate: 148.9 symbols/min [2025-10-24T00:54:28.674429] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:28.702736] [DEBUG] [MAIN ] PRMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:28.725874] [DEBUG] [LOCAL ] PRSU: Loaded 23223 existing records from primary storage. [2025-10-24T00:54:28.726358] [INFO ] [MAIN ] PRSU: Loaded 23223 primary data records. [2025-10-24T00:54:28.939526] [DEBUG] [MAIN ] PRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:29.095376] [INFO ] [MAIN ] PRMB: Generated 139 derivative records from 53483 primary records. [2025-10-24T00:54:29.097319] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-24T00:54:29.097701] [FATAL] [LOCAL ] PRMB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:29.098433] [FATAL] [MAIN ] PRMB: Failed to save derivative data. [2025-10-24T00:54:29.101006] [INFO ] [MAIN ] Derivative Progress: 1573/2164 symbols completed. PRMB took 1.4s. Estimated remaining: 3m 58s. Rate: 148.9 symbols/min [2025-10-24T00:54:29.125519] [DEBUG] [MAIN ] PRSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:29.142480] [INFO ] [MAIN ] PRO: Generated 139 derivative records from 40426 primary records. [2025-10-24T00:54:29.145596] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-24T00:54:29.146147] [FATAL] [LOCAL ] PRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:29.146588] [FATAL] [MAIN ] PRO: Failed to save derivative data. [2025-10-24T00:54:29.150282] [INFO ] [MAIN ] Derivative Progress: 1574/2164 symbols completed. PRO took 1.2s. Estimated remaining: 3m 58s. Rate: 149.0 symbols/min [2025-10-24T00:54:29.165713] [INFO ] [MAIN ] PRSU: Generated 139 derivative records from 23223 primary records. [2025-10-24T00:54:29.165889] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-10-24T00:54:29.166096] [FATAL] [LOCAL ] PRSU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:29.166176] [FATAL] [MAIN ] PRSU: Failed to save derivative data. [2025-10-24T00:54:29.168436] [INFO ] [MAIN ] Derivative Progress: 1575/2164 symbols completed. PRSU took 0.5s. Estimated remaining: 3m 57s. Rate: 149.1 symbols/min [2025-10-24T00:54:29.169084] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:29.168974] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:29.169344] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:29.178637] [DEBUG] [LOCAL ] PRT: Loaded 5085 existing records from primary storage. [2025-10-24T00:54:29.178895] [INFO ] [MAIN ] PRT: Loaded 5085 primary data records. [2025-10-24T00:54:29.502245] [DEBUG] [LOCAL ] PSA: Loaded 42392 existing records from primary storage. [2025-10-24T00:54:29.504235] [INFO ] [MAIN ] PSA: Loaded 42392 primary data records. [2025-10-24T00:54:29.639128] [DEBUG] [LOCAL ] PRU: Loaded 51504 existing records from primary storage. [2025-10-24T00:54:29.650063] [INFO ] [MAIN ] PRU: Loaded 51504 primary data records. [2025-10-24T00:54:29.974608] [DEBUG] [MAIN ] PRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:30.219317] [DEBUG] [MAIN ] PSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:30.261205] [DEBUG] [MAIN ] PRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:30.284849] [INFO ] [MAIN ] PRT: Generated 139 derivative records from 5085 primary records. [2025-10-24T00:54:30.287891] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-24T00:54:30.291219] [FATAL] [LOCAL ] PRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:30.291685] [FATAL] [MAIN ] PRT: Failed to save derivative data. [2025-10-24T00:54:30.294094] [INFO ] [MAIN ] Derivative Progress: 1576/2164 symbols completed. PRT took 1.1s. Estimated remaining: 3m 57s. Rate: 148.9 symbols/min [2025-10-24T00:54:30.294679] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:30.313044] [DEBUG] [LOCAL ] PSBD: Loaded 8310 existing records from primary storage. [2025-10-24T00:54:30.315042] [INFO ] [MAIN ] PSBD: Loaded 8310 primary data records. [2025-10-24T00:54:30.437418] [INFO ] [MAIN ] PSA: Generated 139 derivative records from 42392 primary records. [2025-10-24T00:54:30.450876] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-24T00:54:30.487066] [FATAL] [LOCAL ] PSA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:30.521225] [FATAL] [MAIN ] PSA: Failed to save derivative data. [2025-10-24T00:54:30.547701] [INFO ] [MAIN ] Derivative Progress: 1577/2164 symbols completed. PSA took 1.4s. Estimated remaining: 3m 56s. Rate: 148.9 symbols/min [2025-10-24T00:54:30.631997] [INFO ] [MAIN ] PRU: Generated 139 derivative records from 51504 primary records. [2025-10-24T00:54:30.640476] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:30.640569] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-24T00:54:30.641362] [FATAL] [LOCAL ] PRU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:30.641441] [FATAL] [MAIN ] PRU: Failed to save derivative data. [2025-10-24T00:54:30.644776] [INFO ] [MAIN ] Derivative Progress: 1578/2164 symbols completed. PRU took 1.5s. Estimated remaining: 3m 56s. Rate: 149.0 symbols/min [2025-10-24T00:54:30.645138] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:30.654716] [DEBUG] [LOCAL ] PSF: Loaded 6972 existing records from primary storage. [2025-10-24T00:54:30.655126] [INFO ] [MAIN ] PSF: Loaded 6972 primary data records. [2025-10-24T00:54:30.814894] [DEBUG] [LOCAL ] PSFE: Loaded 29746 existing records from primary storage. [2025-10-24T00:54:30.823731] [INFO ] [MAIN ] PSFE: Loaded 29746 primary data records. [2025-10-24T00:54:31.184395] [DEBUG] [MAIN ] PSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:31.371514] [DEBUG] [MAIN ] PSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:31.401406] [INFO ] [MAIN ] PSBD: Generated 139 derivative records from 8310 primary records. [2025-10-24T00:54:31.403406] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-24T00:54:31.403904] [FATAL] [LOCAL ] PSBD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:31.404004] [FATAL] [MAIN ] PSBD: Failed to save derivative data. [2025-10-24T00:54:31.406495] [INFO ] [MAIN ] Derivative Progress: 1579/2164 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 56s. Rate: 148.9 symbols/min [2025-10-24T00:54:31.408317] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:31.425195] [DEBUG] [MAIN ] PSFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:31.464720] [INFO ] [MAIN ] PSF: Generated 139 derivative records from 6972 primary records. [2025-10-24T00:54:31.465190] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-24T00:54:31.468093] [FATAL] [LOCAL ] PSF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:31.469327] [FATAL] [MAIN ] PSF: Failed to save derivative data. [2025-10-24T00:54:31.486765] [INFO ] [MAIN ] Derivative Progress: 1580/2164 symbols completed. PSF took 0.8s. Estimated remaining: 3m 55s. Rate: 149.0 symbols/min [2025-10-24T00:54:31.488854] [DEBUG] [LOCAL ] PSN: Loaded 45425 existing records from primary storage. [2025-10-24T00:54:31.489240] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:31.489088] [INFO ] [MAIN ] PSN: Loaded 45425 primary data records. [2025-10-24T00:54:31.653538] [INFO ] [MAIN ] PSFE: Generated 139 derivative records from 29746 primary records. [2025-10-24T00:54:31.792325] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-24T00:54:31.806308] [FATAL] [LOCAL ] PSFE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:31.807030] [FATAL] [MAIN ] PSFE: Failed to save derivative data. [2025-10-24T00:54:31.809879] [INFO ] [MAIN ] Derivative Progress: 1581/2164 symbols completed. PSFE took 1.2s. Estimated remaining: 3m 55s. Rate: 149.0 symbols/min [2025-10-24T00:54:31.810096] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:31.830519] [DEBUG] [LOCAL ] PSO: Loaded 36855 existing records from primary storage. [2025-10-24T00:54:31.832096] [INFO ] [MAIN ] PSO: Loaded 36855 primary data records. [2025-10-24T00:54:31.967867] [DEBUG] [LOCAL ] PSQH: Loaded 35712 existing records from primary storage. [2025-10-24T00:54:31.975056] [INFO ] [MAIN ] PSQH: Loaded 35712 primary data records. [2025-10-24T00:54:32.157394] [DEBUG] [MAIN ] PSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:32.564776] [INFO ] [MAIN ] PSN: Generated 139 derivative records from 45425 primary records. [2025-10-24T00:54:32.565801] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-24T00:54:32.566191] [FATAL] [LOCAL ] PSN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:32.565223] [DEBUG] [MAIN ] PSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:32.566292] [FATAL] [MAIN ] PSN: Failed to save derivative data. [2025-10-24T00:54:32.582321] [INFO ] [MAIN ] Derivative Progress: 1582/2164 symbols completed. PSN took 1.2s. Estimated remaining: 3m 54s. Rate: 148.9 symbols/min [2025-10-24T00:54:32.582878] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:32.607769] [DEBUG] [MAIN ] PSQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:32.671810] [INFO ] [MAIN ] PSO: Generated 139 derivative records from 36855 primary records. [2025-10-24T00:54:32.672222] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-24T00:54:32.672630] [FATAL] [LOCAL ] PSO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:32.672865] [FATAL] [MAIN ] PSO: Failed to save derivative data. [2025-10-24T00:54:32.677511] [INFO ] [MAIN ] Derivative Progress: 1583/2164 symbols completed. PSO took 1.2s. Estimated remaining: 3m 54s. Rate: 149.0 symbols/min [2025-10-24T00:54:32.677871] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:32.700623] [INFO ] [MAIN ] PSQH: Generated 139 derivative records from 35712 primary records. [2025-10-24T00:54:32.700880] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-24T00:54:32.701397] [FATAL] [LOCAL ] PSQH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:32.701540] [FATAL] [MAIN ] PSQH: Failed to save derivative data. [2025-10-24T00:54:32.704324] [INFO ] [MAIN ] Derivative Progress: 1584/2164 symbols completed. PSQH took 0.9s. Estimated remaining: 3m 53s. Rate: 149.1 symbols/min [2025-10-24T00:54:32.706591] [DEBUG] [LOCAL ] PSTG: Loaded 53212 existing records from primary storage. [2025-10-24T00:54:32.706968] [INFO ] [MAIN ] PSTG: Loaded 53212 primary data records. [2025-10-24T00:54:32.706804] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:32.868506] [DEBUG] [LOCAL ] PSTL: Loaded 20000 existing records from primary storage. [2025-10-24T00:54:32.946161] [INFO ] [MAIN ] PSTL: Loaded 20000 primary data records. [2025-10-24T00:54:33.196803] [DEBUG] [LOCAL ] PSX: Loaded 53511 existing records from primary storage. [2025-10-24T00:54:33.198242] [INFO ] [MAIN ] PSX: Loaded 53511 primary data records. [2025-10-24T00:54:33.723983] [DEBUG] [MAIN ] PSTG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:33.784341] [DEBUG] [MAIN ] PSTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:33.815088] [INFO ] [MAIN ] PSTG: Generated 139 derivative records from 53212 primary records. [2025-10-24T00:54:33.816481] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-24T00:54:33.829832] [FATAL] [LOCAL ] PSTG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:33.830286] [DEBUG] [MAIN ] PSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:33.829964] [FATAL] [MAIN ] PSTG: Failed to save derivative data. [2025-10-24T00:54:33.850062] [INFO ] [MAIN ] Derivative Progress: 1585/2164 symbols completed. PSTG took 1.3s. Estimated remaining: 3m 53s. Rate: 148.9 symbols/min [2025-10-24T00:54:33.852787] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:33.883971] [INFO ] [MAIN ] PSTL: Generated 139 derivative records from 20000 primary records. [2025-10-24T00:54:33.887016] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-24T00:54:33.887760] [FATAL] [LOCAL ] PSTL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:33.887862] [FATAL] [MAIN ] PSTL: Failed to save derivative data. [2025-10-24T00:54:33.890112] [INFO ] [MAIN ] Derivative Progress: 1586/2164 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 53s. Rate: 149.0 symbols/min [2025-10-24T00:54:33.900860] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:33.904472] [INFO ] [MAIN ] PSX: Generated 139 derivative records from 53511 primary records. [2025-10-24T00:54:33.904809] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-24T00:54:33.905112] [FATAL] [LOCAL ] PSX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:33.905190] [FATAL] [MAIN ] PSX: Failed to save derivative data. [2025-10-24T00:54:33.907995] [INFO ] [MAIN ] Derivative Progress: 1587/2164 symbols completed. PSX took 1.2s. Estimated remaining: 3m 52s. Rate: 149.1 symbols/min [2025-10-24T00:54:33.908257] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:33.922514] [DEBUG] [LOCAL ] PTY: Loaded 38196 existing records from primary storage. [2025-10-24T00:54:33.922739] [INFO ] [MAIN ] PTY: Loaded 38196 primary data records. [2025-10-24T00:54:34.245010] [DEBUG] [LOCAL ] PUK: Loaded 44662 existing records from primary storage. [2025-10-24T00:54:34.253637] [INFO ] [MAIN ] PUK: Loaded 44662 primary data records. [2025-10-24T00:54:34.361674] [DEBUG] [LOCAL ] PUMP: Loaded 49808 existing records from primary storage. [2025-10-24T00:54:34.368959] [INFO ] [MAIN ] PUMP: Loaded 49808 primary data records. [2025-10-24T00:54:35.017417] [DEBUG] [MAIN ] PTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:35.075536] [DEBUG] [MAIN ] PUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:35.132731] [DEBUG] [MAIN ] PUMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:35.166005] [INFO ] [MAIN ] PTY: Generated 139 derivative records from 38196 primary records. [2025-10-24T00:54:35.168197] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-24T00:54:35.168947] [FATAL] [LOCAL ] PTY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:35.172159] [FATAL] [MAIN ] PTY: Failed to save derivative data. [2025-10-24T00:54:35.181888] [INFO ] [MAIN ] Derivative Progress: 1588/2164 symbols completed. PTY took 1.3s. Estimated remaining: 3m 52s. Rate: 148.9 symbols/min [2025-10-24T00:54:35.206218] [INFO ] [MAIN ] PUK: Generated 139 derivative records from 44662 primary records. [2025-10-24T00:54:35.208103] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-24T00:54:35.208401] [FATAL] [LOCAL ] PUK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:35.208843] [FATAL] [MAIN ] PUK: Failed to save derivative data. [2025-10-24T00:54:35.214269] [INFO ] [MAIN ] Derivative Progress: 1589/2164 symbols completed. PUK took 1.3s. Estimated remaining: 3m 52s. Rate: 149.0 symbols/min [2025-10-24T00:54:35.220523] [INFO ] [MAIN ] PUMP: Generated 139 derivative records from 49808 primary records. [2025-10-24T00:54:35.220748] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-24T00:54:35.221028] [FATAL] [LOCAL ] PUMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:35.221129] [FATAL] [MAIN ] PUMP: Failed to save derivative data. [2025-10-24T00:54:35.225164] [INFO ] [MAIN ] Derivative Progress: 1590/2164 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 51s. Rate: 149.1 symbols/min [2025-10-24T00:54:35.226164] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:35.226330] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:35.225991] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:35.237032] [DEBUG] [LOCAL ] PVL: Loaded 4774 existing records from primary storage. [2025-10-24T00:54:35.237354] [INFO ] [MAIN ] PVL: Loaded 4774 primary data records. [2025-10-24T00:54:35.624507] [DEBUG] [LOCAL ] PWR: Loaded 46797 existing records from primary storage. [2025-10-24T00:54:35.626240] [INFO ] [MAIN ] PWR: Loaded 46797 primary data records. [2025-10-24T00:54:35.628398] [DEBUG] [LOCAL ] PVH: Loaded 49778 existing records from primary storage. [2025-10-24T00:54:35.647898] [INFO ] [MAIN ] PVH: Loaded 49778 primary data records. [2025-10-24T00:54:36.277584] [DEBUG] [MAIN ] PVL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:36.335097] [DEBUG] [MAIN ] PWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:36.372448] [DEBUG] [MAIN ] PVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:36.372676] [INFO ] [MAIN ] PVL: Generated 139 derivative records from 4774 primary records. [2025-10-24T00:54:36.390737] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-24T00:54:36.395288] [FATAL] [LOCAL ] PVL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:36.396102] [FATAL] [MAIN ] PVL: Failed to save derivative data. [2025-10-24T00:54:36.403238] [INFO ] [MAIN ] Derivative Progress: 1591/2164 symbols completed. PVL took 1.2s. Estimated remaining: 3m 51s. Rate: 148.9 symbols/min [2025-10-24T00:54:36.404226] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:36.438061] [INFO ] [MAIN ] PWR: Generated 139 derivative records from 46797 primary records. [2025-10-24T00:54:36.449302] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-24T00:54:36.450488] [FATAL] [LOCAL ] PWR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:36.453299] [FATAL] [MAIN ] PWR: Failed to save derivative data. [2025-10-24T00:54:36.456033] [INFO ] [MAIN ] Derivative Progress: 1592/2164 symbols completed. PWR took 1.2s. Estimated remaining: 3m 50s. Rate: 149.0 symbols/min [2025-10-24T00:54:36.456287] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:36.456746] [INFO ] [MAIN ] PVH: Generated 139 derivative records from 49778 primary records. [2025-10-24T00:54:36.457245] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-24T00:54:36.457814] [FATAL] [LOCAL ] PVH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:36.457914] [FATAL] [MAIN ] PVH: Failed to save derivative data. [2025-10-24T00:54:36.460494] [INFO ] [MAIN ] Derivative Progress: 1593/2164 symbols completed. PVH took 1.2s. Estimated remaining: 3m 50s. Rate: 149.1 symbols/min [2025-10-24T00:54:36.460881] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:36.473132] [DEBUG] [LOCAL ] PX: Loaded 34132 existing records from primary storage. [2025-10-24T00:54:36.473355] [INFO ] [MAIN ] PX: Loaded 34132 primary data records. [2025-10-24T00:54:36.678307] [DEBUG] [LOCAL ] QD: Loaded 27628 existing records from primary storage. [2025-10-24T00:54:36.794694] [INFO ] [MAIN ] QD: Loaded 27628 primary data records. [2025-10-24T00:54:36.950199] [DEBUG] [LOCAL ] QBTS: Loaded 54210 existing records from primary storage. [2025-10-24T00:54:36.971700] [INFO ] [MAIN ] QBTS: Loaded 54210 primary data records. [2025-10-24T00:54:37.529563] [DEBUG] [MAIN ] PX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:37.584850] [DEBUG] [MAIN ] QD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:37.615110] [DEBUG] [MAIN ] QBTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:37.617426] [INFO ] [MAIN ] PX: Generated 139 derivative records from 34132 primary records. [2025-10-24T00:54:37.632411] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-24T00:54:37.633016] [FATAL] [LOCAL ] PX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:37.636345] [FATAL] [MAIN ] PX: Failed to save derivative data. [2025-10-24T00:54:37.639511] [INFO ] [MAIN ] Derivative Progress: 1594/2164 symbols completed. PX took 1.2s. Estimated remaining: 3m 50s. Rate: 148.9 symbols/min [2025-10-24T00:54:37.640049] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:37.692918] [INFO ] [MAIN ] QBTS: Generated 139 derivative records from 54210 primary records. [2025-10-24T00:54:37.690711] [INFO ] [MAIN ] QD: Generated 139 derivative records from 27628 primary records. [2025-10-24T00:54:37.693224] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-10-24T00:54:37.693470] [FATAL] [LOCAL ] QBTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:37.693685] [FATAL] [MAIN ] QBTS: Failed to save derivative data. [2025-10-24T00:54:37.693599] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-24T00:54:37.696338] [INFO ] [MAIN ] Derivative Progress: 1595/2164 symbols completed. QBTS took 1.2s. Estimated remaining: 3m 49s. Rate: 149.0 symbols/min [2025-10-24T00:54:37.696946] [FATAL] [LOCAL ] QD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:37.697064] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:37.697230] [FATAL] [MAIN ] QD: Failed to save derivative data. [2025-10-24T00:54:37.700468] [INFO ] [MAIN ] Derivative Progress: 1596/2164 symbols completed. QD took 1.2s. Estimated remaining: 3m 49s. Rate: 149.1 symbols/min [2025-10-24T00:54:37.701502] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:37.718093] [DEBUG] [LOCAL ] QGEN: Loaded 49391 existing records from primary storage. [2025-10-24T00:54:37.718472] [INFO ] [MAIN ] QGEN: Loaded 49391 primary data records. [2025-10-24T00:54:38.067725] [DEBUG] [LOCAL ] QS: Loaded 54150 existing records from primary storage. [2025-10-24T00:54:38.069038] [INFO ] [MAIN ] QS: Loaded 54150 primary data records. [2025-10-24T00:54:38.165690] [DEBUG] [LOCAL ] QSR: Loaded 52811 existing records from primary storage. [2025-10-24T00:54:38.203186] [INFO ] [MAIN ] QSR: Loaded 52811 primary data records. [2025-10-24T00:54:38.595521] [DEBUG] [MAIN ] QGEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:38.767239] [DEBUG] [MAIN ] QS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:38.791631] [INFO ] [MAIN ] QGEN: Generated 139 derivative records from 49391 primary records. [2025-10-24T00:54:38.795236] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-24T00:54:38.796300] [FATAL] [LOCAL ] QGEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:38.812396] [FATAL] [MAIN ] QGEN: Failed to save derivative data. [2025-10-24T00:54:38.812289] [DEBUG] [MAIN ] QSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:38.815139] [INFO ] [MAIN ] Derivative Progress: 1597/2164 symbols completed. QGEN took 1.2s. Estimated remaining: 3m 48s. Rate: 148.9 symbols/min [2025-10-24T00:54:38.828725] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:38.879789] [INFO ] [MAIN ] QS: Generated 139 derivative records from 54150 primary records. [2025-10-24T00:54:38.883494] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-24T00:54:38.883860] [FATAL] [LOCAL ] QS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:38.883976] [FATAL] [MAIN ] QS: Failed to save derivative data. [2025-10-24T00:54:38.896320] [INFO ] [MAIN ] Derivative Progress: 1598/2164 symbols completed. QS took 1.2s. Estimated remaining: 3m 48s. Rate: 149.0 symbols/min [2025-10-24T00:54:38.898001] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:38.898771] [DEBUG] [LOCAL ] QTWO: Loaded 39712 existing records from primary storage. [2025-10-24T00:54:38.903724] [INFO ] [MAIN ] QTWO: Loaded 39712 primary data records. [2025-10-24T00:54:38.903952] [INFO ] [MAIN ] QSR: Generated 139 derivative records from 52811 primary records. [2025-10-24T00:54:38.915700] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-24T00:54:38.942317] [FATAL] [LOCAL ] QSR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:38.942568] [FATAL] [MAIN ] QSR: Failed to save derivative data. [2025-10-24T00:54:38.952565] [INFO ] [MAIN ] Derivative Progress: 1599/2164 symbols completed. QSR took 1.3s. Estimated remaining: 3m 47s. Rate: 149.0 symbols/min [2025-10-24T00:54:38.952842] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:39.053992] [DEBUG] [LOCAL ] QVCC: Loaded 8745 existing records from primary storage. [2025-10-24T00:54:39.077447] [INFO ] [MAIN ] QVCC: Loaded 8745 primary data records. [2025-10-24T00:54:39.310584] [DEBUG] [LOCAL ] QUAD: Loaded 23146 existing records from primary storage. [2025-10-24T00:54:39.331156] [INFO ] [MAIN ] QUAD: Loaded 23146 primary data records. [2025-10-24T00:54:39.880336] [DEBUG] [MAIN ] QTWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:39.926957] [DEBUG] [MAIN ] QVCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:39.961936] [DEBUG] [MAIN ] QUAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:40.014703] [INFO ] [MAIN ] QTWO: Generated 139 derivative records from 39712 primary records. [2025-10-24T00:54:40.019678] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-24T00:54:40.020022] [FATAL] [LOCAL ] QTWO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:40.021397] [FATAL] [MAIN ] QTWO: Failed to save derivative data. [2025-10-24T00:54:40.023620] [INFO ] [MAIN ] Derivative Progress: 1600/2164 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 47s. Rate: 148.9 symbols/min [2025-10-24T00:54:40.030465] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:40.042099] [INFO ] [MAIN ] QVCC: Generated 139 derivative records from 8745 primary records. [2025-10-24T00:54:40.042748] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-24T00:54:40.043095] [FATAL] [LOCAL ] QVCC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:40.043347] [FATAL] [MAIN ] QVCC: Failed to save derivative data. [2025-10-24T00:54:40.045802] [INFO ] [MAIN ] Derivative Progress: 1601/2164 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 47s. Rate: 149.0 symbols/min [2025-10-24T00:54:40.046472] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:40.051225] [DEBUG] [LOCAL ] QVCD: Loaded 4583 existing records from primary storage. [2025-10-24T00:54:40.051943] [INFO ] [MAIN ] QUAD: Generated 139 derivative records from 23146 primary records. [2025-10-24T00:54:40.052319] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-24T00:54:40.052025] [INFO ] [MAIN ] QVCD: Loaded 4583 primary data records. [2025-10-24T00:54:40.052628] [FATAL] [LOCAL ] QUAD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:40.065571] [FATAL] [MAIN ] QUAD: Failed to save derivative data. [2025-10-24T00:54:40.087232] [INFO ] [MAIN ] Derivative Progress: 1602/2164 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 46s. Rate: 149.1 symbols/min [2025-10-24T00:54:40.092798] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:40.403495] [DEBUG] [LOCAL ] R: Loaded 28186 existing records from primary storage. [2025-10-24T00:54:40.405679] [INFO ] [MAIN ] R: Loaded 28186 primary data records. [2025-10-24T00:54:40.405086] [DEBUG] [LOCAL ] QXO: Loaded 53865 existing records from primary storage. [2025-10-24T00:54:40.412547] [INFO ] [MAIN ] QXO: Loaded 53865 primary data records. [2025-10-24T00:54:41.096025] [DEBUG] [MAIN ] QVCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:41.154279] [DEBUG] [MAIN ] R: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:41.183231] [INFO ] [MAIN ] QVCD: Generated 139 derivative records from 4583 primary records. [2025-10-24T00:54:41.182698] [DEBUG] [MAIN ] QXO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:41.202297] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-24T00:54:41.203111] [FATAL] [LOCAL ] QVCD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:41.206170] [FATAL] [MAIN ] QVCD: Failed to save derivative data. [2025-10-24T00:54:41.210880] [INFO ] [MAIN ] Derivative Progress: 1603/2164 symbols completed. QVCD took 1.2s. Estimated remaining: 3m 46s. Rate: 148.9 symbols/min [2025-10-24T00:54:41.249203] [INFO ] [MAIN ] R: Generated 139 derivative records from 28186 primary records. [2025-10-24T00:54:41.250639] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-24T00:54:41.251089] [FATAL] [LOCAL ] R: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:41.253053] [FATAL] [MAIN ] R: Failed to save derivative data. [2025-10-24T00:54:41.252905] [INFO ] [MAIN ] QXO: Generated 139 derivative records from 53865 primary records. [2025-10-24T00:54:41.255385] [INFO ] [MAIN ] Derivative Progress: 1604/2164 symbols completed. R took 1.2s. Estimated remaining: 3m 46s. Rate: 149.0 symbols/min [2025-10-24T00:54:41.255687] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-24T00:54:41.255927] [FATAL] [LOCAL ] QXO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:41.256007] [FATAL] [MAIN ] QXO: Failed to save derivative data. [2025-10-24T00:54:41.259834] [INFO ] [MAIN ] Derivative Progress: 1605/2164 symbols completed. QXO took 1.2s. Estimated remaining: 3m 45s. Rate: 149.1 symbols/min [2025-10-24T00:54:41.260241] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:41.260393] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:41.260544] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:41.283679] [DEBUG] [LOCAL ] RA: Loaded 22073 existing records from primary storage. [2025-10-24T00:54:41.283850] [INFO ] [MAIN ] RA: Loaded 22073 primary data records. [2025-10-24T00:54:41.477170] [DEBUG] [LOCAL ] RACE: Loaded 33262 existing records from primary storage. [2025-10-24T00:54:41.505308] [INFO ] [MAIN ] RACE: Loaded 33262 primary data records. [2025-10-24T00:54:41.449764] [DEBUG] [LOCAL ] RAMP: Loaded 37923 existing records from primary storage. [2025-10-24T00:54:41.640149] [INFO ] [MAIN ] RAMP: Loaded 37923 primary data records. [2025-10-24T00:54:42.258926] [DEBUG] [MAIN ] RA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:42.301149] [DEBUG] [MAIN ] RACE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:42.332893] [DEBUG] [MAIN ] RAMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:42.388871] [INFO ] [MAIN ] RA: Generated 139 derivative records from 22073 primary records. [2025-10-24T00:54:42.396169] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-24T00:54:42.399870] [FATAL] [LOCAL ] RA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:42.402788] [FATAL] [MAIN ] RA: Failed to save derivative data. [2025-10-24T00:54:42.410265] [INFO ] [MAIN ] Derivative Progress: 1606/2164 symbols completed. RA took 1.1s. Estimated remaining: 3m 45s. Rate: 148.9 symbols/min [2025-10-24T00:54:42.411382] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:42.417043] [INFO ] [MAIN ] RACE: Generated 139 derivative records from 33262 primary records. [2025-10-24T00:54:42.420628] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-24T00:54:42.421817] [FATAL] [LOCAL ] RACE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:42.423411] [FATAL] [MAIN ] RACE: Failed to save derivative data. [2025-10-24T00:54:42.426947] [INFO ] [MAIN ] Derivative Progress: 1607/2164 symbols completed. RACE took 1.2s. Estimated remaining: 3m 44s. Rate: 149.0 symbols/min [2025-10-24T00:54:42.427437] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:42.430144] [INFO ] [MAIN ] RAMP: Generated 139 derivative records from 37923 primary records. [2025-10-24T00:54:42.430765] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-24T00:54:42.431017] [FATAL] [LOCAL ] RAMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:42.431238] [FATAL] [MAIN ] RAMP: Failed to save derivative data. [2025-10-24T00:54:42.435403] [INFO ] [MAIN ] Derivative Progress: 1608/2164 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 44s. Rate: 149.1 symbols/min [2025-10-24T00:54:42.435933] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:42.452378] [DEBUG] [LOCAL ] RBC: Loaded 15417 existing records from primary storage. [2025-10-24T00:54:42.452551] [INFO ] [MAIN ] RBC: Loaded 15417 primary data records. [2025-10-24T00:54:42.597254] [DEBUG] [LOCAL ] RBA: Loaded 46387 existing records from primary storage. [2025-10-24T00:54:42.613240] [INFO ] [MAIN ] RBA: Loaded 46387 primary data records. [2025-10-24T00:54:42.957700] [DEBUG] [LOCAL ] RBLX: Loaded 54107 existing records from primary storage. [2025-10-24T00:54:43.006831] [INFO ] [MAIN ] RBLX: Loaded 54107 primary data records. [2025-10-24T00:54:43.523263] [DEBUG] [MAIN ] RBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:43.559157] [DEBUG] [MAIN ] RBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:43.610700] [DEBUG] [MAIN ] RBLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:43.653526] [INFO ] [MAIN ] RBC: Generated 139 derivative records from 15417 primary records. [2025-10-24T00:54:43.655478] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-24T00:54:43.655830] [FATAL] [LOCAL ] RBC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:43.657571] [FATAL] [MAIN ] RBC: Failed to save derivative data. [2025-10-24T00:54:43.660428] [INFO ] [MAIN ] Derivative Progress: 1609/2164 symbols completed. RBC took 1.2s. Estimated remaining: 3m 44s. Rate: 148.9 symbols/min [2025-10-24T00:54:43.658113] [INFO ] [MAIN ] RBA: Generated 139 derivative records from 46387 primary records. [2025-10-24T00:54:43.663311] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:43.663570] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-24T00:54:43.664536] [FATAL] [LOCAL ] RBA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:43.664736] [FATAL] [MAIN ] RBA: Failed to save derivative data. [2025-10-24T00:54:43.667115] [INFO ] [MAIN ] Derivative Progress: 1610/2164 symbols completed. RBA took 1.3s. Estimated remaining: 3m 43s. Rate: 149.0 symbols/min [2025-10-24T00:54:43.669178] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:43.678255] [INFO ] [MAIN ] RBLX: Generated 139 derivative records from 54107 primary records. [2025-10-24T00:54:43.681562] [DEBUG] [LOCAL ] RBOT: Loaded 6293 existing records from primary storage. [2025-10-24T00:54:43.681636] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-24T00:54:43.682074] [FATAL] [LOCAL ] RBLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:43.682299] [FATAL] [MAIN ] RBLX: Failed to save derivative data. [2025-10-24T00:54:43.682199] [INFO ] [MAIN ] RBOT: Loaded 6293 primary data records. [2025-10-24T00:54:43.685126] [INFO ] [MAIN ] Derivative Progress: 1611/2164 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 43s. Rate: 149.1 symbols/min [2025-10-24T00:54:43.696501] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:44.039186] [DEBUG] [LOCAL ] RBRK: Loaded 53553 existing records from primary storage. [2025-10-24T00:54:44.039685] [INFO ] [MAIN ] RBRK: Loaded 53553 primary data records. [2025-10-24T00:54:44.184348] [DEBUG] [LOCAL ] RC: Loaded 49201 existing records from primary storage. [2025-10-24T00:54:44.220258] [INFO ] [MAIN ] RC: Loaded 49201 primary data records. [2025-10-24T00:54:44.571146] [DEBUG] [MAIN ] RBOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:44.749733] [DEBUG] [MAIN ] RBRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:44.774043] [INFO ] [MAIN ] RBOT: Generated 139 derivative records from 6293 primary records. [2025-10-24T00:54:44.791604] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-24T00:54:44.794115] [FATAL] [LOCAL ] RBOT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:44.793597] [DEBUG] [MAIN ] RC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:44.794586] [FATAL] [MAIN ] RBOT: Failed to save derivative data. [2025-10-24T00:54:44.815028] [INFO ] [MAIN ] Derivative Progress: 1612/2164 symbols completed. RBOT took 1.2s. Estimated remaining: 3m 42s. Rate: 148.9 symbols/min [2025-10-24T00:54:44.818063] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:44.834503] [DEBUG] [LOCAL ] RCD: Loaded 3372 existing records from primary storage. [2025-10-24T00:54:44.840090] [INFO ] [MAIN ] RCD: Loaded 3372 primary data records. [2025-10-24T00:54:44.936777] [INFO ] [MAIN ] RBRK: Generated 139 derivative records from 53553 primary records. [2025-10-24T00:54:44.957934] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-24T00:54:44.986323] [FATAL] [LOCAL ] RBRK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:44.987083] [FATAL] [MAIN ] RBRK: Failed to save derivative data. [2025-10-24T00:54:44.995328] [INFO ] [MAIN ] Derivative Progress: 1613/2164 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 42s. Rate: 149.0 symbols/min [2025-10-24T00:54:45.018409] [INFO ] [MAIN ] RC: Generated 139 derivative records from 49201 primary records. [2025-10-24T00:54:45.007827] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:45.034091] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-24T00:54:45.149913] [FATAL] [LOCAL ] RC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:45.230949] [FATAL] [MAIN ] RC: Failed to save derivative data. [2025-10-24T00:54:45.234117] [INFO ] [MAIN ] Derivative Progress: 1614/2164 symbols completed. RC took 1.5s. Estimated remaining: 3m 41s. Rate: 149.0 symbols/min [2025-10-24T00:54:45.234704] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:45.260892] [DEBUG] [MAIN ] RCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:45.334193] [DEBUG] [LOCAL ] RCI: Loaded 48956 existing records from primary storage. [2025-10-24T00:54:45.353088] [INFO ] [MAIN ] RCI: Loaded 48956 primary data records. [2025-10-24T00:54:45.353838] [DEBUG] [LOCAL ] RCL: Loaded 52040 existing records from primary storage. [2025-10-24T00:54:45.361613] [INFO ] [MAIN ] RCL: Loaded 52040 primary data records. [2025-10-24T00:54:45.382013] [INFO ] [MAIN ] RCD: Generated 139 derivative records from 3372 primary records. [2025-10-24T00:54:45.420584] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-24T00:54:45.458119] [FATAL] [LOCAL ] RCD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:45.464767] [FATAL] [MAIN ] RCD: Failed to save derivative data. [2025-10-24T00:54:45.488791] [INFO ] [MAIN ] Derivative Progress: 1615/2164 symbols completed. RCD took 0.7s. Estimated remaining: 3m 41s. Rate: 149.0 symbols/min [2025-10-24T00:54:45.501128] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:45.806046] [DEBUG] [LOCAL ] RCS: Loaded 12530 existing records from primary storage. [2025-10-24T00:54:45.826682] [INFO ] [MAIN ] RCS: Loaded 12530 primary data records. [2025-10-24T00:54:46.337957] [DEBUG] [MAIN ] RCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:46.343245] [DEBUG] [MAIN ] RCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:46.426503] [DEBUG] [MAIN ] RCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:46.458953] [INFO ] [MAIN ] RCI: Generated 139 derivative records from 48956 primary records. [2025-10-24T00:54:46.462013] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-24T00:54:46.461885] [INFO ] [MAIN ] RCL: Generated 139 derivative records from 52040 primary records. [2025-10-24T00:54:46.465233] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-10-24T00:54:46.467491] [FATAL] [LOCAL ] RCL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:46.467889] [FATAL] [MAIN ] RCL: Failed to save derivative data. [2025-10-24T00:54:46.465684] [FATAL] [LOCAL ] RCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:46.468085] [FATAL] [MAIN ] RCI: Failed to save derivative data. [2025-10-24T00:54:46.470851] [INFO ] [MAIN ] Derivative Progress: 1616/2164 symbols completed. RCI took 1.5s. Estimated remaining: 3m 41s. Rate: 148.9 symbols/min [2025-10-24T00:54:46.473548] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:46.476494] [INFO ] [MAIN ] Derivative Progress: 1617/2164 symbols completed. RCL took 1.2s. Estimated remaining: 3m 40s. Rate: 149.0 symbols/min [2025-10-24T00:54:46.477522] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:46.489785] [INFO ] [MAIN ] RCS: Generated 139 derivative records from 12530 primary records. [2025-10-24T00:54:46.489970] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-24T00:54:46.490157] [FATAL] [LOCAL ] RCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:46.490216] [FATAL] [MAIN ] RCS: Failed to save derivative data. [2025-10-24T00:54:46.492951] [INFO ] [MAIN ] Derivative Progress: 1618/2164 symbols completed. RCS took 1.0s. Estimated remaining: 3m 40s. Rate: 149.1 symbols/min [2025-10-24T00:54:46.537779] [DEBUG] [LOCAL ] RCUS: Loaded 43277 existing records from primary storage. [2025-10-24T00:54:46.538204] [INFO ] [MAIN ] RCUS: Loaded 43277 primary data records. [2025-10-24T00:54:46.661823] [DEBUG] [LOCAL ] RDDT: Loaded 54159 existing records from primary storage. [2025-10-24T00:54:46.667713] [INFO ] [MAIN ] RDDT: Loaded 54159 primary data records. [2025-10-24T00:54:47.185253] [DEBUG] [MAIN ] RCUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:47.219494] [DEBUG] [MAIN ] RDDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:47.263298] [INFO ] [MAIN ] RCUS: Generated 139 derivative records from 43277 primary records. [2025-10-24T00:54:47.264771] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-24T00:54:47.265366] [FATAL] [LOCAL ] RCUS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:47.268342] [FATAL] [MAIN ] RCUS: Failed to save derivative data. [2025-10-24T00:54:47.270267] [INFO ] [MAIN ] Derivative Progress: 1619/2164 symbols completed. RCUS took 0.8s. Estimated remaining: 3m 39s. Rate: 149.0 symbols/min [2025-10-24T00:54:47.273104] [INFO ] [MAIN ] RDDT: Generated 139 derivative records from 54159 primary records. [2025-10-24T00:54:47.273292] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-24T00:54:47.273498] [FATAL] [LOCAL ] RDDT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:47.273576] [FATAL] [MAIN ] RDDT: Failed to save derivative data. [2025-10-24T00:54:47.275629] [INFO ] [MAIN ] Derivative Progress: 1620/2164 symbols completed. RDDT took 0.8s. Estimated remaining: 3m 39s. Rate: 149.1 symbols/min [2025-10-24T00:54:47.276083] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:47.276226] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:47.276331] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:47.339289] [DEBUG] [LOCAL ] RDN: Loaded 44353 existing records from primary storage. [2025-10-24T00:54:47.340022] [INFO ] [MAIN ] RDN: Loaded 44353 primary data records. [2025-10-24T00:54:47.453302] [DEBUG] [LOCAL ] RDY: Loaded 46507 existing records from primary storage. [2025-10-24T00:54:47.470106] [INFO ] [MAIN ] RDY: Loaded 46507 primary data records. [2025-10-24T00:54:47.482632] [DEBUG] [LOCAL ] RDW: Loaded 52676 existing records from primary storage. [2025-10-24T00:54:47.586831] [INFO ] [MAIN ] RDW: Loaded 52676 primary data records. [2025-10-24T00:54:48.312742] [DEBUG] [MAIN ] RDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:48.350371] [DEBUG] [MAIN ] RDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:48.363144] [DEBUG] [MAIN ] RDW: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:48.438631] [INFO ] [MAIN ] RDN: Generated 139 derivative records from 44353 primary records. [2025-10-24T00:54:48.442602] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-24T00:54:48.443581] [FATAL] [LOCAL ] RDN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:48.444196] [FATAL] [MAIN ] RDN: Failed to save derivative data. [2025-10-24T00:54:48.447254] [INFO ] [MAIN ] Derivative Progress: 1621/2164 symbols completed. RDN took 1.2s. Estimated remaining: 3m 39s. Rate: 148.9 symbols/min [2025-10-24T00:54:48.447698] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:48.459311] [INFO ] [MAIN ] RDY: Generated 139 derivative records from 46507 primary records. [2025-10-24T00:54:48.461057] [INFO ] [MAIN ] RDW: Generated 139 derivative records from 52676 primary records. [2025-10-24T00:54:48.461325] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-24T00:54:48.461562] [FATAL] [LOCAL ] RDW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:48.461670] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-24T00:54:48.461913] [FATAL] [LOCAL ] RDY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:48.462005] [FATAL] [MAIN ] RDY: Failed to save derivative data. [2025-10-24T00:54:48.464158] [INFO ] [MAIN ] Derivative Progress: 1622/2164 symbols completed. RDY took 1.2s. Estimated remaining: 3m 38s. Rate: 149.0 symbols/min [2025-10-24T00:54:48.464389] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:48.461722] [FATAL] [MAIN ] RDW: Failed to save derivative data. [2025-10-24T00:54:48.467227] [INFO ] [MAIN ] Derivative Progress: 1623/2164 symbols completed. RDW took 1.2s. Estimated remaining: 3m 38s. Rate: 149.1 symbols/min [2025-10-24T00:54:48.467818] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:48.528558] [DEBUG] [LOCAL ] RELX: Loaded 48903 existing records from primary storage. [2025-10-24T00:54:48.529314] [INFO ] [MAIN ] RELX: Loaded 48903 primary data records. [2025-10-24T00:54:48.554453] [DEBUG] [LOCAL ] RES: Loaded 47208 existing records from primary storage. [2025-10-24T00:54:48.589679] [INFO ] [MAIN ] RES: Loaded 47208 primary data records. [2025-10-24T00:54:48.634955] [DEBUG] [LOCAL ] RERE: Loaded 42083 existing records from primary storage. [2025-10-24T00:54:48.672104] [INFO ] [MAIN ] RERE: Loaded 42083 primary data records. [2025-10-24T00:54:49.566868] [DEBUG] [MAIN ] RERE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:49.568324] [DEBUG] [MAIN ] RELX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:49.611382] [DEBUG] [MAIN ] RES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:49.675539] [INFO ] [MAIN ] RELX: Generated 139 derivative records from 48903 primary records. [2025-10-24T00:54:49.677356] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-24T00:54:49.677947] [FATAL] [LOCAL ] RELX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:49.679705] [FATAL] [MAIN ] RELX: Failed to save derivative data. [2025-10-24T00:54:49.684435] [INFO ] [MAIN ] Derivative Progress: 1624/2164 symbols completed. RELX took 1.2s. Estimated remaining: 3m 38s. Rate: 148.9 symbols/min [2025-10-24T00:54:49.688358] [INFO ] [MAIN ] RERE: Generated 139 derivative records from 42083 primary records. [2025-10-24T00:54:49.684686] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:49.688751] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-24T00:54:49.690935] [FATAL] [LOCAL ] RERE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:49.691751] [FATAL] [MAIN ] RERE: Failed to save derivative data. [2025-10-24T00:54:49.691386] [INFO ] [MAIN ] RES: Generated 139 derivative records from 47208 primary records. [2025-10-24T00:54:49.694212] [INFO ] [MAIN ] Derivative Progress: 1625/2164 symbols completed. RERE took 1.2s. Estimated remaining: 3m 37s. Rate: 149.0 symbols/min [2025-10-24T00:54:49.694542] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:49.694724] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-24T00:54:49.695255] [FATAL] [LOCAL ] RES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:49.695482] [FATAL] [MAIN ] RES: Failed to save derivative data. [2025-10-24T00:54:49.698441] [INFO ] [MAIN ] Derivative Progress: 1626/2164 symbols completed. RES took 1.2s. Estimated remaining: 3m 37s. Rate: 149.1 symbols/min [2025-10-24T00:54:49.698639] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:49.714095] [DEBUG] [LOCAL ] REX: Loaded 14444 existing records from primary storage. [2025-10-24T00:54:49.714306] [INFO ] [MAIN ] REX: Loaded 14444 primary data records. [2025-10-24T00:54:49.867769] [DEBUG] [LOCAL ] REVG: Loaded 40460 existing records from primary storage. [2025-10-24T00:54:49.895005] [INFO ] [MAIN ] REVG: Loaded 40460 primary data records. [2025-10-24T00:54:50.077319] [DEBUG] [LOCAL ] REXR: Loaded 52569 existing records from primary storage. [2025-10-24T00:54:50.099850] [INFO ] [MAIN ] REXR: Loaded 52569 primary data records. [2025-10-24T00:54:50.681588] [DEBUG] [MAIN ] REX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:50.736016] [DEBUG] [MAIN ] REVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:50.774208] [DEBUG] [MAIN ] REXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:50.805537] [INFO ] [MAIN ] REX: Generated 139 derivative records from 14444 primary records. [2025-10-24T00:54:50.806556] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-24T00:54:50.812605] [FATAL] [LOCAL ] REX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:50.816121] [FATAL] [MAIN ] REX: Failed to save derivative data. [2025-10-24T00:54:50.818793] [INFO ] [MAIN ] Derivative Progress: 1627/2164 symbols completed. REX took 1.1s. Estimated remaining: 3m 36s. Rate: 148.9 symbols/min [2025-10-24T00:54:50.819137] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:50.837584] [INFO ] [MAIN ] REVG: Generated 139 derivative records from 40460 primary records. [2025-10-24T00:54:50.841928] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-24T00:54:50.842401] [FATAL] [LOCAL ] REVG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:50.845286] [FATAL] [MAIN ] REVG: Failed to save derivative data. [2025-10-24T00:54:50.847508] [INFO ] [MAIN ] Derivative Progress: 1628/2164 symbols completed. REVG took 1.2s. Estimated remaining: 3m 36s. Rate: 149.0 symbols/min [2025-10-24T00:54:50.847776] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:50.848044] [INFO ] [MAIN ] REXR: Generated 139 derivative records from 52569 primary records. [2025-10-24T00:54:50.848901] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-24T00:54:50.849141] [FATAL] [LOCAL ] REXR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:50.849219] [FATAL] [MAIN ] REXR: Failed to save derivative data. [2025-10-24T00:54:50.851807] [INFO ] [MAIN ] Derivative Progress: 1629/2164 symbols completed. REXR took 1.2s. Estimated remaining: 3m 35s. Rate: 149.1 symbols/min [2025-10-24T00:54:50.852124] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:50.876578] [DEBUG] [LOCAL ] RFI: Loaded 10283 existing records from primary storage. [2025-10-24T00:54:50.876767] [INFO ] [MAIN ] RFI: Loaded 10283 primary data records. [2025-10-24T00:54:50.996479] [DEBUG] [LOCAL ] REZI: Loaded 47445 existing records from primary storage. [2025-10-24T00:54:51.009301] [INFO ] [MAIN ] REZI: Loaded 47445 primary data records. [2025-10-24T00:54:51.200072] [DEBUG] [LOCAL ] RF: Loaded 54023 existing records from primary storage. [2025-10-24T00:54:51.335724] [INFO ] [MAIN ] RF: Loaded 54023 primary data records. [2025-10-24T00:54:51.936083] [DEBUG] [MAIN ] RFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:51.965405] [DEBUG] [MAIN ] REZI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:52.013255] [DEBUG] [MAIN ] RF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:52.069040] [INFO ] [MAIN ] REZI: Generated 139 derivative records from 47445 primary records. [2025-10-24T00:54:52.071246] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-24T00:54:52.071939] [FATAL] [LOCAL ] REZI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:52.072963] [FATAL] [MAIN ] REZI: Failed to save derivative data. [2025-10-24T00:54:52.076558] [INFO ] [MAIN ] Derivative Progress: 1630/2164 symbols completed. REZI took 1.3s. Estimated remaining: 3m 35s. Rate: 148.9 symbols/min [2025-10-24T00:54:52.076889] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:52.080160] [INFO ] [MAIN ] RFI: Generated 139 derivative records from 10283 primary records. [2025-10-24T00:54:52.085492] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-24T00:54:52.089701] [FATAL] [LOCAL ] RFI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:52.090118] [FATAL] [MAIN ] RFI: Failed to save derivative data. [2025-10-24T00:54:52.097453] [INFO ] [MAIN ] Derivative Progress: 1631/2164 symbols completed. RFI took 1.2s. Estimated remaining: 3m 35s. Rate: 149.0 symbols/min [2025-10-24T00:54:52.100064] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:52.100260] [INFO ] [MAIN ] RF: Generated 139 derivative records from 54023 primary records. [2025-10-24T00:54:52.105696] [DEBUG] [LOCAL ] RFL: Loaded 11436 existing records from primary storage. [2025-10-24T00:54:52.105812] [INFO ] [MAIN ] RFL: Loaded 11436 primary data records. [2025-10-24T00:54:52.101297] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-24T00:54:52.117473] [FATAL] [LOCAL ] RF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:52.152846] [FATAL] [MAIN ] RF: Failed to save derivative data. [2025-10-24T00:54:52.178163] [DEBUG] [LOCAL ] RFM: Loaded 4225 existing records from primary storage. [2025-10-24T00:54:52.204752] [INFO ] [MAIN ] Derivative Progress: 1632/2164 symbols completed. RF took 1.4s. Estimated remaining: 3m 34s. Rate: 149.1 symbols/min [2025-10-24T00:54:52.211530] [INFO ] [MAIN ] RFM: Loaded 4225 primary data records. [2025-10-24T00:54:52.222763] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:52.530053] [DEBUG] [LOCAL ] RFMZ: Loaded 9143 existing records from primary storage. [2025-10-24T00:54:52.536573] [INFO ] [MAIN ] RFMZ: Loaded 9143 primary data records. [2025-10-24T00:54:53.081745] [DEBUG] [MAIN ] RFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:53.121459] [DEBUG] [MAIN ] RFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:53.182734] [DEBUG] [MAIN ] RFMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:53.185100] [INFO ] [MAIN ] RFL: Generated 139 derivative records from 11436 primary records. [2025-10-24T00:54:53.197617] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-24T00:54:53.200999] [FATAL] [LOCAL ] RFL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:53.201586] [FATAL] [MAIN ] RFL: Failed to save derivative data. [2025-10-24T00:54:53.210072] [INFO ] [MAIN ] Derivative Progress: 1633/2164 symbols completed. RFL took 1.1s. Estimated remaining: 3m 34s. Rate: 148.9 symbols/min [2025-10-24T00:54:53.217612] [INFO ] [MAIN ] RFM: Generated 139 derivative records from 4225 primary records. [2025-10-24T00:54:53.217801] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-24T00:54:53.218034] [FATAL] [LOCAL ] RFM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:53.218126] [FATAL] [MAIN ] RFM: Failed to save derivative data. [2025-10-24T00:54:53.222471] [INFO ] [MAIN ] Derivative Progress: 1634/2164 symbols completed. RFM took 1.1s. Estimated remaining: 3m 33s. Rate: 149.0 symbols/min [2025-10-24T00:54:53.232819] [INFO ] [MAIN ] RFMZ: Generated 139 derivative records from 9143 primary records. [2025-10-24T00:54:53.232976] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-24T00:54:53.233240] [FATAL] [LOCAL ] RFMZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:53.233355] [FATAL] [MAIN ] RFMZ: Failed to save derivative data. [2025-10-24T00:54:53.235976] [INFO ] [MAIN ] Derivative Progress: 1635/2164 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 33s. Rate: 149.1 symbols/min [2025-10-24T00:54:53.236819] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:53.236606] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:53.236707] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:53.244022] [DEBUG] [LOCAL ] RGT: Loaded 2721 existing records from primary storage. [2025-10-24T00:54:53.244419] [INFO ] [MAIN ] RGT: Loaded 2721 primary data records. [2025-10-24T00:54:53.361023] [DEBUG] [LOCAL ] RGR: Loaded 21085 existing records from primary storage. [2025-10-24T00:54:53.383736] [INFO ] [MAIN ] RGR: Loaded 21085 primary data records. [2025-10-24T00:54:53.915984] [DEBUG] [LOCAL ] RH: Loaded 47408 existing records from primary storage. [2025-10-24T00:54:53.916156] [INFO ] [MAIN ] RH: Loaded 47408 primary data records. [2025-10-24T00:54:54.236677] [DEBUG] [MAIN ] RGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:54.273621] [DEBUG] [MAIN ] RGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:54.327037] [DEBUG] [MAIN ] RH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:54.347313] [INFO ] [MAIN ] RGT: Generated 139 derivative records from 2721 primary records. [2025-10-24T00:54:54.352225] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-24T00:54:54.353540] [FATAL] [LOCAL ] RGT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:54.353865] [FATAL] [MAIN ] RGT: Failed to save derivative data. [2025-10-24T00:54:54.355834] [INFO ] [MAIN ] Derivative Progress: 1636/2164 symbols completed. RGT took 1.1s. Estimated remaining: 3m 33s. Rate: 148.9 symbols/min [2025-10-24T00:54:54.356029] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:54.374128] [INFO ] [MAIN ] RGR: Generated 139 derivative records from 21085 primary records. [2025-10-24T00:54:54.374443] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-24T00:54:54.375986] [FATAL] [LOCAL ] RGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:54.376349] [FATAL] [MAIN ] RGR: Failed to save derivative data. [2025-10-24T00:54:54.382308] [INFO ] [MAIN ] Derivative Progress: 1637/2164 symbols completed. RGR took 1.1s. Estimated remaining: 3m 32s. Rate: 149.0 symbols/min [2025-10-24T00:54:54.383874] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:54.386168] [INFO ] [MAIN ] RH: Generated 139 derivative records from 47408 primary records. [2025-10-24T00:54:54.386632] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-24T00:54:54.386880] [FATAL] [LOCAL ] RH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:54.387061] [FATAL] [MAIN ] RH: Failed to save derivative data. [2025-10-24T00:54:54.389584] [INFO ] [MAIN ] Derivative Progress: 1638/2164 symbols completed. RH took 1.2s. Estimated remaining: 3m 32s. Rate: 149.1 symbols/min [2025-10-24T00:54:54.390327] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:54.422722] [DEBUG] [LOCAL ] RHI: Loaded 50078 existing records from primary storage. [2025-10-24T00:54:54.422996] [INFO ] [MAIN ] RHI: Loaded 50078 primary data records. [2025-10-24T00:54:54.751771] [DEBUG] [LOCAL ] RHP: Loaded 40539 existing records from primary storage. [2025-10-24T00:54:54.752387] [INFO ] [MAIN ] RHP: Loaded 40539 primary data records. [2025-10-24T00:54:54.812610] [DEBUG] [LOCAL ] RIG: Loaded 54065 existing records from primary storage. [2025-10-24T00:54:54.854182] [INFO ] [MAIN ] RIG: Loaded 54065 primary data records. [2025-10-24T00:54:55.457449] [DEBUG] [MAIN ] RHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:55.494235] [DEBUG] [MAIN ] RHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:55.543148] [DEBUG] [MAIN ] RIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:55.578333] [INFO ] [MAIN ] RHI: Generated 139 derivative records from 50078 primary records. [2025-10-24T00:54:55.580086] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-24T00:54:55.580459] [FATAL] [LOCAL ] RHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:55.583561] [FATAL] [MAIN ] RHI: Failed to save derivative data. [2025-10-24T00:54:55.586141] [INFO ] [MAIN ] Derivative Progress: 1639/2164 symbols completed. RHI took 1.2s. Estimated remaining: 3m 32s. Rate: 148.9 symbols/min [2025-10-24T00:54:55.590437] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:55.594689] [INFO ] [MAIN ] RHP: Generated 139 derivative records from 40539 primary records. [2025-10-24T00:54:55.595167] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-24T00:54:55.595543] [FATAL] [LOCAL ] RHP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:55.599762] [FATAL] [MAIN ] RHP: Failed to save derivative data. [2025-10-24T00:54:55.603246] [INFO ] [MAIN ] Derivative Progress: 1640/2164 symbols completed. RHP took 1.2s. Estimated remaining: 3m 31s. Rate: 149.0 symbols/min [2025-10-24T00:54:55.604290] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:55.612207] [INFO ] [MAIN ] RIG: Generated 139 derivative records from 54065 primary records. [2025-10-24T00:54:55.612466] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-24T00:54:55.612893] [FATAL] [LOCAL ] RIG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:55.612999] [FATAL] [MAIN ] RIG: Failed to save derivative data. [2025-10-24T00:54:55.615799] [INFO ] [MAIN ] Derivative Progress: 1641/2164 symbols completed. RIG took 1.2s. Estimated remaining: 3m 30s. Rate: 149.1 symbols/min [2025-10-24T00:54:55.616013] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:55.658103] [DEBUG] [LOCAL ] RIV: Loaded 12714 existing records from primary storage. [2025-10-24T00:54:55.659044] [INFO ] [MAIN ] RIV: Loaded 12714 primary data records. [2025-10-24T00:54:55.727329] [DEBUG] [LOCAL ] RIO: Loaded 53792 existing records from primary storage. [2025-10-24T00:54:55.727713] [INFO ] [MAIN ] RIO: Loaded 53792 primary data records. [2025-10-24T00:54:55.856925] [DEBUG] [LOCAL ] RITM: Loaded 53334 existing records from primary storage. [2025-10-24T00:54:55.962727] [INFO ] [MAIN ] RITM: Loaded 53334 primary data records. [2025-10-24T00:54:56.648606] [DEBUG] [MAIN ] RIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:56.683333] [DEBUG] [MAIN ] RIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:56.729912] [DEBUG] [MAIN ] RITM: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:54:56.766394] [INFO ] [MAIN ] RIV: Generated 139 derivative records from 12714 primary records. [2025-10-24T00:54:56.768944] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-24T00:54:56.770077] [FATAL] [LOCAL ] RIV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:56.776022] [FATAL] [MAIN ] RIV: Failed to save derivative data. [2025-10-24T00:54:56.778377] [INFO ] [MAIN ] Derivative Progress: 1642/2164 symbols completed. RIV took 1.2s. Estimated remaining: 3m 30s. Rate: 148.9 symbols/min [2025-10-24T00:54:56.780210] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:56.787285] [INFO ] [MAIN ] RIO: Generated 139 derivative records from 53792 primary records. [2025-10-24T00:54:56.787625] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-24T00:54:56.788088] [FATAL] [LOCAL ] RIO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:56.788186] [FATAL] [MAIN ] RIO: Failed to save derivative data. [2025-10-24T00:54:56.794137] [INFO ] [MAIN ] Derivative Progress: 1643/2164 symbols completed. RIO took 1.2s. Estimated remaining: 3m 30s. Rate: 149.0 symbols/min [2025-10-24T00:54:56.794798] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:56.798699] [INFO ] [MAIN ] RITM: Generated 139 derivative records from 53334 primary records. [2025-10-24T00:54:56.798960] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-24T00:54:56.799174] [FATAL] [LOCAL ] RITM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:56.799257] [FATAL] [MAIN ] RITM: Failed to save derivative data. [2025-10-24T00:54:56.802157] [INFO ] [MAIN ] Derivative Progress: 1644/2164 symbols completed. RITM took 1.2s. Estimated remaining: 3m 29s. Rate: 149.1 symbols/min [2025-10-24T00:54:56.802439] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:56.861320] [DEBUG] [LOCAL ] RJF: Loaded 46930 existing records from primary storage. [2025-10-24T00:54:56.861716] [INFO ] [MAIN ] RJF: Loaded 46930 primary data records. [2025-10-24T00:54:56.992355] [DEBUG] [LOCAL ] RKT: Loaded 54119 existing records from primary storage. [2025-10-24T00:54:57.031273] [DEBUG] [LOCAL ] RL: Loaded 39534 existing records from primary storage. [2025-10-24T00:54:57.031491] [INFO ] [MAIN ] RKT: Loaded 54119 primary data records. [2025-10-24T00:54:57.040172] [INFO ] [MAIN ] RL: Loaded 39534 primary data records. [2025-10-24T00:54:57.851123] [DEBUG] [MAIN ] RJF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:57.904200] [DEBUG] [MAIN ] RL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:57.916573] [DEBUG] [MAIN ] RKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:57.957617] [INFO ] [MAIN ] RJF: Generated 139 derivative records from 46930 primary records. [2025-10-24T00:54:57.959536] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-24T00:54:57.960031] [FATAL] [LOCAL ] RJF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:57.960196] [FATAL] [MAIN ] RJF: Failed to save derivative data. [2025-10-24T00:54:57.963050] [INFO ] [MAIN ] Derivative Progress: 1645/2164 symbols completed. RJF took 1.2s. Estimated remaining: 3m 29s. Rate: 148.9 symbols/min [2025-10-24T00:54:57.968451] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:57.986633] [INFO ] [MAIN ] RKT: Generated 139 derivative records from 54119 primary records. [2025-10-24T00:54:57.988192] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-24T00:54:57.991078] [INFO ] [MAIN ] RL: Generated 139 derivative records from 39534 primary records. [2025-10-24T00:54:57.990529] [FATAL] [LOCAL ] RKT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:57.991236] [FATAL] [MAIN ] RKT: Failed to save derivative data. [2025-10-24T00:54:57.991377] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-24T00:54:57.994308] [INFO ] [MAIN ] Derivative Progress: 1646/2164 symbols completed. RKT took 1.2s. Estimated remaining: 3m 29s. Rate: 149.0 symbols/min [2025-10-24T00:54:57.991581] [FATAL] [LOCAL ] RL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:57.994758] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:57.994637] [FATAL] [MAIN ] RL: Failed to save derivative data. [2025-10-24T00:54:57.999020] [INFO ] [MAIN ] Derivative Progress: 1647/2164 symbols completed. RL took 1.2s. Estimated remaining: 3m 28s. Rate: 149.1 symbols/min [2025-10-24T00:54:57.999398] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:58.027763] [DEBUG] [LOCAL ] RLI: Loaded 34958 existing records from primary storage. [2025-10-24T00:54:58.028212] [INFO ] [MAIN ] RLI: Loaded 34958 primary data records. [2025-10-24T00:54:58.075749] [DEBUG] [LOCAL ] RLTY: Loaded 11046 existing records from primary storage. [2025-10-24T00:54:58.144765] [INFO ] [MAIN ] RLTY: Loaded 11046 primary data records. [2025-10-24T00:54:58.453289] [DEBUG] [LOCAL ] RLJ: Loaded 48283 existing records from primary storage. [2025-10-24T00:54:58.453556] [INFO ] [MAIN ] RLJ: Loaded 48283 primary data records. [2025-10-24T00:54:58.961819] [DEBUG] [MAIN ] RLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:59.004790] [DEBUG] [MAIN ] RLTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:59.041170] [DEBUG] [MAIN ] RLJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:54:59.067089] [INFO ] [MAIN ] RLI: Generated 139 derivative records from 34958 primary records. [2025-10-24T00:54:59.069045] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-24T00:54:59.074420] [FATAL] [LOCAL ] RLI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:59.074981] [FATAL] [MAIN ] RLI: Failed to save derivative data. [2025-10-24T00:54:59.077369] [INFO ] [MAIN ] Derivative Progress: 1648/2164 symbols completed. RLI took 1.1s. Estimated remaining: 3m 28s. Rate: 149.0 symbols/min [2025-10-24T00:54:59.100964] [INFO ] [MAIN ] RLTY: Generated 139 derivative records from 11046 primary records. [2025-10-24T00:54:59.102477] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-24T00:54:59.102949] [FATAL] [LOCAL ] RLTY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:59.104579] [FATAL] [MAIN ] RLTY: Failed to save derivative data. [2025-10-24T00:54:59.106843] [INFO ] [MAIN ] Derivative Progress: 1649/2164 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 27s. Rate: 149.0 symbols/min [2025-10-24T00:54:59.107112] [INFO ] [MAIN ] RLJ: Generated 139 derivative records from 48283 primary records. [2025-10-24T00:54:59.107419] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-24T00:54:59.107638] [FATAL] [LOCAL ] RLJ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:54:59.107768] [FATAL] [MAIN ] RLJ: Failed to save derivative data. [2025-10-24T00:54:59.110508] [INFO ] [MAIN ] Derivative Progress: 1650/2164 symbols completed. RLJ took 1.1s. Estimated remaining: 3m 27s. Rate: 149.1 symbols/min [2025-10-24T00:54:59.111041] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:59.110928] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:59.111168] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:54:59.123858] [DEBUG] [LOCAL ] RM: Loaded 7531 existing records from primary storage. [2025-10-24T00:54:59.124068] [INFO ] [MAIN ] RM: Loaded 7531 primary data records. [2025-10-24T00:54:59.255267] [DEBUG] [LOCAL ] RMAX: Loaded 21748 existing records from primary storage. [2025-10-24T00:54:59.266433] [INFO ] [MAIN ] RMAX: Loaded 21748 primary data records. [2025-10-24T00:54:59.538950] [DEBUG] [LOCAL ] RLX: Loaded 48484 existing records from primary storage. [2025-10-24T00:54:59.597403] [INFO ] [MAIN ] RLX: Loaded 48484 primary data records. [2025-10-24T00:55:00.107966] [DEBUG] [MAIN ] RM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:00.144263] [DEBUG] [MAIN ] RMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:00.194279] [DEBUG] [MAIN ] RLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:00.220914] [INFO ] [MAIN ] RM: Generated 139 derivative records from 7531 primary records. [2025-10-24T00:55:00.224877] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-24T00:55:00.225392] [FATAL] [LOCAL ] RM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:00.226761] [FATAL] [MAIN ] RM: Failed to save derivative data. [2025-10-24T00:55:00.231833] [INFO ] [MAIN ] Derivative Progress: 1651/2164 symbols completed. RM took 1.1s. Estimated remaining: 3m 27s. Rate: 149.0 symbols/min [2025-10-24T00:55:00.235608] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:00.240026] [INFO ] [MAIN ] RMAX: Generated 139 derivative records from 21748 primary records. [2025-10-24T00:55:00.242750] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-24T00:55:00.243040] [FATAL] [LOCAL ] RMAX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:00.243308] [FATAL] [MAIN ] RMAX: Failed to save derivative data. [2025-10-24T00:55:00.245782] [INFO ] [MAIN ] Derivative Progress: 1652/2164 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 26s. Rate: 149.1 symbols/min [2025-10-24T00:55:00.246320] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:00.255583] [INFO ] [MAIN ] RLX: Generated 139 derivative records from 48484 primary records. [2025-10-24T00:55:00.255789] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-24T00:55:00.256019] [FATAL] [LOCAL ] RLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:00.258565] [FATAL] [MAIN ] RLX: Failed to save derivative data. [2025-10-24T00:55:00.261277] [INFO ] [MAIN ] Derivative Progress: 1653/2164 symbols completed. RLX took 1.2s. Estimated remaining: 3m 26s. Rate: 149.1 symbols/min [2025-10-24T00:55:00.261514] [DEBUG] [LOCAL ] RMI: Loaded 4826 existing records from primary storage. [2025-10-24T00:55:00.261800] [INFO ] [MAIN ] RMI: Loaded 4826 primary data records. [2025-10-24T00:55:00.261933] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:00.438297] [DEBUG] [LOCAL ] RMM: Loaded 11008 existing records from primary storage. [2025-10-24T00:55:00.467696] [INFO ] [MAIN ] RMM: Loaded 11008 primary data records. [2025-10-24T00:55:00.469015] [DEBUG] [LOCAL ] RMD: Loaded 42165 existing records from primary storage. [2025-10-24T00:55:00.646992] [INFO ] [MAIN ] RMD: Loaded 42165 primary data records. [2025-10-24T00:55:01.266558] [DEBUG] [MAIN ] RMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:01.300357] [DEBUG] [MAIN ] RMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:01.357162] [DEBUG] [MAIN ] RMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:01.390354] [INFO ] [MAIN ] RMI: Generated 139 derivative records from 4826 primary records. [2025-10-24T00:55:01.393136] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-24T00:55:01.396039] [FATAL] [LOCAL ] RMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:01.396256] [FATAL] [MAIN ] RMI: Failed to save derivative data. [2025-10-24T00:55:01.400517] [INFO ] [MAIN ] Derivative Progress: 1654/2164 symbols completed. RMI took 1.2s. Estimated remaining: 3m 25s. Rate: 149.0 symbols/min [2025-10-24T00:55:01.401323] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:01.405459] [INFO ] [MAIN ] RMM: Generated 139 derivative records from 11008 primary records. [2025-10-24T00:55:01.405748] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-24T00:55:01.406046] [FATAL] [LOCAL ] RMM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:01.406412] [FATAL] [MAIN ] RMM: Failed to save derivative data. [2025-10-24T00:55:01.409635] [INFO ] [MAIN ] Derivative Progress: 1655/2164 symbols completed. RMM took 1.1s. Estimated remaining: 3m 25s. Rate: 149.1 symbols/min [2025-10-24T00:55:01.410012] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:01.423069] [DEBUG] [LOCAL ] RMMZ: Loaded 4821 existing records from primary storage. [2025-10-24T00:55:01.423417] [INFO ] [MAIN ] RMMZ: Loaded 4821 primary data records. [2025-10-24T00:55:01.445511] [INFO ] [MAIN ] RMD: Generated 139 derivative records from 42165 primary records. [2025-10-24T00:55:01.473331] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-24T00:55:01.527541] [FATAL] [LOCAL ] RMD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:01.539671] [DEBUG] [LOCAL ] RMT: Loaded 17211 existing records from primary storage. [2025-10-24T00:55:01.539775] [FATAL] [MAIN ] RMD: Failed to save derivative data. [2025-10-24T00:55:01.539871] [INFO ] [MAIN ] RMT: Loaded 17211 primary data records. [2025-10-24T00:55:01.542922] [INFO ] [MAIN ] Derivative Progress: 1656/2164 symbols completed. RMD took 1.3s. Estimated remaining: 3m 24s. Rate: 149.1 symbols/min [2025-10-24T00:55:01.553879] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:02.081530] [DEBUG] [LOCAL ] RNG: Loaded 48318 existing records from primary storage. [2025-10-24T00:55:02.082098] [INFO ] [MAIN ] RNG: Loaded 48318 primary data records. [2025-10-24T00:55:02.136622] [DEBUG] [MAIN ] RMMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:02.241011] [DEBUG] [MAIN ] RMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:02.498617] [INFO ] [MAIN ] RMMZ: Generated 139 derivative records from 4821 primary records. [2025-10-24T00:55:02.501099] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-24T00:55:02.501352] [FATAL] [LOCAL ] RMMZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:02.503724] [INFO ] [MAIN ] RMT: Generated 139 derivative records from 17211 primary records. [2025-10-24T00:55:02.501450] [FATAL] [MAIN ] RMMZ: Failed to save derivative data. [2025-10-24T00:55:02.503897] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-24T00:55:02.506411] [INFO ] [MAIN ] Derivative Progress: 1657/2164 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 24s. Rate: 149.0 symbols/min [2025-10-24T00:55:02.506737] [FATAL] [LOCAL ] RMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:02.506864] [FATAL] [MAIN ] RMT: Failed to save derivative data. [2025-10-24T00:55:02.509821] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:02.510116] [INFO ] [MAIN ] Derivative Progress: 1658/2164 symbols completed. RMT took 1.1s. Estimated remaining: 3m 24s. Rate: 149.1 symbols/min [2025-10-24T00:55:02.510551] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:02.527761] [DEBUG] [MAIN ] RNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:02.566167] [DEBUG] [LOCAL ] RNP: Loaded 16013 existing records from primary storage. [2025-10-24T00:55:02.572905] [DEBUG] [LOCAL ] RNGR: Loaded 20837 existing records from primary storage. [2025-10-24T00:55:02.574242] [INFO ] [MAIN ] RNGR: Loaded 20837 primary data records. [2025-10-24T00:55:02.574099] [INFO ] [MAIN ] RNP: Loaded 16013 primary data records. [2025-10-24T00:55:02.787702] [INFO ] [MAIN ] RNG: Generated 139 derivative records from 48318 primary records. [2025-10-24T00:55:02.839414] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-24T00:55:02.839834] [FATAL] [LOCAL ] RNG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:02.872611] [FATAL] [MAIN ] RNG: Failed to save derivative data. [2025-10-24T00:55:02.913910] [INFO ] [MAIN ] Derivative Progress: 1659/2164 symbols completed. RNG took 1.4s. Estimated remaining: 3m 23s. Rate: 149.1 symbols/min [2025-10-24T00:55:03.174110] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:03.238543] [DEBUG] [MAIN ] RNGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:03.238868] [DEBUG] [MAIN ] RNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:03.322252] [DEBUG] [LOCAL ] RNR: Loaded 33749 existing records from primary storage. [2025-10-24T00:55:03.324765] [INFO ] [MAIN ] RNR: Loaded 33749 primary data records. [2025-10-24T00:55:03.668637] [INFO ] [MAIN ] RNGR: Generated 139 derivative records from 20837 primary records. [2025-10-24T00:55:03.670259] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-24T00:55:03.670680] [FATAL] [LOCAL ] RNGR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:03.673395] [INFO ] [MAIN ] RNP: Generated 139 derivative records from 16013 primary records. [2025-10-24T00:55:03.673677] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-24T00:55:03.673593] [FATAL] [MAIN ] RNGR: Failed to save derivative data. [2025-10-24T00:55:03.674743] [FATAL] [LOCAL ] RNP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:03.677066] [INFO ] [MAIN ] Derivative Progress: 1660/2164 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 23s. Rate: 149.0 symbols/min [2025-10-24T00:55:03.677778] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:03.677697] [FATAL] [MAIN ] RNP: Failed to save derivative data. [2025-10-24T00:55:03.681371] [INFO ] [MAIN ] Derivative Progress: 1661/2164 symbols completed. RNP took 1.2s. Estimated remaining: 3m 22s. Rate: 149.1 symbols/min [2025-10-24T00:55:03.681820] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:03.710794] [DEBUG] [MAIN ] RNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:03.742598] [DEBUG] [LOCAL ] ROG: Loaded 21699 existing records from primary storage. [2025-10-24T00:55:03.743872] [INFO ] [MAIN ] ROG: Loaded 21699 primary data records. [2025-10-24T00:55:03.793810] [DEBUG] [LOCAL ] RNST: Loaded 36124 existing records from primary storage. [2025-10-24T00:55:03.852335] [INFO ] [MAIN ] RNST: Loaded 36124 primary data records. [2025-10-24T00:55:04.437520] [INFO ] [MAIN ] RNR: Generated 139 derivative records from 33749 primary records. [2025-10-24T00:55:04.441237] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-24T00:55:04.442998] [FATAL] [LOCAL ] RNR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:04.443959] [FATAL] [MAIN ] RNR: Failed to save derivative data. [2025-10-24T00:55:04.450532] [INFO ] [MAIN ] Derivative Progress: 1662/2164 symbols completed. RNR took 1.3s. Estimated remaining: 3m 22s. Rate: 149.0 symbols/min [2025-10-24T00:55:04.451007] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:04.479843] [DEBUG] [MAIN ] ROG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:04.512018] [DEBUG] [MAIN ] RNST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:04.566037] [DEBUG] [LOCAL ] ROK: Loaded 43027 existing records from primary storage. [2025-10-24T00:55:04.572435] [INFO ] [MAIN ] ROK: Loaded 43027 primary data records. [2025-10-24T00:55:04.938230] [INFO ] [MAIN ] ROG: Generated 139 derivative records from 21699 primary records. [2025-10-24T00:55:04.941675] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-24T00:55:04.945276] [FATAL] [LOCAL ] ROG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:04.946026] [FATAL] [MAIN ] ROG: Failed to save derivative data. [2025-10-24T00:55:04.949292] [INFO ] [MAIN ] Derivative Progress: 1663/2164 symbols completed. ROG took 1.3s. Estimated remaining: 3m 22s. Rate: 149.0 symbols/min [2025-10-24T00:55:04.953203] [INFO ] [MAIN ] RNST: Generated 139 derivative records from 36124 primary records. [2025-10-24T00:55:04.954112] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-24T00:55:04.954700] [FATAL] [LOCAL ] RNST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:04.955330] [FATAL] [MAIN ] RNST: Failed to save derivative data. [2025-10-24T00:55:04.958242] [INFO ] [MAIN ] Derivative Progress: 1664/2164 symbols completed. RNST took 1.3s. Estimated remaining: 3m 21s. Rate: 149.1 symbols/min [2025-10-24T00:55:04.979869] [DEBUG] [MAIN ] ROK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:05.011106] [INFO ] [MAIN ] ROK: Generated 139 derivative records from 43027 primary records. [2025-10-24T00:55:05.011345] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-24T00:55:05.011573] [FATAL] [LOCAL ] ROK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:05.011682] [FATAL] [MAIN ] ROK: Failed to save derivative data. [2025-10-24T00:55:05.014578] [INFO ] [MAIN ] Derivative Progress: 1665/2164 symbols completed. ROK took 0.6s. Estimated remaining: 3m 21s. Rate: 149.2 symbols/min [2025-10-24T00:55:05.015182] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:05.015755] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:05.015373] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:05.065389] [DEBUG] [LOCAL ] RPT: Loaded 19086 existing records from primary storage. [2025-10-24T00:55:05.065615] [INFO ] [MAIN ] RPT: Loaded 19086 primary data records. [2025-10-24T00:55:05.199507] [DEBUG] [LOCAL ] ROL: Loaded 50634 existing records from primary storage. [2025-10-24T00:55:05.222203] [DEBUG] [LOCAL ] RPM: Loaded 42318 existing records from primary storage. [2025-10-24T00:55:05.274406] [INFO ] [MAIN ] RPM: Loaded 42318 primary data records. [2025-10-24T00:55:05.227495] [INFO ] [MAIN ] ROL: Loaded 50634 primary data records. [2025-10-24T00:55:06.119431] [DEBUG] [MAIN ] RPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:06.158365] [DEBUG] [MAIN ] RPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:06.198082] [DEBUG] [MAIN ] ROL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:06.253126] [INFO ] [MAIN ] RPT: Generated 139 derivative records from 19086 primary records. [2025-10-24T00:55:06.259258] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-24T00:55:06.260365] [FATAL] [LOCAL ] RPT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:06.260623] [FATAL] [MAIN ] RPT: Failed to save derivative data. [2025-10-24T00:55:06.262800] [INFO ] [MAIN ] Derivative Progress: 1666/2164 symbols completed. RPT took 1.2s. Estimated remaining: 3m 21s. Rate: 149.0 symbols/min [2025-10-24T00:55:06.264389] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:06.269186] [INFO ] [MAIN ] RPM: Generated 139 derivative records from 42318 primary records. [2025-10-24T00:55:06.272281] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-24T00:55:06.272940] [FATAL] [LOCAL ] RPM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:06.273266] [FATAL] [MAIN ] RPM: Failed to save derivative data. [2025-10-24T00:55:06.277239] [INFO ] [MAIN ] Derivative Progress: 1667/2164 symbols completed. RPM took 1.3s. Estimated remaining: 3m 20s. Rate: 149.1 symbols/min [2025-10-24T00:55:06.277489] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:06.284733] [INFO ] [MAIN ] ROL: Generated 139 derivative records from 50634 primary records. [2025-10-24T00:55:06.285810] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-24T00:55:06.286066] [FATAL] [LOCAL ] ROL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:06.286152] [FATAL] [MAIN ] ROL: Failed to save derivative data. [2025-10-24T00:55:06.289250] [INFO ] [MAIN ] Derivative Progress: 1668/2164 symbols completed. ROL took 1.3s. Estimated remaining: 3m 20s. Rate: 149.1 symbols/min [2025-10-24T00:55:06.289588] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:06.315368] [DEBUG] [LOCAL ] RQI: Loaded 28922 existing records from primary storage. [2025-10-24T00:55:06.315774] [INFO ] [MAIN ] RQI: Loaded 28922 primary data records. [2025-10-24T00:55:06.533861] [DEBUG] [LOCAL ] RRX: Loaded 41001 existing records from primary storage. [2025-10-24T00:55:06.557030] [DEBUG] [LOCAL ] RRC: Loaded 53305 existing records from primary storage. [2025-10-24T00:55:06.674965] [INFO ] [MAIN ] RRX: Loaded 41001 primary data records. [2025-10-24T00:55:06.674871] [INFO ] [MAIN ] RRC: Loaded 53305 primary data records. [2025-10-24T00:55:07.350450] [DEBUG] [MAIN ] RQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:07.392282] [DEBUG] [MAIN ] RRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:07.442995] [DEBUG] [MAIN ] RRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:07.469490] [INFO ] [MAIN ] RQI: Generated 139 derivative records from 28922 primary records. [2025-10-24T00:55:07.473270] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-24T00:55:07.474286] [FATAL] [LOCAL ] RQI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:07.478111] [FATAL] [MAIN ] RQI: Failed to save derivative data. [2025-10-24T00:55:07.480097] [INFO ] [MAIN ] Derivative Progress: 1669/2164 symbols completed. RQI took 1.2s. Estimated remaining: 3m 19s. Rate: 149.0 symbols/min [2025-10-24T00:55:07.480328] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:07.515705] [INFO ] [MAIN ] RRX: Generated 139 derivative records from 41001 primary records. [2025-10-24T00:55:07.517446] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-24T00:55:07.526312] [FATAL] [LOCAL ] RRX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:07.526879] [DEBUG] [LOCAL ] RS: Loaded 24797 existing records from primary storage. [2025-10-24T00:55:07.527470] [INFO ] [MAIN ] RS: Loaded 24797 primary data records. [2025-10-24T00:55:07.560733] [INFO ] [MAIN ] RRC: Generated 139 derivative records from 53305 primary records. [2025-10-24T00:55:07.560139] [FATAL] [MAIN ] RRX: Failed to save derivative data. [2025-10-24T00:55:07.560887] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-24T00:55:07.577085] [INFO ] [MAIN ] Derivative Progress: 1670/2164 symbols completed. RRX took 1.3s. Estimated remaining: 3m 19s. Rate: 149.0 symbols/min [2025-10-24T00:55:07.589756] [FATAL] [LOCAL ] RRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:07.589464] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:07.615329] [FATAL] [MAIN ] RRC: Failed to save derivative data. [2025-10-24T00:55:07.623684] [INFO ] [MAIN ] Derivative Progress: 1671/2164 symbols completed. RRC took 1.3s. Estimated remaining: 3m 18s. Rate: 149.1 symbols/min [2025-10-24T00:55:07.639255] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:07.689248] [DEBUG] [LOCAL ] RSF: Loaded 4278 existing records from primary storage. [2025-10-24T00:55:07.853746] [INFO ] [MAIN ] RSF: Loaded 4278 primary data records. [2025-10-24T00:55:08.101474] [DEBUG] [LOCAL ] RSG: Loaded 47641 existing records from primary storage. [2025-10-24T00:55:08.193741] [INFO ] [MAIN ] RSG: Loaded 47641 primary data records. [2025-10-24T00:55:08.329171] [DEBUG] [MAIN ] RS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:08.564085] [DEBUG] [MAIN ] RSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:08.592419] [INFO ] [MAIN ] RS: Generated 139 derivative records from 24797 primary records. [2025-10-24T00:55:08.595524] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-24T00:55:08.596924] [FATAL] [LOCAL ] RS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:08.597783] [FATAL] [MAIN ] RS: Failed to save derivative data. [2025-10-24T00:55:08.616232] [INFO ] [MAIN ] Derivative Progress: 1672/2164 symbols completed. RS took 1.1s. Estimated remaining: 3m 18s. Rate: 149.0 symbols/min [2025-10-24T00:55:08.616825] [DEBUG] [MAIN ] RSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:08.617052] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:08.660137] [INFO ] [MAIN ] RSF: Generated 139 derivative records from 4278 primary records. [2025-10-24T00:55:08.662489] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-24T00:55:08.663485] [FATAL] [LOCAL ] RSF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:08.665125] [FATAL] [MAIN ] RSF: Failed to save derivative data. [2025-10-24T00:55:08.667976] [INFO ] [MAIN ] Derivative Progress: 1673/2164 symbols completed. RSF took 1.1s. Estimated remaining: 3m 18s. Rate: 149.1 symbols/min [2025-10-24T00:55:08.678515] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:08.685727] [INFO ] [MAIN ] RSG: Generated 139 derivative records from 47641 primary records. [2025-10-24T00:55:08.685914] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-24T00:55:08.686132] [FATAL] [LOCAL ] RSG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:08.686284] [FATAL] [MAIN ] RSG: Failed to save derivative data. [2025-10-24T00:55:08.689322] [INFO ] [MAIN ] Derivative Progress: 1674/2164 symbols completed. RSG took 1.1s. Estimated remaining: 3m 17s. Rate: 149.1 symbols/min [2025-10-24T00:55:08.689574] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:08.708097] [DEBUG] [LOCAL ] RSI: Loaded 47344 existing records from primary storage. [2025-10-24T00:55:08.708402] [INFO ] [MAIN ] RSI: Loaded 47344 primary data records. [2025-10-24T00:55:08.836829] [DEBUG] [LOCAL ] RSKD: Loaded 33437 existing records from primary storage. [2025-10-24T00:55:08.837710] [INFO ] [MAIN ] RSKD: Loaded 33437 primary data records. [2025-10-24T00:55:09.173056] [DEBUG] [LOCAL ] RTO: Loaded 40099 existing records from primary storage. [2025-10-24T00:55:09.184636] [INFO ] [MAIN ] RTO: Loaded 40099 primary data records. [2025-10-24T00:55:09.740070] [DEBUG] [MAIN ] RSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:09.781034] [DEBUG] [MAIN ] RSKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:09.834439] [DEBUG] [MAIN ] RTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:09.872346] [INFO ] [MAIN ] RSI: Generated 139 derivative records from 47344 primary records. [2025-10-24T00:55:09.875424] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-24T00:55:09.878694] [FATAL] [LOCAL ] RSI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:09.879057] [FATAL] [MAIN ] RSI: Failed to save derivative data. [2025-10-24T00:55:09.883326] [INFO ] [MAIN ] Derivative Progress: 1675/2164 symbols completed. RSI took 1.3s. Estimated remaining: 3m 17s. Rate: 149.0 symbols/min [2025-10-24T00:55:09.884307] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:09.889228] [INFO ] [MAIN ] RSKD: Generated 139 derivative records from 33437 primary records. [2025-10-24T00:55:09.890490] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-24T00:55:09.890740] [FATAL] [LOCAL ] RSKD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:09.893412] [FATAL] [MAIN ] RSKD: Failed to save derivative data. [2025-10-24T00:55:09.896516] [INFO ] [MAIN ] Derivative Progress: 1676/2164 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 16s. Rate: 149.1 symbols/min [2025-10-24T00:55:09.897778] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:09.906060] [INFO ] [MAIN ] RTO: Generated 139 derivative records from 40099 primary records. [2025-10-24T00:55:09.906330] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-24T00:55:09.906553] [FATAL] [LOCAL ] RTO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:09.906631] [FATAL] [MAIN ] RTO: Failed to save derivative data. [2025-10-24T00:55:09.909517] [INFO ] [MAIN ] Derivative Progress: 1677/2164 symbols completed. RTO took 1.2s. Estimated remaining: 3m 16s. Rate: 149.1 symbols/min [2025-10-24T00:55:09.909730] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:09.962132] [DEBUG] [LOCAL ] RVT: Loaded 26270 existing records from primary storage. [2025-10-24T00:55:09.963507] [INFO ] [MAIN ] RVT: Loaded 26270 primary data records. [2025-10-24T00:55:10.032786] [DEBUG] [LOCAL ] RTX: Loaded 54096 existing records from primary storage. [2025-10-24T00:55:10.053304] [INFO ] [MAIN ] RTX: Loaded 54096 primary data records. [2025-10-24T00:55:10.041019] [DEBUG] [LOCAL ] RVLV: Loaded 47671 existing records from primary storage. [2025-10-24T00:55:10.053477] [INFO ] [MAIN ] RVLV: Loaded 47671 primary data records. [2025-10-24T00:55:10.906136] [DEBUG] [MAIN ] RVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:10.939129] [DEBUG] [MAIN ] RTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:10.945916] [DEBUG] [MAIN ] RVLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:11.025555] [INFO ] [MAIN ] RVT: Generated 139 derivative records from 26270 primary records. [2025-10-24T00:55:11.028108] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-24T00:55:11.029104] [FATAL] [LOCAL ] RVT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:11.034141] [FATAL] [MAIN ] RVT: Failed to save derivative data. [2025-10-24T00:55:11.036365] [INFO ] [MAIN ] Derivative Progress: 1678/2164 symbols completed. RVT took 1.1s. Estimated remaining: 3m 16s. Rate: 149.0 symbols/min [2025-10-24T00:55:11.036772] [INFO ] [MAIN ] RTX: Generated 139 derivative records from 54096 primary records. [2025-10-24T00:55:11.037184] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-24T00:55:11.037483] [FATAL] [LOCAL ] RTX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:11.040598] [FATAL] [MAIN ] RTX: Failed to save derivative data. [2025-10-24T00:55:11.040488] [INFO ] [MAIN ] RVLV: Generated 139 derivative records from 47671 primary records. [2025-10-24T00:55:11.042874] [INFO ] [MAIN ] Derivative Progress: 1679/2164 symbols completed. RTX took 1.2s. Estimated remaining: 3m 15s. Rate: 149.1 symbols/min [2025-10-24T00:55:11.043134] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-24T00:55:11.043362] [FATAL] [LOCAL ] RVLV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:11.043441] [FATAL] [MAIN ] RVLV: Failed to save derivative data. [2025-10-24T00:55:11.046208] [INFO ] [MAIN ] Derivative Progress: 1680/2164 symbols completed. RVLV took 1.1s. Estimated remaining: 3m 15s. Rate: 149.2 symbols/min [2025-10-24T00:55:11.046604] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:11.046814] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:11.046735] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:11.111060] [DEBUG] [LOCAL ] RVTY: Loaded 48134 existing records from primary storage. [2025-10-24T00:55:11.123175] [INFO ] [MAIN ] RVTY: Loaded 48134 primary data records. [2025-10-24T00:55:11.123869] [DEBUG] [LOCAL ] RWT: Loaded 40660 existing records from primary storage. [2025-10-24T00:55:11.135175] [INFO ] [MAIN ] RWT: Loaded 40660 primary data records. [2025-10-24T00:55:11.327236] [DEBUG] [LOCAL ] RXO: Loaded 48829 existing records from primary storage. [2025-10-24T00:55:11.366339] [INFO ] [MAIN ] RXO: Loaded 48829 primary data records. [2025-10-24T00:55:12.143038] [DEBUG] [MAIN ] RVTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:12.154432] [DEBUG] [MAIN ] RWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:12.202697] [DEBUG] [MAIN ] RXO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:12.252477] [INFO ] [MAIN ] RVTY: Generated 139 derivative records from 48134 primary records. [2025-10-24T00:55:12.255188] [INFO ] [MAIN ] RWT: Generated 139 derivative records from 40660 primary records. [2025-10-24T00:55:12.257853] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-24T00:55:12.257993] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-24T00:55:12.258682] [FATAL] [LOCAL ] RVTY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:12.259324] [FATAL] [LOCAL ] RWT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:12.259054] [FATAL] [MAIN ] RVTY: Failed to save derivative data. [2025-10-24T00:55:12.262678] [FATAL] [MAIN ] RWT: Failed to save derivative data. [2025-10-24T00:55:12.262584] [INFO ] [MAIN ] Derivative Progress: 1681/2164 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 15s. Rate: 149.0 symbols/min [2025-10-24T00:55:12.266708] [INFO ] [MAIN ] Derivative Progress: 1682/2164 symbols completed. RWT took 1.2s. Estimated remaining: 3m 14s. Rate: 149.1 symbols/min [2025-10-24T00:55:12.267057] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:12.266235] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:12.274248] [INFO ] [MAIN ] RXO: Generated 139 derivative records from 48829 primary records. [2025-10-24T00:55:12.274354] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-24T00:55:12.274545] [FATAL] [LOCAL ] RXO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:12.274619] [FATAL] [MAIN ] RXO: Failed to save derivative data. [2025-10-24T00:55:12.277408] [INFO ] [MAIN ] Derivative Progress: 1683/2164 symbols completed. RXO took 1.2s. Estimated remaining: 3m 13s. Rate: 149.2 symbols/min [2025-10-24T00:55:12.277595] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:12.327123] [DEBUG] [LOCAL ] RYI: Loaded 21877 existing records from primary storage. [2025-10-24T00:55:12.327450] [INFO ] [MAIN ] RYI: Loaded 21877 primary data records. [2025-10-24T00:55:12.328845] [DEBUG] [LOCAL ] RYAM: Loaded 35289 existing records from primary storage. [2025-10-24T00:55:12.359916] [INFO ] [MAIN ] RYAM: Loaded 35289 primary data records. [2025-10-24T00:55:12.509506] [DEBUG] [LOCAL ] RYAN: Loaded 45325 existing records from primary storage. [2025-10-24T00:55:12.532308] [INFO ] [MAIN ] RYAN: Loaded 45325 primary data records. [2025-10-24T00:55:13.284408] [DEBUG] [MAIN ] RYAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:13.311911] [DEBUG] [MAIN ] RYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:13.348879] [DEBUG] [MAIN ] RYAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:13.400738] [INFO ] [MAIN ] RYAM: Generated 139 derivative records from 35289 primary records. [2025-10-24T00:55:13.403483] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-24T00:55:13.404782] [FATAL] [LOCAL ] RYAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:13.405280] [FATAL] [MAIN ] RYAM: Failed to save derivative data. [2025-10-24T00:55:13.408108] [INFO ] [MAIN ] Derivative Progress: 1684/2164 symbols completed. RYAM took 1.1s. Estimated remaining: 3m 13s. Rate: 149.0 symbols/min [2025-10-24T00:55:13.408856] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:13.420105] [INFO ] [MAIN ] RYI: Generated 139 derivative records from 21877 primary records. [2025-10-24T00:55:13.424117] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-24T00:55:13.425946] [FATAL] [LOCAL ] RYI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:13.426310] [FATAL] [MAIN ] RYI: Failed to save derivative data. [2025-10-24T00:55:13.428955] [INFO ] [MAIN ] Derivative Progress: 1685/2164 symbols completed. RYI took 1.2s. Estimated remaining: 3m 13s. Rate: 149.1 symbols/min [2025-10-24T00:55:13.431441] [INFO ] [MAIN ] RYAN: Generated 139 derivative records from 45325 primary records. [2025-10-24T00:55:13.432513] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:13.432727] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-24T00:55:13.433290] [FATAL] [LOCAL ] RYAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:13.433488] [FATAL] [MAIN ] RYAN: Failed to save derivative data. [2025-10-24T00:55:13.436132] [INFO ] [MAIN ] Derivative Progress: 1686/2164 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 12s. Rate: 149.2 symbols/min [2025-10-24T00:55:13.436589] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:13.455243] [DEBUG] [LOCAL ] RZB: Loaded 5912 existing records from primary storage. [2025-10-24T00:55:13.455495] [INFO ] [MAIN ] RZB: Loaded 5912 primary data records. [2025-10-24T00:55:13.479260] [DEBUG] [LOCAL ] RZC: Loaded 6506 existing records from primary storage. [2025-10-24T00:55:13.501632] [INFO ] [MAIN ] RZC: Loaded 6506 primary data records. [2025-10-24T00:55:13.648171] [DEBUG] [LOCAL ] RYN: Loaded 46088 existing records from primary storage. [2025-10-24T00:55:13.676703] [INFO ] [MAIN ] RYN: Loaded 46088 primary data records. [2025-10-24T00:55:14.413947] [DEBUG] [MAIN ] RZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:14.448568] [DEBUG] [MAIN ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:14.474733] [DEBUG] [MAIN ] RYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:14.533056] [INFO ] [MAIN ] RZB: Generated 139 derivative records from 5912 primary records. [2025-10-24T00:55:14.533487] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-24T00:55:14.534955] [FATAL] [LOCAL ] RZB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:14.535194] [FATAL] [MAIN ] RZB: Failed to save derivative data. [2025-10-24T00:55:14.537455] [INFO ] [MAIN ] Derivative Progress: 1687/2164 symbols completed. RZB took 1.1s. Estimated remaining: 3m 12s. Rate: 149.0 symbols/min [2025-10-24T00:55:14.541389] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:14.549227] [INFO ] [MAIN ] RYN: Generated 139 derivative records from 46088 primary records. [2025-10-24T00:55:14.549818] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-24T00:55:14.551566] [FATAL] [LOCAL ] RYN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:14.551759] [FATAL] [MAIN ] RYN: Failed to save derivative data. [2025-10-24T00:55:14.554455] [INFO ] [MAIN ] Derivative Progress: 1688/2164 symbols completed. RYN took 1.1s. Estimated remaining: 3m 12s. Rate: 149.1 symbols/min [2025-10-24T00:55:14.551988] [INFO ] [MAIN ] RZC: Generated 139 derivative records from 6506 primary records. [2025-10-24T00:55:14.554796] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:14.554914] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-24T00:55:14.555470] [FATAL] [LOCAL ] RZC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:14.555583] [FATAL] [MAIN ] RZC: Failed to save derivative data. [2025-10-24T00:55:14.558142] [INFO ] [MAIN ] Derivative Progress: 1689/2164 symbols completed. RZC took 1.1s. Estimated remaining: 3m 11s. Rate: 149.2 symbols/min [2025-10-24T00:55:14.558412] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:14.572369] [DEBUG] [LOCAL ] SABA: Loaded 9226 existing records from primary storage. [2025-10-24T00:55:14.585703] [INFO ] [MAIN ] SABA: Loaded 9226 primary data records. [2025-10-24T00:55:14.719989] [DEBUG] [LOCAL ] S: Loaded 53927 existing records from primary storage. [2025-10-24T00:55:14.731403] [INFO ] [MAIN ] S: Loaded 53927 primary data records. [2025-10-24T00:55:15.012923] [DEBUG] [LOCAL ] SA: Loaded 44981 existing records from primary storage. [2025-10-24T00:55:15.018454] [INFO ] [MAIN ] SA: Loaded 44981 primary data records. [2025-10-24T00:55:15.595109] [DEBUG] [MAIN ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:15.638002] [DEBUG] [MAIN ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:15.674049] [DEBUG] [MAIN ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:15.698371] [INFO ] [MAIN ] SABA: Generated 139 derivative records from 9226 primary records. [2025-10-24T00:55:15.700021] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-24T00:55:15.701226] [FATAL] [LOCAL ] SABA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:15.701323] [FATAL] [MAIN ] SABA: Failed to save derivative data. [2025-10-24T00:55:15.703916] [INFO ] [MAIN ] Derivative Progress: 1690/2164 symbols completed. SABA took 1.1s. Estimated remaining: 3m 11s. Rate: 149.0 symbols/min [2025-10-24T00:55:15.704428] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:15.725336] [INFO ] [MAIN ] S: Generated 139 derivative records from 53927 primary records. [2025-10-24T00:55:15.736797] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-24T00:55:15.737321] [FATAL] [LOCAL ] S: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:15.739103] [FATAL] [MAIN ] S: Failed to save derivative data. [2025-10-24T00:55:15.741427] [INFO ] [MAIN ] Derivative Progress: 1691/2164 symbols completed. S took 1.2s. Estimated remaining: 3m 10s. Rate: 149.1 symbols/min [2025-10-24T00:55:15.743967] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:15.743875] [INFO ] [MAIN ] SA: Generated 139 derivative records from 44981 primary records. [2025-10-24T00:55:15.744406] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-24T00:55:15.744675] [FATAL] [LOCAL ] SA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:15.744763] [FATAL] [MAIN ] SA: Failed to save derivative data. [2025-10-24T00:55:15.747234] [INFO ] [MAIN ] Derivative Progress: 1692/2164 symbols completed. SA took 1.2s. Estimated remaining: 3m 10s. Rate: 149.2 symbols/min [2025-10-24T00:55:15.747495] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:15.759241] [DEBUG] [LOCAL ] SAFE: Loaded 30040 existing records from primary storage. [2025-10-24T00:55:15.759576] [INFO ] [MAIN ] SAFE: Loaded 30040 primary data records. [2025-10-24T00:55:15.877376] [DEBUG] [LOCAL ] SAH: Loaded 20933 existing records from primary storage. [2025-10-24T00:55:15.877531] [INFO ] [MAIN ] SAH: Loaded 20933 primary data records. [2025-10-24T00:55:16.039685] [DEBUG] [LOCAL ] SAM: Loaded 21387 existing records from primary storage. [2025-10-24T00:55:16.169327] [INFO ] [MAIN ] SAM: Loaded 21387 primary data records. [2025-10-24T00:55:16.686673] [DEBUG] [MAIN ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:16.720100] [DEBUG] [MAIN ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:16.752142] [DEBUG] [MAIN ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:16.795499] [INFO ] [MAIN ] SAFE: Generated 139 derivative records from 30040 primary records. [2025-10-24T00:55:16.796514] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-24T00:55:16.798025] [FATAL] [LOCAL ] SAFE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:16.798423] [FATAL] [MAIN ] SAFE: Failed to save derivative data. [2025-10-24T00:55:16.802802] [INFO ] [MAIN ] Derivative Progress: 1693/2164 symbols completed. SAFE took 1.1s. Estimated remaining: 3m 10s. Rate: 149.0 symbols/min [2025-10-24T00:55:16.812289] [INFO ] [MAIN ] SAH: Generated 139 derivative records from 20933 primary records. [2025-10-24T00:55:16.812435] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-24T00:55:16.812680] [FATAL] [LOCAL ] SAH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:16.815375] [INFO ] [MAIN ] SAM: Generated 139 derivative records from 21387 primary records. [2025-10-24T00:55:16.815473] [FATAL] [MAIN ] SAH: Failed to save derivative data. [2025-10-24T00:55:16.818077] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-24T00:55:16.818014] [INFO ] [MAIN ] Derivative Progress: 1694/2164 symbols completed. SAH took 1.1s. Estimated remaining: 3m 9s. Rate: 149.1 symbols/min [2025-10-24T00:55:16.818347] [FATAL] [LOCAL ] SAM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:16.818441] [FATAL] [MAIN ] SAM: Failed to save derivative data. [2025-10-24T00:55:16.821037] [INFO ] [MAIN ] Derivative Progress: 1695/2164 symbols completed. SAM took 1.1s. Estimated remaining: 3m 9s. Rate: 149.2 symbols/min [2025-10-24T00:55:16.821361] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:16.821465] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:16.821551] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:16.840319] [DEBUG] [LOCAL ] SAR: Loaded 17208 existing records from primary storage. [2025-10-24T00:55:16.840513] [INFO ] [MAIN ] SAR: Loaded 17208 primary data records. [2025-10-24T00:55:17.180605] [DEBUG] [LOCAL ] SAP: Loaded 50250 existing records from primary storage. [2025-10-24T00:55:17.181627] [INFO ] [MAIN ] SAP: Loaded 50250 primary data records. [2025-10-24T00:55:17.181531] [DEBUG] [LOCAL ] SAN: Loaded 53345 existing records from primary storage. [2025-10-24T00:55:17.182298] [INFO ] [MAIN ] SAN: Loaded 53345 primary data records. [2025-10-24T00:55:17.832891] [DEBUG] [MAIN ] SAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:17.900774] [DEBUG] [MAIN ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:17.902529] [DEBUG] [MAIN ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:17.902812] [INFO ] [MAIN ] SAR: Generated 139 derivative records from 17208 primary records. [2025-10-24T00:55:17.925988] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-24T00:55:17.927619] [FATAL] [LOCAL ] SAR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:17.929690] [FATAL] [MAIN ] SAR: Failed to save derivative data. [2025-10-24T00:55:17.933707] [INFO ] [MAIN ] Derivative Progress: 1696/2164 symbols completed. SAR took 1.1s. Estimated remaining: 3m 8s. Rate: 149.1 symbols/min [2025-10-24T00:55:17.934739] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:17.977875] [INFO ] [MAIN ] SAN: Generated 139 derivative records from 53345 primary records. [2025-10-24T00:55:17.979254] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-24T00:55:17.979605] [FATAL] [LOCAL ] SAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:17.981299] [INFO ] [MAIN ] SAP: Generated 139 derivative records from 50250 primary records. [2025-10-24T00:55:17.981419] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-24T00:55:17.981584] [FATAL] [LOCAL ] SAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:17.981736] [FATAL] [MAIN ] SAP: Failed to save derivative data. [2025-10-24T00:55:17.981662] [FATAL] [MAIN ] SAN: Failed to save derivative data. [2025-10-24T00:55:17.984052] [INFO ] [MAIN ] Derivative Progress: 1697/2164 symbols completed. SAP took 1.2s. Estimated remaining: 3m 8s. Rate: 149.1 symbols/min [2025-10-24T00:55:17.986551] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:17.986621] [INFO ] [MAIN ] Derivative Progress: 1698/2164 symbols completed. SAN took 1.2s. Estimated remaining: 3m 7s. Rate: 149.2 symbols/min [2025-10-24T00:55:17.987586] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:18.002279] [DEBUG] [LOCAL ] SARO: Loaded 48571 existing records from primary storage. [2025-10-24T00:55:18.002671] [INFO ] [MAIN ] SARO: Loaded 48571 primary data records. [2025-10-24T00:55:18.321885] [DEBUG] [LOCAL ] SB: Loaded 32641 existing records from primary storage. [2025-10-24T00:55:18.322676] [INFO ] [MAIN ] SB: Loaded 32641 primary data records. [2025-10-24T00:55:18.400819] [DEBUG] [LOCAL ] SBH: Loaded 50207 existing records from primary storage. [2025-10-24T00:55:18.440354] [INFO ] [MAIN ] SBH: Loaded 50207 primary data records. [2025-10-24T00:55:18.943068] [DEBUG] [MAIN ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:18.984092] [DEBUG] [MAIN ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:19.030866] [DEBUG] [MAIN ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:19.047148] [INFO ] [MAIN ] SARO: Generated 139 derivative records from 48571 primary records. [2025-10-24T00:55:19.049805] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-24T00:55:19.050325] [FATAL] [LOCAL ] SARO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:19.050797] [FATAL] [MAIN ] SARO: Failed to save derivative data. [2025-10-24T00:55:19.053227] [INFO ] [MAIN ] Derivative Progress: 1699/2164 symbols completed. SARO took 1.1s. Estimated remaining: 3m 7s. Rate: 149.1 symbols/min [2025-10-24T00:55:19.054587] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:19.076455] [DEBUG] [LOCAL ] SBI: Loaded 7797 existing records from primary storage. [2025-10-24T00:55:19.079096] [INFO ] [MAIN ] SB: Generated 139 derivative records from 32641 primary records. [2025-10-24T00:55:19.079249] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-24T00:55:19.079344] [INFO ] [MAIN ] SBI: Loaded 7797 primary data records. [2025-10-24T00:55:19.079756] [FATAL] [LOCAL ] SB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:19.080111] [FATAL] [MAIN ] SB: Failed to save derivative data. [2025-10-24T00:55:19.147582] [INFO ] [MAIN ] Derivative Progress: 1700/2164 symbols completed. SB took 1.2s. Estimated remaining: 3m 7s. Rate: 149.1 symbols/min [2025-10-24T00:55:19.190632] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:19.400426] [DEBUG] [LOCAL ] SBR: Loaded 7861 existing records from primary storage. [2025-10-24T00:55:19.401383] [INFO ] [MAIN ] SBR: Loaded 7861 primary data records. [2025-10-24T00:55:19.459008] [INFO ] [MAIN ] SBH: Generated 139 derivative records from 50207 primary records. [2025-10-24T00:55:19.485898] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-24T00:55:19.504227] [FATAL] [LOCAL ] SBH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:19.507505] [FATAL] [MAIN ] SBH: Failed to save derivative data. [2025-10-24T00:55:19.511320] [INFO ] [MAIN ] Derivative Progress: 1701/2164 symbols completed. SBH took 1.5s. Estimated remaining: 3m 6s. Rate: 149.2 symbols/min [2025-10-24T00:55:19.511793] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:19.755602] [DEBUG] [MAIN ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:19.821370] [DEBUG] [LOCAL ] SBS: Loaded 49623 existing records from primary storage. [2025-10-24T00:55:19.818201] [DEBUG] [MAIN ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:19.822062] [INFO ] [MAIN ] SBS: Loaded 49623 primary data records. [2025-10-24T00:55:20.025166] [INFO ] [MAIN ] SBI: Generated 139 derivative records from 7797 primary records. [2025-10-24T00:55:20.026592] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-24T00:55:20.142313] [FATAL] [LOCAL ] SBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:20.145531] [FATAL] [MAIN ] SBI: Failed to save derivative data. [2025-10-24T00:55:20.149711] [INFO ] [MAIN ] Derivative Progress: 1702/2164 symbols completed. SBI took 1.1s. Estimated remaining: 3m 6s. Rate: 149.1 symbols/min [2025-10-24T00:55:20.153704] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:20.160977] [INFO ] [MAIN ] SBR: Generated 139 derivative records from 7861 primary records. [2025-10-24T00:55:20.161313] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-24T00:55:20.161545] [FATAL] [LOCAL ] SBR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:20.161624] [FATAL] [MAIN ] SBR: Failed to save derivative data. [2025-10-24T00:55:20.164232] [INFO ] [MAIN ] Derivative Progress: 1703/2164 symbols completed. SBR took 1.0s. Estimated remaining: 3m 5s. Rate: 149.2 symbols/min [2025-10-24T00:55:20.165773] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:20.179499] [DEBUG] [LOCAL ] SBSI: Loaded 14898 existing records from primary storage. [2025-10-24T00:55:20.179818] [INFO ] [MAIN ] SBSI: Loaded 14898 primary data records. [2025-10-24T00:55:20.379531] [DEBUG] [MAIN ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:20.545073] [DEBUG] [LOCAL ] SCCO: Loaded 49917 existing records from primary storage. [2025-10-24T00:55:20.545992] [INFO ] [MAIN ] SCCO: Loaded 49917 primary data records. [2025-10-24T00:55:20.870280] [DEBUG] [MAIN ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:20.902471] [INFO ] [MAIN ] SBS: Generated 139 derivative records from 49623 primary records. [2025-10-24T00:55:20.905283] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-24T00:55:20.908375] [FATAL] [LOCAL ] SBS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:20.908495] [FATAL] [MAIN ] SBS: Failed to save derivative data. [2025-10-24T00:55:20.911021] [INFO ] [MAIN ] Derivative Progress: 1704/2164 symbols completed. SBS took 1.4s. Estimated remaining: 3m 5s. Rate: 149.1 symbols/min [2025-10-24T00:55:20.913853] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:20.931542] [INFO ] [MAIN ] SBSI: Generated 139 derivative records from 14898 primary records. [2025-10-24T00:55:20.949497] [DEBUG] [MAIN ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:20.949575] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-24T00:55:20.949192] [DEBUG] [LOCAL ] SCD: Loaded 13638 existing records from primary storage. [2025-10-24T00:55:20.963914] [FATAL] [LOCAL ] SBSI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:20.963663] [INFO ] [MAIN ] SCD: Loaded 13638 primary data records. [2025-10-24T00:55:20.964023] [FATAL] [MAIN ] SBSI: Failed to save derivative data. [2025-10-24T00:55:20.978412] [INFO ] [MAIN ] Derivative Progress: 1705/2164 symbols completed. SBSI took 0.8s. Estimated remaining: 3m 5s. Rate: 149.2 symbols/min [2025-10-24T00:55:20.998115] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:21.291792] [INFO ] [MAIN ] SCCO: Generated 139 derivative records from 49917 primary records. [2025-10-24T00:55:21.292551] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-24T00:55:21.293179] [FATAL] [LOCAL ] SCCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:21.293406] [FATAL] [MAIN ] SCCO: Failed to save derivative data. [2025-10-24T00:55:21.296056] [INFO ] [MAIN ] Derivative Progress: 1706/2164 symbols completed. SCCO took 1.1s. Estimated remaining: 3m 4s. Rate: 149.2 symbols/min [2025-10-24T00:55:21.296493] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:21.314764] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-24T00:55:21.315355] [INFO ] [MAIN ] SCHW: Loaded 54075 primary data records. [2025-10-24T00:55:21.577097] [DEBUG] [MAIN ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:21.692416] [DEBUG] [LOCAL ] SCI: Loaded 46439 existing records from primary storage. [2025-10-24T00:55:21.697747] [INFO ] [MAIN ] SCI: Loaded 46439 primary data records. [2025-10-24T00:55:22.027476] [INFO ] [MAIN ] SCD: Generated 139 derivative records from 13638 primary records. [2025-10-24T00:55:22.027807] [DEBUG] [MAIN ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:22.040169] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-24T00:55:22.041258] [FATAL] [LOCAL ] SCD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:22.043345] [FATAL] [MAIN ] SCD: Failed to save derivative data. [2025-10-24T00:55:22.045620] [INFO ] [MAIN ] Derivative Progress: 1707/2164 symbols completed. SCD took 1.1s. Estimated remaining: 3m 4s. Rate: 149.1 symbols/min [2025-10-24T00:55:22.047295] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:22.075244] [DEBUG] [LOCAL ] SCL: Loaded 15300 existing records from primary storage. [2025-10-24T00:55:22.075840] [INFO ] [MAIN ] SCL: Loaded 15300 primary data records. [2025-10-24T00:55:22.100755] [DEBUG] [MAIN ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:22.319089] [INFO ] [MAIN ] SCHW: Generated 139 derivative records from 54075 primary records. [2025-10-24T00:55:22.402947] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-24T00:55:22.403480] [FATAL] [LOCAL ] SCHW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:22.406511] [FATAL] [MAIN ] SCHW: Failed to save derivative data. [2025-10-24T00:55:22.408916] [INFO ] [MAIN ] Derivative Progress: 1708/2164 symbols completed. SCHW took 1.4s. Estimated remaining: 3m 3s. Rate: 149.1 symbols/min [2025-10-24T00:55:22.425185] [INFO ] [MAIN ] SCI: Generated 139 derivative records from 46439 primary records. [2025-10-24T00:55:22.425608] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-24T00:55:22.425865] [FATAL] [LOCAL ] SCI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:22.425964] [FATAL] [MAIN ] SCI: Failed to save derivative data. [2025-10-24T00:55:22.428585] [INFO ] [MAIN ] Derivative Progress: 1709/2164 symbols completed. SCI took 1.1s. Estimated remaining: 3m 3s. Rate: 149.2 symbols/min [2025-10-24T00:55:22.444865] [DEBUG] [MAIN ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:22.469604] [INFO ] [MAIN ] SCL: Generated 139 derivative records from 15300 primary records. [2025-10-24T00:55:22.469723] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-24T00:55:22.469908] [FATAL] [LOCAL ] SCL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:22.469985] [FATAL] [MAIN ] SCL: Failed to save derivative data. [2025-10-24T00:55:22.472312] [INFO ] [MAIN ] Derivative Progress: 1710/2164 symbols completed. SCL took 0.4s. Estimated remaining: 3m 2s. Rate: 149.3 symbols/min [2025-10-24T00:55:22.472771] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:22.473315] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:22.472923] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:22.496419] [DEBUG] [LOCAL ] SCM: Loaded 20250 existing records from primary storage. [2025-10-24T00:55:22.503153] [INFO ] [MAIN ] SCM: Loaded 20250 primary data records. [2025-10-24T00:55:22.628171] [DEBUG] [LOCAL ] SD: Loaded 28416 existing records from primary storage. [2025-10-24T00:55:22.660323] [INFO ] [MAIN ] SD: Loaded 28416 primary data records. [2025-10-24T00:55:22.672026] [DEBUG] [LOCAL ] SCS: Loaded 43507 existing records from primary storage. [2025-10-24T00:55:22.694916] [INFO ] [MAIN ] SCS: Loaded 43507 primary data records. [2025-10-24T00:55:23.496172] [DEBUG] [MAIN ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:23.546804] [DEBUG] [MAIN ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:23.543018] [DEBUG] [MAIN ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:23.624943] [INFO ] [MAIN ] SCM: Generated 139 derivative records from 20250 primary records. [2025-10-24T00:55:23.628638] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-24T00:55:23.629170] [FATAL] [LOCAL ] SCM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:23.631795] [FATAL] [MAIN ] SCM: Failed to save derivative data. [2025-10-24T00:55:23.632265] [INFO ] [MAIN ] SD: Generated 139 derivative records from 28416 primary records. [2025-10-24T00:55:23.636581] [INFO ] [MAIN ] SCS: Generated 139 derivative records from 43507 primary records. [2025-10-24T00:55:23.634423] [INFO ] [MAIN ] Derivative Progress: 1711/2164 symbols completed. SCM took 1.2s. Estimated remaining: 3m 2s. Rate: 149.1 symbols/min [2025-10-24T00:55:23.636770] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-24T00:55:23.637313] [FATAL] [LOCAL ] SCS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:23.636867] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-24T00:55:23.637013] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:23.637719] [FATAL] [LOCAL ] SD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:23.637414] [FATAL] [MAIN ] SCS: Failed to save derivative data. [2025-10-24T00:55:23.640689] [INFO ] [MAIN ] Derivative Progress: 1712/2164 symbols completed. SCS took 1.2s. Estimated remaining: 3m 2s. Rate: 149.2 symbols/min [2025-10-24T00:55:23.640841] [FATAL] [MAIN ] SD: Failed to save derivative data. [2025-10-24T00:55:23.641077] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:23.643910] [INFO ] [MAIN ] Derivative Progress: 1713/2164 symbols completed. SD took 1.2s. Estimated remaining: 3m 1s. Rate: 149.3 symbols/min [2025-10-24T00:55:23.644178] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:23.654868] [DEBUG] [LOCAL ] SDHC: Loaded 10434 existing records from primary storage. [2025-10-24T00:55:23.657217] [INFO ] [MAIN ] SDHC: Loaded 10434 primary data records. [2025-10-24T00:55:23.761693] [DEBUG] [LOCAL ] SDHY: Loaded 11276 existing records from primary storage. [2025-10-24T00:55:23.765431] [INFO ] [MAIN ] SDHY: Loaded 11276 primary data records. [2025-10-24T00:55:24.121515] [DEBUG] [LOCAL ] SDRL: Loaded 41448 existing records from primary storage. [2025-10-24T00:55:24.156696] [INFO ] [MAIN ] SDRL: Loaded 41448 primary data records. [2025-10-24T00:55:24.596748] [DEBUG] [MAIN ] SDHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:24.626295] [DEBUG] [MAIN ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:24.671378] [DEBUG] [MAIN ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:24.705827] [INFO ] [MAIN ] SDHC: Generated 139 derivative records from 10434 primary records. [2025-10-24T00:55:24.706754] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-24T00:55:24.706982] [FATAL] [LOCAL ] SDHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:24.708090] [FATAL] [MAIN ] SDHC: Failed to save derivative data. [2025-10-24T00:55:24.712684] [INFO ] [MAIN ] Derivative Progress: 1714/2164 symbols completed. SDHC took 1.1s. Estimated remaining: 3m 1s. Rate: 149.2 symbols/min [2025-10-24T00:55:24.715296] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:24.719695] [INFO ] [MAIN ] SDHY: Generated 139 derivative records from 11276 primary records. [2025-10-24T00:55:24.722777] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-24T00:55:24.723535] [FATAL] [LOCAL ] SDHY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:24.723726] [FATAL] [MAIN ] SDHY: Failed to save derivative data. [2025-10-24T00:55:24.726347] [INFO ] [MAIN ] Derivative Progress: 1715/2164 symbols completed. SDHY took 1.1s. Estimated remaining: 3m 1s. Rate: 149.2 symbols/min [2025-10-24T00:55:24.728750] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:24.735443] [INFO ] [MAIN ] SDRL: Generated 139 derivative records from 41448 primary records. [2025-10-24T00:55:24.735917] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-24T00:55:24.736308] [FATAL] [LOCAL ] SDRL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:24.736388] [FATAL] [MAIN ] SDRL: Failed to save derivative data. [2025-10-24T00:55:24.739053] [INFO ] [MAIN ] Derivative Progress: 1716/2164 symbols completed. SDRL took 1.1s. Estimated remaining: 3m 0s. Rate: 149.3 symbols/min [2025-10-24T00:55:24.739237] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:24.765313] [DEBUG] [LOCAL ] SEG: Loaded 12541 existing records from primary storage. [2025-10-24T00:55:24.765549] [INFO ] [MAIN ] SEG: Loaded 12541 primary data records. [2025-10-24T00:55:24.926393] [DEBUG] [LOCAL ] SE: Loaded 53690 existing records from primary storage. [2025-10-24T00:55:25.079682] [DEBUG] [LOCAL ] SEE: Loaded 48408 existing records from primary storage. [2025-10-24T00:55:25.092805] [INFO ] [MAIN ] SE: Loaded 53690 primary data records. [2025-10-24T00:55:25.094312] [INFO ] [MAIN ] SEE: Loaded 48408 primary data records. [2025-10-24T00:55:25.745399] [DEBUG] [MAIN ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:25.794173] [DEBUG] [MAIN ] SE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:25.823667] [DEBUG] [MAIN ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:25.841136] [INFO ] [MAIN ] SEG: Generated 139 derivative records from 12541 primary records. [2025-10-24T00:55:25.841444] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-24T00:55:25.841819] [FATAL] [LOCAL ] SEG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:25.844433] [FATAL] [MAIN ] SEG: Failed to save derivative data. [2025-10-24T00:55:25.849160] [INFO ] [MAIN ] Derivative Progress: 1717/2164 symbols completed. SEG took 1.1s. Estimated remaining: 2m 60s. Rate: 149.2 symbols/min [2025-10-24T00:55:25.849432] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:25.880445] [INFO ] [MAIN ] SE: Generated 139 derivative records from 53690 primary records. [2025-10-24T00:55:25.883603] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-24T00:55:25.884004] [FATAL] [LOCAL ] SE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:25.895533] [FATAL] [MAIN ] SE: Failed to save derivative data. [2025-10-24T00:55:25.898635] [INFO ] [MAIN ] Derivative Progress: 1718/2164 symbols completed. SE took 1.2s. Estimated remaining: 2m 59s. Rate: 149.3 symbols/min [2025-10-24T00:55:25.900871] [INFO ] [MAIN ] SEE: Generated 139 derivative records from 48408 primary records. [2025-10-24T00:55:25.901152] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:25.901051] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-24T00:55:25.901876] [FATAL] [LOCAL ] SEE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:25.902080] [FATAL] [MAIN ] SEE: Failed to save derivative data. [2025-10-24T00:55:25.905424] [INFO ] [MAIN ] Derivative Progress: 1719/2164 symbols completed. SEE took 1.2s. Estimated remaining: 2m 59s. Rate: 149.3 symbols/min [2025-10-24T00:55:25.905873] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:25.922933] [DEBUG] [LOCAL ] SEI: Loaded 50409 existing records from primary storage. [2025-10-24T00:55:25.923303] [INFO ] [MAIN ] SEI: Loaded 50409 primary data records. [2025-10-24T00:55:26.255420] [DEBUG] [LOCAL ] SEMR: Loaded 42346 existing records from primary storage. [2025-10-24T00:55:26.255679] [INFO ] [MAIN ] SEMR: Loaded 42346 primary data records. [2025-10-24T00:55:26.256769] [DEBUG] [LOCAL ] SEM: Loaded 43469 existing records from primary storage. [2025-10-24T00:55:26.268361] [INFO ] [MAIN ] SEM: Loaded 43469 primary data records. [2025-10-24T00:55:26.858616] [DEBUG] [MAIN ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:26.913166] [DEBUG] [MAIN ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:26.928033] [DEBUG] [MAIN ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:26.968395] [INFO ] [MAIN ] SEI: Generated 139 derivative records from 50409 primary records. [2025-10-24T00:55:26.970727] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-24T00:55:26.971868] [FATAL] [LOCAL ] SEI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:26.971969] [FATAL] [MAIN ] SEI: Failed to save derivative data. [2025-10-24T00:55:26.975234] [INFO ] [MAIN ] Derivative Progress: 1720/2164 symbols completed. SEI took 1.1s. Estimated remaining: 2m 59s. Rate: 149.2 symbols/min [2025-10-24T00:55:26.979343] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:27.001127] [INFO ] [MAIN ] SEMR: Generated 139 derivative records from 42346 primary records. [2025-10-24T00:55:27.002819] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-24T00:55:27.003068] [FATAL] [LOCAL ] SEMR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:27.003391] [FATAL] [MAIN ] SEMR: Failed to save derivative data. [2025-10-24T00:55:27.005571] [INFO ] [MAIN ] Derivative Progress: 1721/2164 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 58s. Rate: 149.3 symbols/min [2025-10-24T00:55:27.007871] [INFO ] [MAIN ] SEM: Generated 139 derivative records from 43469 primary records. [2025-10-24T00:55:27.008012] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-24T00:55:27.008320] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:27.008238] [FATAL] [LOCAL ] SEM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:27.008897] [FATAL] [MAIN ] SEM: Failed to save derivative data. [2025-10-24T00:55:27.011621] [INFO ] [MAIN ] Derivative Progress: 1722/2164 symbols completed. SEM took 1.1s. Estimated remaining: 2m 58s. Rate: 149.4 symbols/min [2025-10-24T00:55:27.012039] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:27.031316] [DEBUG] [LOCAL ] SFB: Loaded 3706 existing records from primary storage. [2025-10-24T00:55:27.031468] [INFO ] [MAIN ] SFB: Loaded 3706 primary data records. [2025-10-24T00:55:27.178537] [DEBUG] [LOCAL ] SES: Loaded 52003 existing records from primary storage. [2025-10-24T00:55:27.232939] [INFO ] [MAIN ] SES: Loaded 52003 primary data records. [2025-10-24T00:55:27.438803] [DEBUG] [LOCAL ] SF: Loaded 41695 existing records from primary storage. [2025-10-24T00:55:27.474680] [INFO ] [MAIN ] SF: Loaded 41695 primary data records. [2025-10-24T00:55:28.039862] [DEBUG] [MAIN ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:28.101432] [DEBUG] [MAIN ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:28.134429] [DEBUG] [MAIN ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:28.189570] [INFO ] [MAIN ] SFB: Generated 139 derivative records from 3706 primary records. [2025-10-24T00:55:28.191814] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-24T00:55:28.193733] [FATAL] [LOCAL ] SFB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:28.194164] [FATAL] [MAIN ] SFB: Failed to save derivative data. [2025-10-24T00:55:28.203460] [INFO ] [MAIN ] Derivative Progress: 1723/2164 symbols completed. SFB took 1.2s. Estimated remaining: 2m 57s. Rate: 149.2 symbols/min [2025-10-24T00:55:28.219109] [INFO ] [MAIN ] SF: Generated 139 derivative records from 41695 primary records. [2025-10-24T00:55:28.219478] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-24T00:55:28.219795] [FATAL] [LOCAL ] SF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:28.219894] [FATAL] [MAIN ] SF: Failed to save derivative data. [2025-10-24T00:55:28.225329] [INFO ] [MAIN ] Derivative Progress: 1724/2164 symbols completed. SF took 1.2s. Estimated remaining: 2m 57s. Rate: 149.3 symbols/min [2025-10-24T00:55:28.226441] [INFO ] [MAIN ] SES: Generated 139 derivative records from 52003 primary records. [2025-10-24T00:55:28.226935] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-24T00:55:28.227225] [FATAL] [LOCAL ] SES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:28.227348] [FATAL] [MAIN ] SES: Failed to save derivative data. [2025-10-24T00:55:28.230203] [INFO ] [MAIN ] Derivative Progress: 1725/2164 symbols completed. SES took 1.3s. Estimated remaining: 2m 56s. Rate: 149.4 symbols/min [2025-10-24T00:55:28.231049] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:28.230955] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:28.231288] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:28.259997] [DEBUG] [LOCAL ] SFBS: Loaded 21618 existing records from primary storage. [2025-10-24T00:55:28.260291] [INFO ] [MAIN ] SFBS: Loaded 21618 primary data records. [2025-10-24T00:55:28.455970] [DEBUG] [LOCAL ] SGHC: Loaded 47651 existing records from primary storage. [2025-10-24T00:55:28.456897] [INFO ] [MAIN ] SGHC: Loaded 47651 primary data records. [2025-10-24T00:55:28.576626] [DEBUG] [LOCAL ] SG: Loaded 53894 existing records from primary storage. [2025-10-24T00:55:28.621061] [INFO ] [MAIN ] SG: Loaded 53894 primary data records. [2025-10-24T00:55:29.459833] [DEBUG] [MAIN ] SFBS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:29.493365] [DEBUG] [MAIN ] SGHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:29.528483] [DEBUG] [MAIN ] SG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:29.566558] [INFO ] [MAIN ] SFBS: Generated 139 derivative records from 21618 primary records. [2025-10-24T00:55:29.570356] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-24T00:55:29.571598] [FATAL] [LOCAL ] SFBS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:29.572868] [FATAL] [MAIN ] SFBS: Failed to save derivative data. [2025-10-24T00:55:29.576811] [INFO ] [MAIN ] Derivative Progress: 1726/2164 symbols completed. SFBS took 1.3s. Estimated remaining: 2m 56s. Rate: 149.2 symbols/min [2025-10-24T00:55:29.577419] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:29.589301] [INFO ] [MAIN ] SGHC: Generated 139 derivative records from 47651 primary records. [2025-10-24T00:55:29.590874] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-24T00:55:29.591167] [FATAL] [LOCAL ] SGHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:29.591370] [FATAL] [MAIN ] SGHC: Failed to save derivative data. [2025-10-24T00:55:29.595166] [INFO ] [MAIN ] Derivative Progress: 1727/2164 symbols completed. SGHC took 1.4s. Estimated remaining: 2m 56s. Rate: 149.2 symbols/min [2025-10-24T00:55:29.598084] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:29.605398] [DEBUG] [LOCAL ] SGU: Loaded 6520 existing records from primary storage. [2025-10-24T00:55:29.608516] [INFO ] [MAIN ] SGU: Loaded 6520 primary data records. [2025-10-24T00:55:29.642036] [INFO ] [MAIN ] SG: Generated 139 derivative records from 53894 primary records. [2025-10-24T00:55:29.648358] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-24T00:55:29.648695] [FATAL] [LOCAL ] SG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:29.648823] [FATAL] [MAIN ] SG: Failed to save derivative data. [2025-10-24T00:55:29.690407] [INFO ] [MAIN ] Derivative Progress: 1728/2164 symbols completed. SG took 1.5s. Estimated remaining: 2m 55s. Rate: 149.3 symbols/min [2025-10-24T00:55:29.717143] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:29.950424] [DEBUG] [LOCAL ] SHAK: Loaded 49001 existing records from primary storage. [2025-10-24T00:55:29.954098] [INFO ] [MAIN ] SHAK: Loaded 49001 primary data records. [2025-10-24T00:55:29.953940] [DEBUG] [LOCAL ] SHCO: Loaded 25438 existing records from primary storage. [2025-10-24T00:55:29.966153] [INFO ] [MAIN ] SHCO: Loaded 25438 primary data records. [2025-10-24T00:55:30.597459] [DEBUG] [MAIN ] SGU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:30.664251] [INFO ] [MAIN ] SGU: Generated 139 derivative records from 6520 primary records. [2025-10-24T00:55:30.677119] [DEBUG] [MAIN ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:30.677375] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-24T00:55:30.677905] [DEBUG] [MAIN ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:30.691291] [FATAL] [LOCAL ] SGU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:30.705480] [FATAL] [MAIN ] SGU: Failed to save derivative data. [2025-10-24T00:55:30.710132] [INFO ] [MAIN ] Derivative Progress: 1729/2164 symbols completed. SGU took 1.1s. Estimated remaining: 2m 55s. Rate: 149.2 symbols/min [2025-10-24T00:55:30.710906] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:30.771466] [INFO ] [MAIN ] SHCO: Generated 139 derivative records from 25438 primary records. [2025-10-24T00:55:30.775469] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-24T00:55:30.775908] [INFO ] [MAIN ] SHAK: Generated 139 derivative records from 49001 primary records. [2025-10-24T00:55:30.776448] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-24T00:55:30.776360] [FATAL] [LOCAL ] SHCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:30.776758] [FATAL] [LOCAL ] SHAK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:30.776998] [FATAL] [MAIN ] SHAK: Failed to save derivative data. [2025-10-24T00:55:30.779387] [INFO ] [MAIN ] Derivative Progress: 1730/2164 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 54s. Rate: 149.2 symbols/min [2025-10-24T00:55:30.776878] [FATAL] [MAIN ] SHCO: Failed to save derivative data. [2025-10-24T00:55:30.779801] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:30.782864] [INFO ] [MAIN ] Derivative Progress: 1731/2164 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 54s. Rate: 149.3 symbols/min [2025-10-24T00:55:30.784385] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:30.804537] [DEBUG] [LOCAL ] SHEL: Loaded 54065 existing records from primary storage. [2025-10-24T00:55:30.804922] [INFO ] [MAIN ] SHEL: Loaded 54065 primary data records. [2025-10-24T00:55:30.957591] [DEBUG] [LOCAL ] SHG: Loaded 26875 existing records from primary storage. [2025-10-24T00:55:31.025908] [INFO ] [MAIN ] SHG: Loaded 26875 primary data records. [2025-10-24T00:55:31.266140] [DEBUG] [LOCAL ] SHO: Loaded 49414 existing records from primary storage. [2025-10-24T00:55:31.282470] [INFO ] [MAIN ] SHO: Loaded 49414 primary data records. [2025-10-24T00:55:31.859131] [DEBUG] [MAIN ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:31.911276] [DEBUG] [MAIN ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:31.939005] [INFO ] [MAIN ] SHEL: Generated 139 derivative records from 54065 primary records. [2025-10-24T00:55:31.943865] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-24T00:55:31.946217] [FATAL] [LOCAL ] SHEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:31.946456] [FATAL] [MAIN ] SHEL: Failed to save derivative data. [2025-10-24T00:55:31.956834] [INFO ] [MAIN ] Derivative Progress: 1732/2164 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 54s. Rate: 149.2 symbols/min [2025-10-24T00:55:31.961899] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:31.964674] [DEBUG] [MAIN ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:31.988068] [DEBUG] [LOCAL ] SHOC: Loaded 3025 existing records from primary storage. [2025-10-24T00:55:31.989985] [INFO ] [MAIN ] SHOC: Loaded 3025 primary data records. [2025-10-24T00:55:32.110471] [INFO ] [MAIN ] SHG: Generated 139 derivative records from 26875 primary records. [2025-10-24T00:55:32.132815] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-24T00:55:32.160065] [FATAL] [LOCAL ] SHG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:32.312771] [FATAL] [MAIN ] SHG: Failed to save derivative data. [2025-10-24T00:55:32.320320] [INFO ] [MAIN ] Derivative Progress: 1733/2164 symbols completed. SHG took 1.5s. Estimated remaining: 2m 53s. Rate: 149.2 symbols/min [2025-10-24T00:55:32.321563] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:32.326972] [INFO ] [MAIN ] SHO: Generated 139 derivative records from 49414 primary records. [2025-10-24T00:55:32.327431] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-24T00:55:32.327817] [FATAL] [LOCAL ] SHO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:32.327906] [FATAL] [MAIN ] SHO: Failed to save derivative data. [2025-10-24T00:55:32.330315] [INFO ] [MAIN ] Derivative Progress: 1734/2164 symbols completed. SHO took 1.5s. Estimated remaining: 2m 53s. Rate: 149.3 symbols/min [2025-10-24T00:55:32.330682] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:32.350959] [DEBUG] [MAIN ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:32.422926] [DEBUG] [LOCAL ] SHW: Loaded 50760 existing records from primary storage. [2025-10-24T00:55:32.436820] [INFO ] [MAIN ] SHW: Loaded 50760 primary data records. [2025-10-24T00:55:32.449160] [DEBUG] [LOCAL ] SID: Loaded 43285 existing records from primary storage. [2025-10-24T00:55:32.469980] [INFO ] [MAIN ] SID: Loaded 43285 primary data records. [2025-10-24T00:55:32.529043] [INFO ] [MAIN ] SHOC: Generated 139 derivative records from 3025 primary records. [2025-10-24T00:55:32.582252] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-24T00:55:32.628102] [FATAL] [LOCAL ] SHOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:32.645484] [FATAL] [MAIN ] SHOC: Failed to save derivative data. [2025-10-24T00:55:32.755624] [INFO ] [MAIN ] Derivative Progress: 1735/2164 symbols completed. SHOC took 0.8s. Estimated remaining: 2m 52s. Rate: 149.3 symbols/min [2025-10-24T00:55:32.766103] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:33.109552] [DEBUG] [LOCAL ] SIG: Loaded 45589 existing records from primary storage. [2025-10-24T00:55:33.125586] [INFO ] [MAIN ] SIG: Loaded 45589 primary data records. [2025-10-24T00:55:33.126666] [DEBUG] [MAIN ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:33.173428] [DEBUG] [MAIN ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:33.523176] [INFO ] [MAIN ] SHW: Generated 139 derivative records from 50760 primary records. [2025-10-24T00:55:33.525973] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-24T00:55:33.526289] [FATAL] [LOCAL ] SHW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:33.529441] [FATAL] [MAIN ] SHW: Failed to save derivative data. [2025-10-24T00:55:33.532025] [INFO ] [MAIN ] Derivative Progress: 1736/2164 symbols completed. SHW took 1.2s. Estimated remaining: 2m 52s. Rate: 149.2 symbols/min [2025-10-24T00:55:33.532566] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:33.529758] [INFO ] [MAIN ] SID: Generated 139 derivative records from 43285 primary records. [2025-10-24T00:55:33.533198] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-24T00:55:33.533488] [FATAL] [LOCAL ] SID: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:33.533728] [FATAL] [MAIN ] SID: Failed to save derivative data. [2025-10-24T00:55:33.536285] [INFO ] [MAIN ] Derivative Progress: 1737/2164 symbols completed. SID took 1.2s. Estimated remaining: 2m 52s. Rate: 149.3 symbols/min [2025-10-24T00:55:33.536556] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:33.564001] [DEBUG] [MAIN ] SIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:33.597696] [DEBUG] [LOCAL ] SII: Loaded 24307 existing records from primary storage. [2025-10-24T00:55:33.599009] [INFO ] [MAIN ] SII: Loaded 24307 primary data records. [2025-10-24T00:55:33.675768] [DEBUG] [LOCAL ] SILA: Loaded 30079 existing records from primary storage. [2025-10-24T00:55:33.724831] [INFO ] [MAIN ] SILA: Loaded 30079 primary data records. [2025-10-24T00:55:34.134779] [INFO ] [MAIN ] SIG: Generated 139 derivative records from 45589 primary records. [2025-10-24T00:55:34.163891] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-24T00:55:34.274621] [FATAL] [LOCAL ] SIG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:34.282983] [FATAL] [MAIN ] SIG: Failed to save derivative data. [2025-10-24T00:55:34.285524] [INFO ] [MAIN ] Derivative Progress: 1738/2164 symbols completed. SIG took 1.5s. Estimated remaining: 2m 51s. Rate: 149.2 symbols/min [2025-10-24T00:55:34.305727] [DEBUG] [MAIN ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:34.343347] [INFO ] [MAIN ] SII: Generated 139 derivative records from 24307 primary records. [2025-10-24T00:55:34.356317] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-24T00:55:34.356576] [FATAL] [LOCAL ] SII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:34.356697] [FATAL] [MAIN ] SII: Failed to save derivative data. [2025-10-24T00:55:34.356176] [DEBUG] [MAIN ] SILA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:34.358743] [INFO ] [MAIN ] Derivative Progress: 1739/2164 symbols completed. SII took 0.8s. Estimated remaining: 2m 51s. Rate: 149.3 symbols/min [2025-10-24T00:55:34.385677] [INFO ] [MAIN ] SILA: Generated 139 derivative records from 30079 primary records. [2025-10-24T00:55:34.385869] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-24T00:55:34.386078] [FATAL] [LOCAL ] SILA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:34.386156] [FATAL] [MAIN ] SILA: Failed to save derivative data. [2025-10-24T00:55:34.389285] [INFO ] [MAIN ] Derivative Progress: 1740/2164 symbols completed. SILA took 0.9s. Estimated remaining: 2m 50s. Rate: 149.3 symbols/min [2025-10-24T00:55:34.389725] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:34.389844] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:34.389890] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:34.446212] [DEBUG] [LOCAL ] SITC: Loaded 42011 existing records from primary storage. [2025-10-24T00:55:34.460671] [INFO ] [MAIN ] SITC: Loaded 42011 primary data records. [2025-10-24T00:55:34.497825] [DEBUG] [LOCAL ] SITE: Loaded 35740 existing records from primary storage. [2025-10-24T00:55:34.531445] [INFO ] [MAIN ] SITE: Loaded 35740 primary data records. [2025-10-24T00:55:34.712961] [DEBUG] [LOCAL ] SJM: Loaded 50444 existing records from primary storage. [2025-10-24T00:55:34.760566] [INFO ] [MAIN ] SJM: Loaded 50444 primary data records. [2025-10-24T00:55:35.439015] [DEBUG] [MAIN ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:35.439564] [DEBUG] [MAIN ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:35.502025] [DEBUG] [MAIN ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:35.547908] [INFO ] [MAIN ] SITC: Generated 139 derivative records from 42011 primary records. [2025-10-24T00:55:35.549938] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-24T00:55:35.552239] [INFO ] [MAIN ] SITE: Generated 139 derivative records from 35740 primary records. [2025-10-24T00:55:35.552853] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-24T00:55:35.553082] [FATAL] [LOCAL ] SITE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:35.552024] [FATAL] [LOCAL ] SITC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:35.555807] [FATAL] [MAIN ] SITE: Failed to save derivative data. [2025-10-24T00:55:35.556112] [FATAL] [MAIN ] SITC: Failed to save derivative data. [2025-10-24T00:55:35.558809] [INFO ] [MAIN ] Derivative Progress: 1741/2164 symbols completed. SITE took 1.2s. Estimated remaining: 2m 50s. Rate: 149.2 symbols/min [2025-10-24T00:55:35.562272] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:35.562935] [INFO ] [MAIN ] Derivative Progress: 1742/2164 symbols completed. SITC took 1.2s. Estimated remaining: 2m 50s. Rate: 149.3 symbols/min [2025-10-24T00:55:35.563067] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:35.570272] [INFO ] [MAIN ] SJM: Generated 139 derivative records from 50444 primary records. [2025-10-24T00:55:35.570497] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-24T00:55:35.570746] [FATAL] [LOCAL ] SJM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:35.570873] [FATAL] [MAIN ] SJM: Failed to save derivative data. [2025-10-24T00:55:35.573544] [INFO ] [MAIN ] Derivative Progress: 1743/2164 symbols completed. SJM took 1.2s. Estimated remaining: 2m 49s. Rate: 149.3 symbols/min [2025-10-24T00:55:35.573855] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:35.602673] [DEBUG] [LOCAL ] SJT: Loaded 22795 existing records from primary storage. [2025-10-24T00:55:35.603109] [INFO ] [MAIN ] SJT: Loaded 22795 primary data records. [2025-10-24T00:55:35.627849] [DEBUG] [LOCAL ] SKIL: Loaded 6988 existing records from primary storage. [2025-10-24T00:55:35.710905] [INFO ] [MAIN ] SKIL: Loaded 6988 primary data records. [2025-10-24T00:55:35.728375] [DEBUG] [LOCAL ] SKE: Loaded 37582 existing records from primary storage. [2025-10-24T00:55:35.794915] [INFO ] [MAIN ] SKE: Loaded 37582 primary data records. [2025-10-24T00:55:36.582386] [DEBUG] [MAIN ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:36.615464] [DEBUG] [MAIN ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:36.643998] [DEBUG] [MAIN ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:36.709485] [INFO ] [MAIN ] SJT: Generated 139 derivative records from 22795 primary records. [2025-10-24T00:55:36.713956] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-24T00:55:36.714981] [FATAL] [LOCAL ] SJT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:36.715481] [FATAL] [MAIN ] SJT: Failed to save derivative data. [2025-10-24T00:55:36.715269] [INFO ] [MAIN ] SKIL: Generated 139 derivative records from 6988 primary records. [2025-10-24T00:55:36.718961] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-24T00:55:36.719262] [FATAL] [LOCAL ] SKIL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:36.718558] [INFO ] [MAIN ] Derivative Progress: 1744/2164 symbols completed. SJT took 1.2s. Estimated remaining: 2m 49s. Rate: 149.2 symbols/min [2025-10-24T00:55:36.719610] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:36.722367] [INFO ] [MAIN ] SKE: Generated 139 derivative records from 37582 primary records. [2025-10-24T00:55:36.719369] [FATAL] [MAIN ] SKIL: Failed to save derivative data. [2025-10-24T00:55:36.722538] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-24T00:55:36.722854] [FATAL] [LOCAL ] SKE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:36.725350] [INFO ] [MAIN ] Derivative Progress: 1745/2164 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 48s. Rate: 149.3 symbols/min [2025-10-24T00:55:36.725612] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:36.725813] [FATAL] [MAIN ] SKE: Failed to save derivative data. [2025-10-24T00:55:36.728626] [INFO ] [MAIN ] Derivative Progress: 1746/2164 symbols completed. SKE took 1.2s. Estimated remaining: 2m 48s. Rate: 149.3 symbols/min [2025-10-24T00:55:36.728910] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:36.739989] [DEBUG] [LOCAL ] SKLZ: Loaded 11598 existing records from primary storage. [2025-10-24T00:55:36.740163] [INFO ] [MAIN ] SKLZ: Loaded 11598 primary data records. [2025-10-24T00:55:37.075030] [DEBUG] [LOCAL ] SKM: Loaded 35467 existing records from primary storage. [2025-10-24T00:55:37.065807] [DEBUG] [LOCAL ] SKT: Loaded 42521 existing records from primary storage. [2025-10-24T00:55:37.075795] [INFO ] [MAIN ] SKT: Loaded 42521 primary data records. [2025-10-24T00:55:37.075978] [INFO ] [MAIN ] SKM: Loaded 35467 primary data records. [2025-10-24T00:55:37.727400] [DEBUG] [MAIN ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:37.770147] [DEBUG] [MAIN ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:37.799004] [DEBUG] [MAIN ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:37.829025] [INFO ] [MAIN ] SKLZ: Generated 139 derivative records from 11598 primary records. [2025-10-24T00:55:37.832774] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-24T00:55:37.833284] [FATAL] [LOCAL ] SKLZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:37.833407] [FATAL] [MAIN ] SKLZ: Failed to save derivative data. [2025-10-24T00:55:37.836330] [INFO ] [MAIN ] Derivative Progress: 1747/2164 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 48s. Rate: 149.2 symbols/min [2025-10-24T00:55:37.836498] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:37.859573] [INFO ] [MAIN ] SKT: Generated 139 derivative records from 42521 primary records. [2025-10-24T00:55:37.861775] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-24T00:55:37.862264] [FATAL] [LOCAL ] SKT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:37.862053] [INFO ] [MAIN ] SKM: Generated 139 derivative records from 35467 primary records. [2025-10-24T00:55:37.862443] [FATAL] [MAIN ] SKT: Failed to save derivative data. [2025-10-24T00:55:37.871001] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-24T00:55:37.873030] [INFO ] [MAIN ] Derivative Progress: 1748/2164 symbols completed. SKT took 1.1s. Estimated remaining: 2m 47s. Rate: 149.3 symbols/min [2025-10-24T00:55:37.873533] [FATAL] [LOCAL ] SKM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:37.873681] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:37.873814] [FATAL] [MAIN ] SKM: Failed to save derivative data. [2025-10-24T00:55:37.876803] [INFO ] [MAIN ] Derivative Progress: 1749/2164 symbols completed. SKM took 1.2s. Estimated remaining: 2m 47s. Rate: 149.4 symbols/min [2025-10-24T00:55:37.877052] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:37.891926] [DEBUG] [LOCAL ] SKY: Loaded 38830 existing records from primary storage. [2025-10-24T00:55:37.892445] [INFO ] [MAIN ] SKY: Loaded 38830 primary data records. [2025-10-24T00:55:37.988025] [DEBUG] [LOCAL ] SKYH: Loaded 15863 existing records from primary storage. [2025-10-24T00:55:38.004350] [INFO ] [MAIN ] SKYH: Loaded 15863 primary data records. [2025-10-24T00:55:38.404140] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-24T00:55:38.516573] [INFO ] [MAIN ] SLB: Loaded 54087 primary data records. [2025-10-24T00:55:38.835935] [DEBUG] [MAIN ] SKY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:38.868109] [DEBUG] [MAIN ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:38.913386] [DEBUG] [MAIN ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:38.941583] [INFO ] [MAIN ] SKY: Generated 139 derivative records from 38830 primary records. [2025-10-24T00:55:38.942927] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-24T00:55:38.946306] [FATAL] [LOCAL ] SKY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:38.946455] [FATAL] [MAIN ] SKY: Failed to save derivative data. [2025-10-24T00:55:38.951595] [INFO ] [MAIN ] Derivative Progress: 1750/2164 symbols completed. SKY took 1.1s. Estimated remaining: 2m 46s. Rate: 149.2 symbols/min [2025-10-24T00:55:38.954493] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:38.959772] [INFO ] [MAIN ] SKYH: Generated 139 derivative records from 15863 primary records. [2025-10-24T00:55:38.961556] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-24T00:55:38.964165] [FATAL] [LOCAL ] SKYH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:38.964479] [FATAL] [MAIN ] SKYH: Failed to save derivative data. [2025-10-24T00:55:38.968932] [INFO ] [MAIN ] Derivative Progress: 1751/2164 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 46s. Rate: 149.3 symbols/min [2025-10-24T00:55:38.971973] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:38.976581] [INFO ] [MAIN ] SLB: Generated 139 derivative records from 54087 primary records. [2025-10-24T00:55:38.976888] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-24T00:55:38.977183] [FATAL] [LOCAL ] SLB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:38.977312] [FATAL] [MAIN ] SLB: Failed to save derivative data. [2025-10-24T00:55:38.979844] [INFO ] [MAIN ] Derivative Progress: 1752/2164 symbols completed. SLB took 1.1s. Estimated remaining: 2m 45s. Rate: 149.4 symbols/min [2025-10-24T00:55:38.988672] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:39.010237] [DEBUG] [LOCAL ] SLF: Loaded 38557 existing records from primary storage. [2025-10-24T00:55:39.010586] [INFO ] [MAIN ] SLF: Loaded 38557 primary data records. [2025-10-24T00:55:39.180476] [DEBUG] [LOCAL ] SLG: Loaded 46144 existing records from primary storage. [2025-10-24T00:55:39.211765] [INFO ] [MAIN ] SLG: Loaded 46144 primary data records. [2025-10-24T00:55:39.414207] [DEBUG] [LOCAL ] SLGN: Loaded 41337 existing records from primary storage. [2025-10-24T00:55:39.446336] [INFO ] [MAIN ] SLGN: Loaded 41337 primary data records. [2025-10-24T00:55:40.017132] [DEBUG] [MAIN ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:40.053768] [DEBUG] [MAIN ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:40.108890] [DEBUG] [MAIN ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:40.129370] [INFO ] [MAIN ] SLF: Generated 139 derivative records from 38557 primary records. [2025-10-24T00:55:40.129610] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-24T00:55:40.131013] [FATAL] [LOCAL ] SLF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:40.131359] [FATAL] [MAIN ] SLF: Failed to save derivative data. [2025-10-24T00:55:40.136265] [INFO ] [MAIN ] Derivative Progress: 1753/2164 symbols completed. SLF took 1.2s. Estimated remaining: 2m 45s. Rate: 149.2 symbols/min [2025-10-24T00:55:40.151149] [INFO ] [MAIN ] SLG: Generated 139 derivative records from 46144 primary records. [2025-10-24T00:55:40.154886] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-24T00:55:40.155371] [FATAL] [LOCAL ] SLG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:40.155577] [FATAL] [MAIN ] SLG: Failed to save derivative data. [2025-10-24T00:55:40.157842] [INFO ] [MAIN ] Derivative Progress: 1754/2164 symbols completed. SLG took 1.2s. Estimated remaining: 2m 45s. Rate: 149.3 symbols/min [2025-10-24T00:55:40.163606] [INFO ] [MAIN ] SLGN: Generated 139 derivative records from 41337 primary records. [2025-10-24T00:55:40.163743] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-24T00:55:40.163943] [FATAL] [LOCAL ] SLGN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:40.164020] [FATAL] [MAIN ] SLGN: Failed to save derivative data. [2025-10-24T00:55:40.166572] [INFO ] [MAIN ] Derivative Progress: 1755/2164 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 44s. Rate: 149.4 symbols/min [2025-10-24T00:55:40.166990] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:40.167130] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:40.167068] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:40.208037] [DEBUG] [LOCAL ] SLVM: Loaded 27918 existing records from primary storage. [2025-10-24T00:55:40.221476] [INFO ] [MAIN ] SLVM: Loaded 27918 primary data records. [2025-10-24T00:55:40.334076] [DEBUG] [LOCAL ] SLQT: Loaded 43671 existing records from primary storage. [2025-10-24T00:55:40.351677] [INFO ] [MAIN ] SLQT: Loaded 43671 primary data records. [2025-10-24T00:55:40.379804] [DEBUG] [LOCAL ] SM: Loaded 52743 existing records from primary storage. [2025-10-24T00:55:40.407069] [INFO ] [MAIN ] SM: Loaded 52743 primary data records. [2025-10-24T00:55:41.185990] [DEBUG] [MAIN ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:41.210694] [DEBUG] [MAIN ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:41.251198] [DEBUG] [MAIN ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:41.308355] [INFO ] [MAIN ] SLVM: Generated 139 derivative records from 27918 primary records. [2025-10-24T00:55:41.311780] [INFO ] [MAIN ] SLQT: Generated 139 derivative records from 43671 primary records. [2025-10-24T00:55:41.311483] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-24T00:55:41.312553] [FATAL] [LOCAL ] SLVM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:41.314689] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-24T00:55:41.314965] [FATAL] [MAIN ] SLVM: Failed to save derivative data. [2025-10-24T00:55:41.317577] [FATAL] [LOCAL ] SLQT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:41.316993] [INFO ] [MAIN ] Derivative Progress: 1756/2164 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 44s. Rate: 149.2 symbols/min [2025-10-24T00:55:41.317930] [FATAL] [MAIN ] SLQT: Failed to save derivative data. [2025-10-24T00:55:41.318075] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:41.320707] [INFO ] [MAIN ] Derivative Progress: 1757/2164 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 44s. Rate: 149.3 symbols/min [2025-10-24T00:55:41.322367] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:41.325141] [INFO ] [MAIN ] SM: Generated 139 derivative records from 52743 primary records. [2025-10-24T00:55:41.325820] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-24T00:55:41.326281] [FATAL] [LOCAL ] SM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:41.326459] [FATAL] [MAIN ] SM: Failed to save derivative data. [2025-10-24T00:55:41.329189] [INFO ] [MAIN ] Derivative Progress: 1758/2164 symbols completed. SM took 1.2s. Estimated remaining: 2m 43s. Rate: 149.4 symbols/min [2025-10-24T00:55:41.329358] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:41.343959] [DEBUG] [LOCAL ] SMBK: Loaded 8331 existing records from primary storage. [2025-10-24T00:55:41.344282] [DEBUG] [LOCAL ] SMC: Loaded 10961 existing records from primary storage. [2025-10-24T00:55:41.344510] [INFO ] [MAIN ] SMBK: Loaded 8331 primary data records. [2025-10-24T00:55:41.349854] [INFO ] [MAIN ] SMC: Loaded 10961 primary data records. [2025-10-24T00:55:41.753512] [DEBUG] [LOCAL ] SMFG: Loaded 48644 existing records from primary storage. [2025-10-24T00:55:42.012154] [INFO ] [MAIN ] SMFG: Loaded 48644 primary data records. [2025-10-24T00:55:42.383919] [DEBUG] [MAIN ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:42.383108] [DEBUG] [MAIN ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:42.451776] [DEBUG] [MAIN ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:42.506554] [INFO ] [MAIN ] SMBK: Generated 139 derivative records from 8331 primary records. [2025-10-24T00:55:42.506181] [INFO ] [MAIN ] SMC: Generated 139 derivative records from 10961 primary records. [2025-10-24T00:55:42.508259] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-24T00:55:42.508713] [FATAL] [LOCAL ] SMBK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:42.508399] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-24T00:55:42.509065] [FATAL] [MAIN ] SMBK: Failed to save derivative data. [2025-10-24T00:55:42.509317] [FATAL] [LOCAL ] SMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:42.509698] [FATAL] [MAIN ] SMC: Failed to save derivative data. [2025-10-24T00:55:42.512117] [INFO ] [MAIN ] Derivative Progress: 1759/2164 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 43s. Rate: 149.2 symbols/min [2025-10-24T00:55:42.517559] [INFO ] [MAIN ] Derivative Progress: 1760/2164 symbols completed. SMC took 1.2s. Estimated remaining: 2m 42s. Rate: 149.3 symbols/min [2025-10-24T00:55:42.517444] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:42.518073] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:42.526144] [INFO ] [MAIN ] SMFG: Generated 139 derivative records from 48644 primary records. [2025-10-24T00:55:42.526384] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-24T00:55:42.526666] [FATAL] [LOCAL ] SMFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:42.530418] [FATAL] [MAIN ] SMFG: Failed to save derivative data. [2025-10-24T00:55:42.533394] [INFO ] [MAIN ] Derivative Progress: 1761/2164 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 42s. Rate: 149.4 symbols/min [2025-10-24T00:55:42.533732] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:42.540525] [DEBUG] [LOCAL ] SMHI: Loaded 12718 existing records from primary storage. [2025-10-24T00:55:42.540738] [INFO ] [MAIN ] SMHI: Loaded 12718 primary data records. [2025-10-24T00:55:42.676152] [DEBUG] [LOCAL ] SMP: Loaded 18750 existing records from primary storage. [2025-10-24T00:55:42.692831] [INFO ] [MAIN ] SMP: Loaded 18750 primary data records. [2025-10-24T00:55:43.033510] [DEBUG] [LOCAL ] SMG: Loaded 42957 existing records from primary storage. [2025-10-24T00:55:43.037239] [INFO ] [MAIN ] SMG: Loaded 42957 primary data records. [2025-10-24T00:55:43.613959] [DEBUG] [MAIN ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:43.644739] [DEBUG] [MAIN ] SMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:43.695361] [DEBUG] [MAIN ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:43.725545] [INFO ] [MAIN ] SMHI: Generated 139 derivative records from 12718 primary records. [2025-10-24T00:55:43.726984] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-24T00:55:43.727452] [FATAL] [LOCAL ] SMHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:43.728732] [FATAL] [MAIN ] SMHI: Failed to save derivative data. [2025-10-24T00:55:43.730901] [INFO ] [MAIN ] Derivative Progress: 1762/2164 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 42s. Rate: 149.2 symbols/min [2025-10-24T00:55:43.731564] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:43.736283] [INFO ] [MAIN ] SMP: Generated 139 derivative records from 18750 primary records. [2025-10-24T00:55:43.736787] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-24T00:55:43.737222] [FATAL] [LOCAL ] SMP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:43.741562] [FATAL] [MAIN ] SMP: Failed to save derivative data. [2025-10-24T00:55:43.744040] [INFO ] [MAIN ] Derivative Progress: 1763/2164 symbols completed. SMP took 1.2s. Estimated remaining: 2m 41s. Rate: 149.3 symbols/min [2025-10-24T00:55:43.745432] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:43.751630] [INFO ] [MAIN ] SMG: Generated 139 derivative records from 42957 primary records. [2025-10-24T00:55:43.751958] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-24T00:55:43.752172] [FATAL] [LOCAL ] SMG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:43.752245] [FATAL] [MAIN ] SMG: Failed to save derivative data. [2025-10-24T00:55:43.754954] [INFO ] [MAIN ] Derivative Progress: 1764/2164 symbols completed. SMG took 1.2s. Estimated remaining: 2m 41s. Rate: 149.4 symbols/min [2025-10-24T00:55:43.755238] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:43.805496] [DEBUG] [LOCAL ] SMWB: Loaded 31720 existing records from primary storage. [2025-10-24T00:55:43.805755] [INFO ] [MAIN ] SMWB: Loaded 31720 primary data records. [2025-10-24T00:55:43.926322] [DEBUG] [LOCAL ] SMRT: Loaded 44050 existing records from primary storage. [2025-10-24T00:55:43.939692] [INFO ] [MAIN ] SMRT: Loaded 44050 primary data records. [2025-10-24T00:55:43.939275] [DEBUG] [LOCAL ] SMR: Loaded 54189 existing records from primary storage. [2025-10-24T00:55:43.972125] [INFO ] [MAIN ] SMR: Loaded 54189 primary data records. [2025-10-24T00:55:44.775780] [DEBUG] [MAIN ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:44.811070] [DEBUG] [MAIN ] SMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:44.842061] [DEBUG] [MAIN ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:44.901979] [INFO ] [MAIN ] SMWB: Generated 139 derivative records from 31720 primary records. [2025-10-24T00:55:44.905912] [INFO ] [MAIN ] SMR: Generated 139 derivative records from 54189 primary records. [2025-10-24T00:55:44.905462] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-24T00:55:44.906282] [FATAL] [LOCAL ] SMWB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:44.906074] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-24T00:55:44.908790] [FATAL] [MAIN ] SMWB: Failed to save derivative data. [2025-10-24T00:55:44.909177] [FATAL] [LOCAL ] SMR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:44.911309] [INFO ] [MAIN ] Derivative Progress: 1765/2164 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 40s. Rate: 149.2 symbols/min [2025-10-24T00:55:44.909516] [FATAL] [MAIN ] SMR: Failed to save derivative data. [2025-10-24T00:55:44.912593] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:44.915921] [INFO ] [MAIN ] Derivative Progress: 1766/2164 symbols completed. SMR took 1.2s. Estimated remaining: 2m 40s. Rate: 149.3 symbols/min [2025-10-24T00:55:44.916174] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:44.918954] [INFO ] [MAIN ] SMRT: Generated 139 derivative records from 44050 primary records. [2025-10-24T00:55:44.919498] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-24T00:55:44.919763] [FATAL] [LOCAL ] SMRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:44.919914] [FATAL] [MAIN ] SMRT: Failed to save derivative data. [2025-10-24T00:55:44.922912] [INFO ] [MAIN ] Derivative Progress: 1767/2164 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 39s. Rate: 149.4 symbols/min [2025-10-24T00:55:44.923150] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:44.959370] [DEBUG] [LOCAL ] SNA: Loaded 25908 existing records from primary storage. [2025-10-24T00:55:44.959608] [INFO ] [MAIN ] SNA: Loaded 25908 primary data records. [2025-10-24T00:55:45.077222] [DEBUG] [LOCAL ] SN: Loaded 50369 existing records from primary storage. [2025-10-24T00:55:45.117794] [INFO ] [MAIN ] SN: Loaded 50369 primary data records. [2025-10-24T00:55:45.377396] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-24T00:55:45.396505] [INFO ] [MAIN ] SNAP: Loaded 54186 primary data records. [2025-10-24T00:55:45.994045] [DEBUG] [MAIN ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:46.038005] [DEBUG] [MAIN ] SN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:46.080722] [DEBUG] [MAIN ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:46.122600] [INFO ] [MAIN ] SNA: Generated 139 derivative records from 25908 primary records. [2025-10-24T00:55:46.126633] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-24T00:55:46.127821] [FATAL] [LOCAL ] SNA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:46.132985] [FATAL] [MAIN ] SNA: Failed to save derivative data. [2025-10-24T00:55:46.135560] [INFO ] [MAIN ] Derivative Progress: 1768/2164 symbols completed. SNA took 1.2s. Estimated remaining: 2m 39s. Rate: 149.2 symbols/min [2025-10-24T00:55:46.142365] [INFO ] [MAIN ] SN: Generated 139 derivative records from 50369 primary records. [2025-10-24T00:55:46.143180] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-24T00:55:46.143438] [FATAL] [LOCAL ] SN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:46.144585] [FATAL] [MAIN ] SN: Failed to save derivative data. [2025-10-24T00:55:46.147113] [INFO ] [MAIN ] Derivative Progress: 1769/2164 symbols completed. SN took 1.2s. Estimated remaining: 2m 39s. Rate: 149.3 symbols/min [2025-10-24T00:55:46.152122] [INFO ] [MAIN ] SNAP: Generated 139 derivative records from 54186 primary records. [2025-10-24T00:55:46.152259] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-24T00:55:46.152522] [FATAL] [LOCAL ] SNAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:46.152611] [FATAL] [MAIN ] SNAP: Failed to save derivative data. [2025-10-24T00:55:46.155348] [INFO ] [MAIN ] Derivative Progress: 1770/2164 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 38s. Rate: 149.4 symbols/min [2025-10-24T00:55:46.156013] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:46.155914] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:46.155825] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:46.167436] [DEBUG] [LOCAL ] SNDA: Loaded 4490 existing records from primary storage. [2025-10-24T00:55:46.167595] [INFO ] [MAIN ] SNDA: Loaded 4490 primary data records. [2025-10-24T00:55:46.517413] [DEBUG] [LOCAL ] SNDR: Loaded 41922 existing records from primary storage. [2025-10-24T00:55:46.518404] [DEBUG] [LOCAL ] SNN: Loaded 44659 existing records from primary storage. [2025-10-24T00:55:46.519708] [INFO ] [MAIN ] SNDR: Loaded 41922 primary data records. [2025-10-24T00:55:46.520054] [INFO ] [MAIN ] SNN: Loaded 44659 primary data records. [2025-10-24T00:55:47.157382] [DEBUG] [MAIN ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:47.213470] [INFO ] [MAIN ] SNDA: Generated 139 derivative records from 4490 primary records. [2025-10-24T00:55:47.215624] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-24T00:55:47.216335] [FATAL] [LOCAL ] SNDA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:47.228875] [FATAL] [MAIN ] SNDA: Failed to save derivative data. [2025-10-24T00:55:47.231904] [INFO ] [MAIN ] Derivative Progress: 1771/2164 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 38s. Rate: 149.2 symbols/min [2025-10-24T00:55:47.232574] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:47.232445] [DEBUG] [MAIN ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:47.268958] [DEBUG] [MAIN ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:47.352737] [DEBUG] [LOCAL ] SNOW: Loaded 53967 existing records from primary storage. [2025-10-24T00:55:47.355158] [INFO ] [MAIN ] SNOW: Loaded 53967 primary data records. [2025-10-24T00:55:47.428886] [INFO ] [MAIN ] SNDR: Generated 139 derivative records from 41922 primary records. [2025-10-24T00:55:47.451379] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-24T00:55:47.465679] [FATAL] [LOCAL ] SNDR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:47.469525] [FATAL] [MAIN ] SNDR: Failed to save derivative data. [2025-10-24T00:55:47.481066] [INFO ] [MAIN ] Derivative Progress: 1772/2164 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 38s. Rate: 149.3 symbols/min [2025-10-24T00:55:47.481724] [INFO ] [MAIN ] SNN: Generated 139 derivative records from 44659 primary records. [2025-10-24T00:55:47.502948] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-24T00:55:47.502712] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:47.519254] [FATAL] [LOCAL ] SNN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:47.519898] [FATAL] [MAIN ] SNN: Failed to save derivative data. [2025-10-24T00:55:47.562459] [INFO ] [MAIN ] Derivative Progress: 1773/2164 symbols completed. SNN took 1.4s. Estimated remaining: 2m 37s. Rate: 149.3 symbols/min [2025-10-24T00:55:47.681467] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:47.730140] [DEBUG] [MAIN ] SNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:47.767393] [DEBUG] [LOCAL ] SNV: Loaded 49425 existing records from primary storage. [2025-10-24T00:55:47.767969] [INFO ] [MAIN ] SNV: Loaded 49425 primary data records. [2025-10-24T00:55:47.886851] [DEBUG] [LOCAL ] SNX: Loaded 39146 existing records from primary storage. [2025-10-24T00:55:47.931815] [INFO ] [MAIN ] SNX: Loaded 39146 primary data records. [2025-10-24T00:55:48.453847] [INFO ] [MAIN ] SNOW: Generated 139 derivative records from 53967 primary records. [2025-10-24T00:55:48.455412] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-24T00:55:48.456409] [FATAL] [LOCAL ] SNOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:48.456787] [FATAL] [MAIN ] SNOW: Failed to save derivative data. [2025-10-24T00:55:48.458750] [INFO ] [MAIN ] Derivative Progress: 1774/2164 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 37s. Rate: 149.2 symbols/min [2025-10-24T00:55:48.459091] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:48.481335] [DEBUG] [MAIN ] SNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:48.514107] [DEBUG] [MAIN ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:48.582991] [DEBUG] [LOCAL ] SO: Loaded 54005 existing records from primary storage. [2025-10-24T00:55:48.587870] [INFO ] [MAIN ] SO: Loaded 54005 primary data records. [2025-10-24T00:55:48.600261] [INFO ] [MAIN ] SNV: Generated 139 derivative records from 49425 primary records. [2025-10-24T00:55:48.616850] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-24T00:55:48.632389] [FATAL] [LOCAL ] SNV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:48.639595] [FATAL] [MAIN ] SNV: Failed to save derivative data. [2025-10-24T00:55:48.663895] [INFO ] [MAIN ] Derivative Progress: 1775/2164 symbols completed. SNV took 1.2s. Estimated remaining: 2m 36s. Rate: 149.3 symbols/min [2025-10-24T00:55:48.691605] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:48.737392] [INFO ] [MAIN ] SNX: Generated 139 derivative records from 39146 primary records. [2025-10-24T00:55:48.759164] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-24T00:55:48.759462] [FATAL] [LOCAL ] SNX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:48.770087] [FATAL] [MAIN ] SNX: Failed to save derivative data. [2025-10-24T00:55:48.913164] [INFO ] [MAIN ] Derivative Progress: 1776/2164 symbols completed. SNX took 1.2s. Estimated remaining: 2m 36s. Rate: 149.3 symbols/min [2025-10-24T00:55:48.914182] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:48.931035] [DEBUG] [LOCAL ] SOBO: Loaded 39668 existing records from primary storage. [2025-10-24T00:55:48.931706] [INFO ] [MAIN ] SOBO: Loaded 39668 primary data records. [2025-10-24T00:55:49.290191] [DEBUG] [LOCAL ] SOC: Loaded 51616 existing records from primary storage. [2025-10-24T00:55:49.288417] [DEBUG] [MAIN ] SO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:49.302349] [INFO ] [MAIN ] SOC: Loaded 51616 primary data records. [2025-10-24T00:55:49.642896] [DEBUG] [MAIN ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:49.661635] [INFO ] [MAIN ] SO: Generated 139 derivative records from 54005 primary records. [2025-10-24T00:55:49.663294] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-24T00:55:49.666312] [FATAL] [LOCAL ] SO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:49.667958] [FATAL] [MAIN ] SO: Failed to save derivative data. [2025-10-24T00:55:49.672713] [INFO ] [MAIN ] Derivative Progress: 1777/2164 symbols completed. SO took 1.2s. Estimated remaining: 2m 36s. Rate: 149.2 symbols/min [2025-10-24T00:55:49.676180] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:49.690304] [DEBUG] [LOCAL ] SOJC: Loaded 4596 existing records from primary storage. [2025-10-24T00:55:49.692602] [INFO ] [MAIN ] SOJC: Loaded 4596 primary data records. [2025-10-24T00:55:49.780450] [INFO ] [MAIN ] SOBO: Generated 139 derivative records from 39668 primary records. [2025-10-24T00:55:49.813333] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-24T00:55:49.813734] [FATAL] [LOCAL ] SOBO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:49.814313] [DEBUG] [MAIN ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:49.814093] [FATAL] [MAIN ] SOBO: Failed to save derivative data. [2025-10-24T00:55:49.835226] [INFO ] [MAIN ] Derivative Progress: 1778/2164 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 35s. Rate: 149.3 symbols/min [2025-10-24T00:55:49.850891] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:50.069187] [DEBUG] [LOCAL ] SOJD: Loaded 12651 existing records from primary storage. [2025-10-24T00:55:50.075341] [INFO ] [MAIN ] SOJD: Loaded 12651 primary data records. [2025-10-24T00:55:50.392981] [INFO ] [MAIN ] SOC: Generated 139 derivative records from 51616 primary records. [2025-10-24T00:55:50.394176] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-24T00:55:50.394619] [FATAL] [LOCAL ] SOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:50.408152] [FATAL] [MAIN ] SOC: Failed to save derivative data. [2025-10-24T00:55:50.411082] [INFO ] [MAIN ] Derivative Progress: 1779/2164 symbols completed. SOC took 1.5s. Estimated remaining: 2m 35s. Rate: 149.3 symbols/min [2025-10-24T00:55:50.408010] [DEBUG] [MAIN ] SOJC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:50.411447] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:50.446374] [DEBUG] [LOCAL ] SOJE: Loaded 8744 existing records from primary storage. [2025-10-24T00:55:50.447687] [INFO ] [MAIN ] SOJE: Loaded 8744 primary data records. [2025-10-24T00:55:50.594672] [DEBUG] [MAIN ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:50.688907] [INFO ] [MAIN ] SOJC: Generated 139 derivative records from 4596 primary records. [2025-10-24T00:55:50.798915] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-24T00:55:50.799322] [FATAL] [LOCAL ] SOJC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:50.807366] [FATAL] [MAIN ] SOJC: Failed to save derivative data. [2025-10-24T00:55:50.811344] [INFO ] [MAIN ] Derivative Progress: 1780/2164 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 34s. Rate: 149.3 symbols/min [2025-10-24T00:55:50.811699] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:50.837414] [DEBUG] [LOCAL ] SOL: Loaded 13627 existing records from primary storage. [2025-10-24T00:55:50.838524] [INFO ] [MAIN ] SOL: Loaded 13627 primary data records. [2025-10-24T00:55:50.957545] [INFO ] [MAIN ] SOJD: Generated 139 derivative records from 12651 primary records. [2025-10-24T00:55:50.958168] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-24T00:55:50.958568] [FATAL] [LOCAL ] SOJD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:50.969700] [FATAL] [MAIN ] SOJD: Failed to save derivative data. [2025-10-24T00:55:50.977421] [INFO ] [MAIN ] Derivative Progress: 1781/2164 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 34s. Rate: 149.3 symbols/min [2025-10-24T00:55:50.997741] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:50.998219] [DEBUG] [MAIN ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:51.235029] [INFO ] [MAIN ] SOJE: Generated 139 derivative records from 8744 primary records. [2025-10-24T00:55:51.235545] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-24T00:55:51.236018] [FATAL] [LOCAL ] SOJE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:51.236882] [FATAL] [MAIN ] SOJE: Failed to save derivative data. [2025-10-24T00:55:51.236688] [DEBUG] [LOCAL ] SOLV: Loaded 43676 existing records from primary storage. [2025-10-24T00:55:51.237252] [INFO ] [MAIN ] SOLV: Loaded 43676 primary data records. [2025-10-24T00:55:51.239721] [INFO ] [MAIN ] Derivative Progress: 1782/2164 symbols completed. SOJE took 0.8s. Estimated remaining: 2m 33s. Rate: 149.3 symbols/min [2025-10-24T00:55:51.251277] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:51.410700] [DEBUG] [MAIN ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:51.611069] [DEBUG] [LOCAL ] SON: Loaded 43926 existing records from primary storage. [2025-10-24T00:55:51.613905] [INFO ] [MAIN ] SON: Loaded 43926 primary data records. [2025-10-24T00:55:51.682504] [INFO ] [MAIN ] SOL: Generated 139 derivative records from 13627 primary records. [2025-10-24T00:55:51.704809] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-24T00:55:51.723684] [FATAL] [LOCAL ] SOL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:51.724382] [FATAL] [MAIN ] SOL: Failed to save derivative data. [2025-10-24T00:55:51.737113] [INFO ] [MAIN ] Derivative Progress: 1783/2164 symbols completed. SOL took 0.9s. Estimated remaining: 2m 33s. Rate: 149.3 symbols/min [2025-10-24T00:55:51.786396] [DEBUG] [MAIN ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:51.994697] [INFO ] [MAIN ] SOLV: Generated 139 derivative records from 43676 primary records. [2025-10-24T00:55:51.995522] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-24T00:55:51.995761] [FATAL] [LOCAL ] SOLV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:51.995838] [FATAL] [MAIN ] SOLV: Failed to save derivative data. [2025-10-24T00:55:51.997859] [INFO ] [MAIN ] Derivative Progress: 1784/2164 symbols completed. SOLV took 1.0s. Estimated remaining: 2m 33s. Rate: 149.3 symbols/min [2025-10-24T00:55:52.015118] [DEBUG] [MAIN ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:52.039912] [INFO ] [MAIN ] SON: Generated 139 derivative records from 43926 primary records. [2025-10-24T00:55:52.040029] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-24T00:55:52.040209] [FATAL] [LOCAL ] SON: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:52.040286] [FATAL] [MAIN ] SON: Failed to save derivative data. [2025-10-24T00:55:52.042417] [INFO ] [MAIN ] Derivative Progress: 1785/2164 symbols completed. SON took 0.8s. Estimated remaining: 2m 32s. Rate: 149.4 symbols/min [2025-10-24T00:55:52.042909] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:52.043031] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:52.043363] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:52.052893] [DEBUG] [LOCAL ] SOR: Loaded 2831 existing records from primary storage. [2025-10-24T00:55:52.053122] [INFO ] [MAIN ] SOR: Loaded 2831 primary data records. [2025-10-24T00:55:52.100532] [DEBUG] [LOCAL ] SOS: Loaded 9744 existing records from primary storage. [2025-10-24T00:55:52.136925] [INFO ] [MAIN ] SOS: Loaded 9744 primary data records. [2025-10-24T00:55:52.512305] [DEBUG] [LOCAL ] SONY: Loaded 53765 existing records from primary storage. [2025-10-24T00:55:52.533900] [INFO ] [MAIN ] SONY: Loaded 53765 primary data records. [2025-10-24T00:55:53.013527] [DEBUG] [MAIN ] SOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:53.043255] [DEBUG] [MAIN ] SOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:53.094508] [DEBUG] [MAIN ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:53.128667] [INFO ] [MAIN ] SOR: Generated 139 derivative records from 2831 primary records. [2025-10-24T00:55:53.131621] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-24T00:55:53.132145] [FATAL] [LOCAL ] SOR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:53.133135] [FATAL] [MAIN ] SOR: Failed to save derivative data. [2025-10-24T00:55:53.135356] [INFO ] [MAIN ] Derivative Progress: 1786/2164 symbols completed. SOR took 1.1s. Estimated remaining: 2m 32s. Rate: 149.3 symbols/min [2025-10-24T00:55:53.137887] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:53.140783] [INFO ] [MAIN ] SOS: Generated 139 derivative records from 9744 primary records. [2025-10-24T00:55:53.142006] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-24T00:55:53.142580] [FATAL] [LOCAL ] SOS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:53.145478] [FATAL] [MAIN ] SOS: Failed to save derivative data. [2025-10-24T00:55:53.147473] [INFO ] [MAIN ] Derivative Progress: 1787/2164 symbols completed. SOS took 1.1s. Estimated remaining: 2m 31s. Rate: 149.4 symbols/min [2025-10-24T00:55:53.147943] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:53.155942] [INFO ] [MAIN ] SONY: Generated 139 derivative records from 53765 primary records. [2025-10-24T00:55:53.156295] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-24T00:55:53.156581] [FATAL] [LOCAL ] SONY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:53.156699] [FATAL] [MAIN ] SONY: Failed to save derivative data. [2025-10-24T00:55:53.159238] [INFO ] [MAIN ] Derivative Progress: 1788/2164 symbols completed. SONY took 1.1s. Estimated remaining: 2m 31s. Rate: 149.4 symbols/min [2025-10-24T00:55:53.159588] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:53.185808] [DEBUG] [LOCAL ] SPE: Loaded 6180 existing records from primary storage. [2025-10-24T00:55:53.186101] [INFO ] [MAIN ] SPE: Loaded 6180 primary data records. [2025-10-24T00:55:53.186619] [DEBUG] [LOCAL ] SPB: Loaded 34159 existing records from primary storage. [2025-10-24T00:55:53.234279] [INFO ] [MAIN ] SPB: Loaded 34159 primary data records. [2025-10-24T00:55:53.435402] [DEBUG] [LOCAL ] SPCE: Loaded 50424 existing records from primary storage. [2025-10-24T00:55:53.623500] [INFO ] [MAIN ] SPCE: Loaded 50424 primary data records. [2025-10-24T00:55:54.147559] [DEBUG] [MAIN ] SPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:54.180450] [DEBUG] [MAIN ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:54.220922] [DEBUG] [MAIN ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:54.264838] [INFO ] [MAIN ] SPE: Generated 139 derivative records from 6180 primary records. [2025-10-24T00:55:54.266666] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-24T00:55:54.269342] [FATAL] [LOCAL ] SPE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:54.272455] [FATAL] [MAIN ] SPE: Failed to save derivative data. [2025-10-24T00:55:54.274866] [INFO ] [MAIN ] Derivative Progress: 1789/2164 symbols completed. SPE took 1.1s. Estimated remaining: 2m 31s. Rate: 149.3 symbols/min [2025-10-24T00:55:54.275805] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:54.282555] [INFO ] [MAIN ] SPB: Generated 139 derivative records from 34159 primary records. [2025-10-24T00:55:54.282760] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-24T00:55:54.284049] [FATAL] [LOCAL ] SPB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:54.284416] [FATAL] [MAIN ] SPB: Failed to save derivative data. [2025-10-24T00:55:54.286717] [INFO ] [MAIN ] Derivative Progress: 1790/2164 symbols completed. SPB took 1.1s. Estimated remaining: 2m 30s. Rate: 149.4 symbols/min [2025-10-24T00:55:54.289236] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:54.293377] [INFO ] [MAIN ] SPCE: Generated 139 derivative records from 50424 primary records. [2025-10-24T00:55:54.293702] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-24T00:55:54.293915] [FATAL] [LOCAL ] SPCE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:54.293991] [FATAL] [MAIN ] SPCE: Failed to save derivative data. [2025-10-24T00:55:54.296612] [INFO ] [MAIN ] Derivative Progress: 1791/2164 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 30s. Rate: 149.5 symbols/min [2025-10-24T00:55:54.296998] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:54.323535] [DEBUG] [LOCAL ] SPH: Loaded 16559 existing records from primary storage. [2025-10-24T00:55:54.323715] [INFO ] [MAIN ] SPH: Loaded 16559 primary data records. [2025-10-24T00:55:54.464811] [DEBUG] [LOCAL ] SPG: Loaded 50304 existing records from primary storage. [2025-10-24T00:55:54.476693] [DEBUG] [LOCAL ] SPGI: Loaded 46248 existing records from primary storage. [2025-10-24T00:55:54.492276] [INFO ] [MAIN ] SPGI: Loaded 46248 primary data records. [2025-10-24T00:55:54.492186] [INFO ] [MAIN ] SPG: Loaded 50304 primary data records. [2025-10-24T00:55:55.275415] [DEBUG] [MAIN ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:55.342580] [DEBUG] [MAIN ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:55.358577] [DEBUG] [MAIN ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:55.381543] [INFO ] [MAIN ] SPH: Generated 139 derivative records from 16559 primary records. [2025-10-24T00:55:55.381950] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-24T00:55:55.382578] [FATAL] [LOCAL ] SPH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:55.386571] [FATAL] [MAIN ] SPH: Failed to save derivative data. [2025-10-24T00:55:55.389308] [INFO ] [MAIN ] Derivative Progress: 1792/2164 symbols completed. SPH took 1.1s. Estimated remaining: 2m 29s. Rate: 149.3 symbols/min [2025-10-24T00:55:55.393287] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:55.421797] [INFO ] [MAIN ] SPG: Generated 139 derivative records from 50304 primary records. [2025-10-24T00:55:55.422316] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-24T00:55:55.422574] [FATAL] [LOCAL ] SPG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:55.424030] [FATAL] [MAIN ] SPG: Failed to save derivative data. [2025-10-24T00:55:55.437709] [INFO ] [MAIN ] Derivative Progress: 1793/2164 symbols completed. SPG took 1.2s. Estimated remaining: 2m 29s. Rate: 149.4 symbols/min [2025-10-24T00:55:55.437971] [INFO ] [MAIN ] SPGI: Generated 139 derivative records from 46248 primary records. [2025-10-24T00:55:55.438346] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-24T00:55:55.438232] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:55.438696] [FATAL] [LOCAL ] SPGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:55.439166] [FATAL] [MAIN ] SPGI: Failed to save derivative data. [2025-10-24T00:55:55.441629] [INFO ] [MAIN ] Derivative Progress: 1794/2164 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 29s. Rate: 149.5 symbols/min [2025-10-24T00:55:55.441889] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:55.457134] [DEBUG] [LOCAL ] SPHR: Loaded 40951 existing records from primary storage. [2025-10-24T00:55:55.457544] [INFO ] [MAIN ] SPHR: Loaded 40951 primary data records. [2025-10-24T00:55:55.497240] [DEBUG] [LOCAL ] SPMC: Loaded 5288 existing records from primary storage. [2025-10-24T00:55:55.524868] [INFO ] [MAIN ] SPMC: Loaded 5288 primary data records. [2025-10-24T00:55:56.099286] [DEBUG] [LOCAL ] SPIR: Loaded 37729 existing records from primary storage. [2025-10-24T00:55:56.114599] [INFO ] [MAIN ] SPIR: Loaded 37729 primary data records. [2025-10-24T00:55:56.446104] [DEBUG] [MAIN ] SPMC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:55:56.473117] [DEBUG] [MAIN ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:56.528155] [DEBUG] [MAIN ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:56.563229] [INFO ] [MAIN ] SPMC: Generated 139 derivative records from 5288 primary records. [2025-10-24T00:55:56.566356] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-24T00:55:56.571051] [FATAL] [LOCAL ] SPMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:56.571383] [INFO ] [MAIN ] SPHR: Generated 139 derivative records from 40951 primary records. [2025-10-24T00:55:56.572018] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-24T00:55:56.571836] [FATAL] [MAIN ] SPMC: Failed to save derivative data. [2025-10-24T00:55:56.572481] [FATAL] [LOCAL ] SPHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:56.573400] [FATAL] [MAIN ] SPHR: Failed to save derivative data. [2025-10-24T00:55:56.575806] [INFO ] [MAIN ] Derivative Progress: 1795/2164 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 28s. Rate: 149.3 symbols/min [2025-10-24T00:55:56.582433] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:56.582520] [INFO ] [MAIN ] Derivative Progress: 1796/2164 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 28s. Rate: 149.4 symbols/min [2025-10-24T00:55:56.583614] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:56.591564] [INFO ] [MAIN ] SPIR: Generated 139 derivative records from 37729 primary records. [2025-10-24T00:55:56.591775] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-24T00:55:56.591974] [FATAL] [LOCAL ] SPIR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:56.592050] [FATAL] [MAIN ] SPIR: Failed to save derivative data. [2025-10-24T00:55:56.594472] [INFO ] [MAIN ] Derivative Progress: 1797/2164 symbols completed. SPIR took 1.2s. Estimated remaining: 2m 27s. Rate: 149.5 symbols/min [2025-10-24T00:55:56.594765] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:56.637146] [DEBUG] [LOCAL ] SPNT: Loaded 34415 existing records from primary storage. [2025-10-24T00:55:56.637312] [INFO ] [MAIN ] SPNT: Loaded 34415 primary data records. [2025-10-24T00:55:56.802505] [DEBUG] [LOCAL ] SPOT: Loaded 50537 existing records from primary storage. [2025-10-24T00:55:56.832572] [INFO ] [MAIN ] SPOT: Loaded 50537 primary data records. [2025-10-24T00:55:56.834021] [DEBUG] [LOCAL ] SPR: Loaded 40937 existing records from primary storage. [2025-10-24T00:55:56.980804] [INFO ] [MAIN ] SPR: Loaded 40937 primary data records. [2025-10-24T00:55:57.660065] [DEBUG] [MAIN ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:57.705070] [DEBUG] [MAIN ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:57.749726] [DEBUG] [MAIN ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:57.767186] [INFO ] [MAIN ] SPNT: Generated 139 derivative records from 34415 primary records. [2025-10-24T00:55:57.770727] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-24T00:55:57.771439] [FATAL] [LOCAL ] SPNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:57.774212] [FATAL] [MAIN ] SPNT: Failed to save derivative data. [2025-10-24T00:55:57.776506] [INFO ] [MAIN ] Derivative Progress: 1798/2164 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 27s. Rate: 149.3 symbols/min [2025-10-24T00:55:57.803025] [INFO ] [MAIN ] SPOT: Generated 139 derivative records from 50537 primary records. [2025-10-24T00:55:57.803542] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-24T00:55:57.803796] [FATAL] [LOCAL ] SPOT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:57.806988] [INFO ] [MAIN ] SPR: Generated 139 derivative records from 40937 primary records. [2025-10-24T00:55:57.807095] [FATAL] [MAIN ] SPOT: Failed to save derivative data. [2025-10-24T00:55:57.809974] [INFO ] [MAIN ] Derivative Progress: 1799/2164 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 27s. Rate: 149.4 symbols/min [2025-10-24T00:55:57.810045] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-24T00:55:57.810454] [FATAL] [LOCAL ] SPR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:57.810604] [FATAL] [MAIN ] SPR: Failed to save derivative data. [2025-10-24T00:55:57.814200] [INFO ] [MAIN ] Derivative Progress: 1800/2164 symbols completed. SPR took 1.2s. Estimated remaining: 2m 26s. Rate: 149.5 symbols/min [2025-10-24T00:55:57.814609] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:57.814742] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:57.814851] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:57.834449] [DEBUG] [LOCAL ] SPXX: Loaded 9189 existing records from primary storage. [2025-10-24T00:55:57.834694] [INFO ] [MAIN ] SPXX: Loaded 9189 primary data records. [2025-10-24T00:55:57.875513] [DEBUG] [LOCAL ] SPRU: Loaded 10031 existing records from primary storage. [2025-10-24T00:55:57.925766] [INFO ] [MAIN ] SPRU: Loaded 10031 primary data records. [2025-10-24T00:55:57.990409] [DEBUG] [LOCAL ] SPXC: Loaded 23294 existing records from primary storage. [2025-10-24T00:55:58.011349] [INFO ] [MAIN ] SPXC: Loaded 23294 primary data records. [2025-10-24T00:55:58.776949] [DEBUG] [MAIN ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:58.792952] [DEBUG] [MAIN ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:58.843626] [DEBUG] [MAIN ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:55:58.889912] [INFO ] [MAIN ] SPRU: Generated 139 derivative records from 10031 primary records. [2025-10-24T00:55:58.892953] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-24T00:55:58.895181] [FATAL] [LOCAL ] SPRU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:58.895528] [FATAL] [MAIN ] SPRU: Failed to save derivative data. [2025-10-24T00:55:58.897921] [INFO ] [MAIN ] Derivative Progress: 1801/2164 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 26s. Rate: 149.3 symbols/min [2025-10-24T00:55:58.898362] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:58.898205] [INFO ] [MAIN ] SPXX: Generated 139 derivative records from 9189 primary records. [2025-10-24T00:55:58.900540] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-24T00:55:58.900980] [FATAL] [LOCAL ] SPXX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:58.901334] [FATAL] [MAIN ] SPXX: Failed to save derivative data. [2025-10-24T00:55:58.903396] [INFO ] [MAIN ] Derivative Progress: 1802/2164 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 25s. Rate: 149.4 symbols/min [2025-10-24T00:55:58.906752] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:58.914850] [INFO ] [MAIN ] SPXC: Generated 139 derivative records from 23294 primary records. [2025-10-24T00:55:58.915074] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-24T00:55:58.915312] [FATAL] [LOCAL ] SPXC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:55:58.915397] [FATAL] [MAIN ] SPXC: Failed to save derivative data. [2025-10-24T00:55:58.918033] [INFO ] [MAIN ] Derivative Progress: 1803/2164 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 25s. Rate: 149.5 symbols/min [2025-10-24T00:55:58.918785] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:55:58.950118] [DEBUG] [LOCAL ] SQNS: Loaded 28317 existing records from primary storage. [2025-10-24T00:55:58.950546] [INFO ] [MAIN ] SQNS: Loaded 28317 primary data records. [2025-10-24T00:55:59.071406] [DEBUG] [LOCAL ] SQM: Loaded 49265 existing records from primary storage. [2025-10-24T00:55:59.084255] [INFO ] [MAIN ] SQM: Loaded 49265 primary data records. [2025-10-24T00:55:59.107126] [DEBUG] [LOCAL ] SR: Loaded 32475 existing records from primary storage. [2025-10-24T00:55:59.166809] [INFO ] [MAIN ] SR: Loaded 32475 primary data records. [2025-10-24T00:55:59.971304] [DEBUG] [MAIN ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:00.011957] [DEBUG] [MAIN ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:00.051562] [DEBUG] [MAIN ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:00.085235] [INFO ] [MAIN ] SQNS: Generated 139 derivative records from 28317 primary records. [2025-10-24T00:56:00.085777] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-24T00:56:00.088011] [FATAL] [LOCAL ] SQNS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:00.089446] [FATAL] [MAIN ] SQNS: Failed to save derivative data. [2025-10-24T00:56:00.091737] [INFO ] [MAIN ] Derivative Progress: 1804/2164 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 25s. Rate: 149.3 symbols/min [2025-10-24T00:56:00.098919] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:00.116525] [INFO ] [MAIN ] SQM: Generated 139 derivative records from 49265 primary records. [2025-10-24T00:56:00.117080] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-24T00:56:00.119053] [FATAL] [LOCAL ] SQM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:00.118838] [INFO ] [MAIN ] SR: Generated 139 derivative records from 32475 primary records. [2025-10-24T00:56:00.119271] [FATAL] [MAIN ] SQM: Failed to save derivative data. [2025-10-24T00:56:00.122020] [INFO ] [MAIN ] Derivative Progress: 1805/2164 symbols completed. SQM took 1.2s. Estimated remaining: 2m 24s. Rate: 149.4 symbols/min [2025-10-24T00:56:00.119330] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-24T00:56:00.122181] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:00.122696] [FATAL] [LOCAL ] SR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:00.122876] [FATAL] [MAIN ] SR: Failed to save derivative data. [2025-10-24T00:56:00.125881] [INFO ] [MAIN ] Derivative Progress: 1806/2164 symbols completed. SR took 1.2s. Estimated remaining: 2m 24s. Rate: 149.5 symbols/min [2025-10-24T00:56:00.126476] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:00.150688] [DEBUG] [LOCAL ] SREA: Loaded 9711 existing records from primary storage. [2025-10-24T00:56:00.150985] [INFO ] [MAIN ] SREA: Loaded 9711 primary data records. [2025-10-24T00:56:00.279698] [DEBUG] [LOCAL ] SRE: Loaded 53793 existing records from primary storage. [2025-10-24T00:56:00.295725] [INFO ] [MAIN ] SRE: Loaded 53793 primary data records. [2025-10-24T00:56:00.536070] [DEBUG] [LOCAL ] SRFM: Loaded 40399 existing records from primary storage. [2025-10-24T00:56:00.566343] [INFO ] [MAIN ] SRFM: Loaded 40399 primary data records. [2025-10-24T00:56:01.111350] [DEBUG] [MAIN ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:01.148725] [DEBUG] [MAIN ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:01.188658] [DEBUG] [MAIN ] SRFM: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:01.237816] [INFO ] [MAIN ] SREA: Generated 139 derivative records from 9711 primary records. [2025-10-24T00:56:01.238135] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-24T00:56:01.241112] [FATAL] [LOCAL ] SREA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:01.241604] [FATAL] [MAIN ] SREA: Failed to save derivative data. [2025-10-24T00:56:01.247233] [INFO ] [MAIN ] Derivative Progress: 1807/2164 symbols completed. SREA took 1.1s. Estimated remaining: 2m 23s. Rate: 149.3 symbols/min [2025-10-24T00:56:01.248541] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:01.260245] [INFO ] [MAIN ] SRE: Generated 139 derivative records from 53793 primary records. [2025-10-24T00:56:01.262039] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-24T00:56:01.265384] [FATAL] [LOCAL ] SRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:01.272054] [FATAL] [MAIN ] SRE: Failed to save derivative data. [2025-10-24T00:56:01.274696] [INFO ] [MAIN ] Derivative Progress: 1808/2164 symbols completed. SRE took 1.2s. Estimated remaining: 2m 23s. Rate: 149.4 symbols/min [2025-10-24T00:56:01.275170] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:01.277026] [INFO ] [MAIN ] SRFM: Generated 139 derivative records from 40399 primary records. [2025-10-24T00:56:01.283522] [DEBUG] [LOCAL ] SRG: Loaded 14820 existing records from primary storage. [2025-10-24T00:56:01.283729] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-24T00:56:01.284203] [INFO ] [MAIN ] SRG: Loaded 14820 primary data records. [2025-10-24T00:56:01.284678] [FATAL] [LOCAL ] SRFM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:01.316585] [FATAL] [MAIN ] SRFM: Failed to save derivative data. [2025-10-24T00:56:01.340727] [INFO ] [MAIN ] Derivative Progress: 1809/2164 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 22s. Rate: 149.5 symbols/min [2025-10-24T00:56:01.384490] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:01.681497] [DEBUG] [LOCAL ] SRI: Loaded 26338 existing records from primary storage. [2025-10-24T00:56:01.691939] [INFO ] [MAIN ] SRI: Loaded 26338 primary data records. [2025-10-24T00:56:01.696469] [DEBUG] [LOCAL ] SRV: Loaded 7431 existing records from primary storage. [2025-10-24T00:56:01.708483] [INFO ] [MAIN ] SRV: Loaded 7431 primary data records. [2025-10-24T00:56:02.393471] [DEBUG] [MAIN ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:02.458500] [DEBUG] [MAIN ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:02.459438] [DEBUG] [MAIN ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:02.507733] [INFO ] [MAIN ] SRG: Generated 139 derivative records from 14820 primary records. [2025-10-24T00:56:02.513850] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-24T00:56:02.519257] [FATAL] [LOCAL ] SRG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:02.520042] [FATAL] [MAIN ] SRG: Failed to save derivative data. [2025-10-24T00:56:02.522321] [INFO ] [MAIN ] Derivative Progress: 1810/2164 symbols completed. SRG took 1.3s. Estimated remaining: 2m 22s. Rate: 149.3 symbols/min [2025-10-24T00:56:02.524328] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:02.550937] [INFO ] [MAIN ] SRI: Generated 139 derivative records from 26338 primary records. [2025-10-24T00:56:02.551180] [INFO ] [MAIN ] SRV: Generated 139 derivative records from 7431 primary records. [2025-10-24T00:56:02.551505] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-24T00:56:02.551691] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-24T00:56:02.552316] [FATAL] [LOCAL ] SRV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:02.552428] [FATAL] [MAIN ] SRV: Failed to save derivative data. [2025-10-24T00:56:02.554985] [INFO ] [MAIN ] Derivative Progress: 1811/2164 symbols completed. SRV took 1.2s. Estimated remaining: 2m 22s. Rate: 149.4 symbols/min [2025-10-24T00:56:02.555227] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:02.552063] [FATAL] [LOCAL ] SRI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:02.555765] [FATAL] [MAIN ] SRI: Failed to save derivative data. [2025-10-24T00:56:02.558406] [INFO ] [MAIN ] Derivative Progress: 1812/2164 symbols completed. SRI took 1.3s. Estimated remaining: 2m 21s. Rate: 149.5 symbols/min [2025-10-24T00:56:02.558682] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:02.591757] [DEBUG] [LOCAL ] SSB: Loaded 43090 existing records from primary storage. [2025-10-24T00:56:02.591984] [INFO ] [MAIN ] SSB: Loaded 43090 primary data records. [2025-10-24T00:56:02.681322] [DEBUG] [LOCAL ] SSD: Loaded 22503 existing records from primary storage. [2025-10-24T00:56:02.710778] [INFO ] [MAIN ] SSD: Loaded 22503 primary data records. [2025-10-24T00:56:02.853432] [DEBUG] [LOCAL ] SSL: Loaded 41739 existing records from primary storage. [2025-10-24T00:56:02.893603] [INFO ] [MAIN ] SSL: Loaded 41739 primary data records. [2025-10-24T00:56:03.614338] [DEBUG] [MAIN ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:03.648131] [DEBUG] [MAIN ] SSD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:03.751542] [DEBUG] [MAIN ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:03.789677] [INFO ] [MAIN ] SSB: Generated 139 derivative records from 43090 primary records. [2025-10-24T00:56:03.791431] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-24T00:56:03.791833] [FATAL] [LOCAL ] SSB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:03.793597] [FATAL] [MAIN ] SSB: Failed to save derivative data. [2025-10-24T00:56:03.793785] [INFO ] [MAIN ] SSD: Generated 139 derivative records from 22503 primary records. [2025-10-24T00:56:03.794192] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-24T00:56:03.796317] [INFO ] [MAIN ] Derivative Progress: 1813/2164 symbols completed. SSB took 1.3s. Estimated remaining: 2m 21s. Rate: 149.3 symbols/min [2025-10-24T00:56:03.796940] [FATAL] [LOCAL ] SSD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:03.800551] [FATAL] [MAIN ] SSD: Failed to save derivative data. [2025-10-24T00:56:03.803342] [INFO ] [MAIN ] Derivative Progress: 1814/2164 symbols completed. SSD took 1.2s. Estimated remaining: 2m 21s. Rate: 149.4 symbols/min [2025-10-24T00:56:03.812409] [INFO ] [MAIN ] SSL: Generated 139 derivative records from 41739 primary records. [2025-10-24T00:56:03.812610] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-24T00:56:03.812853] [FATAL] [LOCAL ] SSL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:03.812934] [FATAL] [MAIN ] SSL: Failed to save derivative data. [2025-10-24T00:56:03.817000] [INFO ] [MAIN ] Derivative Progress: 1815/2164 symbols completed. SSL took 1.3s. Estimated remaining: 2m 20s. Rate: 149.5 symbols/min [2025-10-24T00:56:03.817455] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:03.817602] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:03.817844] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:03.832772] [DEBUG] [LOCAL ] SST: Loaded 11417 existing records from primary storage. [2025-10-24T00:56:03.839290] [INFO ] [MAIN ] SST: Loaded 11417 primary data records. [2025-10-24T00:56:03.948553] [DEBUG] [LOCAL ] SSTK: Loaded 25424 existing records from primary storage. [2025-10-24T00:56:03.952325] [INFO ] [MAIN ] SSTK: Loaded 25424 primary data records. [2025-10-24T00:56:04.283726] [DEBUG] [LOCAL ] ST: Loaded 50012 existing records from primary storage. [2025-10-24T00:56:04.299454] [INFO ] [MAIN ] ST: Loaded 50012 primary data records. [2025-10-24T00:56:04.793960] [DEBUG] [MAIN ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:04.831503] [DEBUG] [MAIN ] SSTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:04.876177] [DEBUG] [MAIN ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:04.897276] [INFO ] [MAIN ] SST: Generated 139 derivative records from 11417 primary records. [2025-10-24T00:56:04.899436] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-24T00:56:04.901026] [FATAL] [LOCAL ] SST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:04.901359] [FATAL] [MAIN ] SST: Failed to save derivative data. [2025-10-24T00:56:04.906337] [INFO ] [MAIN ] Derivative Progress: 1816/2164 symbols completed. SST took 1.1s. Estimated remaining: 2m 20s. Rate: 149.3 symbols/min [2025-10-24T00:56:04.907056] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:04.926960] [INFO ] [MAIN ] SSTK: Generated 139 derivative records from 25424 primary records. [2025-10-24T00:56:04.928631] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-24T00:56:04.931596] [FATAL] [LOCAL ] SSTK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:04.932083] [FATAL] [MAIN ] SSTK: Failed to save derivative data. [2025-10-24T00:56:04.934914] [INFO ] [MAIN ] Derivative Progress: 1817/2164 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 19s. Rate: 149.4 symbols/min [2025-10-24T00:56:04.935117] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:04.938495] [INFO ] [MAIN ] ST: Generated 139 derivative records from 50012 primary records. [2025-10-24T00:56:04.938729] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-24T00:56:04.938924] [FATAL] [LOCAL ] ST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:04.939000] [FATAL] [MAIN ] ST: Failed to save derivative data. [2025-10-24T00:56:04.942233] [INFO ] [MAIN ] Derivative Progress: 1818/2164 symbols completed. ST took 1.1s. Estimated remaining: 2m 19s. Rate: 149.5 symbols/min [2025-10-24T00:56:04.942388] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:04.968572] [DEBUG] [LOCAL ] STC: Loaded 17598 existing records from primary storage. [2025-10-24T00:56:04.982238] [INFO ] [MAIN ] STC: Loaded 17598 primary data records. [2025-10-24T00:56:04.983255] [DEBUG] [LOCAL ] STAG: Loaded 50429 existing records from primary storage. [2025-10-24T00:56:05.019351] [INFO ] [MAIN ] STAG: Loaded 50429 primary data records. [2025-10-24T00:56:05.196381] [DEBUG] [LOCAL ] STE: Loaded 35341 existing records from primary storage. [2025-10-24T00:56:05.207207] [INFO ] [MAIN ] STE: Loaded 35341 primary data records. [2025-10-24T00:56:05.963970] [DEBUG] [MAIN ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:05.976986] [DEBUG] [MAIN ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:06.035081] [DEBUG] [MAIN ] STE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:06.088683] [INFO ] [MAIN ] STC: Generated 139 derivative records from 17598 primary records. [2025-10-24T00:56:06.089481] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-24T00:56:06.091714] [INFO ] [MAIN ] STAG: Generated 139 derivative records from 50429 primary records. [2025-10-24T00:56:06.092936] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-24T00:56:06.092614] [FATAL] [LOCAL ] STC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:06.093323] [FATAL] [LOCAL ] STAG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:06.093566] [FATAL] [MAIN ] STC: Failed to save derivative data. [2025-10-24T00:56:06.093825] [FATAL] [MAIN ] STAG: Failed to save derivative data. [2025-10-24T00:56:06.098092] [INFO ] [MAIN ] Derivative Progress: 1819/2164 symbols completed. STC took 1.2s. Estimated remaining: 2m 19s. Rate: 149.3 symbols/min [2025-10-24T00:56:06.101275] [INFO ] [MAIN ] Derivative Progress: 1820/2164 symbols completed. STAG took 1.2s. Estimated remaining: 2m 18s. Rate: 149.4 symbols/min [2025-10-24T00:56:06.101428] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:06.098285] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:06.106067] [INFO ] [MAIN ] STE: Generated 139 derivative records from 35341 primary records. [2025-10-24T00:56:06.106345] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-24T00:56:06.106554] [FATAL] [LOCAL ] STE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:06.106629] [FATAL] [MAIN ] STE: Failed to save derivative data. [2025-10-24T00:56:06.109426] [INFO ] [MAIN ] Derivative Progress: 1821/2164 symbols completed. STE took 1.2s. Estimated remaining: 2m 18s. Rate: 149.5 symbols/min [2025-10-24T00:56:06.109720] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:06.133254] [DEBUG] [LOCAL ] STEL: Loaded 22468 existing records from primary storage. [2025-10-24T00:56:06.141069] [INFO ] [MAIN ] STEL: Loaded 22468 primary data records. [2025-10-24T00:56:06.238238] [DEBUG] [LOCAL ] STEW: Loaded 15156 existing records from primary storage. [2025-10-24T00:56:06.250437] [INFO ] [MAIN ] STEW: Loaded 15156 primary data records. [2025-10-24T00:56:06.309836] [DEBUG] [LOCAL ] STEM: Loaded 38586 existing records from primary storage. [2025-10-24T00:56:06.316526] [INFO ] [MAIN ] STEM: Loaded 38586 primary data records. [2025-10-24T00:56:07.085229] [DEBUG] [MAIN ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:07.138491] [DEBUG] [MAIN ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:07.132956] [DEBUG] [MAIN ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:07.189486] [INFO ] [MAIN ] STEL: Generated 139 derivative records from 22468 primary records. [2025-10-24T00:56:07.192044] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-24T00:56:07.192987] [FATAL] [LOCAL ] STEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:07.193140] [FATAL] [MAIN ] STEL: Failed to save derivative data. [2025-10-24T00:56:07.197183] [INFO ] [MAIN ] Derivative Progress: 1822/2164 symbols completed. STEL took 1.1s. Estimated remaining: 2m 17s. Rate: 149.4 symbols/min [2025-10-24T00:56:07.202983] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:07.222678] [DEBUG] [LOCAL ] STK: Loaded 9757 existing records from primary storage. [2025-10-24T00:56:07.223179] [INFO ] [MAIN ] STK: Loaded 9757 primary data records. [2025-10-24T00:56:07.222339] [INFO ] [MAIN ] STEW: Generated 139 derivative records from 15156 primary records. [2025-10-24T00:56:07.223327] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-24T00:56:07.256717] [INFO ] [MAIN ] STEM: Generated 139 derivative records from 38586 primary records. [2025-10-24T00:56:07.256481] [FATAL] [LOCAL ] STEW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:07.281250] [FATAL] [MAIN ] STEW: Failed to save derivative data. [2025-10-24T00:56:07.298153] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-24T00:56:07.298057] [INFO ] [MAIN ] Derivative Progress: 1823/2164 symbols completed. STEW took 1.2s. Estimated remaining: 2m 17s. Rate: 149.4 symbols/min [2025-10-24T00:56:07.329730] [FATAL] [LOCAL ] STEM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:07.333292] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:07.333549] [FATAL] [MAIN ] STEM: Failed to save derivative data. [2025-10-24T00:56:07.341855] [INFO ] [MAIN ] Derivative Progress: 1824/2164 symbols completed. STEM took 1.2s. Estimated remaining: 2m 16s. Rate: 149.5 symbols/min [2025-10-24T00:56:07.347413] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:07.587002] [DEBUG] [MAIN ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:07.631332] [DEBUG] [LOCAL ] STLA: Loaded 53944 existing records from primary storage. [2025-10-24T00:56:07.634107] [DEBUG] [LOCAL ] STM: Loaded 53963 existing records from primary storage. [2025-10-24T00:56:07.633156] [INFO ] [MAIN ] STLA: Loaded 53944 primary data records. [2025-10-24T00:56:07.637070] [INFO ] [MAIN ] STM: Loaded 53963 primary data records. [2025-10-24T00:56:08.276975] [INFO ] [MAIN ] STK: Generated 139 derivative records from 9757 primary records. [2025-10-24T00:56:08.279525] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-24T00:56:08.280986] [FATAL] [LOCAL ] STK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:08.281339] [FATAL] [MAIN ] STK: Failed to save derivative data. [2025-10-24T00:56:08.283531] [INFO ] [MAIN ] Derivative Progress: 1825/2164 symbols completed. STK took 1.1s. Estimated remaining: 2m 16s. Rate: 149.4 symbols/min [2025-10-24T00:56:08.283749] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:08.328328] [DEBUG] [MAIN ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:08.328729] [DEBUG] [MAIN ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:08.362953] [DEBUG] [LOCAL ] STN: Loaded 22702 existing records from primary storage. [2025-10-24T00:56:08.366085] [INFO ] [MAIN ] STN: Loaded 22702 primary data records. [2025-10-24T00:56:08.704073] [INFO ] [MAIN ] STM: Generated 139 derivative records from 53963 primary records. [2025-10-24T00:56:08.702390] [INFO ] [MAIN ] STLA: Generated 139 derivative records from 53944 primary records. [2025-10-24T00:56:08.704832] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-24T00:56:08.704925] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-24T00:56:08.705257] [FATAL] [LOCAL ] STLA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:08.705496] [FATAL] [LOCAL ] STM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:08.705672] [FATAL] [MAIN ] STM: Failed to save derivative data. [2025-10-24T00:56:08.705723] [FATAL] [MAIN ] STLA: Failed to save derivative data. [2025-10-24T00:56:08.708505] [INFO ] [MAIN ] Derivative Progress: 1826/2164 symbols completed. STLA took 1.4s. Estimated remaining: 2m 16s. Rate: 149.4 symbols/min [2025-10-24T00:56:08.710859] [INFO ] [MAIN ] Derivative Progress: 1827/2164 symbols completed. STM took 1.4s. Estimated remaining: 2m 15s. Rate: 149.5 symbols/min [2025-10-24T00:56:08.710761] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:08.712318] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:08.739072] [DEBUG] [LOCAL ] STRV: Loaded 10739 existing records from primary storage. [2025-10-24T00:56:08.739355] [DEBUG] [MAIN ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:08.750697] [INFO ] [MAIN ] STRV: Loaded 10739 primary data records. [2025-10-24T00:56:08.964251] [DEBUG] [LOCAL ] STNG: Loaded 43583 existing records from primary storage. [2025-10-24T00:56:09.063313] [INFO ] [MAIN ] STNG: Loaded 43583 primary data records. [2025-10-24T00:56:09.234116] [INFO ] [MAIN ] STN: Generated 139 derivative records from 22702 primary records. [2025-10-24T00:56:09.271677] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-24T00:56:09.385376] [FATAL] [LOCAL ] STN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:09.386163] [FATAL] [MAIN ] STN: Failed to save derivative data. [2025-10-24T00:56:09.388478] [INFO ] [MAIN ] Derivative Progress: 1828/2164 symbols completed. STN took 1.1s. Estimated remaining: 2m 15s. Rate: 149.4 symbols/min [2025-10-24T00:56:09.405081] [DEBUG] [MAIN ] STRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:09.452517] [DEBUG] [MAIN ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:09.469025] [INFO ] [MAIN ] STRV: Generated 139 derivative records from 10739 primary records. [2025-10-24T00:56:09.470285] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-24T00:56:09.472722] [FATAL] [LOCAL ] STRV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:09.472941] [FATAL] [MAIN ] STRV: Failed to save derivative data. [2025-10-24T00:56:09.474762] [INFO ] [MAIN ] Derivative Progress: 1829/2164 symbols completed. STRV took 0.8s. Estimated remaining: 2m 14s. Rate: 149.5 symbols/min [2025-10-24T00:56:09.485134] [INFO ] [MAIN ] STNG: Generated 139 derivative records from 43583 primary records. [2025-10-24T00:56:09.485224] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-24T00:56:09.485422] [FATAL] [LOCAL ] STNG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:09.485497] [FATAL] [MAIN ] STNG: Failed to save derivative data. [2025-10-24T00:56:09.489120] [INFO ] [MAIN ] Derivative Progress: 1830/2164 symbols completed. STNG took 0.8s. Estimated remaining: 2m 14s. Rate: 149.5 symbols/min [2025-10-24T00:56:09.489508] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:09.489592] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:09.489726] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:09.518472] [DEBUG] [LOCAL ] STVN: Loaded 26897 existing records from primary storage. [2025-10-24T00:56:09.518758] [INFO ] [MAIN ] STVN: Loaded 26897 primary data records. [2025-10-24T00:56:09.891891] [DEBUG] [LOCAL ] STT: Loaded 51483 existing records from primary storage. [2025-10-24T00:56:09.892632] [DEBUG] [LOCAL ] STWD: Loaded 52342 existing records from primary storage. [2025-10-24T00:56:09.892932] [INFO ] [MAIN ] STWD: Loaded 52342 primary data records. [2025-10-24T00:56:09.893181] [INFO ] [MAIN ] STT: Loaded 51483 primary data records. [2025-10-24T00:56:10.533011] [DEBUG] [MAIN ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:10.601901] [DEBUG] [MAIN ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:10.603118] [DEBUG] [MAIN ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:10.639739] [INFO ] [MAIN ] STVN: Generated 139 derivative records from 26897 primary records. [2025-10-24T00:56:10.644576] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-24T00:56:10.647052] [FATAL] [LOCAL ] STVN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:10.647161] [FATAL] [MAIN ] STVN: Failed to save derivative data. [2025-10-24T00:56:10.649754] [INFO ] [MAIN ] Derivative Progress: 1831/2164 symbols completed. STVN took 1.2s. Estimated remaining: 2m 14s. Rate: 149.4 symbols/min [2025-10-24T00:56:10.652862] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:10.664216] [DEBUG] [LOCAL ] STXD: Loaded 1352 existing records from primary storage. [2025-10-24T00:56:10.664742] [INFO ] [MAIN ] STXD: Loaded 1352 primary data records. [2025-10-24T00:56:10.870712] [INFO ] [MAIN ] STWD: Generated 139 derivative records from 52342 primary records. [2025-10-24T00:56:10.988562] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-24T00:56:10.989139] [FATAL] [LOCAL ] STWD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:10.989727] [FATAL] [MAIN ] STWD: Failed to save derivative data. [2025-10-24T00:56:10.993023] [INFO ] [MAIN ] Derivative Progress: 1832/2164 symbols completed. STWD took 1.5s. Estimated remaining: 2m 13s. Rate: 149.4 symbols/min [2025-10-24T00:56:10.993393] [INFO ] [MAIN ] STT: Generated 139 derivative records from 51483 primary records. [2025-10-24T00:56:10.993750] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:10.993665] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-24T00:56:10.994128] [FATAL] [LOCAL ] STT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:10.994726] [FATAL] [MAIN ] STT: Failed to save derivative data. [2025-10-24T00:56:10.997221] [INFO ] [MAIN ] Derivative Progress: 1833/2164 symbols completed. STT took 1.5s. Estimated remaining: 2m 13s. Rate: 149.5 symbols/min [2025-10-24T00:56:10.998188] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:11.002431] [DEBUG] [LOCAL ] STXE: Loaded 2067 existing records from primary storage. [2025-10-24T00:56:11.002775] [INFO ] [MAIN ] STXE: Loaded 2067 primary data records. [2025-10-24T00:56:11.101533] [DEBUG] [LOCAL ] STXG: Loaded 2312 existing records from primary storage. [2025-10-24T00:56:11.113446] [INFO ] [MAIN ] STXG: Loaded 2312 primary data records. [2025-10-24T00:56:11.609244] [DEBUG] [MAIN ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:11.714143] [DEBUG] [MAIN ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:11.750334] [INFO ] [MAIN ] STXD: Generated 139 derivative records from 1352 primary records. [2025-10-24T00:56:11.750908] [DEBUG] [MAIN ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:11.751171] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-24T00:56:11.751412] [FATAL] [LOCAL ] STXD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:11.751525] [FATAL] [MAIN ] STXD: Failed to save derivative data. [2025-10-24T00:56:11.770581] [INFO ] [MAIN ] Derivative Progress: 1834/2164 symbols completed. STXD took 1.1s. Estimated remaining: 2m 13s. Rate: 149.4 symbols/min [2025-10-24T00:56:11.776568] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:11.788098] [DEBUG] [LOCAL ] STXK: Loaded 1484 existing records from primary storage. [2025-10-24T00:56:11.790885] [INFO ] [MAIN ] STXK: Loaded 1484 primary data records. [2025-10-24T00:56:12.107723] [INFO ] [MAIN ] STXE: Generated 139 derivative records from 2067 primary records. [2025-10-24T00:56:12.109819] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-24T00:56:12.110566] [FATAL] [LOCAL ] STXE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:12.110788] [FATAL] [MAIN ] STXE: Failed to save derivative data. [2025-10-24T00:56:12.113065] [INFO ] [MAIN ] STXG: Generated 139 derivative records from 2312 primary records. [2025-10-24T00:56:12.112743] [INFO ] [MAIN ] Derivative Progress: 1835/2164 symbols completed. STXE took 1.1s. Estimated remaining: 2m 12s. Rate: 149.4 symbols/min [2025-10-24T00:56:12.113843] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-24T00:56:12.113958] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:12.114828] [FATAL] [LOCAL ] STXG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:12.115493] [FATAL] [MAIN ] STXG: Failed to save derivative data. [2025-10-24T00:56:12.118209] [INFO ] [MAIN ] Derivative Progress: 1836/2164 symbols completed. STXG took 1.1s. Estimated remaining: 2m 12s. Rate: 149.5 symbols/min [2025-10-24T00:56:12.118488] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:12.126780] [DEBUG] [LOCAL ] STXV: Loaded 1474 existing records from primary storage. [2025-10-24T00:56:12.124747] [DEBUG] [LOCAL ] STXT: Loaded 2533 existing records from primary storage. [2025-10-24T00:56:12.126956] [INFO ] [MAIN ] STXV: Loaded 1474 primary data records. [2025-10-24T00:56:12.127014] [INFO ] [MAIN ] STXT: Loaded 2533 primary data records. [2025-10-24T00:56:12.608373] [DEBUG] [MAIN ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:12.796588] [INFO ] [MAIN ] STXK: Generated 139 derivative records from 1484 primary records. [2025-10-24T00:56:12.799712] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-24T00:56:12.800209] [FATAL] [LOCAL ] STXK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:12.808031] [FATAL] [MAIN ] STXK: Failed to save derivative data. [2025-10-24T00:56:12.828275] [INFO ] [MAIN ] Derivative Progress: 1837/2164 symbols completed. STXK took 1.1s. Estimated remaining: 2m 11s. Rate: 149.4 symbols/min [2025-10-24T00:56:12.829203] [DEBUG] [MAIN ] STXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:12.829946] [DEBUG] [MAIN ] STXV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:12.829339] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:12.912535] [INFO ] [MAIN ] STXT: Generated 139 derivative records from 2533 primary records. [2025-10-24T00:56:12.914688] [INFO ] [MAIN ] STXV: Generated 139 derivative records from 1474 primary records. [2025-10-24T00:56:12.914395] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-24T00:56:12.915205] [FATAL] [LOCAL ] STXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:12.915285] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-24T00:56:12.915611] [FATAL] [LOCAL ] STXV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:12.915738] [FATAL] [MAIN ] STXT: Failed to save derivative data. [2025-10-24T00:56:12.918103] [FATAL] [MAIN ] STXV: Failed to save derivative data. [2025-10-24T00:56:12.917982] [INFO ] [MAIN ] Derivative Progress: 1838/2164 symbols completed. STXT took 0.8s. Estimated remaining: 2m 11s. Rate: 149.5 symbols/min [2025-10-24T00:56:12.921000] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:12.921545] [INFO ] [MAIN ] Derivative Progress: 1839/2164 symbols completed. STXV took 0.8s. Estimated remaining: 2m 10s. Rate: 149.6 symbols/min [2025-10-24T00:56:12.921768] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:12.939989] [DEBUG] [LOCAL ] STZ: Loaded 52805 existing records from primary storage. [2025-10-24T00:56:12.940409] [INFO ] [MAIN ] STZ: Loaded 52805 primary data records. [2025-10-24T00:56:13.293614] [DEBUG] [LOCAL ] SUI: Loaded 42165 existing records from primary storage. [2025-10-24T00:56:13.295457] [INFO ] [MAIN ] SUI: Loaded 42165 primary data records. [2025-10-24T00:56:13.296638] [DEBUG] [LOCAL ] SU: Loaded 53820 existing records from primary storage. [2025-10-24T00:56:13.351705] [INFO ] [MAIN ] SU: Loaded 53820 primary data records. [2025-10-24T00:56:13.954492] [DEBUG] [MAIN ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:14.000579] [DEBUG] [MAIN ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:14.034310] [DEBUG] [MAIN ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:14.053896] [INFO ] [MAIN ] STZ: Generated 139 derivative records from 52805 primary records. [2025-10-24T00:56:14.055000] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-24T00:56:14.055421] [FATAL] [LOCAL ] STZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:14.056779] [FATAL] [MAIN ] STZ: Failed to save derivative data. [2025-10-24T00:56:14.059462] [INFO ] [MAIN ] Derivative Progress: 1840/2164 symbols completed. STZ took 1.2s. Estimated remaining: 2m 10s. Rate: 149.4 symbols/min [2025-10-24T00:56:14.060142] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:14.098568] [INFO ] [MAIN ] SUI: Generated 139 derivative records from 42165 primary records. [2025-10-24T00:56:14.098795] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-24T00:56:14.099095] [FATAL] [LOCAL ] SUI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:14.100489] [FATAL] [MAIN ] SUI: Failed to save derivative data. [2025-10-24T00:56:14.102540] [INFO ] [MAIN ] Derivative Progress: 1841/2164 symbols completed. SUI took 1.2s. Estimated remaining: 2m 10s. Rate: 149.5 symbols/min [2025-10-24T00:56:14.104876] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:14.104778] [INFO ] [MAIN ] SU: Generated 139 derivative records from 53820 primary records. [2025-10-24T00:56:14.105388] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-24T00:56:14.105625] [FATAL] [LOCAL ] SU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:14.105713] [FATAL] [MAIN ] SU: Failed to save derivative data. [2025-10-24T00:56:14.108175] [INFO ] [MAIN ] Derivative Progress: 1842/2164 symbols completed. SU took 1.2s. Estimated remaining: 2m 9s. Rate: 149.6 symbols/min [2025-10-24T00:56:14.109094] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:14.122263] [DEBUG] [LOCAL ] SUN: Loaded 39054 existing records from primary storage. [2025-10-24T00:56:14.122674] [INFO ] [MAIN ] SUN: Loaded 39054 primary data records. [2025-10-24T00:56:14.462681] [DEBUG] [LOCAL ] SUZ: Loaded 45832 existing records from primary storage. [2025-10-24T00:56:14.476045] [INFO ] [MAIN ] SUZ: Loaded 45832 primary data records. [2025-10-24T00:56:14.500560] [DEBUG] [LOCAL ] SUPV: Loaded 48430 existing records from primary storage. [2025-10-24T00:56:14.531666] [INFO ] [MAIN ] SUPV: Loaded 48430 primary data records. [2025-10-24T00:56:15.151176] [DEBUG] [MAIN ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:15.195849] [DEBUG] [MAIN ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:15.237276] [DEBUG] [MAIN ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:15.255480] [INFO ] [MAIN ] SUN: Generated 139 derivative records from 39054 primary records. [2025-10-24T00:56:15.255768] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-24T00:56:15.258828] [FATAL] [LOCAL ] SUN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:15.258961] [FATAL] [MAIN ] SUN: Failed to save derivative data. [2025-10-24T00:56:15.263539] [INFO ] [MAIN ] Derivative Progress: 1843/2164 symbols completed. SUN took 1.2s. Estimated remaining: 2m 9s. Rate: 149.4 symbols/min [2025-10-24T00:56:15.287119] [INFO ] [MAIN ] SUZ: Generated 139 derivative records from 45832 primary records. [2025-10-24T00:56:15.287794] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-24T00:56:15.292099] [FATAL] [LOCAL ] SUZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:15.294045] [FATAL] [MAIN ] SUZ: Failed to save derivative data. [2025-10-24T00:56:15.297186] [INFO ] [MAIN ] Derivative Progress: 1844/2164 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 8s. Rate: 149.5 symbols/min [2025-10-24T00:56:15.299822] [INFO ] [MAIN ] SUPV: Generated 139 derivative records from 48430 primary records. [2025-10-24T00:56:15.300144] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-24T00:56:15.300358] [FATAL] [LOCAL ] SUPV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:15.300437] [FATAL] [MAIN ] SUPV: Failed to save derivative data. [2025-10-24T00:56:15.303164] [INFO ] [MAIN ] Derivative Progress: 1845/2164 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 8s. Rate: 149.6 symbols/min [2025-10-24T00:56:15.303566] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:15.303782] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:15.304135] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:15.367206] [DEBUG] [LOCAL ] SVV: Loaded 40525 existing records from primary storage. [2025-10-24T00:56:15.367444] [INFO ] [MAIN ] SVV: Loaded 40525 primary data records. [2025-10-24T00:56:15.502180] [DEBUG] [LOCAL ] SWK: Loaded 52755 existing records from primary storage. [2025-10-24T00:56:15.501382] [DEBUG] [LOCAL ] SW: Loaded 53568 existing records from primary storage. [2025-10-24T00:56:15.508229] [INFO ] [MAIN ] SWK: Loaded 52755 primary data records. [2025-10-24T00:56:15.508346] [INFO ] [MAIN ] SW: Loaded 53568 primary data records. [2025-10-24T00:56:16.387029] [DEBUG] [MAIN ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:16.423444] [DEBUG] [MAIN ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:16.456538] [DEBUG] [MAIN ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:16.503299] [INFO ] [MAIN ] SVV: Generated 139 derivative records from 40525 primary records. [2025-10-24T00:56:16.506857] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-24T00:56:16.508006] [FATAL] [LOCAL ] SVV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:16.508611] [FATAL] [MAIN ] SVV: Failed to save derivative data. [2025-10-24T00:56:16.511005] [INFO ] [MAIN ] Derivative Progress: 1846/2164 symbols completed. SVV took 1.2s. Estimated remaining: 2m 8s. Rate: 149.4 symbols/min [2025-10-24T00:56:16.511220] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:16.533746] [INFO ] [MAIN ] SWK: Generated 139 derivative records from 52755 primary records. [2025-10-24T00:56:16.536006] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-24T00:56:16.536480] [FATAL] [LOCAL ] SWK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:16.536609] [FATAL] [MAIN ] SWK: Failed to save derivative data. [2025-10-24T00:56:16.544294] [INFO ] [MAIN ] Derivative Progress: 1847/2164 symbols completed. SWK took 1.2s. Estimated remaining: 2m 7s. Rate: 149.5 symbols/min [2025-10-24T00:56:16.544734] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:16.540044] [INFO ] [MAIN ] SW: Generated 139 derivative records from 53568 primary records. [2025-10-24T00:56:16.553945] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-24T00:56:16.555411] [FATAL] [LOCAL ] SW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:16.555517] [FATAL] [MAIN ] SW: Failed to save derivative data. [2025-10-24T00:56:16.558464] [INFO ] [MAIN ] Derivative Progress: 1848/2164 symbols completed. SW took 1.3s. Estimated remaining: 2m 7s. Rate: 149.6 symbols/min [2025-10-24T00:56:16.558918] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:16.577592] [DEBUG] [LOCAL ] SWZ: Loaded 6009 existing records from primary storage. [2025-10-24T00:56:16.578300] [DEBUG] [LOCAL ] SWX: Loaded 30757 existing records from primary storage. [2025-10-24T00:56:16.578877] [INFO ] [MAIN ] SWZ: Loaded 6009 primary data records. [2025-10-24T00:56:16.578959] [INFO ] [MAIN ] SWX: Loaded 30757 primary data records. [2025-10-24T00:56:17.200986] [DEBUG] [LOCAL ] SXC: Loaded 41860 existing records from primary storage. [2025-10-24T00:56:17.202198] [INFO ] [MAIN ] SXC: Loaded 41860 primary data records. [2025-10-24T00:56:17.559948] [DEBUG] [MAIN ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:17.642239] [DEBUG] [MAIN ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:17.706943] [DEBUG] [MAIN ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:17.738309] [INFO ] [MAIN ] SWZ: Generated 139 derivative records from 6009 primary records. [2025-10-24T00:56:17.743007] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-24T00:56:17.746628] [FATAL] [LOCAL ] SWZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:17.747258] [INFO ] [MAIN ] SWX: Generated 139 derivative records from 30757 primary records. [2025-10-24T00:56:17.747531] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-24T00:56:17.747712] [FATAL] [MAIN ] SWZ: Failed to save derivative data. [2025-10-24T00:56:17.750636] [INFO ] [MAIN ] Derivative Progress: 1849/2164 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 6s. Rate: 149.4 symbols/min [2025-10-24T00:56:17.750979] [FATAL] [LOCAL ] SWX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:17.751875] [FATAL] [MAIN ] SWX: Failed to save derivative data. [2025-10-24T00:56:17.754297] [INFO ] [MAIN ] Derivative Progress: 1850/2164 symbols completed. SWX took 1.2s. Estimated remaining: 2m 6s. Rate: 149.5 symbols/min [2025-10-24T00:56:17.751685] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:17.754617] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:17.774668] [INFO ] [MAIN ] SXC: Generated 139 derivative records from 41860 primary records. [2025-10-24T00:56:17.774968] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-24T00:56:17.775193] [FATAL] [LOCAL ] SXC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:17.775280] [FATAL] [MAIN ] SXC: Failed to save derivative data. [2025-10-24T00:56:17.777995] [INFO ] [MAIN ] Derivative Progress: 1851/2164 symbols completed. SXC took 1.2s. Estimated remaining: 2m 6s. Rate: 149.6 symbols/min [2025-10-24T00:56:17.778211] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:17.785554] [DEBUG] [LOCAL ] SXI: Loaded 12093 existing records from primary storage. [2025-10-24T00:56:17.794500] [INFO ] [MAIN ] SXI: Loaded 12093 primary data records. [2025-10-24T00:56:17.939294] [DEBUG] [LOCAL ] SXT: Loaded 29769 existing records from primary storage. [2025-10-24T00:56:17.966609] [INFO ] [MAIN ] SXT: Loaded 29769 primary data records. [2025-10-24T00:56:18.320941] [DEBUG] [LOCAL ] SYF: Loaded 53841 existing records from primary storage. [2025-10-24T00:56:18.332377] [INFO ] [MAIN ] SYF: Loaded 53841 primary data records. [2025-10-24T00:56:18.848427] [DEBUG] [MAIN ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:18.896060] [DEBUG] [MAIN ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:18.946447] [DEBUG] [MAIN ] SYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:18.966125] [INFO ] [MAIN ] SXI: Generated 139 derivative records from 12093 primary records. [2025-10-24T00:56:18.967141] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-24T00:56:18.973116] [FATAL] [LOCAL ] SXI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:18.973228] [FATAL] [MAIN ] SXI: Failed to save derivative data. [2025-10-24T00:56:18.975881] [INFO ] [MAIN ] Derivative Progress: 1852/2164 symbols completed. SXI took 1.2s. Estimated remaining: 2m 5s. Rate: 149.4 symbols/min [2025-10-24T00:56:18.978891] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:19.009638] [INFO ] [MAIN ] SXT: Generated 139 derivative records from 29769 primary records. [2025-10-24T00:56:19.010632] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-24T00:56:19.012591] [FATAL] [LOCAL ] SXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:19.012844] [FATAL] [MAIN ] SXT: Failed to save derivative data. [2025-10-24T00:56:19.015481] [INFO ] [MAIN ] Derivative Progress: 1853/2164 symbols completed. SXT took 1.3s. Estimated remaining: 2m 5s. Rate: 149.5 symbols/min [2025-10-24T00:56:19.018707] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:19.036530] [INFO ] [MAIN ] SYF: Generated 139 derivative records from 53841 primary records. [2025-10-24T00:56:19.036954] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-24T00:56:19.037239] [FATAL] [LOCAL ] SYF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:19.037336] [FATAL] [MAIN ] SYF: Failed to save derivative data. [2025-10-24T00:56:19.040135] [INFO ] [MAIN ] Derivative Progress: 1854/2164 symbols completed. SYF took 1.3s. Estimated remaining: 2m 4s. Rate: 149.6 symbols/min [2025-10-24T00:56:19.040458] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:19.061496] [DEBUG] [LOCAL ] SYK: Loaded 47139 existing records from primary storage. [2025-10-24T00:56:19.062094] [INFO ] [MAIN ] SYK: Loaded 47139 primary data records. [2025-10-24T00:56:19.413101] [DEBUG] [LOCAL ] SYY: Loaded 53592 existing records from primary storage. [2025-10-24T00:56:19.425150] [INFO ] [MAIN ] SYY: Loaded 53592 primary data records. [2025-10-24T00:56:19.573182] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-24T00:56:19.604159] [INFO ] [MAIN ] T: Loaded 54188 primary data records. [2025-10-24T00:56:20.127285] [DEBUG] [MAIN ] SYK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:20.179208] [DEBUG] [MAIN ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:20.233514] [DEBUG] [MAIN ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:20.253772] [INFO ] [MAIN ] SYK: Generated 139 derivative records from 47139 primary records. [2025-10-24T00:56:20.257585] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-24T00:56:20.260585] [FATAL] [LOCAL ] SYK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:20.265571] [FATAL] [MAIN ] SYK: Failed to save derivative data. [2025-10-24T00:56:20.269299] [INFO ] [MAIN ] Derivative Progress: 1855/2164 symbols completed. SYK took 1.3s. Estimated remaining: 2m 4s. Rate: 149.4 symbols/min [2025-10-24T00:56:20.269939] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:20.300403] [INFO ] [MAIN ] T: Generated 139 derivative records from 54188 primary records. [2025-10-24T00:56:20.303182] [INFO ] [MAIN ] SYY: Generated 139 derivative records from 53592 primary records. [2025-10-24T00:56:20.303496] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-24T00:56:20.303675] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-24T00:56:20.304098] [FATAL] [LOCAL ] T: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:20.304619] [FATAL] [MAIN ] T: Failed to save derivative data. [2025-10-24T00:56:20.304451] [FATAL] [LOCAL ] SYY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:20.308065] [INFO ] [MAIN ] Derivative Progress: 1856/2164 symbols completed. T took 1.3s. Estimated remaining: 2m 4s. Rate: 149.5 symbols/min [2025-10-24T00:56:20.308221] [FATAL] [MAIN ] SYY: Failed to save derivative data. [2025-10-24T00:56:20.308477] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:20.311497] [INFO ] [MAIN ] Derivative Progress: 1857/2164 symbols completed. SYY took 1.3s. Estimated remaining: 2m 3s. Rate: 149.5 symbols/min [2025-10-24T00:56:20.324060] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:20.344535] [DEBUG] [LOCAL ] TAC: Loaded 43784 existing records from primary storage. [2025-10-24T00:56:20.345310] [INFO ] [MAIN ] TAC: Loaded 43784 primary data records. [2025-10-24T00:56:20.659280] [DEBUG] [LOCAL ] TAL: Loaded 52091 existing records from primary storage. [2025-10-24T00:56:20.726950] [DEBUG] [LOCAL ] TAK: Loaded 50590 existing records from primary storage. [2025-10-24T00:56:20.727207] [INFO ] [MAIN ] TAL: Loaded 52091 primary data records. [2025-10-24T00:56:20.727482] [INFO ] [MAIN ] TAK: Loaded 50590 primary data records. [2025-10-24T00:56:21.582190] [DEBUG] [MAIN ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:21.657477] [DEBUG] [MAIN ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:21.664750] [DEBUG] [MAIN ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:21.710249] [INFO ] [MAIN ] TAC: Generated 139 derivative records from 43784 primary records. [2025-10-24T00:56:21.711510] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-24T00:56:21.714945] [FATAL] [LOCAL ] TAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:21.716524] [FATAL] [MAIN ] TAC: Failed to save derivative data. [2025-10-24T00:56:21.719820] [INFO ] [MAIN ] Derivative Progress: 1858/2164 symbols completed. TAC took 1.4s. Estimated remaining: 2m 3s. Rate: 149.3 symbols/min [2025-10-24T00:56:21.753315] [INFO ] [MAIN ] TAK: Generated 139 derivative records from 50590 primary records. [2025-10-24T00:56:21.754160] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-24T00:56:21.754422] [FATAL] [LOCAL ] TAK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:21.756631] [INFO ] [MAIN ] TAL: Generated 139 derivative records from 52091 primary records. [2025-10-24T00:56:21.756795] [FATAL] [MAIN ] TAK: Failed to save derivative data. [2025-10-24T00:56:21.756845] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-24T00:56:21.757137] [FATAL] [LOCAL ] TAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:21.761857] [INFO ] [MAIN ] Derivative Progress: 1859/2164 symbols completed. TAK took 1.5s. Estimated remaining: 2m 2s. Rate: 149.4 symbols/min [2025-10-24T00:56:21.761982] [FATAL] [MAIN ] TAL: Failed to save derivative data. [2025-10-24T00:56:21.764323] [INFO ] [MAIN ] Derivative Progress: 1860/2164 symbols completed. TAL took 1.4s. Estimated remaining: 2m 2s. Rate: 149.5 symbols/min [2025-10-24T00:56:21.764868] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:21.764804] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:21.764730] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:21.783031] [DEBUG] [LOCAL ] TBB: Loaded 11343 existing records from primary storage. [2025-10-24T00:56:21.783365] [INFO ] [MAIN ] TBB: Loaded 11343 primary data records. [2025-10-24T00:56:22.017413] [DEBUG] [LOCAL ] TALO: Loaded 51375 existing records from primary storage. [2025-10-24T00:56:22.137587] [INFO ] [MAIN ] TALO: Loaded 51375 primary data records. [2025-10-24T00:56:22.159318] [DEBUG] [LOCAL ] TAP: Loaded 53338 existing records from primary storage. [2025-10-24T00:56:22.204318] [INFO ] [MAIN ] TAP: Loaded 53338 primary data records. [2025-10-24T00:56:22.797982] [DEBUG] [MAIN ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:22.838698] [DEBUG] [MAIN ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:22.868858] [DEBUG] [MAIN ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:22.915620] [INFO ] [MAIN ] TBB: Generated 139 derivative records from 11343 primary records. [2025-10-24T00:56:22.917266] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-24T00:56:22.918981] [FATAL] [LOCAL ] TBB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:22.919090] [FATAL] [MAIN ] TBB: Failed to save derivative data. [2025-10-24T00:56:22.921141] [INFO ] [MAIN ] Derivative Progress: 1861/2164 symbols completed. TBB took 1.2s. Estimated remaining: 2m 2s. Rate: 149.3 symbols/min [2025-10-24T00:56:22.923743] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:22.934543] [INFO ] [MAIN ] TALO: Generated 139 derivative records from 51375 primary records. [2025-10-24T00:56:22.935864] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-24T00:56:22.936209] [FATAL] [LOCAL ] TALO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:22.936498] [FATAL] [MAIN ] TALO: Failed to save derivative data. [2025-10-24T00:56:22.941004] [INFO ] [MAIN ] Derivative Progress: 1862/2164 symbols completed. TALO took 1.2s. Estimated remaining: 2m 1s. Rate: 149.4 symbols/min [2025-10-24T00:56:22.944710] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:22.944587] [INFO ] [MAIN ] TAP: Generated 139 derivative records from 53338 primary records. [2025-10-24T00:56:22.944913] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-24T00:56:22.945509] [FATAL] [LOCAL ] TAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:22.945596] [FATAL] [MAIN ] TAP: Failed to save derivative data. [2025-10-24T00:56:22.948684] [INFO ] [MAIN ] Derivative Progress: 1863/2164 symbols completed. TAP took 1.2s. Estimated remaining: 2m 1s. Rate: 149.5 symbols/min [2025-10-24T00:56:22.948919] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:22.963767] [DEBUG] [LOCAL ] TBN: Loaded 4269 existing records from primary storage. [2025-10-24T00:56:22.964072] [INFO ] [MAIN ] TBN: Loaded 4269 primary data records. [2025-10-24T00:56:23.089973] [DEBUG] [LOCAL ] TBI: Loaded 22933 existing records from primary storage. [2025-10-24T00:56:23.129699] [INFO ] [MAIN ] TBI: Loaded 22933 primary data records. [2025-10-24T00:56:23.117330] [DEBUG] [LOCAL ] TBBB: Loaded 35816 existing records from primary storage. [2025-10-24T00:56:23.165116] [INFO ] [MAIN ] TBBB: Loaded 35816 primary data records. [2025-10-24T00:56:23.908164] [DEBUG] [MAIN ] TBN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:23.960272] [DEBUG] [MAIN ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:23.974328] [DEBUG] [MAIN ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:24.011555] [INFO ] [MAIN ] TBN: Generated 139 derivative records from 4269 primary records. [2025-10-24T00:56:24.015875] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-24T00:56:24.016404] [FATAL] [LOCAL ] TBN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:24.022565] [FATAL] [MAIN ] TBN: Failed to save derivative data. [2025-10-24T00:56:24.025269] [INFO ] [MAIN ] Derivative Progress: 1864/2164 symbols completed. TBN took 1.1s. Estimated remaining: 2m 1s. Rate: 149.4 symbols/min [2025-10-24T00:56:24.027984] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:24.049971] [INFO ] [MAIN ] TBBB: Generated 139 derivative records from 35816 primary records. [2025-10-24T00:56:24.049783] [DEBUG] [LOCAL ] TCBX: Loaded 10283 existing records from primary storage. [2025-10-24T00:56:24.050614] [INFO ] [MAIN ] TCBX: Loaded 10283 primary data records. [2025-10-24T00:56:24.050472] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-24T00:56:24.063749] [FATAL] [LOCAL ] TBBB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:24.085310] [FATAL] [MAIN ] TBBB: Failed to save derivative data. [2025-10-24T00:56:24.101938] [INFO ] [MAIN ] Derivative Progress: 1865/2164 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 0s. Rate: 149.4 symbols/min [2025-10-24T00:56:24.160036] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:24.166423] [INFO ] [MAIN ] TBI: Generated 139 derivative records from 22933 primary records. [2025-10-24T00:56:24.177536] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-24T00:56:24.214966] [FATAL] [LOCAL ] TBI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:24.215103] [FATAL] [MAIN ] TBI: Failed to save derivative data. [2025-10-24T00:56:24.378815] [INFO ] [MAIN ] Derivative Progress: 1866/2164 symbols completed. TBI took 1.4s. Estimated remaining: 1m 60s. Rate: 149.5 symbols/min [2025-10-24T00:56:24.392728] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:24.460944] [DEBUG] [MAIN ] TCBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:24.461831] [DEBUG] [LOCAL ] TD: Loaded 52588 existing records from primary storage. [2025-10-24T00:56:24.474903] [INFO ] [MAIN ] TD: Loaded 52588 primary data records. [2025-10-24T00:56:24.598690] [DEBUG] [LOCAL ] TDC: Loaded 46766 existing records from primary storage. [2025-10-24T00:56:24.617460] [INFO ] [MAIN ] TDC: Loaded 46766 primary data records. [2025-10-24T00:56:25.115689] [INFO ] [MAIN ] TCBX: Generated 139 derivative records from 10283 primary records. [2025-10-24T00:56:25.116901] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-24T00:56:25.117950] [FATAL] [LOCAL ] TCBX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:25.118318] [FATAL] [MAIN ] TCBX: Failed to save derivative data. [2025-10-24T00:56:25.120698] [INFO ] [MAIN ] Derivative Progress: 1867/2164 symbols completed. TCBX took 1.1s. Estimated remaining: 1m 59s. Rate: 149.4 symbols/min [2025-10-24T00:56:25.120929] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:25.144631] [DEBUG] [LOCAL ] TDF: Loaded 6235 existing records from primary storage. [2025-10-24T00:56:25.145058] [DEBUG] [MAIN ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:25.145245] [INFO ] [MAIN ] TDF: Loaded 6235 primary data records. [2025-10-24T00:56:25.284096] [DEBUG] [MAIN ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:25.522384] [INFO ] [MAIN ] TD: Generated 139 derivative records from 52588 primary records. [2025-10-24T00:56:25.525577] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-24T00:56:25.525968] [FATAL] [LOCAL ] TD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:25.527758] [FATAL] [MAIN ] TD: Failed to save derivative data. [2025-10-24T00:56:25.529771] [INFO ] [MAIN ] Derivative Progress: 1868/2164 symbols completed. TD took 1.4s. Estimated remaining: 1m 59s. Rate: 149.4 symbols/min [2025-10-24T00:56:25.530077] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:25.538194] [INFO ] [MAIN ] TDC: Generated 139 derivative records from 46766 primary records. [2025-10-24T00:56:25.540447] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-24T00:56:25.541729] [FATAL] [LOCAL ] TDC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:25.541958] [FATAL] [MAIN ] TDC: Failed to save derivative data. [2025-10-24T00:56:25.544819] [INFO ] [MAIN ] Derivative Progress: 1869/2164 symbols completed. TDC took 1.2s. Estimated remaining: 1m 58s. Rate: 149.5 symbols/min [2025-10-24T00:56:25.558426] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:25.559022] [DEBUG] [MAIN ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:25.604464] [DEBUG] [LOCAL ] TDG: Loaded 22110 existing records from primary storage. [2025-10-24T00:56:25.609209] [INFO ] [MAIN ] TDG: Loaded 22110 primary data records. [2025-10-24T00:56:25.626698] [INFO ] [MAIN ] TDF: Generated 139 derivative records from 6235 primary records. [2025-10-24T00:56:25.649304] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-24T00:56:25.655486] [FATAL] [LOCAL ] TDF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:25.685143] [FATAL] [MAIN ] TDF: Failed to save derivative data. [2025-10-24T00:56:25.729899] [INFO ] [MAIN ] Derivative Progress: 1870/2164 symbols completed. TDF took 0.6s. Estimated remaining: 1m 58s. Rate: 149.5 symbols/min [2025-10-24T00:56:25.742100] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:25.955053] [DEBUG] [LOCAL ] TDOC: Loaded 53758 existing records from primary storage. [2025-10-24T00:56:25.955555] [INFO ] [MAIN ] TDOC: Loaded 53758 primary data records. [2025-10-24T00:56:26.384902] [DEBUG] [LOCAL ] TDS: Loaded 42409 existing records from primary storage. [2025-10-24T00:56:26.385556] [INFO ] [MAIN ] TDS: Loaded 42409 primary data records. [2025-10-24T00:56:26.509557] [DEBUG] [MAIN ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:26.759083] [DEBUG] [MAIN ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:26.782071] [INFO ] [MAIN ] TDG: Generated 139 derivative records from 22110 primary records. [2025-10-24T00:56:26.786861] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-24T00:56:26.787337] [FATAL] [LOCAL ] TDG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:26.787537] [FATAL] [MAIN ] TDG: Failed to save derivative data. [2025-10-24T00:56:26.790747] [INFO ] [MAIN ] Derivative Progress: 1871/2164 symbols completed. TDG took 1.3s. Estimated remaining: 1m 58s. Rate: 149.4 symbols/min [2025-10-24T00:56:26.793474] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:26.814841] [DEBUG] [MAIN ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:26.843042] [INFO ] [MAIN ] TDOC: Generated 139 derivative records from 53758 primary records. [2025-10-24T00:56:26.844558] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-24T00:56:26.857134] [FATAL] [LOCAL ] TDOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:26.857606] [FATAL] [MAIN ] TDOC: Failed to save derivative data. [2025-10-24T00:56:26.861946] [INFO ] [MAIN ] Derivative Progress: 1872/2164 symbols completed. TDOC took 1.3s. Estimated remaining: 1m 57s. Rate: 149.4 symbols/min [2025-10-24T00:56:26.864959] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:26.879413] [DEBUG] [LOCAL ] TDW: Loaded 45265 existing records from primary storage. [2025-10-24T00:56:26.881001] [INFO ] [MAIN ] TDW: Loaded 45265 primary data records. [2025-10-24T00:56:26.981074] [INFO ] [MAIN ] TDS: Generated 139 derivative records from 42409 primary records. [2025-10-24T00:56:27.001965] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-24T00:56:27.012073] [FATAL] [LOCAL ] TDS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:27.024158] [FATAL] [MAIN ] TDS: Failed to save derivative data. [2025-10-24T00:56:27.024059] [DEBUG] [LOCAL ] TDY: Loaded 22311 existing records from primary storage. [2025-10-24T00:56:27.052872] [INFO ] [MAIN ] TDY: Loaded 22311 primary data records. [2025-10-24T00:56:27.056978] [INFO ] [MAIN ] Derivative Progress: 1873/2164 symbols completed. TDS took 1.3s. Estimated remaining: 1m 57s. Rate: 149.5 symbols/min [2025-10-24T00:56:27.566828] [DEBUG] [MAIN ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:27.600622] [DEBUG] [MAIN ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:27.634234] [INFO ] [MAIN ] TDW: Generated 139 derivative records from 45265 primary records. [2025-10-24T00:56:27.634580] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-24T00:56:27.635587] [FATAL] [LOCAL ] TDW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:27.636064] [FATAL] [MAIN ] TDW: Failed to save derivative data. [2025-10-24T00:56:27.638049] [INFO ] [MAIN ] Derivative Progress: 1874/2164 symbols completed. TDW took 0.8s. Estimated remaining: 1m 56s. Rate: 149.4 symbols/min [2025-10-24T00:56:27.645823] [INFO ] [MAIN ] TDY: Generated 139 derivative records from 22311 primary records. [2025-10-24T00:56:27.645922] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-24T00:56:27.646134] [FATAL] [LOCAL ] TDY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:27.646211] [FATAL] [MAIN ] TDY: Failed to save derivative data. [2025-10-24T00:56:27.648379] [INFO ] [MAIN ] Derivative Progress: 1875/2164 symbols completed. TDY took 0.8s. Estimated remaining: 1m 56s. Rate: 149.5 symbols/min [2025-10-24T00:56:27.648851] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:27.648937] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:27.649218] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:27.661507] [DEBUG] [LOCAL ] TEAF: Loaded 7393 existing records from primary storage. [2025-10-24T00:56:27.661704] [INFO ] [MAIN ] TEAF: Loaded 7393 primary data records. [2025-10-24T00:56:28.000970] [DEBUG] [LOCAL ] TEF: Loaded 37042 existing records from primary storage. [2025-10-24T00:56:28.001330] [INFO ] [MAIN ] TEF: Loaded 37042 primary data records. [2025-10-24T00:56:28.053982] [DEBUG] [LOCAL ] TECK: Loaded 53821 existing records from primary storage. [2025-10-24T00:56:28.081962] [INFO ] [MAIN ] TECK: Loaded 53821 primary data records. [2025-10-24T00:56:28.723253] [DEBUG] [MAIN ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:28.773680] [DEBUG] [MAIN ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:28.817017] [DEBUG] [MAIN ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:28.830296] [INFO ] [MAIN ] TEAF: Generated 139 derivative records from 7393 primary records. [2025-10-24T00:56:28.833167] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-24T00:56:28.833622] [FATAL] [LOCAL ] TEAF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:28.838070] [FATAL] [MAIN ] TEAF: Failed to save derivative data. [2025-10-24T00:56:28.840541] [INFO ] [MAIN ] Derivative Progress: 1876/2164 symbols completed. TEAF took 1.2s. Estimated remaining: 1m 56s. Rate: 149.4 symbols/min [2025-10-24T00:56:28.841299] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:28.887591] [INFO ] [MAIN ] TEF: Generated 139 derivative records from 37042 primary records. [2025-10-24T00:56:28.885182] [DEBUG] [LOCAL ] TEI: Loaded 21262 existing records from primary storage. [2025-10-24T00:56:28.888401] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-24T00:56:28.889142] [FATAL] [LOCAL ] TEF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:28.888235] [INFO ] [MAIN ] TEI: Loaded 21262 primary data records. [2025-10-24T00:56:28.889627] [FATAL] [MAIN ] TEF: Failed to save derivative data. [2025-10-24T00:56:28.895271] [INFO ] [MAIN ] Derivative Progress: 1877/2164 symbols completed. TEF took 1.2s. Estimated remaining: 1m 55s. Rate: 149.4 symbols/min [2025-10-24T00:56:28.895579] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:28.995849] [INFO ] [MAIN ] TECK: Generated 139 derivative records from 53821 primary records. [2025-10-24T00:56:29.006818] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-24T00:56:29.007430] [FATAL] [LOCAL ] TECK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:29.012786] [FATAL] [MAIN ] TECK: Failed to save derivative data. [2025-10-24T00:56:29.036214] [INFO ] [MAIN ] Derivative Progress: 1878/2164 symbols completed. TECK took 1.4s. Estimated remaining: 1m 55s. Rate: 149.5 symbols/min [2025-10-24T00:56:29.036369] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:29.256389] [DEBUG] [LOCAL ] TEL: Loaded 51400 existing records from primary storage. [2025-10-24T00:56:29.257143] [INFO ] [MAIN ] TEL: Loaded 51400 primary data records. [2025-10-24T00:56:29.256961] [DEBUG] [LOCAL ] TEN: Loaded 30505 existing records from primary storage. [2025-10-24T00:56:29.257805] [INFO ] [MAIN ] TEN: Loaded 30505 primary data records. [2025-10-24T00:56:29.515912] [DEBUG] [MAIN ] TEI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:29.912038] [INFO ] [MAIN ] TEI: Generated 139 derivative records from 21262 primary records. [2025-10-24T00:56:29.912706] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-24T00:56:29.912937] [FATAL] [LOCAL ] TEI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:29.913015] [FATAL] [MAIN ] TEI: Failed to save derivative data. [2025-10-24T00:56:29.915209] [INFO ] [MAIN ] Derivative Progress: 1879/2164 symbols completed. TEI took 1.1s. Estimated remaining: 1m 54s. Rate: 149.4 symbols/min [2025-10-24T00:56:29.915670] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:29.947126] [DEBUG] [MAIN ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:29.964514] [DEBUG] [MAIN ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:29.990538] [DEBUG] [LOCAL ] TEO: Loaded 23036 existing records from primary storage. [2025-10-24T00:56:29.997141] [INFO ] [MAIN ] TEO: Loaded 23036 primary data records. [2025-10-24T00:56:30.378835] [INFO ] [MAIN ] TEL: Generated 139 derivative records from 51400 primary records. [2025-10-24T00:56:30.381723] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-24T00:56:30.382899] [INFO ] [MAIN ] TEN: Generated 139 derivative records from 30505 primary records. [2025-10-24T00:56:30.382722] [FATAL] [LOCAL ] TEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:30.383437] [FATAL] [MAIN ] TEL: Failed to save derivative data. [2025-10-24T00:56:30.386039] [INFO ] [MAIN ] Derivative Progress: 1880/2164 symbols completed. TEL took 1.5s. Estimated remaining: 1m 54s. Rate: 149.4 symbols/min [2025-10-24T00:56:30.383243] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-24T00:56:30.386816] [FATAL] [LOCAL ] TEN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:30.387308] [FATAL] [MAIN ] TEN: Failed to save derivative data. [2025-10-24T00:56:30.386231] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:30.389494] [INFO ] [MAIN ] Derivative Progress: 1881/2164 symbols completed. TEN took 1.4s. Estimated remaining: 1m 54s. Rate: 149.5 symbols/min [2025-10-24T00:56:30.390402] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:30.411031] [DEBUG] [MAIN ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:30.474628] [INFO ] [MAIN ] TEO: Generated 139 derivative records from 23036 primary records. [2025-10-24T00:56:30.475610] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-24T00:56:30.490504] [FATAL] [LOCAL ] TEO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:30.491674] [DEBUG] [LOCAL ] TEVA: Loaded 54007 existing records from primary storage. [2025-10-24T00:56:30.491808] [FATAL] [MAIN ] TEO: Failed to save derivative data. [2025-10-24T00:56:30.493901] [INFO ] [MAIN ] Derivative Progress: 1882/2164 symbols completed. TEO took 0.6s. Estimated remaining: 1m 53s. Rate: 149.5 symbols/min [2025-10-24T00:56:30.491925] [INFO ] [MAIN ] TEVA: Loaded 54007 primary data records. [2025-10-24T00:56:30.504829] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:30.537765] [DEBUG] [LOCAL ] TEX: Loaded 43837 existing records from primary storage. [2025-10-24T00:56:30.562137] [INFO ] [MAIN ] TEX: Loaded 43837 primary data records. [2025-10-24T00:56:31.140162] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-24T00:56:31.140509] [INFO ] [MAIN ] TFC: Loaded 54057 primary data records. [2025-10-24T00:56:31.457739] [DEBUG] [MAIN ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:31.495822] [DEBUG] [MAIN ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:31.559242] [DEBUG] [MAIN ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:31.581481] [INFO ] [MAIN ] TEVA: Generated 139 derivative records from 54007 primary records. [2025-10-24T00:56:31.582570] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-24T00:56:31.583363] [FATAL] [LOCAL ] TEVA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:31.587141] [FATAL] [MAIN ] TEVA: Failed to save derivative data. [2025-10-24T00:56:31.589804] [INFO ] [MAIN ] Derivative Progress: 1883/2164 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 53s. Rate: 149.4 symbols/min [2025-10-24T00:56:31.592337] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:31.593879] [INFO ] [MAIN ] TEX: Generated 139 derivative records from 43837 primary records. [2025-10-24T00:56:31.594088] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-24T00:56:31.594806] [FATAL] [LOCAL ] TEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:31.594975] [FATAL] [MAIN ] TEX: Failed to save derivative data. [2025-10-24T00:56:31.599189] [INFO ] [MAIN ] Derivative Progress: 1884/2164 symbols completed. TEX took 1.2s. Estimated remaining: 1m 52s. Rate: 149.5 symbols/min [2025-10-24T00:56:31.599564] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:31.611244] [INFO ] [MAIN ] TFC: Generated 139 derivative records from 54057 primary records. [2025-10-24T00:56:31.611444] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-24T00:56:31.611682] [FATAL] [LOCAL ] TFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:31.611793] [FATAL] [MAIN ] TFC: Failed to save derivative data. [2025-10-24T00:56:31.615734] [INFO ] [MAIN ] Derivative Progress: 1885/2164 symbols completed. TFC took 1.1s. Estimated remaining: 1m 52s. Rate: 149.5 symbols/min [2025-10-24T00:56:31.616001] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:31.640497] [DEBUG] [LOCAL ] TFIN: Loaded 23831 existing records from primary storage. [2025-10-24T00:56:31.640695] [INFO ] [MAIN ] TFIN: Loaded 23831 primary data records. [2025-10-24T00:56:31.730225] [DEBUG] [LOCAL ] TFII: Loaded 32486 existing records from primary storage. [2025-10-24T00:56:31.741541] [INFO ] [MAIN ] TFII: Loaded 32486 primary data records. [2025-10-24T00:56:31.931121] [DEBUG] [LOCAL ] TFPM: Loaded 40157 existing records from primary storage. [2025-10-24T00:56:31.965753] [INFO ] [MAIN ] TFPM: Loaded 40157 primary data records. [2025-10-24T00:56:32.663186] [DEBUG] [MAIN ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:32.690269] [DEBUG] [MAIN ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:32.732511] [DEBUG] [MAIN ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:32.781055] [INFO ] [MAIN ] TFIN: Generated 139 derivative records from 23831 primary records. [2025-10-24T00:56:32.784105] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-24T00:56:32.784568] [FATAL] [LOCAL ] TFIN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:32.785819] [FATAL] [MAIN ] TFIN: Failed to save derivative data. [2025-10-24T00:56:32.788185] [INFO ] [MAIN ] Derivative Progress: 1886/2164 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 52s. Rate: 149.4 symbols/min [2025-10-24T00:56:32.785542] [INFO ] [MAIN ] TFII: Generated 139 derivative records from 32486 primary records. [2025-10-24T00:56:32.788724] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:32.791678] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-24T00:56:32.792427] [FATAL] [LOCAL ] TFII: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:32.792568] [FATAL] [MAIN ] TFII: Failed to save derivative data. [2025-10-24T00:56:32.798996] [INFO ] [MAIN ] TFPM: Generated 139 derivative records from 40157 primary records. [2025-10-24T00:56:32.796200] [INFO ] [MAIN ] Derivative Progress: 1887/2164 symbols completed. TFII took 1.2s. Estimated remaining: 1m 51s. Rate: 149.5 symbols/min [2025-10-24T00:56:32.799196] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:32.799635] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-24T00:56:32.799996] [FATAL] [LOCAL ] TFPM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:32.800075] [FATAL] [MAIN ] TFPM: Failed to save derivative data. [2025-10-24T00:56:32.802671] [INFO ] [MAIN ] Derivative Progress: 1888/2164 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 51s. Rate: 149.5 symbols/min [2025-10-24T00:56:32.816379] [DEBUG] [LOCAL ] TG: Loaded 10709 existing records from primary storage. [2025-10-24T00:56:32.816627] [INFO ] [MAIN ] TG: Loaded 10709 primary data records. [2025-10-24T00:56:32.989139] [DEBUG] [LOCAL ] TFX: Loaded 35805 existing records from primary storage. [2025-10-24T00:56:33.005576] [INFO ] [MAIN ] TFX: Loaded 35805 primary data records. [2025-10-24T00:56:33.436670] [DEBUG] [MAIN ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:33.485449] [INFO ] [MAIN ] TG: Generated 139 derivative records from 10709 primary records. [2025-10-24T00:56:33.485736] [DEBUG] [MAIN ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:33.497714] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-24T00:56:33.498848] [FATAL] [LOCAL ] TG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:33.499299] [FATAL] [MAIN ] TG: Failed to save derivative data. [2025-10-24T00:56:33.502889] [INFO ] [MAIN ] Derivative Progress: 1889/2164 symbols completed. TG took 0.7s. Estimated remaining: 1m 50s. Rate: 149.5 symbols/min [2025-10-24T00:56:33.516038] [INFO ] [MAIN ] TFX: Generated 139 derivative records from 35805 primary records. [2025-10-24T00:56:33.516201] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-24T00:56:33.516381] [FATAL] [LOCAL ] TFX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:33.516457] [FATAL] [MAIN ] TFX: Failed to save derivative data. [2025-10-24T00:56:33.518362] [INFO ] [MAIN ] Derivative Progress: 1890/2164 symbols completed. TFX took 0.7s. Estimated remaining: 1m 50s. Rate: 149.6 symbols/min [2025-10-24T00:56:33.518787] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:33.519199] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:33.519123] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:33.554756] [DEBUG] [LOCAL ] TGLS: Loaded 27762 existing records from primary storage. [2025-10-24T00:56:33.564225] [INFO ] [MAIN ] TGLS: Loaded 27762 primary data records. [2025-10-24T00:56:33.574403] [DEBUG] [LOCAL ] TGS: Loaded 34102 existing records from primary storage. [2025-10-24T00:56:33.621441] [INFO ] [MAIN ] TGS: Loaded 34102 primary data records. [2025-10-24T00:56:33.762974] [DEBUG] [LOCAL ] TGNA: Loaded 48836 existing records from primary storage. [2025-10-24T00:56:33.795764] [INFO ] [MAIN ] TGNA: Loaded 48836 primary data records. [2025-10-24T00:56:34.572048] [DEBUG] [MAIN ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:34.629860] [DEBUG] [MAIN ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:34.628839] [DEBUG] [MAIN ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:34.699568] [INFO ] [MAIN ] TGLS: Generated 139 derivative records from 27762 primary records. [2025-10-24T00:56:34.700246] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-24T00:56:34.703726] [FATAL] [LOCAL ] TGLS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:34.704293] [FATAL] [MAIN ] TGLS: Failed to save derivative data. [2025-10-24T00:56:34.707021] [INFO ] [MAIN ] Derivative Progress: 1891/2164 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 50s. Rate: 149.4 symbols/min [2025-10-24T00:56:34.707252] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:34.721243] [INFO ] [MAIN ] TGNA: Generated 139 derivative records from 48836 primary records. [2025-10-24T00:56:34.723751] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-24T00:56:34.724184] [FATAL] [LOCAL ] TGNA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:34.726275] [FATAL] [MAIN ] TGNA: Failed to save derivative data. [2025-10-24T00:56:34.729477] [INFO ] [MAIN ] Derivative Progress: 1892/2164 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 49s. Rate: 149.5 symbols/min [2025-10-24T00:56:34.726514] [INFO ] [MAIN ] TGS: Generated 139 derivative records from 34102 primary records. [2025-10-24T00:56:34.729750] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:34.729979] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-24T00:56:34.730236] [FATAL] [LOCAL ] TGS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:34.730629] [FATAL] [MAIN ] TGS: Failed to save derivative data. [2025-10-24T00:56:34.733375] [INFO ] [MAIN ] Derivative Progress: 1893/2164 symbols completed. TGS took 1.2s. Estimated remaining: 1m 49s. Rate: 149.6 symbols/min [2025-10-24T00:56:34.733697] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:34.794297] [DEBUG] [LOCAL ] THG: Loaded 21631 existing records from primary storage. [2025-10-24T00:56:34.793549] [DEBUG] [LOCAL ] TGT: Loaded 54167 existing records from primary storage. [2025-10-24T00:56:34.794757] [INFO ] [MAIN ] THG: Loaded 21631 primary data records. [2025-10-24T00:56:34.794629] [INFO ] [MAIN ] TGT: Loaded 54167 primary data records. [2025-10-24T00:56:34.986595] [DEBUG] [LOCAL ] THC: Loaded 46974 existing records from primary storage. [2025-10-24T00:56:35.015802] [INFO ] [MAIN ] THC: Loaded 46974 primary data records. [2025-10-24T00:56:35.771674] [DEBUG] [MAIN ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:35.771819] [DEBUG] [MAIN ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:35.816096] [DEBUG] [MAIN ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:35.886756] [INFO ] [MAIN ] THG: Generated 139 derivative records from 21631 primary records. [2025-10-24T00:56:35.888925] [INFO ] [MAIN ] THC: Generated 139 derivative records from 46974 primary records. [2025-10-24T00:56:35.890622] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-24T00:56:35.890859] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-24T00:56:35.891073] [INFO ] [MAIN ] TGT: Generated 139 derivative records from 54167 primary records. [2025-10-24T00:56:35.891319] [FATAL] [LOCAL ] THC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:35.891623] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-24T00:56:35.891544] [FATAL] [LOCAL ] THG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:35.892253] [FATAL] [MAIN ] THG: Failed to save derivative data. [2025-10-24T00:56:35.894537] [INFO ] [MAIN ] Derivative Progress: 1894/2164 symbols completed. THG took 1.2s. Estimated remaining: 1m 48s. Rate: 149.4 symbols/min [2025-10-24T00:56:35.891925] [FATAL] [MAIN ] THC: Failed to save derivative data. [2025-10-24T00:56:35.892121] [FATAL] [LOCAL ] TGT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:35.894717] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:35.897434] [INFO ] [MAIN ] Derivative Progress: 1895/2164 symbols completed. THC took 1.2s. Estimated remaining: 1m 48s. Rate: 149.5 symbols/min [2025-10-24T00:56:35.897621] [FATAL] [MAIN ] TGT: Failed to save derivative data. [2025-10-24T00:56:35.900414] [INFO ] [MAIN ] Derivative Progress: 1896/2164 symbols completed. TGT took 1.2s. Estimated remaining: 1m 48s. Rate: 149.6 symbols/min [2025-10-24T00:56:35.898459] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:35.900791] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:35.905281] [DEBUG] [LOCAL ] THIR: Loaded 2480 existing records from primary storage. [2025-10-24T00:56:35.905901] [INFO ] [MAIN ] THIR: Loaded 2480 primary data records. [2025-10-24T00:56:35.961944] [DEBUG] [LOCAL ] THLV: Loaded 1496 existing records from primary storage. [2025-10-24T00:56:35.970744] [INFO ] [MAIN ] THLV: Loaded 1496 primary data records. [2025-10-24T00:56:36.219358] [DEBUG] [LOCAL ] THO: Loaded 41235 existing records from primary storage. [2025-10-24T00:56:36.404130] [INFO ] [MAIN ] THO: Loaded 41235 primary data records. [2025-10-24T00:56:36.890753] [DEBUG] [MAIN ] THIR: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-24T00:56:36.918267] [DEBUG] [MAIN ] THLV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-24T00:56:36.965139] [DEBUG] [MAIN ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:37.016948] [INFO ] [MAIN ] THLV: Generated 139 derivative records from 1496 primary records. [2025-10-24T00:56:37.015114] [INFO ] [MAIN ] THIR: Generated 139 derivative records from 2480 primary records. [2025-10-24T00:56:37.018422] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-24T00:56:37.018844] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-24T00:56:37.019257] [FATAL] [LOCAL ] THLV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:37.019363] [FATAL] [MAIN ] THLV: Failed to save derivative data. [2025-10-24T00:56:37.021983] [INFO ] [MAIN ] Derivative Progress: 1897/2164 symbols completed. THLV took 1.1s. Estimated remaining: 1m 47s. Rate: 149.4 symbols/min [2025-10-24T00:56:37.019686] [FATAL] [LOCAL ] THIR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:37.022477] [FATAL] [MAIN ] THIR: Failed to save derivative data. [2025-10-24T00:56:37.024380] [INFO ] [MAIN ] Derivative Progress: 1898/2164 symbols completed. THIR took 1.1s. Estimated remaining: 1m 47s. Rate: 149.5 symbols/min [2025-10-24T00:56:37.022147] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:37.025258] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:37.038624] [INFO ] [MAIN ] THO: Generated 139 derivative records from 41235 primary records. [2025-10-24T00:56:37.038880] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-24T00:56:37.039078] [FATAL] [LOCAL ] THO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:37.039151] [FATAL] [MAIN ] THO: Failed to save derivative data. [2025-10-24T00:56:37.041721] [INFO ] [MAIN ] Derivative Progress: 1899/2164 symbols completed. THO took 1.1s. Estimated remaining: 1m 46s. Rate: 149.6 symbols/min [2025-10-24T00:56:37.042033] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:37.063042] [DEBUG] [LOCAL ] THR: Loaded 19624 existing records from primary storage. [2025-10-24T00:56:37.063213] [INFO ] [MAIN ] THR: Loaded 19624 primary data records. [2025-10-24T00:56:37.083274] [DEBUG] [LOCAL ] THQ: Loaded 25471 existing records from primary storage. [2025-10-24T00:56:37.115261] [INFO ] [MAIN ] THQ: Loaded 25471 primary data records. [2025-10-24T00:56:37.380935] [DEBUG] [LOCAL ] THS: Loaded 38900 existing records from primary storage. [2025-10-24T00:56:37.419097] [INFO ] [MAIN ] THS: Loaded 38900 primary data records. [2025-10-24T00:56:38.049937] [DEBUG] [MAIN ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:38.077474] [DEBUG] [MAIN ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:38.125220] [DEBUG] [MAIN ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:38.167409] [INFO ] [MAIN ] THQ: Generated 139 derivative records from 25471 primary records. [2025-10-24T00:56:38.170212] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-24T00:56:38.170454] [FATAL] [LOCAL ] THQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:38.172756] [FATAL] [MAIN ] THQ: Failed to save derivative data. [2025-10-24T00:56:38.177584] [INFO ] [MAIN ] Derivative Progress: 1900/2164 symbols completed. THQ took 1.2s. Estimated remaining: 1m 46s. Rate: 149.4 symbols/min [2025-10-24T00:56:38.179140] [INFO ] [MAIN ] THR: Generated 139 derivative records from 19624 primary records. [2025-10-24T00:56:38.179771] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:38.180413] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-24T00:56:38.180695] [FATAL] [LOCAL ] THR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:38.180906] [FATAL] [MAIN ] THR: Failed to save derivative data. [2025-10-24T00:56:38.182965] [INFO ] [MAIN ] Derivative Progress: 1901/2164 symbols completed. THR took 1.2s. Estimated remaining: 1m 46s. Rate: 149.5 symbols/min [2025-10-24T00:56:38.186107] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:38.190123] [INFO ] [MAIN ] THS: Generated 139 derivative records from 38900 primary records. [2025-10-24T00:56:38.190293] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-24T00:56:38.190514] [FATAL] [LOCAL ] THS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:38.190603] [FATAL] [MAIN ] THS: Failed to save derivative data. [2025-10-24T00:56:38.193258] [INFO ] [MAIN ] Derivative Progress: 1902/2164 symbols completed. THS took 1.2s. Estimated remaining: 1m 45s. Rate: 149.6 symbols/min [2025-10-24T00:56:38.193572] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:38.204186] [DEBUG] [LOCAL ] TISI: Loaded 3185 existing records from primary storage. [2025-10-24T00:56:38.204363] [INFO ] [MAIN ] TISI: Loaded 3185 primary data records. [2025-10-24T00:56:38.291915] [DEBUG] [LOCAL ] THW: Loaded 19695 existing records from primary storage. [2025-10-24T00:56:38.297911] [INFO ] [MAIN ] THW: Loaded 19695 primary data records. [2025-10-24T00:56:38.430271] [DEBUG] [LOCAL ] TIMB: Loaded 34898 existing records from primary storage. [2025-10-24T00:56:38.441164] [INFO ] [MAIN ] TIMB: Loaded 34898 primary data records. [2025-10-24T00:56:39.189747] [DEBUG] [MAIN ] TISI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:39.215744] [DEBUG] [MAIN ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:39.255343] [DEBUG] [MAIN ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:39.319102] [INFO ] [MAIN ] THW: Generated 139 derivative records from 19695 primary records. [2025-10-24T00:56:39.324192] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-24T00:56:39.326572] [FATAL] [LOCAL ] THW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:39.326703] [FATAL] [MAIN ] THW: Failed to save derivative data. [2025-10-24T00:56:39.332283] [INFO ] [MAIN ] TISI: Generated 139 derivative records from 3185 primary records. [2025-10-24T00:56:39.331458] [INFO ] [MAIN ] Derivative Progress: 1903/2164 symbols completed. THW took 1.2s. Estimated remaining: 1m 45s. Rate: 149.4 symbols/min [2025-10-24T00:56:39.334814] [INFO ] [MAIN ] TIMB: Generated 139 derivative records from 34898 primary records. [2025-10-24T00:56:39.335214] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-24T00:56:39.335551] [FATAL] [LOCAL ] TIMB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:39.335036] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-24T00:56:39.335862] [FATAL] [MAIN ] TIMB: Failed to save derivative data. [2025-10-24T00:56:39.336123] [FATAL] [LOCAL ] TISI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:39.338757] [INFO ] [MAIN ] Derivative Progress: 1904/2164 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 44s. Rate: 149.5 symbols/min [2025-10-24T00:56:39.338848] [FATAL] [MAIN ] TISI: Failed to save derivative data. [2025-10-24T00:56:39.341159] [INFO ] [MAIN ] Derivative Progress: 1905/2164 symbols completed. TISI took 1.1s. Estimated remaining: 1m 44s. Rate: 149.6 symbols/min [2025-10-24T00:56:39.341543] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:39.341679] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:39.341815] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:39.379102] [DEBUG] [LOCAL ] TIXT: Loaded 32881 existing records from primary storage. [2025-10-24T00:56:39.379271] [INFO ] [MAIN ] TIXT: Loaded 32881 primary data records. [2025-10-24T00:56:39.544920] [DEBUG] [LOCAL ] TK: Loaded 39324 existing records from primary storage. [2025-10-24T00:56:39.590889] [INFO ] [MAIN ] TK: Loaded 39324 primary data records. [2025-10-24T00:56:39.737992] [DEBUG] [LOCAL ] TJX: Loaded 54050 existing records from primary storage. [2025-10-24T00:56:39.758204] [INFO ] [MAIN ] TJX: Loaded 54050 primary data records. [2025-10-24T00:56:40.442793] [DEBUG] [MAIN ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:40.517416] [DEBUG] [MAIN ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:40.532394] [INFO ] [MAIN ] TIXT: Generated 139 derivative records from 32881 primary records. [2025-10-24T00:56:40.534638] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-24T00:56:40.517976] [DEBUG] [MAIN ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:40.535190] [FATAL] [LOCAL ] TIXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:40.536259] [FATAL] [MAIN ] TIXT: Failed to save derivative data. [2025-10-24T00:56:40.553947] [INFO ] [MAIN ] Derivative Progress: 1906/2164 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 44s. Rate: 149.4 symbols/min [2025-10-24T00:56:40.556903] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:40.604098] [INFO ] [MAIN ] TJX: Generated 139 derivative records from 54050 primary records. [2025-10-24T00:56:40.604745] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-24T00:56:40.605333] [FATAL] [LOCAL ] TJX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:40.606231] [FATAL] [MAIN ] TJX: Failed to save derivative data. [2025-10-24T00:56:40.609436] [INFO ] [MAIN ] Derivative Progress: 1907/2164 symbols completed. TJX took 1.3s. Estimated remaining: 1m 43s. Rate: 149.5 symbols/min [2025-10-24T00:56:40.612374] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:40.612046] [INFO ] [MAIN ] TK: Generated 139 derivative records from 39324 primary records. [2025-10-24T00:56:40.624269] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-24T00:56:40.625254] [DEBUG] [LOCAL ] TKC: Loaded 40332 existing records from primary storage. [2025-10-24T00:56:40.624598] [FATAL] [LOCAL ] TK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:40.625590] [INFO ] [MAIN ] TKC: Loaded 40332 primary data records. [2025-10-24T00:56:40.625677] [FATAL] [MAIN ] TK: Failed to save derivative data. [2025-10-24T00:56:40.650973] [INFO ] [MAIN ] Derivative Progress: 1908/2164 symbols completed. TK took 1.3s. Estimated remaining: 1m 43s. Rate: 149.6 symbols/min [2025-10-24T00:56:40.685985] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:40.955131] [DEBUG] [LOCAL ] TKO: Loaded 43818 existing records from primary storage. [2025-10-24T00:56:40.964419] [INFO ] [MAIN ] TKO: Loaded 43818 primary data records. [2025-10-24T00:56:41.089446] [DEBUG] [LOCAL ] TKR: Loaded 39524 existing records from primary storage. [2025-10-24T00:56:41.100530] [INFO ] [MAIN ] TKR: Loaded 39524 primary data records. [2025-10-24T00:56:41.420499] [DEBUG] [MAIN ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:41.661122] [DEBUG] [MAIN ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:41.663463] [INFO ] [MAIN ] TKC: Generated 139 derivative records from 40332 primary records. [2025-10-24T00:56:41.674341] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-24T00:56:41.677332] [FATAL] [LOCAL ] TKC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:41.690076] [DEBUG] [MAIN ] TKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:41.689822] [FATAL] [MAIN ] TKC: Failed to save derivative data. [2025-10-24T00:56:41.706705] [INFO ] [MAIN ] Derivative Progress: 1909/2164 symbols completed. TKC took 1.1s. Estimated remaining: 1m 42s. Rate: 149.4 symbols/min [2025-10-24T00:56:41.713740] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:41.757789] [INFO ] [MAIN ] TKO: Generated 139 derivative records from 43818 primary records. [2025-10-24T00:56:41.759442] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-24T00:56:41.759749] [FATAL] [LOCAL ] TKO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:41.759895] [FATAL] [MAIN ] TKO: Failed to save derivative data. [2025-10-24T00:56:41.763934] [INFO ] [MAIN ] Derivative Progress: 1910/2164 symbols completed. TKO took 1.2s. Estimated remaining: 1m 42s. Rate: 149.5 symbols/min [2025-10-24T00:56:41.764183] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:41.764484] [INFO ] [MAIN ] TKR: Generated 139 derivative records from 39524 primary records. [2025-10-24T00:56:41.764764] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-24T00:56:41.765101] [FATAL] [LOCAL ] TKR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:41.765783] [FATAL] [MAIN ] TKR: Failed to save derivative data. [2025-10-24T00:56:41.769820] [INFO ] [MAIN ] Derivative Progress: 1911/2164 symbols completed. TKR took 1.1s. Estimated remaining: 1m 41s. Rate: 149.6 symbols/min [2025-10-24T00:56:41.770127] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:41.783182] [DEBUG] [LOCAL ] TLK: Loaded 39028 existing records from primary storage. [2025-10-24T00:56:41.783585] [INFO ] [MAIN ] TLK: Loaded 39028 primary data records. [2025-10-24T00:56:41.896268] [DEBUG] [LOCAL ] TLYS: Loaded 16609 existing records from primary storage. [2025-10-24T00:56:41.912394] [INFO ] [MAIN ] TLYS: Loaded 16609 primary data records. [2025-10-24T00:56:42.293720] [DEBUG] [LOCAL ] TM: Loaded 36277 existing records from primary storage. [2025-10-24T00:56:42.300530] [INFO ] [MAIN ] TM: Loaded 36277 primary data records. [2025-10-24T00:56:42.812036] [DEBUG] [MAIN ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:42.844700] [DEBUG] [MAIN ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:42.893266] [DEBUG] [MAIN ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:42.927518] [INFO ] [MAIN ] TLK: Generated 139 derivative records from 39028 primary records. [2025-10-24T00:56:42.931058] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-24T00:56:42.931849] [FATAL] [LOCAL ] TLK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:42.931969] [FATAL] [MAIN ] TLK: Failed to save derivative data. [2025-10-24T00:56:42.935171] [INFO ] [MAIN ] Derivative Progress: 1912/2164 symbols completed. TLK took 1.2s. Estimated remaining: 1m 41s. Rate: 149.4 symbols/min [2025-10-24T00:56:42.936105] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:42.950072] [INFO ] [MAIN ] TLYS: Generated 139 derivative records from 16609 primary records. [2025-10-24T00:56:42.952005] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-24T00:56:42.954441] [FATAL] [LOCAL ] TLYS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:42.954742] [FATAL] [MAIN ] TLYS: Failed to save derivative data. [2025-10-24T00:56:42.954015] [INFO ] [MAIN ] TM: Generated 139 derivative records from 36277 primary records. [2025-10-24T00:56:42.954874] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-24T00:56:42.957457] [INFO ] [MAIN ] Derivative Progress: 1913/2164 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 41s. Rate: 149.5 symbols/min [2025-10-24T00:56:42.957780] [FATAL] [LOCAL ] TM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:42.958043] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:42.958146] [FATAL] [MAIN ] TM: Failed to save derivative data. [2025-10-24T00:56:42.960971] [INFO ] [MAIN ] Derivative Progress: 1914/2164 symbols completed. TM took 1.2s. Estimated remaining: 1m 40s. Rate: 149.6 symbols/min [2025-10-24T00:56:42.961454] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:43.012724] [DEBUG] [LOCAL ] TME: Loaded 53583 existing records from primary storage. [2025-10-24T00:56:43.013024] [INFO ] [MAIN ] TME: Loaded 53583 primary data records. [2025-10-24T00:56:43.141273] [DEBUG] [LOCAL ] TMHC: Loaded 46022 existing records from primary storage. [2025-10-24T00:56:43.163412] [INFO ] [MAIN ] TMHC: Loaded 46022 primary data records. [2025-10-24T00:56:43.292917] [DEBUG] [LOCAL ] TMO: Loaded 52781 existing records from primary storage. [2025-10-24T00:56:43.433229] [INFO ] [MAIN ] TMO: Loaded 52781 primary data records. [2025-10-24T00:56:43.971214] [DEBUG] [MAIN ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:44.010035] [DEBUG] [MAIN ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:44.040942] [DEBUG] [MAIN ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:44.088083] [INFO ] [MAIN ] TME: Generated 139 derivative records from 53583 primary records. [2025-10-24T00:56:44.093874] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-24T00:56:44.095744] [FATAL] [LOCAL ] TME: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:44.097283] [FATAL] [MAIN ] TME: Failed to save derivative data. [2025-10-24T00:56:44.099395] [INFO ] [MAIN ] Derivative Progress: 1915/2164 symbols completed. TME took 1.2s. Estimated remaining: 1m 40s. Rate: 149.4 symbols/min [2025-10-24T00:56:44.100606] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:44.114940] [INFO ] [MAIN ] TMHC: Generated 139 derivative records from 46022 primary records. [2025-10-24T00:56:44.115545] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-24T00:56:44.115250] [INFO ] [MAIN ] TMO: Generated 139 derivative records from 52781 primary records. [2025-10-24T00:56:44.119766] [FATAL] [LOCAL ] TMHC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:44.119447] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-24T00:56:44.120284] [FATAL] [MAIN ] TMHC: Failed to save derivative data. [2025-10-24T00:56:44.120210] [FATAL] [LOCAL ] TMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:44.120473] [FATAL] [MAIN ] TMO: Failed to save derivative data. [2025-10-24T00:56:44.124147] [INFO ] [MAIN ] Derivative Progress: 1916/2164 symbols completed. TMO took 1.2s. Estimated remaining: 1m 40s. Rate: 149.5 symbols/min [2025-10-24T00:56:44.126901] [INFO ] [MAIN ] Derivative Progress: 1917/2164 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 39s. Rate: 149.6 symbols/min [2025-10-24T00:56:44.126826] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:44.127143] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:44.133558] [DEBUG] [LOCAL ] TNC: Loaded 14222 existing records from primary storage. [2025-10-24T00:56:44.133710] [INFO ] [MAIN ] TNC: Loaded 14222 primary data records. [2025-10-24T00:56:44.500526] [DEBUG] [LOCAL ] TNET: Loaded 28369 existing records from primary storage. [2025-10-24T00:56:44.501287] [INFO ] [MAIN ] TNET: Loaded 28369 primary data records. [2025-10-24T00:56:44.502074] [DEBUG] [LOCAL ] TNK: Loaded 35590 existing records from primary storage. [2025-10-24T00:56:44.513548] [INFO ] [MAIN ] TNK: Loaded 35590 primary data records. [2025-10-24T00:56:45.131169] [DEBUG] [MAIN ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:45.188588] [DEBUG] [MAIN ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:45.214447] [INFO ] [MAIN ] TNC: Generated 139 derivative records from 14222 primary records. [2025-10-24T00:56:45.214828] [DEBUG] [MAIN ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:45.228347] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-24T00:56:45.232235] [FATAL] [LOCAL ] TNC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:45.232347] [FATAL] [MAIN ] TNC: Failed to save derivative data. [2025-10-24T00:56:45.236698] [INFO ] [MAIN ] Derivative Progress: 1918/2164 symbols completed. TNC took 1.1s. Estimated remaining: 1m 39s. Rate: 149.5 symbols/min [2025-10-24T00:56:45.267044] [INFO ] [MAIN ] TNK: Generated 139 derivative records from 35590 primary records. [2025-10-24T00:56:45.268718] [INFO ] [MAIN ] TNET: Generated 139 derivative records from 28369 primary records. [2025-10-24T00:56:45.268875] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-24T00:56:45.268975] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-24T00:56:45.269214] [FATAL] [LOCAL ] TNET: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:45.269362] [FATAL] [MAIN ] TNET: Failed to save derivative data. [2025-10-24T00:56:45.269619] [FATAL] [LOCAL ] TNK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:45.269768] [FATAL] [MAIN ] TNK: Failed to save derivative data. [2025-10-24T00:56:45.272499] [INFO ] [MAIN ] Derivative Progress: 1919/2164 symbols completed. TNET took 1.1s. Estimated remaining: 1m 38s. Rate: 149.5 symbols/min [2025-10-24T00:56:45.274963] [INFO ] [MAIN ] Derivative Progress: 1920/2164 symbols completed. TNK took 1.1s. Estimated remaining: 1m 38s. Rate: 149.6 symbols/min [2025-10-24T00:56:45.275336] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:45.275461] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:45.275592] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:45.351068] [DEBUG] [LOCAL ] TOL: Loaded 50843 existing records from primary storage. [2025-10-24T00:56:45.363010] [INFO ] [MAIN ] TOL: Loaded 50843 primary data records. [2025-10-24T00:56:45.385825] [DEBUG] [LOCAL ] TNL: Loaded 42070 existing records from primary storage. [2025-10-24T00:56:45.420945] [INFO ] [MAIN ] TNL: Loaded 42070 primary data records. [2025-10-24T00:56:45.577914] [DEBUG] [LOCAL ] TOST: Loaded 54080 existing records from primary storage. [2025-10-24T00:56:45.609896] [INFO ] [MAIN ] TOST: Loaded 54080 primary data records. [2025-10-24T00:56:46.345487] [DEBUG] [MAIN ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:46.369092] [DEBUG] [MAIN ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:46.405979] [DEBUG] [MAIN ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:46.472506] [INFO ] [MAIN ] TOL: Generated 139 derivative records from 50843 primary records. [2025-10-24T00:56:46.477060] [INFO ] [MAIN ] TNL: Generated 139 derivative records from 42070 primary records. [2025-10-24T00:56:46.477400] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-24T00:56:46.479315] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-24T00:56:46.478941] [FATAL] [LOCAL ] TOL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:46.479929] [FATAL] [MAIN ] TOL: Failed to save derivative data. [2025-10-24T00:56:46.479755] [FATAL] [LOCAL ] TNL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:46.481772] [INFO ] [MAIN ] Derivative Progress: 1921/2164 symbols completed. TOL took 1.2s. Estimated remaining: 1m 38s. Rate: 149.5 symbols/min [2025-10-24T00:56:46.482120] [FATAL] [MAIN ] TNL: Failed to save derivative data. [2025-10-24T00:56:46.485146] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:46.485289] [INFO ] [MAIN ] Derivative Progress: 1922/2164 symbols completed. TNL took 1.2s. Estimated remaining: 1m 37s. Rate: 149.5 symbols/min [2025-10-24T00:56:46.488834] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:46.494058] [INFO ] [MAIN ] TOST: Generated 139 derivative records from 54080 primary records. [2025-10-24T00:56:46.494408] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-24T00:56:46.494685] [FATAL] [LOCAL ] TOST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:46.494775] [FATAL] [MAIN ] TOST: Failed to save derivative data. [2025-10-24T00:56:46.497548] [INFO ] [MAIN ] Derivative Progress: 1923/2164 symbols completed. TOST took 1.2s. Estimated remaining: 1m 37s. Rate: 149.6 symbols/min [2025-10-24T00:56:46.497800] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:46.523856] [DEBUG] [LOCAL ] TPB: Loaded 26451 existing records from primary storage. [2025-10-24T00:56:46.524017] [INFO ] [MAIN ] TPB: Loaded 26451 primary data records. [2025-10-24T00:56:46.672957] [DEBUG] [LOCAL ] TPC: Loaded 39366 existing records from primary storage. [2025-10-24T00:56:46.684180] [INFO ] [MAIN ] TPC: Loaded 39366 primary data records. [2025-10-24T00:56:46.979266] [DEBUG] [LOCAL ] TPH: Loaded 45097 existing records from primary storage. [2025-10-24T00:56:46.990484] [INFO ] [MAIN ] TPH: Loaded 45097 primary data records. [2025-10-24T00:56:47.488615] [DEBUG] [MAIN ] TPB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:47.528887] [DEBUG] [MAIN ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:47.568813] [DEBUG] [MAIN ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:47.607360] [INFO ] [MAIN ] TPB: Generated 139 derivative records from 26451 primary records. [2025-10-24T00:56:47.608189] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-24T00:56:47.614047] [FATAL] [LOCAL ] TPB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:47.616868] [FATAL] [MAIN ] TPB: Failed to save derivative data. [2025-10-24T00:56:47.621930] [INFO ] [MAIN ] Derivative Progress: 1924/2164 symbols completed. TPB took 1.1s. Estimated remaining: 1m 36s. Rate: 149.5 symbols/min [2025-10-24T00:56:47.625231] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:47.631124] [INFO ] [MAIN ] TPC: Generated 139 derivative records from 39366 primary records. [2025-10-24T00:56:47.631464] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-24T00:56:47.634866] [FATAL] [LOCAL ] TPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:47.635273] [FATAL] [MAIN ] TPC: Failed to save derivative data. [2025-10-24T00:56:47.638627] [INFO ] [MAIN ] Derivative Progress: 1925/2164 symbols completed. TPC took 1.1s. Estimated remaining: 1m 36s. Rate: 149.5 symbols/min [2025-10-24T00:56:47.642328] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:47.644730] [INFO ] [MAIN ] TPH: Generated 139 derivative records from 45097 primary records. [2025-10-24T00:56:47.644861] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-24T00:56:47.645123] [FATAL] [LOCAL ] TPH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:47.645198] [FATAL] [MAIN ] TPH: Failed to save derivative data. [2025-10-24T00:56:47.648000] [INFO ] [MAIN ] Derivative Progress: 1926/2164 symbols completed. TPH took 1.2s. Estimated remaining: 1m 35s. Rate: 149.6 symbols/min [2025-10-24T00:56:47.648226] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:47.654080] [DEBUG] [LOCAL ] TPL: Loaded 12313 existing records from primary storage. [2025-10-24T00:56:47.654169] [INFO ] [MAIN ] TPL: Loaded 12313 primary data records. [2025-10-24T00:56:47.970690] [DEBUG] [LOCAL ] TPVG: Loaded 27412 existing records from primary storage. [2025-10-24T00:56:47.970984] [INFO ] [MAIN ] TPVG: Loaded 27412 primary data records. [2025-10-24T00:56:48.079064] [DEBUG] [LOCAL ] TPR: Loaded 53752 existing records from primary storage. [2025-10-24T00:56:48.090590] [INFO ] [MAIN ] TPR: Loaded 53752 primary data records. [2025-10-24T00:56:48.644477] [DEBUG] [MAIN ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:48.688147] [DEBUG] [MAIN ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:48.739759] [INFO ] [MAIN ] TPL: Generated 139 derivative records from 12313 primary records. [2025-10-24T00:56:48.739909] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-24T00:56:48.743273] [DEBUG] [MAIN ] TPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:48.743754] [FATAL] [LOCAL ] TPL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:48.744199] [FATAL] [MAIN ] TPL: Failed to save derivative data. [2025-10-24T00:56:48.757296] [INFO ] [MAIN ] Derivative Progress: 1927/2164 symbols completed. TPL took 1.1s. Estimated remaining: 1m 35s. Rate: 149.5 symbols/min [2025-10-24T00:56:48.759575] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:48.783830] [DEBUG] [LOCAL ] TPYP: Loaded 7924 existing records from primary storage. [2025-10-24T00:56:48.786767] [INFO ] [MAIN ] TPYP: Loaded 7924 primary data records. [2025-10-24T00:56:48.826801] [INFO ] [MAIN ] TPVG: Generated 139 derivative records from 27412 primary records. [2025-10-24T00:56:48.848445] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-24T00:56:48.857827] [FATAL] [LOCAL ] TPVG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:48.869371] [FATAL] [MAIN ] TPVG: Failed to save derivative data. [2025-10-24T00:56:48.876594] [INFO ] [MAIN ] Derivative Progress: 1928/2164 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 35s. Rate: 149.5 symbols/min [2025-10-24T00:56:48.887386] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:49.088917] [DEBUG] [LOCAL ] TPZ: Loaded 4619 existing records from primary storage. [2025-10-24T00:56:49.103968] [INFO ] [MAIN ] TPZ: Loaded 4619 primary data records. [2025-10-24T00:56:49.106445] [INFO ] [MAIN ] TPR: Generated 139 derivative records from 53752 primary records. [2025-10-24T00:56:49.149257] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-24T00:56:49.149846] [FATAL] [LOCAL ] TPR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:49.176404] [FATAL] [MAIN ] TPR: Failed to save derivative data. [2025-10-24T00:56:49.201800] [INFO ] [MAIN ] Derivative Progress: 1929/2164 symbols completed. TPR took 1.6s. Estimated remaining: 1m 34s. Rate: 149.5 symbols/min [2025-10-24T00:56:49.209369] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:49.416160] [DEBUG] [LOCAL ] TR: Loaded 19306 existing records from primary storage. [2025-10-24T00:56:49.416588] [INFO ] [MAIN ] TR: Loaded 19306 primary data records. [2025-10-24T00:56:49.575575] [DEBUG] [MAIN ] TPYP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:49.765450] [DEBUG] [MAIN ] TPZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:49.808969] [DEBUG] [MAIN ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:49.828201] [INFO ] [MAIN ] TPYP: Generated 139 derivative records from 7924 primary records. [2025-10-24T00:56:49.829561] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-24T00:56:49.830516] [FATAL] [LOCAL ] TPYP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:49.831143] [FATAL] [MAIN ] TPYP: Failed to save derivative data. [2025-10-24T00:56:49.838177] [INFO ] [MAIN ] Derivative Progress: 1930/2164 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 34s. Rate: 149.5 symbols/min [2025-10-24T00:56:49.839836] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:49.854073] [INFO ] [MAIN ] TPZ: Generated 139 derivative records from 4619 primary records. [2025-10-24T00:56:49.856746] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-24T00:56:49.857196] [FATAL] [LOCAL ] TPZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:49.861613] [FATAL] [MAIN ] TPZ: Failed to save derivative data. [2025-10-24T00:56:49.863894] [INFO ] [MAIN ] Derivative Progress: 1931/2164 symbols completed. TPZ took 1.0s. Estimated remaining: 1m 33s. Rate: 149.6 symbols/min [2025-10-24T00:56:49.864219] [DEBUG] [LOCAL ] TRAK: Loaded 9632 existing records from primary storage. [2025-10-24T00:56:49.864462] [INFO ] [MAIN ] TRAK: Loaded 9632 primary data records. [2025-10-24T00:56:49.864368] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:49.974239] [INFO ] [MAIN ] TR: Generated 139 derivative records from 19306 primary records. [2025-10-24T00:56:50.016706] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-24T00:56:50.048828] [FATAL] [LOCAL ] TR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:50.210137] [FATAL] [MAIN ] TR: Failed to save derivative data. [2025-10-24T00:56:50.210504] [DEBUG] [LOCAL ] TRC: Loaded 15456 existing records from primary storage. [2025-10-24T00:56:50.213089] [INFO ] [MAIN ] Derivative Progress: 1932/2164 symbols completed. TR took 1.0s. Estimated remaining: 1m 33s. Rate: 149.6 symbols/min [2025-10-24T00:56:50.213250] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:50.210680] [INFO ] [MAIN ] TRC: Loaded 15456 primary data records. [2025-10-24T00:56:50.552575] [DEBUG] [LOCAL ] TREX: Loaded 50160 existing records from primary storage. [2025-10-24T00:56:50.553367] [DEBUG] [MAIN ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:50.553530] [INFO ] [MAIN ] TREX: Loaded 50160 primary data records. [2025-10-24T00:56:50.883344] [DEBUG] [MAIN ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:50.915183] [INFO ] [MAIN ] TRAK: Generated 139 derivative records from 9632 primary records. [2025-10-24T00:56:50.915684] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-24T00:56:50.918097] [FATAL] [LOCAL ] TRAK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:50.918594] [FATAL] [MAIN ] TRAK: Failed to save derivative data. [2025-10-24T00:56:50.922277] [INFO ] [MAIN ] Derivative Progress: 1933/2164 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 33s. Rate: 149.5 symbols/min [2025-10-24T00:56:50.946350] [DEBUG] [MAIN ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:50.945858] [INFO ] [MAIN ] TRC: Generated 139 derivative records from 15456 primary records. [2025-10-24T00:56:50.956697] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-24T00:56:50.962791] [FATAL] [LOCAL ] TRC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:50.963029] [FATAL] [MAIN ] TRC: Failed to save derivative data. [2025-10-24T00:56:50.965079] [INFO ] [MAIN ] Derivative Progress: 1934/2164 symbols completed. TRC took 1.1s. Estimated remaining: 1m 32s. Rate: 149.6 symbols/min [2025-10-24T00:56:50.978396] [INFO ] [MAIN ] TREX: Generated 139 derivative records from 50160 primary records. [2025-10-24T00:56:50.978500] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-24T00:56:50.978713] [FATAL] [LOCAL ] TREX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:50.978790] [FATAL] [MAIN ] TREX: Failed to save derivative data. [2025-10-24T00:56:50.981208] [INFO ] [MAIN ] Derivative Progress: 1935/2164 symbols completed. TREX took 0.8s. Estimated remaining: 1m 32s. Rate: 149.7 symbols/min [2025-10-24T00:56:50.981584] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:50.981663] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:50.981793] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:51.037630] [DEBUG] [LOCAL ] TRN: Loaded 36448 existing records from primary storage. [2025-10-24T00:56:51.038358] [INFO ] [MAIN ] TRN: Loaded 36448 primary data records. [2025-10-24T00:56:51.086824] [DEBUG] [LOCAL ] TRNO: Loaded 43908 existing records from primary storage. [2025-10-24T00:56:51.149557] [INFO ] [MAIN ] TRNO: Loaded 43908 primary data records. [2025-10-24T00:56:51.186683] [DEBUG] [LOCAL ] TRGP: Loaded 51093 existing records from primary storage. [2025-10-24T00:56:51.198245] [INFO ] [MAIN ] TRGP: Loaded 51093 primary data records. [2025-10-24T00:56:51.960205] [DEBUG] [MAIN ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:52.001675] [DEBUG] [MAIN ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:52.019788] [DEBUG] [MAIN ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:52.118913] [INFO ] [MAIN ] TRN: Generated 139 derivative records from 36448 primary records. [2025-10-24T00:56:52.123076] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-24T00:56:52.123630] [FATAL] [LOCAL ] TRN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:52.124702] [FATAL] [MAIN ] TRN: Failed to save derivative data. [2025-10-24T00:56:52.127536] [INFO ] [MAIN ] Derivative Progress: 1936/2164 symbols completed. TRN took 1.1s. Estimated remaining: 1m 31s. Rate: 149.5 symbols/min [2025-10-24T00:56:52.127753] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:52.134666] [INFO ] [MAIN ] TRNO: Generated 139 derivative records from 43908 primary records. [2025-10-24T00:56:52.136527] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-24T00:56:52.136465] [INFO ] [MAIN ] TRGP: Generated 139 derivative records from 51093 primary records. [2025-10-24T00:56:52.136688] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-24T00:56:52.137067] [FATAL] [LOCAL ] TRGP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:52.136872] [FATAL] [LOCAL ] TRNO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:52.137210] [FATAL] [MAIN ] TRGP: Failed to save derivative data. [2025-10-24T00:56:52.139943] [INFO ] [MAIN ] Derivative Progress: 1937/2164 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 31s. Rate: 149.6 symbols/min [2025-10-24T00:56:52.140200] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:52.137274] [FATAL] [MAIN ] TRNO: Failed to save derivative data. [2025-10-24T00:56:52.142714] [INFO ] [MAIN ] Derivative Progress: 1938/2164 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 31s. Rate: 149.7 symbols/min [2025-10-24T00:56:52.143194] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:52.213363] [DEBUG] [LOCAL ] TROX: Loaded 52582 existing records from primary storage. [2025-10-24T00:56:52.214923] [DEBUG] [LOCAL ] TRTX: Loaded 37134 existing records from primary storage. [2025-10-24T00:56:52.214422] [INFO ] [MAIN ] TROX: Loaded 52582 primary data records. [2025-10-24T00:56:52.215156] [INFO ] [MAIN ] TRTX: Loaded 37134 primary data records. [2025-10-24T00:56:52.433439] [DEBUG] [LOCAL ] TRP: Loaded 52516 existing records from primary storage. [2025-10-24T00:56:52.434238] [INFO ] [MAIN ] TRP: Loaded 52516 primary data records. [2025-10-24T00:56:53.141334] [DEBUG] [MAIN ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:53.140995] [DEBUG] [MAIN ] TRTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:53.190726] [DEBUG] [MAIN ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:53.239480] [INFO ] [MAIN ] TRTX: Generated 139 derivative records from 37134 primary records. [2025-10-24T00:56:53.241894] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-24T00:56:53.242080] [INFO ] [MAIN ] TROX: Generated 139 derivative records from 52582 primary records. [2025-10-24T00:56:53.242633] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-24T00:56:53.243134] [FATAL] [LOCAL ] TROX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:53.242576] [FATAL] [LOCAL ] TRTX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:53.245323] [FATAL] [MAIN ] TROX: Failed to save derivative data. [2025-10-24T00:56:53.247929] [INFO ] [MAIN ] Derivative Progress: 1939/2164 symbols completed. TROX took 1.1s. Estimated remaining: 1m 30s. Rate: 149.5 symbols/min [2025-10-24T00:56:53.248052] [FATAL] [MAIN ] TRTX: Failed to save derivative data. [2025-10-24T00:56:53.248269] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:53.250177] [INFO ] [MAIN ] Derivative Progress: 1940/2164 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 30s. Rate: 149.6 symbols/min [2025-10-24T00:56:53.252174] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:53.258389] [INFO ] [MAIN ] TRP: Generated 139 derivative records from 52516 primary records. [2025-10-24T00:56:53.258600] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-24T00:56:53.258839] [FATAL] [LOCAL ] TRP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:53.258916] [FATAL] [MAIN ] TRP: Failed to save derivative data. [2025-10-24T00:56:53.261607] [INFO ] [MAIN ] Derivative Progress: 1941/2164 symbols completed. TRP took 1.1s. Estimated remaining: 1m 29s. Rate: 149.7 symbols/min [2025-10-24T00:56:53.261902] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:53.337513] [DEBUG] [LOCAL ] TRU: Loaded 51849 existing records from primary storage. [2025-10-24T00:56:53.338674] [INFO ] [MAIN ] TRU: Loaded 51849 primary data records. [2025-10-24T00:56:53.339345] [DEBUG] [LOCAL ] TRV: Loaded 47845 existing records from primary storage. [2025-10-24T00:56:53.350616] [INFO ] [MAIN ] TRV: Loaded 47845 primary data records. [2025-10-24T00:56:53.521671] [DEBUG] [LOCAL ] TS: Loaded 52030 existing records from primary storage. [2025-10-24T00:56:53.548567] [INFO ] [MAIN ] TS: Loaded 52030 primary data records. [2025-10-24T00:56:54.320081] [DEBUG] [MAIN ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:54.320270] [DEBUG] [MAIN ] TRU: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:56:54.367032] [DEBUG] [MAIN ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:54.428788] [INFO ] [MAIN ] TRU: Generated 139 derivative records from 51849 primary records. [2025-10-24T00:56:54.431162] [INFO ] [MAIN ] TRV: Generated 139 derivative records from 47845 primary records. [2025-10-24T00:56:54.432322] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-24T00:56:54.432222] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-24T00:56:54.433127] [FATAL] [LOCAL ] TRV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:54.433729] [FATAL] [MAIN ] TRV: Failed to save derivative data. [2025-10-24T00:56:54.433531] [FATAL] [LOCAL ] TRU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:54.433889] [FATAL] [MAIN ] TRU: Failed to save derivative data. [2025-10-24T00:56:54.435680] [INFO ] [MAIN ] Derivative Progress: 1942/2164 symbols completed. TRV took 1.2s. Estimated remaining: 1m 29s. Rate: 149.5 symbols/min [2025-10-24T00:56:54.441708] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:54.441864] [INFO ] [MAIN ] Derivative Progress: 1943/2164 symbols completed. TRU took 1.2s. Estimated remaining: 1m 29s. Rate: 149.6 symbols/min [2025-10-24T00:56:54.444576] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:54.444286] [INFO ] [MAIN ] TS: Generated 139 derivative records from 52030 primary records. [2025-10-24T00:56:54.445143] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-24T00:56:54.445432] [FATAL] [LOCAL ] TS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:54.445529] [FATAL] [MAIN ] TS: Failed to save derivative data. [2025-10-24T00:56:54.449521] [INFO ] [MAIN ] Derivative Progress: 1944/2164 symbols completed. TS took 1.2s. Estimated remaining: 1m 28s. Rate: 149.7 symbols/min [2025-10-24T00:56:54.449783] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:54.459052] [DEBUG] [LOCAL ] TSI: Loaded 8234 existing records from primary storage. [2025-10-24T00:56:54.459271] [INFO ] [MAIN ] TSI: Loaded 8234 primary data records. [2025-10-24T00:56:54.590458] [DEBUG] [LOCAL ] TSE: Loaded 27989 existing records from primary storage. [2025-10-24T00:56:54.628633] [INFO ] [MAIN ] TSE: Loaded 27989 primary data records. [2025-10-24T00:56:54.883630] [DEBUG] [LOCAL ] TSLX: Loaded 36029 existing records from primary storage. [2025-10-24T00:56:54.894705] [INFO ] [MAIN ] TSLX: Loaded 36029 primary data records. [2025-10-24T00:56:55.408561] [DEBUG] [MAIN ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:55.453871] [DEBUG] [MAIN ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:55.498663] [DEBUG] [MAIN ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:55.514367] [INFO ] [MAIN ] TSI: Generated 139 derivative records from 8234 primary records. [2025-10-24T00:56:55.518614] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-24T00:56:55.520454] [FATAL] [LOCAL ] TSI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:55.523461] [FATAL] [MAIN ] TSI: Failed to save derivative data. [2025-10-24T00:56:55.527369] [INFO ] [MAIN ] Derivative Progress: 1945/2164 symbols completed. TSI took 1.1s. Estimated remaining: 1m 28s. Rate: 149.6 symbols/min [2025-10-24T00:56:55.534286] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:55.551586] [INFO ] [MAIN ] TSE: Generated 139 derivative records from 27989 primary records. [2025-10-24T00:56:55.553400] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-24T00:56:55.557139] [FATAL] [LOCAL ] TSE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:55.560122] [FATAL] [MAIN ] TSE: Failed to save derivative data. [2025-10-24T00:56:55.562926] [INFO ] [MAIN ] Derivative Progress: 1946/2164 symbols completed. TSE took 1.1s. Estimated remaining: 1m 27s. Rate: 149.6 symbols/min [2025-10-24T00:56:55.560857] [INFO ] [MAIN ] TSLX: Generated 139 derivative records from 36029 primary records. [2025-10-24T00:56:55.563277] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:55.563482] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-24T00:56:55.563929] [FATAL] [LOCAL ] TSLX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:55.564363] [FATAL] [MAIN ] TSLX: Failed to save derivative data. [2025-10-24T00:56:55.567476] [INFO ] [MAIN ] Derivative Progress: 1947/2164 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 27s. Rate: 149.7 symbols/min [2025-10-24T00:56:55.567807] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:55.596672] [DEBUG] [LOCAL ] TSQ: Loaded 11726 existing records from primary storage. [2025-10-24T00:56:55.596947] [INFO ] [MAIN ] TSQ: Loaded 11726 primary data records. [2025-10-24T00:56:55.674619] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-24T00:56:55.702173] [INFO ] [MAIN ] TSM: Loaded 54209 primary data records. [2025-10-24T00:56:56.029907] [DEBUG] [LOCAL ] TSN: Loaded 53474 existing records from primary storage. [2025-10-24T00:56:56.036168] [INFO ] [MAIN ] TSN: Loaded 53474 primary data records. [2025-10-24T00:56:56.580691] [DEBUG] [MAIN ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:56.616427] [DEBUG] [MAIN ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:56.652465] [DEBUG] [MAIN ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:56.683762] [INFO ] [MAIN ] TSQ: Generated 139 derivative records from 11726 primary records. [2025-10-24T00:56:56.686592] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-24T00:56:56.687476] [FATAL] [LOCAL ] TSQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:56.689548] [FATAL] [MAIN ] TSQ: Failed to save derivative data. [2025-10-24T00:56:56.691946] [INFO ] [MAIN ] Derivative Progress: 1948/2164 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 27s. Rate: 149.6 symbols/min [2025-10-24T00:56:56.710501] [INFO ] [MAIN ] TSM: Generated 139 derivative records from 54209 primary records. [2025-10-24T00:56:56.711837] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-24T00:56:56.712217] [FATAL] [LOCAL ] TSM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:56.712525] [FATAL] [MAIN ] TSM: Failed to save derivative data. [2025-10-24T00:56:56.716327] [INFO ] [MAIN ] TSN: Generated 139 derivative records from 53474 primary records. [2025-10-24T00:56:56.714733] [INFO ] [MAIN ] Derivative Progress: 1949/2164 symbols completed. TSM took 1.2s. Estimated remaining: 1m 26s. Rate: 149.6 symbols/min [2025-10-24T00:56:56.716478] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-24T00:56:56.716722] [FATAL] [LOCAL ] TSN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:56.716947] [FATAL] [MAIN ] TSN: Failed to save derivative data. [2025-10-24T00:56:56.719546] [INFO ] [MAIN ] Derivative Progress: 1950/2164 symbols completed. TSN took 1.2s. Estimated remaining: 1m 26s. Rate: 149.7 symbols/min [2025-10-24T00:56:56.719916] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:56.720088] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:56.720137] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:56.770845] [DEBUG] [LOCAL ] TTC: Loaded 41771 existing records from primary storage. [2025-10-24T00:56:56.783094] [INFO ] [MAIN ] TTC: Loaded 41771 primary data records. [2025-10-24T00:56:56.914161] [DEBUG] [LOCAL ] TT: Loaded 47349 existing records from primary storage. [2025-10-24T00:56:56.925923] [DEBUG] [LOCAL ] TTE: Loaded 51922 existing records from primary storage. [2025-10-24T00:56:56.969709] [INFO ] [MAIN ] TTE: Loaded 51922 primary data records. [2025-10-24T00:56:56.941532] [INFO ] [MAIN ] TT: Loaded 47349 primary data records. [2025-10-24T00:56:57.717103] [DEBUG] [MAIN ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:57.767344] [DEBUG] [MAIN ] TT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:57.784892] [DEBUG] [MAIN ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:57.824497] [INFO ] [MAIN ] TTC: Generated 139 derivative records from 41771 primary records. [2025-10-24T00:56:57.827243] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-24T00:56:57.830195] [FATAL] [LOCAL ] TTC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:57.832447] [FATAL] [MAIN ] TTC: Failed to save derivative data. [2025-10-24T00:56:57.834677] [INFO ] [MAIN ] Derivative Progress: 1951/2164 symbols completed. TTC took 1.1s. Estimated remaining: 1m 25s. Rate: 149.6 symbols/min [2025-10-24T00:56:57.834952] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:57.851911] [INFO ] [MAIN ] TT: Generated 139 derivative records from 47349 primary records. [2025-10-24T00:56:57.852527] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-24T00:56:57.852920] [FATAL] [LOCAL ] TT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:57.853892] [FATAL] [MAIN ] TT: Failed to save derivative data. [2025-10-24T00:56:57.856827] [INFO ] [MAIN ] Derivative Progress: 1952/2164 symbols completed. TT took 1.1s. Estimated remaining: 1m 25s. Rate: 149.7 symbols/min [2025-10-24T00:56:57.859555] [INFO ] [MAIN ] TTE: Generated 139 derivative records from 51922 primary records. [2025-10-24T00:56:57.859684] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:57.859980] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-24T00:56:57.860225] [FATAL] [LOCAL ] TTE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:57.860537] [FATAL] [MAIN ] TTE: Failed to save derivative data. [2025-10-24T00:56:57.863024] [INFO ] [MAIN ] Derivative Progress: 1953/2164 symbols completed. TTE took 1.1s. Estimated remaining: 1m 25s. Rate: 149.7 symbols/min [2025-10-24T00:56:57.863192] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:57.894783] [DEBUG] [LOCAL ] TTI: Loaded 47037 existing records from primary storage. [2025-10-24T00:56:57.895084] [INFO ] [MAIN ] TTI: Loaded 47037 primary data records. [2025-10-24T00:56:58.256779] [DEBUG] [LOCAL ] TUYA: Loaded 46014 existing records from primary storage. [2025-10-24T00:56:58.255706] [DEBUG] [LOCAL ] TU: Loaded 50129 existing records from primary storage. [2025-10-24T00:56:58.257052] [INFO ] [MAIN ] TU: Loaded 50129 primary data records. [2025-10-24T00:56:58.257228] [INFO ] [MAIN ] TUYA: Loaded 46014 primary data records. [2025-10-24T00:56:58.878572] [DEBUG] [MAIN ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:58.915016] [DEBUG] [MAIN ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:58.955528] [DEBUG] [MAIN ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:56:58.994930] [INFO ] [MAIN ] TTI: Generated 139 derivative records from 47037 primary records. [2025-10-24T00:56:58.997623] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-24T00:56:58.997934] [FATAL] [LOCAL ] TTI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:58.998529] [FATAL] [MAIN ] TTI: Failed to save derivative data. [2025-10-24T00:56:59.000832] [INFO ] [MAIN ] TU: Generated 139 derivative records from 50129 primary records. [2025-10-24T00:56:59.003565] [INFO ] [MAIN ] Derivative Progress: 1954/2164 symbols completed. TTI took 1.2s. Estimated remaining: 1m 24s. Rate: 149.6 symbols/min [2025-10-24T00:56:59.003847] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-24T00:56:59.004334] [FATAL] [LOCAL ] TU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:59.004438] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:59.004844] [FATAL] [MAIN ] TU: Failed to save derivative data. [2025-10-24T00:56:59.007018] [INFO ] [MAIN ] Derivative Progress: 1955/2164 symbols completed. TU took 1.1s. Estimated remaining: 1m 24s. Rate: 149.7 symbols/min [2025-10-24T00:56:59.010193] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:59.019767] [DEBUG] [LOCAL ] TVC: Loaded 3123 existing records from primary storage. [2025-10-24T00:56:59.021903] [INFO ] [MAIN ] TUYA: Generated 139 derivative records from 46014 primary records. [2025-10-24T00:56:59.022044] [INFO ] [MAIN ] TVC: Loaded 3123 primary data records. [2025-10-24T00:56:59.022131] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-24T00:56:59.022398] [FATAL] [LOCAL ] TUYA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:56:59.042699] [FATAL] [MAIN ] TUYA: Failed to save derivative data. [2025-10-24T00:56:59.079741] [INFO ] [MAIN ] Derivative Progress: 1956/2164 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 23s. Rate: 149.7 symbols/min [2025-10-24T00:56:59.110725] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:56:59.341324] [DEBUG] [LOCAL ] TVE: Loaded 2559 existing records from primary storage. [2025-10-24T00:56:59.342672] [DEBUG] [LOCAL ] TV: Loaded 41483 existing records from primary storage. [2025-10-24T00:56:59.341689] [INFO ] [MAIN ] TVE: Loaded 2559 primary data records. [2025-10-24T00:56:59.342931] [INFO ] [MAIN ] TV: Loaded 41483 primary data records. [2025-10-24T00:57:00.017609] [DEBUG] [MAIN ] TVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:00.082478] [INFO ] [MAIN ] TVC: Generated 139 derivative records from 3123 primary records. [2025-10-24T00:57:00.087979] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-24T00:57:00.088371] [DEBUG] [MAIN ] TVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:00.089008] [FATAL] [LOCAL ] TVC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:00.103368] [FATAL] [MAIN ] TVC: Failed to save derivative data. [2025-10-24T00:57:00.088739] [DEBUG] [MAIN ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:00.116147] [INFO ] [MAIN ] Derivative Progress: 1957/2164 symbols completed. TVC took 1.1s. Estimated remaining: 1m 23s. Rate: 149.6 symbols/min [2025-10-24T00:57:00.121072] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:00.173613] [INFO ] [MAIN ] TVE: Generated 139 derivative records from 2559 primary records. [2025-10-24T00:57:00.175675] [DEBUG] [LOCAL ] TWI: Loaded 34041 existing records from primary storage. [2025-10-24T00:57:00.175885] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-24T00:57:00.176031] [INFO ] [MAIN ] TWI: Loaded 34041 primary data records. [2025-10-24T00:57:00.176300] [FATAL] [LOCAL ] TVE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:00.178103] [FATAL] [MAIN ] TVE: Failed to save derivative data. [2025-10-24T00:57:00.192105] [INFO ] [MAIN ] Derivative Progress: 1958/2164 symbols completed. TVE took 1.1s. Estimated remaining: 1m 23s. Rate: 149.7 symbols/min [2025-10-24T00:57:00.192366] [INFO ] [MAIN ] TV: Generated 139 derivative records from 41483 primary records. [2025-10-24T00:57:00.202222] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-24T00:57:00.212743] [FATAL] [LOCAL ] TV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:00.212848] [FATAL] [MAIN ] TV: Failed to save derivative data. [2025-10-24T00:57:00.227078] [INFO ] [MAIN ] Derivative Progress: 1959/2164 symbols completed. TV took 1.2s. Estimated remaining: 1m 22s. Rate: 149.7 symbols/min [2025-10-24T00:57:00.224765] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:00.227210] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:00.308639] [DEBUG] [LOCAL ] TWN: Loaded 3242 existing records from primary storage. [2025-10-24T00:57:00.342011] [INFO ] [MAIN ] TWN: Loaded 3242 primary data records. [2025-10-24T00:57:00.806410] [DEBUG] [LOCAL ] TWLO: Loaded 53169 existing records from primary storage. [2025-10-24T00:57:00.807933] [INFO ] [MAIN ] TWLO: Loaded 53169 primary data records. [2025-10-24T00:57:01.122457] [DEBUG] [MAIN ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:01.159206] [DEBUG] [MAIN ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:01.214076] [DEBUG] [MAIN ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:01.218830] [INFO ] [MAIN ] TWI: Generated 139 derivative records from 34041 primary records. [2025-10-24T00:57:01.230241] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-24T00:57:01.232841] [FATAL] [LOCAL ] TWI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:01.235518] [FATAL] [MAIN ] TWI: Failed to save derivative data. [2025-10-24T00:57:01.238466] [INFO ] [MAIN ] Derivative Progress: 1960/2164 symbols completed. TWI took 1.1s. Estimated remaining: 1m 22s. Rate: 149.6 symbols/min [2025-10-24T00:57:01.239622] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:01.254813] [INFO ] [MAIN ] TWN: Generated 139 derivative records from 3242 primary records. [2025-10-24T00:57:01.255789] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-24T00:57:01.257216] [FATAL] [LOCAL ] TWN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:01.257883] [FATAL] [MAIN ] TWN: Failed to save derivative data. [2025-10-24T00:57:01.260842] [INFO ] [MAIN ] Derivative Progress: 1961/2164 symbols completed. TWN took 1.0s. Estimated remaining: 1m 21s. Rate: 149.7 symbols/min [2025-10-24T00:57:01.263823] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:01.273842] [INFO ] [MAIN ] TWLO: Generated 139 derivative records from 53169 primary records. [2025-10-24T00:57:01.274123] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-24T00:57:01.274366] [FATAL] [LOCAL ] TWLO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:01.274672] [FATAL] [MAIN ] TWLO: Failed to save derivative data. [2025-10-24T00:57:01.287133] [INFO ] [MAIN ] Derivative Progress: 1962/2164 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 21s. Rate: 149.8 symbols/min [2025-10-24T00:57:01.287463] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:01.302427] [DEBUG] [LOCAL ] TX: Loaded 23300 existing records from primary storage. [2025-10-24T00:57:01.302585] [INFO ] [MAIN ] TX: Loaded 23300 primary data records. [2025-10-24T00:57:01.419122] [DEBUG] [LOCAL ] TWO: Loaded 48886 existing records from primary storage. [2025-10-24T00:57:01.433339] [INFO ] [MAIN ] TWO: Loaded 48886 primary data records. [2025-10-24T00:57:01.502439] [DEBUG] [LOCAL ] TXNM: Loaded 43114 existing records from primary storage. [2025-10-24T00:57:01.531760] [INFO ] [MAIN ] TXNM: Loaded 43114 primary data records. [2025-10-24T00:57:02.297621] [DEBUG] [MAIN ] TX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:02.328380] [DEBUG] [MAIN ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:02.372678] [DEBUG] [MAIN ] TXNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:02.425527] [INFO ] [MAIN ] TX: Generated 139 derivative records from 23300 primary records. [2025-10-24T00:57:02.434154] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-24T00:57:02.434886] [FATAL] [LOCAL ] TX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:02.437493] [FATAL] [MAIN ] TX: Failed to save derivative data. [2025-10-24T00:57:02.439896] [INFO ] [MAIN ] Derivative Progress: 1963/2164 symbols completed. TX took 1.2s. Estimated remaining: 1m 21s. Rate: 149.6 symbols/min [2025-10-24T00:57:02.448328] [INFO ] [MAIN ] TWO: Generated 139 derivative records from 48886 primary records. [2025-10-24T00:57:02.450162] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-24T00:57:02.453394] [FATAL] [LOCAL ] TWO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:02.454725] [FATAL] [MAIN ] TWO: Failed to save derivative data. [2025-10-24T00:57:02.458077] [INFO ] [MAIN ] Derivative Progress: 1964/2164 symbols completed. TWO took 1.2s. Estimated remaining: 1m 20s. Rate: 149.7 symbols/min [2025-10-24T00:57:02.460170] [INFO ] [MAIN ] TXNM: Generated 139 derivative records from 43114 primary records. [2025-10-24T00:57:02.460298] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-24T00:57:02.460599] [FATAL] [LOCAL ] TXNM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:02.460712] [FATAL] [MAIN ] TXNM: Failed to save derivative data. [2025-10-24T00:57:02.463464] [INFO ] [MAIN ] Derivative Progress: 1965/2164 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 20s. Rate: 149.8 symbols/min [2025-10-24T00:57:02.463998] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:02.464178] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:02.464340] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:02.476111] [DEBUG] [LOCAL ] TY: Loaded 7553 existing records from primary storage. [2025-10-24T00:57:02.476679] [INFO ] [MAIN ] TY: Loaded 7553 primary data records. [2025-10-24T00:57:02.594733] [DEBUG] [LOCAL ] TXO: Loaded 20165 existing records from primary storage. [2025-10-24T00:57:02.620581] [INFO ] [MAIN ] TXO: Loaded 20165 primary data records. [2025-10-24T00:57:02.924716] [DEBUG] [LOCAL ] TXT: Loaded 49899 existing records from primary storage. [2025-10-24T00:57:02.930745] [INFO ] [MAIN ] TXT: Loaded 49899 primary data records. [2025-10-24T00:57:03.451429] [DEBUG] [MAIN ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:03.491192] [DEBUG] [MAIN ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:03.520951] [DEBUG] [MAIN ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:03.569581] [INFO ] [MAIN ] TY: Generated 139 derivative records from 7553 primary records. [2025-10-24T00:57:03.573216] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-24T00:57:03.573873] [FATAL] [LOCAL ] TY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:03.577501] [FATAL] [MAIN ] TY: Failed to save derivative data. [2025-10-24T00:57:03.581240] [INFO ] [MAIN ] Derivative Progress: 1966/2164 symbols completed. TY took 1.1s. Estimated remaining: 1m 19s. Rate: 149.6 symbols/min [2025-10-24T00:57:03.586058] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:03.587549] [INFO ] [MAIN ] TXO: Generated 139 derivative records from 20165 primary records. [2025-10-24T00:57:03.587748] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-24T00:57:03.590397] [FATAL] [LOCAL ] TXO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:03.590698] [FATAL] [MAIN ] TXO: Failed to save derivative data. [2025-10-24T00:57:03.593394] [INFO ] [MAIN ] TXT: Generated 139 derivative records from 49899 primary records. [2025-10-24T00:57:03.595865] [INFO ] [MAIN ] Derivative Progress: 1967/2164 symbols completed. TXO took 1.1s. Estimated remaining: 1m 19s. Rate: 149.7 symbols/min [2025-10-24T00:57:03.596130] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-24T00:57:03.596244] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:03.596632] [FATAL] [LOCAL ] TXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:03.597351] [FATAL] [MAIN ] TXT: Failed to save derivative data. [2025-10-24T00:57:03.600218] [INFO ] [MAIN ] Derivative Progress: 1968/2164 symbols completed. TXT took 1.1s. Estimated remaining: 1m 19s. Rate: 149.8 symbols/min [2025-10-24T00:57:03.600430] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:03.616502] [DEBUG] [LOCAL ] TYG: Loaded 14093 existing records from primary storage. [2025-10-24T00:57:03.616760] [INFO ] [MAIN ] TYG: Loaded 14093 primary data records. [2025-10-24T00:57:03.732338] [DEBUG] [LOCAL ] TYL: Loaded 22120 existing records from primary storage. [2025-10-24T00:57:03.732717] [INFO ] [MAIN ] TYL: Loaded 22120 primary data records. [2025-10-24T00:57:04.109567] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-24T00:57:04.121065] [INFO ] [MAIN ] U: Loaded 54189 primary data records. [2025-10-24T00:57:04.617017] [DEBUG] [MAIN ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:04.655514] [DEBUG] [MAIN ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:04.690927] [DEBUG] [MAIN ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:04.724064] [INFO ] [MAIN ] TYG: Generated 139 derivative records from 14093 primary records. [2025-10-24T00:57:04.727032] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-24T00:57:04.730582] [FATAL] [LOCAL ] TYG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:04.734487] [FATAL] [MAIN ] TYG: Failed to save derivative data. [2025-10-24T00:57:04.738095] [INFO ] [MAIN ] Derivative Progress: 1969/2164 symbols completed. TYG took 1.2s. Estimated remaining: 1m 18s. Rate: 149.6 symbols/min [2025-10-24T00:57:04.741876] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:04.748814] [INFO ] [MAIN ] TYL: Generated 139 derivative records from 22120 primary records. [2025-10-24T00:57:04.749186] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-24T00:57:04.750610] [FATAL] [LOCAL ] TYL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:04.753281] [FATAL] [MAIN ] TYL: Failed to save derivative data. [2025-10-24T00:57:04.755579] [INFO ] [MAIN ] Derivative Progress: 1970/2164 symbols completed. TYL took 1.2s. Estimated remaining: 1m 18s. Rate: 149.7 symbols/min [2025-10-24T00:57:04.757427] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:04.759417] [INFO ] [MAIN ] U: Generated 139 derivative records from 54189 primary records. [2025-10-24T00:57:04.759552] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-24T00:57:04.760068] [FATAL] [LOCAL ] U: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:04.760427] [FATAL] [MAIN ] U: Failed to save derivative data. [2025-10-24T00:57:04.763729] [INFO ] [MAIN ] Derivative Progress: 1971/2164 symbols completed. U took 1.2s. Estimated remaining: 1m 17s. Rate: 149.8 symbols/min [2025-10-24T00:57:04.764228] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:04.771538] [DEBUG] [LOCAL ] UAN: Loaded 5331 existing records from primary storage. [2025-10-24T00:57:04.771786] [INFO ] [MAIN ] UAN: Loaded 5331 primary data records. [2025-10-24T00:57:04.954817] [DEBUG] [LOCAL ] UA: Loaded 50822 existing records from primary storage. [2025-10-24T00:57:04.994286] [INFO ] [MAIN ] UA: Loaded 50822 primary data records. [2025-10-24T00:57:05.207866] [DEBUG] [LOCAL ] UAA: Loaded 53888 existing records from primary storage. [2025-10-24T00:57:05.231363] [INFO ] [MAIN ] UAA: Loaded 53888 primary data records. [2025-10-24T00:57:05.810956] [DEBUG] [MAIN ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:05.858411] [DEBUG] [MAIN ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:05.894137] [DEBUG] [MAIN ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:05.922524] [INFO ] [MAIN ] UAN: Generated 139 derivative records from 5331 primary records. [2025-10-24T00:57:05.923725] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-24T00:57:05.929748] [FATAL] [LOCAL ] UAN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:05.930315] [FATAL] [MAIN ] UAN: Failed to save derivative data. [2025-10-24T00:57:05.933284] [INFO ] [MAIN ] Derivative Progress: 1972/2164 symbols completed. UAN took 1.2s. Estimated remaining: 1m 17s. Rate: 149.6 symbols/min [2025-10-24T00:57:05.935672] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:05.959340] [INFO ] [MAIN ] UA: Generated 139 derivative records from 50822 primary records. [2025-10-24T00:57:05.961801] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-24T00:57:05.962309] [FATAL] [LOCAL ] UA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:05.962580] [FATAL] [MAIN ] UA: Failed to save derivative data. [2025-10-24T00:57:05.965197] [INFO ] [MAIN ] Derivative Progress: 1973/2164 symbols completed. UA took 1.2s. Estimated remaining: 1m 17s. Rate: 149.7 symbols/min [2025-10-24T00:57:05.967456] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:05.968284] [INFO ] [MAIN ] UAA: Generated 139 derivative records from 53888 primary records. [2025-10-24T00:57:05.968544] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-24T00:57:05.968820] [FATAL] [LOCAL ] UAA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:05.968964] [FATAL] [MAIN ] UAA: Failed to save derivative data. [2025-10-24T00:57:05.971704] [INFO ] [MAIN ] Derivative Progress: 1974/2164 symbols completed. UAA took 1.2s. Estimated remaining: 1m 16s. Rate: 149.8 symbols/min [2025-10-24T00:57:05.972017] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:06.015377] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-24T00:57:06.015682] [INFO ] [MAIN ] UBER: Loaded 54196 primary data records. [2025-10-24T00:57:06.150623] [DEBUG] [LOCAL ] UCB: Loaded 38009 existing records from primary storage. [2025-10-24T00:57:06.172248] [INFO ] [MAIN ] UCB: Loaded 38009 primary data records. [2025-10-24T00:57:06.398732] [DEBUG] [LOCAL ] UBS: Loaded 52657 existing records from primary storage. [2025-10-24T00:57:06.418491] [INFO ] [MAIN ] UBS: Loaded 52657 primary data records. [2025-10-24T00:57:07.004620] [DEBUG] [MAIN ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:07.050773] [DEBUG] [MAIN ] UCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:07.098523] [DEBUG] [MAIN ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:07.132545] [INFO ] [MAIN ] UBER: Generated 139 derivative records from 54196 primary records. [2025-10-24T00:57:07.135439] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-24T00:57:07.136267] [FATAL] [LOCAL ] UBER: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:07.137488] [FATAL] [MAIN ] UBER: Failed to save derivative data. [2025-10-24T00:57:07.144312] [INFO ] [MAIN ] Derivative Progress: 1975/2164 symbols completed. UBER took 1.2s. Estimated remaining: 1m 16s. Rate: 149.6 symbols/min [2025-10-24T00:57:07.144638] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:07.157021] [INFO ] [MAIN ] UCB: Generated 139 derivative records from 38009 primary records. [2025-10-24T00:57:07.157446] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-24T00:57:07.159506] [FATAL] [LOCAL ] UCB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:07.162342] [FATAL] [MAIN ] UCB: Failed to save derivative data. [2025-10-24T00:57:07.164635] [INFO ] [MAIN ] Derivative Progress: 1976/2164 symbols completed. UCB took 1.2s. Estimated remaining: 1m 15s. Rate: 149.7 symbols/min [2025-10-24T00:57:07.166405] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:07.169733] [INFO ] [MAIN ] UBS: Generated 139 derivative records from 52657 primary records. [2025-10-24T00:57:07.170066] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-24T00:57:07.170344] [FATAL] [LOCAL ] UBS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:07.170475] [FATAL] [MAIN ] UBS: Failed to save derivative data. [2025-10-24T00:57:07.173435] [INFO ] [MAIN ] Derivative Progress: 1977/2164 symbols completed. UBS took 1.2s. Estimated remaining: 1m 15s. Rate: 149.8 symbols/min [2025-10-24T00:57:07.173694] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:07.198014] [DEBUG] [LOCAL ] UFI: Loaded 8257 existing records from primary storage. [2025-10-24T00:57:07.198242] [INFO ] [MAIN ] UFI: Loaded 8257 primary data records. [2025-10-24T00:57:07.327488] [DEBUG] [LOCAL ] UDR: Loaded 52492 existing records from primary storage. [2025-10-24T00:57:07.349097] [INFO ] [MAIN ] UDR: Loaded 52492 primary data records. [2025-10-24T00:57:07.507598] [DEBUG] [LOCAL ] UE: Loaded 42745 existing records from primary storage. [2025-10-24T00:57:07.620948] [INFO ] [MAIN ] UE: Loaded 42745 primary data records. [2025-10-24T00:57:08.215752] [DEBUG] [MAIN ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:08.249129] [DEBUG] [MAIN ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:08.294931] [DEBUG] [MAIN ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:08.339758] [INFO ] [MAIN ] UFI: Generated 139 derivative records from 8257 primary records. [2025-10-24T00:57:08.340299] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-24T00:57:08.340812] [FATAL] [LOCAL ] UFI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:08.346131] [FATAL] [MAIN ] UFI: Failed to save derivative data. [2025-10-24T00:57:08.348432] [INFO ] [MAIN ] Derivative Progress: 1978/2164 symbols completed. UFI took 1.2s. Estimated remaining: 1m 15s. Rate: 149.6 symbols/min [2025-10-24T00:57:08.357066] [INFO ] [MAIN ] UDR: Generated 139 derivative records from 52492 primary records. [2025-10-24T00:57:08.357336] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-24T00:57:08.357603] [FATAL] [LOCAL ] UDR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:08.360702] [FATAL] [MAIN ] UDR: Failed to save derivative data. [2025-10-24T00:57:08.364362] [INFO ] [MAIN ] Derivative Progress: 1979/2164 symbols completed. UDR took 1.2s. Estimated remaining: 1m 14s. Rate: 149.7 symbols/min [2025-10-24T00:57:08.369030] [INFO ] [MAIN ] UE: Generated 139 derivative records from 42745 primary records. [2025-10-24T00:57:08.369262] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-24T00:57:08.369490] [FATAL] [LOCAL ] UE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:08.369570] [FATAL] [MAIN ] UE: Failed to save derivative data. [2025-10-24T00:57:08.374034] [INFO ] [MAIN ] Derivative Progress: 1980/2164 symbols completed. UE took 1.2s. Estimated remaining: 1m 14s. Rate: 149.8 symbols/min [2025-10-24T00:57:08.374525] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:08.375070] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:08.375207] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:08.399333] [DEBUG] [LOCAL ] UHAL: Loaded 16970 existing records from primary storage. [2025-10-24T00:57:08.399545] [INFO ] [MAIN ] UHAL: Loaded 16970 primary data records. [2025-10-24T00:57:08.615150] [DEBUG] [LOCAL ] UGP: Loaded 43339 existing records from primary storage. [2025-10-24T00:57:08.640198] [INFO ] [MAIN ] UGP: Loaded 43339 primary data records. [2025-10-24T00:57:08.850814] [DEBUG] [LOCAL ] UGI: Loaded 50834 existing records from primary storage. [2025-10-24T00:57:08.869474] [INFO ] [MAIN ] UGI: Loaded 50834 primary data records. [2025-10-24T00:57:09.426940] [DEBUG] [MAIN ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:09.468913] [DEBUG] [MAIN ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:09.512801] [DEBUG] [MAIN ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:09.539480] [INFO ] [MAIN ] UHAL: Generated 139 derivative records from 16970 primary records. [2025-10-24T00:57:09.545322] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-24T00:57:09.545611] [FATAL] [LOCAL ] UHAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:09.548050] [FATAL] [MAIN ] UHAL: Failed to save derivative data. [2025-10-24T00:57:09.552300] [INFO ] [MAIN ] Derivative Progress: 1981/2164 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 13s. Rate: 149.6 symbols/min [2025-10-24T00:57:09.557152] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:09.567435] [INFO ] [MAIN ] UGP: Generated 139 derivative records from 43339 primary records. [2025-10-24T00:57:09.570564] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-24T00:57:09.570920] [FATAL] [LOCAL ] UGP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:09.571021] [FATAL] [MAIN ] UGP: Failed to save derivative data. [2025-10-24T00:57:09.574619] [INFO ] [MAIN ] Derivative Progress: 1982/2164 symbols completed. UGP took 1.2s. Estimated remaining: 1m 13s. Rate: 149.7 symbols/min [2025-10-24T00:57:09.576422] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:09.584421] [DEBUG] [LOCAL ] UHT: Loaded 10280 existing records from primary storage. [2025-10-24T00:57:09.585975] [INFO ] [MAIN ] UHT: Loaded 10280 primary data records. [2025-10-24T00:57:09.706381] [DEBUG] [LOCAL ] UI: Loaded 14283 existing records from primary storage. [2025-10-24T00:57:09.706865] [INFO ] [MAIN ] UGI: Generated 139 derivative records from 50834 primary records. [2025-10-24T00:57:09.712711] [INFO ] [MAIN ] UI: Loaded 14283 primary data records. [2025-10-24T00:57:09.717924] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-24T00:57:09.761361] [FATAL] [LOCAL ] UGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:09.818026] [FATAL] [MAIN ] UGI: Failed to save derivative data. [2025-10-24T00:57:10.014731] [INFO ] [MAIN ] Derivative Progress: 1983/2164 symbols completed. UGI took 1.6s. Estimated remaining: 1m 13s. Rate: 149.7 symbols/min [2025-10-24T00:57:10.046838] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:10.290177] [DEBUG] [LOCAL ] UIS: Loaded 36820 existing records from primary storage. [2025-10-24T00:57:10.298425] [INFO ] [MAIN ] UIS: Loaded 36820 primary data records. [2025-10-24T00:57:10.309380] [DEBUG] [MAIN ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:10.487324] [DEBUG] [MAIN ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:10.707482] [INFO ] [MAIN ] UHT: Generated 139 derivative records from 10280 primary records. [2025-10-24T00:57:10.712412] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-24T00:57:10.713734] [FATAL] [LOCAL ] UHT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:10.714113] [FATAL] [MAIN ] UHT: Failed to save derivative data. [2025-10-24T00:57:10.730778] [INFO ] [MAIN ] Derivative Progress: 1984/2164 symbols completed. UHT took 1.2s. Estimated remaining: 1m 12s. Rate: 149.6 symbols/min [2025-10-24T00:57:10.733387] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:10.732989] [INFO ] [MAIN ] UI: Generated 139 derivative records from 14283 primary records. [2025-10-24T00:57:10.733712] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-24T00:57:10.732710] [DEBUG] [MAIN ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:10.735157] [FATAL] [LOCAL ] UI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:10.745241] [FATAL] [MAIN ] UI: Failed to save derivative data. [2025-10-24T00:57:10.747881] [INFO ] [MAIN ] Derivative Progress: 1985/2164 symbols completed. UI took 1.2s. Estimated remaining: 1m 12s. Rate: 149.7 symbols/min [2025-10-24T00:57:10.748211] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:10.781771] [INFO ] [MAIN ] UIS: Generated 139 derivative records from 36820 primary records. [2025-10-24T00:57:10.781971] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-24T00:57:10.782204] [FATAL] [LOCAL ] UIS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:10.782348] [FATAL] [MAIN ] UIS: Failed to save derivative data. [2025-10-24T00:57:10.785361] [INFO ] [MAIN ] Derivative Progress: 1986/2164 symbols completed. UIS took 0.7s. Estimated remaining: 1m 11s. Rate: 149.8 symbols/min [2025-10-24T00:57:10.785684] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:10.817117] [DEBUG] [LOCAL ] ULS: Loaded 38712 existing records from primary storage. [2025-10-24T00:57:10.817323] [INFO ] [MAIN ] ULS: Loaded 38712 primary data records. [2025-10-24T00:57:10.980876] [DEBUG] [LOCAL ] UL: Loaded 53459 existing records from primary storage. [2025-10-24T00:57:11.048459] [INFO ] [MAIN ] UL: Loaded 53459 primary data records. [2025-10-24T00:57:11.276368] [DEBUG] [LOCAL ] UMC: Loaded 53054 existing records from primary storage. [2025-10-24T00:57:11.290256] [INFO ] [MAIN ] UMC: Loaded 53054 primary data records. [2025-10-24T00:57:11.854664] [DEBUG] [MAIN ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:11.900090] [DEBUG] [MAIN ] UL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:11.935991] [DEBUG] [MAIN ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:12.026338] [INFO ] [MAIN ] ULS: Generated 139 derivative records from 38712 primary records. [2025-10-24T00:57:12.033292] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-24T00:57:12.034106] [FATAL] [LOCAL ] ULS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:12.034722] [FATAL] [MAIN ] ULS: Failed to save derivative data. [2025-10-24T00:57:12.043339] [INFO ] [MAIN ] Derivative Progress: 1987/2164 symbols completed. ULS took 1.3s. Estimated remaining: 1m 11s. Rate: 149.6 symbols/min [2025-10-24T00:57:12.047206] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:12.061713] [INFO ] [MAIN ] UL: Generated 139 derivative records from 53459 primary records. [2025-10-24T00:57:12.062884] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-24T00:57:12.063638] [FATAL] [LOCAL ] UL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:12.066508] [FATAL] [MAIN ] UL: Failed to save derivative data. [2025-10-24T00:57:12.069368] [INFO ] [MAIN ] Derivative Progress: 1988/2164 symbols completed. UL took 1.3s. Estimated remaining: 1m 11s. Rate: 149.7 symbols/min [2025-10-24T00:57:12.070188] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:12.073847] [INFO ] [MAIN ] UMC: Generated 139 derivative records from 53054 primary records. [2025-10-24T00:57:12.074316] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-24T00:57:12.074712] [FATAL] [LOCAL ] UMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:12.074792] [FATAL] [MAIN ] UMC: Failed to save derivative data. [2025-10-24T00:57:12.077700] [INFO ] [MAIN ] Derivative Progress: 1989/2164 symbols completed. UMC took 1.3s. Estimated remaining: 1m 10s. Rate: 149.8 symbols/min [2025-10-24T00:57:12.077859] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:12.098576] [DEBUG] [LOCAL ] UNF: Loaded 11947 existing records from primary storage. [2025-10-24T00:57:12.098781] [INFO ] [MAIN ] UNF: Loaded 11947 primary data records. [2025-10-24T00:57:12.193040] [DEBUG] [LOCAL ] UMH: Loaded 34448 existing records from primary storage. [2025-10-24T00:57:12.216446] [INFO ] [MAIN ] UMH: Loaded 34448 primary data records. [2025-10-24T00:57:12.558262] [DEBUG] [LOCAL ] UNFI: Loaded 42908 existing records from primary storage. [2025-10-24T00:57:12.578609] [INFO ] [MAIN ] UNFI: Loaded 42908 primary data records. [2025-10-24T00:57:13.121153] [DEBUG] [MAIN ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:13.158739] [DEBUG] [MAIN ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:13.214257] [DEBUG] [MAIN ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:13.237425] [INFO ] [MAIN ] UNF: Generated 139 derivative records from 11947 primary records. [2025-10-24T00:57:13.239190] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-24T00:57:13.241814] [FATAL] [LOCAL ] UNF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:13.248020] [FATAL] [MAIN ] UNF: Failed to save derivative data. [2025-10-24T00:57:13.251433] [INFO ] [MAIN ] Derivative Progress: 1990/2164 symbols completed. UNF took 1.2s. Estimated remaining: 1m 10s. Rate: 149.6 symbols/min [2025-10-24T00:57:13.253840] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:13.268901] [INFO ] [MAIN ] UMH: Generated 139 derivative records from 34448 primary records. [2025-10-24T00:57:13.269663] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-24T00:57:13.271068] [FATAL] [LOCAL ] UMH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:13.271416] [FATAL] [MAIN ] UMH: Failed to save derivative data. [2025-10-24T00:57:13.273950] [INFO ] [MAIN ] Derivative Progress: 1991/2164 symbols completed. UMH took 1.2s. Estimated remaining: 1m 9s. Rate: 149.7 symbols/min [2025-10-24T00:57:13.276790] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:13.280633] [INFO ] [MAIN ] UNFI: Generated 139 derivative records from 42908 primary records. [2025-10-24T00:57:13.281208] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-24T00:57:13.281430] [FATAL] [LOCAL ] UNFI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:13.281511] [FATAL] [MAIN ] UNFI: Failed to save derivative data. [2025-10-24T00:57:13.284742] [INFO ] [MAIN ] Derivative Progress: 1992/2164 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 9s. Rate: 149.8 symbols/min [2025-10-24T00:57:13.285187] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:13.292985] [DEBUG] [LOCAL ] UNMA: Loaded 3427 existing records from primary storage. [2025-10-24T00:57:13.293246] [INFO ] [MAIN ] UNMA: Loaded 3427 primary data records. [2025-10-24T00:57:13.507686] [DEBUG] [LOCAL ] UNH: Loaded 54209 existing records from primary storage. [2025-10-24T00:57:13.531257] [INFO ] [MAIN ] UNH: Loaded 54209 primary data records. [2025-10-24T00:57:13.719575] [DEBUG] [LOCAL ] UNM: Loaded 48281 existing records from primary storage. [2025-10-24T00:57:13.734366] [INFO ] [MAIN ] UNM: Loaded 48281 primary data records. [2025-10-24T00:57:14.333859] [DEBUG] [MAIN ] UNMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:14.370806] [DEBUG] [MAIN ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:14.408277] [DEBUG] [MAIN ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:14.444167] [INFO ] [MAIN ] UNMA: Generated 139 derivative records from 3427 primary records. [2025-10-24T00:57:14.447233] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-24T00:57:14.448256] [FATAL] [LOCAL ] UNMA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:14.448454] [FATAL] [MAIN ] UNMA: Failed to save derivative data. [2025-10-24T00:57:14.451059] [INFO ] [MAIN ] Derivative Progress: 1993/2164 symbols completed. UNMA took 1.2s. Estimated remaining: 1m 9s. Rate: 149.6 symbols/min [2025-10-24T00:57:14.465299] [INFO ] [MAIN ] UNH: Generated 139 derivative records from 54209 primary records. [2025-10-24T00:57:14.465696] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-24T00:57:14.468246] [FATAL] [LOCAL ] UNH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:14.468684] [FATAL] [MAIN ] UNH: Failed to save derivative data. [2025-10-24T00:57:14.470898] [INFO ] [MAIN ] Derivative Progress: 1994/2164 symbols completed. UNH took 1.2s. Estimated remaining: 1m 8s. Rate: 149.7 symbols/min [2025-10-24T00:57:14.474008] [INFO ] [MAIN ] UNM: Generated 139 derivative records from 48281 primary records. [2025-10-24T00:57:14.474109] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-24T00:57:14.474373] [FATAL] [LOCAL ] UNM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:14.474462] [FATAL] [MAIN ] UNM: Failed to save derivative data. [2025-10-24T00:57:14.478590] [INFO ] [MAIN ] Derivative Progress: 1995/2164 symbols completed. UNM took 1.2s. Estimated remaining: 1m 8s. Rate: 149.8 symbols/min [2025-10-24T00:57:14.479229] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:14.479133] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:14.479989] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:14.586197] [DEBUG] [LOCAL ] UNP: Loaded 53752 existing records from primary storage. [2025-10-24T00:57:14.586479] [INFO ] [MAIN ] UNP: Loaded 53752 primary data records. [2025-10-24T00:57:14.589018] [DEBUG] [LOCAL ] UPS: Loaded 54111 existing records from primary storage. [2025-10-24T00:57:14.588139] [DEBUG] [LOCAL ] UP: Loaded 44786 existing records from primary storage. [2025-10-24T00:57:14.619985] [INFO ] [MAIN ] UPS: Loaded 54111 primary data records. [2025-10-24T00:57:14.619884] [INFO ] [MAIN ] UP: Loaded 44786 primary data records. [2025-10-24T00:57:15.523400] [DEBUG] [MAIN ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:15.552717] [DEBUG] [MAIN ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:15.572376] [DEBUG] [MAIN ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:15.671969] [INFO ] [MAIN ] UNP: Generated 139 derivative records from 53752 primary records. [2025-10-24T00:57:15.672936] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-24T00:57:15.675674] [INFO ] [MAIN ] UPS: Generated 139 derivative records from 54111 primary records. [2025-10-24T00:57:15.676481] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-24T00:57:15.676310] [FATAL] [LOCAL ] UNP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:15.678929] [FATAL] [LOCAL ] UPS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:15.679182] [FATAL] [MAIN ] UNP: Failed to save derivative data. [2025-10-24T00:57:15.679564] [INFO ] [MAIN ] UP: Generated 139 derivative records from 44786 primary records. [2025-10-24T00:57:15.681846] [FATAL] [MAIN ] UPS: Failed to save derivative data. [2025-10-24T00:57:15.681590] [INFO ] [MAIN ] Derivative Progress: 1996/2164 symbols completed. UNP took 1.2s. Estimated remaining: 1m 7s. Rate: 149.6 symbols/min [2025-10-24T00:57:15.682337] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:15.682029] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-24T00:57:15.682825] [FATAL] [LOCAL ] UP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:15.687982] [FATAL] [MAIN ] UP: Failed to save derivative data. [2025-10-24T00:57:15.687838] [INFO ] [MAIN ] Derivative Progress: 1997/2164 symbols completed. UPS took 1.2s. Estimated remaining: 1m 7s. Rate: 149.7 symbols/min [2025-10-24T00:57:15.691947] [INFO ] [MAIN ] Derivative Progress: 1998/2164 symbols completed. UP took 1.2s. Estimated remaining: 1m 7s. Rate: 149.8 symbols/min [2025-10-24T00:57:15.691794] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:15.692580] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:15.724191] [DEBUG] [LOCAL ] USAC: Loaded 21803 existing records from primary storage. [2025-10-24T00:57:15.734695] [INFO ] [MAIN ] USAC: Loaded 21803 primary data records. [2025-10-24T00:57:15.826452] [DEBUG] [LOCAL ] URI: Loaded 34614 existing records from primary storage. [2025-10-24T00:57:15.885529] [INFO ] [MAIN ] URI: Loaded 34614 primary data records. [2025-10-24T00:57:15.886578] [DEBUG] [LOCAL ] USA: Loaded 36639 existing records from primary storage. [2025-10-24T00:57:15.909610] [INFO ] [MAIN ] USA: Loaded 36639 primary data records. [2025-10-24T00:57:16.734248] [DEBUG] [MAIN ] USAC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:57:16.768799] [DEBUG] [MAIN ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:16.805484] [DEBUG] [MAIN ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:16.857074] [INFO ] [MAIN ] USAC: Generated 139 derivative records from 21803 primary records. [2025-10-24T00:57:16.859089] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-24T00:57:16.864232] [FATAL] [LOCAL ] USAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:16.864611] [FATAL] [MAIN ] USAC: Failed to save derivative data. [2025-10-24T00:57:16.866682] [INFO ] [MAIN ] Derivative Progress: 1999/2164 symbols completed. USAC took 1.2s. Estimated remaining: 1m 6s. Rate: 149.6 symbols/min [2025-10-24T00:57:16.869169] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:16.875245] [INFO ] [MAIN ] USA: Generated 139 derivative records from 36639 primary records. [2025-10-24T00:57:16.876310] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-24T00:57:16.876934] [FATAL] [LOCAL ] USA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:16.877133] [FATAL] [MAIN ] USA: Failed to save derivative data. [2025-10-24T00:57:16.879695] [INFO ] [MAIN ] Derivative Progress: 2000/2164 symbols completed. USA took 1.2s. Estimated remaining: 1m 6s. Rate: 149.7 symbols/min [2025-10-24T00:57:16.879950] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:16.881893] [INFO ] [MAIN ] URI: Generated 139 derivative records from 34614 primary records. [2025-10-24T00:57:16.882478] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-24T00:57:16.882703] [FATAL] [LOCAL ] URI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:16.882781] [FATAL] [MAIN ] URI: Failed to save derivative data. [2025-10-24T00:57:16.885501] [INFO ] [MAIN ] Derivative Progress: 2001/2164 symbols completed. URI took 1.2s. Estimated remaining: 1m 5s. Rate: 149.8 symbols/min [2025-10-24T00:57:16.886368] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:16.918634] [DEBUG] [LOCAL ] USNA: Loaded 18214 existing records from primary storage. [2025-10-24T00:57:16.918822] [INFO ] [MAIN ] USNA: Loaded 18214 primary data records. [2025-10-24T00:57:17.063194] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-24T00:57:17.064419] [DEBUG] [LOCAL ] USFD: Loaded 51509 existing records from primary storage. [2025-10-24T00:57:17.069761] [INFO ] [MAIN ] USB: Loaded 54078 primary data records. [2025-10-24T00:57:17.139357] [INFO ] [MAIN ] USFD: Loaded 51509 primary data records. [2025-10-24T00:57:17.878160] [DEBUG] [MAIN ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:17.928056] [DEBUG] [MAIN ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:17.963779] [DEBUG] [MAIN ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:17.983906] [INFO ] [MAIN ] USNA: Generated 139 derivative records from 18214 primary records. [2025-10-24T00:57:17.985755] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-24T00:57:17.986027] [FATAL] [LOCAL ] USNA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:17.987498] [FATAL] [MAIN ] USNA: Failed to save derivative data. [2025-10-24T00:57:17.991247] [INFO ] [MAIN ] Derivative Progress: 2002/2164 symbols completed. USNA took 1.1s. Estimated remaining: 1m 5s. Rate: 149.6 symbols/min [2025-10-24T00:57:17.992605] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:18.027843] [DEBUG] [LOCAL ] USPH: Loaded 17083 existing records from primary storage. [2025-10-24T00:57:18.033188] [INFO ] [MAIN ] USPH: Loaded 17083 primary data records. [2025-10-24T00:57:18.033732] [INFO ] [MAIN ] USB: Generated 139 derivative records from 54078 primary records. [2025-10-24T00:57:18.070786] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-24T00:57:18.116297] [INFO ] [MAIN ] USFD: Generated 139 derivative records from 51509 primary records. [2025-10-24T00:57:18.127414] [FATAL] [LOCAL ] USB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:18.121865] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-24T00:57:18.138348] [FATAL] [LOCAL ] USFD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:18.138026] [FATAL] [MAIN ] USB: Failed to save derivative data. [2025-10-24T00:57:18.141023] [INFO ] [MAIN ] Derivative Progress: 2003/2164 symbols completed. USB took 1.3s. Estimated remaining: 1m 5s. Rate: 149.7 symbols/min [2025-10-24T00:57:18.141384] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:18.141177] [FATAL] [MAIN ] USFD: Failed to save derivative data. [2025-10-24T00:57:18.144789] [INFO ] [MAIN ] Derivative Progress: 2004/2164 symbols completed. USFD took 1.3s. Estimated remaining: 1m 4s. Rate: 149.8 symbols/min [2025-10-24T00:57:18.145068] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:18.386697] [DEBUG] [LOCAL ] UTF: Loaded 31254 existing records from primary storage. [2025-10-24T00:57:18.387371] [INFO ] [MAIN ] UTF: Loaded 31254 primary data records. [2025-10-24T00:57:18.481937] [DEBUG] [LOCAL ] UTI: Loaded 40647 existing records from primary storage. [2025-10-24T00:57:18.487532] [INFO ] [MAIN ] UTI: Loaded 40647 primary data records. [2025-10-24T00:57:19.016800] [DEBUG] [MAIN ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:19.075047] [DEBUG] [MAIN ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:19.112173] [DEBUG] [MAIN ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:19.116399] [INFO ] [MAIN ] USPH: Generated 139 derivative records from 17083 primary records. [2025-10-24T00:57:19.129574] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-24T00:57:19.137830] [FATAL] [LOCAL ] USPH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:19.139853] [FATAL] [MAIN ] USPH: Failed to save derivative data. [2025-10-24T00:57:19.142258] [INFO ] [MAIN ] Derivative Progress: 2005/2164 symbols completed. USPH took 1.1s. Estimated remaining: 1m 4s. Rate: 149.7 symbols/min [2025-10-24T00:57:19.146597] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:19.182243] [DEBUG] [LOCAL ] UTL: Loaded 11902 existing records from primary storage. [2025-10-24T00:57:19.181985] [INFO ] [MAIN ] UTF: Generated 139 derivative records from 31254 primary records. [2025-10-24T00:57:19.183190] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-24T00:57:19.183999] [FATAL] [LOCAL ] UTF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:19.183326] [INFO ] [MAIN ] UTL: Loaded 11902 primary data records. [2025-10-24T00:57:19.186621] [FATAL] [MAIN ] UTF: Failed to save derivative data. [2025-10-24T00:57:19.189257] [INFO ] [MAIN ] Derivative Progress: 2006/2164 symbols completed. UTF took 1.0s. Estimated remaining: 1m 3s. Rate: 149.7 symbols/min [2025-10-24T00:57:19.194773] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:19.269858] [INFO ] [MAIN ] UTI: Generated 139 derivative records from 40647 primary records. [2025-10-24T00:57:19.296505] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-24T00:57:19.308047] [FATAL] [LOCAL ] UTI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:19.318662] [FATAL] [MAIN ] UTI: Failed to save derivative data. [2025-10-24T00:57:19.326809] [INFO ] [MAIN ] Derivative Progress: 2007/2164 symbols completed. UTI took 1.2s. Estimated remaining: 1m 3s. Rate: 149.8 symbols/min [2025-10-24T00:57:19.376306] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:19.546213] [DEBUG] [LOCAL ] UVE: Loaded 22079 existing records from primary storage. [2025-10-24T00:57:19.547320] [INFO ] [MAIN ] UVE: Loaded 22079 primary data records. [2025-10-24T00:57:19.546978] [DEBUG] [LOCAL ] UTZ: Loaded 44488 existing records from primary storage. [2025-10-24T00:57:19.558804] [INFO ] [MAIN ] UTZ: Loaded 44488 primary data records. [2025-10-24T00:57:19.811947] [DEBUG] [MAIN ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:20.251232] [INFO ] [MAIN ] UTL: Generated 139 derivative records from 11902 primary records. [2025-10-24T00:57:20.254085] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-24T00:57:20.255049] [FATAL] [LOCAL ] UTL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:20.255206] [FATAL] [MAIN ] UTL: Failed to save derivative data. [2025-10-24T00:57:20.257232] [INFO ] [MAIN ] Derivative Progress: 2008/2164 symbols completed. UTL took 1.1s. Estimated remaining: 1m 3s. Rate: 149.7 symbols/min [2025-10-24T00:57:20.270660] [DEBUG] [MAIN ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:20.295000] [DEBUG] [MAIN ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:20.348508] [INFO ] [MAIN ] UVE: Generated 139 derivative records from 22079 primary records. [2025-10-24T00:57:20.350017] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-24T00:57:20.350282] [FATAL] [LOCAL ] UVE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:20.351954] [FATAL] [MAIN ] UVE: Failed to save derivative data. [2025-10-24T00:57:20.354327] [INFO ] [MAIN ] Derivative Progress: 2009/2164 symbols completed. UVE took 1.0s. Estimated remaining: 1m 2s. Rate: 149.7 symbols/min [2025-10-24T00:57:20.354541] [INFO ] [MAIN ] UTZ: Generated 139 derivative records from 44488 primary records. [2025-10-24T00:57:20.354874] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-24T00:57:20.355076] [FATAL] [LOCAL ] UTZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:20.355154] [FATAL] [MAIN ] UTZ: Failed to save derivative data. [2025-10-24T00:57:20.357977] [INFO ] [MAIN ] Derivative Progress: 2010/2164 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 2s. Rate: 149.8 symbols/min [2025-10-24T00:57:20.358472] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:20.358385] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:20.358563] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:20.367756] [DEBUG] [LOCAL ] UZD: Loaded 5805 existing records from primary storage. [2025-10-24T00:57:20.367969] [INFO ] [MAIN ] UZD: Loaded 5805 primary data records. [2025-10-24T00:57:20.537004] [DEBUG] [LOCAL ] UVV: Loaded 22875 existing records from primary storage. [2025-10-24T00:57:20.567809] [INFO ] [MAIN ] UVV: Loaded 22875 primary data records. [2025-10-24T00:57:20.809821] [DEBUG] [LOCAL ] UWMC: Loaded 53348 existing records from primary storage. [2025-10-24T00:57:20.826113] [INFO ] [MAIN ] UWMC: Loaded 53348 primary data records. [2025-10-24T00:57:21.326876] [DEBUG] [MAIN ] UZD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:21.363199] [DEBUG] [MAIN ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:21.409958] [DEBUG] [MAIN ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:21.433465] [INFO ] [MAIN ] UZD: Generated 139 derivative records from 5805 primary records. [2025-10-24T00:57:21.439973] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-24T00:57:21.442032] [FATAL] [LOCAL ] UZD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:21.442142] [FATAL] [MAIN ] UZD: Failed to save derivative data. [2025-10-24T00:57:21.446363] [INFO ] [MAIN ] Derivative Progress: 2011/2164 symbols completed. UZD took 1.1s. Estimated remaining: 1m 1s. Rate: 149.7 symbols/min [2025-10-24T00:57:21.447150] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:21.463587] [INFO ] [MAIN ] UVV: Generated 139 derivative records from 22875 primary records. [2025-10-24T00:57:21.466385] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-24T00:57:21.466674] [FATAL] [LOCAL ] UVV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:21.466783] [FATAL] [MAIN ] UVV: Failed to save derivative data. [2025-10-24T00:57:21.472223] [INFO ] [MAIN ] Derivative Progress: 2012/2164 symbols completed. UVV took 1.1s. Estimated remaining: 1m 1s. Rate: 149.7 symbols/min [2025-10-24T00:57:21.472805] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:21.472630] [DEBUG] [LOCAL ] UZE: Loaded 6952 existing records from primary storage. [2025-10-24T00:57:21.474855] [INFO ] [MAIN ] UZE: Loaded 6952 primary data records. [2025-10-24T00:57:21.527298] [INFO ] [MAIN ] UWMC: Generated 139 derivative records from 53348 primary records. [2025-10-24T00:57:21.546628] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-24T00:57:21.559152] [FATAL] [LOCAL ] UWMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:21.583747] [FATAL] [MAIN ] UWMC: Failed to save derivative data. [2025-10-24T00:57:21.591378] [INFO ] [MAIN ] Derivative Progress: 2013/2164 symbols completed. UWMC took 1.2s. Estimated remaining: 1m 0s. Rate: 149.8 symbols/min [2025-10-24T00:57:21.607737] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:21.827585] [DEBUG] [LOCAL ] V: Loaded 54139 existing records from primary storage. [2025-10-24T00:57:21.834978] [INFO ] [MAIN ] V: Loaded 54139 primary data records. [2025-10-24T00:57:21.959058] [DEBUG] [LOCAL ] VAC: Loaded 33922 existing records from primary storage. [2025-10-24T00:57:22.004579] [DEBUG] [MAIN ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:22.004252] [INFO ] [MAIN ] VAC: Loaded 33922 primary data records. [2025-10-24T00:57:22.571403] [INFO ] [MAIN ] UZE: Generated 139 derivative records from 6952 primary records. [2025-10-24T00:57:22.572450] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-24T00:57:22.585773] [DEBUG] [MAIN ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:22.585336] [FATAL] [LOCAL ] UZE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:22.597788] [FATAL] [MAIN ] UZE: Failed to save derivative data. [2025-10-24T00:57:22.601303] [INFO ] [MAIN ] Derivative Progress: 2014/2164 symbols completed. UZE took 1.2s. Estimated remaining: 1m 0s. Rate: 149.7 symbols/min [2025-10-24T00:57:22.603325] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:22.659013] [DEBUG] [MAIN ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:22.672541] [INFO ] [MAIN ] V: Generated 139 derivative records from 54139 primary records. [2025-10-24T00:57:22.673638] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-24T00:57:22.674041] [FATAL] [LOCAL ] V: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:22.676341] [FATAL] [MAIN ] V: Failed to save derivative data. [2025-10-24T00:57:22.679813] [INFO ] [MAIN ] Derivative Progress: 2015/2164 symbols completed. V took 1.2s. Estimated remaining: 59.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:22.681275] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:22.701919] [DEBUG] [LOCAL ] VAL: Loaded 50242 existing records from primary storage. [2025-10-24T00:57:22.705837] [INFO ] [MAIN ] VAL: Loaded 50242 primary data records. [2025-10-24T00:57:23.036318] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-24T00:57:23.056663] [INFO ] [MAIN ] VAC: Generated 139 derivative records from 33922 primary records. [2025-10-24T00:57:23.056929] [INFO ] [MAIN ] VALE: Loaded 54083 primary data records. [2025-10-24T00:57:23.057306] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-24T00:57:23.095129] [FATAL] [LOCAL ] VAC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:23.129166] [FATAL] [MAIN ] VAC: Failed to save derivative data. [2025-10-24T00:57:23.138071] [INFO ] [MAIN ] Derivative Progress: 2016/2164 symbols completed. VAC took 1.5s. Estimated remaining: 59.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:23.155221] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:23.376200] [DEBUG] [LOCAL ] VATE: Loaded 5078 existing records from primary storage. [2025-10-24T00:57:23.376729] [INFO ] [MAIN ] VATE: Loaded 5078 primary data records. [2025-10-24T00:57:23.569939] [DEBUG] [MAIN ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:23.760403] [DEBUG] [MAIN ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:23.795461] [INFO ] [MAIN ] VAL: Generated 139 derivative records from 50242 primary records. [2025-10-24T00:57:23.798388] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-24T00:57:23.812940] [FATAL] [LOCAL ] VAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:23.813215] [FATAL] [MAIN ] VAL: Failed to save derivative data. [2025-10-24T00:57:23.812622] [DEBUG] [MAIN ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:23.815366] [INFO ] [MAIN ] Derivative Progress: 2017/2164 symbols completed. VAL took 1.2s. Estimated remaining: 58.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:23.837990] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:23.857938] [DEBUG] [LOCAL ] VBF: Loaded 7227 existing records from primary storage. [2025-10-24T00:57:23.859962] [INFO ] [MAIN ] VBF: Loaded 7227 primary data records. [2025-10-24T00:57:23.888533] [INFO ] [MAIN ] VALE: Generated 139 derivative records from 54083 primary records. [2025-10-24T00:57:23.894425] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-24T00:57:23.894813] [FATAL] [LOCAL ] VALE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:23.915444] [FATAL] [MAIN ] VALE: Failed to save derivative data. [2025-10-24T00:57:23.918081] [INFO ] [MAIN ] Derivative Progress: 2018/2164 symbols completed. VALE took 1.2s. Estimated remaining: 58.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:23.926781] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:24.072095] [DEBUG] [LOCAL ] VCV: Loaded 13232 existing records from primary storage. [2025-10-24T00:57:24.239736] [INFO ] [MAIN ] VCV: Loaded 13232 primary data records. [2025-10-24T00:57:24.323398] [INFO ] [MAIN ] VATE: Generated 139 derivative records from 5078 primary records. [2025-10-24T00:57:24.336195] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-24T00:57:24.352907] [FATAL] [LOCAL ] VATE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:24.363668] [FATAL] [MAIN ] VATE: Failed to save derivative data. [2025-10-24T00:57:24.366630] [INFO ] [MAIN ] Derivative Progress: 2019/2164 symbols completed. VATE took 1.2s. Estimated remaining: 58.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:24.372450] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:24.603863] [DEBUG] [MAIN ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:24.657380] [DEBUG] [LOCAL ] VEEV: Loaded 47474 existing records from primary storage. [2025-10-24T00:57:24.658383] [DEBUG] [MAIN ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:24.658623] [INFO ] [MAIN ] VEEV: Loaded 47474 primary data records. [2025-10-24T00:57:25.022781] [INFO ] [MAIN ] VBF: Generated 139 derivative records from 7227 primary records. [2025-10-24T00:57:25.023290] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-24T00:57:25.025340] [FATAL] [LOCAL ] VBF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:25.025674] [FATAL] [MAIN ] VBF: Failed to save derivative data. [2025-10-24T00:57:25.031457] [INFO ] [MAIN ] Derivative Progress: 2020/2164 symbols completed. VBF took 1.2s. Estimated remaining: 57.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:25.032049] [INFO ] [MAIN ] VCV: Generated 139 derivative records from 13232 primary records. [2025-10-24T00:57:25.032348] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:25.033016] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-24T00:57:25.033518] [FATAL] [LOCAL ] VCV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:25.033598] [FATAL] [MAIN ] VCV: Failed to save derivative data. [2025-10-24T00:57:25.036161] [INFO ] [MAIN ] Derivative Progress: 2021/2164 symbols completed. VCV took 1.1s. Estimated remaining: 57.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:25.036713] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:25.051620] [DEBUG] [LOCAL ] VEL: Loaded 11991 existing records from primary storage. [2025-10-24T00:57:25.052121] [INFO ] [MAIN ] VEL: Loaded 11991 primary data records. [2025-10-24T00:57:25.120741] [DEBUG] [MAIN ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:25.410455] [DEBUG] [LOCAL ] VET: Loaded 44405 existing records from primary storage. [2025-10-24T00:57:25.415516] [INFO ] [MAIN ] VET: Loaded 44405 primary data records. [2025-10-24T00:57:25.749970] [INFO ] [MAIN ] VEEV: Generated 139 derivative records from 47474 primary records. [2025-10-24T00:57:25.750480] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-24T00:57:25.750979] [FATAL] [LOCAL ] VEEV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:25.752045] [FATAL] [MAIN ] VEEV: Failed to save derivative data. [2025-10-24T00:57:25.755607] [INFO ] [MAIN ] Derivative Progress: 2022/2164 symbols completed. VEEV took 1.4s. Estimated remaining: 56.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:25.756396] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:25.780097] [DEBUG] [MAIN ] VEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:25.831782] [DEBUG] [MAIN ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:25.874820] [INFO ] [MAIN ] VEL: Generated 139 derivative records from 11991 primary records. [2025-10-24T00:57:25.890772] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-24T00:57:25.891590] [FATAL] [LOCAL ] VEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:25.896972] [FATAL] [MAIN ] VEL: Failed to save derivative data. [2025-10-24T00:57:25.899663] [INFO ] [MAIN ] Derivative Progress: 2023/2164 symbols completed. VEL took 0.9s. Estimated remaining: 56.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:25.896855] [DEBUG] [LOCAL ] VFC: Loaded 53996 existing records from primary storage. [2025-10-24T00:57:25.903234] [INFO ] [MAIN ] VFC: Loaded 53996 primary data records. [2025-10-24T00:57:26.100594] [INFO ] [MAIN ] VET: Generated 139 derivative records from 44405 primary records. [2025-10-24T00:57:26.104820] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-24T00:57:26.105421] [FATAL] [LOCAL ] VET: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:26.247386] [FATAL] [MAIN ] VET: Failed to save derivative data. [2025-10-24T00:57:26.263012] [INFO ] [MAIN ] Derivative Progress: 2024/2164 symbols completed. VET took 1.2s. Estimated remaining: 56.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:26.284815] [DEBUG] [MAIN ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:26.310936] [INFO ] [MAIN ] VFC: Generated 139 derivative records from 53996 primary records. [2025-10-24T00:57:26.311085] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-24T00:57:26.311268] [FATAL] [LOCAL ] VFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:26.311343] [FATAL] [MAIN ] VFC: Failed to save derivative data. [2025-10-24T00:57:26.313347] [INFO ] [MAIN ] Derivative Progress: 2025/2164 symbols completed. VFC took 0.6s. Estimated remaining: 55.7s. Rate: 149.8 symbols/min [2025-10-24T00:57:26.314102] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:26.313856] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:26.313960] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:26.322929] [DEBUG] [LOCAL ] VHI: Loaded 2684 existing records from primary storage. [2025-10-24T00:57:26.323319] [INFO ] [MAIN ] VHI: Loaded 2684 primary data records. [2025-10-24T00:57:26.326098] [DEBUG] [LOCAL ] VGI: Loaded 5240 existing records from primary storage. [2025-10-24T00:57:26.326288] [INFO ] [MAIN ] VGI: Loaded 5240 primary data records. [2025-10-24T00:57:26.489965] [DEBUG] [LOCAL ] VGM: Loaded 18736 existing records from primary storage. [2025-10-24T00:57:26.526205] [INFO ] [MAIN ] VGM: Loaded 18736 primary data records. [2025-10-24T00:57:27.306325] [DEBUG] [MAIN ] VHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:27.352421] [DEBUG] [MAIN ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:27.358969] [DEBUG] [MAIN ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:27.441469] [INFO ] [MAIN ] VHI: Generated 139 derivative records from 2684 primary records. [2025-10-24T00:57:27.442170] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-24T00:57:27.443895] [FATAL] [LOCAL ] VHI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:27.444926] [FATAL] [MAIN ] VHI: Failed to save derivative data. [2025-10-24T00:57:27.447201] [INFO ] [MAIN ] Derivative Progress: 2026/2164 symbols completed. VHI took 1.1s. Estimated remaining: 55.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:27.447413] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:27.461965] [INFO ] [MAIN ] VGM: Generated 139 derivative records from 18736 primary records. [2025-10-24T00:57:27.462390] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-24T00:57:27.462748] [FATAL] [LOCAL ] VGM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:27.465060] [FATAL] [MAIN ] VGM: Failed to save derivative data. [2025-10-24T00:57:27.465313] [INFO ] [MAIN ] VGI: Generated 139 derivative records from 5240 primary records. [2025-10-24T00:57:27.468526] [INFO ] [MAIN ] Derivative Progress: 2027/2164 symbols completed. VGM took 1.2s. Estimated remaining: 54.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:27.469010] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:27.469521] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-24T00:57:27.470087] [FATAL] [LOCAL ] VGI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:27.470384] [FATAL] [MAIN ] VGI: Failed to save derivative data. [2025-10-24T00:57:27.472993] [INFO ] [MAIN ] Derivative Progress: 2028/2164 symbols completed. VGI took 1.2s. Estimated remaining: 54.5s. Rate: 149.8 symbols/min [2025-10-24T00:57:27.473183] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:27.544375] [DEBUG] [LOCAL ] VICI: Loaded 54043 existing records from primary storage. [2025-10-24T00:57:27.558678] [INFO ] [MAIN ] VICI: Loaded 54043 primary data records. [2025-10-24T00:57:27.571430] [DEBUG] [LOCAL ] VIK: Loaded 52713 existing records from primary storage. [2025-10-24T00:57:27.628733] [INFO ] [MAIN ] VIK: Loaded 52713 primary data records. [2025-10-24T00:57:27.714698] [DEBUG] [LOCAL ] VIPS: Loaded 51623 existing records from primary storage. [2025-10-24T00:57:27.836780] [INFO ] [MAIN ] VIPS: Loaded 51623 primary data records. [2025-10-24T00:57:28.607409] [DEBUG] [MAIN ] VIK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:28.608578] [DEBUG] [MAIN ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:28.659494] [DEBUG] [MAIN ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:28.731286] [INFO ] [MAIN ] VIK: Generated 139 derivative records from 52713 primary records. [2025-10-24T00:57:28.734874] [INFO ] [MAIN ] VICI: Generated 139 derivative records from 54043 primary records. [2025-10-24T00:57:28.735443] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-24T00:57:28.737981] [FATAL] [LOCAL ] VIK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:28.735926] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-24T00:57:28.738277] [INFO ] [MAIN ] VIPS: Generated 139 derivative records from 51623 primary records. [2025-10-24T00:57:28.739037] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-24T00:57:28.738819] [FATAL] [LOCAL ] VICI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:28.739479] [FATAL] [LOCAL ] VIPS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:28.739212] [FATAL] [MAIN ] VICI: Failed to save derivative data. [2025-10-24T00:57:28.738955] [FATAL] [MAIN ] VIK: Failed to save derivative data. [2025-10-24T00:57:28.739688] [FATAL] [MAIN ] VIPS: Failed to save derivative data. [2025-10-24T00:57:28.742404] [INFO ] [MAIN ] Derivative Progress: 2029/2164 symbols completed. VIPS took 1.3s. Estimated remaining: 54.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:28.747904] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:28.748153] [INFO ] [MAIN ] Derivative Progress: 2030/2164 symbols completed. VIK took 1.3s. Estimated remaining: 53.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:28.748796] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:28.749259] [INFO ] [MAIN ] Derivative Progress: 2031/2164 symbols completed. VICI took 1.3s. Estimated remaining: 53.3s. Rate: 149.8 symbols/min [2025-10-24T00:57:28.749569] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:28.809370] [DEBUG] [LOCAL ] VIRT: Loaded 46759 existing records from primary storage. [2025-10-24T00:57:28.836020] [INFO ] [MAIN ] VIRT: Loaded 46759 primary data records. [2025-10-24T00:57:28.837475] [DEBUG] [LOCAL ] VIV: Loaded 44842 existing records from primary storage. [2025-10-24T00:57:28.836861] [DEBUG] [LOCAL ] VIST: Loaded 47029 existing records from primary storage. [2025-10-24T00:57:28.838166] [INFO ] [MAIN ] VIV: Loaded 44842 primary data records. [2025-10-24T00:57:28.838098] [INFO ] [MAIN ] VIST: Loaded 47029 primary data records. [2025-10-24T00:57:29.986608] [DEBUG] [MAIN ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:30.031334] [DEBUG] [MAIN ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:30.031617] [DEBUG] [MAIN ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:30.121079] [INFO ] [MAIN ] VIRT: Generated 139 derivative records from 46759 primary records. [2025-10-24T00:57:30.122805] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-24T00:57:30.125372] [FATAL] [LOCAL ] VIRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:30.125020] [INFO ] [MAIN ] VIST: Generated 139 derivative records from 47029 primary records. [2025-10-24T00:57:30.125571] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-24T00:57:30.125918] [FATAL] [LOCAL ] VIST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:30.128036] [FATAL] [MAIN ] VIST: Failed to save derivative data. [2025-10-24T00:57:30.130924] [INFO ] [MAIN ] Derivative Progress: 2032/2164 symbols completed. VIST took 1.4s. Estimated remaining: 52.9s. Rate: 149.6 symbols/min [2025-10-24T00:57:30.126001] [FATAL] [MAIN ] VIRT: Failed to save derivative data. [2025-10-24T00:57:30.131339] [INFO ] [MAIN ] VIV: Generated 139 derivative records from 44842 primary records. [2025-10-24T00:57:30.131490] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:30.134561] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-24T00:57:30.133910] [INFO ] [MAIN ] Derivative Progress: 2033/2164 symbols completed. VIRT took 1.4s. Estimated remaining: 52.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:30.134814] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:30.135434] [FATAL] [LOCAL ] VIV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:30.135635] [FATAL] [MAIN ] VIV: Failed to save derivative data. [2025-10-24T00:57:30.137611] [INFO ] [MAIN ] Derivative Progress: 2034/2164 symbols completed. VIV took 1.4s. Estimated remaining: 52.1s. Rate: 149.8 symbols/min [2025-10-24T00:57:30.139675] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:30.155943] [DEBUG] [LOCAL ] VKQ: Loaded 17940 existing records from primary storage. [2025-10-24T00:57:30.156197] [INFO ] [MAIN ] VKQ: Loaded 17940 primary data records. [2025-10-24T00:57:30.276187] [DEBUG] [LOCAL ] VLN: Loaded 31255 existing records from primary storage. [2025-10-24T00:57:30.287065] [INFO ] [MAIN ] VLN: Loaded 31255 primary data records. [2025-10-24T00:57:30.620962] [DEBUG] [LOCAL ] VLO: Loaded 53345 existing records from primary storage. [2025-10-24T00:57:30.655781] [INFO ] [MAIN ] VLO: Loaded 53345 primary data records. [2025-10-24T00:57:31.168197] [DEBUG] [MAIN ] VKQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:31.199905] [DEBUG] [MAIN ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:31.252059] [DEBUG] [MAIN ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:31.278558] [INFO ] [MAIN ] VKQ: Generated 139 derivative records from 17940 primary records. [2025-10-24T00:57:31.280284] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-24T00:57:31.280862] [FATAL] [LOCAL ] VKQ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:31.281078] [FATAL] [MAIN ] VKQ: Failed to save derivative data. [2025-10-24T00:57:31.284190] [INFO ] [MAIN ] Derivative Progress: 2035/2164 symbols completed. VKQ took 1.2s. Estimated remaining: 51.7s. Rate: 149.6 symbols/min [2025-10-24T00:57:31.284457] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:31.296770] [INFO ] [MAIN ] VLN: Generated 139 derivative records from 31255 primary records. [2025-10-24T00:57:31.296908] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-24T00:57:31.299235] [FATAL] [LOCAL ] VLN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:31.299795] [FATAL] [MAIN ] VLN: Failed to save derivative data. [2025-10-24T00:57:31.302106] [INFO ] [MAIN ] Derivative Progress: 2036/2164 symbols completed. VLN took 1.2s. Estimated remaining: 51.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:31.303282] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:31.309910] [INFO ] [MAIN ] VLO: Generated 139 derivative records from 53345 primary records. [2025-10-24T00:57:31.310519] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-24T00:57:31.310803] [FATAL] [LOCAL ] VLO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:31.321076] [FATAL] [MAIN ] VLO: Failed to save derivative data. [2025-10-24T00:57:31.323672] [INFO ] [MAIN ] Derivative Progress: 2037/2164 symbols completed. VLO took 1.2s. Estimated remaining: 50.9s. Rate: 149.8 symbols/min [2025-10-24T00:57:31.323886] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:31.327211] [DEBUG] [LOCAL ] VLT: Loaded 4306 existing records from primary storage. [2025-10-24T00:57:31.327378] [INFO ] [MAIN ] VLT: Loaded 4306 primary data records. [2025-10-24T00:57:31.420225] [DEBUG] [LOCAL ] VLRS: Loaded 39561 existing records from primary storage. [2025-10-24T00:57:31.438276] [INFO ] [MAIN ] VLRS: Loaded 39561 primary data records. [2025-10-24T00:57:31.962253] [DEBUG] [LOCAL ] VLTO: Loaded 46360 existing records from primary storage. [2025-10-24T00:57:31.962600] [INFO ] [MAIN ] VLTO: Loaded 46360 primary data records. [2025-10-24T00:57:32.281448] [DEBUG] [MAIN ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:32.320366] [DEBUG] [MAIN ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:32.366301] [DEBUG] [MAIN ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:32.402228] [INFO ] [MAIN ] VLT: Generated 139 derivative records from 4306 primary records. [2025-10-24T00:57:32.404082] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-24T00:57:32.405493] [FATAL] [LOCAL ] VLT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:32.405996] [FATAL] [MAIN ] VLT: Failed to save derivative data. [2025-10-24T00:57:32.412880] [INFO ] [MAIN ] Derivative Progress: 2038/2164 symbols completed. VLT took 1.1s. Estimated remaining: 50.5s. Rate: 149.6 symbols/min [2025-10-24T00:57:32.421115] [INFO ] [MAIN ] VLRS: Generated 139 derivative records from 39561 primary records. [2025-10-24T00:57:32.423386] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-24T00:57:32.423837] [FATAL] [LOCAL ] VLRS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:32.424010] [FATAL] [MAIN ] VLRS: Failed to save derivative data. [2025-10-24T00:57:32.426635] [INFO ] [MAIN ] Derivative Progress: 2039/2164 symbols completed. VLRS took 1.1s. Estimated remaining: 50.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:32.429377] [INFO ] [MAIN ] VLTO: Generated 139 derivative records from 46360 primary records. [2025-10-24T00:57:32.429464] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-24T00:57:32.429694] [FATAL] [LOCAL ] VLTO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:32.429773] [FATAL] [MAIN ] VLTO: Failed to save derivative data. [2025-10-24T00:57:32.433865] [INFO ] [MAIN ] Derivative Progress: 2040/2164 symbols completed. VLTO took 1.1s. Estimated remaining: 49.7s. Rate: 149.8 symbols/min [2025-10-24T00:57:32.434500] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:32.434572] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:32.434402] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:32.456633] [DEBUG] [LOCAL ] VMO: Loaded 20786 existing records from primary storage. [2025-10-24T00:57:32.456833] [INFO ] [MAIN ] VMO: Loaded 20786 primary data records. [2025-10-24T00:57:32.630012] [DEBUG] [LOCAL ] VMC: Loaded 42397 existing records from primary storage. [2025-10-24T00:57:32.675197] [INFO ] [MAIN ] VMC: Loaded 42397 primary data records. [2025-10-24T00:57:32.676929] [DEBUG] [LOCAL ] VNO: Loaded 49140 existing records from primary storage. [2025-10-24T00:57:32.853011] [INFO ] [MAIN ] VNO: Loaded 49140 primary data records. [2025-10-24T00:57:33.429304] [DEBUG] [MAIN ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:33.492692] [DEBUG] [MAIN ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:33.493231] [DEBUG] [MAIN ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:33.543787] [INFO ] [MAIN ] VMO: Generated 139 derivative records from 20786 primary records. [2025-10-24T00:57:33.547259] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-24T00:57:33.553258] [FATAL] [LOCAL ] VMO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:33.554890] [FATAL] [MAIN ] VMO: Failed to save derivative data. [2025-10-24T00:57:33.556805] [INFO ] [MAIN ] Derivative Progress: 2041/2164 symbols completed. VMO took 1.1s. Estimated remaining: 49.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:33.558362] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:33.570998] [INFO ] [MAIN ] VNO: Generated 139 derivative records from 49140 primary records. [2025-10-24T00:57:33.574574] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-24T00:57:33.576024] [FATAL] [LOCAL ] VNO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:33.576184] [FATAL] [MAIN ] VNO: Failed to save derivative data. [2025-10-24T00:57:33.580046] [INFO ] [MAIN ] Derivative Progress: 2042/2164 symbols completed. VNO took 1.1s. Estimated remaining: 48.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:33.580477] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:33.582860] [INFO ] [MAIN ] VMC: Generated 139 derivative records from 42397 primary records. [2025-10-24T00:57:33.583034] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-24T00:57:33.583258] [FATAL] [LOCAL ] VMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:33.583344] [FATAL] [MAIN ] VMC: Failed to save derivative data. [2025-10-24T00:57:33.586362] [INFO ] [MAIN ] Derivative Progress: 2043/2164 symbols completed. VMC took 1.2s. Estimated remaining: 48.5s. Rate: 149.8 symbols/min [2025-10-24T00:57:33.586800] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:33.605713] [DEBUG] [LOCAL ] VOC: Loaded 9134 existing records from primary storage. [2025-10-24T00:57:33.605849] [INFO ] [MAIN ] VOC: Loaded 9134 primary data records. [2025-10-24T00:57:33.720399] [DEBUG] [LOCAL ] VNT: Loaded 44209 existing records from primary storage. [2025-10-24T00:57:33.741456] [INFO ] [MAIN ] VNT: Loaded 44209 primary data records. [2025-10-24T00:57:34.039808] [DEBUG] [LOCAL ] VOYA: Loaded 42078 existing records from primary storage. [2025-10-24T00:57:34.051456] [INFO ] [MAIN ] VOYA: Loaded 42078 primary data records. [2025-10-24T00:57:34.592042] [DEBUG] [MAIN ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:34.623426] [DEBUG] [MAIN ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:34.664189] [DEBUG] [MAIN ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:34.705082] [INFO ] [MAIN ] VOC: Generated 139 derivative records from 9134 primary records. [2025-10-24T00:57:34.707951] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-24T00:57:34.708221] [FATAL] [LOCAL ] VOC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:34.709293] [FATAL] [MAIN ] VOC: Failed to save derivative data. [2025-10-24T00:57:34.712913] [INFO ] [MAIN ] Derivative Progress: 2044/2164 symbols completed. VOC took 1.1s. Estimated remaining: 48.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:34.716998] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:34.718098] [INFO ] [MAIN ] VNT: Generated 139 derivative records from 44209 primary records. [2025-10-24T00:57:34.718371] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-24T00:57:34.718602] [FATAL] [LOCAL ] VNT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:34.719772] [FATAL] [MAIN ] VNT: Failed to save derivative data. [2025-10-24T00:57:34.722547] [INFO ] [MAIN ] Derivative Progress: 2045/2164 symbols completed. VNT took 1.2s. Estimated remaining: 47.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:34.725962] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:34.729347] [INFO ] [MAIN ] VOYA: Generated 139 derivative records from 42078 primary records. [2025-10-24T00:57:34.729635] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-24T00:57:34.729900] [FATAL] [LOCAL ] VOYA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:34.729974] [FATAL] [MAIN ] VOYA: Failed to save derivative data. [2025-10-24T00:57:34.732470] [INFO ] [MAIN ] Derivative Progress: 2046/2164 symbols completed. VOYA took 1.1s. Estimated remaining: 47.3s. Rate: 149.8 symbols/min [2025-10-24T00:57:34.732741] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:34.742486] [DEBUG] [LOCAL ] VPV: Loaded 5234 existing records from primary storage. [2025-10-24T00:57:34.742674] [INFO ] [MAIN ] VPV: Loaded 5234 primary data records. [2025-10-24T00:57:34.803862] [DEBUG] [LOCAL ] VPG: Loaded 16985 existing records from primary storage. [2025-10-24T00:57:34.847820] [INFO ] [MAIN ] VPG: Loaded 16985 primary data records. [2025-10-24T00:57:35.194915] [DEBUG] [LOCAL ] VRE: Loaded 35499 existing records from primary storage. [2025-10-24T00:57:35.250757] [INFO ] [MAIN ] VRE: Loaded 35499 primary data records. [2025-10-24T00:57:35.721699] [DEBUG] [MAIN ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:35.722407] [DEBUG] [MAIN ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:35.787249] [DEBUG] [MAIN ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:35.840725] [INFO ] [MAIN ] VPG: Generated 139 derivative records from 16985 primary records. [2025-10-24T00:57:35.841194] [INFO ] [MAIN ] VPV: Generated 139 derivative records from 5234 primary records. [2025-10-24T00:57:35.841615] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-24T00:57:35.843685] [FATAL] [LOCAL ] VPG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:35.843075] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-24T00:57:35.843800] [FATAL] [MAIN ] VPG: Failed to save derivative data. [2025-10-24T00:57:35.846506] [INFO ] [MAIN ] Derivative Progress: 2047/2164 symbols completed. VPG took 1.1s. Estimated remaining: 46.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:35.846951] [FATAL] [LOCAL ] VPV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:35.849757] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:35.850786] [FATAL] [MAIN ] VPV: Failed to save derivative data. [2025-10-24T00:57:35.853082] [INFO ] [MAIN ] Derivative Progress: 2048/2164 symbols completed. VPV took 1.1s. Estimated remaining: 46.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:35.853874] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:35.861777] [INFO ] [MAIN ] VRE: Generated 139 derivative records from 35499 primary records. [2025-10-24T00:57:35.862018] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-24T00:57:35.862324] [FATAL] [LOCAL ] VRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:35.862584] [FATAL] [MAIN ] VRE: Failed to save derivative data. [2025-10-24T00:57:35.869839] [INFO ] [MAIN ] Derivative Progress: 2049/2164 symbols completed. VRE took 1.1s. Estimated remaining: 46.1s. Rate: 149.8 symbols/min [2025-10-24T00:57:35.870242] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:35.876804] [DEBUG] [LOCAL ] VRTS: Loaded 9434 existing records from primary storage. [2025-10-24T00:57:35.877017] [INFO ] [MAIN ] VRTS: Loaded 9434 primary data records. [2025-10-24T00:57:36.222695] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-24T00:57:36.223899] [INFO ] [MAIN ] VRT: Loaded 54143 primary data records. [2025-10-24T00:57:36.344817] [DEBUG] [LOCAL ] VSCO: Loaded 53067 existing records from primary storage. [2025-10-24T00:57:36.371576] [INFO ] [MAIN ] VSCO: Loaded 53067 primary data records. [2025-10-24T00:57:36.796531] [DEBUG] [MAIN ] VRTS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:57:36.959429] [DEBUG] [MAIN ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:36.985132] [INFO ] [MAIN ] VRTS: Generated 139 derivative records from 9434 primary records. [2025-10-24T00:57:36.987892] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-24T00:57:36.996064] [FATAL] [LOCAL ] VRTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:36.996229] [FATAL] [MAIN ] VRTS: Failed to save derivative data. [2025-10-24T00:57:37.002841] [INFO ] [MAIN ] Derivative Progress: 2050/2164 symbols completed. VRTS took 1.1s. Estimated remaining: 45.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:37.003104] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:37.006177] [DEBUG] [MAIN ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:37.056295] [INFO ] [MAIN ] VRT: Generated 139 derivative records from 54143 primary records. [2025-10-24T00:57:37.069628] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-24T00:57:37.073531] [FATAL] [LOCAL ] VRT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:37.073781] [FATAL] [MAIN ] VRT: Failed to save derivative data. [2025-10-24T00:57:37.077297] [INFO ] [MAIN ] Derivative Progress: 2051/2164 symbols completed. VRT took 1.2s. Estimated remaining: 45.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:37.080413] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:37.080696] [INFO ] [MAIN ] VSCO: Generated 139 derivative records from 53067 primary records. [2025-10-24T00:57:37.081372] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-24T00:57:37.081781] [FATAL] [LOCAL ] VSCO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:37.081956] [FATAL] [MAIN ] VSCO: Failed to save derivative data. [2025-10-24T00:57:37.085573] [INFO ] [MAIN ] Derivative Progress: 2052/2164 symbols completed. VSCO took 1.2s. Estimated remaining: 44.9s. Rate: 149.8 symbols/min [2025-10-24T00:57:37.086092] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:37.104396] [DEBUG] [LOCAL ] VSH: Loaded 48614 existing records from primary storage. [2025-10-24T00:57:37.104943] [INFO ] [MAIN ] VSH: Loaded 48614 primary data records. [2025-10-24T00:57:37.453879] [DEBUG] [LOCAL ] VST: Loaded 54099 existing records from primary storage. [2025-10-24T00:57:37.454765] [INFO ] [MAIN ] VST: Loaded 54099 primary data records. [2025-10-24T00:57:37.571306] [DEBUG] [LOCAL ] VSTS: Loaded 49200 existing records from primary storage. [2025-10-24T00:57:37.582261] [INFO ] [MAIN ] VSTS: Loaded 49200 primary data records. [2025-10-24T00:57:38.098556] [DEBUG] [MAIN ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:38.138032] [DEBUG] [MAIN ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:38.186928] [DEBUG] [MAIN ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:38.206079] [INFO ] [MAIN ] VSH: Generated 139 derivative records from 48614 primary records. [2025-10-24T00:57:38.207095] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-24T00:57:38.210163] [FATAL] [LOCAL ] VSH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:38.213027] [FATAL] [MAIN ] VSH: Failed to save derivative data. [2025-10-24T00:57:38.216049] [INFO ] [MAIN ] Derivative Progress: 2053/2164 symbols completed. VSH took 1.2s. Estimated remaining: 44.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:38.229433] [INFO ] [MAIN ] VST: Generated 139 derivative records from 54099 primary records. [2025-10-24T00:57:38.229675] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-24T00:57:38.229910] [FATAL] [LOCAL ] VST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:38.232208] [FATAL] [MAIN ] VST: Failed to save derivative data. [2025-10-24T00:57:38.235098] [INFO ] [MAIN ] Derivative Progress: 2054/2164 symbols completed. VST took 1.2s. Estimated remaining: 44.1s. Rate: 149.8 symbols/min [2025-10-24T00:57:38.240630] [INFO ] [MAIN ] VSTS: Generated 139 derivative records from 49200 primary records. [2025-10-24T00:57:38.240755] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-24T00:57:38.241007] [FATAL] [LOCAL ] VSTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:38.241096] [FATAL] [MAIN ] VSTS: Failed to save derivative data. [2025-10-24T00:57:38.243609] [INFO ] [MAIN ] Derivative Progress: 2055/2164 symbols completed. VSTS took 1.2s. Estimated remaining: 43.7s. Rate: 149.8 symbols/min [2025-10-24T00:57:38.244078] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:38.244000] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:38.244788] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:38.263276] [DEBUG] [LOCAL ] VTMX: Loaded 17668 existing records from primary storage. [2025-10-24T00:57:38.263472] [INFO ] [MAIN ] VTMX: Loaded 17668 primary data records. [2025-10-24T00:57:38.448066] [DEBUG] [LOCAL ] VTEX: Loaded 43140 existing records from primary storage. [2025-10-24T00:57:38.474173] [INFO ] [MAIN ] VTEX: Loaded 43140 primary data records. [2025-10-24T00:57:38.665092] [DEBUG] [LOCAL ] VTLE: Loaded 47877 existing records from primary storage. [2025-10-24T00:57:38.683453] [INFO ] [MAIN ] VTLE: Loaded 47877 primary data records. [2025-10-24T00:57:39.305694] [DEBUG] [MAIN ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:39.345361] [DEBUG] [MAIN ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:39.382671] [DEBUG] [MAIN ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:39.438129] [INFO ] [MAIN ] VTMX: Generated 139 derivative records from 17668 primary records. [2025-10-24T00:57:39.442044] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-24T00:57:39.445898] [FATAL] [LOCAL ] VTMX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:39.446842] [FATAL] [MAIN ] VTMX: Failed to save derivative data. [2025-10-24T00:57:39.452766] [INFO ] [MAIN ] Derivative Progress: 2056/2164 symbols completed. VTMX took 1.2s. Estimated remaining: 43.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:39.458973] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:39.463273] [INFO ] [MAIN ] VTEX: Generated 139 derivative records from 43140 primary records. [2025-10-24T00:57:39.465078] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-24T00:57:39.465480] [FATAL] [LOCAL ] VTEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:39.465772] [FATAL] [MAIN ] VTEX: Failed to save derivative data. [2025-10-24T00:57:39.468198] [INFO ] [MAIN ] Derivative Progress: 2057/2164 symbols completed. VTEX took 1.2s. Estimated remaining: 42.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:39.472686] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:39.473696] [INFO ] [MAIN ] VTLE: Generated 139 derivative records from 47877 primary records. [2025-10-24T00:57:39.474082] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-24T00:57:39.474345] [FATAL] [LOCAL ] VTLE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:39.474560] [FATAL] [MAIN ] VTLE: Failed to save derivative data. [2025-10-24T00:57:39.478298] [INFO ] [MAIN ] Derivative Progress: 2058/2164 symbols completed. VTLE took 1.2s. Estimated remaining: 42.5s. Rate: 149.8 symbols/min [2025-10-24T00:57:39.482865] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:39.483088] [DEBUG] [LOCAL ] VTN: Loaded 7335 existing records from primary storage. [2025-10-24T00:57:39.483988] [INFO ] [MAIN ] VTN: Loaded 7335 primary data records. [2025-10-24T00:57:39.591695] [DEBUG] [LOCAL ] VTOL: Loaded 19509 existing records from primary storage. [2025-10-24T00:57:39.603824] [INFO ] [MAIN ] VTOL: Loaded 19509 primary data records. [2025-10-24T00:57:40.109241] [DEBUG] [LOCAL ] VTR: Loaded 53049 existing records from primary storage. [2025-10-24T00:57:40.119233] [INFO ] [MAIN ] VTR: Loaded 53049 primary data records. [2025-10-24T00:57:40.479207] [DEBUG] [MAIN ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:40.510247] [DEBUG] [MAIN ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:40.561470] [DEBUG] [MAIN ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:40.597492] [INFO ] [MAIN ] VTN: Generated 139 derivative records from 7335 primary records. [2025-10-24T00:57:40.598298] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-24T00:57:40.598591] [FATAL] [LOCAL ] VTN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:40.601866] [FATAL] [MAIN ] VTN: Failed to save derivative data. [2025-10-24T00:57:40.604277] [INFO ] [MAIN ] Derivative Progress: 2059/2164 symbols completed. VTN took 1.1s. Estimated remaining: 42.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:40.600742] [INFO ] [MAIN ] VTOL: Generated 139 derivative records from 19509 primary records. [2025-10-24T00:57:40.604740] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:40.607543] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-24T00:57:40.608238] [FATAL] [LOCAL ] VTOL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:40.608631] [FATAL] [MAIN ] VTOL: Failed to save derivative data. [2025-10-24T00:57:40.611454] [INFO ] [MAIN ] Derivative Progress: 2060/2164 symbols completed. VTOL took 1.1s. Estimated remaining: 41.7s. Rate: 149.8 symbols/min [2025-10-24T00:57:40.613322] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:40.623191] [INFO ] [MAIN ] VTR: Generated 139 derivative records from 53049 primary records. [2025-10-24T00:57:40.623348] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-24T00:57:40.623547] [FATAL] [LOCAL ] VTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:40.623637] [FATAL] [MAIN ] VTR: Failed to save derivative data. [2025-10-24T00:57:40.625788] [INFO ] [MAIN ] Derivative Progress: 2061/2164 symbols completed. VTR took 1.1s. Estimated remaining: 41.2s. Rate: 149.8 symbols/min [2025-10-24T00:57:40.626055] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:40.664950] [DEBUG] [LOCAL ] VVR: Loaded 31357 existing records from primary storage. [2025-10-24T00:57:40.666014] [DEBUG] [LOCAL ] VTS: Loaded 30045 existing records from primary storage. [2025-10-24T00:57:40.666373] [INFO ] [MAIN ] VTS: Loaded 30045 primary data records. [2025-10-24T00:57:40.666461] [INFO ] [MAIN ] VVR: Loaded 31357 primary data records. [2025-10-24T00:57:41.050505] [DEBUG] [LOCAL ] VVV: Loaded 50497 existing records from primary storage. [2025-10-24T00:57:41.170563] [INFO ] [MAIN ] VVV: Loaded 50497 primary data records. [2025-10-24T00:57:41.635076] [DEBUG] [MAIN ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:41.659885] [DEBUG] [MAIN ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:41.724067] [DEBUG] [MAIN ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:41.760858] [INFO ] [MAIN ] VTS: Generated 139 derivative records from 30045 primary records. [2025-10-24T00:57:41.765429] [INFO ] [MAIN ] VVR: Generated 139 derivative records from 31357 primary records. [2025-10-24T00:57:41.765824] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-24T00:57:41.766433] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-24T00:57:41.769078] [FATAL] [LOCAL ] VVR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:41.773290] [FATAL] [MAIN ] VVR: Failed to save derivative data. [2025-10-24T00:57:41.775836] [INFO ] [MAIN ] Derivative Progress: 2062/2164 symbols completed. VVR took 1.2s. Estimated remaining: 40.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:41.769544] [FATAL] [LOCAL ] VTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:41.776503] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:41.776342] [FATAL] [MAIN ] VTS: Failed to save derivative data. [2025-10-24T00:57:41.781040] [INFO ] [MAIN ] Derivative Progress: 2063/2164 symbols completed. VTS took 1.2s. Estimated remaining: 40.5s. Rate: 149.8 symbols/min [2025-10-24T00:57:41.782998] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:41.791201] [INFO ] [MAIN ] VVV: Generated 139 derivative records from 50497 primary records. [2025-10-24T00:57:41.791306] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-24T00:57:41.791519] [FATAL] [LOCAL ] VVV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:41.791700] [FATAL] [MAIN ] VVV: Failed to save derivative data. [2025-10-24T00:57:41.794244] [INFO ] [MAIN ] Derivative Progress: 2064/2164 symbols completed. VVV took 1.2s. Estimated remaining: 40.0s. Rate: 149.8 symbols/min [2025-10-24T00:57:41.800443] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:41.810955] [DEBUG] [LOCAL ] VVX: Loaded 23194 existing records from primary storage. [2025-10-24T00:57:41.811114] [INFO ] [MAIN ] VVX: Loaded 23194 primary data records. [2025-10-24T00:57:42.139056] [DEBUG] [LOCAL ] VYX: Loaded 48651 existing records from primary storage. [2025-10-24T00:57:42.139464] [INFO ] [MAIN ] VYX: Loaded 48651 primary data records. [2025-10-24T00:57:42.268289] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-24T00:57:42.482151] [INFO ] [MAIN ] VZ: Loaded 54181 primary data records. [2025-10-24T00:57:42.805846] [DEBUG] [MAIN ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:42.869320] [DEBUG] [MAIN ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:42.907766] [INFO ] [MAIN ] VVX: Generated 139 derivative records from 23194 primary records. [2025-10-24T00:57:42.916178] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-24T00:57:42.916497] [FATAL] [LOCAL ] VVX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:42.924480] [FATAL] [MAIN ] VVX: Failed to save derivative data. [2025-10-24T00:57:42.921917] [DEBUG] [MAIN ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:42.927417] [INFO ] [MAIN ] Derivative Progress: 2065/2164 symbols completed. VVX took 1.2s. Estimated remaining: 39.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:42.928570] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:42.952571] [INFO ] [MAIN ] VYX: Generated 139 derivative records from 48651 primary records. [2025-10-24T00:57:42.954117] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-24T00:57:42.954445] [FATAL] [LOCAL ] VYX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:42.954556] [FATAL] [MAIN ] VYX: Failed to save derivative data. [2025-10-24T00:57:42.957158] [INFO ] [MAIN ] Derivative Progress: 2066/2164 symbols completed. VYX took 1.2s. Estimated remaining: 39.3s. Rate: 149.8 symbols/min [2025-10-24T00:57:42.957598] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:42.985729] [INFO ] [MAIN ] VZ: Generated 139 derivative records from 54181 primary records. [2025-10-24T00:57:42.985849] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-24T00:57:42.986025] [FATAL] [LOCAL ] VZ: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:42.986101] [FATAL] [MAIN ] VZ: Failed to save derivative data. [2025-10-24T00:57:42.988490] [INFO ] [MAIN ] Derivative Progress: 2067/2164 symbols completed. VZ took 1.2s. Estimated remaining: 38.8s. Rate: 149.8 symbols/min [2025-10-24T00:57:42.988693] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:43.009739] [DEBUG] [LOCAL ] W: Loaded 53793 existing records from primary storage. [2025-10-24T00:57:43.010195] [INFO ] [MAIN ] W: Loaded 53793 primary data records. [2025-10-24T00:57:43.351218] [DEBUG] [LOCAL ] WAB: Loaded 44111 existing records from primary storage. [2025-10-24T00:57:43.353060] [INFO ] [MAIN ] WAB: Loaded 44111 primary data records. [2025-10-24T00:57:43.374465] [DEBUG] [LOCAL ] WAL: Loaded 46034 existing records from primary storage. [2025-10-24T00:57:43.417808] [INFO ] [MAIN ] WAL: Loaded 46034 primary data records. [2025-10-24T00:57:43.959345] [DEBUG] [MAIN ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:44.021123] [DEBUG] [MAIN ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:44.020270] [DEBUG] [MAIN ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:44.076255] [INFO ] [MAIN ] W: Generated 139 derivative records from 53793 primary records. [2025-10-24T00:57:44.080590] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-24T00:57:44.084013] [FATAL] [LOCAL ] W: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:44.085337] [FATAL] [MAIN ] W: Failed to save derivative data. [2025-10-24T00:57:44.088307] [INFO ] [MAIN ] Derivative Progress: 2068/2164 symbols completed. W took 1.2s. Estimated remaining: 38.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:44.098592] [INFO ] [MAIN ] WAL: Generated 139 derivative records from 46034 primary records. [2025-10-24T00:57:44.101102] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-24T00:57:44.101444] [FATAL] [LOCAL ] WAL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:44.101840] [FATAL] [MAIN ] WAL: Failed to save derivative data. [2025-10-24T00:57:44.106576] [INFO ] [MAIN ] Derivative Progress: 2069/2164 symbols completed. WAL took 1.1s. Estimated remaining: 38.1s. Rate: 149.8 symbols/min [2025-10-24T00:57:44.109133] [INFO ] [MAIN ] WAB: Generated 139 derivative records from 44111 primary records. [2025-10-24T00:57:44.109231] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-24T00:57:44.109429] [FATAL] [LOCAL ] WAB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:44.109504] [FATAL] [MAIN ] WAB: Failed to save derivative data. [2025-10-24T00:57:44.111714] [INFO ] [MAIN ] Derivative Progress: 2070/2164 symbols completed. WAB took 1.2s. Estimated remaining: 37.6s. Rate: 149.8 symbols/min [2025-10-24T00:57:44.112106] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:44.112226] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:44.112334] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:44.125359] [DEBUG] [LOCAL ] WBX: Loaded 9989 existing records from primary storage. [2025-10-24T00:57:44.125571] [INFO ] [MAIN ] WBX: Loaded 9989 primary data records. [2025-10-24T00:57:44.318385] [DEBUG] [LOCAL ] WAT: Loaded 35962 existing records from primary storage. [2025-10-24T00:57:44.480695] [INFO ] [MAIN ] WAT: Loaded 35962 primary data records. [2025-10-24T00:57:44.567266] [DEBUG] [LOCAL ] WBS: Loaded 49206 existing records from primary storage. [2025-10-24T00:57:44.582883] [INFO ] [MAIN ] WBS: Loaded 49206 primary data records. [2025-10-24T00:57:45.130226] [DEBUG] [MAIN ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:45.179513] [DEBUG] [MAIN ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:45.216347] [DEBUG] [MAIN ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:45.260193] [INFO ] [MAIN ] WBX: Generated 139 derivative records from 9989 primary records. [2025-10-24T00:57:45.261310] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-24T00:57:45.261996] [FATAL] [LOCAL ] WBX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:45.262195] [FATAL] [MAIN ] WBX: Failed to save derivative data. [2025-10-24T00:57:45.266211] [INFO ] [MAIN ] Derivative Progress: 2071/2164 symbols completed. WBX took 1.2s. Estimated remaining: 37.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:45.267778] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:45.289815] [INFO ] [MAIN ] WBS: Generated 139 derivative records from 49206 primary records. [2025-10-24T00:57:45.290075] [INFO ] [MAIN ] WAT: Generated 139 derivative records from 35962 primary records. [2025-10-24T00:57:45.290208] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-24T00:57:45.290514] [FATAL] [LOCAL ] WBS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:45.290869] [FATAL] [MAIN ] WBS: Failed to save derivative data. [2025-10-24T00:57:45.293444] [INFO ] [MAIN ] Derivative Progress: 2072/2164 symbols completed. WBS took 1.2s. Estimated remaining: 36.9s. Rate: 149.8 symbols/min [2025-10-24T00:57:45.290630] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-24T00:57:45.293804] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:45.294481] [FATAL] [LOCAL ] WAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:45.295042] [FATAL] [MAIN ] WAT: Failed to save derivative data. [2025-10-24T00:57:45.298343] [INFO ] [MAIN ] Derivative Progress: 2073/2164 symbols completed. WAT took 1.2s. Estimated remaining: 36.4s. Rate: 149.9 symbols/min [2025-10-24T00:57:45.298588] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:45.331605] [DEBUG] [LOCAL ] WCC: Loaded 38640 existing records from primary storage. [2025-10-24T00:57:45.331874] [INFO ] [MAIN ] WCC: Loaded 38640 primary data records. [2025-10-24T00:57:45.462137] [DEBUG] [LOCAL ] WD: Loaded 22618 existing records from primary storage. [2025-10-24T00:57:45.473272] [INFO ] [MAIN ] WD: Loaded 22618 primary data records. [2025-10-24T00:57:45.750883] [DEBUG] [LOCAL ] WCN: Loaded 48248 existing records from primary storage. [2025-10-24T00:57:45.785738] [INFO ] [MAIN ] WCN: Loaded 48248 primary data records. [2025-10-24T00:57:46.322822] [DEBUG] [MAIN ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:46.357758] [DEBUG] [MAIN ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:46.404711] [DEBUG] [MAIN ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:46.465230] [INFO ] [MAIN ] WCC: Generated 139 derivative records from 38640 primary records. [2025-10-24T00:57:46.468600] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-24T00:57:46.471571] [FATAL] [LOCAL ] WCC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:46.474773] [FATAL] [MAIN ] WCC: Failed to save derivative data. [2025-10-24T00:57:46.477406] [INFO ] [MAIN ] Derivative Progress: 2074/2164 symbols completed. WCC took 1.2s. Estimated remaining: 36.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:46.478862] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:46.481079] [INFO ] [MAIN ] WD: Generated 139 derivative records from 22618 primary records. [2025-10-24T00:57:46.485223] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-24T00:57:46.485793] [FATAL] [LOCAL ] WD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:46.486112] [FATAL] [MAIN ] WD: Failed to save derivative data. [2025-10-24T00:57:46.491623] [INFO ] [MAIN ] Derivative Progress: 2075/2164 symbols completed. WD took 1.2s. Estimated remaining: 35.7s. Rate: 149.8 symbols/min [2025-10-24T00:57:46.491916] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:46.493054] [INFO ] [MAIN ] WCN: Generated 139 derivative records from 48248 primary records. [2025-10-24T00:57:46.493859] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-24T00:57:46.494120] [FATAL] [LOCAL ] WCN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:46.494201] [FATAL] [MAIN ] WCN: Failed to save derivative data. [2025-10-24T00:57:46.498212] [INFO ] [MAIN ] Derivative Progress: 2076/2164 symbols completed. WCN took 1.2s. Estimated remaining: 35.2s. Rate: 149.9 symbols/min [2025-10-24T00:57:46.503730] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:46.514092] [DEBUG] [LOCAL ] WDH: Loaded 18142 existing records from primary storage. [2025-10-24T00:57:46.514313] [INFO ] [MAIN ] WDH: Loaded 18142 primary data records. [2025-10-24T00:57:46.690892] [DEBUG] [LOCAL ] WDI: Loaded 21400 existing records from primary storage. [2025-10-24T00:57:46.701547] [INFO ] [MAIN ] WDI: Loaded 21400 primary data records. [2025-10-24T00:57:46.888846] [DEBUG] [LOCAL ] WDS: Loaded 43353 existing records from primary storage. [2025-10-24T00:57:47.006483] [INFO ] [MAIN ] WDS: Loaded 43353 primary data records. [2025-10-24T00:57:47.553887] [DEBUG] [MAIN ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:47.587390] [DEBUG] [MAIN ] WDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:47.635820] [DEBUG] [MAIN ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:47.676333] [INFO ] [MAIN ] WDH: Generated 139 derivative records from 18142 primary records. [2025-10-24T00:57:47.682212] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-24T00:57:47.682957] [FATAL] [LOCAL ] WDH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:47.683169] [FATAL] [MAIN ] WDH: Failed to save derivative data. [2025-10-24T00:57:47.686580] [INFO ] [MAIN ] Derivative Progress: 2077/2164 symbols completed. WDH took 1.2s. Estimated remaining: 34.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:47.688096] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:47.691851] [INFO ] [MAIN ] WDI: Generated 139 derivative records from 21400 primary records. [2025-10-24T00:57:47.693740] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-24T00:57:47.694051] [FATAL] [LOCAL ] WDI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:47.699697] [FATAL] [MAIN ] WDI: Failed to save derivative data. [2025-10-24T00:57:47.703099] [INFO ] [MAIN ] Derivative Progress: 2078/2164 symbols completed. WDI took 1.2s. Estimated remaining: 34.5s. Rate: 149.8 symbols/min [2025-10-24T00:57:47.706228] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:47.714895] [DEBUG] [LOCAL ] WEA: Loaded 7912 existing records from primary storage. [2025-10-24T00:57:47.715098] [INFO ] [MAIN ] WEA: Loaded 7912 primary data records. [2025-10-24T00:57:47.893923] [INFO ] [MAIN ] WDS: Generated 139 derivative records from 43353 primary records. [2025-10-24T00:57:47.914589] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-24T00:57:48.041523] [FATAL] [LOCAL ] WDS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:48.042255] [DEBUG] [LOCAL ] WEAV: Loaded 42662 existing records from primary storage. [2025-10-24T00:57:48.042598] [FATAL] [MAIN ] WDS: Failed to save derivative data. [2025-10-24T00:57:48.043473] [INFO ] [MAIN ] WEAV: Loaded 42662 primary data records. [2025-10-24T00:57:48.049158] [INFO ] [MAIN ] Derivative Progress: 2079/2164 symbols completed. WDS took 1.5s. Estimated remaining: 34.0s. Rate: 149.8 symbols/min [2025-10-24T00:57:48.070249] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:48.386581] [DEBUG] [MAIN ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:48.424134] [DEBUG] [LOCAL ] WEC: Loaded 52524 existing records from primary storage. [2025-10-24T00:57:48.426548] [INFO ] [MAIN ] WEC: Loaded 52524 primary data records. [2025-10-24T00:57:48.567024] [DEBUG] [MAIN ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:48.836422] [INFO ] [MAIN ] WEA: Generated 139 derivative records from 7912 primary records. [2025-10-24T00:57:48.845329] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-24T00:57:48.845729] [FATAL] [LOCAL ] WEA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:48.845863] [FATAL] [MAIN ] WEA: Failed to save derivative data. [2025-10-24T00:57:48.850979] [INFO ] [MAIN ] Derivative Progress: 2080/2164 symbols completed. WEA took 1.2s. Estimated remaining: 33.7s. Rate: 149.7 symbols/min [2025-10-24T00:57:48.852257] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:48.874162] [INFO ] [MAIN ] WEAV: Generated 139 derivative records from 42662 primary records. [2025-10-24T00:57:48.874784] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-24T00:57:48.875160] [FATAL] [LOCAL ] WEAV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:48.875307] [FATAL] [MAIN ] WEAV: Failed to save derivative data. [2025-10-24T00:57:48.879304] [INFO ] [MAIN ] Derivative Progress: 2081/2164 symbols completed. WEAV took 1.2s. Estimated remaining: 33.2s. Rate: 149.8 symbols/min [2025-10-24T00:57:48.893756] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:48.894527] [DEBUG] [MAIN ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:48.939900] [INFO ] [MAIN ] WEC: Generated 139 derivative records from 52524 primary records. [2025-10-24T00:57:48.940072] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-24T00:57:48.940254] [FATAL] [LOCAL ] WEC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:48.940328] [FATAL] [MAIN ] WEC: Failed to save derivative data. [2025-10-24T00:57:48.942808] [INFO ] [MAIN ] Derivative Progress: 2082/2164 symbols completed. WEC took 0.9s. Estimated remaining: 32.8s. Rate: 149.8 symbols/min [2025-10-24T00:57:48.943802] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:48.960551] [DEBUG] [LOCAL ] WELL: Loaded 52666 existing records from primary storage. [2025-10-24T00:57:48.961018] [INFO ] [MAIN ] WELL: Loaded 52666 primary data records. [2025-10-24T00:57:49.093076] [DEBUG] [LOCAL ] WES: Loaded 49086 existing records from primary storage. [2025-10-24T00:57:49.093445] [INFO ] [MAIN ] WES: Loaded 49086 primary data records. [2025-10-24T00:57:49.385609] [DEBUG] [LOCAL ] WEX: Loaded 32584 existing records from primary storage. [2025-10-24T00:57:49.408704] [INFO ] [MAIN ] WEX: Loaded 32584 primary data records. [2025-10-24T00:57:49.940008] [DEBUG] [MAIN ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:49.980722] [DEBUG] [MAIN ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:50.012910] [DEBUG] [MAIN ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:50.046468] [INFO ] [MAIN ] WELL: Generated 139 derivative records from 52666 primary records. [2025-10-24T00:57:50.047895] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-24T00:57:50.051275] [FATAL] [LOCAL ] WELL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:50.052337] [FATAL] [MAIN ] WELL: Failed to save derivative data. [2025-10-24T00:57:50.060907] [INFO ] [MAIN ] Derivative Progress: 2083/2164 symbols completed. WELL took 1.2s. Estimated remaining: 32.5s. Rate: 149.7 symbols/min [2025-10-24T00:57:50.074083] [INFO ] [MAIN ] WES: Generated 139 derivative records from 49086 primary records. [2025-10-24T00:57:50.075433] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-24T00:57:50.075780] [FATAL] [LOCAL ] WES: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:50.077972] [FATAL] [MAIN ] WES: Failed to save derivative data. [2025-10-24T00:57:50.080606] [INFO ] [MAIN ] Derivative Progress: 2084/2164 symbols completed. WES took 1.2s. Estimated remaining: 32.0s. Rate: 149.8 symbols/min [2025-10-24T00:57:50.080952] [INFO ] [MAIN ] WEX: Generated 139 derivative records from 32584 primary records. [2025-10-24T00:57:50.081320] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-24T00:57:50.081546] [FATAL] [LOCAL ] WEX: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:50.081627] [FATAL] [MAIN ] WEX: Failed to save derivative data. [2025-10-24T00:57:50.084250] [INFO ] [MAIN ] Derivative Progress: 2085/2164 symbols completed. WEX took 1.1s. Estimated remaining: 31.6s. Rate: 149.9 symbols/min [2025-10-24T00:57:50.084685] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:50.084831] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:50.084916] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:50.100379] [DEBUG] [LOCAL ] WF: Loaded 10779 existing records from primary storage. [2025-10-24T00:57:50.100626] [INFO ] [MAIN ] WF: Loaded 10779 primary data records. [2025-10-24T00:57:50.232034] [DEBUG] [LOCAL ] WFG: Loaded 24704 existing records from primary storage. [2025-10-24T00:57:50.237781] [INFO ] [MAIN ] WFG: Loaded 24704 primary data records. [2025-10-24T00:57:50.620468] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-24T00:57:50.646688] [INFO ] [MAIN ] WFC: Loaded 54138 primary data records. [2025-10-24T00:57:51.152896] [DEBUG] [MAIN ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:51.185259] [DEBUG] [MAIN ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:51.222818] [DEBUG] [MAIN ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:51.269591] [INFO ] [MAIN ] WF: Generated 139 derivative records from 10779 primary records. [2025-10-24T00:57:51.269977] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-24T00:57:51.272794] [FATAL] [LOCAL ] WF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:51.273397] [FATAL] [MAIN ] WF: Failed to save derivative data. [2025-10-24T00:57:51.279199] [INFO ] [MAIN ] Derivative Progress: 2086/2164 symbols completed. WF took 1.2s. Estimated remaining: 31.3s. Rate: 149.7 symbols/min [2025-10-24T00:57:51.279739] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:51.286939] [INFO ] [MAIN ] WFG: Generated 139 derivative records from 24704 primary records. [2025-10-24T00:57:51.288621] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-24T00:57:51.289025] [FATAL] [LOCAL ] WFG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:51.289181] [FATAL] [MAIN ] WFG: Failed to save derivative data. [2025-10-24T00:57:51.291033] [INFO ] [MAIN ] WFC: Generated 139 derivative records from 54138 primary records. [2025-10-24T00:57:51.291196] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-24T00:57:51.293631] [INFO ] [MAIN ] Derivative Progress: 2087/2164 symbols completed. WFG took 1.2s. Estimated remaining: 30.8s. Rate: 149.8 symbols/min [2025-10-24T00:57:51.294020] [FATAL] [LOCAL ] WFC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:51.294231] [FATAL] [MAIN ] WFC: Failed to save derivative data. [2025-10-24T00:57:51.297056] [INFO ] [MAIN ] Derivative Progress: 2088/2164 symbols completed. WFC took 1.2s. Estimated remaining: 30.4s. Rate: 149.9 symbols/min [2025-10-24T00:57:51.297364] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:51.296974] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:51.330963] [DEBUG] [LOCAL ] WGO: Loaded 38321 existing records from primary storage. [2025-10-24T00:57:51.331172] [INFO ] [MAIN ] WGO: Loaded 38321 primary data records. [2025-10-24T00:57:51.555329] [DEBUG] [LOCAL ] WH: Loaded 45647 existing records from primary storage. [2025-10-24T00:57:51.664991] [DEBUG] [LOCAL ] WHD: Loaded 40265 existing records from primary storage. [2025-10-24T00:57:51.679467] [INFO ] [MAIN ] WHD: Loaded 40265 primary data records. [2025-10-24T00:57:51.670410] [INFO ] [MAIN ] WH: Loaded 45647 primary data records. [2025-10-24T00:57:52.314356] [DEBUG] [MAIN ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:52.368983] [DEBUG] [MAIN ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:52.372076] [DEBUG] [MAIN ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:52.434568] [INFO ] [MAIN ] WGO: Generated 139 derivative records from 38321 primary records. [2025-10-24T00:57:52.435355] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-24T00:57:52.435726] [FATAL] [LOCAL ] WGO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:52.435835] [FATAL] [MAIN ] WGO: Failed to save derivative data. [2025-10-24T00:57:52.438182] [INFO ] [MAIN ] Derivative Progress: 2089/2164 symbols completed. WGO took 1.2s. Estimated remaining: 30.1s. Rate: 149.7 symbols/min [2025-10-24T00:57:52.442119] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:52.456176] [DEBUG] [LOCAL ] WHG: Loaded 3056 existing records from primary storage. [2025-10-24T00:57:52.458216] [INFO ] [MAIN ] WHG: Loaded 3056 primary data records. [2025-10-24T00:57:52.482237] [INFO ] [MAIN ] WHD: Generated 139 derivative records from 40265 primary records. [2025-10-24T00:57:52.506421] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-24T00:57:52.527770] [FATAL] [LOCAL ] WHD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:52.539869] [FATAL] [MAIN ] WHD: Failed to save derivative data. [2025-10-24T00:57:52.554955] [INFO ] [MAIN ] Derivative Progress: 2090/2164 symbols completed. WHD took 1.3s. Estimated remaining: 29.6s. Rate: 149.8 symbols/min [2025-10-24T00:57:52.552088] [INFO ] [MAIN ] WH: Generated 139 derivative records from 45647 primary records. [2025-10-24T00:57:52.560821] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-24T00:57:52.569174] [FATAL] [LOCAL ] WH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:52.573117] [FATAL] [MAIN ] WH: Failed to save derivative data. [2025-10-24T00:57:52.560957] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:52.581201] [INFO ] [MAIN ] Derivative Progress: 2091/2164 symbols completed. WH took 1.3s. Estimated remaining: 29.2s. Rate: 149.8 symbols/min [2025-10-24T00:57:52.597058] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:52.788557] [DEBUG] [LOCAL ] WIA: Loaded 5067 existing records from primary storage. [2025-10-24T00:57:52.802607] [INFO ] [MAIN ] WIA: Loaded 5067 primary data records. [2025-10-24T00:57:53.146683] [DEBUG] [LOCAL ] WHR: Loaded 49256 existing records from primary storage. [2025-10-24T00:57:53.161453] [INFO ] [MAIN ] WHR: Loaded 49256 primary data records. [2025-10-24T00:57:53.341159] [DEBUG] [MAIN ] WHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:53.537137] [DEBUG] [MAIN ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:53.605360] [DEBUG] [MAIN ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:53.608771] [INFO ] [MAIN ] WHG: Generated 139 derivative records from 3056 primary records. [2025-10-24T00:57:53.620172] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-24T00:57:53.620857] [FATAL] [LOCAL ] WHG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:53.622961] [FATAL] [MAIN ] WHG: Failed to save derivative data. [2025-10-24T00:57:53.628505] [INFO ] [MAIN ] Derivative Progress: 2092/2164 symbols completed. WHG took 1.2s. Estimated remaining: 28.9s. Rate: 149.7 symbols/min [2025-10-24T00:57:53.629348] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:53.661693] [DEBUG] [LOCAL ] WINN: Loaded 11255 existing records from primary storage. [2025-10-24T00:57:53.664716] [INFO ] [MAIN ] WINN: Loaded 11255 primary data records. [2025-10-24T00:57:53.662193] [INFO ] [MAIN ] WIA: Generated 139 derivative records from 5067 primary records. [2025-10-24T00:57:53.676745] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-24T00:57:53.714939] [FATAL] [LOCAL ] WIA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:53.737360] [FATAL] [MAIN ] WIA: Failed to save derivative data. [2025-10-24T00:57:53.772132] [INFO ] [MAIN ] Derivative Progress: 2093/2164 symbols completed. WIA took 1.2s. Estimated remaining: 28.4s. Rate: 149.8 symbols/min [2025-10-24T00:57:53.783102] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:53.845908] [INFO ] [MAIN ] WHR: Generated 139 derivative records from 49256 primary records. [2025-10-24T00:57:53.872551] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-24T00:57:53.996423] [FATAL] [LOCAL ] WHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:53.996595] [FATAL] [MAIN ] WHR: Failed to save derivative data. [2025-10-24T00:57:53.999561] [INFO ] [MAIN ] Derivative Progress: 2094/2164 symbols completed. WHR took 1.4s. Estimated remaining: 28.0s. Rate: 149.8 symbols/min [2025-10-24T00:57:53.999975] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:54.045623] [DEBUG] [LOCAL ] WIT: Loaded 52922 existing records from primary storage. [2025-10-24T00:57:54.046123] [INFO ] [MAIN ] WIT: Loaded 52922 primary data records. [2025-10-24T00:57:54.103278] [DEBUG] [MAIN ] WINN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:54.122477] [DEBUG] [LOCAL ] WIW: Loaded 20389 existing records from primary storage. [2025-10-24T00:57:54.178704] [INFO ] [MAIN ] WIW: Loaded 20389 primary data records. [2025-10-24T00:57:54.761213] [INFO ] [MAIN ] WINN: Generated 139 derivative records from 11255 primary records. [2025-10-24T00:57:54.761661] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-24T00:57:54.762763] [FATAL] [LOCAL ] WINN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:54.763157] [FATAL] [MAIN ] WINN: Failed to save derivative data. [2025-10-24T00:57:54.765931] [INFO ] [MAIN ] Derivative Progress: 2095/2164 symbols completed. WINN took 1.1s. Estimated remaining: 27.6s. Rate: 149.7 symbols/min [2025-10-24T00:57:54.766562] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:54.783611] [DEBUG] [MAIN ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:54.844827] [DEBUG] [LOCAL ] WK: Loaded 37264 existing records from primary storage. [2025-10-24T00:57:54.844253] [INFO ] [MAIN ] WIT: Generated 139 derivative records from 52922 primary records. [2025-10-24T00:57:54.857844] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-24T00:57:54.858162] [DEBUG] [MAIN ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:54.857559] [INFO ] [MAIN ] WK: Loaded 37264 primary data records. [2025-10-24T00:57:54.858515] [FATAL] [LOCAL ] WIT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:54.877425] [FATAL] [MAIN ] WIT: Failed to save derivative data. [2025-10-24T00:57:54.910673] [INFO ] [MAIN ] Derivative Progress: 2096/2164 symbols completed. WIT took 1.1s. Estimated remaining: 27.2s. Rate: 149.8 symbols/min [2025-10-24T00:57:54.923146] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:55.238206] [INFO ] [MAIN ] WIW: Generated 139 derivative records from 20389 primary records. [2025-10-24T00:57:55.248376] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-24T00:57:55.250560] [FATAL] [LOCAL ] WIW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:55.250707] [FATAL] [MAIN ] WIW: Failed to save derivative data. [2025-10-24T00:57:55.253819] [INFO ] [MAIN ] Derivative Progress: 2097/2164 symbols completed. WIW took 1.3s. Estimated remaining: 26.8s. Rate: 149.8 symbols/min [2025-10-24T00:57:55.248977] [DEBUG] [LOCAL ] WKC: Loaded 34728 existing records from primary storage. [2025-10-24T00:57:55.254030] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:55.254168] [INFO ] [MAIN ] WKC: Loaded 34728 primary data records. [2025-10-24T00:57:55.583010] [DEBUG] [MAIN ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:55.618625] [DEBUG] [LOCAL ] WLK: Loaded 46176 existing records from primary storage. [2025-10-24T00:57:55.619635] [INFO ] [MAIN ] WLK: Loaded 46176 primary data records. [2025-10-24T00:57:55.954538] [INFO ] [MAIN ] WK: Generated 139 derivative records from 37264 primary records. [2025-10-24T00:57:55.955701] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-24T00:57:55.956084] [FATAL] [LOCAL ] WK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:55.956255] [FATAL] [MAIN ] WK: Failed to save derivative data. [2025-10-24T00:57:55.972053] [INFO ] [MAIN ] Derivative Progress: 2098/2164 symbols completed. WK took 1.2s. Estimated remaining: 26.4s. Rate: 149.7 symbols/min [2025-10-24T00:57:55.973343] [DEBUG] [MAIN ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:56.012675] [INFO ] [MAIN ] WKC: Generated 139 derivative records from 34728 primary records. [2025-10-24T00:57:56.025166] [DEBUG] [MAIN ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:56.025256] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-24T00:57:56.025708] [FATAL] [LOCAL ] WKC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:56.037277] [FATAL] [MAIN ] WKC: Failed to save derivative data. [2025-10-24T00:57:56.041750] [INFO ] [MAIN ] Derivative Progress: 2099/2164 symbols completed. WKC took 1.1s. Estimated remaining: 26.0s. Rate: 149.8 symbols/min [2025-10-24T00:57:56.055291] [INFO ] [MAIN ] WLK: Generated 139 derivative records from 46176 primary records. [2025-10-24T00:57:56.055422] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-24T00:57:56.055621] [FATAL] [LOCAL ] WLK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:56.055720] [FATAL] [MAIN ] WLK: Failed to save derivative data. [2025-10-24T00:57:56.058075] [INFO ] [MAIN ] Derivative Progress: 2100/2164 symbols completed. WLK took 0.8s. Estimated remaining: 25.6s. Rate: 149.9 symbols/min [2025-10-24T00:57:56.058591] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:56.058513] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:56.058746] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:56.071632] [DEBUG] [LOCAL ] WLKP: Loaded 7323 existing records from primary storage. [2025-10-24T00:57:56.071905] [INFO ] [MAIN ] WLKP: Loaded 7323 primary data records. [2025-10-24T00:57:56.235245] [DEBUG] [LOCAL ] WLY: Loaded 29962 existing records from primary storage. [2025-10-24T00:57:56.286053] [INFO ] [MAIN ] WLY: Loaded 29962 primary data records. [2025-10-24T00:57:56.511319] [DEBUG] [LOCAL ] WM: Loaded 51209 existing records from primary storage. [2025-10-24T00:57:56.534998] [INFO ] [MAIN ] WM: Loaded 51209 primary data records. [2025-10-24T00:57:57.139337] [DEBUG] [MAIN ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:57.186017] [DEBUG] [MAIN ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:57.231492] [INFO ] [MAIN ] WLKP: Generated 139 derivative records from 7323 primary records. [2025-10-24T00:57:57.229252] [DEBUG] [MAIN ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:57.245898] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-24T00:57:57.248692] [FATAL] [LOCAL ] WLKP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:57.251603] [FATAL] [MAIN ] WLKP: Failed to save derivative data. [2025-10-24T00:57:57.254286] [INFO ] [MAIN ] Derivative Progress: 2101/2164 symbols completed. WLKP took 1.2s. Estimated remaining: 25.2s. Rate: 149.7 symbols/min [2025-10-24T00:57:57.254797] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:57.278170] [INFO ] [MAIN ] WLY: Generated 139 derivative records from 29962 primary records. [2025-10-24T00:57:57.279702] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-24T00:57:57.284212] [FATAL] [LOCAL ] WLY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:57.286387] [INFO ] [MAIN ] WM: Generated 139 derivative records from 51209 primary records. [2025-10-24T00:57:57.286625] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-24T00:57:57.286555] [FATAL] [MAIN ] WLY: Failed to save derivative data. [2025-10-24T00:57:57.289117] [INFO ] [MAIN ] Derivative Progress: 2102/2164 symbols completed. WLY took 1.2s. Estimated remaining: 24.8s. Rate: 149.8 symbols/min [2025-10-24T00:57:57.286847] [FATAL] [LOCAL ] WM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:57.289405] [FATAL] [MAIN ] WM: Failed to save derivative data. [2025-10-24T00:57:57.293227] [INFO ] [MAIN ] Derivative Progress: 2103/2164 symbols completed. WM took 1.2s. Estimated remaining: 24.4s. Rate: 149.9 symbols/min [2025-10-24T00:57:57.293379] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:57.293137] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:57.323921] [DEBUG] [LOCAL ] WMK: Loaded 14724 existing records from primary storage. [2025-10-24T00:57:57.324084] [INFO ] [MAIN ] WMK: Loaded 14724 primary data records. [2025-10-24T00:57:57.443582] [DEBUG] [LOCAL ] WMB: Loaded 54062 existing records from primary storage. [2025-10-24T00:57:57.456312] [INFO ] [MAIN ] WMB: Loaded 54062 primary data records. [2025-10-24T00:57:57.769879] [DEBUG] [LOCAL ] WMS: Loaded 39739 existing records from primary storage. [2025-10-24T00:57:57.786537] [INFO ] [MAIN ] WMS: Loaded 39739 primary data records. [2025-10-24T00:57:58.303718] [DEBUG] [MAIN ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:58.335322] [DEBUG] [MAIN ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:58.395373] [DEBUG] [MAIN ] WMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:58.421017] [INFO ] [MAIN ] WMK: Generated 139 derivative records from 14724 primary records. [2025-10-24T00:57:58.421319] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-24T00:57:58.421823] [FATAL] [LOCAL ] WMK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:58.423157] [FATAL] [MAIN ] WMK: Failed to save derivative data. [2025-10-24T00:57:58.427102] [INFO ] [MAIN ] Derivative Progress: 2104/2164 symbols completed. WMK took 1.1s. Estimated remaining: 24.0s. Rate: 149.7 symbols/min [2025-10-24T00:57:58.427560] [INFO ] [MAIN ] WMB: Generated 139 derivative records from 54062 primary records. [2025-10-24T00:57:58.427913] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:58.430774] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-24T00:57:58.431618] [FATAL] [LOCAL ] WMB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:58.432094] [FATAL] [MAIN ] WMB: Failed to save derivative data. [2025-10-24T00:57:58.435218] [INFO ] [MAIN ] Derivative Progress: 2105/2164 symbols completed. WMB took 1.2s. Estimated remaining: 23.6s. Rate: 149.8 symbols/min [2025-10-24T00:57:58.435766] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:58.451015] [INFO ] [MAIN ] WMS: Generated 139 derivative records from 39739 primary records. [2025-10-24T00:57:58.451183] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-24T00:57:58.451450] [FATAL] [LOCAL ] WMS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:58.451548] [FATAL] [MAIN ] WMS: Failed to save derivative data. [2025-10-24T00:57:58.454360] [INFO ] [MAIN ] Derivative Progress: 2106/2164 symbols completed. WMS took 1.2s. Estimated remaining: 23.2s. Rate: 149.9 symbols/min [2025-10-24T00:57:58.454806] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:58.496094] [DEBUG] [LOCAL ] WNC: Loaded 38303 existing records from primary storage. [2025-10-24T00:57:58.496622] [INFO ] [MAIN ] WNC: Loaded 38303 primary data records. [2025-10-24T00:57:58.630507] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-24T00:57:58.641866] [INFO ] [MAIN ] WMT: Loaded 54190 primary data records. [2025-10-24T00:57:58.917450] [DEBUG] [LOCAL ] WOLF: Loaded 53356 existing records from primary storage. [2025-10-24T00:57:58.963425] [INFO ] [MAIN ] WOLF: Loaded 53356 primary data records. [2025-10-24T00:57:59.525998] [DEBUG] [MAIN ] WNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:59.583581] [DEBUG] [MAIN ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:59.584773] [DEBUG] [MAIN ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:57:59.659547] [INFO ] [MAIN ] WNC: Generated 139 derivative records from 38303 primary records. [2025-10-24T00:57:59.663331] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-24T00:57:59.668593] [FATAL] [LOCAL ] WNC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:59.669400] [FATAL] [MAIN ] WNC: Failed to save derivative data. [2025-10-24T00:57:59.671586] [INFO ] [MAIN ] Derivative Progress: 2107/2164 symbols completed. WNC took 1.2s. Estimated remaining: 22.8s. Rate: 149.7 symbols/min [2025-10-24T00:57:59.672207] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:59.687134] [INFO ] [MAIN ] WMT: Generated 139 derivative records from 54190 primary records. [2025-10-24T00:57:59.688910] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-24T00:57:59.689621] [FATAL] [LOCAL ] WMT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:59.690041] [FATAL] [MAIN ] WMT: Failed to save derivative data. [2025-10-24T00:57:59.695511] [INFO ] [MAIN ] Derivative Progress: 2108/2164 symbols completed. WMT took 1.3s. Estimated remaining: 22.4s. Rate: 149.8 symbols/min [2025-10-24T00:57:59.696230] [INFO ] [MAIN ] WOLF: Generated 139 derivative records from 53356 primary records. [2025-10-24T00:57:59.702481] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:59.696593] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-24T00:57:59.703620] [FATAL] [LOCAL ] WOLF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:57:59.703784] [FATAL] [MAIN ] WOLF: Failed to save derivative data. [2025-10-24T00:57:59.706611] [INFO ] [MAIN ] Derivative Progress: 2109/2164 symbols completed. WOLF took 1.3s. Estimated remaining: 22.0s. Rate: 149.9 symbols/min [2025-10-24T00:57:59.706987] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:57:59.718881] [DEBUG] [LOCAL ] WOR: Loaded 23641 existing records from primary storage. [2025-10-24T00:57:59.719241] [INFO ] [MAIN ] WOR: Loaded 23641 primary data records. [2025-10-24T00:58:00.042910] [DEBUG] [LOCAL ] WOW: Loaded 31346 existing records from primary storage. [2025-10-24T00:58:00.043328] [INFO ] [MAIN ] WOW: Loaded 31346 primary data records. [2025-10-24T00:58:00.180192] [DEBUG] [LOCAL ] WPC: Loaded 48471 existing records from primary storage. [2025-10-24T00:58:00.180501] [INFO ] [MAIN ] WPC: Loaded 48471 primary data records. [2025-10-24T00:58:00.781784] [DEBUG] [MAIN ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:00.837263] [DEBUG] [MAIN ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:00.868740] [DEBUG] [MAIN ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:00.884166] [INFO ] [MAIN ] WOR: Generated 139 derivative records from 23641 primary records. [2025-10-24T00:58:00.890371] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-24T00:58:00.890998] [FATAL] [LOCAL ] WOR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:00.893632] [FATAL] [MAIN ] WOR: Failed to save derivative data. [2025-10-24T00:58:00.899602] [INFO ] [MAIN ] Derivative Progress: 2110/2164 symbols completed. WOR took 1.2s. Estimated remaining: 21.6s. Rate: 149.7 symbols/min [2025-10-24T00:58:00.900220] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:00.927225] [INFO ] [MAIN ] WOW: Generated 139 derivative records from 31346 primary records. [2025-10-24T00:58:00.930587] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-24T00:58:00.930970] [FATAL] [LOCAL ] WOW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:00.932128] [FATAL] [MAIN ] WOW: Failed to save derivative data. [2025-10-24T00:58:00.934762] [INFO ] [MAIN ] Derivative Progress: 2111/2164 symbols completed. WOW took 1.2s. Estimated remaining: 21.2s. Rate: 149.8 symbols/min [2025-10-24T00:58:00.935539] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:00.938117] [INFO ] [MAIN ] WPC: Generated 139 derivative records from 48471 primary records. [2025-10-24T00:58:00.938430] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-24T00:58:00.939231] [FATAL] [LOCAL ] WPC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:00.939632] [FATAL] [MAIN ] WPC: Failed to save derivative data. [2025-10-24T00:58:00.956784] [INFO ] [MAIN ] Derivative Progress: 2112/2164 symbols completed. WPC took 1.2s. Estimated remaining: 20.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:00.959877] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:00.988803] [DEBUG] [LOCAL ] WPM: Loaded 53176 existing records from primary storage. [2025-10-24T00:58:00.989261] [INFO ] [MAIN ] WPM: Loaded 53176 primary data records. [2025-10-24T00:58:01.097616] [DEBUG] [LOCAL ] WPP: Loaded 34564 existing records from primary storage. [2025-10-24T00:58:01.122026] [INFO ] [MAIN ] WPP: Loaded 34564 primary data records. [2025-10-24T00:58:01.473305] [DEBUG] [LOCAL ] WRB: Loaded 51176 existing records from primary storage. [2025-10-24T00:58:01.511719] [INFO ] [MAIN ] WRB: Loaded 51176 primary data records. [2025-10-24T00:58:02.057571] [DEBUG] [MAIN ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:02.095637] [DEBUG] [MAIN ] WPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:02.164604] [DEBUG] [MAIN ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:02.194125] [INFO ] [MAIN ] WPM: Generated 139 derivative records from 53176 primary records. [2025-10-24T00:58:02.200790] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-24T00:58:02.205355] [FATAL] [LOCAL ] WPM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:02.206172] [FATAL] [MAIN ] WPM: Failed to save derivative data. [2025-10-24T00:58:02.209030] [INFO ] [MAIN ] Derivative Progress: 2113/2164 symbols completed. WPM took 1.3s. Estimated remaining: 20.4s. Rate: 149.7 symbols/min [2025-10-24T00:58:02.223430] [INFO ] [MAIN ] WPP: Generated 139 derivative records from 34564 primary records. [2025-10-24T00:58:02.226617] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-24T00:58:02.228481] [FATAL] [LOCAL ] WPP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:02.228780] [FATAL] [MAIN ] WPP: Failed to save derivative data. [2025-10-24T00:58:02.232156] [INFO ] [MAIN ] Derivative Progress: 2114/2164 symbols completed. WPP took 1.3s. Estimated remaining: 20.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:02.237744] [INFO ] [MAIN ] WRB: Generated 139 derivative records from 51176 primary records. [2025-10-24T00:58:02.237974] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-24T00:58:02.238199] [FATAL] [LOCAL ] WRB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:02.238282] [FATAL] [MAIN ] WRB: Failed to save derivative data. [2025-10-24T00:58:02.241257] [INFO ] [MAIN ] Derivative Progress: 2115/2164 symbols completed. WRB took 1.3s. Estimated remaining: 19.6s. Rate: 149.8 symbols/min [2025-10-24T00:58:02.242388] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:02.242272] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:02.242123] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:02.291864] [DEBUG] [LOCAL ] WS: Loaded 23638 existing records from primary storage. [2025-10-24T00:58:02.302449] [INFO ] [MAIN ] WS: Loaded 23638 primary data records. [2025-10-24T00:58:02.436751] [DEBUG] [LOCAL ] WSM: Loaded 49047 existing records from primary storage. [2025-10-24T00:58:02.448687] [DEBUG] [LOCAL ] WRBY: Loaded 51034 existing records from primary storage. [2025-10-24T00:58:02.492423] [INFO ] [MAIN ] WSM: Loaded 49047 primary data records. [2025-10-24T00:58:02.614009] [INFO ] [MAIN ] WRBY: Loaded 51034 primary data records. [2025-10-24T00:58:03.314469] [DEBUG] [MAIN ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:03.361259] [DEBUG] [MAIN ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:03.405952] [DEBUG] [MAIN ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:03.432561] [INFO ] [MAIN ] WS: Generated 139 derivative records from 23638 primary records. [2025-10-24T00:58:03.435330] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-24T00:58:03.435987] [FATAL] [LOCAL ] WS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:03.436428] [FATAL] [MAIN ] WS: Failed to save derivative data. [2025-10-24T00:58:03.440606] [INFO ] [MAIN ] Derivative Progress: 2116/2164 symbols completed. WS took 1.2s. Estimated remaining: 19.2s. Rate: 149.7 symbols/min [2025-10-24T00:58:03.442673] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:03.455186] [INFO ] [MAIN ] WSM: Generated 139 derivative records from 49047 primary records. [2025-10-24T00:58:03.458884] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-24T00:58:03.459278] [FATAL] [LOCAL ] WSM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:03.460008] [FATAL] [MAIN ] WSM: Failed to save derivative data. [2025-10-24T00:58:03.462562] [INFO ] [MAIN ] Derivative Progress: 2117/2164 symbols completed. WSM took 1.2s. Estimated remaining: 18.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:03.463070] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:03.480003] [INFO ] [MAIN ] WRBY: Generated 139 derivative records from 51034 primary records. [2025-10-24T00:58:03.480274] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-24T00:58:03.480546] [FATAL] [LOCAL ] WRBY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:03.480632] [FATAL] [MAIN ] WRBY: Failed to save derivative data. [2025-10-24T00:58:03.483513] [INFO ] [MAIN ] Derivative Progress: 2118/2164 symbols completed. WRBY took 1.2s. Estimated remaining: 18.4s. Rate: 149.8 symbols/min [2025-10-24T00:58:03.491278] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:03.497774] [DEBUG] [LOCAL ] WSO: Loaded 26088 existing records from primary storage. [2025-10-24T00:58:03.497991] [INFO ] [MAIN ] WSO: Loaded 26088 primary data records. [2025-10-24T00:58:03.588310] [DEBUG] [LOCAL ] WSR: Loaded 22684 existing records from primary storage. [2025-10-24T00:58:03.610930] [INFO ] [MAIN ] WSR: Loaded 22684 primary data records. [2025-10-24T00:58:04.004430] [DEBUG] [LOCAL ] WST: Loaded 37059 existing records from primary storage. [2025-10-24T00:58:04.004884] [INFO ] [MAIN ] WST: Loaded 37059 primary data records. [2025-10-24T00:58:04.456933] [DEBUG] [MAIN ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:04.490850] [DEBUG] [MAIN ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:04.554588] [DEBUG] [MAIN ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:04.577689] [INFO ] [MAIN ] WSR: Generated 139 derivative records from 22684 primary records. [2025-10-24T00:58:04.580004] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-24T00:58:04.580435] [FATAL] [LOCAL ] WSR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:04.579908] [INFO ] [MAIN ] WSO: Generated 139 derivative records from 26088 primary records. [2025-10-24T00:58:04.580816] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-24T00:58:04.580726] [FATAL] [MAIN ] WSR: Failed to save derivative data. [2025-10-24T00:58:04.583362] [INFO ] [MAIN ] Derivative Progress: 2119/2164 symbols completed. WSR took 1.1s. Estimated remaining: 18.0s. Rate: 149.7 symbols/min [2025-10-24T00:58:04.583750] [FATAL] [LOCAL ] WSO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:04.584043] [FATAL] [MAIN ] WSO: Failed to save derivative data. [2025-10-24T00:58:04.583929] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:04.588731] [INFO ] [MAIN ] Derivative Progress: 2120/2164 symbols completed. WSO took 1.1s. Estimated remaining: 17.6s. Rate: 149.8 symbols/min [2025-10-24T00:58:04.589967] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:04.605513] [INFO ] [MAIN ] WST: Generated 139 derivative records from 37059 primary records. [2025-10-24T00:58:04.605811] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-24T00:58:04.606045] [FATAL] [LOCAL ] WST: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:04.606126] [FATAL] [MAIN ] WST: Failed to save derivative data. [2025-10-24T00:58:04.609018] [INFO ] [MAIN ] Derivative Progress: 2121/2164 symbols completed. WST took 1.1s. Estimated remaining: 17.2s. Rate: 149.8 symbols/min [2025-10-24T00:58:04.609229] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:04.677499] [DEBUG] [LOCAL ] WTI: Loaded 45096 existing records from primary storage. [2025-10-24T00:58:04.678729] [INFO ] [MAIN ] WTI: Loaded 45096 primary data records. [2025-10-24T00:58:04.679505] [DEBUG] [LOCAL ] WT: Loaded 48552 existing records from primary storage. [2025-10-24T00:58:04.710865] [INFO ] [MAIN ] WT: Loaded 48552 primary data records. [2025-10-24T00:58:04.867314] [DEBUG] [LOCAL ] WTRG: Loaded 51295 existing records from primary storage. [2025-10-24T00:58:04.911825] [INFO ] [MAIN ] WTRG: Loaded 51295 primary data records. [2025-10-24T00:58:05.674444] [DEBUG] [MAIN ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:05.705288] [DEBUG] [MAIN ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:05.747782] [DEBUG] [MAIN ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:05.784703] [INFO ] [MAIN ] WTI: Generated 139 derivative records from 45096 primary records. [2025-10-24T00:58:05.788863] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-24T00:58:05.789440] [FATAL] [LOCAL ] WTI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:05.790376] [FATAL] [MAIN ] WTI: Failed to save derivative data. [2025-10-24T00:58:05.794589] [INFO ] [MAIN ] Derivative Progress: 2122/2164 symbols completed. WTI took 1.2s. Estimated remaining: 16.8s. Rate: 149.7 symbols/min [2025-10-24T00:58:05.796338] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:05.799124] [INFO ] [MAIN ] WT: Generated 139 derivative records from 48552 primary records. [2025-10-24T00:58:05.799503] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-24T00:58:05.803400] [FATAL] [LOCAL ] WT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:05.803883] [FATAL] [MAIN ] WT: Failed to save derivative data. [2025-10-24T00:58:05.806697] [INFO ] [MAIN ] Derivative Progress: 2123/2164 symbols completed. WT took 1.2s. Estimated remaining: 16.4s. Rate: 149.8 symbols/min [2025-10-24T00:58:05.806886] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:05.819450] [INFO ] [MAIN ] WTRG: Generated 139 derivative records from 51295 primary records. [2025-10-24T00:58:05.819700] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-24T00:58:05.819927] [FATAL] [LOCAL ] WTRG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:05.820061] [FATAL] [MAIN ] WTRG: Failed to save derivative data. [2025-10-24T00:58:05.823157] [INFO ] [MAIN ] Derivative Progress: 2124/2164 symbols completed. WTRG took 1.2s. Estimated remaining: 16.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:05.823497] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:05.830830] [DEBUG] [LOCAL ] WTS: Loaded 17345 existing records from primary storage. [2025-10-24T00:58:05.830992] [INFO ] [MAIN ] WTS: Loaded 17345 primary data records. [2025-10-24T00:58:06.173554] [DEBUG] [LOCAL ] WTTR: Loaded 44859 existing records from primary storage. [2025-10-24T00:58:06.174163] [INFO ] [MAIN ] WTTR: Loaded 44859 primary data records. [2025-10-24T00:58:06.303589] [DEBUG] [LOCAL ] WU: Loaded 53877 existing records from primary storage. [2025-10-24T00:58:06.314757] [INFO ] [MAIN ] WU: Loaded 53877 primary data records. [2025-10-24T00:58:06.831877] [DEBUG] [MAIN ] WTS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:58:06.890830] [DEBUG] [MAIN ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:06.909708] [INFO ] [MAIN ] WTS: Generated 139 derivative records from 17345 primary records. [2025-10-24T00:58:06.910432] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-24T00:58:06.910832] [FATAL] [LOCAL ] WTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:06.911055] [FATAL] [MAIN ] WTS: Failed to save derivative data. [2025-10-24T00:58:06.913099] [INFO ] [MAIN ] Derivative Progress: 2125/2164 symbols completed. WTS took 1.1s. Estimated remaining: 15.6s. Rate: 149.7 symbols/min [2025-10-24T00:58:06.926669] [DEBUG] [MAIN ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:06.926794] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:06.997551] [INFO ] [MAIN ] WTTR: Generated 139 derivative records from 44859 primary records. [2025-10-24T00:58:06.998089] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-24T00:58:07.000712] [FATAL] [LOCAL ] WTTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:07.000363] [INFO ] [MAIN ] WU: Generated 139 derivative records from 53877 primary records. [2025-10-24T00:58:07.000811] [FATAL] [MAIN ] WTTR: Failed to save derivative data. [2025-10-24T00:58:07.002820] [INFO ] [MAIN ] Derivative Progress: 2126/2164 symbols completed. WTTR took 1.2s. Estimated remaining: 15.2s. Rate: 149.8 symbols/min [2025-10-24T00:58:07.003872] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:07.003052] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-24T00:58:07.004881] [FATAL] [LOCAL ] WU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:07.018080] [FATAL] [MAIN ] WU: Failed to save derivative data. [2025-10-24T00:58:07.022755] [INFO ] [MAIN ] Derivative Progress: 2127/2164 symbols completed. WU took 1.2s. Estimated remaining: 14.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:07.023015] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:07.025965] [DEBUG] [LOCAL ] WWW: Loaded 49577 existing records from primary storage. [2025-10-24T00:58:07.026391] [INFO ] [MAIN ] WWW: Loaded 49577 primary data records. [2025-10-24T00:58:07.377710] [DEBUG] [LOCAL ] XFLT: Loaded 30116 existing records from primary storage. [2025-10-24T00:58:07.378141] [INFO ] [MAIN ] XFLT: Loaded 30116 primary data records. [2025-10-24T00:58:07.490498] [DEBUG] [LOCAL ] WY: Loaded 53597 existing records from primary storage. [2025-10-24T00:58:07.507741] [INFO ] [MAIN ] WY: Loaded 53597 primary data records. [2025-10-24T00:58:08.038149] [DEBUG] [MAIN ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:08.073940] [DEBUG] [MAIN ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:08.118314] [DEBUG] [MAIN ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:08.158167] [INFO ] [MAIN ] WWW: Generated 139 derivative records from 49577 primary records. [2025-10-24T00:58:08.164072] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-24T00:58:08.164888] [FATAL] [LOCAL ] WWW: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:08.165176] [FATAL] [MAIN ] WWW: Failed to save derivative data. [2025-10-24T00:58:08.170710] [INFO ] [MAIN ] Derivative Progress: 2128/2164 symbols completed. WWW took 1.2s. Estimated remaining: 14.4s. Rate: 149.7 symbols/min [2025-10-24T00:58:08.178779] [INFO ] [MAIN ] XFLT: Generated 139 derivative records from 30116 primary records. [2025-10-24T00:58:08.181312] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-24T00:58:08.181936] [FATAL] [LOCAL ] XFLT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:08.182028] [FATAL] [MAIN ] XFLT: Failed to save derivative data. [2025-10-24T00:58:08.184261] [INFO ] [MAIN ] Derivative Progress: 2129/2164 symbols completed. XFLT took 1.2s. Estimated remaining: 14.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:08.187411] [INFO ] [MAIN ] WY: Generated 139 derivative records from 53597 primary records. [2025-10-24T00:58:08.187776] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-24T00:58:08.187997] [FATAL] [LOCAL ] WY: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:08.188076] [FATAL] [MAIN ] WY: Failed to save derivative data. [2025-10-24T00:58:08.190840] [INFO ] [MAIN ] Derivative Progress: 2130/2164 symbols completed. WY took 1.2s. Estimated remaining: 13.6s. Rate: 149.8 symbols/min [2025-10-24T00:58:08.191272] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:08.191465] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:08.191381] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:08.233022] [DEBUG] [LOCAL ] XPER: Loaded 30878 existing records from primary storage. [2025-10-24T00:58:08.246920] [INFO ] [MAIN ] XPER: Loaded 30878 primary data records. [2025-10-24T00:58:08.377834] [DEBUG] [LOCAL ] XHR: Loaded 43601 existing records from primary storage. [2025-10-24T00:58:08.394994] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-24T00:58:08.400438] [INFO ] [MAIN ] XHR: Loaded 43601 primary data records. [2025-10-24T00:58:08.400565] [INFO ] [MAIN ] XOM: Loaded 54183 primary data records. [2025-10-24T00:58:09.235930] [DEBUG] [MAIN ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:09.281231] [DEBUG] [MAIN ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:09.326921] [INFO ] [MAIN ] XPER: Generated 139 derivative records from 30878 primary records. [2025-10-24T00:58:09.326500] [DEBUG] [MAIN ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:09.328534] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-24T00:58:09.345678] [FATAL] [LOCAL ] XPER: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:09.348594] [FATAL] [MAIN ] XPER: Failed to save derivative data. [2025-10-24T00:58:09.353863] [INFO ] [MAIN ] Derivative Progress: 2131/2164 symbols completed. XPER took 1.2s. Estimated remaining: 13.2s. Rate: 149.7 symbols/min [2025-10-24T00:58:09.354563] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:09.379570] [INFO ] [MAIN ] XOM: Generated 139 derivative records from 54183 primary records. [2025-10-24T00:58:09.381842] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-24T00:58:09.385281] [FATAL] [LOCAL ] XOM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:09.386796] [FATAL] [MAIN ] XOM: Failed to save derivative data. [2025-10-24T00:58:09.391426] [INFO ] [MAIN ] Derivative Progress: 2132/2164 symbols completed. XOM took 1.2s. Estimated remaining: 12.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:09.391766] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:09.396782] [INFO ] [MAIN ] XHR: Generated 139 derivative records from 43601 primary records. [2025-10-24T00:58:09.410972] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-24T00:58:09.411237] [FATAL] [LOCAL ] XHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:09.411343] [FATAL] [MAIN ] XHR: Failed to save derivative data. [2025-10-24T00:58:09.415967] [INFO ] [MAIN ] Derivative Progress: 2133/2164 symbols completed. XHR took 1.2s. Estimated remaining: 12.4s. Rate: 149.8 symbols/min [2025-10-24T00:58:09.416329] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:09.440223] [DEBUG] [LOCAL ] XPEV: Loaded 54006 existing records from primary storage. [2025-10-24T00:58:09.440636] [INFO ] [MAIN ] XPEV: Loaded 54006 primary data records. [2025-10-24T00:58:09.646521] [DEBUG] [LOCAL ] XPO: Loaded 47814 existing records from primary storage. [2025-10-24T00:58:09.670868] [INFO ] [MAIN ] XPO: Loaded 47814 primary data records. [2025-10-24T00:58:09.671800] [DEBUG] [LOCAL ] XPOF: Loaded 37137 existing records from primary storage. [2025-10-24T00:58:09.802760] [INFO ] [MAIN ] XPOF: Loaded 37137 primary data records. [2025-10-24T00:58:10.433023] [DEBUG] [MAIN ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:10.499486] [DEBUG] [MAIN ] XPO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:58:10.502768] [DEBUG] [MAIN ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:10.534586] [INFO ] [MAIN ] XPEV: Generated 139 derivative records from 54006 primary records. [2025-10-24T00:58:10.537691] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-24T00:58:10.539301] [FATAL] [LOCAL ] XPEV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:10.540458] [FATAL] [MAIN ] XPEV: Failed to save derivative data. [2025-10-24T00:58:10.543240] [INFO ] [MAIN ] Derivative Progress: 2134/2164 symbols completed. XPEV took 1.2s. Estimated remaining: 12.0s. Rate: 149.7 symbols/min [2025-10-24T00:58:10.543580] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:10.574175] [INFO ] [MAIN ] XPO: Generated 139 derivative records from 47814 primary records. [2025-10-24T00:58:10.587458] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-24T00:58:10.589292] [FATAL] [LOCAL ] XPO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:10.589446] [FATAL] [MAIN ] XPO: Failed to save derivative data. [2025-10-24T00:58:10.591852] [INFO ] [MAIN ] Derivative Progress: 2135/2164 symbols completed. XPO took 1.2s. Estimated remaining: 11.6s. Rate: 149.8 symbols/min [2025-10-24T00:58:10.592082] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:10.594720] [INFO ] [MAIN ] XPOF: Generated 139 derivative records from 37137 primary records. [2025-10-24T00:58:10.594814] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-24T00:58:10.595020] [FATAL] [LOCAL ] XPOF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:10.595101] [FATAL] [MAIN ] XPOF: Failed to save derivative data. [2025-10-24T00:58:10.597433] [INFO ] [MAIN ] Derivative Progress: 2136/2164 symbols completed. XPOF took 1.2s. Estimated remaining: 11.2s. Rate: 149.8 symbols/min [2025-10-24T00:58:10.597766] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:10.614227] [DEBUG] [LOCAL ] XPRO: Loaded 46174 existing records from primary storage. [2025-10-24T00:58:10.614737] [INFO ] [MAIN ] XPRO: Loaded 46174 primary data records. [2025-10-24T00:58:10.777015] [DEBUG] [LOCAL ] XYF: Loaded 27493 existing records from primary storage. [2025-10-24T00:58:10.810853] [INFO ] [MAIN ] XYF: Loaded 27493 primary data records. [2025-10-24T00:58:11.063687] [DEBUG] [LOCAL ] XYL: Loaded 47890 existing records from primary storage. [2025-10-24T00:58:11.075015] [INFO ] [MAIN ] XYL: Loaded 47890 primary data records. [2025-10-24T00:58:11.600332] [DEBUG] [MAIN ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:11.635101] [DEBUG] [MAIN ] XYF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:58:11.683704] [DEBUG] [MAIN ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:11.716935] [INFO ] [MAIN ] XPRO: Generated 139 derivative records from 46174 primary records. [2025-10-24T00:58:11.717477] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-24T00:58:11.717755] [FATAL] [LOCAL ] XPRO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:11.720152] [FATAL] [MAIN ] XPRO: Failed to save derivative data. [2025-10-24T00:58:11.722362] [INFO ] [MAIN ] Derivative Progress: 2137/2164 symbols completed. XPRO took 1.2s. Estimated remaining: 10.8s. Rate: 149.7 symbols/min [2025-10-24T00:58:11.722974] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:11.725922] [INFO ] [MAIN ] XYF: Generated 139 derivative records from 27493 primary records. [2025-10-24T00:58:11.726502] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-24T00:58:11.727150] [FATAL] [LOCAL ] XYF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:11.727239] [FATAL] [MAIN ] XYF: Failed to save derivative data. [2025-10-24T00:58:11.729910] [INFO ] [MAIN ] Derivative Progress: 2138/2164 symbols completed. XYF took 1.1s. Estimated remaining: 10.4s. Rate: 149.8 symbols/min [2025-10-24T00:58:11.732864] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:11.741360] [INFO ] [MAIN ] XYL: Generated 139 derivative records from 47890 primary records. [2025-10-24T00:58:11.741602] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-24T00:58:11.742036] [FATAL] [LOCAL ] XYL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:11.742153] [FATAL] [MAIN ] XYL: Failed to save derivative data. [2025-10-24T00:58:11.746053] [INFO ] [MAIN ] Derivative Progress: 2139/2164 symbols completed. XYL took 1.1s. Estimated remaining: 10.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:11.746490] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:11.773846] [DEBUG] [LOCAL ] YALA: Loaded 36512 existing records from primary storage. [2025-10-24T00:58:11.782821] [INFO ] [MAIN ] YALA: Loaded 36512 primary data records. [2025-10-24T00:58:11.938308] [DEBUG] [LOCAL ] YELP: Loaded 45479 existing records from primary storage. [2025-10-24T00:58:11.959804] [INFO ] [MAIN ] YELP: Loaded 45479 primary data records. [2025-10-24T00:58:12.192617] [DEBUG] [LOCAL ] YETI: Loaded 52897 existing records from primary storage. [2025-10-24T00:58:12.215014] [INFO ] [MAIN ] YETI: Loaded 52897 primary data records. [2025-10-24T00:58:12.739274] [DEBUG] [MAIN ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:12.778992] [DEBUG] [MAIN ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:12.831717] [DEBUG] [MAIN ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:12.831313] [INFO ] [MAIN ] YALA: Generated 139 derivative records from 36512 primary records. [2025-10-24T00:58:12.843229] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-24T00:58:12.850127] [FATAL] [LOCAL ] YALA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:12.852141] [FATAL] [MAIN ] YALA: Failed to save derivative data. [2025-10-24T00:58:12.857117] [INFO ] [MAIN ] Derivative Progress: 2140/2164 symbols completed. YALA took 1.1s. Estimated remaining: 9.6s. Rate: 149.7 symbols/min [2025-10-24T00:58:12.859816] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:12.872701] [INFO ] [MAIN ] YELP: Generated 139 derivative records from 45479 primary records. [2025-10-24T00:58:12.875055] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-24T00:58:12.875465] [FATAL] [LOCAL ] YELP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:12.875586] [FATAL] [MAIN ] YELP: Failed to save derivative data. [2025-10-24T00:58:12.877946] [INFO ] [MAIN ] Derivative Progress: 2141/2164 symbols completed. YELP took 1.1s. Estimated remaining: 9.2s. Rate: 149.8 symbols/min [2025-10-24T00:58:12.878172] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:12.885088] [INFO ] [MAIN ] YETI: Generated 139 derivative records from 52897 primary records. [2025-10-24T00:58:12.895100] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-24T00:58:12.895362] [FATAL] [LOCAL ] YETI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:12.895440] [FATAL] [MAIN ] YETI: Failed to save derivative data. [2025-10-24T00:58:12.899028] [INFO ] [MAIN ] Derivative Progress: 2142/2164 symbols completed. YETI took 1.2s. Estimated remaining: 8.8s. Rate: 149.9 symbols/min [2025-10-24T00:58:12.899265] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:12.916912] [DEBUG] [LOCAL ] YEXT: Loaded 43337 existing records from primary storage. [2025-10-24T00:58:12.917170] [INFO ] [MAIN ] YEXT: Loaded 43337 primary data records. [2025-10-24T00:58:13.275840] [DEBUG] [LOCAL ] YMM: Loaded 52966 existing records from primary storage. [2025-10-24T00:58:13.288479] [INFO ] [MAIN ] YMM: Loaded 52966 primary data records. [2025-10-24T00:58:13.322456] [DEBUG] [LOCAL ] YOU: Loaded 49826 existing records from primary storage. [2025-10-24T00:58:13.322956] [INFO ] [MAIN ] YOU: Loaded 49826 primary data records. [2025-10-24T00:58:13.929045] [DEBUG] [MAIN ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:13.975105] [DEBUG] [MAIN ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:14.002747] [DEBUG] [MAIN ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:14.042274] [INFO ] [MAIN ] YEXT: Generated 139 derivative records from 43337 primary records. [2025-10-24T00:58:14.045583] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-24T00:58:14.048340] [FATAL] [LOCAL ] YEXT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:14.049561] [FATAL] [MAIN ] YEXT: Failed to save derivative data. [2025-10-24T00:58:14.051940] [INFO ] [MAIN ] Derivative Progress: 2143/2164 symbols completed. YEXT took 1.2s. Estimated remaining: 8.4s. Rate: 149.7 symbols/min [2025-10-24T00:58:14.075283] [INFO ] [MAIN ] YMM: Generated 139 derivative records from 52966 primary records. [2025-10-24T00:58:14.076731] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-24T00:58:14.077147] [FATAL] [LOCAL ] YMM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:14.079282] [FATAL] [MAIN ] YMM: Failed to save derivative data. [2025-10-24T00:58:14.079584] [INFO ] [MAIN ] YOU: Generated 139 derivative records from 49826 primary records. [2025-10-24T00:58:14.081849] [INFO ] [MAIN ] Derivative Progress: 2144/2164 symbols completed. YMM took 1.2s. Estimated remaining: 8.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:14.082248] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-24T00:58:14.082679] [FATAL] [LOCAL ] YOU: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:14.082765] [FATAL] [MAIN ] YOU: Failed to save derivative data. [2025-10-24T00:58:14.085546] [INFO ] [MAIN ] Derivative Progress: 2145/2164 symbols completed. YOU took 1.2s. Estimated remaining: 7.6s. Rate: 149.9 symbols/min [2025-10-24T00:58:14.086131] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:14.086028] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:14.085943] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:14.110724] [DEBUG] [LOCAL ] YRD: Loaded 11205 existing records from primary storage. [2025-10-24T00:58:14.110983] [INFO ] [MAIN ] YRD: Loaded 11205 primary data records. [2025-10-24T00:58:14.256027] [DEBUG] [LOCAL ] YSG: Loaded 25773 existing records from primary storage. [2025-10-24T00:58:14.299187] [INFO ] [MAIN ] YSG: Loaded 25773 primary data records. [2025-10-24T00:58:14.481944] [DEBUG] [LOCAL ] YPF: Loaded 51139 existing records from primary storage. [2025-10-24T00:58:14.499440] [INFO ] [MAIN ] YPF: Loaded 51139 primary data records. [2025-10-24T00:58:15.136914] [DEBUG] [MAIN ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:15.178084] [DEBUG] [MAIN ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:15.213255] [DEBUG] [MAIN ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:15.246045] [INFO ] [MAIN ] YRD: Generated 139 derivative records from 11205 primary records. [2025-10-24T00:58:15.251097] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-24T00:58:15.251500] [FATAL] [LOCAL ] YRD: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:15.251638] [FATAL] [MAIN ] YRD: Failed to save derivative data. [2025-10-24T00:58:15.255083] [INFO ] [MAIN ] Derivative Progress: 2146/2164 symbols completed. YRD took 1.2s. Estimated remaining: 7.2s. Rate: 149.7 symbols/min [2025-10-24T00:58:15.255327] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:15.277578] [INFO ] [MAIN ] YSG: Generated 139 derivative records from 25773 primary records. [2025-10-24T00:58:15.281255] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-24T00:58:15.281629] [INFO ] [MAIN ] YPF: Generated 139 derivative records from 51139 primary records. [2025-10-24T00:58:15.281972] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-24T00:58:15.281915] [FATAL] [LOCAL ] YSG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:15.282299] [FATAL] [MAIN ] YSG: Failed to save derivative data. [2025-10-24T00:58:15.284543] [INFO ] [MAIN ] Derivative Progress: 2147/2164 symbols completed. YSG took 1.2s. Estimated remaining: 6.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:15.282174] [FATAL] [LOCAL ] YPF: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:15.284873] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:15.285107] [FATAL] [MAIN ] YPF: Failed to save derivative data. [2025-10-24T00:58:15.288359] [INFO ] [MAIN ] Derivative Progress: 2148/2164 symbols completed. YPF took 1.2s. Estimated remaining: 6.4s. Rate: 149.9 symbols/min [2025-10-24T00:58:15.288732] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:15.328940] [DEBUG] [LOCAL ] YUM: Loaded 51489 existing records from primary storage. [2025-10-24T00:58:15.329259] [INFO ] [MAIN ] YUM: Loaded 51489 primary data records. [2025-10-24T00:58:15.549454] [DEBUG] [LOCAL ] ZBH: Loaded 51035 existing records from primary storage. [2025-10-24T00:58:15.684940] [DEBUG] [LOCAL ] YUMC: Loaded 52963 existing records from primary storage. [2025-10-24T00:58:15.685946] [INFO ] [MAIN ] ZBH: Loaded 51035 primary data records. [2025-10-24T00:58:15.685849] [INFO ] [MAIN ] YUMC: Loaded 52963 primary data records. [2025-10-24T00:58:16.300890] [DEBUG] [MAIN ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:16.342045] [DEBUG] [MAIN ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:16.385585] [DEBUG] [MAIN ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:16.428214] [INFO ] [MAIN ] YUM: Generated 139 derivative records from 51489 primary records. [2025-10-24T00:58:16.433914] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-24T00:58:16.438313] [FATAL] [LOCAL ] YUM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:16.442464] [FATAL] [MAIN ] YUM: Failed to save derivative data. [2025-10-24T00:58:16.445720] [INFO ] [MAIN ] Derivative Progress: 2149/2164 symbols completed. YUM took 1.2s. Estimated remaining: 6.0s. Rate: 149.7 symbols/min [2025-10-24T00:58:16.449459] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:16.450222] [INFO ] [MAIN ] ZBH: Generated 139 derivative records from 51035 primary records. [2025-10-24T00:58:16.451071] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-24T00:58:16.451414] [FATAL] [LOCAL ] ZBH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:16.451512] [FATAL] [MAIN ] ZBH: Failed to save derivative data. [2025-10-24T00:58:16.454018] [INFO ] [MAIN ] Derivative Progress: 2150/2164 symbols completed. ZBH took 1.2s. Estimated remaining: 5.6s. Rate: 149.8 symbols/min [2025-10-24T00:58:16.457550] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:16.462164] [INFO ] [MAIN ] YUMC: Generated 139 derivative records from 52963 primary records. [2025-10-24T00:58:16.462410] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-24T00:58:16.462693] [FATAL] [LOCAL ] YUMC: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:16.468049] [FATAL] [MAIN ] YUMC: Failed to save derivative data. [2025-10-24T00:58:16.472024] [INFO ] [MAIN ] Derivative Progress: 2151/2164 symbols completed. YUMC took 1.2s. Estimated remaining: 5.2s. Rate: 149.9 symbols/min [2025-10-24T00:58:16.472278] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:16.482574] [DEBUG] [LOCAL ] ZEPP: Loaded 19786 existing records from primary storage. [2025-10-24T00:58:16.482776] [INFO ] [MAIN ] ZEPP: Loaded 19786 primary data records. [2025-10-24T00:58:16.826230] [DEBUG] [LOCAL ] ZETA: Loaded 54008 existing records from primary storage. [2025-10-24T00:58:16.826751] [INFO ] [MAIN ] ZETA: Loaded 54008 primary data records. [2025-10-24T00:58:16.946361] [DEBUG] [LOCAL ] ZGN: Loaded 41195 existing records from primary storage. [2025-10-24T00:58:16.946754] [INFO ] [MAIN ] ZGN: Loaded 41195 primary data records. [2025-10-24T00:58:17.495377] [DEBUG] [MAIN ] ZEPP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-24T00:58:17.547216] [DEBUG] [MAIN ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:17.581905] [DEBUG] [MAIN ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:17.581474] [INFO ] [MAIN ] ZEPP: Generated 139 derivative records from 19786 primary records. [2025-10-24T00:58:17.583362] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-24T00:58:17.583949] [FATAL] [LOCAL ] ZEPP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:17.599982] [FATAL] [MAIN ] ZEPP: Failed to save derivative data. [2025-10-24T00:58:17.604046] [INFO ] [MAIN ] Derivative Progress: 2152/2164 symbols completed. ZEPP took 1.2s. Estimated remaining: 4.8s. Rate: 149.7 symbols/min [2025-10-24T00:58:17.604469] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:17.646570] [INFO ] [MAIN ] ZETA: Generated 139 derivative records from 54008 primary records. [2025-10-24T00:58:17.648135] [DEBUG] [LOCAL ] ZH: Loaded 24766 existing records from primary storage. [2025-10-24T00:58:17.648275] [INFO ] [MAIN ] ZH: Loaded 24766 primary data records. [2025-10-24T00:58:17.646921] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-24T00:58:17.681861] [FATAL] [LOCAL ] ZETA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:17.706444] [FATAL] [MAIN ] ZETA: Failed to save derivative data. [2025-10-24T00:58:17.717461] [INFO ] [MAIN ] Derivative Progress: 2153/2164 symbols completed. ZETA took 1.3s. Estimated remaining: 4.4s. Rate: 149.8 symbols/min [2025-10-24T00:58:17.717722] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:17.762347] [INFO ] [MAIN ] ZGN: Generated 139 derivative records from 41195 primary records. [2025-10-24T00:58:17.778885] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-24T00:58:17.802844] [FATAL] [LOCAL ] ZGN: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:17.812015] [FATAL] [MAIN ] ZGN: Failed to save derivative data. [2025-10-24T00:58:17.851614] [INFO ] [MAIN ] Derivative Progress: 2154/2164 symbols completed. ZGN took 1.4s. Estimated remaining: 4.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:17.967226] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:17.997340] [DEBUG] [MAIN ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:18.065318] [DEBUG] [LOCAL ] ZIM: Loaded 53836 existing records from primary storage. [2025-10-24T00:58:18.068399] [INFO ] [MAIN ] ZIM: Loaded 53836 primary data records. [2025-10-24T00:58:18.084290] [DEBUG] [LOCAL ] ZIP: Loaded 43737 existing records from primary storage. [2025-10-24T00:58:18.103504] [INFO ] [MAIN ] ZIP: Loaded 43737 primary data records. [2025-10-24T00:58:18.103417] [INFO ] [MAIN ] ZH: Generated 139 derivative records from 24766 primary records. [2025-10-24T00:58:18.157366] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-24T00:58:18.212982] [FATAL] [LOCAL ] ZH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:18.218767] [FATAL] [MAIN ] ZH: Failed to save derivative data. [2025-10-24T00:58:18.238691] [INFO ] [MAIN ] Derivative Progress: 2155/2164 symbols completed. ZH took 0.6s. Estimated remaining: 3.6s. Rate: 149.8 symbols/min [2025-10-24T00:58:18.260726] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:18.723559] [DEBUG] [LOCAL ] ZK: Loaded 39272 existing records from primary storage. [2025-10-24T00:58:18.725567] [INFO ] [MAIN ] ZK: Loaded 39272 primary data records. [2025-10-24T00:58:19.072959] [DEBUG] [MAIN ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:19.132728] [DEBUG] [MAIN ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:19.187481] [INFO ] [MAIN ] ZIM: Generated 139 derivative records from 53836 primary records. [2025-10-24T00:58:19.187870] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-24T00:58:19.201465] [FATAL] [LOCAL ] ZIM: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:19.202034] [FATAL] [MAIN ] ZIM: Failed to save derivative data. [2025-10-24T00:58:19.204402] [INFO ] [MAIN ] Derivative Progress: 2156/2164 symbols completed. ZIM took 1.5s. Estimated remaining: 3.2s. Rate: 149.7 symbols/min [2025-10-24T00:58:19.201936] [DEBUG] [MAIN ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:19.204682] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:19.235412] [DEBUG] [LOCAL ] ZKH: Loaded 7354 existing records from primary storage. [2025-10-24T00:58:19.238620] [INFO ] [MAIN ] ZKH: Loaded 7354 primary data records. [2025-10-24T00:58:19.254899] [INFO ] [MAIN ] ZIP: Generated 139 derivative records from 43737 primary records. [2025-10-24T00:58:19.280423] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-24T00:58:19.282081] [FATAL] [LOCAL ] ZIP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:19.300738] [FATAL] [MAIN ] ZIP: Failed to save derivative data. [2025-10-24T00:58:19.324936] [INFO ] [MAIN ] Derivative Progress: 2157/2164 symbols completed. ZIP took 1.4s. Estimated remaining: 2.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:19.338053] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:19.448729] [INFO ] [MAIN ] ZK: Generated 139 derivative records from 39272 primary records. [2025-10-24T00:58:19.454063] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-24T00:58:19.454553] [FATAL] [LOCAL ] ZK: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:19.454775] [FATAL] [MAIN ] ZK: Failed to save derivative data. [2025-10-24T00:58:19.583698] [INFO ] [MAIN ] Derivative Progress: 2158/2164 symbols completed. ZK took 1.3s. Estimated remaining: 2.4s. Rate: 149.8 symbols/min [2025-10-24T00:58:19.620818] [DEBUG] [LOCAL ] ZTO: Loaded 49634 existing records from primary storage. [2025-10-24T00:58:19.621349] [INFO ] [MAIN ] ZTO: Loaded 49634 primary data records. [2025-10-24T00:58:19.768116] [DEBUG] [MAIN ] ZKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:19.991968] [INFO ] [MAIN ] ZKH: Generated 139 derivative records from 7354 primary records. [2025-10-24T00:58:19.992519] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-24T00:58:19.992856] [FATAL] [LOCAL ] ZKH: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:19.992962] [FATAL] [MAIN ] ZKH: Failed to save derivative data. [2025-10-24T00:58:19.996570] [INFO ] [MAIN ] Derivative Progress: 2159/2164 symbols completed. ZKH took 0.8s. Estimated remaining: 2.0s. Rate: 149.8 symbols/min [2025-10-24T00:58:20.013683] [DEBUG] [MAIN ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:20.040124] [INFO ] [MAIN ] ZTO: Generated 139 derivative records from 49634 primary records. [2025-10-24T00:58:20.040254] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-24T00:58:20.040453] [FATAL] [LOCAL ] ZTO: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:20.040535] [FATAL] [MAIN ] ZTO: Failed to save derivative data. [2025-10-24T00:58:20.043464] [INFO ] [MAIN ] Derivative Progress: 2160/2164 symbols completed. ZTO took 0.7s. Estimated remaining: 1.6s. Rate: 149.9 symbols/min [2025-10-24T00:58:20.044202] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:20.044061] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:20.044293] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:20.079411] [DEBUG] [LOCAL ] ZTR: Loaded 16659 existing records from primary storage. [2025-10-24T00:58:20.079689] [INFO ] [MAIN ] ZTR: Loaded 16659 primary data records. [2025-10-24T00:58:20.178019] [DEBUG] [LOCAL ] ZVIA: Loaded 36071 existing records from primary storage. [2025-10-24T00:58:20.194420] [INFO ] [MAIN ] ZVIA: Loaded 36071 primary data records. [2025-10-24T00:58:20.420497] [DEBUG] [LOCAL ] ZTS: Loaded 53500 existing records from primary storage. [2025-10-24T00:58:20.572990] [INFO ] [MAIN ] ZTS: Loaded 53500 primary data records. [2025-10-24T00:58:21.099379] [DEBUG] [MAIN ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:21.131675] [DEBUG] [MAIN ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:21.248545] [DEBUG] [MAIN ] ZTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:21.279069] [INFO ] [MAIN ] ZTR: Generated 139 derivative records from 16659 primary records. [2025-10-24T00:58:21.287747] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-24T00:58:21.288369] [FATAL] [LOCAL ] ZTR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:21.292767] [FATAL] [MAIN ] ZTR: Failed to save derivative data. [2025-10-24T00:58:21.298693] [INFO ] [MAIN ] Derivative Progress: 2161/2164 symbols completed. ZTR took 1.3s. Estimated remaining: 1.2s. Rate: 149.7 symbols/min [2025-10-24T00:58:21.303002] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-24T00:58:21.303704] [INFO ] [MAIN ] ZVIA: Generated 139 derivative records from 36071 primary records. [2025-10-24T00:58:21.303930] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-24T00:58:21.304260] [FATAL] [LOCAL ] ZVIA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:21.304814] [FATAL] [MAIN ] ZVIA: Failed to save derivative data. [2025-10-24T00:58:21.310464] [INFO ] [MAIN ] Derivative Progress: 2162/2164 symbols completed. ZVIA took 1.3s. Estimated remaining: 0.8s. Rate: 149.8 symbols/min [2025-10-24T00:58:21.317811] [INFO ] [MAIN ] ZTS: Generated 139 derivative records from 53500 primary records. [2025-10-24T00:58:21.318259] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-24T00:58:21.318511] [FATAL] [LOCAL ] ZTS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:21.318609] [FATAL] [MAIN ] ZTS: Failed to save derivative data. [2025-10-24T00:58:21.321277] [INFO ] [MAIN ] Derivative Progress: 2163/2164 symbols completed. ZTS took 1.3s. Estimated remaining: 0.4s. Rate: 149.9 symbols/min [2025-10-24T00:58:21.350214] [DEBUG] [LOCAL ] ZWS: Loaded 42439 existing records from primary storage. [2025-10-24T00:58:21.350409] [INFO ] [MAIN ] ZWS: Loaded 42439 primary data records. [2025-10-24T00:58:21.687352] [DEBUG] [MAIN ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-24T00:58:21.721816] [INFO ] [MAIN ] ZWS: Generated 139 derivative records from 42439 primary records. [2025-10-24T00:58:21.722013] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-24T00:58:21.722227] [FATAL] [LOCAL ] ZWS: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-24T00:58:21.722304] [FATAL] [MAIN ] ZWS: Failed to save derivative data. [2025-10-24T00:58:21.724332] [INFO ] [MAIN ] Derivative Progress: 2164/2164 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 149.9 symbols/min [2025-10-24T00:58:21.725272] [INFO ] [MAIN ] Parallel derivative generation completed in 14m 26s [2025-10-24T00:58:21.725500] [WARN ] [MAIN ] Failed symbols (2164): AAMI, A, AA, AAP, AB, AAT, ABCB, ABM, ABR, ACA... [2025-10-24T00:58:21.725608] [INFO ] [MAIN ] Derivative generation success rate: 0.0% (0/2164 symbols) [2025-10-24T00:58:23.877387] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (0/2164 @ 0.00%)' [2025-10-24T00:58:23.878025] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-24T00:58:23.878334] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-24T00:58:23.878507] [INFO ] [STATE ] Last completion updated: 2025-10-24T00:58:23.878410